I switched to Brave a while ago, it wasn’t until recent versions it was even possible. Pre-Chromium version wasn’t nearly as good
Extension permissions are tough because you don’t have the granularity your need.
For example my Chrome extension needs permissions to see all sites even though all it does is look at the url and applies a regex if it is one of any of the known front ends.