however we need someone who will be actively checking (random number) 1 out of 5 translation reviews
You don't. You need the translators to check 1 or of 1 of the comments they get. And to use the existing ticketing system to report issues on a per-problem basis. If specific moderators are a consistent problem, we want to know.