Those with weaker reputations are unable to harm the reputation of those with strong reputation.
That partially make sense...
But what if many of lower reputation accounts downvote a higher reputation account? It make sense for example if 10 or more accounts of reputation of 7 votes against an account of reputation of (8) ... it should make an impact! No?