I think some of your decrease may be due to other people tweaking their votes, mine dropped 2-3% recently and I've changed very little!
I guess there is the possibility that as the larger accounts grow more rapidly, the curation returns of middling accounts get reduced also.