Isn't it punishment enough that your VP from that vote is lost?
No because it unfairly allows you to increase your vote if a post is popular, that is why it is important the vote time is adjusted to the latest vote. Under latest hard fork the vote time is less critical, but still important after the first 24 hours.
Something I assumed would only be logical anyway and thought was what happened. 😅