It is also so obvious when it happens as you suddenly have your last 50 posts with one lone downvote. I seriously get a big kick out of it, especially when visualizing the person doing it who is likely thinking "I'll show him."
Honestly downvoting in general is pretty damn cringe IMO unless it's to a post for giving a low effort insult. Like "I disagree with what you said, better downvote it" is just reddit level lame and seems pretty ghey to me. Upvote the good, downvote the horrid. But 99.9% of posts are in between.
Yeah it happens.
The only people on this site that care about "goodboy points" are the ones who feel the need to take them from you.
They're only really used to make interesting posts visible to more people. And the cucks that downvote people can't take points away from posts anyway.