The fact that you noticed at all means that you are definitely experiencing paranoia. Reddit karma are worthless, and lemmy points are even less useful. Either engage or don't, stop caring about the votes.
I could see an argument where "paranoia made you check your posts/comments or you wouldn't have noticed"
But I've also noticed stuff like that simple because when I reply to a comment, I see the votes and notice there's always a weird single down vote on almost everything.
So while I don't think you are paranoid, I do see how one could try to argue that point.
You asked if you were being paranoid and I answered and gave my reasoning. What part of my comments were unkind? Just because it's not the answer you wanted?