But then again, we all have anonymous usernames, which can be different over several account.... if you care about privacy that much.
I don't mind if cellar dwellers knows my username or e-mail, I get so much spam either way.
Oh, and regarding upvoting/downvoting, it's only a bad thing if the admins actually would care and then start to sell user information like any other big corporation does.