I think downvotes give core users of a community a chance to slow down low-relevance posts, and reposts, which might otherwise hit the main page and get upvoted by people who don't really look at the community name. So, I like them for that reason. In other circumstances they're a bit of a net neutral option compared to simply not upvoting.