"And my dick fucks your wife more than you do. What's your point?"

don't. make a "oh poor guy" face and move on. he wants you to engage, to be angry, if you don't he will be mad