A player on Big Brother said that both her parents ran track and so she was "literally born on the track". Unless your mother went into labour on the track and gave birth right there, you were not literally born on the track!
You said this makes you "irrationally angry" and then went on to explain a rationale behind why it makes you angry. I just want to note that's pretty much the same misuse of a term as the one you're complaining about.
They can have rational reasons for their anger but be aware of the fact that they needn't be quite as angry as they are, that the extent of their anger is irrational. The two things are unrelated.