I think you are missing the point. If you take offence then of course it matters and it's gone too far.
This is a very difficult topic and one that people can easily be flippant about especially if they have not been a victim of pernicious racism. Imagine walking down the street and being spat on for no good reason other than they don't like your colour or religion. Imagine being told to f off back to your own country especially when you were born here and this is your home. Imagine your kids coming home wishing they could change their skin colour, their national origins or religion because kids have been laughing at them for it. There is no banter here, no jokes. it makes people sensitive and scared so they see issues that others might not. Cut them some slack.
In the main it's not just the words themselves but the way those words are said and how the group they are directed at feel about their identity. Most Scots I know feel ok about a bit of banter around Highland kisses and being tight fisted. Most Irish however get uptight if you tell bomber jokes for obvious reasons and Muslims are same if you make reference to terrorists.
There is so much hatred out there between ethnic and religious groups I just think
@scaramanga should take more care with his words.