Well quite. You know as well as I do it's down to society, but I suppose that's why you're saying it. My understanding is that 'coloured' was used in a derogatory way before and that's why it's deemed offensive. That seems fair enough to some extent but then it's not fair to criticise someone who's genuinely not in the know and where there was zero offence meant.
At the end of the day I won't shout about it because I haven't been persecuted in any way growing up, whereas some people have had horrendous treatment through no fault of their own. But I certainly see both sides of the argument here, choosing the correct term is somewhat of a minefield...
If only that were so, it is actually down to one very vocal section of society, just like revisionism the good old white middle class liberal and of course if you disagree with them then you are racist.