Of course it's not ok for any such term to be reserved for use by one group of people, or for one group of people to set the rules of usage. That's simple discrimination, a petty tyranny.
Those that have decided that it is ok are either very, very stupid, highly hypocritical or playing a rather deep joke on the majority of society. You decide.