Black, white, olive, brown, fair, ginger, brunette, grey, tall, short, thin, fat, handsome, pretty, ugly, old, young - all just descriptions.
I think that it's only when you automatically associate negativeness with any of those attributes that there is an issue.