It isn't nice but if he is good looking then a woman might say what a waste as in now I cant get him. A waste to womankind because the men get the good looking guy.
Sorry, not a very good explanation!
They say it because they are bigoted, pompous idiots who give the implication that in some way the individual in question has redeeming qualities, but is wasteful on the grounds of differing sexual orientation.