Because it's stereotype. Well think about it, most bi and gay guys are not into masculine things and are more effeminate... sorry but it is mostly true, not always.
People like to put down people who aren't exactly like themselves.. it makes them feel better for how big of failures they are either at work home or in their relationships.
I wouldn't worry about it.
People are stupid.