Women in the workplace love, love, love, to gossip, esp about ppl who are different to them, (you are young and american), i wouldnt worry, yes, they may find you interesting. The only important thing is to be polite, nice, dont be nasty, and dont start nasty gossip, do yr work, yr work is whats important.
Im sure they will get sick of it sooner or later and someone else will be their target.