You can find clear, plastic jewelry at places like HotTopic.
If you're using fishing wire it could slip out. I have a nose piercing, and I've never tried it before, so I don't know that from experience. That's why I got clear jewelry so I know it'll stay in.