I know we have many satellites that orbit Earth and probes that move out from the Earth toward other planets and comets, but do we have any that are just orbiting the sun?
Yes, there are lot's of artificial satellites orbiting the Sun, They range from spent rocket boosters, various probes (both active and inactive) and full fledged observatories. The most notable is the SOHO observatory.