I know how you feel. In the area I live in, everyone stares at the joggers like there some sort of rare endangered species. Puts me off when I run.
When I try to run sprints (For HITT) in a field, a group of kids run into the field with a couple adults (probably for some day care thing) and the adults are staring and whispering at me. There like
"psst drugs psst irresponsible teenager psst stay away from the children"
And I'm like I just want to do sprints. After doing 4 100m sprints, I highly doubt I will have the energy to cause "trouble".
Also, there was these group of kids watching me do pull ups at a play structure. It was extremely unsettling and I left after doing two pull ups.