Yes. Like if I'm reading a book in a library I find a spot where no one can see me. But with the nature thing, it's pretty bad because they might be talking really loud and you just want to enjoy the sounds of nature.
It does take away from the atmosphere, similar to going to a quiet place to study, and than several obnoxious people enter the room. I agree with you 100%