There's an old movie based on that idea called The Crazy Ray. The small group of people that are the only ones not frozen in time eventually get tired of being by themselves and they get lonely. It would be cool for a little while, but it would grow old pretty quickly.