I like my SUV's mostly because i can see over the vehicle in front of me, unless it's another SUV.
I have a Suburban, which is very big, and a Wrangler, which is very small. I like them both but for different things. The Wrangler probably better for a first car the Suburban can be hard to park. My brother SWEARS by his Toyota Land Cruiser.
SUV's are more susceptible to rollover if you swerve suddenly. And gas mileage can be a drawback.
A pickup might be a good choice for you.