I'd rather go to the Cape
I like the beach
Ptown is really nice, lots of fun
perhaps take a whale watch cruise, go to Coast Guard Beach in Eastham (excellent beach BTW) Hit the shops in many of the towns down there, go to Woods Hole in Falmouth, go to the wildlife refuge in Welfleet
Maybe go to the islands for a day
If you like sports, there is the Cape Cod Summer Baseball league. Over half of it's players make it to the Big Leagues
Vermont has it's things too
hiking in the mountains
Ben and Jerry's
Burlington is supposed to be really cool, and Vermont has a lake monster (actually, I think it is just a population of rather large sturgeon - a kind of really big fish)
Given my choice, I'd pick the Cape