Trying to get rid of fat on upper arms?

I have the fattest, flabbiest upper arms and I'm so self conscious wearing dresses and tank tops.

People always say, "Oh, well then do these arm exercises with weights and stuff!"

But I don't want to build muscle! I want to slim down my arms. So does that mean I should just lose weight overall?
 
Top