Yeah...that'll happen. Smoking ups your metabolism, so when you quit, you will naturally gain weight. It may not seem like a fair trade, but quitting smoking was a good idea. As for exercise (I am no expert), do exercises that keep your metabolism up, like cardio and stuff like that, so it'll act like the cigarettes did only in a healthy way.
Hope this helps!