Stop doing whatever it is that he is complaining about. If he wants it done a certain way, then let him do it himself!
Maybe it's not you "taking it the wrong way", it's him "saying it the wrong way". Some people fail to realize that there is a fine line between constructive criticism and complaining.
I bet he's the type of guy who only notices what you do, when you DON'T do it.