I see your distinction.
However, I think if a man maims or kills his ex for wanting to leave him, then has three more relationships where he exhibits no behaviours in a similar vein, I would be inclined to agree with your distinction.
But to my eyes men who inflict domestic violence are misogynists, plain and simple, though it may not fit academic notions of misogyny. Of course YMMV.