I'm not yet banded, but I feel your pain. I was married to someone I didn't truely love because of family pressure. I'm the first in my family to have ever been divorced, and PROUD of it. I married a man who turned out to be an incredible father, he was neither abusive or drunk or anything like that, we were just not ment for each other. I had to leave for my sanity. I decided that struggling with money and being alone was better than the loveless relationship I was in.
Part of my journey in life has been to do the right thing for me--leaving my husband, explaining it to my child and family. Becoming financially stable and yes, loving myself and taking control!
If he is a good father now, he will be a good father later. My ex husband is still the best father I have ever met! I'm not saying leaving your husband is the answer, but you need to speak to him and maybe a therapist too.
LOTS OF HUGS!