Is it wrong for me to leave my drug addict husband?

Well I am I suppose considered a newly wed. My husband and I have been married a lil over a year, and we date for a yr before we got married. When I met him we were just friends. I was a courier he worked the shipping and recieving dock at a warehouse. When we first started hanging out I had lost my b/f about 1month and a half before.
I had no intentions of falling in love with anyone, I didnt think it was possible at the time with my grieving process. Well I guess you could say I accidently fell in love with my husband. So we started dating and moved in with one another after 4 short months of dating. Shortly after I became preg. When I was about 4 months preg I then found out that my husband had a drug problem. No one cared to tell me nor did he! But I loved him too much to leave him for that reason knowing there was help for him. An at the time was under the impression it was his first time ever doin crack cocain.

Well he had asked me to marry him on christmas of 05.  Me being so in love I said yes!  He then went on another binge and took off for 2 days.  I didnt know what to think.  Long story short hes does this several times in just the short period of time we've been together and now that we are married and have a family, when I tell him im going to leave he gets mad.  Then tells me that he has to apporve of where I go with his daughter.  But I really dont want him to know where I go if I do leave.  So I am stuck here what should I do.  I have 2 kids and a drug adict husband would it be wrong of me to leave him?  
Does he have a right to know where I am or who Im staying with just b/c we have a child together?