I want to leave my daughter's father, but im obsessed with him

My daughter's father and I been together for almost 7 years at first we used to get a long and our families too, but a year ago his mother and I had more than one arguments (her judging my ways, and wanted me to do it her way when it comes to parenting my daughter) we had some mean word's and she told me I wasn't welcome in her house my bf of course took his mom side. Well it's been 4months and he hasn't had a job so I been paying for everything including his needs and wants and a month ago mom and I got into it again so he move to his mom but of course I went and beg him to come back so lately his been such a jack a$$ treating me to move out if I pretty much don't do what he says or if we argue and not just that it's been many times we're he tells me that I cam be replaced in a day or how he doesn't care if im the only one paying for all the bills that's what he has me for.. etc.. the list goes on, my dad told me to leave him but im too blind his friends and cousin tells me that I baby him and his a jack a$$ or lazy!! He never wants to go out with me or with my family his always hurting my feelings and he never makes time for me his always playing games and I really wanna leave him but everytime I try I cry and beg him to stay I really need help I don't wana loose him but I don't wanna feel like shit and leaving this way I feel lonely and like I lost my identity I feel low as a mother and person