Was I wrong to break up with him?

I still care about my boyfriend a lot but I broke up with him last night because I cannot deal with his baby mama drama. And I've dealt with baby mama drama in past relationships but this girl is over the top. I know she is not over him and she would always use the baby as an excuse to get what she wants. And when he refused, she threatened him that she will file for full custody and he won't be able to see the baby anymore. He's not a citizen so he cannot contest it. It's hard enough that I cannot see him often (baby mama doesn't let me near the child) but I felt like I just reached my boiling point. I miss him so much but it's just such a messed up situation. I'm so sad.