A 4th baby

I’ve got 3 children already and really wanting a 4th.
Me and my partner have been together almost 11 years and he really doesn’t want another one and makes it known that when he met me he only wanted 1 baby to start with (and we now have 3). Im starting to think that he is a very selfish person. He does provide for his children and help me put financially but physically he doesn’t do much with the children anyways, it’s all me that looks after the children.

He has told me if I fall pregnant again he will leave me and try guilt trip me into saying that the other children will miss out on a father because of my own selfishness of wanting one more.

Has anyone been in this situation before and what did you do.