Custody Battle Over Baby Who Hasn't Been Born Yet

Hello, I (28f) am pregnant with my first child. The father (34m) and I are no longer together. I live in Vermont. He has threatened to take full custody of our baby once it is born. He claims I am an unfit mother (even though I haven't even gotten to be a mother yet). I have no addictions, I have a home, I have a full time job working with traumatized youth, and I have a car that I lease. I have never been charged with a crime and I have no history of abuse. His only argument is that I'm toxic to him. He hasn't had a job in over a year, is considered homeless (he lives with his mother) and doesn't own his own vehicle (his mom does). He is absolutely convinced he will win this custody battle. He has been very mean to me in the past and he has me terrified he is going to take our baby. He hasn't been here for any of my pregnancy or helped me with anything at all. What are the chances of a judge acually giving him full custody? What do I need to prove I am no where close to an unfit mother? I have offered to be reasonable and co parent, but he won't budge.