He is not involved right now but has said he wants 50 50 custody. He says things but hasn't acted yet.
If/When he actually gets off his duff and files then you can "worry". A judge will likely give him shared legal (decision making) and visitation which will likely be supervised until the child gets to know him.
Keep in mind that your child having a relationship with his Dad is a good thing...you want to facilitate this relationship.