You're going to court no matter what.
He can absolutely adopt your son. But in doing so, you and bio-Dad will both be strangers to the child.
If you mean a step-parent adoption, there must be an actual step-parent involved.
It would behoove you - for the sake of your child - not to keep...