So essentially I am either forced to pay to evict him or I'm stuck supporting him for as long as he wants to stay there.
I provided you ONLY with your LEGAL options.
Yes, they are somewhat limited.
Just so you know, after the notice period has expired, and refuses to vacate, you then file formally with the court.
If that is successful, it will often take anywhere from eight to ten weeks, before a judge orders him gone.
Then another week to 10 days before the deputies come to move him and his junk to the curb.
This is why I never allow anyone to stay overnight in my home, no one.
If I like a relative, I will pay for their hotel stay for a few days.
There are other things that can happen to shorten the removal time.
Some people pay these bums for the keys and to leave earlier.
They get the terms in writing, and they pay after the person has left.
The amounts vary, but I hear $500 can get some to leave.
If he commits domestic violence against you or your child, the police can arrest him.
You can then get a restraining order, and he is effectively evicted by his own stupidity.
Good luck.