Gmorning,
I would definately start using a bonding bag during the day with him again, and get him neutered if necessary and a cage mate. I'd imagine he is very lonely
Stop trying to get him out of the cage when he's already awake, your just making it harder on yourself and him.
Secure/glider proof your bathroom, close toilet lid, any gaps above or below the door make sure they are filled you can use a towel. Check under counter tops for any holes, make sure the drawers are all closed, put anything that can be knocked over in a basket somewhere and do play time in the secure bathroom.
Take the glider out of the cage while he is still in his sleeping pouch. Bring snacks, and a pouch to transport him back to his cage. I wouldn't advise letting him free roam your house, play time should be in a small enough space that he has to interact with you and get to know you.