Hello dear!
I would first recommend purchasing more toys, pouches, and other such materials for Sugar Gliders ASAP. More variety will help him not get bored, and you can swap out pouches and such when dirty.
Second, do you have a food plan for him? What are you feeding him?
Third, where is he in your house and what cage is he in?
Fourthly. Continue to be around him, continue to pet him if he will let you. Let him out in your bathroom or somewhere secure and small (shut the toilet lid so he doesn't drown!!) to play in the evening with you!
If he was already bonded to his previous owners, complete trust will take time. so the biggest piece of advice I can give you is PATIENCE. BE. PATIENT.
As for that, keep him with you as much as possible, whether sleeping in a pouch around your neck, or a hood, or pocket, or sleeve. He will bond best when WITH you. And he will NEED your company if he is alone.
You are doing very well thus far! Keep it up! I'm here to help if you need anything!