Are the lights on when you'r trying to get him out of the cage? neither of mine are social unless the room is very very dark. If it's to bright they either freeze or go back in the pouch.
Did you get him neutered yet? Getting him neutered may help with his attitude as well. Being intact He will be posturing for the Dominant position of the colony (which includes you ).
If he was bonded to the other family it is like taking him away from a colony of gliders. When they bond with humans they are accepting the human as part of their colony. So he maybe a little depressed or missing his human colony, it will take some time to bond with you.
Because he has history with other humans he probably won't bond the same way your first one did. My female bonded rather quickly with me, but we had to do things differently when we got Simon. He just wasn't responding to the same methods that we used with my female.
Do you actually know the other family that had him before? They may not have spent as much time with him that they said they did. So he may need to "re learn" how to be social. Let Toothless teach Hiccup ( love the names btw lol ) Offer treats to Toothless first so Hiccup can see that Toothless trusts you and that your hands aren't threats. Then offer Hiccup a treat... they will learn from each other and follow the lead of the more confident glider.
My Leela has taught Simon to take treats and to forage for his own snacks in the cage. I use easter eggs for foraging treats, she taught him to pop them open to get to the snacks. I found it much easier to let Leela show him rather than me trying to force things.
Be patient and good luck !!