Other than being cold and lethargic, are there any other weird behaviors? How warm is the room his cage is located in?
In November I had a cage of gliders that we're always cold. The coldness caused the Joey's to be lethargic. I would take them and warm them up in my bra before returning them to thier parents. Soon I figured out it was because thier room was cold. Once I moved them to a warmer room they were fine.
I'm no expert or vet, but I think you'll be fine as long as he's eating, drinking, and not showing any other signs of sickness. Just to be safe you should still take him to the vet on Monday. In the meantime try and keep him warm and monitor his eating and drinking.
I wish you the best. :)