I've had lots of babies so from what I've seen the males will attack the females and eat her baby's so she will mate faster.
i would remove them if you have more than 2 if your worried.
They do go back into the pouch tho the bump is super easy to see if there that big