There could be many reasons for this, as you've mentioned...stress, diet, etc. But, he should absolutely be taken to a vet to be checked out so that you may ensure he is in good health and to begin the 30 day quarantine process. Him being on a poor diet to start with and this added stress is enough on a little guy already.
It also seems that you do not feed a research approved diet?
Did the vet give you a cause of death for your little Daisy?
Good luck, get him some good care right away.