Thanks for posting your query at DoctorSpring.com
Please relax, the anxiety is natural for a first time mom - to - be.
You did not handle the cat litter, that is important.
Handling cat litter exposes a pregnant woman to the risk of toxoplasmosis.
You just shifted the box, and that does not carry any risk.
Please do not worry.
Just to reassure yourself, get Toxoplasmosis antibody test done 4 weeks afterwards.
All the best
Please feel free to discuss further.