Thanks for posting your query at DoctorSpring.com
These side effects mean that you are not suited for progesterone only birth control.
Taking estrogen supplements alone will not suffice to act as proper birth control.
IT is best to switchover to combined birth control.
You may try the combined pill or the combined contraceptive patch or implant.
That might ameliorate these symptoms to a great extent.
All the best.
Please feel free to discuss further.