Thank you for your query at DoctorSpring.com.
The mechanism of action of clomiphene to increase Testosterone levels, also may lead to these side effects that you are experiencing. Not due to estrogen.
However, in your case, it will be better if Testosterone replacement is given, unless your sperm counts require treatment and you contemplate having children in near future. Testorenone supplementation will not have such side effects.
Also, further tests such as LH, FSH, Prolactin; are required to know the cause of your low Testosterone.
I hope this was helpful. Let me know if you have any further queries.