Objective: We investigated whether serum testosterone to estradiol ratio was decreased in infertile men and whether this condition can be corrected with oral aromatase inhibitor. Method: The serum testosterone to estradiol ratio of 26 men with testicular failure were compared with those of normal semen analysis parameter, 89 control reference group. All of 26 testicular failure group were diagnosed with the previous testicular biopsy. Then 46 men with oligospermia and/or asthenospermia were selected and treated with 1 mg of the aromatase inhibitor anastrozole ($Arimidex^{(R)}$) orally once daily for 3 months. Testosterone to estradiol ratio and semen analyses were evaluated during anastrozole therapy. Results: The testosterone level of testicular failure group was significantly lower and the testosterone to estradiol ratio was more decreased than normal semen parameter group. Forty six on-anastrozole group had significantly lower testosterone (4.6 versus 5.7 ng/ml, p<0.01) and higher estradiol (15.9 versus 23.4 pg/ml, p<0.01) than pre-anastrozole group, resulting in a decreased testosterone to estradiol ratio ($0.21{pm}0.07$ versus $0.39{pm}0.15$, p<0.01). Semen analyses before and during anastrozole treatment revealed significant increases in sperm count (35.5 versus 52.2 million sperm per ml, p<0.01) and motility (22.9% versus 29.3%, p<0.01). Conclusions: We identified infertile men with testicular failure had hormonal changes characterized by a decreased serum testosterone to estradiol ratio. The ratio can be corrected with aromatase inhibitor, resulting in a significant improvement in semen parameters.