Ground state energy levels of the $Fe^{3+}$ paramagnetic impurity ion in stoichiometric $LiTaO_3$ and in congruent $LiTaO_3$ single crystals were calculated with electron paramagnetic resonance constants. Energy levels between six energy levels were obtained with spectroscopic splitting parameter g and zero field splitting constant D for $Fe^{3+}$ ion. The energy diagrams of $Fe^{3+}$ ion were different from different magnetic field directions ([100], [001], [111]) when magnetic field increases. The calculated ZFS energies of $Fe^{3+}$ ion in stoichiometric and congruent $LiTaO_3$ single crystals for ${mid}{pm}5/2$ > ${leftrightarrow}{mid}{pm}3/2$ > and ${mid}{pm}3/2$ > ${leftrightarrow}{mid}{pm}1/2$ > transitions were 12.300 GHz and 6.150 GHz, and 59.358 GHz and 29.679 GHz, respectively. It turns out that energy levels of $Fe^{3+}$ paramagnetic impurity in $LiTaO_3$ crystal are different from different crystal growing condition.