Various crystal defects such as voids, inclusions dislocations, stacking faults and precipitates were observed in the Czochralski-grown Bi12GeO20 crystals. Particularly, precipitates were found in the whole crystals. The phase of these precipitates was identified as Bi4Ge3O12 by EPMA and transmission electron microscopy. The precipitates were produced by pulling rapidly from a non-stoichiometric charge. During the pulling of Bi12GeO20 crystals, the melt composition of stoichiometric charge was changed Bi-deficent with gradual volatilization of Bi2O3. Precipition of the second phase may have been affected by an abrube thermal stress. By adding excess Bi2O3 into the stoichiometric batch, the precipitation of Bi4Ge3O12 was suppressed. At a pulling speed of 2 mm/hr, clear and precipitate from crystals of Bi12GeO20 were grown from the melt of the Bi2O3 excess charge.