A self-organizing network is designed to estimate parameters of normal mixtures. SOMN achieves fast convergence and low possibility of divergence even when sample sizes are small, while PMLE eliminate unnecessary components. The proposed network effectively combines the good properties of SOMN and PMLE. Simulation verifies that the proposed network eliminates unnecessary components in normal mixtures when sample sizes are relatively small.