The accuracy of face recognition used unmanned security system is very important and necessary. However, face recognition is a lot of restriction due to the change of distortion of face image, illumination, face size, face expression, round image. We propose a hybrid neural network for improve the performance of the face recognition. The proposed method is consisted of SOM and LVQ. In order to verify usefulness of the proposed method, we make a comparison between eigenface method, hidden Markov model method, multi-layer neural network.