The accuracy of a real facial recognition system can be varied according to the accuracy of the eye detection algorithm when we design and implement a semi-automatic facial recognition algorithm depending on the eye position of a database. In this paper, a fully automatic facial recognition algorithm is proposed such that Gabor and LBP features are extracted from fiducial points of a face graph which was created by using fiducial points based on the eyes, nose, mouth and border lines of a face, fitted on the face image. In this algorithm, the recognition performance could be increased because a face graph can be fitted on a face image automatically and fiducial points based LPB features are implemented with the basic Gabor features. The simulation results show that the proposed algorithm can be used in real-time recognition for more than 1,000 faces and produce good recognition performance for each data set.