The stabilization control of inverted pendulum (IP) system is difficult because of its nonlinearity and structural unstability. In this paper, an Evolving Neural Network Controller (ENNC) without Error Back Propagation (EBP) is presented. An ENNC is described simply by genetic representation using an encoding strategy for types and slope values of each active functions, biases, weights and so on. By an evolutionary programming which has three genetic operation; selection, crossover and mutation, the predetermine controller is optimally evolved by updating simultaneously the connection patterns and weights of the neural networks. The performances of the proposed ENNC(PENNC)are compared with the one of conventional optimal controller and the conventional evolving neural network controller (CENNC) through the simulation and experimental results. And we showed that the finally optimized PENNC was very useful in the stabilization control of an IP system.