A new scheme to estimate the moment of inertia in the servo motor drive system in very low speed is proposed in this paper. The typical speed estimation scheme in most servo system for low speed operation is sensitive to the variation of machine parameters, especially the moment of inertia. To estimate the motor inertia value, the observer using the Radial Basis Function Networks(RBFN) is applied. The effectiveness of the proposed inertia estimation method is verified by experiments. It is concluded that the speed control performance in the low speed region is improved with the proposed disturbance observer using RBFN.