Localization is very important for the autonomous navigation of Unmanned Ground Vehicles; however, it is difficult that they have a precise Inertial Navigation System(INS) sensor, especially Small Unmanned Ground Vehicle(SUGV). Moreover, there are some condition such as denial of global position system(GPS), GPS/INS integrated system is not robust. This paper proposes the estimation algorithm with optical flow sensor and INS. Being compared with previous researches, the proposed algorithm is suitable for skid steering vehicles. We revised the measurement model of previous research for the accuracy of side direction position. Experimental results were performed to verify the algorithm, and the result showed an excellent performance.