This paper proposes a new approach to study generation mechanism and influence factors of cogging torque of permanent magnet synchronous motors, in order to improve the operational performance and riding comfort of electric vehicle. Based on energy method and Fourier expansion, the method of predicting cogging torque is proposed. Two-dimensional finite element model of in-wheel motor is established by Maxwell software, and electromagnetic character of that is analyzed. Skew slot, pole arc coefficient and width of slot mouth are analyzed and studied by finite element method, in order to realize the change regularity of cogging torque. Cogging torque curves under the different skew slots, the different pole arc coefficients and the different widths of slot mouth are obtained, which can effectively reduce the cogging torque of in-wheel motor, but they still exists some limitations. The final simulation analysis results are in good agreement with the theoretical predicting results, which indicates that this method can be used to afford a theoretical basis to reduce the cogging torque and optimize the in-wheel motor of electric vehicle in the future.