The hemming process, composed of flanging, pre-hemming and main hemming, is the last one of a series of forming processes conducted on the automotive panels, having greater influence on the outward appearance of cars rather than on their performance. The hem quality can be quantitatively defined by the hemming defects including turn-down/up, warp and roll-in/out. However, it is difficult to evaluate and predict the hem quality through an experimental measurement or a numerical calculation since the size of defects is very small. This study aims to precisely evaluate the hemming defects, especially turn-down and roll-in, through numerical and experimental approaches and to investigate the influence of process parameters on the hem quality, focused on how to simulate the same conditions as in the experiment by the finite element analysis (FEA). The FEA results on the turn-down and roll-in obtained from a model composed of the optimum-sized elements, including a spring element linked to the flanging pad, and given the double master contact condition between the inner and outer panels, had a good correlation with the experimental data. It is thought possible to make an early estimate of the hem quality in a practical automotive design by applying the methodology proposed in this study.