It was pointed out that the terrain distortion of SAR image is even worse than that of optical image although SAR imagery has the advantages of being independent of solar illumination and weather conditions. It is thus necessary to correct terrain distortion in SAR image for various application areas to integrate SAR and optical image information. There has to be a clear evaluation of terrain correction of high resolution SAR image according to the quality of DEM because the DEM of study site is generally used in the process of terrain correction. To achieve this issue, this paper compared the effects of quality of Digital Elevation Model(DEM) in the process of terrain correction of high resolution SAR images, using the DEM produced from 1:5000 topographic contour maps, LiDAR DEM, ASTER GDEM, SRTM DEM. We used TerraSAR-X and Cosmo-SkyMed, as the test data set, which are constructed on the same X-band SAR system as KOMPSAT-5. In order to evaluate quantitatively the correction results, we conducted comparative evaluation with the KOMPSAT-2 ortho image of the same region. The evaluation results showed that the DEM produced from 1:5000 topographic contour maps achieved successful results in the terrain correction of SAR image compared with the other DEM data, and the widely used SRTM DEM data in various applications was not suitable for the terrain correction of high resolution SAR images.