This study investigates the difference in the evaluation of English pronunciation quality between native speakers of English and Korean learners of English. This study employs a novel method of independently evaluating the prosody and segmentals of English sentences. A set of stimuli were made by swapping the prosody and the segmentals of English sentences read by a native speaker of American English and a Korean learner of English. Evaluations of the difference level of stimuli pairs and the goodness of the pronunciation quality showed that both native speakers of English and Korean learners of English give priority to the segmentals but native speakers of English were more sensitive to the difference in prosody in the evaluation of English pronunciation.