One way to recycle the construction wastes is to use the waste concrete aggregates as the pavement materials. Although there are many studies and technical developments about waste concrete aggregates, the impurities produced in the process of the aggregate production prevent the use of the waste concrete aggregates in the pavement construction. In this study, the impurities included in the recycled waste aggregates were classified into inorganic and organic ones according to their characteristics, and the influences of each impurities on the pavement performance were presented. It was also showed that the limit of impurity content in the lean concrete base through the correlation between the inorganic impurity content and the compressive strength, and that in the granuler subbase layer through the correlation between the organic impurity content and the modified CBR. In conclusion, it is possible to apply waste concrete aggregates for the pavement when inorganic impurity content is less than 10% in the lean concrete base, and organic impurity content is less than 2% in granular subbase.