CCTV inspection method has been used in Korea for more than 20 years, but there is no proper assessment system for sewer failure severity that considers the domestic circumstances. This study classified the defects caused by the overburden load of reinforced concrete sewer pipes depending on severity and developed defect code by analyzing the domestic CCTV inspection videos. The defect score was assigned to each defect code, and it was classified into 5 grades for the decision-making of repair and rehabilitation. The result of this study is expected to be useful for domestic CCTV inspectors to assess the sewer condition and helpful for managers to make a decision of repair and rehabilitation.