This study examined the effect of the main color of apartment building as background color on the preference for residential streetscape in the relation with surrounding environment of streetscape with its focus on the color of apartment building outer wall. To research a visual evaluation structure, this study aimed to understand its characteristics through quantitative assay and to provide more scientific and specific data about improvement direction. The results suggested that the current brightness and chroma of main color of apartment building was high and low respectively which was advisable. On the other hand, in the color, when the components of the whole streetscape included buildings or soundproofing walls, a streetscape image needed to be improved though the color scheme of 4-distance color difference.