This study is intended to formulate the issues through the status analysis and image evaluation for each street on the basis of colors for the outdoor advertisements for part of street side in the oldest downtown for its construction year. Analysing the business type of the street side, it displays the identity of the fashion business area and the color status shown on the outdoor advertisement did not consider the harmony on the other business type and building improvements that it displays chaotic street views in overall. Status of color for the outdoor advertisement compared and analyzed for each street-side to be analyzed with high color contrast with the building structure and outdoor advertisements than the Street B side where there are many businesses of fashion sundries and fashion clothes to form more complicated street scenery visually for the Street A side. The color combination principle of building structure and outdoor advertisement was shown to be the factor for the contrasting unity and diversity. In order not to stimulate this visual confusion, the colors of outdoor advertisement has to be applied on the basis of the color guideline based on the color combination principle of outdoor advertisement and building structure to have the aesthetic harmony overall. As a result of analysis using the KJ method, the present image of the old downtown area was shown with the adjective vocabularies of "complicated", "out-dated", "chaotic", "disorganized", "dirty", "suffocating", and "unilateral", and its image to strive for would be in a total of 6 adjective vocabularies of "well-arranged", "young", "dynamic", "sophisticated", "personable" and "neat", and it has presented the basic foundation of color guideline of outdoor advertisement fit for its image.