This paper proposes a system detecting the area of traffic sign, which uses color rate as the information of colors, and corner point and distance rate as the information of morphology. In this system, a candidate area is extracted by performing dilation operation on the binary image made by the color rate of R, G, B components and by detecting corner point and center point through mask. The area of traffic sign with varied shapes is extracted by calculating the distance rate from center point, which is the information of morphology. The results of this experiment demonstrate that in this system which is invariable regardless of its size and location, it is possible to extract the exact area from varied traffic signs such as the shapes of triangle, circle, inverse triangle, and square as well as from the images at both day and night when brightness value is greatly different. Moreover, it demonstrates great accuracy and speed in processing.