The purpose of this study is to obtain the patent for extracting the color map and color chip from the color image source and to develop color image map for fashion design. For this study, fashion image maps were produced from 210 pictures with Adobe Photoshop CS2 program targeting 200 university students from 2004 to 2006. The procedures for extracting the color map and color chip included providing the color image, the filtering phase, the segmentation phase, the extraction phrase, and the arrangement phase. Based on the results of this study, patent application was made to KIPO(Korean Intellectual Property Office) for this invention. The following effects can be expected from the standpoint of design based on the case study. First, it is a straight forward procedure to extract a color chip and color map from a color image. Second, it can be applied to various art works based on the recombination of colors as representative colors can be extracted from the related color image that combines a variety of colors. Third, desired colors can be selected based on the taste cluster classification or sensibility axis of design by extracting the representative color from the color image.