The method of recognizing color texture brought forth in the present study is to employ unsupervised learning network to automatically recognize the fabric type and the main texture types. Firstly, the color scanner is adopted to extract fabric image which is afterwards saved as the digital image. Secondly, CIE-Lab color model is taken to obtain the feature value and wavelet transform is utilized to display the texture of the fabric image. Thirdly, co-occurrence matrix is employed to figure out the feature values of the texture structure such as angular second moment, entropy, homogeneity, contrast. Finally, self-organizing map (SOM) network is used as the classifier. The experiment result shows that the study can automatically and accurately classify the fabric types (including shuttle-woven fabric, jersey fabric and non-woven fabric) and main texture type of the fabric (such as plain weave, twill weave, satin weave, single jersey, double jersey and non-woven fabric).