The development of computer technology and the advancement of the technology of information and communications spread the technology of multimedia and increased the use of multimedia data with large capacity, Users can grasp the overall video data and they are able to play wanted video back. To grasp the overall video data it is necessary to offer the list of summarized video data information, In order to search video efficiently on index process of video data is essential and it is also indispensable skill, Therefore, this thesis suggested the effective method about the cut detection of frames which will become a basis of an index based on contents of video image data. This suggested method was detected as the unchanging pixel color intelligence value, classified into diagonal direction. Pixel value of color detected in each frame of video data is stored as A(i, j) matrix-i is the number of frames. j is an image height of frame. By using the stored pixel value as the method of sum of squared difference of color two frames I calculated a specified value difference between frames and detected cut quickly and exactly in case it is bigger than threshold value set in advance, To carry out on experiment on the cut detection of frames comprehensively, I experimented on many kinds of video. analyzing and comparing efficiency of the cut detection system,