This paper presents algorithms which are region labeling and data structure of a boundary segmentation as image intermediate description process. In the method, the algorithms are region labeling, boundary segmentation, line and curve fitting and extracting data structure of each segment. As a result, a data structure of image is described by a set of region number, segment number, line or curve, starting point and end point of each segment and coefficient of line or curve. These data structures would serve for higher level processing as object recognition. For example we will use this data structure to solve the correspondence problem of stereoscopic image information. And we verified these algorithms through the image reconstruction of data structure.