The handling ability of containers at the terminal strongly depends on the performance of the cargo handling system such as RTGC(Rubber Tired Gantry Crane) and RMGC(Rail Mounted Gantry Crane). This paper introduces a guide line measurement system on the operating condition, in which two camera are installed to detect the guide line. Because the line tracking is the basic technique for control system design of RTGC, it is necessary to develop a useful and reliable measurement system. If the displacement and angle of the RTGC relative to a guide line as the trajectory to follow is obtained, the position of RTGC is automatically calculated. Therefore, in this paper, a camera-based measurement system is introduced. The proposed measurement system is robust against light fluctuation and cracks of the guide line. This system consists of two camera and a PC which are installed at the lower side of the RTGC. Two edges of the guide line are detected from an input image taken by the cameras in the moving state, and these positions are determined in a Hough parameter space by using the Hough transformation method. From the experimental results, the accuracy and usefulness of the proposed system is evaluated by comparing other instruments.