In general, the swing motion of the crane is controlled and suppressed by activating the trolley motion. In many papers reported by us, we suggested a new type of anti-sway control system of the crane. In the proposed control system, a small auxiliary mass(moving-mass) is installed on the spreader and the swing motion is controlled by moving the auxiliary mass. The actuator reaction against the auxiliary mass applies inertial control forces to the container in order to reduce the swing motion in the desired manner. The measuring system is based on laser sensor or others. However it is not so useful in real world. Especially, in this paper, the image sensor is used to measures the motions of the spreader and the measured data are fed back to the controller in real time. The applied image processing technique is a kind of robust template matching method which is named Vector Code Correlation (VCC) and devised to consider the real environmental conditions. And the $H_{infty}$ based control technique is applied to suppress swing motion of the crane. And the experimental result shows that the proposed measurement system based on image sensor and control system is useful and robust to disturbances.