In general, the swing motions of a crane are controlled and suppressed by controlling the trolley motion. In many of our previous studies, we suggested a new type of anti-sway control system for a crane. In this proposed control system, a small auxiliary mass (moving-mass) is installed on the spreader and moving this auxiliary mass controls tire swing motion. The actuator reaction against the auxiliary mass applies inertial control forces to the container in order to reduce the swing motion in the desired manner. However, measuring systems based on a laser sensor or other means are not veryuseful in real-worldapplications. So, in this paper, animage sensor is used to measure the motions of the spreader and the measured data are fed back to the controller in real time. The applied image processing technique is a kind of robust template matching method called Vector Code Correlation (VCC), which was devised to consider real environmental conditions. The H $infty$ based control technique is applied to suppress the swing motion of the crane. Experimental results showed that the proposed measurement and control system based on an image sensor is useful and robust to disturbances.