Polishing a die that has free-form surfaces is a time-consuming and tedious job, and requires a considerable amount of high-precision skill. Some workers tend to gradually avoid the polishing work because of the poor environment caused by dust and noise. In order to reduce the polishing time and cope with the shortage of skilled workers, a user-friendly automatic polishing system was developed in this research. The polishing system with five degrees of freedom is able to keep the polishing tool normal to the die surface. The polishing system is controlled by a PC-NC controller. To easily operate the developed polishing robot system, this study developed an integrated program in the Windows environment. This program consists of four modules: the polishing module, the graphic simulator, the polishing data generation module, and the teaching module. Also, the automatic teaching system was developed to easily obtain teaching data and it consists of a three dimensional joystick and a proximity sensor. The joystick is used to simultaneously drive the polishing system to an arbitrary orientation and the proximity sensor is used to obtain teaching points precisely. Also, to evaluate the stability of the driving program and the teaching system, polishing experiments of a die of saddle shape were carried out.