The magnetic abrasive polishing (MAP), for online monitoring with AE sensor attachment, was performed in this study. To predict the surface roughness after the magnetic abrasive polishing of NAK80, the signal data acquired from the AE sensor were analyzed. A dimensionless coefficient, which consisted of average of AErms and standard deviation of AE signal, was defined as a characteristic of the MAP and a prediction model was obtained using least square method. A neural network, which had multiple input parameters from AE signals and polishing conditions, was applied for predicting the surface roughness. As a result of this study, it was seen that there was very close correlation between the AE signal and the surface roughness in the MAP. And then on-line prediction of the surface roughness after the MAP of the NAK80 was possible by the developed prediction model.