Recently, two phase scheme for removing impulse noise in images is proposed. This algorithms first detect the noise candidates based on the adaptive median filter, and then apply optimizing techniques recursively only to those noise candidates to restore image. Thus the noise detector with high accuracy is important role on this algorithm, In this paper, novel noise detector is proposed, which can detect impose noise with high accuracy while reducing the probability of false detecting image details as impulses. And the method for reducing computational cost of regularization phase is presented also.