In this paper, we propose the novel approach to enhance the visual quality of the digital image with adaptively sharpening and removing the noise. Image enhancement is performed in two ways. The pixels in the high dynamics area are sharpened by the adaptive unsharp mask with the parameter, which is derived using the statistical information of the image. On the other hand, the proposed algorithm do not perform the sharpening process in the uniform area that may cause the undesired artifact due to noise amplification, rather it performs smoothing to suppress the noise in this area. The decision, which process will be applied at the pixel, is also controlled by the statistics of the pixel dynamics. The proposed algorithm enhances the visual quality almost automatically by sharpening and smoothing at the same time with less parameter selection.