We fabricated the diffraction grating on the surface of fused silica glass using a femtosecond laser. The grooves of diffraction grating has a lot of micro crack and debris result in reduced diffraction efficiency. So, we polished the diffraction grating with $CO_2$ laser beam. With different scan number of $CO_2$ laser beam, we observed the image of diffraction grating and measured the diffraction efficiency.