We studied the detection of the Hg(II) concentration in an aqueous solution using rhodamine dyes on citrate-reduced Au nanoparticles (NPs). The quenching effect from Au NPs was found to decrease as the Hg(II) concentration increased under our experimental conditions. As the fluorescence signals intensified, the surface-enhanced Raman scattering (SERS) intensities reduced on the contrary due to less rhodamine dyes on Au NPs as the Hg(II) concentration increased. The rhodamine 6G (Rh6G) and rhodamine 123 (Rh123) dyes were examined via fluorescence and SERS measurements depending on Hg(II) concentrations. Fast and easy fluorescence detection of an Hg (II) concentration as low as a few ppm could be achieved by naked eye using citrate-reduced Au NPs.