In this paper, we reduced the optical noise interference in a visible light communication system using two color LEDs. In the transmitter, the original and the inverted signals of the transmitted data modulated a red LED and a blue LED, respectively. In the receiver, a differential detector which is composed of two photodetectors and an optical red filter detected the mixed signal radiated from the two LEDs. In an environment that the optical noise from a fluorescent lamp exists, the signal-to-noise ratio in this system was improved by about 20dB compared to that in the conventional system which uses a single LED and a single photodetector.