We propose a visible light road-to-vehicle communication system at intersection as one of ITS technique. In this system, the communication between vehicle and a LED traffic light is approached using LED traffic light as a transmitter, and on-vehicle high-speed camera as a receiver. The LEDs in the transmitter are emitted in 500Hz and those emitting LEDs are captured by a high-speed camera for making communication. Here, the luminance value of each LED in the transmitter should be found for consecutive frames to achieve effective communication. For this purpose, first the transmitter should be identified, then it should be tracked for consecutive frames while the vehicle is moving, by processing the images from the high-speed camera. In our previous work, the transmitter was identified by getting the subtraction of two consecutive frames. In this paper, we mainly introduce an algorithm to track the identified transmitter in consecutive frames. Experimental results using appropriate images showed the effectiveness of the proposal.