We demonstrate an improvement of detection tolerance of visible light IDs using a two-color differential detection scheme. A visible light ID simulated by 20-b/s pseudo-random bit sequence is generated by differentially modulating red and blue LEDs. These two-color signals are received by using a conventional camera, and then the differential signal between red and blue is extracted to suppress common mode noises originating from such as background white lights. A clear eye opening is confirmed in the differential signal even under background illumination with a white light blinking at 5 Hz. Our scheme for the visible light IDs is expected to contribute to enhance robustness of automated rescue after disasters.