Well, as you won't be able to get the voltage higher than 4.2*3=12.6 V, it should prove ok for a 12 V lamp. However, I'm pretty sure that the G&P 12v is intended for four 3 V lithium batteries, which would sag down to perhaps 9 V during load, and that's what voltage the bulb is made for. If you knew the power consumption/current draw of the lamp, I could give you a better answer here.
If the lamp is too powerful and pull too much current, you might trip your cells if they are protected too, especially at startup.
If you have more bulbs and they are inexpensive, you can always try. I'd give it a 30% chance of working ok, 50% tripping the cells, if they are protected and 20% blowing the lamp, but don't take my word for it. Someone else muct have tried this before.