Try swapping just the tailcaps. It's possible the tailcap could be doing this but if it were it would be a lot dimmer, not just a little bit. Since it's regulated, it needs <4 volts from the 6V worth of 123's. So the tailcap would have to be really bad to drop that much voltage.