Yes, it will fry the poor LED immediately. With just 1 of those Lithium rechargeables you have not enough voltage (because a resistor is built in). 2 primaries (e.g. CR123s) in a special battery holder probably might fry it, too (though they have 6V, like the Alkies). If you consider Alkaline vs. Lithium performance...