I figured it out. It wasn't even going onto the high setting.
I took the circuit board off the housing to change out the 5mm LED's to some whiter ones. I damaged the temp sensing device that is glued into the housing. It was reducing current to the LED's on the high setting. I desoldered and removed it, and now it has high/low like it should and doesn't go bright briefly when I turn it off. I just don't have the overheating safety circuit anymore. Oh well.