I go through the earthquake stash every year and pull out the batteries that are reaching their "use by" date -- and sometimes find some that are years past it. And I do use them, but try to always take them out of the light before I put it down. Most of my 'emergency box' lights don't have batteries in them -- just a few with lithium Energizer AAs and glow-in-the-dark keyfobs, and the little 9v PALights that have a find-me dim glow.
Just had too many alkalines leak over the years to ever trust them for very long unattended.
I have also regularly each year found one or two packages of alkalines -- still a year or more before their "use by" date -- that have one or more cells leaking inside the blister pack.
The reputable companies so far have always sent me some kind of coupon and a return envelope to get the batteries back -- though I'm sure I must be on their list of cranky customers. Explaining it's the earthquake box, and will serve the whole block when the dark happens, usually seems to convince them it's not just something mysterious about my house. I just buy a lot of batteries and put them aside for a long time.