How about more like this:
Light a match, watch it burn. It isn't like getting punched in the face. Yes, there is heat, but it is slowly released.
Now, wrap the head in aluminum foil to make a "match rocket." (Search engine for "match rocket.")
The energy of the match plus a shred of aluminum foil is enough to launch the tiny match a few feet. 10 if you had it nearly perfect.
The difference? Containment. As stated before, strength of the container limits the maximum energy of the burst. There's still more burning going on in a vent with flame event, but the container has already burst. The "hard slap" has already happened, the rest of the energy does not contribute to the burst. "Wasted," so to speak. It's the difference between a campfire and dynamite.
This is how a bursting flashlight is fundamentally different from an explosive. In a real explosive, the energy "goes all at once" and that's why no confinement is required for an actual explosive. Big difference, though it may seem small.
Breathing the stuff is a top hazard, as is burning down your house. The limits of the system mean that any frag is highly likely to be "less than lethal." More like a stingball grenade or a flashbang. It cannot blow your arm off, or it would have happened already. Please point us to a case where someone lost an arm, we must read and study the case. It'll be new to us, AFAIK.
If you're worried about it, use a plastic host 18650x1 non-multicell P60 with a moderately driven module, 2 amp max maybe? You'll likely never ever have a problem and even if you do, the container is not strong enough to do much of anything.
NiMH is far safer, use that if you have kids. Lock up the lithium.