While I do like to read other's experience with these water tests, I also won't conduct them with my own lights. If my light ever failed in the field, I always have a back-up or two (that I wouldn't mind actually "needing" once in a while), but an unjustified failure would give me serious pause on another purchase from that manufacturer. Although I do understand the "better test it new, rather than fail in the field" mentality, I find it interesting that you never read about people conducting 2-meter drop tests with new lights - which is probably a much more common scenario than submersion.... guess it boils down to aesthetics and form over function.
The problem with conducting water and drop tests, is that failure becomes a huge cost and hassle for everyone - time and shipping cost for both flashaholic and retailer, and the manufacturer is out money without any way of proving if their product actually failed the advertised spec..... which Selfbuilt has now clarified for the water test (and it makes sense, given the air pressure change that can be created by dropping a hot light into cool water):
..... people read too much into IPX ratings (i,e., the actual standard is not consistent with most people's intuitive understanding of "waterproof"). Only dive-rated lights are guaranteed to operate underwater without issue.
FYI, the ANSI FL-1 standards of "waterproof" and "submersible" are slightly more stringent than the IPX-7 and IPX-8 (upon which they are based), but even they don't cover lights in actual use - only submerged lights in the off state. Unfortunately, all bets are off if you turn the light on while submerged.
From what I've of these water tests conducted on CPF, it now seems that ZL (and other manufacturers) have gratuitously provided many warranty replacements for lights that may have actually met the advertised specs, yet were "abused" by CPF members.
All that said, I'm no ZL fan.