The difference is actually noticable in comparison with many glass lenses as well; many have reported seeing an improvement over Surefire's Pyrex-based lenses as well as McGizmo's sapphire lenses (both made more for temperature or damage resistance than light transmission, admittedly.) They've even been reported to have sufficient temperature resistance for high-power hotwire mods like the famous Mag85 by a few individuals, though I haven't read enough to stand by that myself (nor have I tried it. Personally I'd go with a Borofloat there just for the extra shock and scratch resistance.)
IMO, whether or not you can notice a difference depends on your use of the light in question. If you're using it for close-up work and you already find the light to be sufficient for your task, chances are that you either won't notice or won't care. If you're trying to shoot farther, or the light is wanting for any improvement in luminescence, it just might make a nice difference.
For well-used lights, it's worth noting that a treatment with DeoxIT and ProGold will also reap a number of benefits regarding light output (possibly moreso than a lens upgrade, if the lens isn't pretty much destroyed.)