The slightly more complex answer can be found in by looking at what the "real" LED mfgs do. They USED TO use epoxy as the encapsulant - low power LEDs still do. Now - virtually all power LEDs use silicones, because even the best epoxy could not handle the application.
There is quite a difference in power / heat level between your application and the materials in direct contact with an LED die, but - depending on how "sure" you need to be - as in "life or death" or "inconvenient".
If the project is really critical, then you can get more info from the material mfgs - they have a lot of experience actually.
Just as an example, while most white leds are backdriven with 460nm, quite a few are moving toward 450nm to increase color quality, etc. At 450nm, you can use them to "cure" UV epoxy and dental epoxy. It is definitely in the range to make an impact.