There is no right or wrong when it comes to what you prefer when using lights. What's important is that you know what alternatives are available, and then have made an informed choice.
Personally, I like a bit of warmth in my work EDC. I work at night as a chauffeur, often driving bus loads of folks (luxury limo bus) out to the beach for a sunset wedding, or out to a ranch in the middle of nowhere for an evening BBQ, of course with no lights available to light the way back to the bus, so I carry LOTS of lights, and I've applied filters to every one of them, custom color correcting them to my own personal preference.
Heck, I even added a tiny bit of color correction to my ZL SC600 triple nichia 219, just to make it "perfect". Of course my perfect might not be your perfect.
What I've found is that when I get the tint right, colors pop more, and the added contrast makes it easier to see subtle shadow clues when walking, helping folks avoid tree roots or small uneven areas on the ground that might cause them to stumble.
So, yes, I find HICRI and proper color temperature, or at least a more daylight like tint, to be greatly beneficial for my work light. But that's ME. The most important thing for you is whatever floats YOUR boat. If you've tried a more neutral light and didn't enjoy it, then there is no reason whatsoever that you should feel like you're missing something........ however....... I do wonder what neutral or HICRI lights you've used that you didn't like?
It might be that you just haven't yet found the correct combination of HICRI AND color temperature. Many manufacturers sell lights that they list as "neutral", yet they might have a yellow or greenish tint, making you wonder what all the fuss is about. For me, neutral means NO TINT, just white light, and so far I haven't seen ANY lights that actually live up to that claim, which is why I color correct all my lights.
In the same vein, some lights are listed as HICRI, yet the color temp is way RED, or Yellow, or both. That's because HI CRI doesn't necessarily correlate directly with tint, so when selecting LEDs it's important to know BOTH the CRI value AND the color temp, and even then, there can be small variations in the final tints that might or might not be objectionable to a particular user.
In any case, it's all fun and quite an interesting journey.