Out of curiosity, how warm is too warm?
Yeah, "warm" is a subjective term. Let's just say they should never get "hot". How's that?

The best way to put it I guess, is that a problem cell will get warmer than a cell that isn't in question. So, the best way is to compare a questionable cell to a known, similar, "good" cell
Whether a Li-Ion cell gets warm or not, has a lot to do with the condition of the cell, and the charger being used. Older, well used cells, for example, will usually warm up a bit when charging.
The type of charger used makes a difference also. When a hobby charger, which uses the proper CC/CV algorithm, is used with newer cells, the cells will remain pretty much at ambient temperature. With older cells, there is a just detectable, increase in temperature.
When a CC charger such as the WF-139 is used, especially older cells, will get warmer towards the end of the charge. This is because this type charger is actually "forcing" current through the cell, until a predetermined voltage is reached. A charger using a proper CC/CV algorithm will terminate the charge when the current drops to a certain level during the CV stage, and thus prevent the cell from heating up.
So again, the best way to determine if a cell is getting "too warm", is to compare it to a similar cell (same brand, type, age etc.). And for sure, they should never actually get "hot". If they do, your running the risk of a

incident.
Dave