I would check the CO when warm, and that the timing is not retarded, as these will both affect hot starting.
As you suggest the starter is not the fault, like you hint at it only has one job, if turning over at a normal speed then it's working, and so should start, of course it's possible it's not the above but something breaking down when warm/hot.
tabetha