If you hadn't mentioned that you have already replaced the water pump i would have put money on it being the problem !

Seen quite a few give bother, the plastic impeller breaks away from the pump body and wont pump the water through the engine at higher revs or when out driving on the road, usually alright when at idle and only heats up when driving.

Other than that this sounds like a real strage one, faulty temp sender maybe ?