What ISP, NTL are currently doing upgrades so service is a bit hit and miss at the moment.
It could also be any part of the network - basically, you're 'travelling' across many servers, any one of which could be causing the slow down. It could also be your PC, but then the problem would be generally more consistent.