Spoon, if your request takes a second to get to the server because of particularly bad routing problems, .1 of a second to be generated by the server, and another second or so to come back (Again routing issues), the page would appear to take a couple of seconds to arrive.
All I am saying is that improper routing by one ISP or from an ISP's pop location [b]may[b] explain why some users are finding the site slow while others find it very fast (At the same time).