What does it read on the boost gauge?
If it only goes up to about a 1/4 then spikes a little higher when you let off the throttle, I'd say that it's more than likely a dodgy boost control solenoid which seems to be quite a common thing.
That's the first thing I would try anyway.