check the fuel pressure, it may be high.

the other option is the fuelling is massivly rich, so when you shut the pump off the pressure in the line drops, so the car runs ok ish untill it runs out of fuel in the line

the feed out of your reg is the return line