i had a similar problem, only happened when the car got warm. i put in a new idle speed control valve (auxillary air device) and its been working fine since.

check the hoses on either side of the valve as one of mine had come loose causing an air leak.