You need to fit a a blanking plate between exhaust gas supply pipe and the valve itself. This will stop contamination of the combustion by precombusted gasses actually getting to the valve.
The valve may be stuck open slightly. Removing the vacuum will not have any effect (or at least a marginal effect) on the car if this is the case.