The valve should close up to hold the pressure in the line, if they stick open all the pressure gets forced back into the tank when you switch off.

Also means your pump is getting more knackered each time it primes up after a long switch off.