The dump valve will open everytime it is on the overun, but only when boost is present, as it needs this pressure to force open the valve.
If it is opening purely and only on vacuum prerssure(overun), then it needs adjusting.
tabetha