like any car, they form part of the pressurised cabin ventilation system

without them in place, the cabin will not be pressurised by the blower, so as you are discovering it leads to exhaust fumes coming in.