It's as that live is powering the ignition, as you suspect. This will cause all sorts of problems, as well as draining the battery.

Martin