No it will stay on until you reset the ECU again, then do the same thing. The only ways to turn it off safely are:

1) Put a cat back in,

2) install a MIL eliminator in the second sensor,

3) find someone who knows the encryption and can write over that part of the ECU software.

Martin