The light should come on with the ignition, as should the oil pressure light.

Both should go out when the engine is running.