You have connected to right terminal? On many alternators there are different terminals normally spare, which are not used for your car, it should go on the "IND" terminal. If connected to another then you will just have permanent earth on the bulb so will stay on all time. Sounds like what may have happened it should go out as soon as car is running.

Certainly is not a battery fault that has nothing to do with it.

Martin