It's the regulator at fault or the rectification side, thus allowing current to flow backwards back to the light illuminating it, trouble is this will flatten your battery when left, it can still charge ok though as in your case, despite the light telling you otherwise.

Martin