it sound like it is back feeding somewhere , check all the wiring around the starter and alternator again and make sure its all correct

have you swapped the alternator for a new one or used ? if used , was it def ok ? try disconnecting the small wire on the alternator and try the ignition then

also was the alternator a like for like ?