When you say from the middle off the car where exactly do you mean. Around the steering rack area or in the engine bay?
And by lower arms i assume you mean the wishbones?
Could be an ABS fault from the knocking noise, however this wouldnt make it handle badly.