Knackered Steering Column Bushes would make it feel perhaps worse than it is, but if there is a wobble there, then it really needs to be found.

Mine used to judder like feck with EBC discs, but I don't have that problem now. So there's your answer, do a 330mm/4 Pot conversion.