Hi Steve,
I would be inclined to refit your original arm and just change the rubber boot over. If you can move the ball joint easily then it is worn out its as simple as that, and will soon be making nasty knocking noises when going over bumps.
Did you have the slow speed brake judder prior to swapping arms over?

CheeRS, Mike.