My old XR2 Turbo used to do exactly that.

I replaced everything and it still didn't sort the problem.

One day though the drive shaft snapped and after replacing it the vibrating went away.