I would go with CV joint straight away, especially with the symptoms you've described and the fact the noise goes away once moving (a damaged CV will make the shaft work elliptically rather than symetrically, i.e: throws it out of balance, causing it to wobble).

Put it on full lock (L and R) and turn the car around - if it knocks on one side you've solved the problem.

HTH.