You should get away with 2-3mm off the mounting face, I did it to the front wheels when I fitted EsCos wheels to my XR4x4.

I had to change the wheel nuts as the threads bottomed out before they where completely tight.

Mark