I would expect it requires a small amount of clearance at all times, that said its been many years since I've had one in bits.

What you could do is, when the brakes start binding slacken the master cylinder a little and if they then release you either know the servo is faulty or the rod is over adjusted?