That rod inside the servo shouldnt really be played with tbh, it just holds the brakes on partially, which obviously isnt good.
When i first did my rear disc & 4 pot conversions they were crap but they do improve a lot when they bed in.
As Tony asked what brakes have you got all round and what size master cylinder?