yes, but you don't do it really tight, the washer behind the nut should be able to move ever so slightly if you lever against it with a screw driver.

Your wheel bearing may be knackered so I personally would replace it, then adjust the 24mm as described above. then re fit the cage and lastly replace the split pin, will be a new 1 in a bearing kit.