Its the selector bushes that have worn causing the lever to move around. I think you can just replace the bushes.

A quickshift lever/linkage would also solve your problem.