There should only be one pin - I know it looks like there should be two.
Take the lever shaft out completely. Wonder if someone has fitted the bearing retaining fork 180degrees out (threaded bolt hole being the other side as it stands so hidden until you remove).