Yes to remove you remove the two screws and the oval ring, but the trouble is the valve siezes to the housing which is what you have, I rocked mine out, cleaned and smeared some grease round the circumferance when re assembling.

While it can cause "Hunting" it won't cause spluttering etc as said, I would do as explained, check CO and ignition system.

Martin