Maybe a bit of Loctite gasket sealant would help keep it in place.

Has anyone tried threading the oil filler neck and getting a custom cap made?