Touching the throttle will make it go away as increasing the revs will build the oil pressure.
The fact that the oil light is flickering means there is a problem somewhere. Might be worth trying a new pressure switch and oil pump and see if the problem persists.
If you are replacing the lifters I believe it is recommended that you replace the cam as well.