There is a special tool available for doing this, I know of a few people who have wrecked theirs trying to push them back in...