Just use a small file, seriously its a lot more accurate than snadpaper, you dont want to effect the bore or the face, only the edge between them.