The only thing with doing that is you might miss a genuine call from someone who isn't in your phone book.