if you give him the time off then you are leaving yourself open to a whole heap of trouble if the same situation arises with a different employee!!
you cant have one rule for one and a different one for the others.
this guy knows the situation with holidays, if he doesent like it then let him hand his notice in, Im sure theres plenty of other people out there who would welcome his job!