to be totally honest life is too short to hold a grudge against anyone .. i never really got on briliantly with my dad .. but would give up everything to have him back ...
if you haven't done so already might be worth actually sitting down with him to hear his side of the story...
time affects peoples .. if you really feel you no longer want any contact why do you worry if you cause the pain of sending it back?