This is all about timing.
leave it and let it all calm down, then when he's least expecting it, dish the revenge out.
if you go in now all guns blazing, he will be expecting it and will, no doubt involve the police.
people who cause agro hate it when they dont get a response, because they dont know what you are thinking.
as the saying goes:
"the quiet ones are the worst"
i'd find out what his routine is from day to day, where he goes etc and i'd make a point of 'bumping into him' one night, when he's least expecting it and exact my revenge.
preferably at night when he's on his own, with no witnesses