I've never had to deal with that sort of situation before but I know a few mates been in similar sort of positions. If you are known to have a strong mental attitude and can hold your own, scum generally get the point and don't fuck with you. However, they may bring mates and stuff around and them knowing where you live doesn't help matters. Given the same situation, I would've done the same mate. Another thing with me, I've been boxing for a while now and started sparring here and there...people don't tend to mess with people they know have the ability to smash faces in and break things...