The best advice you have been given here is by dangerous reyland. how many of these people have stood in a sober fight or went roud with the intent to beat someone senseless. You could do all this, but what if he gives you a good beating?
Do it the way people have suggested, whats gonna hurt both them more, her walking out of her temporary council house with her two kids who this bloke probably dont want and maybe having to provide for them so having less money, whilst you without there burden have thar little bit more.