i would say thats a bit over protective, it is effectively your back garden after all. You can see him from your balcony just keep a bit of an eye from there if you feel you have to.