It depends on how much of your business is VAT claimable. It has its positive and negative points.

VAT returns are a bit time consuming and you need to know what you can and can't claim for, but then being an ex-Accountant I've done it a thousand times

And no, you don't have to be VAT registered but it does help, ie: setting up customer/supplier accounts and obtaining credit etc.