Theres nothing wrong with tax avoidance....
Tax evasion is illegal however!
One legal way is to pay yourself say 4k a year (sadly below the tax and NI and EMPLOYERS NI) and pay the company shareholders a dividand oof any profit made by the company. You will pay tax on dividands (or rather your company would of 19%).
IR35 is more to do with being single sourced.
Alex