It doesnt matter how long you have been contracting, its still you thats liable to repay if there is a mistake with your tax.

If you were a permy who had worked stacking shelves for tesco for 40 years and never had another job and they made a mistake with your tax it would STILL be you that had to repay it.