A decent sized hard drive is less than £50 nowadays and yes you will need an operating system which is likely to be the most esxpensive part.

What system you need depends on the spec of the system but you may be able to find one from a mate etc.