It depends what the company pension scheme is like. If it's a decent one then leave the money where it is, it will continue to accrue interest for you. When you get another job if the scheme is better or if you want to move the funds from the 'old' scheme to the new one you could do that.

The 'cash in' value (if you even can) is minimal so not an option.