Exhaust manifold is a pain in the arse to remove in situ, so I'd leave it on. Just disconnect the exhaust downpipe from the turbo.
You could leave the inlet manifold in place too, just disconnect the fuel and electrical connectors.
Not too bad a job if I'm.honest, even I can do it