I had mine off for a couple weeks when mine was rattling tho i ordered a new one and fitted it after that. IIRC you can put a washer where the bolts hold it on to stop the rattle.
And the exhaust looked like this after a good drive, so prob best keeping it or wrapping the manifold.