They do whirr a bit anyway, especially when cold. If it were mine I wouldn't worry about it. All my opinion though, if you want to get it done for peace of mind then you may aswell.
I'd be changing the dual mass flywheel too while the box i off, these are a nightmare on the tdci's.