Are there any downsides to having a lighter flywheel?

i know it affects idle, but can this be sorted with mapping?

also how does this affect torque?

i know it makes the engine rev quicker, and slow down quicker, but other than that are there any detrimental affects?