Also, more cylinders means more moving parts in the valvetrain, rotating assembly, and sometimes bearing surfaces. Increasing the parasitic friction.
Not to mention the power required to pump water through bigger water jackets and larger quantity's of oil through the engine