The problem is you can't really drive like the m3 should be driven on the roads these days, far to busy and dangerous most of the time.
I like the e60 as the in gear acceleration is great, but you feel the weight in the bends.
From a rolling in gear start an e46 M seems to be fairly even on the straights with a remapped 530