Aside from the obvious camp/gay associations which i wouldnt care about, i wouldnt ever own/drive a cabriolet for the reasons specified by Chip.
The only cabriolets i would drive cost £50k plus and are genuine super cars so it balances out.
However something like a lotus 7, cobra replica or similar I would drive but they are sports cars and have the performance to boot, not cabriolet conversions of normal cars.