The higher the compression the more responsive the engine tends to be, in an ideal world we would run the highest possible, but we lose it to prevent detonation. I think people drop it to allow more boost higher up

Dropping to gain more reliability than more power is actually the same thing, it is a trade off, more power OR more reliability.