you cant overcool, that only happens if your on a carb when you freeze the fuel.
Your intercooler can only at best match the air temps outside it, go as big as you can, anyone who says it will cause lag is speaking poo aswell, your talking a very small difference in time from filling a small intercooler to filling a large one