NO you won't but you must of course have a way of getting air around the throttle plate.
Saying that it is not the end of the world, some people run without idle speed control, without any problems, just have to be a bit more easy on throttle when cold that's all coming to a stop as it will try and stall until warm.
You could use something like a mody iscv, and make a plate up for it to sit on so you have an air IN/OUT then just route either side of the throttle plate.
tabetha