The valve is the sole control of idle, so yes it's working! They are known to get 'coked up' and so the operation is not smooth. In your case however I suspect an air leak.
What I meant by new, i.e. has it recently been fitted, so to eliminate this as a source of trouble.
The typical vacuum pipes are at the front by the PCV, there is a 'T' piece as well.
Martin