I think the bit you mean is the non return valve, which will be attatched to the old pump, I don't think they're supplied with a new pump or with a fitting kit.
This stops fuel returning into the fuel tank via the pump when it isn't running, so there is instant fuel in the system (lines, rail) when you start the engine.