Correct,it goes from the pump to the rail,fills the rail then the reg must release unwanted fuel from the rail back to the tank,I'm guessing it will be a 1 way affair so if it's hooked up back to front it won't start.
Makes sense too as that's all you have done is swap the fuel lines out.