yep thats the lan connector....
you just get a cable (crossover cable, not normal one... they cost the same tho) and plug the 2PCs into each other with that socket.
if all works well and theyre on decent operating systems the other PC should appear in network neighbourhood (or my network places as its now called)
worse case scenario you'll have to press a few buttons to get them talking to each other