I believe this is incorrect. The server usually listen on one port, but everytime it does an accept, a different random port is used, and the client start talking to the server on that new port.
Alternatively one can read RFC793 or, better, Stevens' "TCP/IP Illustrated".