I’m always looking up how to do this, so here’s the quick instructions.
Open regedit and navigate to:
\HKEY_LOCAL_MACHINE\System\CurrentControlSet\Control\Terminal Server\WinStations\RDP-Tcp
Find the PortNumber key and change the value (in hex) to the port you want.
Change the Port on Remote Desktop Connection