By far the easiest way to copy SSH authorized public keys is using the ssh-copy-id tool, but it has a quirky syntax issue when you try to use it on a remote SSH server that’s operating on a non-standard port. If you want to use it, try the following.
# ssh-copy-id "[email protected] -p 1234"
Any other variation will most likely fail.