For more protection your authorized_keys file can be set up to only settle for connections from specified IP addresses or hostnames. Location that up is over and above the scope of the information, but more details over the SSH authorized_keys file can be found at SSH Academy: Configuring authorized_keys https://createssh.org/