You need to add the REMOTE IP address.
(Assuming there is no firewall in the way of your SME.)
E.g you are at home on 1.2.3.4 wanting to connect to your SME 5.6.7.8 at work.
You enable access for 1.2.3.4 255.255.255.255
Then access
https://5.6.7.8/server-managerSimples.