Cousin,
What happens when you drop the firewall? Can you connect then. If so... it's your firewall. If not it's probably the remote access panel. Remember you have to give access to outside IPs or they cannot use the GUI.
It cannot be a routing problem because FTP works just fine... so it's either the firewall on the SME or the Smoothwall.
Hope this helps.