If SSH login takes a long time, all you have to do is to add the following to /etc/ssh/sshd_config on your SSH server:
UseDNS no
and then restart the service.
Found this here:
http://www.ubuntugeek.com/fix-for-ssh-slow-to-ask-for-password-in-ubuntu-feisty-fawn.html
Go to System > Administration > Network
Click the “General” tab
You need to Uncheck the option that says “Scan for available services and advertise…” and close.
Now you can try to login using ssh you should see it will prompt for password immediately.
That’s it!