As I said yesterday that I tried to create a remote PostgreSQL database on the Ubuntu Server hosted by DigitalOcean. After I created the PostgreSQL, I met some problems connecting to the remote database. I realized that it is not too easy since PostgreSQL doesn't allow remote access by default. Then I got two references[1][2] and they did help.
Firstly you need a user and password to connect to the database, but the default superuser postgres doesn't have password or don't allow password to log in. You need to create a new user[3].
After that, basically to set up a remote PostgreSQL database: (1) You need to do some configurations(details in [1][2]), (2) Add rules or disable the firewall.
After every thing settled, try connecting to it
psql -h [host] -U [user] -d [database name]
Reference
[1] http://www.ndchost.com/wiki/postgres/remote-access
[2] http://www.cyberciti.biz/tips/postgres-allow-remote-access-tcp-connection.html
[3] https://www.digitalocean.com/community/articles/how-to-install-and-use-postgresql-on-ubuntu-12-04