If you are happy with others being able to list your files, and access any files that you allow them to, then use mode 755 on your home directory:
chmod 755 ~
On the other hand, you may not want anyone to be able to even get a directory listing of your files. Even so, you should leave the x (search) bit on. This allows others to access files under your home directory that you would like to be public (like your web pages, for example). Do:
chmod 711 ~