# /robots.txt file for http://fridaynightskate.org/ # http://www.robotstxt.org/wc/faq.html#robotstxt # If you have files on your web site that you don't want # unauthorized people to access, then configure your server to do authentication, # and configure appropriate authorization. Basic Authentication has been around # since the early days of the web (and in e.g. Apache on UNIX is trivial to configure), # and if you're really serious, SSL is commonplace in web servers. # You could put all the files you don't want robots to visit in a separate sub # directory, make that directory un-listable on the web (by configuring your server), # then place your files in there, and list only the directory name in the /robots.txt. # Now an ill-willed robot can't traverse that directory unless you or someone else puts # a direct link on the web to one of your files, and then it's not /robots.txt fault. # For more information: http://www.ebrandmanagement.com/whitepapers/robots2.htm User-agent: * Disallow: /cgi-bin/ Disallow: /Archive/ Disallow: /images/ Disallow: /UPLOADS/