# /robots.txt file for several sites # Upd: don't spider temp directory. Content is not likely to stay around. # Formatted according to http://www.robotstxt.org/wc/faq.html#robotstxt # mail robert b at no little spam cutie dot net (removing the obvious) if any problems. User-agent: * Disallow: /temp