# File: ROBOTS.TXT # Purpose: Allow/Disallow crawling on http://sobac.com # Date: 18 August 2002 # Author: Bob Jonkman # Reference: http://www.robotstxt.org/wc/robots.html # At this time we allow all robots to crawl (almost) everywhere... User-agent: * #Added 2009-03-01 Disallow: /clients Disallow: /bjonkman/oldpages # EOF: ROBOTS.TXT