# Robots.txt file, robots welcome User-agent: Googlebot Allow: / Allow: /cgi-bin/webbbs Disallow: /cgi-bin Disallow: /logs Disallow: /*.txt Disallow: /form-out Disallow: /russell Disallow: /gvm Disallow: /blog Disallow: /WysisygPro User-agent: * # Disallow: /graphics Disallow: /cgi-bin Disallow: /logs Disallow: /reports Disallow: *.txt Disallow: /russell Disallow: /mission Disallow: /gvm Disallow: /forums Disallow: /blog Disallow: /form-out Disallow: /WysisygPro Crawl-delay: 5 # SEE ROBOTS.309 FOR HISTORICAL NOTES REMOVED HERE