# TheRoc.net/robots.txt # See www.SearchEngineWorld.com/robots/robots_tutorial.htm # www.SearchTools.com/robots/robots-txt.html # and www.CNN.com/robots.txt. User-agent: * # Actual content disallowed: Disallow: /image/ Disallow: /util/ # Nonexistent content crawlers keep looking for: Disallow: /aspnet_client/ Disallow: /cgi-bin/ Disallow: _vti_inf.html Disallow: postinfo.html