# Make changes for all web spiders User-agent: * Disallow: / tpabbs/ allow: / index.asp