User-agent: * Disallow: /current/ Disallow: /docs/refs/ Disallow: /docs/abbrevs/ Disallow: /docs/toc.html Disallow: /docs/*/toc.html Disallow: /docs/*/tocs/ Disallow: /docs/*/ftns/ Disallow: /archive/item/ Disallow: /cgi-bin/ User-agent: PicoSearch/1.0 Disallow: / User-agent: WGet/ Disallow: / User-agent: Wget/1.5.3 Disallow: User-agent: Wget/1.8.2 Disallow: User-agent: Plucker/Py-1.0 Disallow: / User-agent: DISCo Pump 3.2 Disallow: / User-agent: Gulliver/1.3 Disallow: / User-agent: vspider Disallow: / User-agent: fast Disallow: / User-agent: EmailSiphon Disallow: / User-agent: Teleport Disallow: / User-agent: Teleport Pro/1.29.1820 Disallow: / User-agent: Fetch API Request Disallow: / User-agent: Fetch Disallow: / User-agent: API Request Disallow: / User-agent: pamuk Disallow: / User-agent: WebCopier v2.8 Disallow: / User-agent: WebCopier Disallow: / User-agent: WebCapture Disallow: / User-agent: Mass Downloader/2.2 Disallow: / User-agent: Mass Downloader/ Disallow: / User-agent: WebCopy/0.98b7 Disallow: / User-agent: WebCopy/ Disallow: / User-agent: AWV0.8d Disallow: / User-agent: Crescent Internet ToolPak Disallow: / User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 Disallow: / User-agent: HTTP OLE Control v.1.0 Disallow: / User-agent: Wget/1.7 Disallow: / User-agent: WebCopier v3.0 Disallow: / User-agent: JOC Web Spider Disallow: / User-agent: WebStripper/2.10 Disallow: / User-agent: SiteSucker/1.3.1 Disallow: / User-agent: SiteSucker Disallow: / User-agent: Webdup/0.9 Disallow: / User-agent: Webdup/ Disallow: / User-agent: Scooter/3.3 Disallow: / User-agent: Scooter/3.2 Disallow: / User-agent: Scooter/ Disallow: / User-agent: Python-urllib/1.15 Disallow: / User-agent: Python-urllib/1.0 Disallow: / User-agent: Python-urllib Disallow: / User-agent: Python Disallow: / User-agent: Franklin Locator 1.8 Disallow: / User-agent: Franklin Locator Disallow: / User-agent: (CK-SillyDog) Disallow: / User-agent: CK-SillyDog Disallow: / User-agent: PocketHTTP Disallow: / User-agent: PocketHTTP/1.0.2 Disallow: /