# robot/spider exclusion for agents.home-sale.co.uk # http://info.webcrawler.com/mak/projects/robots/robots.html # ban known e-mail harvesters User-agent: EmailSiphon User-agent: CherryPicker/1.0 User-agent: CherryPickerSE/1.0 User-agent: CherryPickerElite/1.0 User-agent: EmailCollector/1.0 User-agent: EmailWolf 1.00 User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 User-agent: NICErsPRO User-agent: WebBandit/2.1 User-agent: WebBandit/3.50 User-agent: Mozilla/2.0 (compatible; NEWT ActiveX; Win32) Disallow: / User-agent: * Disallow: /asp/ Disallow: /graphics/ Disallow: /images/ Disallow: /include_files/