User-agent: * Disallow: / Disallow: /aspnet_client/ Disallow: /bin/ Disallow: /cgi-bin/ Disallow: /databases/ Disallow: /includes/ Disallow: /java1.0/ Disallow: /js/ Disallow: /plugins/ Disallow: /styles/ Disallow: /templates/ Disallow: /global.asax/ Disallow: /web.config/ Disallow: /noaccess.aspx/ Disallow: /error.htm/ Disallow: /error404.htm/ Disallow: /*.axd$ User-agent: Sosospider Disallow: / # User-agent: europarchive.org