gecko-dev/webtools/bonsai/robots.txt

зеркало из https://github.com/mozilla/gecko-dev.git
User-agent: *
Allow: /index.html
Allow: /cvsqueryform.cgi
Disallow: /
If the application is set up at the server root (e.g. bugzilla.mozilla.org) then this robots.txt disallows robots from scanning the site except for the top level file. 2000-07-29 01:28:41 +04:00			`User-agent: *`
			`Allow: /index.html`
			`Allow: /cvsqueryform.cgi`
			`Disallow: /`