User-agent: *
Allow: /
Disallow:
Robot-version: 2.0.0 2.0
Crawl-delay: 4
Request-rate: 1/25
User-agent: Slurp
Crawl-delay: 90