User-agent: * 
Disallow:
Allow: /*
User-agent: Slurp
Crawl-delay: 10