# All robots will spider the domain User-agent:* Disallow: /l10apps/ Disallow: /scripts/ Disallow: /backup/ Disallow: /isearch/