#Prevent crawlers from tripping download routine User-agent: * Disallow: /admin/ Disallow: /include/ Disallow: /maintenance/ Disallow: /dev/ Disallow: /download.php