# Make changes for all web spiders User-agent: * Disallow: /old Disallow: /system Disallow: /ccwebadmin Disallow: /myasg Disallow: /documents/prospectus/old Disallow: /dev