# Disallow only Internet Archiver Wayback Machine User-agent: ia_archiver Disallow: / # Allow all other crawlers User-agent: * Disallow: