# block the spiders from getting into development site # Next section for all web crawlers User-agent: * Disallow: /