# Spider-director for domain: http://www.modest.nl # All robots will spider the domain User-agent: * Disallow: # Disallow directory /downloads User-agent: * Disallow: /downloads