User-agent: * Disallow: /news/ Disallow: /archive/ Disallow: /aspnet_client/ Disallow: /logs/ Disallow: /test/