# robots.txt for http://www.westerndigital.com/ and http://www.wdc.com/ User-agent: gsa-crawler Disallow: Allow: /WDProducts/Library Disallow: /WDProducts/ User-agent: * Disallow: /global/ Disallow: /eDM/ Disallow: /errorPages/ Disallow: /css Disallow: /ch/images/ Disallow: /cn/images/ Disallow: /de/images/ Disallow: /fr/images/ Disallow: /jp/images/ Disallow: /kr/images/ Disallow: /pt/images/ Disallow: /ru/images/ Disallow: /sp/images/ Disallow: /includes/ Disallow: /Seminars/ Disallow: /rydercup/ Disallow: /survey/ Disallow: /W3C/ Disallow: /WDCaviar320/ Disallow: /WDPassport/ Disallow: /WDScorpio/ Disallow: /WDSEARCH/ Disallow: /webapps/ Disallow: /advformat/ Disallow: /en/products/advancedformat/ Disallow: /en/library/ Disallow: /promotions/ Disallow: /WDProducts/ # Rover Email list compiler User-agent: Roverbot Disallow: / # ActiveAgent email list compiler User-agent: ActiveAgent Disallow: /