# Sample robots.txt file 1 User-agent: * Disallow: /eki2/search.htm Disallow: /idic/search.htm Disallow: /news/Asahi/ Disallow: /news/Mainichi/ Disallow: /news/Yomiuri/ Disallow: /news/Impress/ Disallow: /news/NikkeiNet/ Disallow: /news/Sankei/ Disallow: /news/FujiSankeiBusinessI/ Disallow: /news/CNET/