User-Agent: smart.apnoti.com Robot/v1.34 (http://smart.apnoti.com/bot) Disallow: / User-Agent: smart.apnoti.com Disallow: / User-Agent: Slurp Allow: / Disallow: /code/info User-agent: kalooga Disallow: / User-agent: SimilarPages Disallow: / User-agent: YesupBot Disallow: / User-agent: Nutch-1.0-dev Disallow: / User-agent: nutch-crawl Disallow: / User-agent: Baiduspider Disallow: / User-agent:Yanga* Disallow: / User-agent: Yanga Disallow: / User-agent: beta Disallow: / User-agent: * Disallow: /php-codes User-agent: * Disallow: /code3 User-agent: heritrix Disallow: / User-agent: BuzzBot Disallow: / User-Agent: Mediapartners-Google Allow: / Disallow: /code/info User-Agent: Googlebot Allow: / Disallow: /code/info User-Agent: Adsbot-Google Allow: / Disallow: /code/info User-Agent: Googlebot-Image Allow: / Disallow: /code/info User-Agent: Googlebot-Mobile Allow: / Disallow: /code/info User-agent:Baiduspider Disallow: / User-agent: CRAWLER Disallow: / User-Agent: Charlotte Disallow: / User-agent: ia_archiver Disallow: / User-agent:Baiduspider+ Disallow: / User-Agent: Baiduspider+ (+ http://www.baidu.jp/spider/) Disallow: / User-Agent: BaiduImagespider (+ http://www.baidu.jp/spider/) Disallow: / User-Agent: DoCoMo/2.0 P05A (c100; TB; W24H15) (compatible; BaiduMobaider/1.0; + http://www.baidu.jp/spider/) Disallow: / User-Agent: BaiduImagespider Disallow: / User-Agent: DoCoMo/2.0 P05A Disallow: / User-Agent:Yandex Disallow: / User-Agent:Baidu Disallow: / User-agent: MLBot Disallow: / User-agent: Scarlett Disallow: / User-agent: discobot Disallow: / User-agent: radian6_default_ Disallow: / User-agent: radian6 Disallow: / User-agent: ScoutJet Disallow: / User-agent: Nutch Disallow: / User-agent: kalooga Disallow: / User-Agent: YoudaoBot Disallow: / User-Agent: Sosospider+ Disallow: / User-Agent: Sosospider Disallow: / User-Agent: Soso Disallow: / User-Agent: * Allow: / User-agent: dotbot Disallow: /