如被源站屏蔽,可尝试更换采集标识!亲测成功!
百度爬虫标识:
Mozilla/5.0 (compatible; Baiduspider/2.0; http://www.baidu.com/search/spider.html)
谷歌爬虫标识:
Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)
9 z, i! K" P X; n0 D3 ^! A- b
搜狗爬虫标识:$ l5 Q$ D% u" Q: k1 x# U7 @
3 G$ f0 G* `# W+ L2 j$ F7 |
Sogou web spider/4.0( http://www.sogou.com/docs/help/webmasters.htm#07)
360爬虫标识:
Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; rv:1.8.0.11) Gecko/20070312 Firefox/1.5.0.11; 360Spider
宜搜爬虫标识:
Mozilla/5.0 (compatible; EasouSpider; www.easou.com/search/spider.html)
必应爬虫标识:
Mozilla/5.0 (compatible; bingbot/2.0 http://www.bing.com/bingbot.htm)
百度转码标识:
Firefox 3.6 Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; rv:1.9.2.8;baidu Transcoder) Gecko/20100722 Firefox/3.6.8 ( .NET CLR 3.5.30729)
谷歌转码标识:* ] j$ J2 s% M* E
Chrome Mozilla/5.0 (en-us) AppleWebKit/534.14 (KHTML, like Gecko; Google Wireless Transcoder) Chrome/9.0.597 Safari/534.14
新浪转码标识:0 d4 T' + e* c4 x. V5 S; w
Mozilla 0.0 SINA_WEIBO; Mozilla/5.0 (Windows; U; Windows NT 5.1; MSIE8.0; zh-CN; rv:1.9.1.8) Gecko/20100202 Firef8 (.NET CLR 3.5.30729)