今天到《AJAX修炼之道》网站下载随书代码ajax-code.zip,得到的结果是:
We’re sorry, but access is denied to that document.This might be because you are accessing this site from a machine in China. Because of a massive amount of robot traffic from Chinese machines, we’ve had to take the unfortunate step of blocking access from those IPs.
If you feel that access has been denied in error, please contact our support folks.
这就是国内某些搜索引擎不遵守robot协议,疯狂爬抓网站带来的恶果。连累我无法下载代码,搜了半天也没找到其他下载地址。
同样因为过度爬抓,百度在进军日本伊始,就在首页向日本网管公开道歉。
更新:
我给pragprog.com发了mail,对方把代码作为附件回复给我了。为了惠泽同好,我把代码压成rar格式,放在空间上,请不要盗链:
原文永久链接:https://jijian91.com/blog20070417/baidu-spider-ip-block-ajax.html
分类: 互联网 — jijian91