论坛 › 重庆 › SEO优化：搜索引擎蜘蛛抓取反常，原来是这个原由！

nqkk58 发表于 2024-7-4 02:32:32

SEO优化：搜索引擎蜘蛛抓取反常，原来是这个原由！

    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><img src="http://mmbiz.qpic.cn/mmbiz/cZV2hRpuAPhQmPPCyMGfbceYAFImOiaofKwTHibYHj2x88YG8YmPia46TC9lykAOBLJxibcoWFiaeAN6POOpDZ3FViaQ/640?tp=webp&amp;wxfrom=5&amp;wx_lazy=1&amp;wx_co=1" style="width: 50%; margin-bottom: 20px;"></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">有<span style="color: black;">有些</span>网页内容<span style="color: black;">优秀</span>，用户<span style="color: black;">亦</span><span style="color: black;">能够</span>正常<span style="color: black;">拜访</span>，<span style="color: black;">然则</span>搜索引擎蜘蛛</span><span style="color: black;">却<span style="color: black;">没</span>法正常<span style="color: black;">拜访</span>并抓取，<span style="color: black;">导致</span>搜索结果覆盖率缺失，对搜索引擎对站点都是一种损失，百度把这种<span style="color: black;">状况</span>叫“抓取<span style="color: black;">反常</span>”。<span style="color: black;">针对</span><span style="color: black;">海量</span>内容<span style="color: black;">没</span>法正常抓取的网站，百度搜索引擎会认为网站存在用户体验上的缺陷，并降低对网站的<span style="color: black;">评估</span>，在抓取、索引、排序上都会受到<span style="color: black;">必定</span>程度的<span style="color: black;">消极</span>影响，<span style="color: black;">最后</span>影响到网站从百度获取的流量。</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;"><strong style="color: blue;">服务器连接<span style="color: black;">反常</span></strong></span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">　　服务器连接<span style="color: black;">反常</span>会有两种<span style="color: black;">状况</span>：一种是站点不稳定，搜索引擎蜘蛛尝试连接您网站的服务器时<span style="color: black;">显现</span>暂时<span style="color: black;">没</span>法连接的<span style="color: black;">状况</span>；一种是搜索引擎蜘蛛<span style="color: black;">始终</span><span style="color: black;">没</span>法连接上您网站的服务器。</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;"><span style="color: black;">导致</span>服务器连接<span style="color: black;">反常</span>的<span style="color: black;">原由</span><span style="color: black;">一般</span>是您的网站服务器过大，超负荷运转。<span style="color: black;">亦</span>有可能是您的网站运行不正常，请<span style="color: black;">检测</span>网站的web服务器（如apache、iis）<span style="color: black;">是不是</span>安装且正常运行，并<span style="color: black;">运用</span>浏览器<span style="color: black;">检测</span><span style="color: black;">重点</span>页面能否正常<span style="color: black;">拜访</span>。您的网站和主机还可能阻止了搜索引擎蜘蛛的<span style="color: black;">拜访</span>，您<span style="color: black;">必须</span><span style="color: black;">检测</span>网站和主机的防火墙。</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;"><strong style="color: blue;">网络运营商<span style="color: black;">反常</span></strong></span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">网络运营商分电信和联通两种，搜索引擎蜘蛛<span style="color: black;">经过</span>电信或网通<span style="color: black;">没</span>法<span style="color: black;">拜访</span>您的网站。<span style="color: black;">倘若</span><span style="color: black;">显现</span>这种<span style="color: black;">状况</span>，您<span style="color: black;">必须</span>与网络服务运营商进行联系，<span style="color: black;">或</span>购买<span style="color: black;">持有</span>双线服务的空间<span style="color: black;">或</span>购买cdn服务。</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;"><strong style="color: blue;">DNS<span style="color: black;">反常</span></strong></span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">当搜索引擎蜘蛛<span style="color: black;">没</span>法解析您网站的IP时，会<span style="color: black;">显现</span>DNS<span style="color: black;">反常</span>。可能是您的网站IP<span style="color: black;">位置</span>错误，<span style="color: black;">或</span>域名服务商把搜索引擎蜘蛛封禁。请<span style="color: black;">运用</span>WHOIS<span style="color: black;">或</span>host<span style="color: black;">查找</span>自己网站IP<span style="color: black;">位置</span><span style="color: black;">是不是</span>正确且可解析，<span style="color: black;">倘若</span>不正确或<span style="color: black;">没</span>法解析，请与域名注册商联系，更新您的IP<span style="color: black;">位置</span>。</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;"><strong style="color: blue;">IP封禁</strong></span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">IP封禁为：限制网络的出口IP<span style="color: black;">位置</span>，禁止该IP段的<span style="color: black;">运用</span>者进行内容<span style="color: black;">拜访</span>，在<span style="color: black;">这儿</span>特指封禁了搜索引擎蜘蛛IP。当您的网站不<span style="color: black;">期盼</span>搜索引擎蜘蛛<span style="color: black;">拜访</span>时，才<span style="color: black;">必须</span>该设置，<span style="color: black;">倘若</span>您<span style="color: black;">期盼</span>搜索引擎蜘蛛<span style="color: black;">拜访</span>您的网站，请<span style="color: black;">检测</span><span style="color: black;">关联</span>设置中<span style="color: black;">是不是</span>误添加了搜索引擎蜘蛛IP。<span style="color: black;">亦</span>有可能是您网站所在的空间服务商把百度IP进行了封禁，<span style="color: black;">此时</span>您<span style="color: black;">必须</span>联系服务商更改设置。</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;"><strong style="color: blue;">UA封禁</strong></span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">UA即为用户代理（User-Agent），服务器<span style="color: black;">经过</span>UA识别<span style="color: black;">拜访</span>者的身份。当网站针对指定UA的<span style="color: black;">拜访</span>，返回<span style="color: black;">反常</span>页面（如403，500）或<span style="color: black;">转</span>到其他页面的<span style="color: black;">状况</span>，即为UA封禁。当您的网站不<span style="color: black;">期盼</span>搜索引擎蜘蛛<span style="color: black;">拜访</span>时，才<span style="color: black;">必须</span>该设置，<span style="color: black;">倘若</span>您<span style="color: black;">期盼</span>搜索引擎蜘蛛<span style="color: black;">拜访</span>您的网站，useragent<span style="color: black;">关联</span>的设置中<span style="color: black;">是不是</span>有搜索引擎蜘蛛&nbsp;UA，并<span style="color: black;">即时</span>修改。</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;"><strong style="color: blue;">死链</strong></span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">页面<span style="color: black;">已然</span><span style="color: black;">没</span>效，<span style="color: black;">没</span>法对用户<span style="color: black;">供给</span>任何有价值信息的页面<span style="color: black;">便是</span>死链接，<span style="color: black;">包含</span>协议死链和内容死链两种形式。</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;"><strong style="color: blue;">协议死链</strong></span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">页面的TCP协议状态/HTTP协议状态<span style="color: black;">知道</span><span style="color: black;">暗示</span>的死链，<span style="color: black;">平常</span>的如404、403、503状态等。</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">内容死链：服务器返回状态是正常的，但内容<span style="color: black;">已然</span>变更为不存在、已删除或<span style="color: black;">必须</span>权限等与原内容<span style="color: black;">没</span>关的信息页面。</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">　　<span style="color: black;">针对</span>死链，<span style="color: black;">咱们</span><span style="color: black;">意见</span>站点<span style="color: black;">运用</span>协议死链，并<span style="color: black;">经过</span>百度站长平台--死链<span style="color: black;">工具</span>向百度提交，以便百度更快地<span style="color: black;">发掘</span>死链，减少死链对用户以及搜索引擎<span style="color: black;">导致</span>的<span style="color: black;">消极</span>影响。</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;"><strong style="color: blue;"><span style="color: black;">反常</span><span style="color: black;">转</span></strong></span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">将网络请求重新指向其他位置即为<span style="color: black;">转</span>。<span style="color: black;">反常</span><span style="color: black;">转</span>指的是以下几种<span style="color: black;">状况</span>：</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">1）当前该页面为<span style="color: black;">没</span>效页面（内容已删除、死链等），直接<span style="color: black;">转</span>到前一目录<span style="color: black;">或</span>首页，百度<span style="color: black;">意见</span>站长将该<span style="color: black;">没</span>效页面的入口超链接删除掉</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">　　2）<span style="color: black;">转</span>到出错<span style="color: black;">或</span><span style="color: black;">没</span>效页面</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">　　<span style="color: black;">重视</span>：<span style="color: black;">针对</span><span style="color: black;">长期</span><span style="color: black;">转</span>到其他域名的<span style="color: black;">状况</span>，如网站更换域名，百度<span style="color: black;">意见</span><span style="color: black;">运用</span>301<span style="color: black;">转</span>协议进行设置。</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;"><strong style="color: blue;">其他<span style="color: black;">反常</span>：</strong></span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">1）针对百度refer的<span style="color: black;">反常</span>：网页针对来自百度的refer返回<span style="color: black;">区别</span>于正常内容的<span style="color: black;">行径</span>。</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">　　2）针对百度ua的<span style="color: black;">反常</span>：网页对百度UA返回<span style="color: black;">区别</span>于页面原内容的<span style="color: black;">行径</span>。</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">　　3）JS<span style="color: black;">转</span><span style="color: black;">反常</span>：网页加载了百度<span style="color: black;">没</span>法识别的JS<span style="color: black;">转</span>代码，使得用户<span style="color: black;">经过</span>搜索结果进入页面后<span style="color: black;">出现</span>了<span style="color: black;">转</span>的<span style="color: black;">状况</span>。</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">4）压力过大<span style="color: black;">导致</span>的偶然封禁：百度会<span style="color: black;">按照</span>站点的规模、<span style="color: black;">拜访</span>量等信息，自动设定一个<span style="color: black;">恰当</span>的抓取压力。<span style="color: black;">然则</span>在<span style="color: black;">反常</span><span style="color: black;">状况</span>下，如压力<span style="color: black;">掌控</span>失常时，服务器会<span style="color: black;">按照</span><span style="color: black;">自己</span>负荷进行<span style="color: black;">守护</span>性的偶然封禁。这种<span style="color: black;">状况</span>下，请在返回码中返回503(其含义是“Service Unavailable”)，<span style="color: black;">这般</span>搜索引擎蜘蛛会过段时间再来尝试抓取这个链接，<span style="color: black;">倘若</span>网站已空闲，则会被成功抓取。</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><img src="http://mmbiz.qpic.cn/mmbiz_jpg/ricA7dic5DKcaIgPTCsvNMH3Icp8WibNGliccmMEibqzDRHicbYEcqKZGWAX6XuodF0wSHbiaLSvHjK0iaSHZAzvEtGicxQ/640?tp=webp&amp;wxfrom=5&amp;wx_lazy=1&amp;wx_co=1" style="width: 50%; margin-bottom: 20px;"></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;"><span style="color: black;">文案</span><span style="color: black;">源自</span>于卢松松博客，版权归原作者所有，如<span style="color: black;">触及</span>版权问题请<span style="color: black;">即时</span>联系我方处理</span></p><span style="color: black;"><strong style="color: blue;"><span style="color: black;">开课<span style="color: black;">通告</span></span></strong></span>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">今日课题：网站SEO排名新手<span style="color: black;">平常</span>误区操作</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 授课老师：阿君（SEO<span style="color: black;">商场</span>思维策划师）</p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 上课时间：2016年12月17日 20：30分</p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">刚才</span>接触SEO的小白童鞋<span style="color: black;">针对</span>排名优化和网络推广非常迷茫，<span style="color: black;">那样</span>今天阿君老师会<span style="color: black;">经过</span> 菜鸟入门，到快速流量排名，分<span style="color: black;">过程</span>来讲解。<span style="color: black;">处理</span>你的收录排名<span style="color: black;">困难</span>，<span style="color: black;">帮忙</span>你快速获取流量。YY6359 20：30分，请<span style="color: black;">大众</span>提前进教室！</p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">开通学习权限</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">联系QQ：2823703501 &nbsp;&nbsp;</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">&nbsp;<span style="color: black;">微X</span>：xiamo-jiejie&nbsp;</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">添加时请注明<span style="color: black;">源自</span>于<span style="color: black;">微X</span>平台</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">长按二维码</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">　订 阅 SEO<span style="color: black;">科研</span>中心</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; <span style="color: black;">一块</span>分享SEO的乐趣</span></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><span style="color: black;">　　▼</span></p><img src="http://mmbiz.qpic.cn/mmbiz_jpg/ziadDDQxbCJGab3rpPXgk7tibdPROwfQAbbuQ9T15nbZT9DLru0ENrBwdaKic8lzyZ4Sbc4qbYtSH47KerErWNgXw/640?tp=webp&amp;wxfrom=5&amp;wx_lazy=1&amp;wx_co=1" style="width: 50%; margin-bottom: 20px;">
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;"><img src="http://mmbiz.qpic.cn/mmbiz_jpg/ricA7dic5DKcaIgPTCsvNMH3Icp8WibNGliccmMEibqzDRHicbYEcqKZGWAX6XuodF0wSHbiaLSvHjK0iaSHZAzvEtGicxQ/640?tp=webp&amp;wxfrom=5&amp;wx_lazy=1&amp;wx_co=1" style="width: 50%; margin-bottom: 20px;"></p>
    <p style="font-size: 16px; color: black; line-height: 40px; text-align: left; margin-bottom: 15px;">-THE END -</p>

wrjc1hod 发表于 2024-9-30 07:47:05

论坛外链网http://www.fok120.com/

1fy07h 发表于 2024-11-3 12:26:47

回顾历史，我们感慨万千；放眼未来，我们信心百倍。

4zhvml8 发表于 2024-11-6 19:36:56

这夸赞甜到心里，让我感觉温暖无比。

查看完整版本: SEO优化：搜索引擎蜘蛛抓取反常，原来是这个原由！