如何做搜索引擎蜘蛛日志分析
搜索引擎蜘蛛日志文件是一种非常强大但未被站长充分利用的文件，分析它可以获取有关每个搜索引擎如何爬取网站内容的相关信息点，及查看搜索引擎蜘蛛在一段时间内的行为。
| IP地址(11137) | 服务器名称 | 所属国家 |
|---|---|---|
| 45.10.139.82 | 45.10.139.82 | PL |
| 101.0.35.61 | 101.0.35.61 | IN |
| 177.40.12.32 | 177.40.12.32.static.host.gvt.net.br | BR |
| 187.94.175.169 | 187-94-175-169.dynamic.desktop.com.br | BR |
| 179.167.28.62 | 179-167-28-62.user.vivozap.com.br | BR |
| 45.160.161.123 | 45.160.161.123 | BR |
| 179.247.130.25 | 179-247-130-25.user.vivozap.com.br | BR |
| 138.59.80.53 | 138.59.80.53 | BR |
| 5.173.22.79 | user-5-173-22-79.play-internet.pl | PL |
| 121.200.54.213 | 121.200.54.213 | IN |
| 190.121.139.83 | 19012113983.ip52.static.mediacommerce.com.co | CO |
| 45.249.123.178 | 45.249.123.178 | ? |
| 189.6.233.245 | bd06e9f5.virtua.com.br | BR |
| 78.146.62.27 | host-78-146-62-27.as13285.net | GB |
| 201.69.143.119 | 201-69-143-119.dial-up.telesp.net.br | ? |
| 187.190.95.66 | fixed-187-190-95-66.totalplay.net | MX |
| 201.6.101.188 | c90665bc.static.spo.virtua.com.br | BR |
| 103.77.48.187 | 103.77.48.187 | ID |
| 201.40.158.151 | 201-40-158-151.user3p.brasiltelecom.net.br | BR |
| 110.130.192.16 | 110-130-192-16.rev.home.ne.jp | JP |
| 103.77.51.5 | 103.77.51.5 | ID |
| 177.205.127.226 | 177.205.127.226.dynamic.adsl.gvt.net.br | BR |
| 177.63.213.26 | 177-63-213-26.dsl.telesp.net.br | BR |
| 187.16.186.59 | 59.186.16.187.in-addr.arpa.verointernet.com.br | BR |
| 45.185.193.196 | 45.185.193.196 | BR |
| 45.189.16.235 | 45.189.16.235 | BR |
| 103.84.213.22 | 103.84.213.22 | IN |
| 62.49.6.153 | 62.49.6.153 | GB |
| 187.8.27.186 | mail.afip.com.br | BR |
| 187.19.185.190 | 187-19-185-190-tmp.static.brisanet.net.br | BR |
| 45.164.63.205 | 45.164.63.205 | BR |
| 187.251.246.35 | fixed-187-251-246-35.totalplay.net | MX |
| 143.255.197.102 | 143.255.197-102.jetinternet.com.br | BR |
| 103.58.66.226 | 103.58.66.226 | IN |
| 114.5.218.83 | 114-5-218-83.resources.indosat.com | ID |
| 191.189.24.181 | bfbd18b5.virtua.com.br | ? |
| 201.56.197.35 | 201.56.197.35 | BR |
| 170.231.110.178 | 170-231-110-178.sys3telecom.com.br | BR |
| 177.220.206.66 | 177-220-206-66.static.algartelecom.com.br | BR |
| 213.5.139.5 | 213.5.139.5 | PL |
| 191.243.208.238 | 191.243.208.238 | BR |
| 189.121.200.67 | bd79c843.virtua.com.br | BR |
| 179.167.28.149 | 179-167-28-149.user.vivozap.com.br | BR |
| 185.220.64.157 | 185.220.64.157 | PL |
| 188.33.224.211 | user-188-33-224-211.play-internet.pl | PL |
| 138.118.59.120 | 138.118.59.120 | BR |
| 191.34.212.208 | 191.34.212.208.dynamic.adsl.gvt.net.br | BR |
| 81.158.31.197 | host81-158-31-197.range81-158.btcentralplus.com | GB |
| 188.33.224.131 | user-188-33-224-131.play-internet.pl | PL |
| 187.191.8.191 | fixed-187-191-8-191.totalplay.net | MX |
| 200.207.170.87 | 200-207-170-87.dial-up.telesp.net.br | BR |
| 187.38.60.54 | 187.38.60.54 | BR |
| 179.176.100.61 | 179.176.100.61.dynamic.adsl.gvt.net.br | BR |
| 189.12.225.73 | 189-12-225-73.user3p.veloxzone.com.br | BR |
| 177.201.76.145 | 177-201-76-145.user3p.brasiltelecom.net.br | BR |
| 201.88.67.140 | 201-88-67-140.user3p.brasiltelecom.net.br | ? |
| 200.175.172.165 | 200.175.172.165.static.host.gvt.net.br | BR |
| 138.255.50.43 | 43.50.255.138.internetnitro.com.br | BR |
| 190.130.97.167 | 190.130.97.167 | CO |
| 201.33.77.143 | 201-33-77-143.customer.nbtos.com.br | BR |
| 179.193.7.106 | 179-193-7-106.user.vivozap.com.br | BR |
| 188.33.224.42 | user-188-33-224-42.play-internet.pl | ? |
| 103.161.55.241 | keralavisionisp-dynamic-241.55.161.103.keralavisionisp.com | IN |
| 45.185.193.152 | 45.185.193.152 | BR |
| 143.255.197.101 | 143.255.197-101.jetinternet.com.br | BR |
| 186.30.122.150 | dynamic-186-30-122-150.dynamic.etb.net.co | CO |
| 61.45.57.141 | g141.61-45-57.ppp.wakwak.ne.jp | JP |
| 186.224.28.7 | ip-186.224.28.7.dtel.com.br | ? |
| 103.178.218.17 | 103.178.218.17 | ID |
| 177.156.92.103 | 177.156.92.103.dynamic.adsl.gvt.net.br | BR |
| 187.19.149.176 | 187.19.149.176 | BR |
| 103.111.209.106 | 103.111.209.106 | ID |
| 168.194.13.189 | 168.194.13.189 | BR |
| 180.242.59.118 | 180.242.59.118 | ? |
| 49.204.1.244 | broadband.actcorp.in | ? |
| 179.127.251.203 | 179.127.251.203 | ? |
| 177.37.248.103 | 177.37.248.103 | BR |
| 111.95.126.22 | fm-dyn-111-95-126-22.fast.net.id | ? |
| 191.156.40.203 | 191.156.40.203 | CO |
| 177.124.51.239 | 177-124-51-239.ateky.net.br | BR |
| 188.33.225.126 | user-188-33-225-126.play-internet.pl | PL |
| 114.125.116.165 | 114.125.116.165 | ID |
| 177.137.114.174 | customer.digitotal.com.br | BR |
| 187.169.199.212 | dsl-187-169-199-212-dyn.prod-infinitum.com.mx | MX |
| 180.252.93.199 | 180.252.93.199 | ID |
| 186.233.111.64 | ip-186.233.111.64.dtel.com.br | BR |
| 189.40.73.2 | 189.40.73.2 | BR |
| 201.9.102.204 | 201-9-102-204.user3p.veloxzone.com.br | BR |
| 177.37.248.199 | 177.37.248.199 | BR |
| 186.1.128.241 | natpool-186-1-128-241.hnremote.net | CO |
| 190.108.99.46 | 46.99.108.190.in-addr.arpa.verointernet.com.br | BR |
| 89.247.168.33 | i59f7a821.versanet.de | DE |
| 170.78.181.8 | 170.78.181.8 | BR |
| 191.249.134.184 | 191.249.134.184.dynamic.adsl.gvt.net.br | BR |
| 79.192.193.80 | p4fc0c150.dip0.t-ipconnect.de | DE |
| 103.161.98.42 | 103.161.98.42 | IN |
| 179.6.34.251 | 179.6.34.251 | ? |
| 110.138.91.113 | 110.138.91.113 | ? |
| 192.141.232.20 | 192.141.232.20 | BR |
| 88.76.92.129 | dslb-088-076-092-129.088.076.pools.vodafone-ip.de | DE |
| 187.102.36.3 | 187-102-36-3.mkm.net.br | BR |
| 201.33.66.235 | 201-33-66-235.customer.nbtos.com.br | ? |
| 177.132.168.108 | 177.132.168.108.dynamic.adsl.gvt.net.br | BR |
| 170.245.25.195 | dynamic.digitalnetms.com.br | BR |
| 87.102.245.141 | cable-static-245-141.breitband.ch | ? |
| 177.75.232.11 | 177.75.232.11 | BR |
| 109.150.216.31 | host109-150-216-31.range109-150.btcentralplus.com | GB |
| 31.17.254.242 | ip1f11fef2.dynamic.kabel-deutschland.de | DE |
| 187.180.156.172 | bbb49cac.virtua.com.br | BR |
| 177.149.136.82 | 177.149.136.82 | BR |
| 92.40.111.48 | 92.40.111.48.threembb.co.uk | GB |
| 36.227.24.104 | 36-227-24-104.dynamic-ip.hinet.net | TW |
| 192.141.73.191 | 192-141-73-191.online.caxias.br | BR |
| 179.127.249.151 | 179.127.249.151 | BR |
| 186.1.128.240 | natpool-186-1-128-240.hnremote.net | CO |
| 191.6.55.208 | ip-191.6.55.208.dtel.com.br | BR |
| 189.113.224.95 | 189-113-224-95.unifique.net | BR |
| 177.75.232.120 | 177.75.232.120 | ? |
| 188.33.240.100 | user-188-33-240-100.play-internet.pl | PL |
| 213.246.178.182 | the562-1025844.routed.opal-solutions.com | ? |
| 186.210.201.252 | 186-210-201-252.xd-dynamic.algarnetsuper.com.br | ? |
| 191.5.255.6 | 191.5.255.6 | BR |
| 177.92.144.113 | 177-92-144-113.dynamic.starnetcomunicacao.com.br | BR |
| 188.33.224.221 | user-188-33-224-221.play-internet.pl | PL |
| 170.83.215.66 | 170.83.215.66-static.host.megalink.net.br | BR |
| 73.218.165.173 | c-73-218-165-173.hsd1.ma.comcast.net | US |
| 187.74.113.8 | 187-74-113-8.dsl.telesp.net.br | BR |
| 45.168.222.246 | 45.168.222.246.bottegatelecom.com.br | BR |
| 81.134.50.181 | host81-134-50-181.in-addr.btopenworld.com | GB |
| 189.13.106.188 | 189-13-106-188.user3p.veloxzone.com.br | BR |
| 138.0.245.32 | 138.0.245.33.in-addr-arpa | BR |
| 83.135.190.238 | i5387beee.versanet.de | DE |
| 186.28.108.106 | dynamic-186-28-108-106.dynamic.etb.net.co | CO |
| 170.79.222.181 | 181.222.79.170.in-addr.arpa.verointernet.com.br | BR |
| 187.19.209.222 | 187-19-209-222-tmp.static.brisanet.net.br | BR |
| 217.43.241.98 | host217-43-241-98.range217-43.btcentralplus.com | GB |
| 103.108.21.66 | 103.108.21.66 | ID |
| 45.160.248.78 | 45.160.248.78 | BR |
| 191.193.45.184 | 191-193-45-184.user.vivozap.com.br | BR |
| 201.42.20.141 | 201-42-20-141.dsl.telesp.net.br | BR |
| 181.65.25.231 | 181.65.25.231 | ? |
| 191.243.208.170 | 191.243.208.170 | BR |
| 186.249.158.183 | 186-249-158-183.shared.desktop.com.br | BR |
| 92.20.65.234 | host-92-20-65-234.as13285.net | ? |
| 114.10.67.15 | 114.10.67.15 | ID |
| 181.216.220.94 | b5d8dc5e.virtua.com.br | BR |
| 103.8.12.22 | 103.8.12.22 | ID |
| 132.157.129.111 | 132.157.129.111 | PE |
| 177.23.251.199 | 177-23-251-199.usrsoftdns.com.br | BR |
| 177.106.76.100 | 177-106-076-100.xd-dynamic.algarnetsuper.com.br | BR |
| 185.23.12.114 | 185.23.12.114 | PL |
| 181.65.19.199 | 181.65.19.199 | PE |
| 186.249.152.216 | 186-249-152-216.shared.desktop.com.br | BR |
| 177.207.157.199 | 177.207.157.199.dynamic.adsl.gvt.net.br | BR |
| 190.116.87.83 | 190.116.87.83 | PE |
| 187.60.84.96 | 187-60-84-96.cable.cabotelecom.com.br | BR |
| 179.6.34.43 | 179.6.34.43 | PE |
| 190.52.74.29 | 190-52-74-29.blinktelecom.com.br | BR |
| 186.220.39.102 | badc2766.virtua.com.br | BR |
| 179.157.138.182 | b39d8ab6.virtua.com.br | ? |
| 191.95.23.157 | dinamic-tigo-191-95-23-157.tigo.com.co | CO |
| 38.43.150.173 | 38-43-150-173.nextnet.com.pe | PE |
| 201.182.153.71 | 201.182.153.71 | BR |
| 187.73.198.196 | stetnet198-196.radio.stetnet.com.br | BR |
| 2.102.155.80 | host-2-102-155-80.as13285.net | GB |
| 45.232.194.175 | 45.232.194.175 | PE |
| 189.82.239.152 | 189-82-239-152.user3p.veloxzone.com.br | BR |
| 188.33.248.254 | user-188-33-248-254.play-internet.pl | PL |
| 106.205.77.25 | 106.205.77.25 | ? |
| 186.232.65.57 | 57.65.232.186.heliodoraonline.com.br | BR |
| 164.163.149.114 | 164.163.149.114.itnettelecom.com.br | BR |
| 201.43.254.70 | 201-43-254-70.dsl.telesp.net.br | ? |
| 187.44.245.214 | 187.44.245.214 | ? |
| 189.27.250.14 | 189.27.250.14.dynamic.adsl.gvt.net.br | BR |
| 45.167.106.39 | 45-167-106-39.giganet-rs.com.br | BR |
| 201.141.111.131 | customer-201-141-111-131.cablevision.net.mx | ? |
| 187.0.234.230 | 187.0.234.230 | BR |
| 14.201.40.201 | 14-201-40-201.tpgi.com.au | AU |
| 170.79.76.200 | saloa.200.76.79.170.vlinkinternet.com.br | BR |
| 86.189.238.135 | host86-189-238-135.range86-189.btcentralplus.com | GB |
| 186.194.21.14 | 186.194.21.14 | BR |
| 45.185.193.237 | 45.185.193.237 | ? |
| 177.10.232.69 | 177-10-232-69.radarinternet.com.br | BR |
| 92.16.170.230 | host-92-16-170-230.as13285.net | GB |
| 77.222.254.215 | 077222254215.warszawa.vectranet.pl | PL |
| 186.28.108.114 | dynamic-186-28-108-114.dynamic.etb.net.co | CO |
| 45.235.160.131 | 45.235.160.131.nortenettelecom.com.br | BR |
| 86.179.247.93 | host86-179-247-93.range86-179.btcentralplus.com | GB |
| 45.185.195.205 | 45.185.195.205 | BR |
| 187.19.243.168 | 187-19-243-168-tmp.static.brisanet.net.br | BR |
| 189.78.161.194 | 189-78-161-194.dsl.telesp.net.br | BR |
| 190.108.99.39 | 190.108.99.39 | BR |
| 143.255.197.108 | 143.255.197-108.jetinternet.com.br | BR |
| 70.48.33.124 | bras-base-okvlon3013w-grc-35-70-48-33-124.dsl.bell.ca | CA |
| 31.94.26.94 | 31.94.26.94 | GB |
| 186.84.174.137 | dynamic-ip-18684174137.cable.net.co | CO |
| 189.27.243.137 | 189.27.243.137.dynamic.adsl.gvt.net.br | BR |
| 179.214.113.25 | b3d67119.virtua.com.br | BR |
| 45.166.250.145 | 45-166-250-145.impactnet.com.br | ? |
| 177.223.97.208 | 177-223-97-208.zaaztelecom.com.br | BR |
| 190.52.73.122 | 190.52.73.122.blinktelecom.com.br | ? |
| 177.185.184.1 | 177.185.184.1.dynamic.cabonnet.com.br | ? |
| 187.56.49.13 | 187-56-49-13.dsl.telesp.net.br | BR |
| 187.106.32.167 | bb6a20a7.virtua.com.br | ? |
| 45.225.195.162 | 45-225-195-162.ibiunet.com.br | ? |
| 189.37.73.54 | 189.37.73.54 | BR |
| 179.116.37.23 | 179-116-37-23.user.vivozap.com.br | BR |
| 189.6.15.235 | bd060feb.virtua.com.br | BR |
| 201.0.40.175 | 201-0-40-175.dsl.telesp.net.br | BR |
| 177.75.59.179 | 179.59.75.177.explorernet.com.br | BR |
| 186.250.21.14 | 186.250.21.14 | BR |
| 207.6.113.100 | d207-6-113-100.bchsia.telus.net | CA |
| 177.8.70.217 | cgnatip-217.suafibra.net.br | BR |
| 131.221.90.160 | 131-221-90-160.unifique.net | BR |
| 177.23.60.142 | 177.23.60.142 | ? |
| 104.220.211.52 | 104.220.211.52 | ? |
| 139.192.63.153 | 139.192.63.153 | ID |
| 179.116.81.78 | 179-116-81-78.user.vivozap.com.br | BR |
| 45.234.43.123 | 45.234.43.123 | BR |
| 8.242.189.228 | 8.242.189.228 | CO |
| 179.214.127.17 | b3d67f11.virtua.com.br | BR |
| 190.27.137.104 | dynamic-190-27-137-104.dynamic.etb.net.co | CO |
| 179.116.80.139 | 179-116-80-139.user.vivozap.com.br | BR |
| 45.234.43.207 | 45.234.43.207 | BR |
| 177.45.98.3 | 177.45.98.3 | BR |
| 45.176.218.19 | 45.176.218.19 | BR |
| 190.27.137.192 | dynamic-190-27-137-192.dynamic.etb.net.co | CO |
| 200.108.166.249 | 200-108-166-249.vavatec.com.br | ? |
| 92.40.170.243 | 92.40.170.243.threembb.co.uk | GB |
| 187.134.238.176 | dsl-187-134-238-176-dyn.prod-infinitum.com.mx | MX |
| 45.229.156.141 | 45.229.156.141 | BR |
| 45.184.28.14 | 45.184.28.14 | BR |
| 167.249.190.104 | 167-249-190-104.henet.com.br | BR |
| 45.160.177.194 | 45.160.177.194 | BR |
| 36.70.234.206 | 36.70.234.206 | ID |
| 187.251.150.10 | fixed-187-251-150-10.totalplay.net | MX |
| 45.233.170.9 | 45.233.170.9 | CO |
| 80.1.216.160 | lewi-28-b2-v4wan-167619-cust159.vm4.cable.virginm.net | GB |
| 187.34.198.247 | 187-34-198-247.dsl.telesp.net.br | BR |
| 103.58.66.146 | 103.58.66.146 | IN |
| 201.75.183.2 | 201.75.183.2 | BR |
| 191.243.208.111 | 191.243.208.111 | BR |
| 109.76.75.54 | 109.76.75.54 | IE |
| 191.189.11.220 | bfbd0bdc.virtua.com.br | BR |
| 180.252.113.13 | 180.252.113.13 | ID |
| 35.150.228.15 | syn-035-150-228-015.res.spectrum.com | US |
| 180.252.118.74 | 180.252.118.74 | ? |
| 177.54.192.27 | 177-54-192-27.weclix.com.br | BR |
| 177.149.150.95 | 95.150.149.177.isp.timbrasil.com.br | BR |
| 177.181.5.116 | b1b50574.virtua.com.br | BR |
| 81.97.240.44 | swin-19-b2-v4wan-169327-cust43.vm38.cable.virginm.net | GB |
| 180.252.126.108 | 180.252.126.108 | ID |
| 189.206.197.90 | static-189-206-197-90.alestra.net.mx | MX |
| 5.133.46.101 | 5.133.46.101 | ? |
| 177.36.10.146 | 177.36.10.146 | BR |
| 186.28.108.161 | dynamic-186-28-108-161.dynamic.etb.net.co | CO |
| 177.70.93.116 | 116.93.70.177.in-addr.arpa.verointernet.com.br | BR |
| 200.229.212.108 | 200-229-212-108.bng-pop.tmw.net.br | BR |
| 31.40.213.230 | 31.40.213.230 | SE |
| 179.116.88.127 | 179-116-88-127.user.vivozap.com.br | BR |
| 201.17.148.117 | c9119475.virtua.com.br | BR |
| 187.188.239.26 | fixed-187-188-239-26.totalplay.net | MX |
| 200.229.212.77 | 200-229-212-77.bng-pop.tmw.net.br | BR |
| 49.36.183.113 | 49.36.183.113 | IN |
| 128.201.76.185 | 128.201.76.185 | BR |
| 187.46.161.176 | 176.161.46.187.isp.timbrasil.com.br | BR |
| 170.79.12.194 | 194.12.79.170.itt.net.br | BR |
| 187.122.60.128 | bb7a3c80.virtua.com.br | BR |
| 187.13.237.130 | 187-13-237-130.user3p.veloxzone.com.br | BR |
| 191.163.175.35 | 35.175.163.191.isp.timbrasil.com.br | BR |
| 168.196.138.1 | 168.196.138.1 | BR |
| 179.116.81.212 | 179-116-81-212.user.vivozap.com.br | BR |
| 131.0.62.157 | 131.0.62.157 | BR |
| 177.155.220.74 | gbonline.com.br | BR |
| 191.179.179.173 | bfb3b3ad.virtua.com.br | BR |
| 177.36.243.222 | 243-36-177-222.grupojcc.com.br | BR |
| 179.127.70.198 | 198.70.127.179.efit.net.br | BR |
| 80.2.56.41 | belf-11-b2-v4wan-167843-cust2088.vm9.cable.virginm.net | GB |
| 181.191.85.68 | 181.191.85.68.clicknetba.com.br | BR |
| 186.244.185.31 | 186-244-185-31.user3p.vtal.net.br | BR |
| 191.156.154.246 | 191.156.154.246 | CO |
| 179.157.128.117 | 179.157.128.117 | BR |
| 37.228.228.52 | 37.228.228.52 | IE |
| 179.116.80.217 | 179-116-80-217.user.vivozap.com.br | BR |
| 189.11.113.192 | 189-11-113-192.user3p.v-tal.net.br | BR |
| 45.71.130.174 | 45.71.130.174 | BR |
| 177.93.119.62 | 177.93.119.62 | BR |
| 177.180.131.100 | b1b48364.virtua.com.br | BR |
| 138.97.38.130 | 138-97-38-130.fliptelecom.com.br | BR |
| 187.19.239.181 | 187-19-239-181-tmp.static.brisanet.net.br | BR |
| 187.102.92.31 | 187.102.92.31.bnet.com.br | BR |
| 148.230.238.100 | fixed-148-230-238-100.totalplay.net | MX |
| 114.10.115.250 | 114.10.115.250 | ID |
| 177.220.176.194 | 194.176.220.177.rfc6598.dynamic.copelfibra.com.br | BR |
| 189.126.45.123 | ip-189.126.45.123.jrtelecom.com.br | BR |
| 191.177.138.28 | bfb18a1c.virtua.com.br | BR |
| 180.252.90.202 | 180.252.90.202 | ID |
| 106.51.117.248 | broadband.actcorp.in | IN |
| 175.136.83.188 | 175.136.83.188 | MY |
| 191.156.158.171 | 191.156.158.171 | CO |
| 189.192.49.209 | customer-gdl-cgn-49-209.megared.net.mx | MX |
| 186.212.88.22 | 186.212.88.22.static.host.gvt.net.br | BR |
| 179.116.80.42 | 179-116-80-42.user.vivozap.com.br | BR |
| 187.19.233.49 | 187-19-233-49-tmp.static.brisanet.net.br | BR |
| 191.219.154.77 | 191-219-154-77.user3p.v-tal.net.br | BR |
| 103.117.37.41 | 103.117.37.41 | IN |
| 89.67.91.142 | 89-67-91-142.dynamic.chello.pl | PL |
| 189.96.0.212 | ip-189-96-0-212.user.vivozap.com.br | BR |
| 179.93.133.137 | 179-93-133-137.user.vivozap.com.br | BR |
| 189.126.47.1 | ip-189.126.47.1.jrtelecom.com.br | BR |
| 180.243.12.225 | 180.243.12.225 | ID |
| 200.161.17.204 | 200-161-17-204.speedyterra.com.br | BR |
| 187.251.242.150 | fixed-187-251-242-150.totalplay.net | MX |
| 187.73.203.29 | host-203-29.host.stetnet.com.br | BR |
| 168.232.17.26 | 168.232.17.26 | BR |
| 186.235.221.252 | 252.221.235.186.in-addr.arpa.verointernet.com.br | BR |
可以考虑拦截。。爬虫通常会下载公开的互联网内容，这些内容默认情况下可以免费访问。不过，如果你不希望你的内容被用于未经授权的目的，你应该拦截它们。
您可以通过在网站的 robots.txt 中设置用户代理访问规则来屏蔽 Test Certificate Info 或限制其访问权限。我们建议安装 Spider Analyser 插件，以检查它是否真正遵循这些规则。
# robots.txt # 下列代码一般情况可以拦截该代理 User-agent: Test Certificate Info Disallow: /
您无需手动执行此操作，可通过我们的 Wordpress 插件 Spider Analyser 来拦截不必要的蜘蛛或者爬虫。
