如何做搜尋引擎蜘蛛日誌分析
搜尋引擎蜘蛛日誌檔案是一種非常強大但未被站長充分利用的檔案，分析它可以獲取有關每個搜尋引擎如何爬取網站內容的相關資訊點，及檢視搜尋引擎蜘蛛在一段時間內的行為。
| IP地址(134) | 伺服器名稱 | 所屬國家 |
|---|---|---|
| 216.229.2.232 | lincoln.wonderproxy.com | US |
| 176.62.0.64 | static-176-62-0-64.rev-addr.terrakom.hr | HR |
| 104.244.211.138 | ? | US |
| 200.25.45.70 | ? | PE |
| 139.196.195.234 | ? | CN |
| 168.205.92.102 | ? | AR |
| 176.31.250.138 | ns3100614.ip-176-31-250.eu | FR |
| 69.27.107.36 | ? | CA |
| 185.78.64.120 | host120-64-78-185.static.rackone.it | IT |
| 74.118.137.63 | ? | US |
| 208.72.116.38 | ? | US |
| 120.136.55.202 | ip-120-136-55-202.solarix.net.nz | NZ |
| 216.244.81.26 | 216-244-81-26-reverse.wowrack.com | US |
| 41.223.53.127 | ? | EG |
| 179.50.90.156 | ? | CO |
| 185.209.84.151 | b9d1-5497.khv01.ru.misaka.io | RU |
| 216.238.67.24 | ? | MX |
| 49.157.47.121 | ? | PH |
| 46.246.93.17 | stockholm-hf.wonderproxy.com | SE |
| 23.235.230.138 | ? | US |
| 186.227.194.184 | 186-227-194-184.static.hostdime.com | BR |
| 206.75.231.129 | wonderproxy-1.racknine.net | CA |
| 41.220.3.118 | ? | UG |
| 45.248.78.81 | ? | AU |
| 192.73.243.211 | miami.wonderproxy.com | US |
| 173.234.116.106 | ? | US |
| 94.131.2.25 | almaty.wonderproxy.com | US |
| 103.143.208.41 | ? | VN |
| 210.48.0.138 | ? | NZ |
| 103.39.134.168 | smtp1-7.sicher4u.com | IN |
| 41.106.3.134 | ? | DZ |
| 199.15.250.35 | hopesinter.com | US |
| 206.41.229.92 | ? | US |
| 80.76.197.186 | wonderproxy-bhd.preceptit.com | GB |
| 45.63.13.10 | ? | US |
| 192.73.252.162 | sanjose.wonderproxy.com | US |
| 205.151.212.3 | ? | CA |
| 119.235.250.151 | hexbrag.com | ID |
| 103.9.78.132 | ? | VN |
| 185.75.159.52 | 185-75-159-52.dhst.nl | NL |
| 216.184.30.28 | ? | US |
| 102.213.153.183 | accra.wonderproxy.com | GH |
| 122.155.9.112 | goofilo.co | TH |
| 45.228.64.183 | montevideo.wonderproxy.com | UY |
| 155.254.18.36 | ? | ? |
| 103.48.119.237 | ? | ? |
| 104.234.171.161 | ? | ? |
| 82.113.131.207 | edinburgh.wonderproxy.com | GB |
| 209.190.51.147 | 209-190-51-147.xlhdns.com | ? |
| 154.127.57.223 | ? | ZA |
| 74.80.180.242 | ? | US |
| 163.47.21.114 | ? | NZ |
| 186.250.242.166 | ? | BR |
| 107.173.58.160 | 160-58-173-107.reverse-dns | US |
| 172.111.50.101 | unassigned.l1servers.com | US |
| 190.14.38.128 | ? | PA |
| 217.29.128.226 | 217-29-128-226.as37349.aptus.co.tz | TZ |
| 139.59.2.71 | bangalore.wonderproxy.com | IN |
| 31.171.154.203 | ? | AL |
| 151.236.20.22 | ? | HK |
| 70.36.35.129 | ? | US |
| 91.216.93.189 | ? | GB |
| 62.12.114.62 | static-62-12-114-62.ips.angani.co | KE |
| 138.121.203.22 | 138-121-203-22.static.hostdime.com | CO |
| 45.248.77.16 | ? | AU |
| 198.199.98.122 | sanfrancisco.wonderproxy.com | US |
| 87.237.71.229 | 87-237.71-229.hns.net | GB |
| 5.2.70.94 | ? | ? |
| 46.101.149.28 | frankfurt.wonderproxy.com | DE |
| 80.95.29.146 | unknown.fitdedi.com | BG |
| 80.209.228.127 | 2xr1.l.time4vps.cloud | LT |
| 66.231.216.23 | 66-231-216-23.static.firstlight.net | US |
| 38.92.191.10 | 38.92.191.10 | US |
| 103.6.87.232 | chennai.wonderproxy.com | IN |
通常不需要，如果您不需要此類監控服務，在服務提供網站移除您的網站即可。
您可以通過在網站的 robots.txt 中設定使用者代理訪問規則來遮蔽 wheresitup.com 或限制其訪問許可權。我們建議安裝 Spider Analyser 外掛，以檢查它是否真正遵循這些規則。
# robots.txt # 下列程式碼一般情況可以攔截該代理 User-agent: wheresitup.com Disallow: /
您無需手動執行此操作，可通過我們的 Wordpress 外掛 Spider Analyser 來攔截不必要的蜘蛛或者爬蟲。
