BuiltWith crawler

BuiltWith crawler蜘蛛/爬虫属于工具类型,由BuiltWith Pty Ltd开发运行。您可以继续阅读下方信息,以深入了解BuiltWith crawler基本信息,用户代理和访问控制等。

基本信息

BuiltWith crawler的基本信息如下表。但部分不是很规范的蜘蛛和爬虫,可能存在信息不明的情况。
蜘蛛/爬虫名称
BuiltWith crawler
类型
工具
开发商
BuiltWith Pty Ltd
当前状态
活动

用户代理

关于BuiltWith crawler蜘蛛或者爬虫的用户代理字符串,IP地址和服务器,所在地等信息如下表格所示:
BW/1.3
用户代理字符串
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.3; rb.gy/qyzae5) Chrome/124.0.0.0 Safari/537.36
首次出现
2024-12-21 00:06:04
最后出现
2025-01-09 11:57:45
遵循robots.txt
未知
来源
IP地址(25) 服务器名称 所属国家
35.217.18.157 157.18.217.35.bc.googleusercontent.com FI
34.0.211.53 53.211.0.34.bc.googleusercontent.com ES
35.219.245.138 ? IT
34.0.158.203 ? US
35.212.171.43 43.171.212.35.bc.googleusercontent.com US
3.29.134.49 ec2-3-29-134-49.me-central-1.compute.amazonaws.com AE
35.213.223.92 92.223.213.35.bc.googleusercontent.com AU
35.207.215.104 104.215.207.35.bc.googleusercontent.com IN
34.1.43.178 ? QA
34.1.22.199 199.22.1.34.bc.googleusercontent.com ?
34.0.129.105 ? US
35.219.247.54 ? IT
15.236.225.192 ec2-15-236-225-192.eu-west-3.compute.amazonaws.com FR
34.0.135.51 ? US
35.209.31.237 237.31.209.35.bc.googleusercontent.com US
34.1.11.46 46.11.1.34.bc.googleusercontent.com FR
34.1.25.70 ? US
35.207.238.138 ? IN
35.206.115.46 ? US
34.1.32.144 ? QA
35.212.166.46 ? US
35.211.10.21 21.10.211.35.bc.googleusercontent.com US
35.213.197.94 94.197.213.35.bc.googleusercontent.com AU
35.215.97.90 90.97.215.35.bc.googleusercontent.com US
35.207.5.150 150.5.207.35.bc.googleusercontent.com US
用户代理字符串
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.2; rb.gy/oupwis) Chrome/84.0.4147.105 Safari/537.36
首次出现
2024-04-26 12:28:40
最后出现
2024-05-03 05:34:32
遵循robots.txt
未知
来源
IP地址(16) 服务器名称 所属国家
35.210.108.76 ? BE
35.207.212.6 ? IN
35.217.68.215 ? US
3.78.247.129 ec2-3-78-247-129.eu-central-1.compute.amazonaws.com DE
35.217.33.216 ? FI
35.206.194.70 ? TW
35.207.206.7 7.206.207.35.bc.googleusercontent.com IN
35.217.109.238 ? US
35.213.241.230 230.241.213.35.bc.googleusercontent.com ?
34.1.43.3 34.1.43.3 QA
34.0.219.26 34.0.219.26 ES
35.207.248.89 ? IN
35.213.250.209 209.250.213.35.bc.googleusercontent.com AU
35.212.176.45 ? US
35.215.121.143 143.121.215.35.bc.googleusercontent.com US
35.219.252.45 45.252.219.35.bc.googleusercontent.com IT
34.1.19.210 34.1.19.210 US
35.213.245.168 168.245.213.35.bc.googleusercontent.com AU
35.212.186.31 31.186.212.35.bc.googleusercontent.com US
34.0.194.177 34.0.194.177 ES
35.206.90.132 132.90.206.35.bc.googleusercontent.com US
34.1.8.89 ? FR
34.0.135.5 ? US
34.0.220.22 34.0.220.22 ES
34.1.4.244 34.1.4.244 FR
34.1.20.228 34.1.20.228 US
35.211.10.21 ? US
34.1.23.37 ? US
35.207.5.150 ? US
34.0.80.164 ? IL
34.1.18.252 34.1.18.252 US
34.1.41.84 34.1.41.84 QA
35.212.147.88 ? ?
34.0.79.148 34.0.79.148 IL
35.217.37.136 ? FI
35.213.229.199 199.229.213.35.bc.googleusercontent.com AU
34.0.144.210 34.0.144.210 US
35.215.93.127 127.93.215.35.bc.googleusercontent.com US
35.207.209.92 ? IN
34.0.198.152 ? ES
35.215.71.74 74.71.215.35.bc.googleusercontent.com US
35.219.239.72 72.239.219.35.bc.googleusercontent.com IT
15.236.225.192 ec2-15-236-225-192.eu-west-3.compute.amazonaws.com FR
34.1.29.220 ? US
35.217.40.244 ? FI
34.1.12.43 34.1.12.43 FR
34.1.14.93 34.1.14.93 FR
35.217.1.191 191.1.217.35.bc.googleusercontent.com FI
34.1.7.58 34.1.7.58 FR
35.207.223.141 141.223.207.35.bc.googleusercontent.com IN
35.215.122.114 114.122.215.35.bc.googleusercontent.com US
34.0.205.200 34.0.205.200 ES
34.1.47.166 34.1.47.166 QA
34.0.215.225 ? ES
34.0.215.184 34.0.215.184 ES
35.215.126.238 238.126.215.35.bc.googleusercontent.com US
35.213.219.30 30.219.213.35.bc.googleusercontent.com AU
35.207.251.138 138.251.207.35.bc.googleusercontent.com IN
34.1.22.246 246.22.1.34.bc.googleusercontent.com US
35.219.249.96 ? IT
35.217.33.81 81.33.217.35.bc.googleusercontent.com FI
34.1.13.153 ? FR
34.0.194.186 ? ES
35.215.67.92 92.67.215.35.bc.googleusercontent.com US
15.235.50.228 juno.builtwith.xyz CA
34.1.22.77 ? US
34.1.31.216 ? US
35.219.224.197 ? IT
34.1.4.6 ? FR
35.215.94.30 ? US
35.219.236.143 ? IT
35.207.239.162 162.239.207.35.bc.googleusercontent.com IN
34.1.29.106 ? ?
34.0.218.186 186.218.0.34.bc.googleusercontent.com ES
51.161.84.56 unicorn.builtwith.xyz CA
35.212.152.192 ? ?
35.217.40.35 35.40.217.35.bc.googleusercontent.com FI
34.1.25.209 209.25.1.34.bc.googleusercontent.com US
35.207.209.94 ? IN
35.215.100.121 ? ?
35.207.252.192 ? IN
35.213.215.205 ? AU
34.0.133.250 250.133.0.34.bc.googleusercontent.com US
34.0.195.237 237.195.0.34.bc.googleusercontent.com ES
35.215.106.18 ? US
35.217.12.214 ? FI
35.219.250.20 ? IT
34.1.39.145 ? QA
34.1.21.87 ? US
35.215.124.246 246.124.215.35.bc.googleusercontent.com US
34.1.16.49 49.16.1.34.bc.googleusercontent.com US
34.0.220.67 67.220.0.34.bc.googleusercontent.com ?
34.1.20.176 ? US
34.1.12.239 ? FR
34.0.218.106 ? ES
34.1.12.133 ? FR
34.0.132.210 210.132.0.34.bc.googleusercontent.com US
34.0.211.14 14.211.0.34.bc.googleusercontent.com ES
34.1.25.52 52.25.1.34.bc.googleusercontent.com US
35.212.185.32 32.185.212.35.bc.googleusercontent.com US
34.1.13.193 193.13.1.34.bc.googleusercontent.com FR
34.1.22.48 48.22.1.34.bc.googleusercontent.com US
34.1.24.207 207.24.1.34.bc.googleusercontent.com US
35.217.34.165 165.34.217.35.bc.googleusercontent.com FI
35.215.120.50 50.120.215.35.bc.googleusercontent.com US
35.207.204.100 100.204.207.35.bc.googleusercontent.com IN
35.219.243.160 160.243.219.35.bc.googleusercontent.com IT
34.0.212.197 197.212.0.34.bc.googleusercontent.com ES
35.208.205.22 ? ?
35.219.233.144 144.233.219.35.bc.googleusercontent.com IT
35.215.127.4 4.127.215.35.bc.googleusercontent.com US
35.217.43.184 184.43.217.35.bc.googleusercontent.com FI
118.127.8.98 amy.builtwith.au AU
35.215.107.207 ? ?
35.206.115.46 ? US
35.212.151.150 150.151.212.35.bc.googleusercontent.com US
34.0.201.85 ? ES
35.213.229.218 ? AU
35.219.227.164 ? IT
35.215.114.141 ? US
35.217.10.125 ? FI
34.1.29.10 10.29.1.34.bc.googleusercontent.com US
34.0.219.241 ? ES
143.110.192.235 143.110.192.235 US
34.0.157.210 210.157.0.34.bc.googleusercontent.com US
143.198.173.204 143.198.173.204 US
35.217.39.73 ? FI
34.1.40.252 ? QA
34.0.80.192 192.80.0.34.bc.googleusercontent.com IL
35.215.68.60 60.68.215.35.bc.googleusercontent.com US
35.217.9.251 ? FI
34.0.142.51 ? US
34.0.209.171 ? ES
34.0.64.141 141.64.0.34.bc.googleusercontent.com IL
35.207.215.126 ? IN
35.213.238.120 120.238.213.35.bc.googleusercontent.com AU
34.1.22.16 16.22.1.34.bc.googleusercontent.com US
34.1.16.40 ? US
35.208.27.10 10.27.208.35.bc.googleusercontent.com US
35.212.183.147 147.183.212.35.bc.googleusercontent.com US
34.1.22.221 ? US
51.161.15.95 elmo.builtwith.xyz CA
34.1.19.110 110.19.1.34.bc.googleusercontent.com US
1.129.105.255 1.129.105.255 AU
35.213.238.230 230.238.213.35.bc.googleusercontent.com AU
34.0.223.36 36.223.0.34.bc.googleusercontent.com ES
35.217.52.185 185.52.217.35.bc.googleusercontent.com FI
35.207.215.84 ? IN
46.4.84.237 amy.builtwith.xyz DE
34.0.134.68 68.134.0.34.bc.googleusercontent.com ?
15.235.9.75 strawberry.builtwith.xyz CA
34.1.26.205 ? ?
34.1.31.111 111.31.1.34.bc.googleusercontent.com US
34.1.25.55 55.25.1.34.bc.googleusercontent.com US
34.0.133.43 ? US
35.215.99.233 233.99.215.35.bc.googleusercontent.com ?
34.1.2.113 ? FR
34.0.64.185 185.64.0.34.bc.googleusercontent.com IL
35.212.189.1 ? ?
34.1.6.20 20.6.1.34.bc.googleusercontent.com FR
35.207.238.105 105.238.207.35.bc.googleusercontent.com IN
34.0.142.187 187.142.0.34.bc.googleusercontent.com US
35.215.107.24 24.107.215.35.bc.googleusercontent.com US
34.0.198.29 ? ES
35.219.237.72 72.237.219.35.bc.googleusercontent.com IT
34.1.27.159 159.27.1.34.bc.googleusercontent.com US
35.215.87.212 ? US
34.1.38.72 72.38.1.34.bc.googleusercontent.com QA
34.1.40.160 ? ?
34.1.27.85 85.27.1.34.bc.googleusercontent.com US
34.1.5.17 ? FR
35.215.112.171 171.112.215.35.bc.googleusercontent.com US
34.0.153.203 203.153.0.34.bc.googleusercontent.com US
34.1.28.42 42.28.1.34.bc.googleusercontent.com US
35.207.228.82 82.228.207.35.bc.googleusercontent.com IN
34.0.147.213 213.147.0.34.bc.googleusercontent.com US
35.212.128.99 99.128.212.35.bc.googleusercontent.com ?
35.215.125.158 158.125.215.35.bc.googleusercontent.com US
35.213.234.136 136.234.213.35.bc.googleusercontent.com AU
35.215.99.245 245.99.215.35.bc.googleusercontent.com US
34.0.131.10 ? US
34.1.18.58 58.18.1.34.bc.googleusercontent.com US
35.213.195.32 32.195.213.35.bc.googleusercontent.com AU
35.212.138.136 136.138.212.35.bc.googleusercontent.com US
34.0.193.134 ? ES
34.0.133.62 62.133.0.34.bc.googleusercontent.com US
34.1.22.130 ? US
35.215.78.40 40.78.215.35.bc.googleusercontent.com US
34.1.28.167 167.28.1.34.bc.googleusercontent.com US
34.1.43.178 ? QA
34.0.80.142 142.80.0.34.bc.googleusercontent.com IL
35.219.248.240 240.248.219.35.bc.googleusercontent.com IT
35.217.19.12 12.19.217.35.bc.googleusercontent.com FI
117.210.139.11 117.210.139.11 IN
35.212.200.119 ? US
34.0.157.185 185.157.0.34.bc.googleusercontent.com US
35.219.253.47 47.253.219.35.bc.googleusercontent.com IT
35.215.118.37 ? US
35.217.18.223 ? FI
34.1.18.155 ? US
34.1.32.144 144.32.1.34.bc.googleusercontent.com QA
34.0.141.215 ? US
34.1.18.154 154.18.1.34.bc.googleusercontent.com US
35.212.169.143 143.169.212.35.bc.googleusercontent.com US
35.215.124.32 32.124.215.35.bc.googleusercontent.com US
35.219.231.152 ? IT
34.0.155.68 68.155.0.34.bc.googleusercontent.com US
35.207.241.196 196.241.207.35.bc.googleusercontent.com IN
35.212.153.195 195.153.212.35.bc.googleusercontent.com US
34.1.27.55 55.27.1.34.bc.googleusercontent.com US
35.207.251.152 152.251.207.35.bc.googleusercontent.com IN
35.212.171.35 ? US
35.217.15.244 244.15.217.35.bc.googleusercontent.com FI
34.1.25.177 ? US
35.207.249.220 ? IN
34.1.4.135 135.4.1.34.bc.googleusercontent.com FR
34.0.129.252 252.129.0.34.bc.googleusercontent.com US
34.1.21.66 ? US
34.0.147.102 ? US
35.209.31.237 ? US
35.215.125.197 ? US
34.0.69.87 87.69.0.34.bc.googleusercontent.com IL
35.207.215.104 104.215.207.35.bc.googleusercontent.com IN
34.1.10.233 ? FR
用户代理字符串
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.1; bit.ly/2W6Px8S; 0756356a4e) Chrome/84.0.4147.105 Safari/537.36
首次出现
2022-02-05 17:19:17
最后出现
2022-08-27 04:15:09
遵循robots.txt
未知
来源
IP地址(7) 服务器名称 所属国家
35.217.51.214 ? FI
3.128.79.74 ec2-3-128-79-74.us-east-2.compute.amazonaws.com US
35.87.86.67 ec2-35-87-86-67.us-west-2.compute.amazonaws.com US
18.216.214.63 ec2-18-216-214-63.us-east-2.compute.amazonaws.com US
35.208.60.118 ? US
3.145.112.208 ec2-3-145-112-208.us-east-2.compute.amazonaws.com US
35.217.48.162 ? FI
用户代理字符串
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.1; bit.ly/2W6Px8S; 8b8d52af0d) Chrome/84.0.4147.105 Safari/537.36
首次出现
2022-02-05 15:07:51
最后出现
2022-08-27 00:01:52
遵循robots.txt
未知
来源
IP地址(7) 服务器名称 所属国家
35.211.224.135 ? US
35.215.51.71 ? CA
54.171.212.141 ec2-54-171-212-141.eu-west-1.compute.amazonaws.com IE
3.143.239.95 ec2-3-143-239-95.us-east-2.compute.amazonaws.com US
34.222.190.88 ec2-34-222-190-88.us-west-2.compute.amazonaws.com US
35.84.24.155 ec2-35-84-24-155.us-west-2.compute.amazonaws.com US
35.212.232.39 ? US
用户代理字符串
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.1; bit.ly/2W6Px8S; 50dcc0e8d1) Chrome/84.0.4147.105 Safari/537.36
首次出现
2022-02-03 15:26:50
最后出现
2022-08-24 02:53:03
遵循robots.txt
未知
来源
IP地址(8) 服务器名称 所属国家
35.213.167.52 ? SG
44.200.61.147 ec2-44-200-61-147.compute-1.amazonaws.com US
35.208.170.235 ? ?
34.253.228.106 ec2-34-253-228-106.eu-west-1.compute.amazonaws.com IE
35.84.2.231 ec2-35-84-2-231.us-west-2.compute.amazonaws.com US
35.215.13.197 ? CA
35.212.163.212 ? US
44.234.254.117 ec2-44-234-254-117.us-west-2.compute.amazonaws.com US
用户代理字符串
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.1; bit.ly/2W6Px8S; 22542faf4a) Chrome/84.0.4147.105 Safari/537.36
首次出现
2022-02-02 12:55:12
最后出现
2022-08-22 15:46:54
遵循robots.txt
未知
来源
IP地址(7) 服务器名称 所属国家
35.212.239.193 ? US
35.217.92.253 ? US
35.84.189.251 ec2-35-84-189-251.us-west-2.compute.amazonaws.com US
35.217.23.45 ? FI
35.217.36.186 ? FI
35.206.253.134 ? TW
35.211.201.14 ? US
用户代理字符串
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.1; bit.ly/2W6Px8S; f7a1fd935a) Chrome/84.0.4147.105 Safari/537.36
首次出现
2022-01-23 05:55:22
最后出现
2022-08-20 16:49:24
遵循robots.txt
未知
来源
IP地址(9) 服务器名称 所属国家
35.210.151.25 ? BE
35.211.177.192 ? US
3.99.174.5 ec2-3-99-174-5.ca-central-1.compute.amazonaws.com CA
35.217.0.133 ? FI
3.15.149.246 ec2-3-15-149-246.us-east-2.compute.amazonaws.com US
34.222.194.203 ec2-34-222-194-203.us-west-2.compute.amazonaws.com US
44.235.74.220 ec2-44-235-74-220.us-west-2.compute.amazonaws.com US
35.217.36.186 ? FI
3.142.164.216 ec2-3-142-164-216.us-east-2.compute.amazonaws.com US
用户代理字符串
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.1; bit.ly/2W6Px8S; a2244af186) Chrome/84.0.4147.105 Safari/537.36
首次出现
2022-01-26 03:07:25
最后出现
2022-08-11 11:15:17
遵循robots.txt
未知
来源
IP地址(7) 服务器名称 所属国家
35.206.153.39 ? BE
35.215.117.69 ? US
13.210.79.45 ec2-13-210-79-45.ap-southeast-2.compute.amazonaws.com AU
35.215.64.144 ? US
104.45.194.225 ? US
35.207.231.2 ? IN
18.218.185.175 ec2-18-218-185-175.us-east-2.compute.amazonaws.com US
用户代理字符串
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.1; bit.ly/2W6Px8S; 85f6ace805) Chrome/84.0.4147.105 Safari/537.36
首次出现
2022-01-19 13:56:44
最后出现
2022-08-06 22:34:46
遵循robots.txt
未知
来源
IP地址(7) 服务器名称 所属国家
35.217.123.100 ? US
35.206.194.63 ? TW
35.213.211.88 ? AU
3.126.55.41 ec2-3-126-55-41.eu-central-1.compute.amazonaws.com DE
3.23.92.26 ec2-3-23-92-26.us-east-2.compute.amazonaws.com US
3.22.79.139 ec2-3-22-79-139.us-east-2.compute.amazonaws.com US
18.133.181.190 ec2-18-133-181-190.eu-west-2.compute.amazonaws.com GB
用户代理字符串
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.1; bit.ly/2W6Px8S; 6fd1c55da3) Chrome/84.0.4147.105 Safari/537.36
首次出现
2022-02-09 11:10:21
最后出现
2022-07-22 17:54:06
遵循robots.txt
未知
来源
IP地址(6) 服务器名称 所属国家
35.212.72.131 131.72.212.35.bc.googleusercontent.com US
35.213.223.219 219.223.213.35.bc.googleusercontent.com AU
35.213.234.99 99.234.213.35.bc.googleusercontent.com AU
35.213.133.191 191.133.213.35.bc.googleusercontent.com SG
35.213.241.103 103.241.213.35.bc.googleusercontent.com AU
44.242.145.97 ec2-44-242-145-97.us-west-2.compute.amazonaws.com US
用户代理字符串
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.1; bit.ly/2W6Px8S; 57a74ea5be) Chrome/84.0.4147.105 Safari/537.36
首次出现
2022-03-02 00:10:31
最后出现
2022-07-13 18:01:14
遵循robots.txt
未知
来源
IP地址(9) 服务器名称 所属国家
35.87.64.110 ec2-35-87-64-110.us-west-2.compute.amazonaws.com US
35.214.190.203 ? NL
35.212.179.95 ? US
44.200.185.9 ec2-44-200-185-9.compute-1.amazonaws.com US
3.138.204.69 ec2-3-138-204-69.us-east-2.compute.amazonaws.com US
35.217.123.100 ? US
35.208.97.249 ? US
35.206.153.39 ? BE
35.211.132.229 ? US
用户代理字符串
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.1; bit.ly/2W6Px8S) Chrome/74.0.3729.131 Safari/537.36
首次出现
2020-04-29 05:40:31
最后出现
2022-03-02 16:02:33
遵循robots.txt
未知
来源
IP地址(111) 服务器名称 所属国家
104.45.194.225 104.45.194.225 US
44.230.202.248 ec2-44-230-202-248.us-west-2.compute.amazonaws.com US
35.208.51.137 137.51.208.35.bc.googleusercontent.com US
35.219.139.221 221.139.219.35.bc.googleusercontent.com US
3.144.1.0 ec2-3-144-1-0.us-east-2.compute.amazonaws.com US
34.204.194.230 ec2-34-204-194-230.compute-1.amazonaws.com US
35.84.133.19 ec2-35-84-133-19.us-west-2.compute.amazonaws.com US
35.215.13.197 197.13.215.35.bc.googleusercontent.com ?
35.212.163.212 212.163.212.35.bc.googleusercontent.com US
35.213.234.99 99.234.213.35.bc.googleusercontent.com AU
用户代理字符串
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.1; bit.ly/2W6Px8S) Chrome/84.0.4147.105 Safari/537.36
首次出现
2020-08-09 13:37:16
最后出现
2022-03-02 06:08:50
遵循robots.txt
未知
来源
IP地址(462) 服务器名称 所属国家
35.217.31.190 ? FI
35.211.95.9 ? US
35.217.92.253 ? US
35.213.167.52 ? SG
35.206.153.39 ? BE
35.217.96.49 ? US
35.213.234.99 99.234.213.35.bc.googleusercontent.com AU
35.86.233.110 ec2-35-86-233-110.us-west-2.compute.amazonaws.com US
35.213.176.218 ? SG
35.217.97.157 ? US
35.208.51.137 137.51.208.35.bc.googleusercontent.com US
35.211.201.14 ? US
35.214.242.237 ? NL
35.215.121.179 ? US
3.234.140.140 ec2-3-234-140-140.compute-1.amazonaws.com US
35.206.82.75 ? ?
35.213.211.88 ? AU
35.212.203.104 ? US
35.217.43.61 ? FI
35.209.133.94 ? US
35.208.69.188 ? US
35.213.241.103 ? AU
35.206.194.63 ? TW
35.208.166.254 ? US
35.206.253.134 ? TW
35.217.2.217 ? FI
35.208.7.7 ? US
35.215.117.69 ? US
35.212.153.217 ? US
35.214.190.203 ? NL
35.209.181.3 ? US
35.213.223.219 219.223.213.35.bc.googleusercontent.com AU
35.217.123.100 ? US
3.126.55.41 ec2-3-126-55-41.eu-central-1.compute.amazonaws.com DE
3.23.92.26 ec2-3-23-92-26.us-east-2.compute.amazonaws.com US
3.22.79.139 ec2-3-22-79-139.us-east-2.compute.amazonaws.com US
18.133.181.190 ec2-18-133-181-190.eu-west-2.compute.amazonaws.com GB
35.210.151.25 ? BE
35.212.239.193 ? US
35.84.189.251 ec2-35-84-189-251.us-west-2.compute.amazonaws.com US
35.217.23.45 ? FI
35.217.36.186 ? FI
35.212.253.196 ? US
35.211.224.135 ? US
35.215.51.71 ? CA
54.171.212.141 ec2-54-171-212-141.eu-west-1.compute.amazonaws.com IE
3.143.239.95 ec2-3-143-239-95.us-east-2.compute.amazonaws.com US
34.222.190.88 ec2-34-222-190-88.us-west-2.compute.amazonaws.com US
35.84.24.155 ec2-35-84-24-155.us-west-2.compute.amazonaws.com US
35.212.232.39 ? US
35.209.96.24 ? US
44.200.61.147 ec2-44-200-61-147.compute-1.amazonaws.com US
35.208.170.235 ? US
34.253.228.106 ec2-34-253-228-106.eu-west-1.compute.amazonaws.com IE
35.84.2.231 ec2-35-84-2-231.us-west-2.compute.amazonaws.com US
35.215.13.197 197.13.215.35.bc.googleusercontent.com CA
35.212.163.212 212.163.212.35.bc.googleusercontent.com US
44.234.254.117 ec2-44-234-254-117.us-west-2.compute.amazonaws.com US
35.87.64.110 ec2-35-87-64-110.us-west-2.compute.amazonaws.com US
35.212.179.95 ? US
44.200.185.9 ec2-44-200-185-9.compute-1.amazonaws.com US
3.138.204.69 ec2-3-138-204-69.us-east-2.compute.amazonaws.com US
35.208.97.249 ? US
35.211.132.229 ? US
13.210.79.45 ec2-13-210-79-45.ap-southeast-2.compute.amazonaws.com AU
35.215.64.144 ? US
104.45.194.225 104.45.194.225 US
35.207.231.2 ? IN
18.218.185.175 ec2-18-218-185-175.us-east-2.compute.amazonaws.com US
35.211.177.192 ? US
3.99.174.5 ec2-3-99-174-5.ca-central-1.compute.amazonaws.com CA
35.217.0.133 ? FI
3.15.149.246 ec2-3-15-149-246.us-east-2.compute.amazonaws.com US
34.222.194.203 ec2-34-222-194-203.us-west-2.compute.amazonaws.com US
44.235.74.220 ec2-44-235-74-220.us-west-2.compute.amazonaws.com US
3.142.164.216 ec2-3-142-164-216.us-east-2.compute.amazonaws.com US
35.217.51.214 ? FI
3.128.79.74 ec2-3-128-79-74.us-east-2.compute.amazonaws.com US
35.87.86.67 ec2-35-87-86-67.us-west-2.compute.amazonaws.com US
18.216.214.63 ec2-18-216-214-63.us-east-2.compute.amazonaws.com US
35.208.60.118 ? US
3.145.112.208 ec2-3-145-112-208.us-east-2.compute.amazonaws.com US
35.217.48.162 ? FI
35.212.72.131 131.72.212.35.bc.googleusercontent.com US
35.213.133.191 191.133.213.35.bc.googleusercontent.com SG
44.242.145.97 ec2-44-242-145-97.us-west-2.compute.amazonaws.com US
44.230.202.248 ec2-44-230-202-248.us-west-2.compute.amazonaws.com US
35.219.139.221 221.139.219.35.bc.googleusercontent.com US
3.144.1.0 ec2-3-144-1-0.us-east-2.compute.amazonaws.com US
34.204.194.230 ec2-34-204-194-230.compute-1.amazonaws.com US
35.84.133.19 ec2-35-84-133-19.us-west-2.compute.amazonaws.com US
35.219.137.69 69.137.219.35.bc.googleusercontent.com US
51.161.15.95 elmo.builtwith.xyz FR
35.215.8.122 ? US
35.217.33.156 156.33.217.35.bc.googleusercontent.com FI
51.161.84.56 unicorn.builtwith.xyz CA
3.127.66.58 ec2-3-127-66-58.eu-central-1.compute.amazonaws.com DE
54.218.84.150 ec2-54-218-84-150.us-west-2.compute.amazonaws.com US
35.215.39.199 ? CA
35.212.159.108 ? US
35.208.7.196 ? US
35.217.15.240 ? FI
35.209.103.171 ? US
44.200.7.14 ec2-44-200-7-14.compute-1.amazonaws.com US
35.217.74.140 ? US
35.211.10.21 ? US
35.211.253.98 ? US
3.238.222.226 ec2-3-238-222-226.compute-1.amazonaws.com US
35.211.17.242 ? US
35.206.82.85 ? US
35.217.19.207 ? ?
35.212.234.187 ? US
35.212.175.213 ? US
35.213.191.235 ? SG
35.217.37.67 ? FI
35.217.88.92 ? US
35.214.204.123 ? NL
35.212.222.235 ? US
35.215.64.28 ? US
35.212.211.76 ? US
35.217.23.130 ? FI
35.211.248.167 ? US
35.217.73.164 ? US
35.209.79.175 ? US
35.215.84.249 ? US
35.209.187.78 ? US
35.211.139.15 ? US
18.197.19.255 ec2-18-197-19-255.eu-central-1.compute.amazonaws.com DE
35.206.215.15 ? TW
35.217.26.113 ? FI
35.212.137.141 ? US
18.184.122.106 ec2-18-184-122-106.eu-central-1.compute.amazonaws.com DE
35.208.11.114 ? US
35.213.203.149 ? AU
35.215.47.24 ? CA
35.206.153.204 ? BE
35.217.37.226 ? FI
35.213.233.14 ? AU
35.157.134.76 ec2-35-157-134-76.eu-central-1.compute.amazonaws.com DE
52.59.231.99 ec2-52-59-231-99.eu-central-1.compute.amazonaws.com DE
35.212.26.22 ? US
35.215.117.203 ? US
35.213.230.86 ? AU
18.196.145.56 ec2-18-196-145-56.eu-central-1.compute.amazonaws.com DE
35.213.211.32 ? AU
18.184.6.77 ec2-18-184-6-77.eu-central-1.compute.amazonaws.com DE
35.215.23.242 ? CA
35.219.134.110 ? US
35.214.140.188 ? NL
35.217.81.157 ? US
35.206.209.249 ? TW
35.215.88.36 ? US
35.215.80.210 ? US
35.214.161.13 ? NL
35.206.238.205 ? TW
35.212.110.19 ? US
35.213.201.35 ? AU
35.217.107.235 ? US
35.217.69.220 ? US
35.215.19.159 159.19.215.35.bc.googleusercontent.com CA
35.219.178.21 ? US
35.212.166.193 ? US
35.213.224.188 ? ?
35.215.112.133 ? US
35.207.193.163 ? IN
35.212.165.230 ? ?
35.214.182.31 ? NL
35.219.149.75 ? US
35.215.70.21 ? US
35.212.10.132 ? US
35.217.6.152 ? FI
35.217.106.247 ? US
35.206.213.227 ? TW
35.217.51.60 ? FI
35.215.39.164 ? CA
35.217.97.198 ? US
35.207.233.125 ? IN
35.219.152.214 ? US
35.212.135.45 ? US
35.212.17.113 ? US
35.211.111.19 ? US
35.206.215.9 ? TW
35.213.218.132 ? AU
35.219.129.250 ? US
35.214.230.110 ? NL
35.213.193.173 ? AU
35.215.123.183 ? US
35.212.23.243 ? US
35.217.100.136 ? US
35.206.212.199 ? TW
35.206.204.142 ? TW
35.206.218.64 ? TW
35.212.111.31 ? US
35.206.240.199 ? ?
35.217.117.104 ? US
35.213.195.154 ? AU
35.217.62.62 ? FI
35.215.51.85 ? CA
35.212.181.64 ? US
35.206.236.22 ? TW
35.215.72.56 ? US
35.215.1.54 ? CA
35.214.160.163 ? NL
35.212.205.117 ? US
35.212.130.102 ? US
35.206.242.182 ? TW
35.214.212.20 ? NL
35.214.151.249 ? NL
35.213.210.5 ? AU
35.213.222.68 ? AU
35.214.225.59 ? NL
35.215.47.153 ? CA
35.212.98.156 ? US
35.212.254.39 ? US
35.212.6.2 ? US
35.212.246.152 ? US
35.214.172.168 ? NL
35.212.89.123 ? US
35.212.199.227 ? US
35.217.22.43 ? FI
35.214.129.139 ? NL
35.212.146.14 ? US
35.219.166.80 ? US
35.208.177.52 ? US
35.206.202.163 ? TW
35.215.84.203 ? US
35.212.124.35 ? US
35.215.99.143 ? US
35.207.5.150 ? US
35.219.135.173 ? US
用户代理字符串
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.1; bit.ly/2W6Px8S) Chrome/84.0.4147.105 Safari/537.36
首次出现
2020-08-09 13:37:16
最后出现
2022-03-02 06:08:50
遵循robots.txt
未知
来源
IP地址(462) 服务器名称 所属国家
35.213.167.52 ? SG
35.219.137.69 69.137.219.35.bc.googleusercontent.com US
51.161.15.95 elmo.builtwith.xyz FR
35.215.8.122 ? US
35.213.241.103 ? AU
35.217.33.156 156.33.217.35.bc.googleusercontent.com FI
51.161.84.56 unicorn.builtwith.xyz CA
35.219.139.221 221.139.219.35.bc.googleusercontent.com US
3.127.66.58 ec2-3-127-66-58.eu-central-1.compute.amazonaws.com DE
54.218.84.150 ec2-54-218-84-150.us-west-2.compute.amazonaws.com US
用户代理字符串
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BuiltWith/1.0; +http://builtwith.com/biup) Chrome/74.0.3729.131 Safari/537.36
首次出现
2019-12-01 18:40:16
最后出现
2020-06-17 03:25:44
遵循robots.txt
未知
来源
IP地址(220) 服务器名称 所属国家
37.225.8.119 public-gprs549174.centertel.pl PL
31.0.40.226 apn-31-0-40-226.dynamic.gprs.plus.pl PL
37.225.8.85 public-gprs549140.centertel.pl PL
37.248.224.10 apn-37-248-224-10.data.lycamobile.pl PL
31.0.47.86 apn-31-0-47-86.dynamic.gprs.plus.pl PL
31.0.46.210 apn-31-0-46-210.dynamic.gprs.plus.pl PL
31.0.69.249 apn-31-0-69-249.dynamic.gprs.plus.pl PL
31.0.82.191 ip-31-0-82-191.dynamic.gprs.plus.pl PL
100.20.59.123 ec2-100-20-59-123.us-west-2.compute.amazonaws.com US
37.225.12.193 public-gprs550272.centertel.pl PL
37.248.224.225 apn-37-248-224-225.data.lycamobile.pl PL
52.53.243.114 ec2-52-53-243-114.us-west-1.compute.amazonaws.com US
18.228.219.23 ec2-18-228-219-23.sa-east-1.compute.amazonaws.com BR
3.249.36.83 ec2-3-249-36-83.eu-west-1.compute.amazonaws.com US
3.112.27.172 ec2-3-112-27-172.ap-northeast-1.compute.amazonaws.com JP
18.229.140.74 ec2-18-229-140-74.sa-east-1.compute.amazonaws.com BR
54.234.64.247 ec2-54-234-64-247.compute-1.amazonaws.com US
100.26.253.226 ec2-100-26-253-226.compute-1.amazonaws.com US
95.216.200.193 ? FI
54.198.79.48 ec2-54-198-79-48.compute-1.amazonaws.com US
54.90.56.51 ec2-54-90-56-51.compute-1.amazonaws.com US
158.69.52.114 bst.builtwith.xyz CA
13.250.125.83 ec2-13-250-125-83.ap-southeast-1.compute.amazonaws.com SG
15.235.50.228 juno.builtwith.xyz CA
用户代理字符串
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BuiltWith/1.0; +http://builtwith.com/biup) Chrome/74.0.3729.131 Safari/537.36
首次出现
2019-12-01 18:40:16
最后出现
2020-06-17 03:25:44
遵循robots.txt
未知
来源
IP地址(220) 服务器名称 所属国家
52.53.243.114 ec2-52-53-243-114.us-west-1.compute.amazonaws.com US
18.228.219.23 ec2-18-228-219-23.sa-east-1.compute.amazonaws.com BR
3.249.36.83 ec2-3-249-36-83.eu-west-1.compute.amazonaws.com US
3.112.27.172 ec2-3-112-27-172.ap-northeast-1.compute.amazonaws.com JP
18.229.140.74 ec2-18-229-140-74.sa-east-1.compute.amazonaws.com BR
54.234.64.247 ec2-54-234-64-247.compute-1.amazonaws.com US
100.26.253.226 ec2-100-26-253-226.compute-1.amazonaws.com US
95.216.200.193 ? FI
54.198.79.48 ec2-54-198-79-48.compute-1.amazonaws.com US
54.90.56.51 ec2-54-90-56-51.compute-1.amazonaws.com US
用户代理字符串
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BuiltWith/1.1; http://builtwith.com/biup) Chrome/74.0.3729.131 Safari/537.36
首次出现
2020-04-25 23:30:12
最后出现
2020-04-25 23:30:16
遵循robots.txt
未知
来源
IP地址(1) 服务器名称 所属国家
3.235.85.188 ec2-3-235-85-188.compute-1.amazonaws.com US
3.231.57.174 ec2-3-231-57-174.compute-1.amazonaws.com US
18.237.179.230 ec2-18-237-179-230.us-west-2.compute.amazonaws.com US
34.222.64.224 ec2-34-222-64-224.us-west-2.compute.amazonaws.com US
63.33.190.92 ec2-63-33-190-92.eu-west-1.compute.amazonaws.com IE
34.241.92.116 ec2-34-241-92-116.eu-west-1.compute.amazonaws.com IE
3.83.21.4 ec2-3-83-21-4.compute-1.amazonaws.com US
34.220.246.160 ec2-34-220-246-160.us-west-2.compute.amazonaws.com US
34.209.33.141 ec2-34-209-33-141.us-west-2.compute.amazonaws.com US
34.220.63.207 ec2-34-220-63-207.us-west-2.compute.amazonaws.com US
用户代理字符串
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BuiltWith/1.1; http://builtwith.com/biup) Chrome/74.0.3729.131 Safari/537.36
首次出现
2020-04-25 23:30:12
最后出现
2020-04-25 23:30:16
遵循robots.txt
未知
来源
IP地址(1) 服务器名称 所属国家
34.220.63.207 ec2-34-220-63-207.us-west-2.compute.amazonaws.com US
用户代理字符串
Mozilla/5.0 (X11; Ubuntu; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BuiltWith/1.0; +http://builtwith.com/biup) Chrome/60.0.3112.101 Safari/537.36
首次出现
2020-01-18 05:54:29
最后出现
2020-03-25 21:20:22
遵循robots.txt
未知
来源
IP地址(3) 服务器名称 所属国家
54.90.56.51 ec2-54-90-56-51.compute-1.amazonaws.com US
158.69.52.114 bst.builtwith.xyz CA
13.250.125.83 ec2-13-250-125-83.ap-southeast-1.compute.amazonaws.com SG
用户代理字符串
Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US) AppleWebKit/534.13 (KHTML, like Gecko) Chrome/9.0.597.107 Safari/534.13 BuiltWith/1.2
首次出现
2019-09-19 23:51:44
最后出现
2019-09-19 23:51:44
遵循robots.txt
未知
来源
IP地址(10) 服务器名称 所属国家
195.242.80.29 195.242.80.29 UA
195.242.80.91 195.242.80.91 UA
195.242.80.31 195.242.80.31 UA
195.242.80.130 195.242.80.130 UA
195.242.80.92 195.242.80.92 UA
195.242.80.26 195.242.80.26 UA
195.242.80.47 195.242.80.47 UA
195.242.80.41 195.242.80.41 UA
198.27.69.78 ns508339.ip-198-27-69.net CA
88.198.48.141 static.88-198-48-141.clients.your-server.de DE
用户代理字符串
builtwith
首次出现
2017-07-04 08:12:54
最后出现
2017-07-04 08:12:54
遵循robots.txt
未知
来源
IP地址(1) 服务器名称 所属国家
151.80.98.81 ns3052559.ip-151-80-98.eu FR

访问控制

了解如何控制BuiltWith crawler访问权限,避免BuiltWith crawler抓取行为不当。

是否拦截BuiltWith crawler?

可能不需要。工具类型爬虫通常为网站所有者使用此类工具对网站进行相关服务请求才会出现。当然,实际情况需站长判断后再作决定。

通过Robots.txt拦截

您可以通过在网站的 robots.txt 中设置用户代理访问规则来屏蔽 BuiltWith crawler 或限制其访问权限。我们建议安装 Spider Analyser 插件,以检查它是否真正遵循这些规则。

	# robots.txt
	# 下列代码一般情况可以拦截该代理
	
	User-agent: BuiltWith crawler
	Disallow: /

您无需手动执行此操作,可通过我们的 Wordpress 插件 Spider Analyser 来拦截不必要的蜘蛛或者爬虫。

常见蜘蛛/爬虫

Common Spiders
GoodBarber
GoodBarber蜘蛛/爬虫属于工具类型,由GoodBarber SAS开发运行。您可以继续阅读下方信息,以深入了解GoodBarber基本信息,用户代理和访问控制等。
PWABuilder
PWABuilder蜘蛛/爬虫属于工具类型,由Microsoft Corporation.开发运行。您可以继续阅读下方信息,以深入了解PWABuilder基本信息,用户代理和访问控制等。
webzio
webzio蜘蛛/爬虫属于工具类型,由Webz.io Ltd.开发运行。您可以继续阅读下方信息,以深入了解webzio基本信息,用户代理和访问控制等。
globalping bot
globalping bot蜘蛛/爬虫属于工具类型,由globalping.io开发运行。您可以继续阅读下方信息,以深入了解globalping bot基本信息,用户代理和访问控制等。
Googlebot
GoogleBot蜘蛛/爬虫属于搜索引擎类型,由Google Inc.开发运行。您可以继续阅读下方信息,以深入了解GoogleBot基本信息,用户代理和访问控制等。
Online Domain Tools
Online Domain Tools蜘蛛/爬虫属于监控类型,由AITIS s.r.o.开发运行。您可以继续阅读下方信息,以深入了解Online Domain Tools基本信息,用户代理和访问控制等。
cron-job.org
cron-job.org蜘蛛/爬虫属于工具类型,由B1G Software开发运行。您可以继续阅读下方信息,以深入了解cron-job.org基本信息,用户代理和访问控制等。
WGETbot
WGETbot蜘蛛/爬虫属于工具类型,由Alan Reed开发运行。您可以继续阅读下方信息,以深入了解WGETbot基本信息,用户代理和访问控制等。

相关文章

Related Articles