mozilla/5.0 (compatible; crawler)

[[TODO: MAP ONE SENTENCE SUMMARY]]

Category: [[TODO: MAP CATEGORY]] Avg 1.9 req/min Seen on 91 systems 5,614 observed requests 3 exact variants First seen August 3, 2026 Last seen October 19, 2026

[[TODO: MAP INTRODUCTION PARAGRAPH 1]]

[[TODO: MAP INTRODUCTION PARAGRAPH 2]]

What is mozilla/5.0 (compatible; crawler)?

[[TODO: MAP DEFINITION SUMMARY]]

[[TODO: MAP SHORT REFERENCE SUMMARY]]

Analyst summary: [[TODO: MAP ANALYST REPORT SUMMARY]]
User-agent
mozilla/5.0 (compatible; crawler)
Observed source IPs
0
Observed requests
5,614
Source networks
1,132
Exact variants
3
Latest hit count
13,716
Latest miss count
1,531
Latest 404 count
0
Unique paths
43
Related campaigns
[[TODO: MAP RELATED CAMPAIGN COUNT]]

Observed exact user-agent strings

mozilla/5.0 (compatible; crawler) First seen August 3, 2026 · Last seen October 19, 2026
mozilla/5.0 (compatible; crawler/1.0) First seen October 15, 2026 · Last seen October 15, 2026
mozilla/5.0 (compatible; crawler/2.0) First seen September 16, 2026 · Last seen September 16, 2026

Behavior profile

[[TODO: MAP BEHAVIOR PROFILE INTRO]]

Category
[[TODO: MAP CATEGORY]]
Average request rate
1.9 requests per minute
HTTP and HTTPS support
[[TODO: MAP HTTP HTTPS SUPPORT]]
HTTP version support
[[TODO: MAP PROTOCOL SUPPORT SUMMARY]]
Redirect behavior
[[TODO: MAP REDIRECT BEHAVIOR]]
Robots.txt behavior
[[TODO: MAP ROBOTS TXT BEHAVIOR]]
Crawl-rate behavior
[[TODO: MAP CRAWL RATE BEHAVIOR]]
JavaScript execution
[[TODO: MAP JAVASCRIPT SUPPORT]]
Form submission activity
[[TODO: MAP FORM SUBMISSION ACTIVITY]]
Malformed URL requests
[[TODO: MAP MALFORMED URL BEHAVIOR]]
HTTP/1.0: [[TODO: MAP HTTP 1.0 SUPPORT]] HTTP/1.1: [[TODO: MAP HTTP 1.1 SUPPORT]] HTTP/2: [[TODO: MAP HTTP 2 SUPPORT]] HTTP/3: [[TODO: MAP HTTP 3 SUPPORT]] [[TODO: MAP HEADER ORDER FINGERPRINTED]]

Source distribution

[[TODO: MAP SOURCE DISTRIBUTION INTRO]]

Top countries

Country Networks Site sightings Share
United States 721 1,889 63.1%
Seychelles 93 433 16.5%
Lithuania 83 282 9.1%
France 48 119 3.7%
Unknown 89 91 1.9%
United Kingdom 33 48 1.5%
Germany 16 37 1.4%
China 6 10 0.8%
Ukraine 15 23 0.7%
Canada 5 10 0.4%

Top ASNs

ASN Organization Networks Share
AS17497 [[TODO: MAP ASN ORGANIZATION]] 68 14.8%
AS212238 [[TODO: MAP ASN ORGANIZATION]] 148 14.0%
AS62874 [[TODO: MAP ASN ORGANIZATION]] 38 13.7%
AS5065 [[TODO: MAP ASN ORGANIZATION]] 159 6.7%
AS11798 [[TODO: MAP ASN ORGANIZATION]] 20 6.2%
AS6079 [[TODO: MAP ASN ORGANIZATION]] 35 5.8%
AS9009 [[TODO: MAP ASN ORGANIZATION]] 70 5.2%
AS11404 [[TODO: MAP ASN ORGANIZATION]] 82 4.2%
AS3257 [[TODO: MAP ASN ORGANIZATION]] 38 3.0%
AS46635 [[TODO: MAP ASN ORGANIZATION]] 9 2.9%

Top datacenters

Provider Type Snapshots Share

Representative source IPs

[[TODO: MAP REPRESENTATIVE IPS INTRO]]

HTTP fingerprint and request characteristics

[[TODO: MAP HTTP FINGERPRINT INTRO]]

Observed header order
[[TODO: MAP HTTP HEADER ORDER SUMMARY]]
Common headers sent
[[TODO: MAP COMMON HEADERS SUMMARY]]
TLS and HTTPS behavior
[[TODO: MAP TLS HTTPS SUMMARY]]
URL normalization behavior
[[TODO: MAP URL NORMALIZATION SUMMARY]]
Malformed request patterns
[[TODO: MAP MALFORMED REQUEST SUMMARY]]
[[TODO: MAP OBSERVED HTTP HEADERS]]

Observed sample requests

[[TODO: MAP SAMPLE REQUESTS INTRO]]

GET
/2021/page/2/
Status pattern: HTTP 200
Seen 1 times, Last seen October 11, 2026
GET
/2017/page/2/
Status pattern: HTTP 200
Seen 1 times, Last seen October 10, 2026
GET
/2018/02/
Status pattern: HTTP 200
Seen 1 times, Last seen September 30, 2026
GET
/wp-content/uploads/2019/09/2nd-bone-marrow-biopsy.jpg
Status pattern: HTTP 404
Seen 1 times, Last seen September 8, 2026
GET
/wp-content/uploads/2024/04/how-to-paint-laminate-cabinets-%C3%A2%C2%80%C2%93-and-love-the-results-1536x1152-1.jpg
Status pattern: HTTP 404
Seen 1 times, Last seen September 3, 2026
GET
/wp-content/uploads/2026/03/Maine-child-car-seat-guidelines.webp
Status pattern: HTTP 404
Seen 1 times, Last seen August 19, 2026
GET
/download/multimedia.grande.a328234f352e6d9e.494d472d32303231313130352d5741303035375b315d5f6772616e64652e6a7067.jpg
Status pattern: HTTP 403
Seen 1 times, Last seen August 18, 2026
GET
/fotos/masturbacion280910in.jpg
Status pattern: HTTP 404
Seen 1 times, Last seen August 18, 2026
GET
/wp-content/uploads/sites/20/2020/08/D_GAN_oasSp_ga2289.jpg
Status pattern: HTTP 404
Seen 1 times, Last seen August 18, 2026
GET
/wp-content/uploads/2025/08/spirit-airlines-1-770x440.jpg
Status pattern: HTTP 404
Seen 1 times, Last seen August 18, 2026
GET
/wp-content/uploads/2021/12/arthrites-1-300x180.jpg
Status pattern: HTTP 404
Seen 1 times, Last seen August 17, 2026
GET
/bitcoin-plunge-theories
Status pattern: HTTP 301
Seen 3 times, Last seen August 17, 2026

Related campaigns and associations

[[TODO: MAP RELATED CAMPAIGNS INTRO]]

[[TODO: MAP RELATED CAMPAIGN NAME]]

[[TODO: MAP RELATED CAMPAIGN SUMMARY]]
Related IPs: [[TODO: MAP RELATED CAMPAIGN IP COUNT]], Systems seen: [[TODO: MAP RELATED CAMPAIGN SYSTEMS SEEN]]
Confidence: [[TODO: MAP RELATED CAMPAIGN CONFIDENCE]]

Detailed analyst report

[[TODO: MAP ANALYST REPORT PARAGRAPH 1]]

[[TODO: MAP ANALYST REPORT PARAGRAPH 2]]

[[TODO: MAP ANALYST REPORT PARAGRAPH 3]]

Frequently asked questions about mozilla/5.0 (compatible; crawler)

What is mozilla/5.0 (compatible; crawler)?

[[TODO: MAP FAQ WHAT IS ANSWER]]

Is mozilla/5.0 (compatible; crawler) considered malicious?

[[TODO: MAP FAQ MALICIOUS ANSWER]]

Does mozilla/5.0 (compatible; crawler) respect robots.txt and crawl-rate controls?

[[TODO: MAP FAQ ROBOTS ANSWER]]

What infrastructure is commonly associated with mozilla/5.0 (compatible; crawler)?

[[TODO: MAP FAQ INFRASTRUCTURE ANSWER]]