Bots and scanners

About 5 min

Automated traffic includes legitimate search engines and ordinary crawlers, but also vulnerability scanners. Configure it in Security Center › Protection settings › Bots & scanners.

Demo
RequestHostnameMatches no siteBot detectionBrowser · Crawler · AutomationScanner blockingnuclei · LeakIX etc.Origin
Browser
Allowed
Search engine crawlerUsually allowed
Allowed
Hitting the IP directlyNever reaches the origin
Blocked
Automation tool · new IP and UAJA4 fingerprint unchanged
Verify
nuclei scanScanner signature
Blocked
Same IP keeps hittingBanned automatically, unlocks when it expires
Banned
Automatic bansUnlock automatically when they expire
UnbanManually in Lists
AllowlistBot events cannot be allowlisted yet
Probes with invalid hostnames never reach the origin; scanners are recognized, and IPs that keep hitting are banned automatically

Bot detection

Nodes tell normal browsers, crawlers and automation tools apart by request features, and you can adjust the handling strength in the Bot settings. JA4 is a fingerprint computed from the client's TLS handshake: the same tool keeps its fingerprint even after changing IP or UA, which helps especially against tools hiding their identity. See JA4 / TLS fingerprint for how to use it.

Tip Look in the attack log for a day or two to see which bots visit before deciding which to block. Search engine crawlers should usually be allowed, otherwise indexing suffers.

Scanner blocking

Recognizes the signatures of vulnerability scanners such as nuclei and LeakIX and handles them. Probes with invalid hostnames, such as hitting the IP directly or forging a domain, match no site and never reach your origin.

Automatic bans

IPs that keep hitting protection rules are banned automatically for a while and unlock when it expires. Banned IPs appear in "Lists & access control" and can be unbanned manually.

Caution Bot, upload scan, tamper protection and leak protection events cannot be allowlisted yet. For false blocks, adjust the policy itself rather than expecting an allowlist entry.

Upload scanning, tamper protection and leak protection are also available depending on the plan; see Paid features.

Get started

Try the live demo

Open the live demo, or contact us for a quote and the install command