404 Scanner Guard
Catch the bots that map your site, one missing page at a time.
This is a PRO add-on: it needs a PRO license.
Most bots that look for a way in do not knock on the front door. They walk down a long list of addresses that should not exist: old backups, hidden files, admin paths, plugin leftovers. Every one of those guesses returns "page not found". A person rarely collects a pile of not-found pages in a few minutes. A scanner does it all day.
This add-on watches how many not-found pages one address asks for. When that number gets too high too quickly, the next request gets a visitor check, or a block, before the scanner finishes its list. Normal visitors, broken links that you already know about, and your own team are left alone.
How it works
1. It counts not-found pages, per address. Only real "page not found" answers count. A normal page view never adds to the count.
2. It looks at a moving window. The add-on keeps only the last few minutes of activity. An address that guesses a couple of times, then behaves, is forgotten. This is not a permanent record of small mistakes.
3. It acts when the number is too high. Once an address passes the threshold inside the window, the add-on remembers it for the block time below. On its next request it gets a check (a real person passes it and continues), or a block, depending on the action you choose.
4. It protects the innocent. Visitors who follow a broken link from your own site usually carry your site as their referrer, and logged-in users are your staff. Both are excluded by default. You can also list networks that must never be touched.
Prefer to watch first? Turn on Monitor Only. The add-on still counts, but it never checks or blocks anyone. Use it to see your normal level of not-found traffic, then pick a threshold.
Settings
Detection and Threshold
Enable 404 Scanner Guard
Default: On after activation
The master switch. Turn it off to stop counting and acting entirely. Nothing else on this page has any effect while it is off.
404 Threshold
Default: 12
How many not-found pages one address may ask for inside the window before the add-on reacts. Lower it to catch scanners sooner, but expect more checks for busy real visitors on a large site. Raise it if your site has many naturally missing addresses.
Window (minutes)
Default: 10
How far back the add-on counts. A shorter window reacts faster to a burst and forgets sooner; a longer window catches a slow scanner that spreads its guesses out.
Monitor Only
Default: Off
When on, the add-on counts activity but never checks or blocks anyone. Turn it on when you set up the add-on, watch for a day under Traffic and audit logs, then turn it off and set a threshold above your busiest real visitor.
Response
Action
Default: Challenge (CAPTCHA)
What happens to an address that passes the threshold.
- Challenge (CAPTCHA) asks the visitor to pass your normal visitor check. A real person continues; most scanners cannot.
- Block request shows the block page. Use it only if you are confident the threshold is right, because a blocked real visitor sees an error.
Block Duration (minutes)
Default: 60
How long the address stays challenged or blocked after it passes the threshold. When the time ends, the count starts fresh. Keep it long enough to outlast a scan, and short enough that a shared address (an office, a mobile network) recovers.
Exceptions
Ignore Same-Host Referer
Default: On
When on, a not-found page that a visitor reached from your own site does not count. This covers the normal case of a broken internal link. Leave it on unless you are chasing a scanner that fakes referrers.
Exempt Logged-In Visitors
Default: On
When on, signed-in users are never counted or blocked. Keep this on so your editors and administrators cannot lock themselves out while checking links.
Allowlist
Default: empty
Addresses or networks that are never counted or blocked, one per line. Accepts a single address (192.0.2.10) or a range (192.0.2.0/24). Lines that start with # are ignored. Add your office, your monitoring service, and any trusted crawler you run.
What you will see
When the add-on checks or blocks an address, the event appears in your traffic and audit log like any other decision, with the reason "404 scanner threshold exceeded". Use the log to tune the threshold: if real visitors are being checked too often, raise the threshold or the window.
Common problems
- Real visitors get a check? Raise the 404 Threshold, or turn on Monitor Only for a while and watch the log to find your normal level.
- A scanner still gets through? Lower the threshold or shorten the window. Very slow scanners spread their guesses out; a longer window catches them but also counts more normal activity.
- A shared office or network is caught? Add it to the Allowlist.
- My monitoring tool gets blocked? Add its address to the Allowlist.