How to Identify and Resolve Scanner Timeouts
An overview on identifying and resolving scanner timeouts or when pages are being blocked from scanning.
User Agent
How to exclude Pope Tech user agents from Google Analytics
Organizations who wish to exclude Pope Tech web requests from their Google Analytics data can do this utilizing filters in their Google Analytics admin settings. To do so, follow the instructions below: Navigate to the Admin tab Select Filters in the View column Select + Add Filter Enter a name in the Filter Name field, such as “Pope Tech Accessibility Scanning User-Agent”…
Forbidden by robots.txt
Forbidden by robots.txt is the most common crawl error type. The Pope Tech crawler respects your robots.txt file. To get around this simply update the robots.txt file found on yourdomain.com/robots.txt. You can leave it to block other bots but add in a line to specifically allow the Pope Tech user agents. Example robots.txt entry: User-agent:…