What it does
Screaming Frog Log File Analyser is a separate desktop SEO application for analyzing server access logs. It reports bot requests, crawl frequency, response codes, redirects and URL-level behavior, and can match those events with imported crawl or URL data.
Compare known pages with recorded bot visits
Obtain server logs for the period being investigated and check that they contain the required request fields, including user agent. In Log File Analyser, choose Project > New, name the project and select its timezone and user agents. Drag the log files into the application, or use Import > Log File.
Next, import a CSV or Excel file of known site URLs through Import > URL Data. URLs must include http:// or https://. A sitemap's URLs need converting to a spreadsheet first; the application does not import the sitemap directly.
In URLs or Response Codes, change the View filter to Matched With URL Data to compare the datasets. Not In URL Data finds recorded requests missing from the supplied page list; Not In Log File finds known pages absent from the supplied logs. An absent request only describes that period and data, not whether the page has ever been crawled.
The free edition analyzes 1,000 log events and saves one project. A single paid license costs GBP 99 per user per year and removes those product limits; practical capacity still depends on local storage. The application runs on Windows, Mac and Linux. Keep the log dates with the findings so a migration or redirect review remains meaningful.
Strengths
- Uses recorded bot requests rather than relying only on a simulated crawl.
- Matches log events with crawl or other URL-based datasets.
Watch out for
- The free edition is limited to 1,000 log events and one project.
- Useful bot analysis requires compatible logs with the necessary request fields.
Best for
- Technical SEO teams checking which pages bots request and how redirects behave
Sources
- Log File Analyser free limits and annual GBP licensing (Oct 27, 2026)
- Log File Analyser project, imports and matched-data filters (Oct 27, 2026)
- Log File Analyser supported data and free application (Oct 27, 2026)
- Log File Analyser FAQ - Screaming Frog (Oct 26, 2026)