v0.6.6: Redirected Pages Excluded from SEO Checks
Redirected pages are no longer flagged as SEO issues. Pages with redirect chains are excluded from SEO analysis in both CLI and desktop.
What’s New in v0.6.6
Redirected Pages Excluded from SEO Checks
Fixed false positives in SEO analysis caused by redirected pages. Pages that redirect to another URL have no content of their own, but they were still being checked for missing titles, missing descriptions, and other content-related SEO issues. This produced noisy, misleading results on sites with many redirects.
The SEO filter in both the CLI (crawler seo) and the desktop app now skips any page with a non-empty redirect chain. Only final destination pages with actual content are analyzed.
What Changed
Previously, the SEO analysis filtered pages by status code (2xx) and content type (text/html). Redirected pages passed this filter because the crawler stores the final response data under the original URL. Now, pages with a redirect chain are excluded before any SEO checks run.
Who Benefits
- SEO professionals get cleaner reports without redirect noise cluttering the issue list
- Content teams can focus on real SEO problems instead of triaging false positives
- CLI users running
crawler seoon large sites with many redirects see accurate issue counts
Related
About crawler.sh
crawler.sh is a fast Rust-based web crawler and SEO auditing tool that runs entirely on your own machine. Use the CLI for automation, scripts, and CI pipelines, or the desktop app for a visual dashboard with live crawl progress, SEO issue charts, and one-click exports.
Every release ships across both the CLI and the desktop app.
Download the latest version
or run crawler update
from the terminal to upgrade an existing install.
