Changelog

What's new in Crawly

Every release, documented.

v1.5.0Latest13 May 2026

v1.5.0

What's new

Bulk selection across all tabs

Select rows on any tab and copy, export, or open in bulk. Extend selection to all matching results across pages.

Column resizing everywhere

Drag to resize columns on all tabs, not just All URLs.

Images tab improvements

New File Name column alongside Image Source

Next.js image URLs are automatically decoded to their original paths

Schema.org validation

Validates structured data against 15 rich result types. Issues surface in the Issues tab and All URLs table.

Open Graph auditing

Missing `og:image`, `og:title`, and `og:description` are detected and listed as issues.

MCP server enhancements

Two new tools: `get_linking_suggestions` for internal linking analysis, and `validate_schema` for structured data audits.

Bug fixes and polish

Response Codes tab filter now correctly filters by status group

Database corruption is auto-detected and recovered silently on launch

Header buttons now labelled: New Crawl, History, Settings

Fixed header layout jitter when crawl counts update

Download free

v1.4.012 May 2026

1.4.0

What's new in v1.4.0

Pause/resume crawl - pause any running crawl and resume it later

Re-crawl single page - right-click any URL in the table to re-fetch just that page

Robots.txt viewer - new Robots tab shows raw robots.txt + pages blocked during crawl

AI Tools MCP setup - configure Crawly's MCP server for Claude Code, Cursor, Codex, Windsurf, or any custom tool path

Usage analytics - anonymous PostHog telemetry with opt-out in Settings → Data & Storage

MCP improvements - check_migration_redirects, generate_redirect_map, get_robots tools; maxPages=0 = unlimited; www-redirect crawl fix

v1.3.91 April 2026

v1.3.9

What's new

Settings screen

A new gear icon in the header opens the Settings panel, with sections for Crawl Defaults (max pages, user agent, crawl speed), Data and Storage (clear history, open DB folder), Claude Code integration, and Legal.

Response Codes tab

A dedicated tab showing a breakdown of all status codes (2xx, 3xx, 4xx, 5xx) with filterable cards and a full URL table including status text and indexability.

Headings tab

Browse all H1s and H2s across your crawl. Filter by Missing H1, Duplicate H1, or Missing H2. H1 length is highlighted when over 70 characters.

External Links tab

All outbound external links in one place, with source page and anchor text. Filterable and exportable.

URL bar in header

A permanent address bar lets you kick off a new crawl from anywhere in the app - just type a URL and press Enter or click Start.

Unlimited crawl pages

Toggle between a page limit and unlimited crawling in both the New Crawl modal and Settings. Unlimited crawls will spider the entire site.

MCP server improvements

User agent picker, URL prefix scoping, and depth filter in `get_pages`

Inline crawl summary and status text in results

Bot detection guidance - tips when a site appears to be blocking crawlers

`meta_too_long` filter, grouped duplicate detection, page cap warning

Inlinks surfaced directly in issue results

`fetch_as_markdown` crash fix when a single URL string is passed instead of an array

Bug fixes

Fixed a crash on macOS when clicking the dock icon after the app was already open

Canonicalised pages are no longer flagged as duplicate titles or duplicate H1s

DB syncs automatically when the app regains focus, so crawls started from the CLI or MCP server appear without needing a restart