Screaming Frog
SEO Spider

The laptop-based SEO crawler that lets a one-person shop deliver agency-grade technical audits without agency overheads. Bill more, expense less — runs on Windows, macOS and Linux off a single licence.

Windows Windows macOS macOS Linux Linux
Screaming Frog SEO Spider screenshot

SEO Spider Tool

For an independent consultant, the Screaming Frog SEO Spider turns a client's messy site into a clear, billable list of fixes — an SEO crawler that does the audit grunt work while you keep the relationship.

Pitching a prospect? Crawl 500 URLs free — no sign-up, no expiry — to scope the job before you quote. Each pass surfaces 300+ technical, on-page, speed and content issues you can package straight into a deliverable.

500
URLs crawlable free
300+
SEO issues identified
10+
years of development
v24.0
latest version

Download Screaming Frog SEO Spider — Versions 19 to 24

Grab any release at no cost — handy when a client is still on an older build. Every version audits up to 500 URLs free, with no sign-up, no registration and no time limit.

v23.0

Insight Audits & Semantic Rules

  • Lighthouse & PSI updated to Insight Audits
  • Ahrefs v3 API integration
  • Crawl retention auto-delete settings
  • Semantic similarity embedding rules
  • All links displayed in visualizations
  • Links in Semantic Content Cluster Diagram

+ v23.1 (Nov 2025), v23.2 (Dec 2025), v23.3 (Feb 2026)

v22.0

Semantic Analysis & AI Improvements

  • Semantic Similarity Analysis
  • Semantic Content Cluster Visualisation
  • Advanced column configurator
  • Custom multi-export functionality
  • Export to multiple tabs in one workbook
  • Download multiple XML sitemaps
  • Download from Google Sheets · APIs mode
v21.0

Direct AI API Integration

  • AI integration: OpenAI, Google Gemini & Ollama
  • Generate & classify content with AI in-app
  • Accessibility auditing tab
  • Email notifications for completed crawls
  • Custom search bulk upload
v20.0

Custom JS Snippets & Mobile Audits

  • Custom JavaScript Snippets execution
  • Mobile Usability Auditing
  • N-grams content analysis
  • Aggregated Anchor Text reporting
  • Local Lighthouse integration
  • Carbon Footprint & Rating assessment
v19.0

UI Refresh & 3D Visualizations

  • Redesigned UI and updated interface
  • Unified configuration settings panel
  • Segments functionality for filtered analysis
  • Visual Custom Extraction
  • 3D site visualizations
  • New filters and issue categories

Release Timeline — v19 to v24

v24.0 MCP Integration · Auto Compare · Arm64 Linux
v23.3 Bug fixes & stability
v23.2 Bug fixes
v23.1 Bug fixes & stability
v23.0 Insight Audits · Ahrefs v3 · Semantic Rules
v22.0 Semantic Analysis · Content Clusters · APIs Mode
v21.0 AI API Integration · Accessibility · Email Notifications
v20.0 Custom JS Snippets · Mobile Usability · Carbon Footprint
v19.0 UI Refresh · Segments · 3D Visualizations

Billable wins you can find in one crawl

Spot 300+ SEO issues, warnings and quick wins you can write up as line items on the next client invoice.

Find Broken Links

Find Broken Links

Surface every 404 and server error, then hand the client's developer a tidy export of source URLs — no back-and-forth.

Audit Redirects

Audit Redirects

Trace 301s, 302s, chains and loops, or paste a client's old URL list to sign off a migration before it goes live.

Analyse Metadata

Analyse Page Titles & Meta Data

Flag titles and descriptions that run long, fall short, go missing or repeat — the on-page rewrites clients notice fastest.

Duplicate Content

Discover Duplicate Content

Catch exact duplicates by MD5 hash, near-duplicate titles and headings, plus thin pages worth consolidating.

Custom Extraction

Extract Data with XPath

Pull whatever a client brief needs from the HTML with CSS Path, XPath or regex — prices, SKUs, author bylines, social tags.

Robots Directives

Review Robots & Directives

Check what robots.txt, meta robots and X-Robots-Tag are quietly blocking, alongside canonicals and hreflang.

XML Sitemaps

Generate XML Sitemaps

Build clean XML and Image XML sitemaps for a client in minutes, with full say over URLs, last-modified, priority and change frequency.

Google API Integration

Integrate with GA, GSC & PSI

Plug a client's Google Analytics 4, Search Console and PageSpeed Insights into the crawl so every URL carries real traffic context.

JavaScript Crawling

Crawl JavaScript Websites

Render with the built-in Chromium engine so you can audit that React, Angular or Vue.js client build the same as any static site.

Site Architecture

Visualise Site Architecture

Turn internal linking into force-directed diagrams, tree graphs and 3D views that make a tricky structure obvious in a client meeting.

Schedule Audits

Schedule Audits

Set recurring crawls to run while you sleep and auto-export to Google Sheets or the command line — retainer reporting on autopilot.

Compare Crawls

Compare Crawls & Staging

Show a retainer exactly what improved since last month, and vet staging against production before sign-off with URL Mapping.

One crawl, a full audit deliverable across every SEO dimension

Technical

  • 404 errors and broken links
  • Looping and chained redirects
  • robots.txt-blocked resources
  • Mixed-content over HTTPS
  • Hreflang and multi-region setup
  • Paginated rel=next/prev sequences

On-Page SEO

  • Meta descriptions and page titles
  • Heading order — H1, H2 and below
  • noindex flags and canonical tags
  • Duplicate and near-duplicate copy
  • Low-content and thin pages
  • schema.org structured data

Performance & UX

  • Core Web Vitals via PSI/Lighthouse
  • Mobile-usability checks
  • Carbon footprint rating
  • AMP page validation
  • Accessibility checks
  • Alt text and image weight

Analysis & AI

  • Anchor text and internal links
  • N-gram content breakdown
  • Semantic similarity scoring
  • Content-cluster diagrams
  • Crawl-to-crawl tracking
  • AI drafting via OpenAI/Gemini

What solo consultants say

★★★★★

"It's just me and a laptop, so every tool has to earn its keep. Screaming Frog is the one subscription I'd never drop — one crawl scopes a new client and basically writes the first half of my audit for me."

Dylan Okafor
Dylan Okafor Freelance SEO Consultant, Bristol
★★★★★

"I went solo last year and worried I'd look small next to agencies. Honestly the Screaming Frog SEO Spider levels the field — clients see the same depth of audit, and the £199 licence pays itself back on the first project."

Priya Nair
Priya Nair Independent SEO, Manchester
★★★★★

"Running a one-person shop means I bill by the hour, and this SEO crawler buys me hours back. Scheduled crawls land overnight, so a retainer's monthly report is half-built before I open my coffee."

Marco Ferraro
Marco Ferraro Solo SEO Contractor, Austin
★★★★★

"I keep one licence across my desk Mac and travel laptop, so I can run a quick technical SEO audit from a client's office or a coffee shop. For a freelancer that flexibility is worth more than any cloud platform."

Hannah Bergström
Hannah Bergström Freelance Technical SEO, Berlin
// The freelancer's field guide · 2026

Screaming Frog SEO Spider: how one freelancer out-audits a whole agency

If you run a one-person SEO practice, the Screaming Frog SEO Spider is probably the single piece of software standing between a vague client brief and a deliverable you can actually charge for. Made in the UK by Screaming Frog Ltd, this SEO crawler walks a client's site exactly as a search engine would, then dumps the findings — dead links, redirect chains, absent titles, thin pages, sluggish Core Web Vitals and 300+ more defects — into exports you shape into a paid audit, all from the laptop on your desk.

The economics suit a solo budget. One £199-a-year licence travels across two machines, so there are no seat fees, no per-client add-ons and no metered cloud bill eating the margin on a small retainer. Before any of that, the free build lets you crawl 500 URLs free with no sign-up — plenty to size up a prospect and quote with confidence. This guide covers what the tool does day to day for an independent, the v24 features worth your billable hours, where screaming frog pricing sits, and a repeatable on-page workflow.

Freelancer's quick answer: the free SEO spider scopes a prospect at 500 URLs with no sign-up. Step up to the £199/yr licence and you lose the URL ceiling and gain JavaScript rendering, custom extraction, scheduled crawls and API integrations — spread across two machines.

At your kitchen-table desk

What is Screaming Frog when you're the whole team

What is screaming frog for a freelancer? It's a desktop SEO spider that takes one client site at a time, renders the JavaScript through a bundled Chromium engine, and writes a full URL inventory — flagged with every problem it found — straight to your own drive. Nothing waits in a cloud queue, nothing locks behind a higher tier, and there's no support ticket to file just to raise a row limit.

Each run of the screaming frog seo tool catalogues 300+ issue types: titles, meta descriptions, headings, canonicals, hreflang, structured data, internal links, redirects, response codes, page speed and rendered DOM weight. That's work you'd otherwise split across a sitemap builder, a link checker, a redirect mapper, a schema tester and a log analyser — five line items on five different bills. For a solo practitioner, seo screaming frog becomes the one local source of truth you can open live on a client call and defend on the spot.

Version 24 · May 2026

The v24 features that earn back your billable hours

The May 2026 release is the most useful update since JavaScript rendering arrived. Three of the new screaming frog seo spider features matter most when there's no junior to delegate to and every hour is on the clock.

MCP integration

Wire the crawler into Claude, LM Studio or Cursor and brief it in plain English. It's the analyst you'd hire if you had headcount — a research sidekick on your terms, no payroll, no onboarding.

Auto Compare Crawls

Queue the weekly client crawl and the week-over-week diff is waiting in your inbox before the Monday catch-up. Talk a retainer through what's fixed — no spreadsheet rebuilt by hand.

Find Uncrawlable Links

A fresh report calls out JavaScript-injected URLs the spider can't follow and malformed addresses such as hppts://example.com. Precisely the slip a client pays you to catch before a launch goes wrong.

Day-to-day staples: beyond v24, the kit a freelancer leans on includes JavaScript rendering via the bundled Chromium WRS for React, Angular, Vue and Next.js builds; custom extraction using XPath, CSS Path or regex to lift any DOM element into its own column; and the GA4, Search Console and PageSpeed Insights APIs, which layer a client's traffic, CTR and Core Web Vitals onto each crawled URL in a single view.

There's a structured-data validator for schema.org and Google rich-result checks, plus a companion log-file analyser for the moment a client asks why Googlebot keeps skipping their category pages — a crawl-budget answer you can give without subcontracting it out.

Pricing

Screaming Frog pricing that a solo P&L can love

Screaming frog pricing hasn't budged since 2017 — and predictable costs are a gift when you're forecasting a freelance year. Use the free tier to win the work, then let the £199 licence (which spans your desk and travel machines) clear its own cost on the very first proper audit.

Free forever
£0/yr · no sign-up

Screaming Frog Free

Up to 500 URLs a session — ample for sizing up a lead or auditing a small brochure site. You still get the core reports (titles, meta, headings, redirects, response codes, canonicals), the XML sitemap generator and native Mac, Windows and Linux builds. Nothing counts down, nothing expires, and there's no sign-up wall.

Pro licence
£199/yr · ~$250 USD

Screaming Frog Paid

The URL ceiling disappears, and you unlock JavaScript rendering (Chromium WRS), custom extraction (XPath, regex), the GA4, Search Console and PageSpeed Insights APIs, scheduled crawls and Auto Compare. The single licence runs on two machines at once — the classic freelance pairing of a desk Mac and a travel Windows laptop, with no extra seat to buy.

Cross-platform

Screaming Frog on whatever's in your bag

The screaming frog seo spider ships as a native build for Mac, Windows and Linux, and the feature set is identical on each. For a freelancer juggling two machines, the only things that change are the install path and how much memory the app grabs by default.

Screaming Frog on MacUniversal binary · M1 → Tahoe

It's a notarised universal binary covering macOS Monterey (12) up to Sequoia (15) and macOS Tahoe (26). If your main rig is an Apple Silicon Mac, JavaScript-rendered crawls fly — an M3 Pro chews through a 100k-URL JS site in about half the time of a similarly-clocked Intel Core i9, which is real money when you bill by the hour.

The default 2 GB memory cap is easy to lift under Configuration → System → Memory. You'll find the app at /Applications/Screaming Frog SEO Spider.app and its database tucked under ~/Library/Application Support/Screaming Frog SEO Spider/.

Screaming Frog on Windows64-bit Win 10 & Win 11

On the road, Windows 10 and 11 (64-bit only) run the same build. It also opens at a 2 GB memory cap, lifted in that same Configuration → System → Memory dialog, and a typical workstation happily takes the allocation up to 16 GB for a heavier client crawl.

The installer lands in C:\Program Files (x86)\Screaming Frog SEO Spider\ with the database under %APPDATA%\Screaming Frog SEO Spider\. Nothing is missing versus the Mac — every report, every integration behaves the same, so you can quote a client the same audit whichever laptop is open.

vs the alternatives

Screaming Frog vs Ahrefs, SEMrush, SE Ranking, DeepCrawl

Clients love to ask screaming frog vs ahrefs, ahrefs vs screaming frog or screaming frog vs semrush — but they're rarely the same kind of tool. As a freelancer watching every subscription line, it helps to know which one to pay for and which to skip. Here's the honest read.

vs Ahrefs
Is ahrefs like screaming frog? Not really. Ahrefs is a subscription cloud suite — backlink index, keyword data, rank tracking. Its Site Audit overlaps most, but it lives on Ahrefs' servers and meters audits by quota. The SEO spider does no research at all; it only crawls, yet it crawls without a quota in sight. A freelancer often keeps Ahrefs monthly for research and the crawler year-round for audits.
vs SEMrush
Overlaps only at the audit edge Screaming frog vs semrush — only SEMrush's Site Audit module sits in the same lane. The rest of SEMrush (keyword research, competitor digging, PPC) is territory the crawler never enters. For a solo, that often means a short SEMrush stint per project rather than a year-round seat.
vs SE Ranking
Budget cloud suite, still not a crawler Se ranking vs screaming frog — SE Ranking is the wallet-friendly answer to Ahrefs and SEMrush, cloud-hosted, with its own Site Audit going up against the crawl-only seo screaming frog. Same trade as the others: capped cloud audits versus unlimited crawls running off your laptop.
vs DeepCrawl
Closest match, priced for big teams Screaming frog vs deepcrawl (now Lumar) is the one genuine like-for-like — DeepCrawl is a cloud enterprise crawler with unlimited URLs, scheduling and team workflows. As a screaming frog alternative it only earns its keep past the million-URL mark; for the sites a freelancer typically handles, the desktop tool is quicker and far cheaper per crawl.
A repeatable client workflow

How to use Screaming Frog to improve on page SEO

Here's the five-step routine I run on a new client — how to use screaming frog to improve on page seo without burning a whole billable day on a mid-sized site.

Crawl with JavaScript rendering on

Flip Configuration → Spider → Rendering → JavaScript before you crawl the live domain. It's the only way to see the content a modern CMS injects after load — and what the client's framework actually serves Google.

Pick off the three biggest issue buckets

Head to Reports → Crawl Overview. It's almost always missing meta descriptions, duplicate titles and broken internal links. Export each, fix them in the CMS, then re-crawl staging to prove the change landed.

Layer on the client's GA4 & Search Console

Under Configuration → API Access, pull in impressions, CTR and sessions per URL. Now you can steer rewrites toward the pages that actually earn the client traffic — not just the ones that look broken.

Ship a clean XML sitemap

From Sitemaps → XML Sitemap, generate off the tidy crawl, drop redirected and 404 URLs, and submit it to Search Console as a visible quick win for the client.

Put a weekly Auto Compare on autopilot

Schedule a recurring crawl with Auto Compare turned on. New issues hit your inbox the day they appear, so you spot a client's regression before they email you — same on Mac and Windows.

Done well, an hour's crawl becomes a rankings move you can point to at renewal time. Grab the latest build below for Mac, Windows or Linux and run your first audit today.

Crawl 500 URLs free — scope your next client today

The SEO crawler that punches well above a one-person budget. No sign-up, no card. Ready for Windows, macOS and Linux.

Free Download — v24.0
Windows macOS Linux

Free · 500 URLs per crawl · No sign-up, no card

Frequently asked questions

For a small site, yes. The free Screaming Frog SEO Spider downloads with no sign-up, no registration and no expiry, crawls up to 500 URLs, and bundles the core audit reports — enough to scope a prospect or audit a brochure site before you ever pay a penny.
The free build caps at 500 URLs per session — fine for testing or a tiny site. The moment a client site runs larger, or you need JavaScript rendering, custom extraction, API data and scheduled crawls, the £199/yr licence pays for itself on a single proper audit. No sign-up needed to start on free.
Yes — a single licence covers two machines, which is the usual freelance setup. Screaming Frog SEO Spider is a 64-bit app for Windows, macOS and Linux (with native Arm64 Linux from version 24), and one download serves all three platforms, so your Mac and your Windows laptop stay in sync.
v24.0 (19 May 2026) is full of time-savers for a one-person shop: MCP (Model Context Protocol) so AI tools can drive the crawler, Auto Compare Crawls and email change summaries with attachment exports for hands-off retainer reporting, uncrawlable-link detection, a usage-stats dashboard and native Arm64 Linux support.
Yes. A built-in Chromium Web Rendering Service (WRS) lets the SEO crawler render and audit JavaScript sites — React, Angular, Vue.js, Next.js and the rest — so you can take on modern-stack clients with confidence. Rendering is a per-crawl toggle, so plain HTML sites stay fast.
Yes. Connect the Google Analytics 4, Search Console and PageSpeed Insights APIs and every crawled URL carries the client's real traffic, impressions, click-through rate and Core Web Vitals — so your audit recommends fixes where the data says they'll actually pay off.