DWA Open Data · data APIs on Apify
DATA · Leads & companies

Dead Link Finder (Site Crawl): 404 and Redirect Report

Crawl your website and get one row per broken or redirecting link: 404, 410, 5xx, DNS, timeout, SSL errors, redirect loops and long chains, with source page, anchor text and how many pages link to it. robots.txt honoured.

Who it is for

Sales, growth and RevOps teams building prospect lists, and agencies feeding a CRM with fresh, structured company data.

Pricing

EventPricePer 1,000
Link checkedCharged once per unique URL whose status was actually checked (crawled pages included). Links skipped by robots.txt, exclusions, the external-links switch or the link limit are never charged.$0.0002$0.20
Actor StartCharged when the Actor starts running. Number of events charged depends on Actor memory (one event per GB, minimum one event).$0.00005-

Scheduled change: from Nov 25, 2026 the main event is $0.00325. Prices are read live from the Apify listing at build time.

Input

  • startUrls · Start URLs: Pages to start from, for example https://example.com/. The crawl stays on the same website (www and non-www count as the same site). Several start URLs = several sites in one run.
  • maxPages · Max pages to crawl: How many HTML pages of your site to open and read links from, for example 25 for a quick check or 2000 for a full audit. Links found on those pages are all checked, even when they point to pages beyond this limit.
  • maxLinksChecked · Max links to check: Hard cap on unique URLs checked in one run (crawled pages included), for example 1000. This is also your cost cap: you pay per link checked.
  • checkExternalLinks · Check external links: Also check links that point to other websites (one status request each, never crawled). Turn off to audit internal links only.
  • includeSubdomains · Treat subdomains as internal: When on, blog.example.com and shop.example.com count as part of example.com and get crawled too.
  • checkResources · Also check images, scripts and stylesheets: Check img, script, stylesheet, icon, iframe and media URLs as well as normal links. Finds broken images; adds more links to check.
  • excludeUrlPatterns · Skip URLs containing: URLs that contain any of these texts are skipped and never charged. Use * as a wildcard, for example /wp-admin/, ?replytocom= or https://twitter.com/*.
  • internalRequestsPerSecond · Requests per second to your site: Polite crawl speed on your own site, for example 3. A robots.txt Crawl-delay slows it further (up to 10 seconds between requests).
  • externalRequestsPerMinutePerHost · Requests per minute per external host: Rate limit for each external website you link to, for example 30 per minute, so a page with 200 links to the same site never floods it.
  • maxConcurrency · Max parallel requests: How many requests may be in flight at once across all hosts, for example 8. The per-host limits above still apply.

Use it from an AI agent (MCP)

Add this server URL to Claude, Cursor, VS Code or any MCP client. Authenticate with your Apify account.

https://mcp.apify.com/?tools=transparent_meteorite/dead-link-finder-site-crawl

FAQ

How do I run Dead Link Finder (Site Crawl): 404 and Redirect Report?

Open it on Apify, fill in the input form, and press Start. You can also call it from the Apify API, a schedule, or an AI agent via MCP. Results land in a dataset you can download as JSON, CSV or Excel.

How is it billed?

Pay-per-event on Apify: you are charged only for the events listed in the price table above, plus nothing else from this listing. There is no subscription.

Where does the data come from?

Only publicly available sources. The Actor does not log in to any account or bypass access controls.

Can I use it from an AI assistant?

Yes. Add the MCP URL shown above to any MCP-capable client (Claude, Cursor, VS Code and others) and the Actor becomes a callable tool.