duplicate-content

SEO Macroscope is a website scanning tool, to check your website for broken links; including some technical SEO functionality, site scraping, Excel reporting, and more.

Uses Screaming Frog Internal HTML with text extraction along with a shingling algorithm to compare content duplication across the pages of a crawled site.

My aim to make search engine optimization (SEO) easy. This tool provides simple, professional-quality SEO analysis and critical SEO monitoring for websites. By making our tools intuitive and easy to understand, we've helped thousands of small-business owners, webmasters and SEO professionals improve their online presence.

Detect duplicate and near-duplicate content across your built static site: identical or near-identical titles, meta descriptions and page bodies (shingles + MinHash), site-name-only title differences and boilerplate-heavy pages. Text/JSON/SARIF/Markdown, allowlist with expiry, GitHub Action. Zero deps.

Check canonical tags and hreflang clusters in your built static site: missing, multiple, relative or in-body canonicals, targets that are missing, noindex or chained, and hreflang codes, self-references, return links and x-default. Text/JSON/SARIF/Markdown, allowlist with expiry, GitHub Action. Zero deps.

SQL workflow (DuckDB + GSC BigQuery export) to find duplicate content, competing URLs, and keyword cannibalization on large sites

WordPress plugin to detect and manage duplicate content across posts and pages

Find near-duplicate pages, repeated sections and similar titles across a sitemap, without template boilerplate.

Free, open-source content cannibalization audit tool: find duplicate and near-duplicate pages with AI embeddings, grouped by topic in one Excel file.