Getting Started Guide
Our beginners guide to getting started using the SEO Spider. Including initial set-up, crawling, and viewing reports and issues discovered.
How To Find Broken Links Using The SEO Spider
Learn how to crawl your website and find broken links (404 errors), view which pages link to them, the link text, and export in bulk.
Site Architecture & Crawl Visualisations Guide
Visualise site architecture and internal linking to help communicate ideas and reveal underlying patterns that are harder to uncover in data, and spreadsheets.
How To Compare Crawls
Compare crawls to see how data, issues and opportunities have changed over time to track progress and monitor site health.
How To Crawl Large Websites
Crawl large websites by switching to database storage mode, increasing memory and by configuring the crawl to extract the data you need.
How To Crawl A Staging Website
Find out how to crawl a staging or development website, considering robots.txt, authentication, and the SEO Spider configuration.
How To Automate Crawl Reports In Looker Studio
Learn how to set-up fully automated Google Looker Studio crawl reports to monitor site health, detect issues, & track performance.
How To Audit Core Web Vitals
Analyse which pages pass or fail Google's Core Web Vitals assessment using field data from CrUX to improve page speed.
How to Run the Screaming Frog SEO Spider in the Cloud
Learn how to run the Screaming Frog SEO Spider in the cloud, using Google Compute Engine.
How To Check For Duplicate Content
Minimise duplicate content by identifying exact duplicate pages, and near-duplicate content where some text matches between pages on a website.
How to Work in Teams Using the SEO Spider
Find out the best ways to work collaboratively when using the SEO Spider.
Back to top