download the new version for windows Screaming Frog SEO Spider 19.3

These two phrases are now commonplace within SEO, but they don’t have an exact definition. This is not the third biggest feature in this release, but it’s important to understand the concept of indexability we have introduced into the SEO Spider, as it’s integrated into many old and new features and data.Įvery URL is now classified as either ‘ Indexable‘ or ‘ Non-Indexable‘. We believe this can be an extremely powerful feature, and we’re excited about the new and unique ways users will utilise this ability within their own tech stacks. This also allows running the SEO Spider completely headless, so you won’t even need to look at the user interface if that’s your preference (how rude!). You can read the full list of commands that can be supplied and how to use the command line in our updated user guide. It behaves like a typical console application, and you can use –help to view the full arguments available. This includes launching, full configuration, saving and exporting of almost any data and reporting. You’re now able to operate the SEO Spider entirely via command line. 2) Full Command Line Interface & –Headless Mode The keen-eyed among you may have noticed that the SEO Spider will run in headless mode (meaning without an interface) when scheduled to export data – which leads us to our next point. This should be super useful for anyone that runs regular crawls, has clients that only allow crawling at certain less-than-convenient ‘but, I’ll be in bed!’ off-peak times, uses crawl data for their own automatic reporting, or have a developer that needs a broken links report sent to them every Tuesday by 7 am. You can also automatically save the crawl file and export any of the tabs, filters, bulk exports, reports or XML Sitemaps to a chosen location. You’re able to pre-select the mode (spider, or list), saved configuration, as well as APIs ( Google Analytics, Search Console, Majestic, Ahrefs, Moz) to pull in any data for the scheduled crawl.

You can now schedule crawls to run automatically within the SEO Spider, as a one off, or at chosen intervals.

In our last release, we announced an extremely powerful hybrid storage engine, and in this update, we have lots of very exciting new features driven entirely by user requests and feedback. We are delighted to announce the release of Screaming Frog SEO Spider version 10.0, codenamed internally as ‘ Liger‘.

Download the new version for windows Screaming Frog SEO Spider 19.3