The Screaming Frog SEO Spider is small desktop program you can install on your PC which spiders Web site links, images, CSS, script and apps. It also fetches key onsite page elements for SEO, presents them in tabs by type and allows you to filter for common SEO issues, or slice and dice the data how you see fit by exporting and importing into Excel.
You can view, analyze and filter the information as its gathered and updated continuously in the programs user interface. The Screaming Frog SEO Spider allows you to quickly analyze or review a site from an onsite SEO perspective. Its particularly good for analyzing medium to large sites where manually checking every page would be extremely labor intensive and where you can easily miss a redirect, meta refresh or duplicate page issue. The spider allows you to export key onsite SEO elements (URL, page title, meta descriptions, headings) to Excel so it can easily be used as a base to make SEO recommendations from.