Common SEO Problems: Crawlability and Indexablity

Many business websites have key problems, such as broken internal links and duplicate title tags, that hamper search engines from being able to crawl and index them effectively, according to recent research from SEMrush.

The report was based on an analysis of the websites of 250,000 businesses operating in a wide range of verticals, including health, travel, and science. The researchers used SEMrush’s Site Audit tool to scan each website for more than 130 common search engine optimization issues. The results were then sorted into three levels of severity: errors (the most critical issues), warnings, and notices (the full methodology and findings are here).

Crawlability problems

The most common major problems impacting crawlability (the visibility of a site to search engines) are 4xx errors, such as 404s (an issue on 47% of sites examined), broken internal links (42%), and incorrect pages in the sitemap (30%).