Crawling Challenges: What the 2025 Year-End Report Tells Us.
About this episode
Join Martin and Gary as they dive into Search Off the Record's Episode 103, unpacking the 2025 Year-End report on crawling issues. Discover fascinating insights on faceted navigation, action parameters, irrelevant parameters and more, highlighting the biggest challenges faced by web crawlers last year. With humor and expert analysis, this episode reveals critical takeaways for webmasters and SEO professionals. Don't miss valuable tips to enhance your site's crawl efficiency!
Resources:
URL structure best practices for Google Search → https://developers.google.com/search/docs/crawling-indexing/url-structure
Crawling December: Faceted navigation →
https://developers.google.com/search/blog/2024/12/crawling-december-faceted-nav
Xkcd (programmer humor) →
Get every episode summarized
Each time Search Off the Record publishes, we email you a written briefing from the transcript — the topics, who appeared, and any specific claims, with the ad reads skipped.
Email me new episodesFree for 3 shows. No card needed.
Hosts & guests
No transcript yet
This episode has not been transcribed. Request it and it moves to the front of the queue.
More episodes
More from Search Off the Record
Are websites getting "fat"? Page weight, HTML size & Googlebot limits explained...
Search Off the Record
Are websites getting "fat"? Page weight, HTML size & Googlebot limits explained
Search Off the Record
Google crawlers behind the scenes - transcript
Search Off the Record
Google crawlers behind the scenes
Search Off the Record