6 issues that occur when Googlebot cannot crawl your web site – ewebgod

Blocked Robot.jpeg

Ever puzzled what would occur if you happen to prevented Google from crawling your web site for a number of weeks? Technical search engine optimisation skilled Kristina Azarenko has printed the outcomes of such an experiment.

Six stunning issues that occurred. What occurred when Googlebot couldn’t crawl Azarenko’s website from Oct 5 to Nov. 7:

  • Favicon was faraway from Google Search outcomes.
  • Video search outcomes took a giant hit and nonetheless haven’t recovered post-experiment.
  • Positions remained comparatively steady, besides have been barely extra unstable in Canada.
  • Visitors solely noticed solely a slight lower.
  • A rise in reported listed pages in Google Search Console. Why? Pages with noindex meta robots tags ended up being listed as a result of Google couldn’t crawl the location to see these tags.
  • A number of alerts in GSC (e.g., “Listed, although blocked by robots.txt”, “Blocked by robots.txt”).

Why we care. Testing is an important aspect of search engine optimisation. All adjustments (intentional or unintentional) can impression your rankings and visitors and backside line, so it’s good to grasp how Google might presumably react. Additionally, most firms aren’t in a position to try this type of an experiment, so that is good data to know.

The experiment. You possibly can learn all about it in Surprising Outcomes of My Google Crawling Experiment.

One other comparable experiment. Patrick Stox of Ahrefs has additionally shared outcomes of blocking two high-ranking pages with robots.txt for 5 months. The impression on rating was minimal, however the pages misplaced all their featured snippets.


New on Search Engine Land

In regards to the creator

Danny Goodwin

Danny Goodwin has been Managing Editor of Search Engine Land & Search Advertising Expo – SMX since 2022. He joined Search Engine Land in 2022 as Senior Editor. Along with reporting on the most recent search advertising and marketing information, he manages Search Engine Land’s SME (Topic Matter Knowledgeable) program. He additionally helps program U.S. SMX occasions.

Goodwin has been modifying and writing in regards to the newest developments and developments in search and digital advertising and marketing since 2007. He beforehand was Govt Editor of Search Engine Journal (from 2017 to 2022), managing editor of Momentology (from 2014-2016) and editor of Search Engine Watch (from 2007 to 2014). He has spoken at many main search conferences and digital occasions, and has been sourced for his experience by a variety of publications and podcasts.

#occur #Googlebot #crawl #web site

Leave a Reply

Your email address will not be published. Required fields are marked *