{"id":15688,"date":"2019-10-01T09:00:20","date_gmt":"2019-10-01T06:00:20","guid":{"rendered":"https:\/\/www.reliablesoft.net\/?p=15688"},"modified":"2021-06-23T19:18:05","modified_gmt":"2021-06-23T16:18:05","slug":"force-google-crawl-a-site","status":"publish","type":"post","link":"https:\/\/www.reliablesoft.net\/force-google-crawl-a-site\/","title":{"rendered":"How and When to ask Google Recrawl my Site?"},"content":{"rendered":"
Google is doing a great job in discovering new websites and content but sometimes it\u2019s for your benefit to force Google to crawl your website, either all of it or individual pages.<\/p>\n
In this post, you\u2019ll learn when<\/em> and how<\/em> to ask Google to re-crawl your whole site or individual pages.<\/p>\n Forcing Google to recrawl and re-index your website is not something you need to do on a regular basis. But, there are some cases that requesting a site recrawling, will speed up the process and get your changes in Google\u2019s index faster.<\/p>\n Site-Wide Changes<\/strong><\/p>\n When you make significant changes to a website that affect all pages. For example, changing your website\u2019s URL structure or migrating from http to https<\/strong><\/a> is a good idea to request a re-indexing of your website.<\/p>\n Domain Transfer<\/strong><\/p>\n When changing domains, it\u2019s a good practice to ask Google to crawl both websites so that they can update their index faster.<\/p>\n Re-Branding<\/strong><\/p>\n When you do a re-branding of your business, without necessarily changing domains, you can request a re-index. In this case re-branding refers to substantially changing your page titles, site structure and URLS.<\/p>\n After a Website Redesign<\/strong><\/p>\n Major site redesigns that involve changing themes, removing or adding JavaScript\/html code or substantial changes to menu structure, is a good reason to use the re-index website function.<\/p>\n After a Content Audit<\/strong><\/p>\n After a thorough content audit, you most probably have a number of pages that are removed, changed or redirected and this is a valid reason to let Google know instead of waiting for Google crawlers to find out.<\/p>\n Recovering from a Google Penalty (some cases)<\/strong><\/p>\n When your website is penalized by Google<\/strong><\/a>, the normal course of action is to make the necessary changes and submit a reconsideration request (in case of manual penalties) or wait for the next update (in case of algorithmic penalties), to find out if your site recovered or not.<\/p>\n There some cases though that requesting a site re-indexing, speeds up the process.<\/p>\n For example, if you are penalized because of too many ads (ad heavy penalty), you can make the necessary changes to comply with recommended practices and ask Google to index your website again.<\/p>\n By doing so, it does not guarantee that you will be freed from the penalty immediately but it can potentially speed up the process.<\/p>\n Recommended Reading: Knowing how search engines work<\/a><\/strong> will help you understand how the crawling and indexing process works and why asking Google for a recrawl maybe beneficial for you.<\/p><\/blockquote>\n Besides asking Google to recrawl ALL your URLS, you can force a recrawl of individual pages.<\/p>\n Valid cases where you can ask Google to recrawl individual pages of your website are:<\/p>\n Time Sensitive Posts<\/strong><\/p>\n When you publish a post that is trending at the moment, you can use the \u2018Request Indexing\u2019 feature to get your post indexed faster. For example, breaking news or \u2018happening now\u2019 type of articles.<\/p>\n Adding structured data to a post <\/strong><\/p>\n When you add schema markup<\/strong><\/a> to an existing post, you can request Google to re-index the page.<\/p>\n For example, after adding the FAQ schema markup to some of my posts and requested indexing, the page got re-indexed with the new information in less than 30 minutes.<\/p>\n Making significant changes to a page\u2019s content<\/strong><\/p>\n When during a content review you change or update the content of a post significantly, you can ask Google to re-index the particular post. This will certainly help getting the new content in Google\u2019s index faster.<\/p>\n Changing the post title or meta description of an important post<\/strong><\/p>\n When you change the page title or meta description of a post that already has rankings and gets traffic, you can use the re-indexing feature to let Google know about your changes.<\/p>\n For example, when you change the meta description length<\/a><\/strong> of a popular post to comply with the new standards, you can request a re-index and you will notice that your search snippets will be updated in a matter of hours.<\/p>\n Note: I\u2019m not suggesting that you should use this feature every time you change a post title or description. Use it wisely and only on important posts because as you will read below, there are limits on how many times you can force Google to re-index a page.<\/p><\/blockquote>\n The best way to ask Google to re-index your website is by using the URL Inspection tool, available in Google Search Console.<\/p>\n If for some reason you don\u2019t have a Google Search Console account, you can use the second method below.<\/p>\n Method 1 \u2013 URL Inspection Tool<\/strong><\/p>\n Step 1: The first step is to add your website to Google search console<\/strong><\/a>. Among other features, you will get access to the URL inspection tool.<\/p>\n Step 2: Click on the URL INSPECTION TOOL option from the left menu<\/p>\n Step 3: Type your full domain name in the specified area and click ENTER<\/p>\n Step 4: Click on the REQUEST INDEXING option.<\/p>\n Method 2 \u2013 Ping Tool<\/strong><\/p>\n Step 1: Open a new browser window and paste the following URL: Make sure that you replace ‘path to sitemap file’ with the full url of your sitemap.<\/p>\n For example: Once submitted you will get a \u2018sitemap notification received\u2019.<\/p>\n Recommended Reading: How to optimize your XML Sitemap for SEO<\/a><\/strong>.<\/p><\/blockquote>\n The best and only way to force Google to recrawl an existing page is to use the URL Inspection tool, available in Google Search Console.<\/p>\n Step 1: Login to Google search console<\/p>\n Step 2: Click on the URL INSPECTION TOOL option from the left menu<\/p>\n Step 3: Type the full URL of the individual space in the specified area and click ENTER<\/p>\n Step 4: Click on the REQUEST INDEXING button.<\/p>\n Google has removed from their documentation any information regarding crawl limits but they have confirmed via twitter that there are still limits on how many times you can use the request indexing function for the site as a whole or for individual pages.<\/p>\n Before removing it, the crawl limits where:<\/p>\n It depends on the case. For content changes, it may take from a few days to a few weeks.<\/p>\n For structure data related changes, the results are almost immediate. It took just 10 minutes for Google to take into account the FAQ related schema I added to this page<\/a><\/strong>.<\/p>\n You can use the URL Inspection tool and Index Coverage reports of Google Search Console to monitor progress.<\/p>\n Google is very good in discovering new pages or changes to existing pages but you have the chance to speed up this process by using any of the methods described above.<\/p>\n Do not use the above methods every time you publish a new post but use them wisely and when it really matters.<\/p>\n Don\u2019t submit a request indexing for the same page more than once, it won\u2019t make a difference.<\/p>\n How long it will take for Google to recrawl your website depends on the kind of changes you made. For some cases, you can get an updated version of your page in Google\u2019s index in less than 30 minutes.<\/p>\n\n
When to ask Google to recrawl your site?<\/h2>\n
When to ask Google to recrawl individual pages?<\/h2>\n
How to ask Google to re-index my website?<\/h2>\n
http:\/\/www.google.com\/ping?sitemap='path to sitemap file'<\/code><\/p>\n
http:\/\/www.google.com\/ping?sitemap=https:\/\/example.com\/sitemap.xml<\/code><\/p>\n
How to ask Google to re-index a particular page?<\/h2>\n
Is there a limit on how many times to request indexing?<\/h2>\n
\n
How long will it take for Google to re-index my page or site?<\/h2>\n
Key Learnings<\/h2>\n