{"id":16538,"date":"2020-01-09T09:00:02","date_gmt":"2020-01-09T07:00:02","guid":{"rendered":"https:\/\/www.reliablesoft.net\/?p=16538"},"modified":"2021-06-26T19:22:39","modified_gmt":"2021-06-26T16:22:39","slug":"soft-404","status":"publish","type":"post","link":"https:\/\/www.reliablesoft.net\/soft-404\/","title":{"rendered":"What are Soft 404 Errors and How to Fix Them (Easy Guide)"},"content":{"rendered":"
One of the steps of technical SEO is to find and fix soft 404 errors. Soft 404 errors can be very confusing because in many cases it\u2019s not clear what the issue is and this makes troubleshooting and fixing a cumbersome process.<\/p>\n
In this guide, you\u2019ll learn everything you need to know about soft 404 errors including what they are, how to find them and how to fix them.<\/p>\n
So, when you log in to your Google search console and see Soft 404 errors<\/em> or Submitted URL Seems to be a soft 404 errors<\/em>, read on to find out what this means and how you can fix them.<\/p>\n A soft 404 error occurs when a page requested by the user cannot be found or is invalid and the server instead of returning the correct HTTP error code (404 or 410 not found), it returns an HTTP status code 200 OK (success).<\/p>\n In simple words, this means that while a page is invalid, instead of giving search engines the correct error code so that they ignore it, your server returns a 200 OK code, which tells them that the page is valid.<\/p>\n As a result, search engines keep crawling these pages and list them in the search results.<\/p>\n Let’s see what are the most common causes of soft 404 errors.<\/p>\n You have pages with no or little content. This makes Google think<\/em> that the page should return a 404\/410 code and not a 200 OK code. An example of this is empty tag pages that display no content.<\/p>\n There is a temporary issue with crawling. When Google tries to crawl the page some of the page resources (CSS, JS) cannot be loaded and as a result, the page comes with no content and this makes Google think that it should be a 404.<\/p>\n Google falsely marks a page as \u2018seems to be a 404\u2019 while there is nothing wrong with the page.<\/p>\n It is important to find and fix soft 404 errors because:<\/p>\n It\u2019s a bad practice<\/strong><\/p>\n A page should return the correct HTTP status code. In the case of missing, invalid or non-existent pages it should either return a 404\/410 (not found), or a 301 (moved) and not a 200 (success code).<\/p>\n It\u2019s a bad user experience<\/strong><\/p>\n You don\u2019t want users to click on a link from search engine results and land on a page on your website that has no or little content and with no value to the user.<\/p>\n Your crawl budget gets wasted<\/strong><\/p>\n Search engines<\/a><\/strong> instead of spending time crawling your important pages, spend time crawling and indexing soft 404 pages.<\/p>\n What is the role of HTTP Status Codes? <\/strong><\/p>\n If you are confused on what are HTTP status codes and what is their role, all you have to know is that it\u2019s a way to help crawlers understand whether their request to fetch a page was a success, failure or something else.<\/p>\n Every time a webpage is accessed by a search engine crawler, the first thing that they check is the HTTP status code. The HTTP response code is a 3-digit number that tells search engines if the page is valid (code 200), not found (404\/410) or moved (301).<\/p>\n The status code is included in the page header and It\u2019s only visible to the crawlers and not to the users.<\/p>\n For a complete list of all HTTP status codes, read this guide<\/a><\/strong>.<\/p>\n<\/div>\n The difference between 404 not found and soft 404 errors is that in the case of 404 not found errors<\/strong> the page is not found and the returned HTTP status code is a 404 or 410 (which correctly corresponds to not found<\/strong>).<\/p>\n In the case of a soft 404 error,<\/strong> the page is not found but instead of returning the HTTP status code 404, the page returns the 200-success code and this is misleading.<\/p>\n In simple words, for both cases, the page response code should have been 404 but that\u2019s not the case with soft 404 errors.<\/p>\n Another major difference is that 404 pages are not indexed by search engines and they won\u2019t appear in the search results but soft 404 pages are indexed by search engines and they may appear in the search results.<\/p>\n Do 404 errors affect your SEO and ranking potential? <\/strong>It depends on the case.<\/p>\n There are valid cases where 404 pages are normal and expected. For example, when a product is no longer available you can display a 404 page to the user to let them know that the particular product is permanently gone.<\/p>\n Another example is when you want to completely remove a page from the search results. By returning a 404-status code, you tell search engines that the page was deleted permanently.<\/p>\n When it comes to soft 404 errors it\u2019s trickier because there are cases that the page is valid but Google thinks that it\u2019s not and cases that the page is not valid and your server returns 200 OK.<\/p>\n In those cases, it\u2019s better to investigate why the errors occur and fix them.<\/p>\n As a general rule of thumb, you should avoid having 404 errors on your site to optimize your crawl budget, avoid confusing search engines and offer users a good experience.<\/p>\n The most reliable way to find 404 errors (both 404 not found and soft 404 errors) is through Google search console and in particular the Coverage Report and the URL Inspection tool.<\/p>\n If you haven\u2019t done so already, the first step is to register your website with Google<\/strong><\/a>.\u00a0 This will give you access to a number of features to improve your SEO.<\/p>\n Make sure that the ERROR tab is selected and look for the following items:<\/p>\n Click on the error description to get more details about the affected pages.<\/p>\n Another way to find the HTTP status response code is to use the URL Inspection tool.<\/p>\n Enter a URL into the URL Inspection tool and click enter.<\/p>\n Click on VIEW CRAWLED PAGE and then MORE INFO.<\/p>\n You will see the HTTP Response as shown in the screenshot above.<\/p>\n What is the difference between \u201cSubmitted URL seems to be a soft 404\u201d and \u201cSoft 404\u201d error codes?<\/strong><\/p>\n Before a page is marked as a Soft 404 by Google, it will first be marked as \u201cSubmitted URL seems to be a soft 404\u201d.<\/p>\n This is done because sometimes soft 404 errors are temporary so before Google makes a final decision, it will first mark pages as \u201cseems to be a soft 404\u201d and if the issue is persistent, they will be marked as a Soft 404.<\/p>\n When a page is marked as Submitted URL seems to be a soft 404 in the ERROR tab, it means that Google will retry to crawl the page and change its status if the page is back online.<\/p>\n When a page is shown under SOFT 404 in the EXCLUDED tab, it means that Google no longer tries to index the page because it is not found or because it has been deindexed using the NOINDEX page directive.<\/p>\n To get rid of soft 404 errors, you can use one of the five solutions below:<\/p>\n Sometimes Google Search Console may incorrectly mark a page as a soft 404 so the first step is to check if that\u2019s the case.<\/p>\n If it\u2019s a valid page of your site and you want this to appear in the search results, click the VALIDATE FIX button.<\/p>\n This action will force Google to recrawl the page and change its status code. This process may take a few days and you\u2019ll be notified by email of the result.<\/p>\n Inspect the page and Test Live URL<\/strong><\/p>\n Another method is to move the mouse over a URL and select INSPECT URL. This will give you more information about the page and the option to REQUEST INDEXING.<\/p>\n Before you do that, you can click the TEST LIVE URL button to force Google to refresh the report.<\/p>\n In many cases, you may find that the page is ok and no further action is required.<\/p>\n In the case that a page is indeed not available or not valid, you should configure your website to return the correct HTTP response code (either a 404 or 410) and resubmit the page to Google using the REQUEST INDEXING button of the URL Inspection tool.<\/p>\n The easiest way to configure your site to return a 404 code for invalid pages is to delete the pages. By deleting the page, your HTTP server will show the 404 pages when a requested URL is not found.<\/p>\n Pro Tip:<\/strong> It is important to have a custom 404 page that gives users options on what they can do next. The 404 page can contain links to your homepage and to your most popular pages and can even contain a search box to help users find what they are looking for.<\/p><\/blockquote>\n This is how my custom 404 page looks like:<\/p>\n In the case that a page is available but Google insists on considering the page as a soft 404, you can improve the page\u2019s content and resubmit the page to Google either through the REQUEST INDEXING button or through VALIDATE FIX.<\/p>\n Usually the above happens when a page has very little content and Google wants to remove the page from its index.<\/p>\n By adding more content, you show search engines that the page has value and the soft 404 error will go away.<\/p>\n Another way to fix a soft 404 error is to redirect the affected page to a valid page. This is done by adding a 301 redirect in your .htaccess file which tells search engines that the page has moved to a new location.<\/p>\n This is how it looks:<\/p>\n Another way to add a 301 redirection is to use Yoast SEO plugin.<\/p>\n When adding a 301 redirection you need to make sure that both pages have similar content.<\/p>\nWhat is a soft 404 error?<\/h2>\n
Soft 404 errors usually happen when:<\/h3>\n
What is important to fix soft 404 errors?<\/h3>\n
What is the difference between 404 Not Found and soft 404 errors?<\/h2>\n
404 Errors and SEO<\/h2>\n
How to find soft 404 errors?<\/h2>\n
Coverage Report<\/h3>\n
\n
\n
URL Inspection Tool<\/h3>\n
\nWhat is Google Search Console<\/strong><\/a> \u2013 What is Google search console and how to use it to improve your SEO.
\nWhat is Technical SEO<\/strong> <\/a>– Everything you need to know about technical SEO (includes a checklist)<\/div>\nSubmitted URL Seems to Be a Soft 404<\/h2>\n
How to fix soft 404 errors<\/h2>\n
\n
Check that the page is indeed a soft 404 or a false alarm<\/h3>\n
\n
Configure your server to return the proper not found error code (404\/410)<\/h3>\n
Improve the page and request indexing<\/h3>\n
\nHow to force Google re-index a page<\/strong><\/a> \u2013 How to use the ‘Request Indexing’ feature to force Google to recrawl and re-index a page.<\/div>\nRedirect the page using a 301 redirection<\/h3>\n
Redirect 301 \/soft-404-page https:\/\/example.com\/new-page-URL<\/code><\/p>\n