Zhivko

Member
Joined
Mar 15, 2019
Messages
51
Reaction score
20
I am trying to convince Google to drop about 3000 URLs from their index.
  • Some of them I marked with 404,
  • some of them I marked with "noindex",
  • some of them I redirected.
This happened in February, more than 2 months ago. Google keeps crawling those URLs (even thought here are NO internal links to them!) and keep showing them in the GSC.

I don't want to spend a few days manually sending each of those URLs for removal in the GSC. But I don't want to wait years for Google to realise those URLs no longer exist.

Any ideas?
 

djbaxter

Administrator
Administrator
Moderator
Joined
Jun 28, 2012
Messages
3,521
Reaction score
1,664
Use a 410 error code instead of 404.

404 means "not found".

410 means "permanently removed".

List of HTTP status codes - Wikipedia
410 Gone Indicates that the resource requested is no longer available and will not be available again. This should be used when a resource has been intentionally removed and the resource should be purged. Upon receiving a 410 status code, the client should not request the resource in the future. Clients such as search engines should remove the resource from their indices.

Add this to your .htaccess file:

Code:
# need to 410 these URLs
Redirect 410 {old URL}
 

Tiggerito

Member
Joined
May 5, 2016
Messages
41
Reaction score
22
Google will check pages it knows about for a long time. It does not mean they are in the search index. It just means Google is aware of them and wants to see how they behave every once in a while.

If a page returns 404 or 410, then it is removed from the index. But Google will check every once in a while, because things change.

If it's marked as noindex, it is removed from the index, but Google will check every once in a while.

If it redirects.... you get the picture.

You don't need to remove them. Google is reporting to you that it knows that they 404, 410, 301, 302, noindex, disallow etc. And that they have removed them from the index already.

Only worry about URLs reported that you do want in the index. Use the reports to determine if you have made a mistake.
 

Zhivko

Member
Joined
Mar 15, 2019
Messages
51
Reaction score
20
@Tiggerito In my case, the URLs are still indexed. And that's about 3000 URLs, compared to about 1000 "real" URLs. So it sux.

I will try using 410, thank you all for the feedback.
 

Tiggerito

Member
Joined
May 5, 2016
Messages
41
Reaction score
22
How are you determining that they are indexed?

410 is a slightly stronger signal than 404 and may cause Googlebot to check them less frequently once they have seen the 410 status.

Having a valid xml sitemap can also push Googlebot to crawl your important pages more often.
 

JoshuaMackens

Local Search Expert
Joined
Sep 12, 2012
Messages
1,950
Reaction score
579
Google keeps 410's, 404's, "noindex" directives in their index for much longer than you would expect. From our experience it's been months.
 

Zhivko

Member
Joined
Mar 15, 2019
Messages
51
Reaction score
20
Google keeps 410's, 404's, "noindex" directives in their index for much longer than you would expect. From our experience it's been months.
A quick update - about a month and a half later, GSC shows 1000 fewer URLs. There were 4000, now there are 3000.

For now, I am willing to believe that what I did works. It just takes time.
 

JoshuaMackens

Local Search Expert
Joined
Sep 12, 2012
Messages
1,950
Reaction score
579
A quick update - about a month and a half later, GSC shows 1000 fewer URLs. There were 4000, now there are 3000.

For now, I am willing to believe that what I did works. It just takes time.

Yeah, it's just a factor of time.
 
Similar threads
Thread starter Title Forum Replies Date
M Google keeps reverting our clients address, no matter how many times we send a postcard Moving or Name Changes 4
NickB-Tampa Why does Google keep updating changing the main category on our listings to ones that don't make as much sense? NAP, Categories, Dashboard Data 2
ryannbull We have added a question to our client's Google My Business Q&A section and it keeps disappearing. Is anyone else experiencing this problem? Help & Support for Google Local 4
FriarTuck00 Google Keeps Changing Phone Number on Listing Google My Business & Google Maps 5
S Confused. Very low authority websites keep ranking higher in Google Maps Google My Business & Google Maps 15
K Google Keeps Changing my Business Name Google My Business & Google Maps 7
TalkingMonkey Category Issues - Google keeps reverting to invalid category NAP, Categories, Dashboard Data 4
D Google MY Business and Google Maps Keeps doing the opposite of what I ask! Google My Business & Google Maps 5
Garrett Sussman Keep Calm and Follow Google?s New Schema Guidelines? Or Not Local Reviews 4
Colan Nielsen Why the $%!# Does Google Keep Updating My Business Hours? (A Case Study) Google My Business & Google Maps 5
D Why does Google keep reverting my changes? Google My Business & Google Maps 12
NeptuneMoon Google Calling Businesses to Keep Listings Active? Google My Business & Google Maps 6
Cam My Google+ Business Page Reviews keep dissapearing. How do I deal with this? Local Reviews 6
Bishop Why does Google keep messing with my Places page? Google My Business & Google Maps 3
Linda Buquet Reciprocity - The Gift that Keeps Giving... Google Reviews that is Local Reviews 1
Local Search News Curator Google Looks to Keep Local Users at Google.com With Two Interface Updates Google My Business & Google Maps 4
Phil Rozek Checklist: keeping Google+ reviews from being filtered Local Reviews 5
S Google keeps changing business categories on Google+ Local pages. Why? Help & Support for Google Local 2
M Google Maps Rankings are not Stable Google My Business & Google Maps 2
stankolev What is the maximum number of categories single Google My Business listing can have? NAP, Categories, Dashboard Data 3
Chris Ratchford Google Ads- Local Pack- one GMB location only? Paid Search and Local Service Ads 1
Don Archer Google business listing with 482 Real Review Missing. How do I get them back? Help & Support for Google Local 1
Nikki Stine Are negative Google reviews due to supply shortages considered 'off-topic'? Local Reviews 2
Jeffrey Taylor Adding a new category to Google my Business Google My Business & Google Maps 4
david.victor Attribute used as Category by Google on Maps NAP, Categories, Dashboard Data 5
M Google Search Console Errors "Coverage and Breadcrumbs"? Google My Business & Google Maps 4
Lachlan_Wells Accept/Discard Google Updates - Does this feature work for you? NAP, Categories, Dashboard Data 3
E "Duplicate" Profile That Google Claims We Already Manage? Google Duplicates & Merges 5
T Can a Credit Union Create Google Posts Without Falling Under Prohibited Content? Google My Business & Google Maps 4
djbaxter Google My Business Bug Dropping SAB Businesses In Independence, Kansas Service Area Businesses 1
JamesGreenaway Google Insights query Google My Business & Google Maps 1
RobertCarnitas Google Posts Live on GMB, But Not Showing in GMB Dashboard Google My Business & Google Maps 1
rickvidallon How Do You Access The Buttons In Google My Business For Online Services? Local Search 4
NexstarNickR Google Star Rating: LSA vs. GMB All Things Google My Business [PRIVATE] (LocalU) 2
Phil Rozek Google Maps reviews get "New" label for reviews less than 1 month old Local Reviews 5
JoyHawkins Get Live Inventory Displayed on Your Google My Business Listing Google My Business & Google Maps 9
JoyHawkins Google Testing 2-Packs on Mobile Google News: Important Changes & Features 4
Paul Gregory Google Maps default location bias distance and the Google Maps Places API Google Algorithm Discussions 2
Chris Ratchford Google Analytics - setting up goals for click-to-call Organic SEO 2
L Google ranking in Legal Field Organic SEO 1
Cherie Dickey Something funny going on in Google Maps... am I missing something? Google My Business & Google Maps 1
hajnasiewicz Google Marketing Kit: Create Video Local Content 3
S Google LSA Lead Board - How to manage? Paid Search and Local Service Ads 1
krystaltaing Google My Business Bulk Verification Limit Reached? Multi-Location Issues 0
K Unable to get verified in Google for SAB Local Search 14
Matt Chauhan Google Maps showing category that doesn't even exist Local Search 1
djbaxter Brightlocal Tool shows Large Google Local Search Algorithm Update March 10, 2021 Google Algorithm Discussions 1
D Local Services and Google my Business Paid Search and Local Service Ads 2
F Google Maps Citation confusion? Google My Business & Google Maps 3
K Google requiring storefront photos Google Duplicates & Merges 4

Similar threads

Login / Register

Already a member?   LOG IN
Not a member yet?   REGISTER

Most UpVoted Answers

Trending: Most Viewed

LocalU Podcasts

  Promoted Posts

New advertising option: A review of your product or service posted by a Sterling Sky employee. This will also be shared on the Sterling Sky & LSF Twitter accounts, our Facebook group, LinkedIn, and both newsletters. More...
Google Product Exert


Top Bottom