Status
Not open for further replies.

Ana

Member
Joined
Apr 11, 2015
Messages
11
Reaction score
0
Hi Guys

Recently, I've a SEMRush BOT appear on my server search results, instantly placed a #SEO block then after a number of days unblocked it. Question is, why are they here?

Thanks
 
Joined
Oct 25, 2013
Messages
752
Reaction score
286
When you say you saw it in the server search results, you mean in your log files on your host? Is your question, just wondering why SEMRush was crawling your site?

There's a huge number of bots out there, apparently over half of all internet traffic is from bots. Most friendly bots crawl your site for the same general reason humans do... to find information. I don't know about SEMRush, but a common reason for bots to crawl might be to index pages, or find the link structure connecting your site with other sites. SEMRush likely isn't hurting anything, but (unless you're using their service) they probably aren't helping anything either. Your data's just being used to help others make informed marketing decisions, if you care enough to block, there's no downside for you at least. Unless you have reason to believe the bots are using up more than their fair share of server load though, there's not really any reason to take the time to block them.
 

Ana

Member
Joined
Apr 11, 2015
Messages
11
Reaction score
0
Re: SEMRush Bot seen on results LOG files

I think I know very good SEO. I actually taught myself via the white hat method, but have poor CSS, so I won't show my website. Yes in the log files. I did some reading on their
HTML:
https://www.semrush.com/bot/
and others then decided afterwards to re-block them in my /robots.txt as basically they are criminals pinching other people's hard work for their Adsense benefit. Someone stated a long while ago: Thou shalt not steal.

i believe the reason they are here is because of my high ranking for some top quality keywords i an using.

Thanks
 

Eric Rohrback

Moderator
Joined
Oct 3, 2012
Messages
1,020
Reaction score
339
Re: SEMRush Bot seen on results LOG files

They are visiting your site to document for their tools, not adsense. SEMrush is a reporting software that helps monitor keyword performance for organic ranking and paid search. They are one of the better companies out there to help understand site performance.

I've used both SEMrush and SpyFu, and never had a problem with them. If you block all bots from your site, then hopefully you have developed some internal/proprietary software for your own use. Otherwise you're going to have a tough time understanding the full market landscape.
 

Ana

Member
Joined
Apr 11, 2015
Messages
11
Reaction score
0
Eric, they are here like you say and because I have mastered (this area) how to fully optimize rank on page 1 of Google and Bing for some seriously juicy keywords and they want all the cake, but I have blocked the Semrushbot and SemRushbot-SA plus a few others just in case.
 
Last edited:

Eric Rohrback

Moderator
Joined
Oct 3, 2012
Messages
1,020
Reaction score
339
@Ana - Nice trolling. We'll consider this a case closed subject since you obviously are set on what you want to do and do not want to engage in any real discussion.

Please contribute in a meaningful way to threads in the future.
 
Status
Not open for further replies.
Similar threads
Thread starter Title Forum Replies Date
DragonXD SEMrush and citation service in Denmark NAP, Categories, Dashboard Data 4
L SEMRush, Moz don't show backlinks Citations 4
C SEMrush Position Tracker Inaccurate Unreliable Local Search 1
J How does one use tools such as Moz or Semrush if disavowed has been used. Local Search 2
nerboda SEMRush-like Ranking Report Tool for Local Results Local SEO Tools & Software 5
Eric Rohrback Webinar with SEMrush: Using Competitive Data to Power Lead Gen & Sales Consultant's Corner 1
Tim Colling Moz, SEMrush or Majestic - Pick any two, which do you drop? Local SEO Tools & Software 1
Linda Buquet Gaming Google+ Local: Analysis From 170k SERPs - SEMrush Blog Google My Business & Google Maps 0
Linda Buquet 5 Powerful Local SEO Tactics that are Under Used & Under Appreciated - SEMrush Local Search 9
deanPlumberseo Semrush Local SEO Tools & Software 5
D Multilanguage Learning Chat bot with multi-level logic Recycle Bin 0
HurricaneK8 GMB Spam Created by BOT via. Yellowpages Spam on Google 2
Linda Buquet Merged Google+ Local Category Bots Gone Wild Warning Google My Business & Google Maps 24
Linda Buquet LOL You Thought BOTs Were Bad? New Google StreetView Car Patent Local Search 2
D Google "Find Results on" Error Local Search 3
B Will Removing Addresses for Multiple State SAB Result in Dup Listing or Suspension? Service Area Businesses 4
djbaxter Schema.org vs. Google's Structured Data Rich Results Organic SEO 0
sixthcitysarah Specific location search shows results for other franchise location Multi-Location Issues 6
A How to change GMB ticket field in search results knowledge panel NAP, Categories, Dashboard Data 4
H The weirdness of organic results for certain queries Local Search 3
zach.todd Snack pack versus clickthrough results Local Search 5
Lachlan_Wells Local Falcon - Strange Results for Non-English Queries Local Search 5
Gsmithmike The most accurate Tool to show Local Search Result for Geo Targeting keywords? Local SEO Tools & Software 3
D SERPRiver - Google Search API in Real-Time to Scrape Search Results Recycle Bin 0
Caroline S Maps Results Moving Down The Page? Anyone Else Seeing This ? Google My Business & Google Maps 2
john wieber Mobile Local SERPS Location Data in Result Local Search 5
bdebelle Review Updates - "Accept all for this Location" resulting in listing suspension Help & Support for Google Local 2
diptimayee Google Rich Results Test Tool Is Out Of Beta Google News: Important Changes & Features 0
M New Google My Business Featured Snippet Result Google My Business & Google Maps 3
P Sudden near disappearance from Google My Business search results Help & Support for Google Local 2
D Manage listings directly from Search results? Google My Business & Google Maps 3
hajnasiewicz Search results for service we do not provide Multi-Location Issues 16
IanJohnson Multi-Location Businesses not showing Local results in SERPs Google My Business & Google Maps 1
sethkimball Maps API now returning NO results for SABs Service Area Businesses 2
rayrober Find Results Carousel Local Search 4
A Different local pack results on Android phone and iphone Local Search 9
Terry Local search results acting weirdly? Local Search 4
C Non-personalized results from mobile searches on your phone Help & Support for Google Local 6
Fred Hofstetter Deduplication - local vs. traditional results Local Search 2
U Spam / Scam .it domains and sub domains flooding Google results pages Spam on Google 6
J Can GMB Listings Strengthen Organic Results? Organic SEO 2
Ellen Ranking in GMB and Local Pack - Not Traditional Organic Results Ranking Puzzles 4
Jens Rank Tracking Software for local results Local SEO Tools & Software 12
L Google now allows Site Owners to Customize the Search Results Snippets, but what can be customized? Google News: Important Changes & Features 1
M How do you see the results of backlinks? Organic SEO 31
MannyL Icon in the SERPs results? Google My Business & Google Maps 12
pony Newer Mobile Rich Results - How to Obtain? Local Search 2
Yan Gilbert Icons in Google Desktop Search Results Local Search 2
Conor Treacy Google showing only domain name in results (when not logged in) Local Search 2
Colan Nielsen Possible Bug Alert: Pagination Issue for Local Finder Results Google My Business & Google Maps 5

Similar threads

Login / Register

Already a member?   LOG IN
Not a member yet?   REGISTER

Most UpVoted Answers

Trending: Most Viewed

LocalU Podcasts

  Promoted Posts

New advertising option: A review of your product or service posted by a Sterling Sky employee. This will also be shared on the Sterling Sky & LSF Twitter accounts, our Facebook group, LinkedIn, and both newsletters. More...
Google Product Exert


Top Bottom