User Agent -teracent-feed-processing
-
Does anyone knows some info about "teracent-feed-processing" user agent?
IP's from which user agent reside: 74.125.113.145, 74.125.113.148, 74.125.187.84 ....
In our logs, 2 out of 3 requests are made by it, causing server crash.
-
It seems that the Sudden drop in indexed pages reported in WMT might relate to some reporting issues from Google - https://productforums.google.com/forum/#!topic/webmasters/qkvudy6VqnM;context-place=topicsearchin/webmasters/sitemap|sort:date
-
Since "teracent-feed-processing" didn't followed the rules in robots.txt, we had to hard-block it. If server detects the user agent beeing "teracent-feed-processing" it will drop the connection: _ (104) Connection reset by peer_
-
Well it isn't Googlebot and it isn't one I have come across before. Don't forget that any user agent can be spoofed very easily so I wouldn't worry about blocking it.
**Should I assume that the drop in reported indexed pages is a result of blocking the teracent-feed-processing user agent? **
I really don't think that this is Google. The only one they have is Googlebot, and tell you this is the one to add if you wish to block them.
Just a thought, can you share your robots.txt file just to make sure pages aren't being unintentionally blocked?
-Andy
-
It seems that "teracent-feed-processing" user agent is somehow linked to Google. If you analyse the Ip's , you'll noticed that are Google owned. Teracent company has been bought by Google in 2009.
btw - we've already blocked it, but I'm trying to figure it out what's the key role played by this user agent. We've also noticed a drastic decline in number of pages being reported in Google Webmaster Tools (half of what we used to have). Should I assume that the drop in reported indexed pages is a result of blocking the teracent-feed-processing user agent?
-
It sounds like your typical spammy site so I would suggest just blocking them. Add the following to the top of your robots.txt file:
**User-agent: teracent-feed-processing** **Disallow: /** However, before you go live with this, use the webmaster tools Robots.txt tester to make sure everything else still gets crawled. -Andy
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does user engagement or content of pages requiring login help SEO?
Hi! Our company is trying to come up with a few pages with some manuals to teach our users how to use our products. However, these pages require username and password. My understanding is that user engagement will help a website's keyword rankings and Google will not be able to crawl or have access to pages requiring login as it doesn't have username and password. Based on that idea, does that mean all the content and user engagement on those pages requiring login won't help our overall SEO? Thanks in advance!
Technical SEO | | EverettChen0 -
Site architecture? I've got a free user report, that shoots back a page with their data for them to share with co-workers and friends.
Hi, I have a site about to go online that users can run a free report that connects to their calendar app to get 12 months of statistics for their meetings, and then it shoots out a report. So they go to a.com/freereport and they get back a.zom/freereport/report/xxxxxx The content of those reports is different, but the structure is the same as it is a fun way to show off meeting stats to co-workers and friends. I don't see the point of Google indexing those as the traffic to those pages is going to be from social networks and viral, but I do want the backlink credit. Will I get backlink credit if I nofollow that folder? I am having a hard time deciding what to do seo wise and would love some thoughts and advice, what would you recommend? Do nothing fancy. Mark the report folder no follow. Try to do something with rel=cannonical to point those pages to the root page? Thoughts?
Technical SEO | | bwb0 -
Homepage "personalisation" - different content for different users
Hi Mozians, My firm is looking to present different content to different users depending on whether they are new, return visitors, return customers etc... I am concerned how this would work in practice as far as Google is concrened- how would react to the fact that the bot would see different content to some users. It has the slight whiff of cloacking about it to me, but I also get that in this case it would be a UX thing that would genuinely be of benefit to users, and clearly wouldn't be intended to manipulate search rankings at all. Is there a way of acheiving this "personalisation" in such a way that Google understands thay you are doint it? I am thinking about some kind of markup that "declares" the different versions of the page. Basically I want to be as transparent about it as possible so as to avoid un-intended consequences. Many thanks indeed!
Technical SEO | | unirmk0 -
Robots User-agent Query
Am I correct in saying that the allow/disallow is only applied to msnbot_mobile? mobile robots file User-agent: Googlebot-Mobile User-agent: YahooSeeker/M1A1-R2D2 User-agent: MSNBOT_Mobile Allow: / Disallow: /1 Disallow: /2/ Disallow: /3 Disallow: /4/
Technical SEO | | ThomasHarvey1 -
Will my SEO Affect If I Redirect existing user from homepage to dashboard?
Hi Guys, My client (SaaS company) wants to redirect all the visitors to the dashboard if they have already created an account with them. The redirection would be done at the server level using a cookie. Does the redirection (though done only if user is already registered) affect SEO rankings? They want to be double sure. Thanks.
Technical SEO | | sandeep.clickdesk0 -
Noindex user profile
I have a social networking site with user- and company profiles. Some profiles have little to no content. One of the users here at moz suggested noindex-ing these profiles. I am still investigating this issue and have some follow up questions: What is the possible gain of no-indexing uninteresting profiles? Especially interested in this since these profiles do bring in long-tail traffic atm. How "irreversable" is introducing a noindex directive? Would everything "return to normal" if I remove te noindex directive? When determining the treshold for having profiles indexed, how should the following items be weighed Sum of number of words on the page (comprised of one or more of the following: full name, city, 0 to N company names, bio, activity) (unique) Profile picture (Nofollowed) Links to user's profiles on social networks or user's own site. Embedded Google Map Thanks!
Technical SEO | | thomasvanderkleij0 -
HTTP Vary:User-Agent Server or Page Level?
Looking for any insights regarding the usage of the Vary HTTP Header. Mainly around the idea that search engines will not like having a Vary HTTP Header on pages that don't have a mobile version, which means the header will be to be implemented on a page-by-page basis. Additionally, does anyone has experience with the usage of the Vary HTTP Header and CDNs like Akamai?Google still recommends using the header, even though it can present some challenges with CDNs. Thanks!
Technical SEO | | burnseo0 -
User Reviews Question
On my e-commerce site, I have user reviews that cycle in the header section of my category pages. They appear/cycle via a snippet of code that the review program provided me with. My question is...b/c the actual user-generated content is not in the page content does the google-bot not see this content? Does it not treat the page as having fresh content even though the reviews are new? Does the bot only see the code that provides the reviews? Thanks in advance. Hopefully this question is clear enough.
Technical SEO | | IOSC0