Need suggestion: Should the user profile link be disallowed in robots.txt
-
I maintain a myBB based forum here. The user profile links look something like this http://www.learnqtp.com/forums/User-Ankur
Now in my GWT, I can see many 404 errors for user profile links. This is primarily because we have tight control over spam and auto-profiles generated by bots. Either our moderators or our spam control software delete such spammy member profiles on a periodic basis but by then Google indexes those profiles.
I am wondering, would it be a good idea to disallow User profiles links using robots.txt?
Something like
Disallow: /forums/User-*
-
Maybe you should noindex user profile pages until they've been active on the site long enough that a) you're sure they're not a spam bot and b) they're actually active users, with some interesting information to share on their user page?
Like Shaliendra said, this is your call. It's really about your website goals, and what those user pages do for the site. Are you getting much organic traffic from user pages? If you aren't, it's probably easiest to just noindex all user pages. But if some profiles are bringing in organic traffic, I'd recommend that you add a noindex tag immediately, but remove it once someone has commented a few times.
Does that help?
-
I am only talking about user profile pages not the links inside them. I have already taken care of them.
Request others to please come up with suggestions.
-
If you are talking about user profile pages, it is your call.
If you are talking about links that users post in profile pages, use as signatures or use in threads, make sure to mark them nofollow.
Regards
-
Let me re-phrase my question a bit. Would it be a good idea to get the user profile links noindexed in the first place? or should we keep them indexed in Google?
-
Use meta="noindex" tag for the user profile pages. It is more effective.
Regards
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Internal Linking From Blog to Website
Hi all, I'm just seeking opinions on something an external company have told us about linking from our blog to our website... Our website is; www.XYZ.com and our blog is www.XYZ.com/blog I add content to the blog on an almost daily basis and generally link on average 3 times from the blog (internally) to a various relevant pages on our website. Today I was told that by doing this I am 'diluting' the link juice which I understand but don't agree with... All I am doing is a form of internal linking which as far as I am aware is a good on-page technique? Just curious to learn other people's view on this... Many thanks Andy
On-Page Optimization | | TomKing0 -
Not sure if I need to be concerned with duplicate content plus too many links
Someone else supports this site in terms of making changes so I want to make sure that I know what I am talking about before I speak to them about changes. We seem to have a lot of duplicate content and duplicate titles. This is an example http://www.commonwealthcontractors.com/tag/big-data-scientists/ of a duplicate. Do I need to get things changed? The other problem that crops up on reports is too many on page links. I am going to get shot of the block of tags but need to keep the news. Is there much else I can do? Many thanks.
On-Page Optimization | | Niamh20 -
Which Blog Platform to link to an eCommerce site is best?
I just hired a content writer to blog on my site, but I want to make sure I have the right blog set up properly before doing so. I currently have my blog on my own domain. http://alturl.com/ixd7p It's a pretty crappy blog, to be quite frank. (The link to the blog is in the footer). It doesn't allow me to change category titles so it's throwing duplicate content - not good. I am seriously considering getting a self hosted Wordpress blog and linking that to my site instead at 3dcart- so it will be blog.domainname.comMy CONCERN.... I always heard that it's best to have the blog right right on the eCommerce site (just as I have it now) because it keeps feeding the domain fresh content. If I have a self hosted Wordpress blog and have it linked to my site, will it still feed my site fresh content?
On-Page Optimization | | tutugirl0 -
How far back do you need to optimize your blog posts?
We are going through a clients blog history as they are entering a redesign phase for the blogs. We are trying to determine how far back we need to optimize past blog posts so that they can be found easier on search engines. Is it better to optimize the past years? 2 years? 6 months? only the top posts? Does anyone have any suggestions?
On-Page Optimization | | Scratch_MM0 -
Suggestions to avoid duplicate content
Hi, we have about 6500 products, almost all with descriptions. SEOMOZ is showing about 2500 of them with duplicate content. The reason for this is that only one or two words are different for each product. For example, we have 500 award certificates. All are the same size and have the same description. But one is swimming, one baseball, one reading, etc, etc. Apparently the 1 word difference is not enough to differentiate. We have the same issue with our trophies - they are identical, except for figures. Does anyone have any good tips on how to change the content to avoid this issue and to avoid making up content for 2500 items? Thanks! Neil trophycentral.com
On-Page Optimization | | trophycentraltrophiesandawards0 -
Internal links
Hi, I am working on a project with very few really important pages - its now about 20 pages and this number will not increase to more than 30 by the end of the year. Today the majority of these Pages is 2 clicks away from the Homepage for navigational reasons. Now I am wondering: 1. If I should set links from the Homepage directly to these Pages to pass more juice?
On-Page Optimization | | Naturalmente
2 If you would suggest so - how would you recommend me to do this in Terms of usability and SEO? thanks in advance for your help.0 -
Optimizing Internal Links to Homepage
I've read that the Bots only count the first link on a page. My navigation has 2 links to my homepage - 1 from the logo keyword.png alt txt=keyword & 1 text link 'keyword.' Now in my content does it have any seo value to link relevant pieces of text back to the homepage? Thanks Jason Jackson
On-Page Optimization | | JasonJackson0 -
How to trace back a link from a 404 error?
How do I find the link that is still refferring to a 404 error? Somewhere on my site there is a link pointing to an un-usable page and I cant find where that link is to fix the 404 error. I could just delete the page all together, but I would like to find the problematic link first.
On-Page Optimization | | AtoZion0