Need suggestion: Should the user profile link be disallowed in robots.txt
-
I maintain a myBB based forum here. The user profile links look something like this http://www.learnqtp.com/forums/User-Ankur
Now in my GWT, I can see many 404 errors for user profile links. This is primarily because we have tight control over spam and auto-profiles generated by bots. Either our moderators or our spam control software delete such spammy member profiles on a periodic basis but by then Google indexes those profiles.
I am wondering, would it be a good idea to disallow User profiles links using robots.txt?
Something like
Disallow: /forums/User-*
-
Maybe you should noindex user profile pages until they've been active on the site long enough that a) you're sure they're not a spam bot and b) they're actually active users, with some interesting information to share on their user page?
Like Shaliendra said, this is your call. It's really about your website goals, and what those user pages do for the site. Are you getting much organic traffic from user pages? If you aren't, it's probably easiest to just noindex all user pages. But if some profiles are bringing in organic traffic, I'd recommend that you add a noindex tag immediately, but remove it once someone has commented a few times.
Does that help?
-
I am only talking about user profile pages not the links inside them. I have already taken care of them.
Request others to please come up with suggestions.
-
If you are talking about user profile pages, it is your call.
If you are talking about links that users post in profile pages, use as signatures or use in threads, make sure to mark them nofollow.
Regards
-
Let me re-phrase my question a bit. Would it be a good idea to get the user profile links noindexed in the first place? or should we keep them indexed in Google?
-
Use meta="noindex" tag for the user profile pages. It is more effective.
Regards
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Alt text / internal linking
Hi everyone A question about best practice when linking from pictures on our homepage - hirespace.com We have an option of using divs with background images (nicer in terms of design) but it means that we can't use anchor text or alt text to show Google what these internal links are about. The other option is to use images which do not allow us as much flexibility in terms of CSS but would allow us to use alt text. There is also an opinion that we should have separate text links at the bottom of the homepage to get the anchor page in. What is best practice in this situation - is alt text worth sacrificing some CSS flexibility for? How important is anchor/alt text for internal linking? Thanks guys.
On-Page Optimization | | HireSpace0 -
Need w3c validation error solution
http://validator.nu/?doc=http%3A%2F%2Fwww.topnotchlawsuitloans.com Stray end tag head. An body start tag seen but an element of the same type was already open. Cannot recover after last error. Any further errors will be ignored.
On-Page Optimization | | JulieWhite0 -
How far back do you need to optimize your blog posts?
We are going through a clients blog history as they are entering a redesign phase for the blogs. We are trying to determine how far back we need to optimize past blog posts so that they can be found easier on search engines. Is it better to optimize the past years? 2 years? 6 months? only the top posts? Does anyone have any suggestions?
On-Page Optimization | | Scratch_MM0 -
Main page link reduction
I am in the process of reducing the number of internal links from the homepage with the assumption that the more links I have the more "juice" goes to internal pages I have two options since many of the links are costumer service related 1. create one link that leads to a costumer service page and place all the links their. 2. get all those links on the main page as nofollow links. what are your opinions
On-Page Optimization | | ciznerguy0 -
SEOmoz tells me that I have too many links, however most of them are comments...
Is this affecting the overall ranking of the page? http://www.smileclinic.sk/zubne-implantaty/ (164) http://www.smileclinic.sk/zubne-korunky/ (179) If so how can I disallow them? We use Wordpress with the Joost SEO plugin, but I don't see a disallow option there for comments...
On-Page Optimization | | danielshaw0 -
How do I Avoid Excessive Internal Links on an eCommerce site?
I think I'm getting dinged for this on Term Target because the page is full of products, which have links to their product page, but I'm not sure.
On-Page Optimization | | PageLogic0 -
Best way to link to an affiliate site.
I have a site that promotes a single affiliate product. Would it be better to have a "buy" button in the content that goes straight to the external affiliates website or should I send it all to an internal page that redirects thus only having 1 external link to the product site.
On-Page Optimization | | jafabel0 -
Is anchor text link juice passed in internal links?
Let's say I have www.bobswidgets.com. If I have "widgets for sale in tuscon arizona' be the anchor text on an internal link on www.bobswidgets.com/page1 which goes to www.bobswidgets.com/page2 - does the value of the anchor text (widgets for sale in tuscon arizona) get passed internally? External links pass the value of the anchor text but do internal links?
On-Page Optimization | | qlkasdjfw0