Need suggestion: Should the user profile link be disallowed in robots.txt
-
I maintain a myBB based forum here. The user profile links look something like this http://www.learnqtp.com/forums/User-Ankur
Now in my GWT, I can see many 404 errors for user profile links. This is primarily because we have tight control over spam and auto-profiles generated by bots. Either our moderators or our spam control software delete such spammy member profiles on a periodic basis but by then Google indexes those profiles.
I am wondering, would it be a good idea to disallow User profiles links using robots.txt?
Something like
Disallow: /forums/User-*
-
Maybe you should noindex user profile pages until they've been active on the site long enough that a) you're sure they're not a spam bot and b) they're actually active users, with some interesting information to share on their user page?
Like Shaliendra said, this is your call. It's really about your website goals, and what those user pages do for the site. Are you getting much organic traffic from user pages? If you aren't, it's probably easiest to just noindex all user pages. But if some profiles are bringing in organic traffic, I'd recommend that you add a noindex tag immediately, but remove it once someone has commented a few times.
Does that help?
-
I am only talking about user profile pages not the links inside them. I have already taken care of them.
Request others to please come up with suggestions.
-
If you are talking about user profile pages, it is your call.
If you are talking about links that users post in profile pages, use as signatures or use in threads, make sure to mark them nofollow.
Regards
-
Let me re-phrase my question a bit. Would it be a good idea to get the user profile links noindexed in the first place? or should we keep them indexed in Google?
-
Use meta="noindex" tag for the user profile pages. It is more effective.
Regards
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Listing and Linking Brands from Homepage
We have the popular brands that we sell listed on our homepage. We currently have them in just plain text at the moment but we want to know if it would be best to: Leave them in plain text Link each to the most relevant page on our website Link each out to the actual brands website Link some to internal page, others out to brands website, some blank Not have a list of brands We do have a webpage that lists all of our brands but there are hundreds we carry so we narrowed down the 40 most popular known brands that people will be looking for on the homepage. Thanks for your help!
On-Page Optimization | | petsofoz0 -
ECommerce Website Internal Links
We run an ecommerce website... approx 8K products. When using the page grader, MOZ tools consistently tell me that I have too many Internal Links on the page.
On-Page Optimization | | Ampweb
These are caused from our fairly large menu system, and probably from the sub-category links on the category landing pages as well. I was reading an article that mentioned a no-follow on these Internal links would not really solve the "Too many internal links issue", so wanted to check if anyone has ideas or should I just dis-regard this MOZ suggestion that there are too many in this type of environment?0 -
Is a Mega Menu with over 300 links in it hurting my rankings?
I got hit pretty badly by Panda 4.0 (1/3 of my traffic lost), and I'm fairly certain it was because Google had potentially indexed over 20 million pages from a site filtering piece of software and got done for duplicate content. I have since fixed that using URL Parameters and that 20 million is down to 2.7 million now and I have submitted a clean site map, so now I wait. I have just done a site relaunch and am trying to determine if there are any other issues. I run an online store, and I have a mega menu with well over 300 links in it - makes the user experience really quick and easy to jump exactly where you want - and then I have about 30 links in the footer. I know there's a 'no more than 100 links on a page' guideline for Moz, but does anyone know if Google is smart enough to see the same header / footer navigation structure on every page of a site and know it's navigation and not water down the rest of the links, or do I need to re-think and simplify my navigation? It's one of those things that's there for a user experience and now I'm worried that I'm being penalised. The site is www dot shopnaturally dot com dot au
On-Page Optimization | | sparrowdog0 -
Linking from Subfolders
Hi, on my new theme there are a bunch of links from subfolders to pages that aren't in a sub folder, these pages also don't have links on the home page. Is there an seo issue when linking from subfolders to pages that aren't. I don't know if I'm wording this properly but what I mean is, mysite/project/project1 linking to mysite/post.
On-Page Optimization | | FPK0 -
When should I dofollow a link?
I know I should have all my affiliate links as nofollow but when should I dofollow a link? When will it HELP me to have a dofollow link? Right now - all my links are nofollow because I haven't figured out how to have nofollow and dofollow in the same blog post. Any info appreciated!
On-Page Optimization | | dealblogger0 -
What is on page links?
Hi - i would like to know exactly what an on page link is? i understand the linking system however cant work what exactly what an on page link is? Thanks
On-Page Optimization | | OasisLandDevelopment0 -
Need help, i am lost
Hello all, I am new in this community. I have been for a while on Page 1 on Google with the keyword "Wooden Signs" with my website CreateYourWoodSign.com Since the Google update (April 24th i think)I completely disappeared from Google. I have not been able to come back since. Any help would you highly appreciated. Thank you!
On-Page Optimization | | manu45
Emmanuel0 -
Too many on page links on ecommerce site
I have an online store with 10 catagories, many of those have subcategories. I have a tree style navigation menu on the page. This helps people quickly find what they need. However, I end up with about 125 links on the page that way. Does google really penalize me for this? Is there anyway around this? Advice much appreciated!
On-Page Optimization | | bhsiao0