Need suggestion: Should the user profile link be disallowed in robots.txt
-
I maintain a myBB based forum here. The user profile links look something like this http://www.learnqtp.com/forums/User-Ankur
Now in my GWT, I can see many 404 errors for user profile links. This is primarily because we have tight control over spam and auto-profiles generated by bots. Either our moderators or our spam control software delete such spammy member profiles on a periodic basis but by then Google indexes those profiles.
I am wondering, would it be a good idea to disallow User profiles links using robots.txt?
Something like
Disallow: /forums/User-*
-
Maybe you should noindex user profile pages until they've been active on the site long enough that a) you're sure they're not a spam bot and b) they're actually active users, with some interesting information to share on their user page?
Like Shaliendra said, this is your call. It's really about your website goals, and what those user pages do for the site. Are you getting much organic traffic from user pages? If you aren't, it's probably easiest to just noindex all user pages. But if some profiles are bringing in organic traffic, I'd recommend that you add a noindex tag immediately, but remove it once someone has commented a few times.
Does that help?
-
I am only talking about user profile pages not the links inside them. I have already taken care of them.
Request others to please come up with suggestions.
-
If you are talking about user profile pages, it is your call.
If you are talking about links that users post in profile pages, use as signatures or use in threads, make sure to mark them nofollow.
Regards
-
Let me re-phrase my question a bit. Would it be a good idea to get the user profile links noindexed in the first place? or should we keep them indexed in Google?
-
Use meta="noindex" tag for the user profile pages. It is more effective.
Regards
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Having 200 internal links on a page...is always bad?
I have an e-commerce site with a very important page that have over than 200 links...I have read in various sites that is bad to have too much links in page...what do you think? This is one of the most important pages in my site = general product page. Thank you!
On-Page Optimization | | Maximilian210 -
Low quality links
I remember finding a tutorial on MOZ about how to remove low quality links. But i cant find it now. can someone help?
On-Page Optimization | | kevinbp0 -
Outbound links. External Links.
I have been reading alot on SEO and there is something confusing about having "Outbound links. External Links." on your main ranking page. Some say that We shouldn't have any out bound links. (from Random website) According to Yoast, we should have outbound links. (yoast.com) we should have outbound links but we should add the "no-follow" tag. (from Random website) Q: What should i do and follow?
On-Page Optimization | | kevinbp
If the answer is yes, how many outbound links is an appropriate amount per page?0 -
Does the follow link from the moz Profile really count after first with nofollow?
Hey all, I discovered that the link from the public profile might not count. To my knowledge Google "counts" the first link to another page on any given page. The public profile has a nofollow link before your follow link:
On-Page Optimization | | Sebes
linktodomain.tld linktodomain.tld Doesn't this invalidates all the public profile links? What is your stance on this? Regards Sebastian2 -
Does the link title attribute benefit seo?
Hello, Anyone could tell me the benefit SEO of link title attribute. Is **Link Title **ranking factor? Thanks
On-Page Optimization | | JohnHuynh0 -
Internal link question
Hello, I was wondering if internal links should be full urls? for instance my coder might put "page-title.html" but I was wondering if its better for seo to have it be the full url "http://www.blah-blah.com/page-title.html" thanks in advance..... I love this place!
On-Page Optimization | | Superflys1 -
How do you avoid getting hit for too many links with an ecommerce site?
On my campaign for www.fourcolormagnets.com one of my warnings was "too many on-page links". Is there any thing to do for ecommerce sites? and also, my page www.fourcolormagnets.com/rectangle-sizes.php is listed as having 744 links but, I count nowhere near that number. And idea where this comes from?
On-Page Optimization | | JHSpecialty0 -
Lists of Product Links: What is good, what is bad?
I am a web designer but a bit of an SEO noob (trying to get better at both). I am working with one particular client on a site I inherited with existing structure. This client has about 10 products on 2 pages. On every page there is a product list that is basically the same list sorted in 2 ways: 1st by product, 2nd by usage. These all link to internal anchors so this might be an example on www.site.com Cleaner X1 - links to www.site.com/cleaners.php#x1
On-Page Optimization | | mparry9
Cleaner X2 - links to www.site.com/cleaners.php#x2
Cleaner X3 - links to www.site.com/cleaners.php#x3
...
Cleaner For Brick - links to www.site.com/cleaners.php#x1
Cleaner For Marble - links to www.site.com/cleaners.php#x2
Cleaner For Stone - links to www.site.com/cleaners.php#x3 Obviously this adds about 20 links on every page on the site (including the actual pages these products are on). What are your thoughts on this? Good idea or bad to have on the site? Should I remove the redundant links on the actual page that product falls on...or is this bad and should be removed altogether?0