Need suggestion: Should the user profile link be disallowed in robots.txt
-
I maintain a myBB based forum here. The user profile links look something like this http://www.learnqtp.com/forums/User-Ankur
Now in my GWT, I can see many 404 errors for user profile links. This is primarily because we have tight control over spam and auto-profiles generated by bots. Either our moderators or our spam control software delete such spammy member profiles on a periodic basis but by then Google indexes those profiles.
I am wondering, would it be a good idea to disallow User profiles links using robots.txt?
Something like
Disallow: /forums/User-*
-
Maybe you should noindex user profile pages until they've been active on the site long enough that a) you're sure they're not a spam bot and b) they're actually active users, with some interesting information to share on their user page?
Like Shaliendra said, this is your call. It's really about your website goals, and what those user pages do for the site. Are you getting much organic traffic from user pages? If you aren't, it's probably easiest to just noindex all user pages. But if some profiles are bringing in organic traffic, I'd recommend that you add a noindex tag immediately, but remove it once someone has commented a few times.
Does that help?
-
I am only talking about user profile pages not the links inside them. I have already taken care of them.
Request others to please come up with suggestions.
-
If you are talking about user profile pages, it is your call.
If you are talking about links that users post in profile pages, use as signatures or use in threads, make sure to mark them nofollow.
Regards
-
Let me re-phrase my question a bit. Would it be a good idea to get the user profile links noindexed in the first place? or should we keep them indexed in Google?
-
Use meta="noindex" tag for the user profile pages. It is more effective.
Regards
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
When trying to sculpt an internal link structure, is there any point in placing text links to top level pages that are already in the main menu?
Does Google recognise a link in the content if there is already a link in the menu? My understanding is that Google only counts the first link it finds.
On-Page Optimization | | bittristo0 -
Automated checking for broken links within content pieces
Hi, I am wondering if anyone can send me in the right direction on a system suggestion. We have currently grown out amount of content pieces on our website and our manual checking if the links in the content pieces are still 200 status is becoming extremely time consuming. Does anyone have a recommendation of a system that will crawl your pages and check both the internal and external links within the content for a status code (404,200,etc)? Preferably something server side so it can just run on a schedule but really anything would be fine. I have tried things like Screaming frog, etc and it just doesn't seem to be the right tool.
On-Page Optimization | | GoAbroadKP0 -
Need w3c validation error solution
http://validator.nu/?doc=http%3A%2F%2Fwww.topnotchlawsuitloans.com Stray end tag head. An body start tag seen but an element of the same type was already open. Cannot recover after last error. Any further errors will be ignored.
On-Page Optimization | | JulieWhite0 -
Expert to Improve Site Speed Needed
Hey, I am looking for an expert who can improve the speed performance for my website NaturalSociety.com. Please please email me at mike@naturalsociety.com if you or your company works to improve website speed performance, or if you can recommend someone. Thanks in advance, -Mike
On-Page Optimization | | naturalsociety0 -
Too Many On-Page Links
Ok so I am very new to MOZ, and we have just set up our PRO account and campaign. When we got our crawl results we had 4 pages with "too many on-page links". All of these pages correspond with our blog, which is a wordpress hosted blog that is integrated into our site. Our site is www.moxicopy.com and the blog is www.moxicopy.com/blog I am confused on how we have over 100 on page links on these pages, as we have very few links on our blog.
On-Page Optimization | | Moxicopy.com0 -
Disallow indexing of ALL subdomains
I'm using www.domain.com as my development hosting. Each website that i'm developing get's a temporary URL like this: project1.domain.com
On-Page Optimization | | conversal
project2.domain.com
project3.domain.com
... Now i'd like to set that ALL these subdomains can not be indexed in Google. Now I manually have to do this for each subdomain's site, and when I go online I have to change the robots.txt again. So I would like to make things a bit easier for me. Is this possible?0 -
Too many links on home page
SEOmoz crawl states I have 3 pages with too many links. My sites are hosted on Yahoo small business. One page they state is too long is the home page/ind. with 600 links to each page on the web site ( I think). Is this really a problem and how do I fix it? The other two pages are product categories that link to the products under the main product type. What I do not understand is that we have many larger product categories that SEOmoz crawl is not stating too many.
On-Page Optimization | | Wales0 -
Linkedin profile severely penalized
I may have over optimized my linkedin profile...as a result it only shows up for linkedin + my name (ilya elbert) it does NOT show up for just my name query alone on the first 200 results. I've removed all my jobs and most of the info and am going to gradually re add things when I get it back - is there anything I can do to speed up the process of reconsideration? I guess I'm new to this over optimization penalty.
On-Page Optimization | | ilyaelbert0