Need suggestion: Should the user profile link be disallowed in robots.txt
-
I maintain a myBB based forum here. The user profile links look something like this http://www.learnqtp.com/forums/User-Ankur
Now in my GWT, I can see many 404 errors for user profile links. This is primarily because we have tight control over spam and auto-profiles generated by bots. Either our moderators or our spam control software delete such spammy member profiles on a periodic basis but by then Google indexes those profiles.
I am wondering, would it be a good idea to disallow User profiles links using robots.txt?
Something like
Disallow: /forums/User-*
-
Maybe you should noindex user profile pages until they've been active on the site long enough that a) you're sure they're not a spam bot and b) they're actually active users, with some interesting information to share on their user page?
Like Shaliendra said, this is your call. It's really about your website goals, and what those user pages do for the site. Are you getting much organic traffic from user pages? If you aren't, it's probably easiest to just noindex all user pages. But if some profiles are bringing in organic traffic, I'd recommend that you add a noindex tag immediately, but remove it once someone has commented a few times.
Does that help?
-
I am only talking about user profile pages not the links inside them. I have already taken care of them.
Request others to please come up with suggestions.
-
If you are talking about user profile pages, it is your call.
If you are talking about links that users post in profile pages, use as signatures or use in threads, make sure to mark them nofollow.
Regards
-
Let me re-phrase my question a bit. Would it be a good idea to get the user profile links noindexed in the first place? or should we keep them indexed in Google?
-
Use meta="noindex" tag for the user profile pages. It is more effective.
Regards
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Outbound links
Hi everyone, Just a quick question about using info/statistics from other sources in my articles. If I use a quote/piece of info from another online article do I just say where it's from and link to it? Is this acceptable or do you have to get permission? I find the whole permissions thing quite confusing! I know that outbound links are good for SEO so just wanted to check this. Thanks!
On-Page Optimization | | ClareO0 -
Homepage canonical url with splash or not with splash? All other links are without but logo links with splash
Hello, There is so much contradicting information about the homepage canonical URL. Many websites have all the links without the trailing splash but their homepage URL still contains the splash. Now Moz is an example with this. Their urls don't have the splash, and their canonical does not have the splash. Why is it so and why so much different ways people have it?
On-Page Optimization | | advertisingcloud0 -
Bad to have "As Seen on" links sitewide
I've seen a lot of people saying that sidewide external links are a no-go. Does this also apply to links of a vanity variety? What I mean by this is "as seen on" links or links to awards given to the business? This intellectually seems okay to me, but I want to make sure I'm not shooting myself in the foot. Any evidence, case studies, anecdotal stories would be appreciated!
On-Page Optimization | | Oren.0 -
Related Items Links
Hi, If an item page has 'related items' links and 'you may also like' links - and both those are essentially the same links, doesn't it make sense to only have one set?
On-Page Optimization | | Freelancer130 -
Need help, i am lost
Hello all, I am new in this community. I have been for a while on Page 1 on Google with the keyword "Wooden Signs" with my website CreateYourWoodSign.com Since the Google update (April 24th i think)I completely disappeared from Google. I have not been able to come back since. Any help would you highly appreciated. Thank you!
On-Page Optimization | | manu45
Emmanuel0 -
Are menu links considered spammy?
Hi, I'm wondering if having a footer menu with keyword links is considered spam? It makes sense to me to have your keywords and links to relevant pages on each page. Thanks 🙂
On-Page Optimization | | Memoz0 -
Changing Link Title Tags & Backlinks
On 4/19/12 I began changing the link title tags in an effort to further optimize my website. I thought they were excessively long and it would be beneficial to make them more concise. On 4/26/12 my website traffic began to fall drastically and I'm not sure if it is from google's penguin update or from changing the link title tags. I started looking into the sudden drop of traffic and realized that when I run the site explorer tool on all of the pages I changed, the URL is redirecting. It appears that the backlinks are not passing through to the new URL. Before I Changed the Link Title Tag: http://www.opensiteexplorer.org/links?site=www.beautystoponline.com%2FAndis-Professional-Hair-Clippers-s%2F102150.htm **After I Changed the Link Title Tag: ** http://www.opensiteexplorer.org/links?site=www.beautystoponline.com%2FAndis-Clippers-s%2F102150.htm So my questions are: The above example shows that the old title tag (www.beautystoponline.com/Andis-Professional-Hair-Clippers-s/102150.htm) has 43 backlinks and the new one (www.beautystoponline.com/Andis-Professiona-Hair-Clippers-s/102150.htm) has 0. Will the links eventually be attributed to the new URL. I understand that the user will still be directed to my website they click the any of the backlinks, but will the link juice pointing the old URL pass through the new one? Would it be better, in the long run, to continue optimizing the link title tags.
On-Page Optimization | | BeautyStop0 -
Too many links on page has a state directory how do i lessen this?
I dont mean how do i take away links on the page but i know right off i am going to have at least 50 right off the bat and with my footer and menu bar and such im up over the limit of 100. My seo guy took care of it on my one site and dont know how Site with issue is www.Preexistingconditioninsuranceplan.com/pcip-states one that was fixed that doesnt appear to be too many on seomoz was http://criticalillnesspolicies.com/insurance-coverage/united-states/ if anyone can inform or decypher the code please let me know
On-Page Optimization | | lance010