Need suggestion: Should the user profile link be disallowed in robots.txt
-
I maintain a myBB based forum here. The user profile links look something like this http://www.learnqtp.com/forums/User-Ankur
Now in my GWT, I can see many 404 errors for user profile links. This is primarily because we have tight control over spam and auto-profiles generated by bots. Either our moderators or our spam control software delete such spammy member profiles on a periodic basis but by then Google indexes those profiles.
I am wondering, would it be a good idea to disallow User profiles links using robots.txt?
Something like
Disallow: /forums/User-*
-
Maybe you should noindex user profile pages until they've been active on the site long enough that a) you're sure they're not a spam bot and b) they're actually active users, with some interesting information to share on their user page?
Like Shaliendra said, this is your call. It's really about your website goals, and what those user pages do for the site. Are you getting much organic traffic from user pages? If you aren't, it's probably easiest to just noindex all user pages. But if some profiles are bringing in organic traffic, I'd recommend that you add a noindex tag immediately, but remove it once someone has commented a few times.
Does that help?
-
I am only talking about user profile pages not the links inside them. I have already taken care of them.
Request others to please come up with suggestions.
-
If you are talking about user profile pages, it is your call.
If you are talking about links that users post in profile pages, use as signatures or use in threads, make sure to mark them nofollow.
Regards
-
Let me re-phrase my question a bit. Would it be a good idea to get the user profile links noindexed in the first place? or should we keep them indexed in Google?
-
Use meta="noindex" tag for the user profile pages. It is more effective.
Regards
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What is robots.txt file issue?
I hope you are well. Mostly moz send me a notification that your website can,t be crawled and it says me o check robots.txt file. Now the Question is how can solve this problem and what should I write in robots.txt file? Here is my website. https://www.myqurantutor.com/ need your help brohers.... and Thanks in advance
On-Page Optimization | | matee.usman0 -
Best On page SEO guides needed.
I know my question looks so basic but let me explain what I want. I want advanced on-page SEO guides, should include something new exce[t the below listed things: title, description keyword in article content length video images with alt tag headings external authority links internal links please share something new....
On-Page Optimization | | hammadrafique0 -
Internal link text
Hi With internal links, should I make sure to always use the same anchor text im trying to rank the page for? For example im having a tidy up and have realised im linking to the same page in multiple blog posts using different anchor text. Whats the rule of thumb here? Thanks Chris
On-Page Optimization | | mrcsleonard1 -
WordPress image urls - need a WP maven
We were having a conversation re urls that are indexed for images that are stored in various media plugins in WP. My question for anyone who is an uberWP person is: What is your opinion re best media storage plugins and how these URLs affect pages on a site for ranking, etc. I realize this is broad, but it is driven out of my concern that I cannot touch everything. When I see a url like this: http://www.drumbeatmarketing.net/wp-content/themes/drumbeat2/img/DB-LOGO-White.png I know there is no way with all the sites and clients we handle that I can get it perfect but this just bugs me for some reason. Should I just chill since it (seemingly) affects so little....?
On-Page Optimization | | RobertFisher1 -
Should links on a family bar be no follows?
I have a network of sites that we use a family bar for to get the user to where they want to go but as I am looking at my link profile, i keep on seeing these links everywhere. (DUH, of course) Question is, should these links be no follow? Could these links hurt me?
On-Page Optimization | | SBRMarketing0 -
Too many links??
Hi mozzers I have a question that I need some feedback on please, I run 2 websites both e commerce retail sites and both doing well with SEO however, Our strongest site and parent site so to speak links to our sister site. Here is the outline. Site1 parent site is hosted on a unique URL and on a VPS. I have 384 links coming into this site from the other sister site. from various pages Site 2 the sister site, has 68,864 links coming in from site 1 as we have a link in the footer on site 1 to the home page of site 2. So far we have had no adverse affects from the Google zoo releases, however I am concerned that this many links will soon get penalized. Thoughts from anyone please? I am considering removing the footer link, thus removing 68,000 + incoming links. Looking for any advice here please. thanks Ryan
On-Page Optimization | | RyanC10 -
Internal link to the home page
When building menus and other internal links, should the link to the home page be http://www.domain.com/ or http://www.domain.com/index.html or does it matter? Best,
On-Page Optimization | | ChristopherGlaeser
Christopher0 -
Building content pages, redirecting and linking
Previously the company had created some .HTML content pages around top shoe styles and top manufactures. One or two of these pages used to rank but have been neglected over the page 18 months. I want to build out new content round our top styles / top manufactures and I am wondering if I should use the existing HTML pages or create new pages that use our content management system. The .HTML pages can contain keywords in the URL, using our content management system, all URL’s are www.site.com/content/home/contentid=1234abcd. If we use the .HTML pages all content is managed manually. If we build out 6 to 10 pages, this can become a resource issue and may result in a bad experience for the website visitor. From an SEO perspective, does the benefit of having the keywords in the URL outweigh the manual management hassles? And if not, should we 301 all the HTML pages to the new content pages? And from a linking standpoint, I want these content pages to point to the new version of the top style. From a navigation standpoint, we also want to provide access to all styles from the manufacture. Should we nofollow the links to all styles?
On-Page Optimization | | seorunner0