Need suggestion: Should the user profile link be disallowed in robots.txt
-
I maintain a myBB based forum here. The user profile links look something like this http://www.learnqtp.com/forums/User-Ankur
Now in my GWT, I can see many 404 errors for user profile links. This is primarily because we have tight control over spam and auto-profiles generated by bots. Either our moderators or our spam control software delete such spammy member profiles on a periodic basis but by then Google indexes those profiles.
I am wondering, would it be a good idea to disallow User profiles links using robots.txt?
Something like
Disallow: /forums/User-*
-
Maybe you should noindex user profile pages until they've been active on the site long enough that a) you're sure they're not a spam bot and b) they're actually active users, with some interesting information to share on their user page?
Like Shaliendra said, this is your call. It's really about your website goals, and what those user pages do for the site. Are you getting much organic traffic from user pages? If you aren't, it's probably easiest to just noindex all user pages. But if some profiles are bringing in organic traffic, I'd recommend that you add a noindex tag immediately, but remove it once someone has commented a few times.
Does that help?
-
I am only talking about user profile pages not the links inside them. I have already taken care of them.
Request others to please come up with suggestions.
-
If you are talking about user profile pages, it is your call.
If you are talking about links that users post in profile pages, use as signatures or use in threads, make sure to mark them nofollow.
Regards
-
Let me re-phrase my question a bit. Would it be a good idea to get the user profile links noindexed in the first place? or should we keep them indexed in Google?
-
Use meta="noindex" tag for the user profile pages. It is more effective.
Regards
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Do javascript pseudo-links dilute link juice ?
Hi, On our ecommerce, we use multiple pseudo-links for the layered navigation (to filter by color, site, etc), so that google doesn't crawl every combination of filters. I know this kind of links don't pass link juice and don't get crawled (provided you hide the target urls in your javascript). But, as there is an "onclick" property, I'm afraid that google could understand that these are links, and treat them the same way as nofollowed links (not following them but diluting link juice anyway). Do you know if this is the case ? Thanks,
On-Page Optimization | | Strelok0 -
Link Building
I have to be doing something wrong. I have been trying to get homes for sale in Casa Grande AZ, and Casa Grande Real Estate to rank well in google. However, I am dropping in rank. What am I doing wrong http://azbestlistings.com/casa-grande-az-real-estate-homes-for-sale-in-casa-grande-az
On-Page Optimization | | sansonj0 -
How do I Avoid Excessive Internal Links on an eCommerce site?
I think I'm getting dinged for this on Term Target because the page is full of products, which have links to their product page, but I'm not sure.
On-Page Optimization | | PageLogic0 -
Footer link to home page?
Quick question - is it a best practice to add a footer link on each page of a website that points back to your home page, with the anchor text being your official brand name?
On-Page Optimization | | Bandicoot0 -
100 links on one page
we're recommended 100 links or less on one page. is the 100 links including header and footer links?
On-Page Optimization | | jallenyang0 -
Number of links in breadcrumb
Does google take the number of links in breadcrumb as a indicator to the depth of the page in the site structure? That will mean that a page with 5 links in the breadcrumb is a page very far away from the index, therefore a less important page.
On-Page Optimization | | seo.academy0 -
Should I put a No follow on each link in a Javascript dropdown menu?
I have a javascript dropdown menu on every page of my site. It lists all the wineries I write about and sell. About 300 links. I've been told that google doesn't like so many links on a page, but that it doesn't spider javascrpt. Then I hear that it does. Am I being penalized by all the links? Or does the spider really not see them? I don't want to give up my javascript menus, unless I have to. Should I put a no follow on each link inside the code? And on the other hand, am I losing google juice by not letting it see all the pages on my site that I link to in the javascript menu? Thanks in advance for your help!
On-Page Optimization | | JeanYates0 -
What is the effect of too many internal links on a page?
Hi there! We have been doing a great effort during the last year but our main competitor is still above us in search rankings. Basically, the main differente remains now in the number of internal links, specially in our homepage. We have more than 200 and they only have around 100, so I think we are wasting too much link power among some irrelevant pages. What could be the effect of this?
On-Page Optimization | | bodaclick0