Need suggestion: Should the user profile link be disallowed in robots.txt
-
I maintain a myBB based forum here. The user profile links look something like this http://www.learnqtp.com/forums/User-Ankur
Now in my GWT, I can see many 404 errors for user profile links. This is primarily because we have tight control over spam and auto-profiles generated by bots. Either our moderators or our spam control software delete such spammy member profiles on a periodic basis but by then Google indexes those profiles.
I am wondering, would it be a good idea to disallow User profiles links using robots.txt?
Something like
Disallow: /forums/User-*
-
Maybe you should noindex user profile pages until they've been active on the site long enough that a) you're sure they're not a spam bot and b) they're actually active users, with some interesting information to share on their user page?
Like Shaliendra said, this is your call. It's really about your website goals, and what those user pages do for the site. Are you getting much organic traffic from user pages? If you aren't, it's probably easiest to just noindex all user pages. But if some profiles are bringing in organic traffic, I'd recommend that you add a noindex tag immediately, but remove it once someone has commented a few times.
Does that help?
-
I am only talking about user profile pages not the links inside them. I have already taken care of them.
Request others to please come up with suggestions.
-
If you are talking about user profile pages, it is your call.
If you are talking about links that users post in profile pages, use as signatures or use in threads, make sure to mark them nofollow.
Regards
-
Let me re-phrase my question a bit. Would it be a good idea to get the user profile links noindexed in the first place? or should we keep them indexed in Google?
-
Use meta="noindex" tag for the user profile pages. It is more effective.
Regards
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Do I need Yoast SEO video for YouTube videos?
I have been following advice for improving the SEO of my YouTube videos, for instance by having the keyword early in the title and description. Do I then need a plugin like Yoast Video SEO for my website where the videos are embedded to increase the chance of showing the videos for that keyword?
On-Page Optimization | | AudunBK0 -
Wordpress #comment links?
We just started our trial account and have the results from our first Moz Pro Site Crawl. It's showing that we have a large portion of our pages have 'Too Many Links' and I'm trying to determine exactly what this means and how to fix it. The article referenced is from 2011 and doesn't fully address what I'm looking for. Here are a few questions: 1. Can we lower the 'link count' by adding a 'no follow' or does too many links, count links regardless? The question being, is the only way to solve this by removing links or are their no follow or no index options that will prevent us from having this issue moving forward? 2. Comment Links: Our site is in Wordpress and I just recognized that each of the comment links are followed: https://screencast.com/t/b0CIKVafWw. These aren't links from our users, rather these are links within Wordpress and are structured like this: https://mysite.com/blog-post/#comment-6970. From my screenshot you can see they are highlighted as 'followed links'. Is there a setting within Wordpress to turn this off or is there another option I should consider? Should we just make these no index, no follow links? Will that solve the 'Too many links' problem? I searched through the Q&A's and couldn't find an answer directly to my question. Most were around people leaving links in the comments section, which isn't what I'm looking for. Thank you for any help you can provide.
On-Page Optimization | | FabulesslyFrugal0 -
Should I add canonical links to pages that are redirected?
Hello! I am a little confused concerning canonical links. I have several URLs that all access my page, but I redirect them all. A lot of places I am told to redirect them or use canonicals. Other places, I read that I should always use canonicals. What is the right way for me? If I should use canonicals as well as redirects, which links should I do this on? I redirect my pages like this: http to https:
On-Page Optimization | | hermanok
http://example.com -> https://example.com www to non-www:
https://www.example.com -> https://example.com Remove trailing slashes
https://example.com/ -> https://example.com Would-be 404-requests to index.php?p=$1
https://example.com/home -> https://example.com/index.php?p=home ( show as https://example.com/home ) Example:
http://www.example.com/home/ -> http://www.example.com/home/ -> https://example.com/home/ -> https://example.com/home -> https://example.com/index.php?p=home ( shows as https://example.com/home ) Thank you!0 -
Too Many on page links on my homepage question?
Question, on moz analytics, for my homepage, I've gotten the " Too many on page links" notification every crawl. I've always ignored it because i didnt think it affected ranking or anything really. The on page links on the bottom of our homepage are landing pages. Most users reach those pages by searching those specific pages on google. We just decided to put them on the bottom of our page for unknown reasons. My question is, should i remove the landing pages on the bottom of our homepage? WIll it improve search rankings for my homepage? if i do remove them, should i put the landing pages on another page besides the homepage? Does google index my website better without the on page links on my homepage? My website is- prestigeluxuryrentals.com
On-Page Optimization | | prestigeluxuryrentals.com0 -
To many links hurting me even though they are helping users
I have a scrabble based site where I function as a anagram solver, scrabble dictionary look up and tons of different word lists. In each of these word lists I link every word to my scrabble dictionary. This has caused Google to index 10018 pages total for my site and over 300 of them have well over 100 links. Many of them contain over 1000 links. I know Google's and SEOMOZ stance that anything over 100 will hurt me. I have always seen the warnings in my dashboard warning me of this but I have simply ignored it. I have posted on this Q and A that I have this issue, but IMO having these links benefit the users in the aspect that they don't have to worry about coping the text and putting it in the search box, they can simply click the link. Some have said if it helps the users then I am good, others have said opposite. I am thinking about removing these links from all these word lists to reduce the links per page. My questions are these. 1. If I remove the links from my page could this possible help me? No harm in trying it out so this is an easy question 2. If I remove the links then I will have over 9000 pages that are indexed with Google that no longer have a link pointing to them, except for the aspect that they are indexed with Google still. Is it going to hurt me if I remove these links and Google no longer sees them linked from my site or anywhere else?
On-Page Optimization | | cbielich0 -
Too many on-page links
Hi, My website - www.thepartyhouse.com.au is showing as having too many on-page links for over 4,000 pages. Take for example the homepage which is showing as 188 links, but I don't understand this because I've used SEO tools to display the links and I am showing around 90 links on this page. How can I see what all the links are? Thanks
On-Page Optimization | | Spyre0 -
Breadcrumb links
Hello. Are the breadcrumb links valued more over other links ? (google searches for them specificaly to display them in the results)
On-Page Optimization | | seo.academy0 -
Too many on page links
Our home page (and 1400 of our other pages) have well over 100 links, going beyond the recommend amount. Our competitors have less on page links (to other pages on their site) and way more link popularity so we are trying to figure out the best solution for this without hurting our sites conversions and usbaility.
On-Page Optimization | | iAnalyst.com0