Need suggestion: Should the user profile link be disallowed in robots.txt
-
I maintain a myBB based forum here. The user profile links look something like this http://www.learnqtp.com/forums/User-Ankur
Now in my GWT, I can see many 404 errors for user profile links. This is primarily because we have tight control over spam and auto-profiles generated by bots. Either our moderators or our spam control software delete such spammy member profiles on a periodic basis but by then Google indexes those profiles.
I am wondering, would it be a good idea to disallow User profiles links using robots.txt?
Something like
Disallow: /forums/User-*
-
Maybe you should noindex user profile pages until they've been active on the site long enough that a) you're sure they're not a spam bot and b) they're actually active users, with some interesting information to share on their user page?
Like Shaliendra said, this is your call. It's really about your website goals, and what those user pages do for the site. Are you getting much organic traffic from user pages? If you aren't, it's probably easiest to just noindex all user pages. But if some profiles are bringing in organic traffic, I'd recommend that you add a noindex tag immediately, but remove it once someone has commented a few times.
Does that help?
-
I am only talking about user profile pages not the links inside them. I have already taken care of them.
Request others to please come up with suggestions.
-
If you are talking about user profile pages, it is your call.
If you are talking about links that users post in profile pages, use as signatures or use in threads, make sure to mark them nofollow.
Regards
-
Let me re-phrase my question a bit. Would it be a good idea to get the user profile links noindexed in the first place? or should we keep them indexed in Google?
-
Use meta="noindex" tag for the user profile pages. It is more effective.
Regards
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Linking back to the homepage im trying to rank - Using exact match anchor? Linking from footer?
Hello, Our site is an basically advertisements / listings website. Structure is as following <last 200="" adds=""> (homepage trying to rank) < category 1 > < category 1 > < category 1 > < category 1 > < category 1 ></last> My question - each of the categories links back within the menu back to homepage. The link text currently is last 200 adds. Can i use exact match anchor? Or should i use just last 200 ads? The issue is that one of my categorys (category 1) has already the exact match anchor im trying to rank for. So i can not use the same to link back to homepage. Im worried that google does not see any exact keyword anchor texts back to homepage hence will rank my homepage with lower strenght for that keyword . Im also worried that the category 1 page might now compete with the main homepage for this word (even tho at the moment category itself does not rank for this keyword) Can i link from footer back to homepage with an alternative keyword then to give some "context" to google more? Would this be spamming?
On-Page Optimization | | advertisingcloud0 -
Suggestions on dealing with duplicate content?
What are the best ways to protect / deal with duplicate content? I've added an example scenario, Nike Trainer model 1 – has an overview page that also links to a sub-page about cushioning, one about Gore-Tex and one about breathability. Nike Trainer model 2,3,4,5 – have an overview page that also links to sub-pages page about cushioning , Gore-Tex and breathability. In each of the sub-pages the URL is a child of the parent so a distinct page from each other e.g. /nike-trainer/model-1/gore-tex /nike-trainer/model-2/gore-tex. There is some differences in material composition, some different images and of course the product name is referred multiple times. This makes the page in the region of 80% unique. Any suggestions welcome about the above example or any other ways you guys know of dealing with duplicate content.
On-Page Optimization | | punchseo0 -
Link Structure
On my site I have a dropdown menu going across the page at the top to all of my categories on each page, I also have a similar structure going down the side going to the same categories, is this acceptable or would Google count this as double the internal links?
On-Page Optimization | | Palmbourne0 -
Do we have too many links in our footer?
Hi guys, we have 41 links on our holiday(vacation) rental website, this seems too many when looking at best practice. 24 of these are links to community pages while 8 link to activities pages. The community and activity pages are also accessible from links on the top menu so they are not strictly necessary but do get 10% of site clickthroughs according to Google in-page analytics. I therefore do not want to remove the links if there is no good evidence that google will penalize us for this. What do you think would be best for our site? Thanks, John Tulley. footer.jpg
On-Page Optimization | | JohnTulley0 -
Internal Followed Links and Total Internal Links as 1
It is showing Internal Followed Links and Total Internal Links as 1 in OpenSiteExplorer Tool http://www.expresscasket.com/ http://www.opensiteexplorer.org/comparisons?site=www.expresscasket.com Not able to understand and identify the problem and fix it. But when i check in google webmasters tool, it is showing lots of internal links. Does it differ those internal links and your trace of internal links
On-Page Optimization | | expresscasket0 -
Relating forum discussions to improve internal linking
Hi all, I have a matter i would like a discussion about, since I am looking for a good solution. First the case: I have a site with a large community based discussion board. We daily have 40 to 80 active forum threads with average of 200 posts. As it is right now each thread page shows, at the bottom of the thread, the 20 threads with latest activity. From a SEO point of view this is not the best solution, since all thread pages passes link juice to the latest 20 threads. However, the threads change daily so the juice is sprayed around all over the place. What I want to do is related forum threads, such that each thread at the bottom shows up to 10 threads which could be of interest to the reader. In this way one thread will have more or less the same threads at the bottom at all time, unless the relevancy is better for other threads, causing som minor changes to happen over time. The question is, how can one do this? In the backend, the forum has two tables. One holding threads and one holding posts relating to the threads. All in all the system has 66.500 threads, and in total 469.000 posts. Every thread has a title, and the posts are of varying length. The threads have categories, but they are not so distinct that a thread in one category can not be related to a thread in another category. So I would like to make the relevancy from the title of the thread and the content of the forum posts. As of yet I have not come up with a good solution, and i will look forward to reading any feedback for this. I will answer any questions as fast as possible, to get a good discussion goint here. Best regards, Rasmus
On-Page Optimization | | rasmusbang0 -
Too many On-Page Links warning + Javascript Menu
We do have javascript menus on each page. These are used by a visitor to contact a specific office in a specif city. Could this be where all these links are being counted? I don't see them elsewhere? What about links that are in the footer? They actually link to the same pages as the menus, but are just straight links.
On-Page Optimization | | Stevej240 -
Internal link to the home page
When building menus and other internal links, should the link to the home page be http://www.domain.com/ or http://www.domain.com/index.html or does it matter? Best,
On-Page Optimization | | ChristopherGlaeser
Christopher0
