Some web 2.0 sites blocked by robot
-
I had created some web2.0 sites, google also indexed those sites but those sites robots.txt are disallow, this mean Google will not give any credit on ranking ? I have seen in google, those sites meta description was written - A description of this site is not available due to the robot.txt file. I checked that file, it is written disallow. Can google still count those sites for the ranking purpose ?
-
Hi,
Pages blocked by robots.txt file will not be considered for ranking. You still see those pages in Google's index is because of their mentions on other websites. Google has been doing link discovery from websites other than these Web2.0 sites of yours. So to stop Google completely from indexing these pages, you should go in for page-levelrobots meta tag. Here you go for more: https://support.google.com/webmasters/answer/93710?hl=en
Once you implement the page-level robots meta tag to block those pages, Google will remove them from the index after the next crawl. You can expedite this process by using the link removal procedure in webmaster tools account.
Here you go for more: https://support.google.com/websearch/troubleshooter/3111061?rd=1
Good Luck to you my friend.
Best regards,
Devanur Rafi
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Web Directories and Sponsorships in 2014?
Yes I know many of you will say that link building using web directories is old school and does not work. But after studying a website created last year, it ranks in the top 10 "how make a website" run by Peter Zaborszky.
Link Building | | affigroup
I noticed that he has links from web directories. Not many but he used web directories.. My question is: What you sort a list of web directories and only use ones with high PR and DA . Is this safe? Another remark, what is the difference between web directories and page where donors/sponsors are mentioned with anchor text and dofollow link?. Those pages like web directories contain quite a lot of links from same page. I'm curious how Google sees these pages.0 -
Reassessing site achitecture
Firstly I'm only a recently new member but am already a big fan and rely on the tools a lot. For the sake of context, our site is www.cleancruising.com.au which we've steadily built into one of Australia's top cruise sites. We've focussed on building unique content including a mapping engine to show over 10,000 cruise routes, 3D ship models for virtual tour simulations and over 350,000 words of unique descriptive content. So we think we've got some good content which we currently rank quite well for, but think there's a lot of room for improvement with the links, both internal and inbound. Looking at the internal links, I thought the site architecture was pretty good but now I'm not so sure. The site hierarchy is like this: home > cruiseline (20) > ship (200) > itinerary page (12000) > enquiry form and home > region (25) > port (1400) > itinerary page (12000) > enquiry form My question is, am I wasting link juice by doing the following? A sample itinerary page shows lots of links through to the enquiry form (with different parameters). However years ago we added the enquiry form to be blocked via robots.txt and none of these page variations are indexed by google. Is this stuffing up the link flow, and should I allow the forms to be indexed so their links can add value back through the site? Are there any tools for visualizing a site link structure? Lots of questions and hope this is appropriate. 1am in Australia so may take a few hours before any follow up posts, cheers
Link Building | | cruiserDan0 -
How to do SEO for a social networking site?
Howdy SEOmoz fans, We are about to launch an educational social networking site. We have planned a lot of good strategies for offline and online marketing. Coming to SEO, how we can do search engine optimization effectively for our social networking site. The home page will be sign up page and there wont be any content in it. It would be great if you can suggest us prefect SEO tactics for our site. Thank you.
Link Building | | jjv0 -
Linking to a site in the US from a site in the UK - Good, bad or not important?
Would linking to a site in the US from the UK do harm or good if the site being linked to is industry related? i.e. a UK web design company linking to a US web design career site.
Link Building | | Tone_Agency0 -
Any value in link building to local pages on my site?
If I'm trying to rank for the term 'wedding band' with my url: http://www.musicliveuk.com/home/wedding-bands will linking to local pages such as: http://www.musicliveuk.com/live-acts/hire-wedding-bands/wedding-bands-london help the main page to rank? I added the 'local' pages to try and pick up any traffic from long tail search queries but my main focus is on getting the main page to rank as the traffic from long tail queries is so small. So is it worth me spending time building links to these local pages in order to try and help the main page rank?
Link Building | | SamCUK0 -
Nofollow advertisers with high value sites
A site with a high PA/DA links to all of their advertisers on their home page using nofollow. The advertisers generally have high quality sites and none of them are spammy. Having read this forum for the past couple months, it is my understanding that nofollow should be used to control spam links, and is commonly used in the forum section where site owners can not control or vouch for the outgoing links. However, as I understand the topic, there is no benefit to using nofollow for high value sites for which you can recommend, and in particular, when the site is receiving money from the advertisers. The link juice is divided by all the links on the page, both follow and nofollow, and the juice for the nofollow is discarded. I ask this question because we are one of the advertisers on the site. I want to contact them about this issue, and request that they remove the nofollow from the advertiser links. Comments? Best,
Link Building | | ChristopherGlaeser
Christopher0 -
How to Add Content to a Product-Focused Site
I recently took over management of the SEO work for the following site: http://www.grovercorp.com/rings-and-seals/. I want to do link building, but don't have a ton of experience with it. From what I've read, offering linkable content is the best way to get links. However, this site -- like many in industrial B-2-B -- is focused primarily on promoting their products. I'd like tto offer an article or add an infographic, but am not sure where I would put it? It doesn't seem like the architecture offers a good place to add linkable content. Anyone have thoughts or suggestions?
Link Building | | EricVallee340