Some web 2.0 sites blocked by robot
-
I had created some web2.0 sites, google also indexed those sites but those sites robots.txt are disallow, this mean Google will not give any credit on ranking ? I have seen in google, those sites meta description was written - A description of this site is not available due to the robot.txt file. I checked that file, it is written disallow. Can google still count those sites for the ranking purpose ?
-
Hi,
Pages blocked by robots.txt file will not be considered for ranking. You still see those pages in Google's index is because of their mentions on other websites. Google has been doing link discovery from websites other than these Web2.0 sites of yours. So to stop Google completely from indexing these pages, you should go in for page-levelrobots meta tag. Here you go for more: https://support.google.com/webmasters/answer/93710?hl=en
Once you implement the page-level robots meta tag to block those pages, Google will remove them from the index after the next crawl. You can expedite this process by using the link removal procedure in webmaster tools account.
Here you go for more: https://support.google.com/websearch/troubleshooter/3111061?rd=1
Good Luck to you my friend.
Best regards,
Devanur Rafi
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is it possible to rank a second site, for my buisness, for the same location?
I have an insurance agency, and recently set up a new site, specifically for personal lines insurance. My question is; Is it worth trying to rank this site, by using backlinks and unique content? It will have the same address, and location as my main site. I'm also concerned Google may frown on that.. Any input appreciated.
Link Building | | MissThumann0 -
Links to www version of my site, but we are on http - is this a problem?
My website is hosted on e.g. http://eg1 but i have lots of links and new links pointing to http://www.eg1
Link Building | | fattestcat
Is this something to worry about?
Should i contact the sites and ask them to change the links to http?
Or is it nothing to worry about? Thanks for your advice.0 -
Detected a bad site linking to you? what to do?
I have detected on linkdetox site that had stolen a face photo of a smile from a star my website and is linking to the page. I uploade a disavow with that site very bad domain. But my question is if should a take that picture of my site or rename so the link goes to 404. It is not an important or relevant page for my website
Link Building | | maestrosonrisas1 -
Bought links from sites with target keyword in their URL
One of my rivals in a competitive field (real estate) has done this deliberately and extensively -- it accounts for about 2/3 of his inbound links. Result: he's now #1. How strong a ranking factor is keywords in source URL - ie, how easy is it to beat with other ranking factors?
Link Building | | Jeepster0 -
Pursuing Links on Sites You Have a Link From
Is it a bad idea to spend resources to get a second link from a site that already links to you? It seems like the marginal value of each additional link is much smaller than the first link.
Link Building | | ProjectLabs0 -
Old Site not Passing Along Links?
Recently, we created a new website for a client, and put it on a new domain. We put a 301 redirect site-wide on the old site. The 301 is working correctly, and any visit to the old site is now going to the new one. So, from a functionality standpoint, we're looking good. However, looking at the domain authority of the sites, it doesn't seem that the old links are passing value to the new site. The old site had 43 linking root domains, and a domain authority of 30, compared to the new site with 16 linking root domains and an authority of 22. If I understand correctly, the links should be viewed as pointing to the new site and passing link juice to the new one, correct? Is there a reason why this may be happening that I should be looking into? Any thoughts or advice on this one would be appreciated. Thanks guys!
Link Building | | DeliaAssociates0 -
Observation on Linking to other sites
Hello, I have a blog for one year now and in the overwall is going great. In all this time it was an awesome way to discovery some SEO mysterious and learn with experience wich in my point of view is the best way to do it. Now my observation is about links to other sites and what does that do. At the present I have about 35 keywords in the 3 first places in Google, bing e Yahoo. All good. I notice that the posts that I have links (dofolow) to other sites are performing better then those ones that only have internal-links. And Its curious that this change as starting to surface in Dezember of 2011. Now the confusion is about the SEOmoz observation towards external links. "You should avoid having too many (roughly defined as more than 100) hyperlinks on any given page. When search engine spiders crawl the Internet they are limited by technology resources and are only able to crawl a certain number of links per webpage. In addition, search engine algorithms divide the value of some popularity metrics by the amount of links on a given page." Now hell with this observation I say. Its working for me and for now on I will actually apply this SEO strategy when Im talking about a subject in a post:) What do you guys think? Whats your experince on this? Regards, Pedro M Pereira
Link Building | | PedroM0 -
What is best way to evaluate external links to my site?
What is the best way to evaluate external links coming in to my site? I have been working on trying to build links by commenting on blogs/forums and adding to directories, etc. I've run link reports through Open Site Explorer and Yahoo and they never seem to show the same links coming in. For example, i run link eport on Open Site Explorer and it will show links coming into my site that Yahoo doesn't show, and vice versa. I guess I'm trying to figure best way to monitor each week new links coming into my site to determine if my efforts are fruitful. Also, is there a certain period of time that should pass from time I put my link on another site (ie, a blog) until it will show up in OPen Site Explorer? Thanks! Oh, and I use the NoDoFollow Add-on for Firefox to only comment on those sites that do follow. Not sure if that's really effective or not.
Link Building | | leonenobleseate0