Some web 2.0 sites blocked by robot
-
I had created some web2.0 sites, google also indexed those sites but those sites robots.txt are disallow, this mean Google will not give any credit on ranking ? I have seen in google, those sites meta description was written - A description of this site is not available due to the robot.txt file. I checked that file, it is written disallow. Can google still count those sites for the ranking purpose ?
-
Hi,
Pages blocked by robots.txt file will not be considered for ranking. You still see those pages in Google's index is because of their mentions on other websites. Google has been doing link discovery from websites other than these Web2.0 sites of yours. So to stop Google completely from indexing these pages, you should go in for page-levelrobots meta tag. Here you go for more: https://support.google.com/webmasters/answer/93710?hl=en
Once you implement the page-level robots meta tag to block those pages, Google will remove them from the index after the next crawl. You can expedite this process by using the link removal procedure in webmaster tools account.
Here you go for more: https://support.google.com/websearch/troubleshooter/3111061?rd=1
Good Luck to you my friend.
Best regards,
Devanur Rafi
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can piracy sites linking to you hurt your SEO?
Hello, Our website sells software that we have developed, but there are piracy websites that offer a crack/keygen to our software and are linking to our site. From an SEO perspective, are those sites hurtful to us if their spam score is below 30 and their DA is not 1? We'd like to understand if there is any action we need to take from an SEO point or if our site's SEO is not affected by it. Thank you!
Link Building | | marynau0 -
Is ListofDomains.org a bad linking site?
I am trying to clean up/disavow bad linking domains and ListofDomains.org appears numerous times. Any idea what this site is about and should it make the disavow list?
Link Building | | khull0 -
Adding web designer credits to properties I create
I’m a web designer and I add a “design by studio 35 “ link on the footer of all the web sites I design. By doing so, every page on a website links to me, since the sites I build can have anywhere from 10 to 100 pages (wordpress and shopify). While this does on occasion get me clients and inquiries, is this affecting the SEO to my site in a good, or in a bad way? Non of the sites are spammy, but many of them have low domain authority since they are typical small businesses and organizations and do no SEO efforts. Would it be better to add a "site credits" link to a page within a client site, and there add a bit of info and link out? That way, there is only 1 link back to my site?
Link Building | | studio35design0 -
Detected a bad site linking to you? what to do?
I have detected on linkdetox site that had stolen a face photo of a smile from a star my website and is linking to the page. I uploade a disavow with that site very bad domain. But my question is if should a take that picture of my site or rename so the link goes to 404. It is not an important or relevant page for my website
Link Building | | maestrosonrisas1 -
Are hosting Web badges still worth it?
Hi, I would like to ask you about a really specific case: hosting company web badges. I'm working for a web hosting company, and in order to increase the number of incoming links we were considering providing web badges to our customers, so they could link back to us. Some customers would be glad to show they host their website with us placing one web badge in their website, but after the last penguin update I'm not sure if it's still a good idea. As the company is hosting several thousand websites it could be a really good opportunity to get some back links, but I would like to hear your suggestions. Shall we use "nofollow" on the links? (But that way we would be missing all the link juice that we could get) Would it be better to just show the web badge on the home page of each domain and keep the dofollow attribute? Are there some terms that we should use or avoid in the links? Maybe "Hosted at <company name="">" would be a good anchor text, or shall we just use the company name? </company> So, I would love to hear your advice about doing or not doing it. Or any advice about how to do it properly in order to get the desired result. Thanks! 🙂 Xavier.
Link Building | | xtrill0 -
Links from Related Sites with Low PR or semi-related sites with High PR?
Is it better to get a link from a site with lower PR but related content or higher PR but semi-related or unrelated content? For example, if I sell shoes, would a link from a PR1 or PR2 shoe or apparel site be better or a link from PR4 website that sells books be better? I'm not talking about sites with completely unrelated content, but how relevant is PR in obtaining relevant links if I am trying to raise the PR and rankings of my own site?
Link Building | | applesofgold0 -
Do sites on the same c-block and same server count as seperate linking root domains when linking to each other?
Lets say there are 50 businesses who have their website on the same server and are on the same c-block but the owners of the individual sites are different (i.e. they are all completely different sites not relevant to each other). Each of those sites are linking to each other due to a feature on the sites. This obviously increases the number of total links to each site but does it also increase the number of linking root domains? Or does this just show up as one linking root domain due to all of them being on the same server and the sharing the same c-block?
Link Building | | cinternicola0 -
Hey guys wondering which is more important getting links from authority sites or relevant sites?
basically a site that has really high authority but not that relevant or medium authority pages but relevant. an example an authority site with a mozrank of 80 or a relevant site of 20.
Link Building | | shrikey0