Does anyone know if certain DMOZ categories are blocked/never get indexed on google?
-
Hi all,
After waiting many months I was happy to see a certain site listed on DMOZ, then months later still haven't seen the dmoz category indexed in google.
It makes me wonder if certain categories don't get indexed or blocked or even previously penalized by google.
The category in question is a regional one : http://www.dmoz.org/Regional/North_America/United_States/New_Jersey/Localities/G/Garfield/Business_and_Economy/
Anyone come across this before?
Dave
-
There is a good post here in seomoz about exactly this issue with DMOZ - in recent times due to the sheer size of DMOZ itself, it really doesn't get crawled that well in the more niche or local sections.
-
I'll give that a go thanks Vinnie.
I did some tweets referencing the page but that hadn't help.. a couple of test posts on some forums I run might catch googles attention
-
Hey Dave,
Just a quick followup. It looks like the page is in Google, but in a different language:
I still suggest getting a few links to that directory page.
-
Hey Dave,
One idea that comes to mind is building a few links to that directory page. The nice thing is they don't have to be very targeted since you don't really need to worry about penalties or anything like that. That category seems to be pretty deep which could explain your problem; it probably doesn't get very much link juice at all from the categories above it in the directory.
Get a few links to it and it may be crawled/cached/indexed more often and start showing up in Google.
Cheers,
Vinnie
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google balances SERP results with positive and negative News/PR?
Hey guys, We did reputation management back in March 2017. We basically built high quality links to online assets such as linkedin, twitter, facebook, positive PR articles and other web properties in order to rank them higher then negative PR. However there was 0 change (the link building was solid). And the negative PR remains in the top 10 with also positive new articles about the site. At this point, i believe that Google is keeping the negative PR in the top 10 to keep balanced SERP results. Does anyone know if this is something Google does to balance positive and negative results? Cheers, Chris
Intermediate & Advanced SEO | | cathywix0 -
Do I need to remove pages that don't get any traffic from the index?
Hi, Do I need to remove pages that don't get any traffic from the index? Thanks Roy
Intermediate & Advanced SEO | | kadut1 -
Top-10 ranked site dropping in/out of Google index?
I work for a company that makes an important product in a category. The company has a website (www.company.org); the product is at www.company.org/product. We recently (early May) redesigned and rearchitected the product site for SEO purposes. The company site talks about the category a bit (imagine the Colgate site; it talks about "toothpaste" a bit). The blog (blog.company.org/product) also talks about the category quite a bit (and links to the company site of course). The product is a major product in the category, among the top 3. The site and blog have been around for 15+ years. The site has appx. a billion backlinks, most branded links to the product. It's in the top 50 highest ranked sites among all sites on the internet in the ahrefs rank index. Imagine you are searching for our product category, "category". If you search for "category" in Bing today, my company's site is the 3rd result, and it's the 1st result from a company that makes a product in this category. If you search for "category" in Google today, our site is not in the top 150 results. In fact, the site keeps dropping out of Google's index. (See attached for what that looks like in the search console.) What might cause a site to jump from "ranked in top 10" to "not ranked" in Google -- back and forth every couple of days? Penalties? Our recent (early May) site rearchitecture? We're not making giant, index-shifting changes every day. wE0Bn
Intermediate & Advanced SEO | | hoosteeno0 -
Fetch as Google -- Does not result in pages getting indexed
I run a exotic pet website which currently has several types of species of reptiles. It has done well in SERP for the first couple of types of reptiles, but I am continuing to add new species and for each of these comes the task of getting ranked and I need to figure out the best process. We just released our 4th species, "reticulated pythons", about 2 weeks ago, and I made these pages public and in Webmaster tools did a "Fetch as Google" and index page and child pages for this page: http://www.morphmarket.com/c/reptiles/pythons/reticulated-pythons/index While Google immediately indexed the index page, it did not really index the couple of dozen pages linked from this page despite me checking the option to crawl child pages. I know this by two ways: first, in Google Webmaster Tools, if I look at Search Analytics and Pages filtered by "retic", there are only 2 listed. This at least tells me it's not showing these pages to users. More directly though, if I look at Google search for "site:morphmarket.com/c/reptiles/pythons/reticulated-pythons" there are only 7 pages indexed. More details -- I've tested at least one of these URLs with the robot checker and they are not blocked. The canonical values look right. I have not monkeyed really with Crawl URL Parameters. I do NOT have these pages listed in my sitemap, but in my experience Google didn't care a lot about that -- I previously had about 100 pages there and google didn't index some of them for more than 1 year. Google has indexed "105k" pages from my site so it is very happy to do so, apparently just not the ones I want (this large value is due to permutations of search parameters, something I think I've since improved with canonical, robots, etc). I may have some nofollow links to the same URLs but NOT on this page, so assuming nofollow has only local effects, this shouldn't matter. Any advice on what could be going wrong here. I really want Google to index the top couple of links on this page (home, index, stores, calculator) as well as the couple dozen gene/tag links below.
Intermediate & Advanced SEO | | jplehmann0 -
Anyone actually getting a noticeable SEO boost from a Bitly or TinyURL backlink?
Hi, I'm looking for an example/use case of someone whose site has been linked to from another using a Bitly, or other generic URL shortener link. I'm specifically interested in proving/disproving the value of the backlink in terms of boost in SEO rankings. Ideally you somehow got a juicy backlink from a reputable site, but they accidentally linked to you using a Bitly or something, yet you saw a noticeable increase in your pages search rankings, thus proving the value of a Bitly link still passing all SEO value. Or alternatively, you got that juicy backlink and noticed nothing at all, or not much, and are frustrated that they used a BItly. I'm launching a study on this soon to identify the possible value behind short links as backlinks. Yes, I know that Matt Cutts says all short links are 301 redirects which passes something like 99.9% of link juice. I'd just like to see some use cases on this. Thanks!
Intermediate & Advanced SEO | | Rebrandly0 -
Block web archieve/way back machine
Hi i want to block web archive/wayback machine from indexing my site and creating a record of it on their database. Any ideas on how to do this? Cheers,
Intermediate & Advanced SEO | | Mikey008
Superpak2 -
Killing 404 errors on our site in Google's index
Having moved a site across to Magento, obviously re-directs were a large part of that, ensuring all the old products and categories linked up correctly with the new site structure. However, we came up against an issue where we needed to add, delete, then re-add products. This, coupled with a misunderstanding of the csv upload processing, meant that although the old urls redirected, some of the new Magento urls changed and then didn't redirect: For Example: mysite/product would get deleted re-added and become: mysite/product-1324 We now know what we did wrong to ensure it doesn't continue to happen if we weret o delete and re-add a product, but Google contains all these old URLs in its index which has caused people to search for products on Google, click through, then land on the 404 page - far from ideal. We kind of assumed, with continual updating of sitemaps and time, that Google would realise and update the URL accordingly. But this hasn't happened - we are still getting plenty of 404 errors on certain product searches (These aren't appearing in SEOmoz, there are no links to the old URL on the site, only Google, as the index contains the old URL). Aside from going through and finding the products affected (no easy task), and setting up redirects for each one, is there any way we can tell Google 'These URLs are no longer a thing, forget them and move on, let's make a fresh start and Happy New Year'?
Intermediate & Advanced SEO | | seanmccauley0 -
How do I get 2 column Google sitelinks instead of one line sitelinks?
Currently, if you search for my site's brand name on Google, we are the top result. However, rather than having 2 columns of sitelinks, there is just one line of 4 sitelinks. When you search for the site's domain (sitename.com), you get the full 2 columns of sitelinks. Are there any strategies for getting the 2 columns on more than just the domain name search? At the very least, I'd like to get 2 columns to appear when you do a brand name search, but it'd be great to get 2 columns of sitelinks for our top search queries as well. Thanks for the advice...
Intermediate & Advanced SEO | | BostonWright0