Problem with indexing
-
Hello, we've changed our CMS recently, everything seems to work well, but for some reason google, and other crawlers can't see or index other pages than main. There is no restriction in robots, nor any other visible issue. Please help if you can.
Website: http://www.design-glassware.com/
-
I just want to clarify what I was saying above. In my case, even though I put brand spanking new posts on my blog they weren't getting indexed. I had about 6 duplicate posts and 4 new ones and none of them were getting indexed. But, when I dealt with the duplicate content issues for those 6 (i.e got rid of the original copies and redirected the old site to the new) then all of my content suddenly got indexed. Just sayin'
-
Thank you. I'm sure it's not a duplicate content problem. For example even when I try to put new URL as destination in Ad words, and it didn't took as working.
I think it's more of a technical issue, not SEO, probably was a wrong question here.
Thank you again everyone for helping me out.
-
In my case above, I had new pages as well that weren't being indexed, but they did get indexed once I dealt with the duplicate content. Perhaps Google put some sort of block on my whole blog because of the duplicates? If your information is duplicated anywhere you need to check this.
Also, do you have webmaster tools set up? This will tell you a lot about what is happening with your domain. Have you submitted a sitemap? This will help as well.
It may also help to build a few external links to some of the new pages. This will help Google find them.
-
You may have to resubmit your site through webmaster tools AFTER fixing the forementioned issues.
-
good catch bootleg. I think if you get the dupe content and 301's working correctly google will love you a little more.
-
Yes, I've tried Xenu (right after you asked me), it shows broken links.
-
There are some new pages we've made, and still no indexing. Google visited our page quite often, and it's been almost 1 month since we've changed the URLs.
-
Thank you for the heads up. We know about the duplicate content problem, just our webmaster is somewhat slow.
The URLs are new, and we will do 301 redirect and "canonical".
-
How long has it been since you've had the new CMS? It can sometimes take weeks to get a site crawled and indexed.
I'll share with you something that happened to me recently that may be applicable. I recently started a new site and wrote a few blog posts. Then I changed my mind and decided that those posts would be better suited to another site I had. So, I added them to another site I had. But, they wouldn't index! I realized that I hadn't deleted the content off of my first site. So, when Google came across the new blog I'm assuming they saw all the content as duplicate and didn't index it. I immediately took the content off of the original domain and I 301'd the original domain to the new one and within hours all of my posts were indexed.
-
There's nothing wrong with the links and with your robots.txt. But ...
You obviously have a huge duplicate content problem. Just look at the search result the site: query returns. There are a lot of old links (from the old CMS I suppose). Click through the links and you'll always get to the main page, but the URL remains the same. I.e. no redirect to the correct page with the new URL or to the Homepage.
You should have a look at your old URLs and redirect them with a HTTP 301 redirect to the new URL.
As a quick fix add a rel="canonical" tag to your new pages. This way google will index the correct page (and only the correct page) on its next crawl. Setting up the redirects should have happened prior to switching the CMS ...
-
Have you tried crawling it with Xenu?
-
are you using the exact same URL's with the new CMS as the old cms? if not have you done 301's?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Discovered - currently not indexed issues
Hi there We're having an issue with our site recently where our new blog posts are not indexing properly from Google.
Technical SEO | | Syte
Inspecting it with Google Search Console gives up the errors "Discovered - currently not indexed" and "Excluded". I.e. it seems like Google sees our sitemap but chooses not to crawl and index for some reason. Does anybody have any ideas why this might be, and what we could do to fix it?
Thanks0 -
Webmaster Tools Verification Problem
Hello, Somehow a website I'm working on has lost it's verification in Webmaster Tools. I have absolutely no clue why... The Google Analytics code is still working, the verification meta tag is in place, both are not working. I get an error message about Google not being able to connect to the server. I asked about any possible changes to server settings or stuff about that, but apparently nothing has changed there. The URL in question is Bivolino.com Does someone has any other ideas what I could be looking for. Thanks, Kind regards, Erik
Technical SEO | | buiserik0 -
Www2 vs www problem
Hi, I have a website that has an old version and a new version. The content is not duplicate on the different versions.
Technical SEO | | TihomirPetrov
The point is that the old version uses www. and non-www before the domain and the new one uses www2. My questions is: Is that a problem and what should be done? Thank you in advance!0 -
How to stop my webmail pages not to be indexed on Google ??
when i did a search in google for Site:mywebsite.com , for a list of pages indexed. Surprisingly the following come up " Webmail - Login " Although this is associated with the domain , this is a completely different server , this the rackspace email server browser interface I am sure that there is nothing on the website that links or points to this.
Technical SEO | | UIPL
So why is Google indexing it ? & how do I get it out of there. I tried in webmaster tool but I could not , as it seems like a sub-domain. Any ideas ? Thanks Naresh Sadasivan0 -
CDN Being Crawled and Indexed by Google
I'm doing a SEO site audit, and I've discovered that the site uses a Content Delivery Network (CDN) that's being crawled and indexed by Google. There are two sub-domains from the CDN that are being crawled and indexed. A small number of organic search visitors have come through these two sub domains. So the CDN based content is out-ranking the root domain, in a small number of cases. It's a huge duplicate content issue (tens of thousands of URLs being crawled) - what's the best way to prevent the crawling and indexing of a CDN like this? Exclude via robots.txt? Additionally, the use of relative canonical tags (instead of absolute) appear to be contributing to this problem as well. As I understand it, these canonical tags are telling the SEs that each sub domain is the "home" of the content/URL. Thanks! Scott
Technical SEO | | Scott-Thomas0 -
Page not being indexed
Hi all, On our site we have a lot of bookmaker reviews, and we are ranking pretty good for most bookmaker names as keywords, however a single bookmaker seems to have been shunned by Google. For a search "betsafe" in Denmark, this page does not appear among the top 50: http://www.betxpert.com/bookmakere/betsafe All of our other review pages rank in top 10-20 for the bookmaker name as keyword. What to do if Google has "banned" a page? Best regards, Rasmus
Technical SEO | | rasmusbang0 -
Is this 404 page indexed?
I have a URL that when searched for shows up in the Google index as the first result but does not have any title or description attached to it. When you click on the link it goes to a 404 page. Is it simply that Google is removing it from the index and is in some sort of transitional phase or could there be another reason.
Technical SEO | | bfinternet0