Problem with indexing
-
Hello, we've changed our CMS recently, everything seems to work well, but for some reason google, and other crawlers can't see or index other pages than main. There is no restriction in robots, nor any other visible issue. Please help if you can.
Website: http://www.design-glassware.com/
-
I just want to clarify what I was saying above. In my case, even though I put brand spanking new posts on my blog they weren't getting indexed. I had about 6 duplicate posts and 4 new ones and none of them were getting indexed. But, when I dealt with the duplicate content issues for those 6 (i.e got rid of the original copies and redirected the old site to the new) then all of my content suddenly got indexed. Just sayin'
-
Thank you. I'm sure it's not a duplicate content problem. For example even when I try to put new URL as destination in Ad words, and it didn't took as working.
I think it's more of a technical issue, not SEO, probably was a wrong question here.
Thank you again everyone for helping me out.
-
In my case above, I had new pages as well that weren't being indexed, but they did get indexed once I dealt with the duplicate content. Perhaps Google put some sort of block on my whole blog because of the duplicates? If your information is duplicated anywhere you need to check this.
Also, do you have webmaster tools set up? This will tell you a lot about what is happening with your domain. Have you submitted a sitemap? This will help as well.
It may also help to build a few external links to some of the new pages. This will help Google find them.
-
You may have to resubmit your site through webmaster tools AFTER fixing the forementioned issues.
-
good catch bootleg. I think if you get the dupe content and 301's working correctly google will love you a little more.
-
Yes, I've tried Xenu (right after you asked me), it shows broken links.
-
There are some new pages we've made, and still no indexing. Google visited our page quite often, and it's been almost 1 month since we've changed the URLs.
-
Thank you for the heads up. We know about the duplicate content problem, just our webmaster is somewhat slow.
The URLs are new, and we will do 301 redirect and "canonical".
-
How long has it been since you've had the new CMS? It can sometimes take weeks to get a site crawled and indexed.
I'll share with you something that happened to me recently that may be applicable. I recently started a new site and wrote a few blog posts. Then I changed my mind and decided that those posts would be better suited to another site I had. So, I added them to another site I had. But, they wouldn't index! I realized that I hadn't deleted the content off of my first site. So, when Google came across the new blog I'm assuming they saw all the content as duplicate and didn't index it. I immediately took the content off of the original domain and I 301'd the original domain to the new one and within hours all of my posts were indexed.
-
There's nothing wrong with the links and with your robots.txt. But ...
You obviously have a huge duplicate content problem. Just look at the search result the site: query returns. There are a lot of old links (from the old CMS I suppose). Click through the links and you'll always get to the main page, but the URL remains the same. I.e. no redirect to the correct page with the new URL or to the Homepage.
You should have a look at your old URLs and redirect them with a HTTP 301 redirect to the new URL.
As a quick fix add a rel="canonical" tag to your new pages. This way google will index the correct page (and only the correct page) on its next crawl. Setting up the redirects should have happened prior to switching the CMS ...
-
Have you tried crawling it with Xenu?
-
are you using the exact same URL's with the new CMS as the old cms? if not have you done 301's?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Page Indexing without content
Hello. I have a problem of page indexing without content. I have website in 3 different languages and 2 of the pages are indexing just fine, but one language page (the most important one) is indexing without content. When searching using site: page comes up, but when searching unique keywords for which I should rank 100% nothing comes up. This page was indexing just fine and the problem arose couple of days ago after google update finished. Looking further, the problem is language related and every page in the given language that is newly indexed has this problem, while pages that were last crawled around one week ago are just fine. Has anyone ran into this type of problem?
Technical SEO | | AtuliSulava1 -
Should search pages be indexed?
Hey guys, I've always believed that search pages should be no-indexed but now I'm wondering if there is an argument to index them? Appreciate any thoughts!
Technical SEO | | RebekahVP0 -
Redirect indexed lightbox URLs?
Hello all, So I'm doing some technical SEO work on a client website and wanted to crowdsource some thoughts and suggestions. Without giving away the website name, here is the situation: The website has a dedicated /resources/ page. The bulk of the Resources are industry definitions, all encapsulated in colored boxes. When you click on the box, the definition opens in a lightbox with its own unique URL (Ex: /resources/?resource=augmented-reality). The information for these colored lightbox definitions is pulled from a normal resources page (Ex: /resources/augmented-reality/). Both of these URLs are indexed, leading to a lot of duplicate indexed content. How would you approach this? **Things to Consider: ** -Website is built on Wordpress with a custom theme.
Technical SEO | | Alces
-I have no idea how to even find settings for the lightbox (will be asking the client today).
-Right now my thought is to simply disallow the lightbox URL in robots.txt and hope Google will stop crawling and eventually drop from the index.
-I've considered adding the main resource page canonical to the lightbox URL, but it appears to be dynamically created and thus there is no place to access (outside of the FTP, I imagine?). I'm most rusty with stuff like this, so figured I'd appeal to the masses for some assistance. Thanks! -Brad0 -
Why would Google not index all submitted pages?
On Google Search console we see that many of our submitted pages weren't indexed. What could be the reasons? | Web pages |
Technical SEO | | Leagoldberger
| 130,030 Submitted |
| 87,462 Indexed |0 -
Homepage De-Indexed - No Errors, No Warnings
Hi, I am currently working on this project. Sometime between March 7th & 8th homepage was de-indexed. The rest of the pages are there. Found it out through decreased traffic on GA. No notifications of any kind of penalty/errors recieved. Tried to manually re-index through "Fetch as Google" in WMT to no avail. Site is redirected to https. Any suggestions would be highly appreciated. Thank you in advance.
Technical SEO | | gpapatheodorou0 -
Should We Index These Category Pages?
Currently we have marked category pages like http://www.yournextshoes.com/celebrities/kim-kardashian/ as follow/noindex as they essentially do not include any original content. On the other hand, for someone searching for Kim Kardashian shoes, it's a highly relevant page as we provide links to all the Kim Kardashian shoe sightings that we have covered. Should we index the category pages or leave them unindexed?
Technical SEO | | Jantaro0 -
Clone TLD Problems
I have an online services website www.geekwik.com which I started 3 months back. I also recently made a clone in TLD geekwik.in which has the same content, only pricing is in INR and is targeted at India users, while geekwik.com is targetted at global users with pricing in USD. How do I manage these 2 sites so that I do not face duplicate content penalty from google and the sites do not cannibalize on each other. Is there anything specific I need to do in robots.txt or .htaccess or sitemaps or hrelang etc? I personally feel that after putting up geekwik.in couple of weeks ago, the ranking of geekwik.com went down and I started getting lesser search queries. I would be putting up an IP based switch on both sites shortly so that Indian users are redirected to .in TLD and non-Indians are redirected to .com TLD. From SEO standpoint what are the things I need to do to counter these problems mentioned above. Putting India version in a subdirectory is also an option.
Technical SEO | | geekwik0 -
Mobile Google Not Indexing Mobile Website
Google currently does not index our mobile website. It has the WWW website in it's index. When a user from a mobile phone clicks on a mobile search result for WWW we redirect them to our mobile website. This is posing problems for us as our mobile website is a fraction of the # of pages/sections as our WWW. So for example, mobile search results show that we have a "careers" section; but that's not the case for the mobile website. As a result a user gets a 404. How do we force mobile Google to index our mobile website instead of our WWW?
Technical SEO | | RBA0