Indexing issue or just time?
-
Hey guys,
When I publish a post on our blog, I notice that it barely shows up in SERPs even if I copy and paste the title verbatim into Google. All my settings in Yoast are correct from what I've seen.
Is this just Google slowly getting around to crawling our site? Or is something else wrong here? We recently shut down and relaunched our site about 3 weeks ago.
Here is the site URL: The Tech Block
-
Yep, I also spotted them. And are all the canonical tags point to the right pages?
If all is in place and is configured correctly, it should be a matter of time yes. I would however try to speed up the process by doing some linkbuilding, for instance using social media.
-
Actually Steven. I just looked at my source code and I see the canonicals.
We also have sitemaps too that are being indexed by Google and I can track that in Webmaster. I guess it's just a matter of time?
-
I would recommend reading the Google Help section on this. It's quite complete: http://support.google.com/webmasters/bin/answer.py?hl=en&hlrm=nl&answer=139394.
-
Steven,
Thanks for your help. What is the proper way to set up canonicals?
-
Yes, even with new posts. How are the search engines supposed to find it?
If you don't have the measures I stated in place it will take them longer to find and index the content. The way it's now you want the search engines to find the content (new and old). When having the sitemaps and proper canonicals you're handing it to them.
Good luck!
-
Even with new posts? I can understand old post taking a while to crawl, but new posts too? If I write something, and post it, I'll check hours later and Google hasn't indexed it. Is this normal?
-
Hi Abdel,
As CleverPhD already pointed out: shutting down and relaunched (with a changed information architecture) can search engines to take a while until they're up to speed with indexing your website again. It will take some time, and quite some content and links to speed up that process. In the meantime you can of course help the search engines by:
- Having a HTML sitemap
- Having a XML sitemap (be sure to link the XML sitemap in the HTML sitemap, add the XML sitemap to the robots.txt and submit the XML sitemap and RSS feed in Google Webmaster Tools)
- Having proper canonical tagging and 301-redirects (if possible)
It's important to get crawled, but it also important to let the search engines crawl the right pages. Why are you linking to those tag pages in the bottom right of your website? Perhaps it's better to create category pages for that (better URL structure).
Good luck and keep us posted!
-
If you shut down and relaunched your site 3 weeks ago and lets say you also changed your URL structure and title tags and if you also do not have 301 redirects for old to new content and you don't have a sitemap.
All those things, even if you did them all "correctly" can cause Google to take a while to respider an reindex your pages. Google ranks "pages" vs "sites" generally speaking and so that can impact rankings.
Looks like you canonical all the pages to themselves? Example
<link rel="<a class="attribute-value">canonical</a>" href="[http://thetechblock.com/the-ios-interface-concept](view-source:http://thetechblock.com/the-ios-interface-concept)" />
Were you www.thetechblock.com before and now you are trying to change to the non www? If you did change to non www then Google would see this as a new site and so the rankings would start over
If you want to look at crawl rate, you should be able to go into Google Webmaster Tools and see how often they are spidering. Similarly, you can submit a sitemap and see how many are indexed
I
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Website Indexing Issues - Search Bots will only crawl Homepage of Website, Help!
Hello Moz World, I am stuck on a problem, and wanted to get some insight. When I attempt to use Screaming Spider or SEO Powersuite, the software is only crawling the homepage of my website. I have 17 pages associated with the main domain i.e. example.com/home, example.com/sevices, etc. I've done a bit of investigating, and I have found that my client's website does not have Robot.txt file or a site map. However, under Google Search Console, all of my client's website pages have been indexed. My questions, Why is my software not crawling all of the pages associated with the website? If I integrate a Robot.txt file & sitemap will that resolve the issue? Thanks ahead of time for all of the great responses. B/R Will H.
Intermediate & Advanced SEO | | MarketingChimp100 -
HTTPS pages - To meta no-index or not to meta no-index?
I am working on a client's site at the moment and I noticed that both HTTP and HTTPS versions of certain pages are indexed by Google and both show in the SERPS when you search for the content of these pages. I just wanted to get various opinions on whether HTTPS pages should have a meta no-index tag through an htaccess rule or whether they should be left as is.
Intermediate & Advanced SEO | | Jamie.Stevens0 -
Crawl Issue for Deleted Pages
Hi, sometimes, I just delete a page and not necessarily want to make a 404 to another page. So Google Webmaster Tools shows me 108 'not found' pages under 'Crawling Errors'. Is that a problem for my site?
Intermediate & Advanced SEO | | soralsokal
Can I ignore this with good conscience?
Shall I make 404 to my homepage? I am confused and would like to hear your opinion on this. Best, Robin0 -
Google Indexed my Site then De-indexed a Week After
Hi there, I'm working on getting a large e-commerce website indexed and I am having a lot of trouble.
Intermediate & Advanced SEO | | Travis-W
The site is www.consumerbase.com. We have about 130,000 pages and only 25,000 are getting indexed. I use multiple sitemaps so I can tell which product pages are indexed, and we need our "Mailing List" pages the most - http://www.consumerbase.com/mailing-lists/cigar-smoking-enthusiasts-mailing-list.html I submitted a sitemap a few weeks ago of a particular type of product page and about 40k/43k of the pages were indexed - GREAT! A week ago Google de-indexed almost all of those new pages. Check out this image, it kind of boggles my mind and makes me sad. http://screencast.com/t/GivYGYRrOV While these pages were indexed, we immediately received a ton of traffic to them - making me think Google liked them. I think our breadcrumbs, site structure, and "customers who viewed this product also viewed" links would make the site extremely crawl-able. What gives?
Does it come down to our site not having enough Domain Authority?
My client really needs an answer about how we are going to get these pages indexed.0 -
Can Google index PDFs with flash?
Does anyone know if Google can index PDF with Flash embedded? I would assume that the regular flash recommendations are still valid, even when embedded in another document. I would assume there is a list of the filetype and version which Google can index with the search appliance, but was not able to find any. Does anyone have a link or a list?
Intermediate & Advanced SEO | | andreas.wpv0 -
Reducing Booking Engine Indexation
Hi Mozzers, I am working on a site with a very useful room booking engine. Helpful as it may be, all the variations (2 bedrooms, 3 bedrooms, room with a view, etc, etc,) are indexed by Google. Section 13 on Search Pagination in Dr. Pete's great post on Panda http://www.seomoz.org/blog/duplicate-content-in-a-post-panda-world speaks to our issue, but I was wondering since 2 (!) years have gone by, if there are any additional solutions y'all might recommend. We want to cut down on the duplicate titles and content and get the useful but not useful for SERPs online booking pages out of the index. Any thoughts? Thanks for your help.
Intermediate & Advanced SEO | | Leverage_Marketing0 -
Adding Orphaned Pages to the Google Index
Hey folks, How do you think Google will treat adding 300K orphaned pages to a 4.5 million page site. The URLs would resolve but there would be no on site navigation to those pages, Google would only know about them through sitemap.xmls. These pages are super low competition. The plot thickens, what we are really after is to get 150k real pages back on the site, these pages do have crawlable paths on the site but in order to do that (for technical reasons) we need to push these other 300k orphaned pages live (it's an all or nothing deal) a) Do you think Google will have a problem with this or just decide to not index some or most these pages since they are orphaned. b) If these pages will just fall out of the index or not get included, and have no chance of ever accumulating PR anyway since they are not linked to, would it make sense to just noindex them? c) Should we not submit sitemap.xml files at all, and take our 150k and just ignore these 300k and hope Google ignores them as well since they are orhpaned? d) If Google is OK with this maybe we should submit the sitemap.xmls and keep an eye on the pages, maybe they will rank and bring us a bit of traffic, but we don't want to do that if it could be an issue with Google. Thanks for your opinions and if you have any hard evidence either way especially thanks for that info. 😉
Intermediate & Advanced SEO | | irvingw0 -
Indexing techniques
Hi, I just want a confirmation about my indexing technique, if is good or can be improved. The technique is totally whitehat and can be done by one person. Any suggestions or improvements are welcome. I create the backlinks ofcource first 🙂 I make a list on public doc from Google. On the doc are only ten links. After I digg it , and add some more bookmarks 5-6. I tweet the digg and each doc. (my 2 twitter accounts have page authority 98) I like them in Fb. I ping them thru ping serviecs. Thats it. Works ok for moment. Is anything what I can do to improve my technique? Thanks lot
Intermediate & Advanced SEO | | nyanainc0