Please help us undertsand the things we need to improve so that google crawler visit us more often to reindex pages from our domain
-
we are currently in the process of a massive project which involves us migrating our domain, we realised that Google crawlwer has not been crawling our pages Quiet often. i have observed some cases where google crawled these pages about 6 months back and then never visited the pages again
and we had to manually submit these pages for reindexing in some geographies. can you please help us undertsand the things we need to improve so that google crawler visit us more often to reindex pages from our domain -
Hi Bhaskaran,
Someone with more knowledge than me may be around soon to give you a more in depth answer, but this should get you going.
Google has a limited amount of resources to crawl each webpage, so to be efficient it schedules pages to be crawled based on a few different things. The one i suspect is affecting your crawl times is how often your content is updated. If google does not believe that your site will be updated frequently it sees no reason to crawl it that often.
If you want google to crawl more often you need to give it a reason to do so, that means ensure your site is easily crawled by bots, good internal linking and make sure your content is fresh and up to date.
On a side note, as you are carrying out a domain migration it might be easier to redirect the pages to the new page on the new domain (301 redirect) and ensure your new domain has the points i raised above.
I hope this helps?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does Google understand misspellings in terms of what keywords I should optimize a page for
Hey there! This is sort of an oddball question. We do a lot of hospital websites. One client that we have spells "Orthopedics" as "Orthopaedics" which is another spelling. When I did initial keyword research the volume for Orthopedics as I expected is much higher. However when I do a test search for "Orthopaedics" it looks like I'm getting the same results and Google is highlighting in the content "orthopaedics" even though my search query was "orthopedics". What I'm wondering - is it the same thing to optimize for "orthopaedics" or is it a recommendation I should make to the client to change to "orthopedics" Thanks!
Intermediate & Advanced SEO | | CentreTEK0 -
New Domain VS New Page Backlink?
Assuming you've already got a link from:
Intermediate & Advanced SEO | | Sam.at.Moz
sitea.com/page1 (Moz domain rank 55, Moz page rank 30) You have two choices for another link: 1. Another link on the same domain but a new page:
sitea.com/page2 (Moz domain rank 55, Moz page rank 30) 2. A link on a new domain but with a lesser domain & page rank
siteb.com/page1 (Moz domain rank 30, Moz page rank 20) Assuming you have no other links to your site - both sites are relevant to your industry, both 5 years old, both have the same number of visitors/external links/ads and the content and anchor text remains the same. Which will have a bigger impact on SERP movements? Sam0 -
Google indexed wrong pages of my website.
When I google site:www.ayurjeewan.com, after 8 pages, google shows Slider and shop pages. Which I don't want to be indexed. How can I get rid of these pages?
Intermediate & Advanced SEO | | bondhoward0 -
Google + pages and SEO results...
Hi, Can anyone give me insight into how people are getting away with naming their business by the SEO search term, creating a BS Google + page, then having that page rank high in the search results. I am speaking specifically about the results you get when you Google: "Los Angeles DUI Lawyer". As you can see from my attached screenshot (I'm doing the search in Los Angeles), the FIRST listing is a Google + business. Strangely, the phone number listed doesn't actually take you to a DUI attorney, but rather to some marketing group that never answers the phone. Can anyone give me insight into why Google even allows this? I just find it odd that Google cares so much about the user experience, but have the first result be something completely misleading. I know it sounds like I'm just jealous (which I am, a little), but I find it disheartening that we work so hard on SEO, and someone takes the top spot with an obvious BS page. UupqBU9
Intermediate & Advanced SEO | | mrodriguez14400 -
Why, oh why does Google hate us?
My URL is:
Intermediate & Advanced SEO | | candylotus
www.drupalgeeks.org I have tried my very best to cover all the usual SEO items.... But nothing... We are a legitimate company offering a legitimate service. Ideally we would come up in the results for: "Drupal Developers"
"Drupal Development" and
"Drupal Designers" Yet, we cannot break the top 50 for any of these.... We have:
Optimized Meta Tags
Written Quality Content
Maintained a Social Presence in Twitter, LinkedIn, Facebook, Pinterest, Youtube, and Google Plus
Blogged with some consistency
Guest Blogged
Canonicalization
And dozens of other things And we are all around nice people and a good company....... Why oh why? Can anyone take a look and see if there is something blatantly obvious I am missing? Are we using "drupal" too much?? Thank you in advanced for any assistance. Candice1 -
Review of on page SEO - Please help
Hi I am new to SEOmoz but can see a lot of great information going back and forth. I am looking for a little help with the SEO on our site and looking for suggestions on what to do to improve it. We have some pages where we aggregate content from our database such as this: http://www.touristlink.com/india/nagpur/cat/temples.html It would seem that "Temples in Nagpur" is not that competitive of a term but we dont show up until page 4. Any on page suggestions on what we could do to improve? Or any mistakes we are making. All the content on the site is fairly new as in 6 months even though the site has been established and online for a number of years. We have not done any specific linking building for the term "Temples in Nagpur" Any suggestions on the overall structure of the site would also be great. Thanks in advance.
Intermediate & Advanced SEO | | DavidUrmann0 -
Domain advice needed, please
Could i get a little domain advice please. Launching a new website project and want to put it on a domain we already own (both domains are in the same niche as the larger project). The new project will be aimed at the UK market. The choice is: .co.uk we own with a good name, however it's Domain Authority rank is 7 and it's only about 8 months old. .com domain which is 6 years old, has a Domain Authority rank of 33 but is not as good a domain name. The Competitive Link Analysis tells me that the rivals for the keywords we would be targeting are between 24 and 42. Which domain would people go with? All things equal it would be a fair guess that the older, higher Domain Authority ranked .com will require less work to rank in the engines, however it's not as good brand wise. Thanks Carl
Intermediate & Advanced SEO | | Grumpy_Carl0 -
Google replacing subpages in index with home page?
Hi! I run a backlink building company. Recently, we had a customer who had us build targeted backlinks to certain subpages on his site. Then something really bizarre happened...all of a sudden, their subpages that were indexed in Google (the ones we were building links to) disappeared from the index, to be replaced with their home page. They haven't lost their rank, per se--it's just now their home page instead of their subpages. At this point, we are tracking literally thousands of keywords for our link building customers, and we've never run into this issue before. Have you ever run into it? If so, what's the best way to handle it from an SEO company perspective? They have a sitemap.xml and their GWT account reports no crawl errors, so it doesn't seem to be a site issue.
Intermediate & Advanced SEO | | ownlocal0