Getting Recrawled by Google
-
I have been updating my site a lot and some of the updates are showing up in Google and some are not. Is there a best practice in getting your site fully recrawled by Google?
-
If your site does not get crawl completely, i will recommend
a) To create a site-map, so that search engines can understand the site hierarchy and can deep crawl the site
b) Look at your site structure, Make your site more organized so as to have better crawl. It should not happen that a user needs to visit - home page > category page > sub category page > article or below to read the article. At best, article snippet should come on home page for a day. If not, should be accessible from home page > category page > article
c) Submit the article posted to Social Media - Reddit, Pinterest, Twitter etc. It will help search engines discover your link faster
By sure - will improve the crawl mechanism to your site
-
PS
#1
http://www.distilled.net/blog/seo/beginners-guide-doing-a-site-audit-using-google-webmaster-tools/
http://www.google.com/submityourcontent/
https://support.google.com/webmasters/answer/1352276?hl=en
Same rules for Google https://seomoz.zendesk.com/entries/409821-Why-Isn-t-My-Site-Being-Crawled-You-re-Not-Crawling-All-My-Pages
-
Heres more
Kristina Kledzik from distilled wrights about this a lot
http://www.distilled.net/about/people/kristina-kledzik/
http://www.zemanta.com/blog/technical-seo-audit-for-publishers/
http://www.distilled.net/blog/seo/site-navigation-for-seo/
http://yoast.com/how-to-get-google-to-crawl-your-site-faster/
http://www.stateofsearch.com/a-guide-to-crawling-indexing-and-ranking-your-websit/
http://www.distilled.net/blog/seo/how-to-do-a-5-step-site-audit/
http://www.seerinteractive.com/blog/easy-ways-seo-can-kill-your-site
Use Screaming Frog SEO Spider Use this with http://www.seerinteractive.com/blog/screaming-frog-guide
http://www.portent.com/blog/seo/three-seo-deal-killers.htm
Other good to know
http://www.distilled.net/blog/seo/beginners-guide-doing-a-site-audit-using-google-webmaster-tools/
http://www.portent.com/blog/seo/5-seo-strategies-we-swear-arent-going-anywhere.htm
http://www.mnsearch.org/john-doherty-from-distilled-teaches-mnsearch-about-technical-seo/
Hope this help's,
Thomas
-
Hi,
Yes here is a link to some good info & tips
http://www.distilled.net/blog/seo/advanced-seo-troubleshooting-why-isnt-this-page-indexed/
Absolutely. Make sure you have a fast hosting company hosting your website.
Make sure there's no flash, Ajax, or JavaScript obscuring your site from Google bot
Make sure your robots.txt file is not no following or no indexing any thing that you want to be found by Google
Same goes for your tags
- noindex X-Robots-Tag in HTTP header (X-Robots-Tag: noindex)
- Incorrect mime type declared in HTTP header. For example, for an HTML document, if it was declared as Content-Type: text/javascript
You can use Google Webmaster tools and the selection fetches Google bot and submit all URLs to index if you want to make sure it is being indexed in Google knows that you want the site indexed.
I hope I've been out sincerely,
Thomas
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
When will all of Google Maps be the same again?
As many of you are aware that the pigeon update was only applied to the new Google maps resulting in very different search results for Google local business. When you search for a business on old Google maps then you get totally different results vs the new Google maps. Some businesses totally disappeared completely from the search results. I have done my research and found out that it's because the new Algo was only applied to the new maps. Also new algo does not apply to other countries. Well the reason I posted this topic is because I have noticed that all the new Google Business listings I am verifying for my clients are all being put under the old Google maps and not the new ones. They come up fine when searching from old maps but not the new ones. I understand Google has not rolled out the pigeon on all data centers but why? Will Google eventually roll out the update to old maps? Since Google is adding businesses to old google maps then what's the point of even adding new listings?
Technical SEO | | bajaseo0 -
Image Indexing Issue by Google
Hello All,My URL is: www.thesalebox.comI have Submitted my image Sitemap in google webmaster tool on 10th Oct 2013,Still google could not indexing any of my web images,Please refer my sitemap - www.thesalebox.com/AppliancesHomeEntertainment.xml and www.thesalebox.com/Hardware.xmland my webmaster status and image indexing status are below,
Technical SEO | | CommercePunditCan you please help me, why my images are not indexing in google yet? is there any issue? please give me suggestions?Thanks!
0 -
Google no longer is promoting my website!
My traffic just fell off the cliff and I can not figure out what has happened! Help!
Technical SEO | | PatriciaBeth0 -
Which factors are effect on Google index?
Mywebsite have 455 URL submitedbut only 77 URLs are indexed. How can i improve more indexed URL?
Technical SEO | | magician0 -
Trying to get on Google page one for keyword "criminal defense attorney san diego". What can I do?
I'm trying to help a friend who is an attorney get on page one for the keyword "criminal defense attorney san diego." So far I've changed his title and description tags since they weren't optimized before. (SERP shows old title tag, however I submitted a XML sitemap through Webmaster tools to get the new title tags updated.) He also had a few duplicate pages, but I took care of that with some 301 redirects. I also added a h1 tag, alt image tag, and more content. I also spent a few hours building links for him. He currently has a page authority of 52 and domain authority of 44 with a decent amount of links pointing to his site. I'm wondering why he's stuck on page 4, when his competitors that have less impressive numbers seem to show up on page 1. I did look at his link profile using OSE and I'm worried that his old SEO guy got him spam links. His website is www.nasserilegal.com, however the page I was focusing on was www.nasserilegal.com/criminal.html Any advice would be great.
Technical SEO | | micasalucasa0 -
How do I get rid of duplicate content
I have a site that is new but I managed to get it to page one. Now when I scan it on SEO Moz I see that I have duplicate content. Ex: www.mysite.com, www.mysite.com/index and www.mysite.com/ How do I fix this without jeopardizing my SERPS ranking? Any tips?
Technical SEO | | bronxpad0 -
Odd Google Indexing Issue
I have encountered something odd with Google indexing. According to the Google cache my site was last updated on April 6. I had been making a series of changes on April 7th and none of them show up in the cached version of the site (naturally). Then, on the 8th, my rankings seem to have dropped about 6 places and the main SERP is showing a text that isn't even on the Web site. The cached version has the correct page title from the page that was indexed on the 6th. How do I learn where Google is picking this up from? There is a clean page title tag on my Web site. I've checked the server, etc to see what's going on. The text isn't completely unrelated, but it definitely impacted my ranking. Does Google ever have these hiccups when indexing?
Technical SEO | | VERBInteractive0