Getting Recrawled by Google
-
I have been updating my site a lot and some of the updates are showing up in Google and some are not. Is there a best practice in getting your site fully recrawled by Google?
-
If your site does not get crawl completely, i will recommend
a) To create a site-map, so that search engines can understand the site hierarchy and can deep crawl the site
b) Look at your site structure, Make your site more organized so as to have better crawl. It should not happen that a user needs to visit - home page > category page > sub category page > article or below to read the article. At best, article snippet should come on home page for a day. If not, should be accessible from home page > category page > article
c) Submit the article posted to Social Media - Reddit, Pinterest, Twitter etc. It will help search engines discover your link faster
By sure - will improve the crawl mechanism to your site
-
PS
#1
http://www.distilled.net/blog/seo/beginners-guide-doing-a-site-audit-using-google-webmaster-tools/
http://www.google.com/submityourcontent/
https://support.google.com/webmasters/answer/1352276?hl=en
Same rules for Google https://seomoz.zendesk.com/entries/409821-Why-Isn-t-My-Site-Being-Crawled-You-re-Not-Crawling-All-My-Pages
-
Heres more
Kristina Kledzik from distilled wrights about this a lot
http://www.distilled.net/about/people/kristina-kledzik/
http://www.zemanta.com/blog/technical-seo-audit-for-publishers/
http://www.distilled.net/blog/seo/site-navigation-for-seo/
http://yoast.com/how-to-get-google-to-crawl-your-site-faster/
http://www.stateofsearch.com/a-guide-to-crawling-indexing-and-ranking-your-websit/
http://www.distilled.net/blog/seo/how-to-do-a-5-step-site-audit/
http://www.seerinteractive.com/blog/easy-ways-seo-can-kill-your-site
Use Screaming Frog SEO Spider Use this with http://www.seerinteractive.com/blog/screaming-frog-guide
http://www.portent.com/blog/seo/three-seo-deal-killers.htm
Other good to know
http://www.distilled.net/blog/seo/beginners-guide-doing-a-site-audit-using-google-webmaster-tools/
http://www.portent.com/blog/seo/5-seo-strategies-we-swear-arent-going-anywhere.htm
http://www.mnsearch.org/john-doherty-from-distilled-teaches-mnsearch-about-technical-seo/
Hope this help's,
Thomas
-
Hi,
Yes here is a link to some good info & tips
http://www.distilled.net/blog/seo/advanced-seo-troubleshooting-why-isnt-this-page-indexed/
Absolutely. Make sure you have a fast hosting company hosting your website.
Make sure there's no flash, Ajax, or JavaScript obscuring your site from Google bot
Make sure your robots.txt file is not no following or no indexing any thing that you want to be found by Google
Same goes for your tags
- noindex X-Robots-Tag in HTTP header (X-Robots-Tag: noindex)
- Incorrect mime type declared in HTTP header. For example, for an HTML document, if it was declared as Content-Type: text/javascript
You can use Google Webmaster tools and the selection fetches Google bot and submit all URLs to index if you want to make sure it is being indexed in Google knows that you want the site indexed.
I hope I've been out sincerely,
Thomas
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Canonical error from Google
Moz couldn't explain this properly and I don't understand how to fix it. Google emailed this morning saying "Alternate page with proper canonical tag." Moz also kinda complains about the main URL and the main URL/index.html being duplicate. Of course they are. The main URL doesn't work without the index.html page. What am I missing? How can I fix this to eliminate this duplicate problem which to me isn't a problem?
Technical SEO | | RVForce0 -
Pages are Indexed but not Cached by Google. Why?
Hello, We have magento 2 extensions website mageants.com since 1 years google every 15 days cached my all pages but suddenly last 15 days my websites pages not cached by google showing me 404 error so go search console check error but din't find any error so I have cached manually fetch and render but still most of pages have same 404 error example page : - https://www.mageants.com/free-gift-for-magento-2.html error :- http://webcache.googleusercontent.com/search?q=cache%3Ahttps%3A%2F%2Fwww.mageants.com%2Ffree-gift-for-magento-2.html&rlz=1C1CHBD_enIN803IN804&oq=cache%3Ahttps%3A%2F%2Fwww.mageants.com%2Ffree-gift-for-magento-2.html&aqs=chrome..69i57j69i58.1569j0j4&sourceid=chrome&ie=UTF-8 so have any one solutions for this issues
Technical SEO | | vikrantrathore0 -
Help with Getting Googlebot to See Google Charts
We received a message from Google saying we have an extremely high number of URLs that are linking to pages with similar or duplicate content. The main difference between these pages are the Google charts we use. It looks like Google isn't able to see these charts (most of the text are very similar) and the charts (lots of it) are the main differences between these pages. So my question is what is the best approach to allowing Google to see the data that exists in these charts? I read from here http://webmasters.stackexchange.com/questions/69818/how-can-i-get-google-to-index-content-that-is-written-into-the-page-with-javascr that a solution would be to have the text that is displayed on the charts coded into the html and hidden by CSS. I'm not sure but it seems like a bad idea to have it seen by Google but hidden to the user by CSS. It just sounds like a cloaking hack. Can someone clarify if this is even a solution or is there a better solution?
Technical SEO | | ERICompensationAnalytics1 -
Google webmaster showing 0 indexed, yet I can see them all them Google search?
I can see them all the pages showing up in Google when i search for my site. But in webmaster tools under the sitemaps section in the indexed pages - the red bar is showing 0 indexed pages, even though they seem to be indexed. Any idea why is this showing like this? I don’t really think it’s that important as the pages are still indexed, but it just seems odd. Please see in the image.
Technical SEO | | Perfect0070 -
Google Rewriting PDF Titles
Has anyone else noticed Google rewriting the title of PDF documents?
Technical SEO | | waynekolenchuk0 -
What else: struggling with google position
Hi. I understand everyone is offering their time for free here so any advice or support is much appreciated. http://www.cytronex.com
Technical SEO | | AdamJamesCytronex
PA 44 || mR 4.6 || mT 5.73 || 986 links from 43 Root Domains
DA 33 || 3,942 links from 71 Domains We've dropped from position 25ish to position 70ish in keyword searches for 'electric bikes'. I've tried everything and I just don't understand! It's genuine content, the actual product is increasingly popular, we have several links from sites which are (well, to my mind) reasonable quality. I've only just been brought in to look at this and my lack of any SEO or web experience is not putting my boss off expecting an instant solution 😞 As I'm only just getting to grips with it, Analytics was only installed about a month ago so I can't pin point a moment when it dropped. We're consistently out-positioned by sites with lower PA/DA scores. Any insight anyone might have would be amazing! Thanks
Adam0 -
Google Analtyics Changes?
Did anyone else's google analtyics numbers jump up this month? Our unique visitors increased some, but our pageviews tripled and our bounces dropped significantly. We have been working to optimize the sites and did have a huge drop in errors in our campaign reports.
Technical SEO | | Stevej240 -
Duplicate Homepage In Google
Hi Just found through my SEO dashboard, Google has two versions of the same homepage, the root page, plus the index.html page, causing duplicate content from both the pages. what is the best option to ensure google only have 1 version of the homepage listed?
Technical SEO | | rfksolutionsltd0