Getting Recrawled by Google
-
I have been updating my site a lot and some of the updates are showing up in Google and some are not. Is there a best practice in getting your site fully recrawled by Google?
-
If your site does not get crawl completely, i will recommend
a) To create a site-map, so that search engines can understand the site hierarchy and can deep crawl the site
b) Look at your site structure, Make your site more organized so as to have better crawl. It should not happen that a user needs to visit - home page > category page > sub category page > article or below to read the article. At best, article snippet should come on home page for a day. If not, should be accessible from home page > category page > article
c) Submit the article posted to Social Media - Reddit, Pinterest, Twitter etc. It will help search engines discover your link faster
By sure - will improve the crawl mechanism to your site
-
PS
#1
http://www.distilled.net/blog/seo/beginners-guide-doing-a-site-audit-using-google-webmaster-tools/
http://www.google.com/submityourcontent/
https://support.google.com/webmasters/answer/1352276?hl=en
Same rules for Google https://seomoz.zendesk.com/entries/409821-Why-Isn-t-My-Site-Being-Crawled-You-re-Not-Crawling-All-My-Pages
-
Heres more
Kristina Kledzik from distilled wrights about this a lot
http://www.distilled.net/about/people/kristina-kledzik/
http://www.zemanta.com/blog/technical-seo-audit-for-publishers/
http://www.distilled.net/blog/seo/site-navigation-for-seo/
http://yoast.com/how-to-get-google-to-crawl-your-site-faster/
http://www.stateofsearch.com/a-guide-to-crawling-indexing-and-ranking-your-websit/
http://www.distilled.net/blog/seo/how-to-do-a-5-step-site-audit/
http://www.seerinteractive.com/blog/easy-ways-seo-can-kill-your-site
Use Screaming Frog SEO Spider Use this with http://www.seerinteractive.com/blog/screaming-frog-guide
http://www.portent.com/blog/seo/three-seo-deal-killers.htm
Other good to know
http://www.distilled.net/blog/seo/beginners-guide-doing-a-site-audit-using-google-webmaster-tools/
http://www.portent.com/blog/seo/5-seo-strategies-we-swear-arent-going-anywhere.htm
http://www.mnsearch.org/john-doherty-from-distilled-teaches-mnsearch-about-technical-seo/
Hope this help's,
Thomas
-
Hi,
Yes here is a link to some good info & tips
http://www.distilled.net/blog/seo/advanced-seo-troubleshooting-why-isnt-this-page-indexed/
Absolutely. Make sure you have a fast hosting company hosting your website.
Make sure there's no flash, Ajax, or JavaScript obscuring your site from Google bot
Make sure your robots.txt file is not no following or no indexing any thing that you want to be found by Google
Same goes for your tags
- noindex X-Robots-Tag in HTTP header (X-Robots-Tag: noindex)
- Incorrect mime type declared in HTTP header. For example, for an HTML document, if it was declared as Content-Type: text/javascript
You can use Google Webmaster tools and the selection fetches Google bot and submit all URLs to index if you want to make sure it is being indexed in Google knows that you want the site indexed.
I hope I've been out sincerely,
Thomas
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Canonical error from Google
Moz couldn't explain this properly and I don't understand how to fix it. Google emailed this morning saying "Alternate page with proper canonical tag." Moz also kinda complains about the main URL and the main URL/index.html being duplicate. Of course they are. The main URL doesn't work without the index.html page. What am I missing? How can I fix this to eliminate this duplicate problem which to me isn't a problem?
Technical SEO | | RVForce0 -
Google Dancing?
Hello, I was wondering why my website for some keywords goes from 2nd 3rd page in Google to 7th or even more sometimes? This happens since a while. Any suggestion? Thanks. Eugenio
Technical SEO | | socialengaged0 -
Google Rejects Merchant Feed
Buon Giorno fromn 1 degrees C nearly dark & icy wetherby Uk... WTF Googles merchant centre has rejected my feed and In the time honoured zero customer service Ive grown accustomed to getting from Santa Clara County ive got bugger all idea how to fix it. Here is the feed:
Technical SEO | | Nightwing
http://ramsdensforcash.co.uk/sitefiles/handlers/googlemerchantdatafeed.ashx And here is the violation from the Google Gods themselves: http://ramsdensforcash.co.uk/sitefiles/handlers/googlemerchantdatafeed.ashx Anyone got any ideas why Google has given me the middle finger? Greazie tanto,
David0 -
I am getting an error message from Google Webmaster Tools and I don't know what to do to correct the problem
The message is:
Technical SEO | | whitegyr
"Dear site owner or webmaster of http://www.whitegyr.com/, We've detected that some of your site's pages may be using techniques that are outside Google's Webmaster Guidelines. If you have any questions about how to resolve this issue, please see our Webmaster Help Forum for support. Sincerely, Google Search Quality Team" I have always tried to follow Google's guidelines and don't know what I am doing wrong, I have eight different websites all getting this warning and I don't know what is wrong, is there anyone you know that will look at my sites and advise me what I need to do to correct the problem? Website with this warning:
artistalaska.com
cosmeticshandbook.com
homewindpower.ws
montanalandsale.com
outdoorpizzaoven.net
shoes-place.com
silverstatepost.com
www.whitegyr.com0 -
Google indexing tags help
Hey everyone, So yesterday someone pointed out to me that Google is indexing tags and that will likely hurt search engine results. I just did a "site:thetechblock.com" and I notice that tags are still being pulled. http://d.pr/i/WmE6 Today, I went into my Yoast settings and checked "noindex,follow" tags in the Taxomomies settings. I just want to make sure what I'm doing is right. http://d.pr/i/zmbd Thanks guys
Technical SEO | | ttb0 -
Google Sitelinks
We have an e-commerce site that has about 50k pageviews of our main shop page every week. However in our Google sitelinks we have one for 'Shop'. However, for the Shop sitelink Google is linking to a random URL that we have never & would never use as a URL and not to our Shop page. I can't work out why Google would pick up this random url as we have so many links etc to the main shop page. Why are they not linking to the right page? I have blocked that url in webmaster tools and done a redirect but I want to understand why it happened in the first place. It included 'swedish+fish' so it seems weirdly spammy?! Any thoughts would be really helpful (and I am only mildly techy). Many thanks
Technical SEO | | ahamill0 -
Look of google results
Can anyone tell me why some google results show the main page and then a listing of all subsequent pages (i.e. results for SEOMOZ) while others just show the main page with nothing under it. I have two different sites (one personal the other biz) and they both show their search results differently. Is it something in the site creation or how it is crawled by google? Thanks. bKs3C
Technical SEO | | STF0 -
Where to get expert SEO help?
I joined SEOmoz knowing very little about SEO (it turns out even less than I thought!) I signed up because my business website that had be ranking very well for years made a fast and furious fall to the purgatory of page 2, 3, whatever. We'll I've definitely learned a lot and made a several changes that have helped. Specifically link building (directory submissions) and eliminating duplicate content. But we're still far below where we used to be and I've done everything I can do without making a career change to SEO. I've hired a few offshore SEOs to help but they have all failed to live up to their promises. So, I would love to find a GOOD SEO that can 1. Fix the remaining on-page technical issues in our CMS website (Business Catalyst), and 2. help us develop an SEO strategy for the next year. (I prefer not to post the name of the website for competitive reasons) Our keywords are really not very competitive at all due to the uniqueness of the business. Where should I look for help? Thanks
Technical SEO | | Placeboo0