The "Fetch As Google" limit has been decreased - what now?
-
Since Google decreased the "Fetch As Google" limit to ten pages per day, we've been a bit stuck. We're publishing 20-30 content pages per day, targeting a huge range of search queries. Circa 40% of our traffic comes to us through these pages.
Since we're now heavily restricted on submitting these to Google, who's got other ideas to get the pages picked up quickly? I'm slightly concerned because although the pages link outwards to other areas of the website, no other areas of the site link to these pages. They're purely top-of-the-funnel.
We can't be the only people with this concern. How would you address it?
-
Thank you. Will have a go at Google News - not sure we fit the criteria but can't hurt to try, eh??
-
Thank you very much. That's really helpful and I appreciate you putting so much time into your answer.
-
You maybe right about Google+, but that said, in the google news guidelines, they do suggest that they may use google+ to 'better surface content'.
"Add or edit your Google+ Page URL. We may use publicly available information from your Google+ page to deliver a better news experience and to better surface your content. "
https://support.google.com/news/publisher/answer/4581428?hl=en-GB
-
Hi MSG
You should not have to fetch as Google to get your pages indexed and please with deference to Paul, above, posting on Google+ will not speed up indexing. If it did then people would be all over it and they are not. You also can only apply to Google news if you have a newsworthy site and I can tell you right now that 90+% of sites are rejected because what they post is not news.
The fact that a page is posted puts it in the sitemap which is picked up by Google. Also depending on the size of your site some of it is crawled by Google every day. Just go to Google Seach Console Crawl Stats to see that.
I have seen pages indexed in under a minute (none news sites - yes seriously) and others take a week. What is of major concern is how you say that these pages are not linked from anywhere because there lies a large part of your problem. You need a proper site structure so that link juice passes from the main menu down through all the pages of your website. The more 'shallow' this is, the better as the pages are closer to the top.
If you are burying pages deep in your website with no logical route to them then they are just not going to rank quickly.
Read more on site architecture here: https://moz.com/blog/site-architecture-for-seo It's old but still very relevant.
You need a solid site structure which starts with the main menu with proper departments, categories and if necessary, sub-categories.
Sort that out and you will see your pages indexed much quicker.
If you can get do-follow backlinks then this will help, but certainly not from Facebook and G+ as they are all nofollow.
Regards
Nigel
-
Although I think it depends a little on how 'important' it thinks your site is, I think google crawls sites with regularly updated content very frequently, so I'd suspect that as long as you're linking to this content from somewhere prominent on your site, you shouldn't have an issue.
You could also use a sitemap to tell google about fresh content, perhaps also consider applying to google news if you can, and then use a news sitemap which google will certainly be very quick to check and spider new urls from. In the advice for google news, they also suggest posting content to google+, so I'd also use that to post new content to, as it's another method of telling google you have something fresh for them to spider.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Are large property portals going to continue to dominate Google's search results?
We are having a discussion (potential argument) in our office around whether large portals (namely property portals) have longevity in Google's search. Argument 1:
Industry News | | NeilPursey
Google's rise in local search and rewarding strong brand names rather than keyword driven domain names will devalue property portals with keyword rich domain names. Property portals are essentially duplicating content on smaller individually owned property websites, therefore in time Google will devalue property portals. **Argument 2: **
Property portals have more property stock listed on their websites so therefore Google will reward them by ranking these websites higher than the smaller real estate agencies with niche stock in their areas that they operate in. The property portals that already are already in a dominate position already carry authority and their own sense of branding, therefore it's difficult for Google to ignore them. If we assume that Google is looking into user behaviour as a ranking factor, then this will help portals as they have more stock which means higher engagement on the website. I'd love to read the moz community thoughts and opinions on this. I reckon it's a worthy debate..0 -
Rank high for the term "Software development manager"
I would like to rank high for term like software development manager. How do I get started? I am new at this. I am going to start watching seo moz video tutorials to get some ideas. In the mean time if there are any step by step techniques that would be helpful. Thanks
Industry News | | zsyed0 -
Google Penguin 2.0 - Coming soon
There is an interesting article on SEW that Google is going to update Penguin to the next major version - http://bit.ly/15Vkr6O So what do you think, what should we expect? And also, is there available updated webmaster guidelines?
Industry News | | ditoroin1 -
How to add excel in Google custom Search
Hi I was watching this video http://www.seomoz.org/blog/eight-link-building-tips-whiteboard-friday and i wanted to know how to put the excel sheet in Google Custom Search engine? Many thanks
Industry News | | conversiontactics0 -
Is Google Making Life Harder For Aggregators?
Theres been a bunch of updates recently which have hurt aggregators: Reducing the number of search results to 7 for branded search queries The DMCA update which penalises those with trademark related takedown requests against them. At least 2 'domain diversity' updates, the most recent last week, which seeks to reduce the ability of sites to dominate SERPS e.g. a site which may have 2 search results on page 1 now may have 1. Plus Its commonly believed that Google favours big brands over smaller brands e.g. Marriott over examplehotelaggregator.com. Is this a deliberate ploy against aggregators in favour of brands i.e. does Google believe a brand site is a better search result than an aggregator? A brand site returned above an aggregator for a branded term may be seen by Google as a better fit, a better search result that should be higher. But is that true? Consumers like to see unbiased reviews and lowest prices and that isnt always available at the brand site. Thoughts please.
Industry News | | AndyMacLean0 -
Google Cached "Text Only" version
Is there a way to test what a page would look like in Google "Text Only" version before a page is indexed in Google? Is there a tool out there to help with this?
Industry News | | activejunky10 -
Anyone else know much about the Google Pirate penalty?
The Google 'Pirate' (no official name) seems to have gone largely undiscussed since it was launched last - Fri 10th August http://insidesearch.blogspot.co.uk/2012/08/an-update-to-our-search-algorithms.html. The idea of it is to ensure those 'Pirating' content or abusing trademarks e.g. fake ugg boot sites and file sharing sites do not appear higher in the search results than the genuine websites. Google is using DMCA take down requests for labeling sites as Pirate and demote their rankings, Im amazed not even seomoz has covered the subject yet as far as I can see, yet it is a hugely important new update, albeit affecting a relatively small number of sites now, and in some cases (at least one I know first hand) seemingly without justification (the example I know is not a file sharing, fake goods, trademark abusive site at all.) Google updating its search algorithm based on DMCA take down requests seems a bit strong - these are takedown requests, not legal proof that a site is infringing a trademark. A real weapon for negative SEO? Anyone else had experience of the pirate update or know much more about it? Outside Danny Sullivan I dont see many SEO folk covering it. Heres my own insights into it and what ive learned about what (only innocently) affected sites should do to appeal http://www.andy-maclean.net/the-google-pirate-dmca-guidance/
Industry News | | AndyMacLean0 -
Searching for a keyword on html source code of a website via Google
Is such a thing possible? Can we google for a specific keyword that can be found on the source code of a website? Is there any search operator for this? Thanks in advance!
Industry News | | merkal20050