Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Googlebot crawling AJAX website not always uses _escaped_fragment_

White Hat / Black Hat SEO

564

yohayg last edited by

Hi,

I started to investigate googlebot crawl log of our website, and it appears that there is no 1:1 correlation between a crawled URL with escaped_fragment and without it.
My expectation is that each time that google crawls a URL, a minute or so after, it suppose to crawl the same URL using an escaped_fragment

For example:
Googlebot crawl log for https://my_web_site/some_slug

Results:
Googlebot crawled this URL 17 times in July:

http://i.imgur.com/sA141O0.jpg

Googlebot crawled this URL additional 3 crawls using the escaped_fragment:

http://i.imgur.com/sOQjyPU.jpg

Do you have any idea if this behavior is normal?

Thanks,

Yohay

sOQjyPU.jpg sA141O0.jpg
1 Reply Last reply
Reply Quote 0

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

Linking Websites/ Plagiarized Content Ranking Above Original Content

Hey friends! Sooo this article was originally published in December 2016: https://www.realwealthnetwork.com/learn/best-places-to-buy-rental-property-2017/ It has been consistently ranking in positions 2-3 for long tail keyword "best places to buy rental property 2017" (and related keywords) since January-ish. It's been getting about 2000-2,500 unique views per week, until last week when it completely dropped off the internet (it's now ranking 51+). We just did a site redesign and changed some URL structures, but I created a redirect, so I don't understand why that would affect our ranking so much. Plus all of our other top pages have held their rankings -- in fact, our top organic article actually moved up from position 3 to 2 for much more competitive keywords (1031 exchange). What's even weirder is when I copy the sections of my article & paste into Google with quotes, our websites doesn't show up anywhere. Other websites that have plagiarized my article (some have included links back to the article, and some haven't) are ranking, but mine is nowhere to be found. Here are some examples: https://www.dawgsinc.com/rental-property-the-best-places-to-buy-in-the-year-2017/ http://b2blabs.com/2017/08/rental-property-the-best-places-to-buy-in-the-year-2017/ https://www.linkedin.com/pulse/best-places-buy-rental-property-year-2017-missy-lawwill/?trk=mp-reader-card http://news.sys-con.com/node/4136506 Is it possible that Google thinks my article is newer than the copycat articles, because of the new URL, and now I'm being flagged as spam? Does it think these are spam websites we've created to link back to our own content? Also, clearly my article is higher quality than the ranking articles. Why are they showing up? I double checked the redirect. It's good. The page is indexed... Ahhh what is going on?! Thanks for your help in advance!
White Hat / Black Hat SEO | | Jessica711

0
Website penalized never again be the same

In February 2015 I received google email that had been penalized Superficial content with little or no added value. I resolved the situation with Google and the site was reconsidered two months later. The problem happens that since I had to drop the site never again be the same, since the site has been penalized never again be the same, now owned only 10% of visits and since then has not shown more growth. I'm deciding to leave the site for no more hopes and all who have had the same problem told me to forget about and working with new. What do you think? Give up the site and get a new one? In addition, during this period I rephrased the entire site, let responsive, mobile and improved as a whole in the general context and migrated to wordpress. www.acervoamador.com.br (Warning: adult content) I thank you for your attention and have a nice day.
White Hat / Black Hat SEO | | stroke

0
4 websites - meta titles and descriptions

I manage four separate websites/brands that all focus on the same topics and have the same achitecture. I am trying to improve each site's meta title and description, page by page, that I inherited from another before me. My question is, how different should each title/description be from one another for the same page type? Do the search engines consider this heavily in their decision process of who to show on SERPs? Am i able to simply swap out the brand name in the metas and call it done or should each meta be unique? if unique, how unique? As you can imagine, since each page is essentially the same with the same overall content and layout targeting the same keywords, it is very difficult to rewrite metas four unique ways. I greatly appreciate any advice on how you would approach this project.
White Hat / Black Hat SEO | | dsinger

0
How to resolve - Googlebot found an extremely high number of URLs

Hi, We got this message from Google Webmaster “Googlebot found an extremely high number of URLs on your site”. The sample URLs provided by Google are all either noindex or have a canonical. http://www.myntra.com/nike-stylish-show-caps-sweaters http://www.myntra.com/backpacks/f-gear/f-gear-unisex-black-&-purple-calvin-backpack/162453/buy?src=tn&nav_id=541 http://www.myntra.com/kurtas/alma/alma-women-blue-floral-printed-kurta/85178/buy?nav_id=625 Also we have specified the parameters on these URLs as representative URL in Google Webmaster - URL parameters. Your comments on how to resolve this issue will be appreciated. Thank You Kaushal Thakkar
White Hat / Black Hat SEO | | Myntra

0
Lots of websites copied my original content from my own website, what should I do?

1. Should I ask them to remove and replace the content with their unique and original content? 2. Should I ask them to link to the URL where the original content is located? 3. Should I use a tool to easily track these "copycat" sites and automatically add links from their site to my site? Thanks in advance!
White Hat / Black Hat SEO | | esiow2013

0
Website that lost ranking and now starting to recovery

Hello guys,
About a month ago we got in the webmaster tool a message that saying that we have unnatural links to the website.
We got drop from 200 keys that was in page 1-2 to pages 5-8.
We check our links and notice that someone links more then 1000 links to our site. We apply for reconsideration request plus we send the file with the links to Google to ask to remove. Yesterday we got message from Google that say : Manual spam action revoked.
We check today the ranking and we saw that from 3 keys that was in the first page, now we are with 24 in the first page. Very good improvement but still very far from the 130 keys that was in the first page a month ago. I wanted to ask, what can we expect ?
Are we gonna get the lost ranking now ?
Is this happen overnight ?Maybe the big change will be in the next penguin update ? Bottom Line, what is the chance to get back the ranking as we had before ?
This is the most important thing right now... Thank you
White Hat / Black Hat SEO | | WayneRooney

0
Has anyone used this? www.linkdetox.com/

Has anyone used this? www.linkdetox.com/ Any opinions about it?
White Hat / Black Hat SEO | | Llanero

0
Website Spam Backlinks Solution

I have been doing some back-link checking and found that 25% of the total back-links to my PR5 site are Spam and generated over the past 8 weeks. There are 189 links in total from 38 different domains and the anchor text is a combination of 'ugg boots for women' from TLDs in China, Russia and North Korea. The PR of these sites is 15 are n/a, 12 are 0 and the other 11 range between 1 - 6. More interestingly, all the links point to 1 single page on the domain. I have taken down that page now and wondering if I should 'disavow' the offending links in Google and Bing? Clearly with such a high % of my total links now being Spam, I want to be proactive so this does not hurt my rankings in search. If a Spambot is behind it then the issue is going to get worse moving forward. Any advice is welcome...
White Hat / Black Hat SEO | | Ubique

0