Shopify robots blocking stylesheets causing inconsistent mobile-friendly test results?
-
One of our shopify sites suffered an extreme rankings drop. Recent Google algorithm updates include mobile first so I tested the site and our team got different mobile-friendly test results. However, search console is also flagging pages as not mobile friendly. So, while us end-users see the site as OK on mobile, this may not be the case for Google?
I researched more about inconsistent mobile test results and found answers that say it may be due to robots.txt blocking stylesheets.
Do you recognise any directory blocked that might be affecting Google's rendering? We can't edit shopify robots.txt unfortunately. Our dev said the only thing that stands out to him is Disallow: /design_theme_id and the rest shouldn't be hindering Google bots.
Here are some of the files blocked:
Disallow: /admin
Disallow: /cart
Disallow: /orders
Disallow: /checkout
Disallow: /9103034/checkouts
Disallow: /9103034/orders
Disallow: /carts
Disallow: /account
Disallow: /collections/+
Disallow: /collections/%2B
Disallow: /collections/%2b
Disallow: /blogs/+
Disallow: /blogs/%2B
Disallow: /blogs/%2b
Disallow: /design_theme_id
Disallow: /preview_theme_id
Disallow: /preview_script_id
Disallow: /discount/*
Disallow: /gift_cards/*
Disallow: /apple-app-site-association -
Nikki–if you feel comfortable sharing one of the sites, that would be helpful for further investigation!
It seems like there's a lot you're blocking in your robots.txt that you might need (though that's hard to suss out without knowing your site):
-
Disallow: /blogs/+, Disallow: /blogs/%2B, Disallow: /blogs/%2b
-
assuming /blogs is the primary page path for any other blog content (e.g. /blogs/blog-title-goes-here)
-
Disallow: /design_theme_id
-
assuming this is one of your stylesheets, you should probably remove this.
-
Disallow: /gift_cards/*
-
no idea what comes after /gift_cards/[here], but this may be unnecessary
There may be other reasons Google doesn't reliably see your site as mobile friendly–if you can provide an example site, then we can dig deeper
-
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Backlink inconsistency
Hello! We were ranked on page 1 in Google for the past 10 years for a specific key phase until this February when we were pushed to page 2. When analyzing backlinks via majestic.com we found that our backlinks haven't been consistent, we typically have around 1,000 or less, but in February they dropped, then began spiking inconsistently (from 3000+ to a few hundred, then back up). Not sure how accurate Majestic's reporting is but we've also noticed some sites which are spamming our site with links on their low-quality and porn content websites. Is this type of backlink inconsistency normal, or is this something that could be negatively impacting our rankings? UttesqA
Technical SEO | | EileenCleary0 -
HTTP Status showing up in opensiteexplorer top pages as blocked by robot.txt file
I am trying to find an answer to this question it has alot of url on this page with no data when i go into the data source and search for noindex or robot.txt but the site is visible in the search engines ?
Technical SEO | | ReSEOlve0 -
Robots.txt Download vs Cache
We made an update to the Robots.txt file this morning after the initial download of the robots.txt file. I then submitted the page through Fetch as Google bot to get the changes in asap. The cache time stamp on the page now shows Sep 27, 2013 15:35:28 GMT. I believe that would put the cache time stamp at about 6 hours ago. However the Blocked URLs tab in Google WMT shows the robots.txt last downloaded at 14 hours ago - and therefore it's showing the old file. This leads me to believe for the Robots.txt the cache date and the download time are independent. Is there anyway to get Google to recognize the new file other than waiting this out??
Technical SEO | | Rich_A0 -
Search results indexed
Hi there, is is bad practice in seo to have search results for products indexed? For example a search result of holidays to Ibiza, with lots of deals coming up? its a search query url that would be indexed, with just an image and price per product on the page, with about 10 per page? Any advice appreciated.
Technical SEO | | pauledwards0 -
Mobile Site & SEO
If i create a mobile site for a client will google crawl that site for mobile results or will it effect my rankings. My guess is no, just want to make sure. Obviously code will be different.
Technical SEO | | waqid0 -
What caused my huge drop in search ranking?
On February 8th, 2012 my site's non-branded search traffic dropped overnight by over 80%. It appears I've been hit by a Google penalty. I submitted a reconsideration request and one of Google's staff replied letting me know it was NOT a manual penalty. So it's clearly a result of an algorithm. What is the cause? I haven't made significant changes to the website in the previous months do to being out of the country and the holidays. I'm extremely careful not to out source SEO so there is no chance of questionable link building strategies, unless my competitor launched an attack on my site. I've considered these possible causes: Duplicate content - My site had some redundancy from a marketing plan before Google Panda launched. Last month, I removed all duplicate content. Unnatural link building - I've been moving slowly my site, page by page, from adbio.com to bioworldusa.com after a brand change. Perhaps the 301 redirects triggered a flag in Google's algorithm. I've since removed all redirects to see if that will fix the issue. Poor User Experience - I recently upgraded my Drupal CMS and had to change themes. Currently my theme is an ugly, grey theme which may cause a higher than usual bounce rate. I've been trying to compensate by making sure the content is high quality. The penalty affected these website: www.bioworldusa.com (2/8/12) blog.bioworldusa.com (2/8/12) www.adbio.com (2/17/12)
Technical SEO | | bioworld1 -
Should search pages be disallowed in robots.txt?
The SEOmoz crawler picks up "search" pages on a site as having duplicate page titles, which of course they do. Does that mean I should put a "Disallow: /search" tag in my robots.txt? When I put the URL's into Google, they aren't coming up in any SERPS, so I would assume everything's ok. I try to abide by the SEOmoz crawl errors as much as possible, that's why I'm asking. Any thoughts would be helpful. Thanks!
Technical SEO | | MichaelWeisbaum0 -
Robots.txt and 301
Hi Mozzers, Can you answer something for me please. I have a client and they have 301 re-directed the homepage '/' to '/home.aspx'. Therefore all or most of the linkjuice is being passed which is great. They have also marked the '/' as nofollow / noindex in the Robots.txt file so its not being crawled. My question is if the '/' is being denied access to the robots is it still passing on the authority for the links that go into this page? It is a 301 and not 302 so it would work under normal circumstances but as the page is not being crawled do I need to change the Robots.txt to crawl the '/'? Thanks Bush
Technical SEO | | Bush_JSM0