I have a site that has a 302 redirect loop on the home page (www.oncologynurseadvisor.com) i
-
i am trying to do an audit on it using screaming frog and the 302 stops it. My dev team says it is to discourage Non Human Traffic and that the bots will not see it. Is there any way around this or what can I tell the dev team that shows them it is not working as they state.
-
As I said use robots.txt or htaccess rules for bots, where you would be able to allow access to specific bots like seofrog (at least temporary). Or, maybe they can allow seofrog to crawl it temporarily or something.
As for Google bot - try to "fetch as google" within Google Search console. See what response there is.
-
Thank you.
In response to your question, they want to block any Non Human Traffic. This is another site for a single sign on. So that when someone signs in to one site, they are signed in to all of the sites that we offer. They have said that the bots doe not see the redirect, yet I am trying to crawl it with Screaming Frog and SEO Powersuite that will crawl a site as if it were Googlebot and I still get the same response and both tools go no further unless i ask them to crawl the orphan pages.
-
Howdy.
This is very strange. So, does your dev team block all bots? How about search engine bots? 0.o
Anyway, the 302 redirect is not the way to go. If you'd like to manage bot access, use robots.txt, htaccess rules or simply filter it out afterwords in reporting tools.
Hope this helps
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why is Google displaying meta descriptions for pages that are nowhere contained in said page metas?
Certain search keywords are pulling up incorrect page titles and meta descriptions for our site. I've looked through our code, and the text used by Google in the search results is nowhere found inside our site. I've also looked at previous iterations of our site from over a decade ago and still haven't found it. I then searched specifically for the exact phrased incorrect meta descriptions and found a long list of spammy sites linking to our domain with the exact, incorrect meta description. Is this why Google is displaying the incorrect data, and how do I get Google to use the meta descriptions from my actual site?
Web Design | | Closetstogo0 -
CMS dynamicly created pages indexed?
Hey Moz'erz, Looking at the indexed pages of my clients eCommerce website I noticed that dynamically created pages are being indexed. For example this page does not "exist" but is created by a drop down filter menu that sorts by product tag: /collections/tools/TAG I can only conclude that this page got indexed either through a backlink or once upon a time there was an internal link pointing to this URL and got indexed (currently there is not). Are either of these cases possibilities? In either case before considering removal or any action I would of-course reference analytics to check for conversions, traffic and any backlinks for those "pages". I believe at the end of the day is recommend a drop down filer that doesn't create new pages as the best solution. Thoughts, comments and experience is greatly welcomed 🙂
Web Design | | paul-bold0 -
Major home page change!
Hi Mozzers, Making a major homepage change on my site Orangeoctop.us. I am going from featuring content to featuring products, similar to how moz and hubspot feature their content on the homepage. Just to give you some numbers, the homepage only sees 2.6% of the total traffic and of that traffic half is direct. The homepage is going to be changed to OrangeOctop.us/guides. My Question: Is there anything that should be added to the homepage to ensure that I keep the same domain authority/page authority?
Web Design | | orangeoctop.us0 -
Many errors from previous ecommerce site. Domain is now just a localized wordpress site.
Many errors from previous ecommerce site. Do I need to redirect every single page that no longer exists at this domain? loveyourcabinets.com used to be loveyourkitchenandbath.com but we have since changed course. We want loveyourkitchenandbath.com to be our local site on Long Island and NYC. Loveyourcabinets.com will be an ecommerce project that I'll be revamping in the coming months. I think Moz as well as Google still has all of the old ecommerce pages indexed. And of course, Moz is shooting me a bunch of error all regarding pages from the ecommerce site that used to be on loveyourkitchenandbath.com. Any thoughts? Commentary? Thx
Web Design | | loveyourkitchen0 -
Internal linking for small site
I have a site with 13 pages, 6 are product pages, 5 are free tips pages (the other 2 are the home page and contact form). Currently I have the navbar at top of site with a "products" dropdown menu for the 6 product pages and a "Tips" dropdown menu for the 5 tip pages. All categories except the contact page are at the bottom as breadcrumbs, the homepage is "home" and the rest are relevant user friendly keyword anchor text. So I have 2 more pages to ad to "Tips" and am wondering whether to have a new 2nd level tips page that links to a 3rd level of 7 different tips pages, or keep it shallow as it is, with only 2 levels from the homepage to the other (now 13) pages, with a potential of 22 pages in the foreseable few years? (and some graphics work to make it user friendly like how Zappo's has categories to the side on each of its drop down navbar menu's and non-link text categories for its bottom of page breadcrumb links) Can those aforementioned pages linking to each other in the footer dilute link equity? (I think that's one of the primary reasons I'm curious). What do you think of this: http://www.dbswebsite.com/blog/2012/08/08/internal-linking-101-5-best-practices/ (I guess I should no follow my contact page), could it be better to have a 2nd level page for "Tips" to get more equity to that page rather than across all 7 tips pages? I have read around about this on here (hence how I found out about Zappo's) and elsewhere and wanted ask to make sure.
Web Design | | Zoolander0 -
Site lost in Google
Recently I switched my from Joomla to WordPress. I did 301 re-directs ...and promptly fell from Google results after 5 YEARS at no. 1-3 Still ranking 1 in Bing and 3 in Yahoo...but nowhere near the traffic I previously had. Here is my site: http://selfdirectedira.org Any suggestions? TIA
Web Design | | tvegas0 -
Ajax pagination and filters for ecommerce site
Hi There, Is it ok to use ajax for product filters and pagination? In this case url doesn't change when you navigate to 2nd or 3rd page also when you filter by colours, etc. If not what's your advise?
Web Design | | Jvalops0 -
E-commerce Site Layout
I have got an e-commerce site already and i am thinking of staring a new e-commerce site with new domain, but i will keep the layout and design same. Products would be similar to what i sell on my other ecommerce site Will Google Penalise me of having same layout and same design or is it ok to open multiple ecommerce sites with same layouts
Web Design | | usef4u0