I have a site that has a 302 redirect loop on the home page (www.oncologynurseadvisor.com) i

[HayMktVT]

i am trying to do an audit on it using screaming frog and the 302 stops it. My dev team says it is to discourage Non Human Traffic and that the bots will not see it. Is there any way around this or what can I tell the dev team that shows them it is not working as they state.

[DmitriiK]

As I said use robots.txt or htaccess rules for bots, where you would be able to allow access to specific bots like seofrog (at least temporary). Or, maybe they can allow seofrog to crawl it temporarily or something.

As for Google bot - try to "fetch as google" within Google Search console. See what response there is.

[HayMktVT]

Thank you.

In response to your question, they want to block any Non Human Traffic. This is another site for a single sign on. So that when someone signs in to one site, they are signed in to all of the sites that we offer. They have said that the bots doe not see the redirect, yet I am trying to crawl it with Screaming Frog and SEO Powersuite that will crawl a site as if it were Googlebot and I still get the same response and both tools go no further unless i ask them to crawl the orphan pages.

[DmitriiK]

Howdy.

This is very strange. So, does your dev team block all bots? How about search engine bots? 0.o

Anyway, the 302 redirect is not the way to go. If you'd like to manage bot access, use robots.txt, htaccess rules or simply filter it out afterwords in reporting tools.

Hope this helps