SEO Implications of firewalls that block "foreign connections"
-
Hello!
A client's IT security team has firewalls on the site with GEO blocking enabled. This is to prevent foreign connections to applications as part of a contractual agreements with their own clients.
Does anyone have any experience with workarounds for this?
Thank you!
-
Thank you SO much!
-
I guess that if Google decides to crawl your site using one of their data-centers from one of the blocked regions, suddenly Google will believe that your whole site has gone down and become inaccessible (as Google rarely launches crawls from multiple multi-regional data centers, for one website - simultaneously)
**Exempting GoogleBot via user-agent would be the only possible work-around **(that I know of) If those trying to access your site (whom you are trying to block out) became aware of this modification, they could alter their scripts, browsers and tools to send you the GoogleBot user-agent (thus penetrating your firewall pretty easily)
In the end, you just have to decide what's more important to you
It might be possible to identify Google's data-centre IP addresses from server logs and exempt those instead of exempting their user-agent, but that would probably need a full time employee just to keep up with all the changes. You can be sure that Google won't make it easy to identify their data centers via IP data
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Software "card" carousel results
Hi all! Does anyone have advice for getting a software product to appear in the card results at the top of SERPs? Example https://www.google.com/search?q=budgeting+software&rlz=1C1CHBF_enUS784US784&oq=budgeting+software&aqs=chrome..69i57j0l5.2194j0j7&sourceid=chrome&ie=UTF-8 dzTpe2B
Intermediate & Advanced SEO | | SimpleSearch0 -
SEO Migration Options
Hi Guys, We have a www.sitename.com.au domain name and looking to move into the US market, and other markets in the future such as UK, Canada, etc. We are reviewing our options. Currently the .com.au is ccTLD to Australia so won't perform well in US. It seems the best option at this stage is to get a generic domain Generic top-level domains (gTLDs) like a .com. Then create different sub-folders for each country for example: .com our main country .com/us/ target us .com/uk/ Then in Google Search Console don't set country targeting for entire domain but use Hreflang Tags to specify the targeting for each page? -- This seems like a complex strategy to execute so i just want to check if this would be a optional option? Any suggestions would be very much appreciated! Cheers.
Intermediate & Advanced SEO | | cerednicenko0 -
URL structure for SEO
Hi Mozzers, I have a site which is a combination of product pages, and news and advice pages that relate to the products. How would you approach the URL structure for this, following SEO best practice? Approach 1 Product pages:
Intermediate & Advanced SEO | | A_Q
www.website.com/product-category/product-page News and advice pages:
www.website.com/product-category/product-page/news-and-advice-story-1
www.website.com/product-category/product-page/news-and-advice-story-2
etc or Approach 2 Product pages:
www.website.com/product-category/product-page News and advice pages:
www.website.com/news/product-category/news-and advice-story-1 (with internal linking to relevant product page)
www.website.com/news/product-category/news-and advice-story-2 (with internal linking to relevant product page)
etc Or would a different approach be better?0 -
Nofollow "print" URLs?
Hi there, Apols for the basic question but is it considered good practice to nofollow one of one's own URLs? Basically our 'print page' command produces an identical URL in the same window but with .../?print=1 at the end. As far as I've been reading, the nofollow html attribute is, broadly speaking, only for links to external websites you don't want to vouch for or internal links to login/register pages that together with noindex, you're asking Google not to waste crawl budget on. (The print page is already noindexed so we're good there) Can anyone confirm the above from their own experience? Thanks so much!
Intermediate & Advanced SEO | | Daft.ie0 -
SEO agency makes "hard to believe" claims
Hi I operate in a highly competitive niche of "sell house fast" in UK. Sites that are in top 1-3 tend to have thousands of links. Some of these are spammy type links. These sites have Domain Authority too. My site has good content http://propertysaviour.co.uk and is listed with around 12 well known directories. I have been building back-links manually over the last 3-4 months. The SEO agency we are looking to work with are claiming they can get my website to first page with above keyword. How would you go about this strategy? What questions would you ask SEO agency? What elements can do I myself? By the way, I am good at producing content!
Intermediate & Advanced SEO | | propertysaviour0 -
Your typical blog disclosure. "We received a free product but are not financially compensated".
Good afternoon & Happy Friday! I've ran into the following disclosure multiple times on different blogs. It seems to me like it would be a red flag and counter productive for both the blogger and the brand sending the samples as "free samples" are subject to google link scheming. Am I correct? What are your thoughts on bloggers using this disclaimer in regards to SEO? Disclosure: Some of these products were samples provided to me to try. Opinions and the choice to review are 100% my own! I was not financially compensated for writing this blog post. This post contains affiliate links.
Intermediate & Advanced SEO | | 90miLLA0 -
SEO things that make you say "what!?"
Hi everyone, I'm a recent(ish) beginner to SEO, and while I feel I've got a good grounding in the industry now, there are still certain aspects that make me say "what!?". I'm looking to write a blog post on this and would love to know what parts of SEO still confuse you or make you say "what!?", and explain them from a semi-beginners point of view. Any comments appreciated! Thanks!
Intermediate & Advanced SEO | | White.net0 -
Can too many "noindex" pages compared to "index" pages be a problem?
Hello, I have a question for you: our website virtualsheetmusic.com includes thousands of product pages, and due to Panda penalties in the past, we have no-indexed most of the product pages hoping in a sort of recovery (not yet seen though!). So, currently we have about 4,000 "index" page compared to about 80,000 "noindex" pages. Now, we plan to add additional 100,000 new product pages from a new publisher to offer our customers more music choice, and these new pages will still be marked as "noindex, follow". At the end of the integration process, we will end up having something like 180,000 "noindex, follow" pages compared to about 4,000 "index, follow" pages. Here is my question: can this huge discrepancy between 180,000 "noindex" pages and 4,000 "index" pages be a problem? Can this kind of scenario have or cause any negative effect on our current natural SEs profile? or is this something that doesn't actually matter? Any thoughts on this issue are very welcome. Thank you! Fabrizio
Intermediate & Advanced SEO | | fablau0