Http Response on bulk list
-
Do you know any tool that can find the http response code for a bulk list of urls?
-
bless your little heart erica
-
I found this one. (Haven't used it, bu it looks like what you need!)
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Losing backlinks between http and https
Late last year, Shopify moved all their sites from http to https. I did an audit of a Shopify site recently and discovered the following... The https version of the site has just 13 backlinks from 5 domains The http version of the site has 568 backlinks from 48 domains So I went into the blog (which is on a different domain - long story) and changed all the backlinks from http to https. One week later... the https version of the site now has 278 backlinks from the same 5 domains. I've been told that Google doesn't worry about this when it comes to rankings. Not sure if this is true or not. But I definitely believe this DOES affect MOZ Domain Authority. Can anybody confirm or deny this? If the backlinks do not change from http to https following a migration, does this impact MOZ Domain Authority and/or Google rankings?
Intermediate & Advanced SEO | | muzzmoz0 -
SEO implications of serving a different site on HTTPS vs. HTTP
I have two sites: Site A, and Site B. Both sites are hosted on the same IP address, and server using IIS 7.5. Site B has an SSL cert, and Site A does not. It has recently been brought to my attention that when requesting the HTTPS version of Site A (the site w/o an SSL cert), IIS will serve Site B... Our server has been configured this way for roughly a year. We don't do any promotion of Site A using HTTPS URLs, though I suppose somebody could accidentally link to or type in HTTPS and get the wrong website. Until we can upgrade to IIS8 / Windows Server 2012 to support SNI, it seems I have two reasonable options: Move Site B over to its own dedicated IP, and let HTTPS requests for Site A 404. Get another certificate for Site A, and have it's HTTPS version 301 redirect to HTTP/non-ssl. #1 seems preferable, as we don't really need an SSL cert for Site A, and HTTPS doesn't really have any SEO benefits over HTTP/non-ssl. However, I'm concerned if we've done any SEO damage to Site A by letting our configuration sit this way for so long. I could see Googlebot trying https versions of websites to test if they exist, even if there aren't any ssl/https links for the given domain in the wild... In which case, option #2 would seem to mostly reverse any damage done (if any). Though Site A seems to be indexed fine. No concerns other than my gut. Does anybody have any recommendations? Thanks!
Intermediate & Advanced SEO | | dsbud0 -
Use "If-Modified-Since HTTP header"
I´m working on a online brazilian marketplace ( looks like etsy in US) and we have a huge amount of pages... I´ve been studing a lot about that and I was wondering to use If-Modified-Since so Googlebot could check if the pages have been updated, and if it is not, there is no reason to get a new copy of them since it already has a current copy in the index. It uses a 304 status code, "and If a search engine crawler sees a web page status code of 304 it knows that web page has not been updated and does not need to be accessed again." Someone quoted before me**Since Google spiders billions of pages, there is no real need to use their resources or mine to look at a webpage that has not changed. For very large websites, the crawling process of search engine spiders can consume lots of bandwidth and result in extra cost and Googlebot could spend more time in pages actually changed or new stuff!**However, I´ve checked Amazon, Rakuten, Etsy and few others competitors and no one use it! I´d love to know what you folks think about it 🙂
Intermediate & Advanced SEO | | SeoMartin10 -
Is a dynamic online user list bad for SEO?
Hello everyone, I have a question that is currently puzzling me, and I hope you can help me with. On musicianspage.com (one of our websites), we show a list of online users embedded within the page which, as you may expect, changes all the time according to who's online at that moment. That list appears on every page of the site, so at any time any page on the site has a different content and different link profile (sometimes we have just a few users connected, other times we may have over 50 users connected at the same time). My question is: is such a "dynamical-embedded" list bad, good or neutral from a SEO stand point? If it is bad, what do you suggest to do? Put it inside a frame? Using AJAX? Any thoughts and suggestions are very welcome! Thanks in advance to anyone reading this. All the best, Fabrizio
Intermediate & Advanced SEO | | fablau0 -
Is it worth changing themes to be Responsive, and risk a SERP change?
I've got a site that ranks #1 for it's term. It's Worpress on Thesis 1.85. The site is not responsive and cannot be because Thesis 1x is not (and Thesis 1x is a dead end). I really would like my site responsive, but I fear changing things might affect my #1 rank. The least impactful change I could do is move to Thesis 2.x, but I have come to really dislike the company and hate to get locked in again. There are other frameworks I would prefer to move to, but their impact on my pages' source would be much more. So, my question is, is it worth moving to a new theme (keeping the layout looking exactly the same, although the "source" would look different) just to make the site responsive? Is it that important?
Intermediate & Advanced SEO | | bizzer0 -
Best practice for listings with outbound links
My site contains a number of listings for charities that offer various sporting activities for people to get involved in order to raise money. As part of the listing we provide an outbound link for the user to find out more info about each of the charities and their activities. Currently these listings are blocked in the robots.txt for fear that we may be viewed as a 'link farm or spam site' (as there are hundreds of charities listed on the scrolling page) but these links out are genuine and provide benefits and are a useful resource for the user and not paid links. What I'd like to do is make these listings fully crawlable and indexable to increase our search traffic to these listing, but I'm not sure whether this would have a negative impact on our Pagerank with Google potentially viewing all these outbound links as 'bad' or 'paid links', Would removing the listing pages from our robots.txt and making all the outbound links 'nofollow' be the way forward to allow us to properly index the listings without being penalised as some kind of link farm or spam site? (N.B. I have no interest in passing link juice to the external charity websites)
Intermediate & Advanced SEO | | simon_realbuzz0 -
How to get a full blended listing
Hi people, After much hard work our site www.noyelling.com.au is doing very well in the SERPS in Brisbane. The only problem is that we've gone from having a full blended listing to what can be seen in the attached image - a map-pack listing. While we are number 1, I don't feel that having the listing as it is is offering anywhere near the value we'd receive from a full blended maps/organic listing. Any ideas on how a full listing can be achieved so that we can be number 1 and be separate from the map-pack we are part of currently? Thanks, Matt Williams www.noyelling.com.au 0t3I1Z2x3W3n3F08342R
Intermediate & Advanced SEO | | duncan2740 -
Foreign languages and first page listings on search engines
I have a customer that has asked me to find out the best way to move forwards with foreign languages. He sells Jukeboxes in the UK and has found recently that a large number of his customers are coming from abroad due to the financial climate. So he wants to appear on the first page of google in Russia, Arabic countries, French speaking countries and China. Whats the best route ? Add pages to his current .co.uk site or look at purchasing domains for each country. Then submitting them to each google. So Google.ru etc. Thanks
Intermediate & Advanced SEO | | onlinemediadirect0