Large Redirects, How do I cross check two websites
-
My company currently owns five different websites and every day we download a list of for Google crawl errors.I then crawl the downloaded list with screaming frog to double check the redirects to make sure the pages are not 404s. We have two websites that have similar identical content and used to cross-check each and used to redirect to the parent page by our bread crumbs.
(404 error) www.website1.com/productxx.html
(working Site) www.website2.com/productxx.html
we then redirect (404 error) www.website1.com/productxx.html to the last parent page or similar page.
Is there a faster way to compare two websites beside opening 200 windows all at once? Is there a program that would allow us to compare two websites?
-
Hi there,
Thanks for the question. Can I just check something regarding this bit from your question:
"My company currently owns five different websites and every day we download a list of for Google crawl errors.I then crawl the downloaded list with screaming frog to double check the redirects to make sure the pages are not 404s."
I'm a bit confused because you say you download a list of crawl errors, which would be 404s, but you then crawl them to make sure they're not 404s?
Could you clarify this bit?
Thanks!
Paddy
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
New websites
Hi Moz community, My company updated and used a new developer to build and re-design their charity websites: www.runforcharity.com, www.cycleforcharity.com and www.sportforcharity.com. This sites were "re-launched" at the beggining of December 2015 and I have now been able to get a good 6 weeks worth of data. I've been religiously using Moz.com for a couple of years and I use it simply for SEO purposes. Our websites are built upon organic traffic being driven to them and I have noticed that the PA on the new sites has taken a hammering. They all appear to have a PA of 1 and I'm at a loss why? It appears that no page has h1 text? Would this be an issue with the developer or something the content team is doing wrong? Any help of advice would be much appreciated. Many thanks Ryan
Intermediate & Advanced SEO | | Bennerya0 -
Website Does not index in any page?
I created a website www.astrologersktantrik.com 4 days ago and fetch it with google but still my website does not index on google as the keywords I use is with low competition but still my website does not appear on any keywords?
Intermediate & Advanced SEO | | ramansaab0 -
Why is this url redirecting to our site?
I was doing an audit on our site and searching for duplicate content using some different terms from each of our pages. I came across the following result: www.sswug.org/url/32639 redirects to our website. Is that normal? There are hundreds of these url's in google all with the exact same description. I thought it was odd. Any ideas and what is the consequence of this?
Intermediate & Advanced SEO | | Sika220 -
Interlinking multiple websites
Most websites (for example) Zalando intern link there other CC tld domains to the root. For example: On http://www.zalando.nl/damesschoenen-pumps/ the links in the footer go to the other CC tld's: http://www.zalando.es , zalando.co.uk etc. Does anyone have experience with the fact if you would interlink to the relevant page on the other CC tld;s.
Intermediate & Advanced SEO | | TjeerdvZ
For example: http://www.zalando.nl/damesschoenen-pumps/ links to http://www.zalando.co.uk/womens-shoes-heels/ in stead of linking to the homepage ?
In theory this would give more relevance intern linking. Looking forward to hear if anyone tried or experienced this and what the results where?0 -
Website Migration and SEO
Recently I migrated three websites from www.product.com to www.brandname.com/product. Two of these site are performing as normal when it comes to SEO but one of them lost half of its traffic and dropped in rankings significantly. All pages have been properly redirected, onsite SEO is intact and optimized, and all pages are indexed by Search engines. Has anyone had experience with this type of migration that could give some input on what a possible solution could be? Any help would be greatly appreciated!
Intermediate & Advanced SEO | | AlexVelazquez0 -
API to power all websites
I spoke to one of my lead web developers and we are planning on powering all of our desktop, mobile and tablet sites with our new API. Everything will be populated through javascript and is cloud-based rather than through actual HTML. How do we incorporate all of our SEO?
Intermediate & Advanced SEO | | recbrands0 -
Questions about 301 Redirects
I have about 10 - 15 URLs that are redirecting to http://www.domainname.comwww.domainname.com/. (which is an invalid URL)The website is on a Joomla platform. Does anyone know how I can fix this? I can't figure out where the problem is coming from.
Intermediate & Advanced SEO | | JohnParker27920 -
How to do a wildcard redirect?
Sorry if this is a dumb question, but I am not a programmer and my client's programmer is asking me how to set this up. Normally I do it in my cPanel, but they can't and need to write it in the .htaccess file. The client's new website was posted at dev.site.com and of course their programmer put robots="index,follow" and so the site is completely indexed. They are launching it tomorrow at www.site.com. I need a wildcard redirect that takes dev.site.com/anything and 301 redirects it to www.site.com/samething if that makes sense. Basically redirects every dev.site.com URL to www.site.com so we don't have duplicate indexation issues. Can anyone tell me the code to do this that needs to go in the .htaccess file? I would just do it through cPanel but that's not an option, so any help is appreciated.
Intermediate & Advanced SEO | | DanDeceuster0