Measuring the size of a competitors website?
-
I think our website is too big, far too many indexed pages. I'd like to do some research on how big our competitors' websites are (how many indexed pages). Is there a way to do this?
Cheers,
Rhys
-
Thanks, both!
-
Xenu's Link Sleuth is free so you may want to check that out (not sure just now whether there are any limits with regard to website size) but I also recommend Screaming Frog - it's money well-spent, such a feature rich tool!
-
I highly recommend buying the license for Screaming Frog, at $100/year, you won't find a more valuable SEO tool for the money. You won't find a free (and trustworthy) that will crawl a site that large.
-
Hi Alick,
I tried that but I only have the free version so we're capped at 500 URLs. Also, the site:search provided 50,000 results, but I know we don't have that many pages. Are there any other tools?
Cheers,
Rhys
-
Hi,
Do a site: search on Google itself - like "site:google.com" - to return pages of SERPs containing the pages from your competitors site which Google has indexed.
I would also suggest you use screaming frog tool you will get more accurate value here.
Hope this helps.
Thanks
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Target load time on ecommerce websites in 2017
I have a client that is redeveloping their website in Magento and is interested to know what their target page load time should be. I've read some stuff on this that's over a year old and curious if anyone has a census on what the averages are or what we should aim for. I know the simple answer is "as fast as it can be", but wondering if anyone has additional insight. Thanks!
Technical SEO | | aedesignco0 -
To merge website and blog?
I was hoping to get a bit of advice if possible. Our website has a domain authority of 25. Our blog, on a separate platform has a domain authority of 73. In essence, we were wondering if we should move all the content from our blog to our website and then set up redirects? What's stopped us so far is the fear that the links from the blog, with the higher domain authority, are having a positive effect on the website, and if we were to move the content we'd lose the value of those backlinks. So I was wondering if you could possibly advise me on the matter? Any help would be much appreciated. Thanks
Technical SEO | | Stone_Junction0 -
Duplicate content on charity website
Hi Mozers, We are working on a website for a UK charity – they are a hospice and have two distinct brands, one for their adult services and another for their children’s services. They currently have two different websites which have a large number of pages that contain identical text. We spoke with them and agreed that it would be better to combine the websites under one URL – that way a number of the duplicate pages could be reduced as they are relevant to both brands. What seamed like a good idea initially is beginning to not look so good now. We had planned to use CSS to load different style sheets for each brand – depending on the referring URL (adult / Child) the page would display the appropriate branding. This will will work well up to a point. What we can’t work out is how to style the page if it is the initial landing page – the brands are quite different and we need to get this right. It is not such an issue for the management type pages (board of trustees etc) as they govern both identities. The issue is the donation, fundraising pages – they need to be found, and we are concerned that users will be confused if one of those pages is the initial landing page and they are served the wrong brand. We have thought of making one page the main page and using rel canonical on the other one, but that will affect its ability to be found in the search engines. Really not sure what the best way to move forward would be, any suggestions / guidance would be much appreciated. Thanks Fraser .
Technical SEO | | fraserhannah0 -
Has anyone relocated a website from one country to another?
Has anyone relocated a website from one country to another? I want to replace all reference from one country (UK) to another (Australia) Phone number change, currency change, address will change Meta/products/content/urls will remain the same The .com URL will be associated to Australia Will the website keep its ranking or will it be damaged to the point where another website should be built from scratch?
Technical SEO | | GardenBeet0 -
What can I do to stop ranking for a keyword that has nothing to do with the companies website?
A website that we maintain keeps ranking for the keyword 'homeless shelter'. The company is UTILIS USA and they produce heavy duty shelters for military personnel. They have nothing to do with homeless shelters but continue to receive traffic concerning the phrase.
Technical SEO | | ReviveMedia0 -
Building a new website post penalty and redirects
A website I'm working on is clearly algorithmically penalised. I've spent a lot of time mass disavowing spammy links, but it doesn't seem to make a difference. We have been planning to build a new website anyway since we are rebranding. 1. Is it possible to tell which pages are most likely to have a penalty applied? 2. If the website as a whole has a penalty, will redirecting certain pages to the new website carry the penalty? 3. Our website is structured as sales pages and blog content. It is the sales pages that have the spammy links, yet most of the blog content does not rank either. Would it be a good strategy to only redirect all the blog posts (which have natural links pointing to them) to the new website and not the sales pages? 4. The homepage has a mix of spam and very good editorial links. If I have disavowed links and domains, can I safely redirect this page?
Technical SEO | | designquotes0 -
Blog separate from Website
One of my clients has a well established website, and a well established blog - each with its own domain. Is there any way to move the blog to his website domain without losing the SEO and links that he has built up over time?
Technical SEO | | EchelonSEO0 -
Author Mark on multiple websites - Is this possible?
Let's assume that someone has a blog and they've added the author tag to that so they appear in author search. Let's say they then write an article on another site? Can that site use the same author mark for them? I guess the question is: Can the same author mark be used across multiple sites?
Technical SEO | | PhoenixLander0