Measuring the size of a competitors website?
-
I think our website is too big, far too many indexed pages. I'd like to do some research on how big our competitors' websites are (how many indexed pages). Is there a way to do this?
Cheers,
Rhys
-
Thanks, both!
-
Xenu's Link Sleuth is free so you may want to check that out (not sure just now whether there are any limits with regard to website size) but I also recommend Screaming Frog - it's money well-spent, such a feature rich tool!
-
I highly recommend buying the license for Screaming Frog, at $100/year, you won't find a more valuable SEO tool for the money. You won't find a free (and trustworthy) that will crawl a site that large.
-
Hi Alick,
I tried that but I only have the free version so we're capped at 500 URLs. Also, the site:search provided 50,000 results, but I know we don't have that many pages. Are there any other tools?
Cheers,
Rhys
-
Hi,
Do a site: search on Google itself - like "site:google.com" - to return pages of SERPs containing the pages from your competitors site which Google has indexed.
I would also suggest you use screaming frog tool you will get more accurate value here.
Hope this helps.
Thanks
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Multiregional SEO - different website designs
Hello, when it comes to location & language targeting, is it possible to have different website page designs for their respective regions? So let's say we have one design for www.example.com/product-1 and a completely different design for www.example.com/us/product-1? Our branding is different for the US so would ideally like to use specific US designs for US pages. Thanks,
Technical SEO | | SEOCT0 -
New website - not showing in Google?
This site was launched 3 days ago, bimcosupply.com and I'm trying to get it to show in Google just for a branded search for the moment (Bimco, Bimco Corporation, etc). The old site is still showing in search, bimcoplumbingsupplies.com instead. This site was taken down a while back. I set up a redirect for the domain in cPanel, and also set individual pages to redirect in WordPress on the bimcosupply.com site. I've verified the site in Google Search Console, submitted a sitemap and did URL inspection on each page. Each page is showing as indexed, though now when I search site:bimcosupply.com not all pages are there, and there are two results for the home page, one "https" and one "http." (Before today, all of the pages were showing so not sure what changed). I know this new domain does not have any (or very little) domain authority yet, but I would have thought that the site should display for branded search by now. So I'm concerned that something is wrong with the site, how the redirects are set up, etc. that is preventing it from displaying. Could anyone take a look and help me figure this out please?
Technical SEO | | browncreative0 -
Website analysis for SEO
Hi, We have been trying to gain ranking for 7 keywords for a year now but have been unsuccessful We are not sure where we are going wrong, if someone could please help us out, we are happy to pay for your time.
Technical SEO | | mframing0 -
Our Website Get too many visits from this IP ?
Hi, We get alot of visits from this IP below... Whats this ? | Host Name: | google-proxy-66-249-85-8.google.com | Browser: | IE 8.0 |
Technical SEO | | Asjad
| IP Address: | 66.249.85.8 — [Label IP Address] | Operating System: | WinVista |
| Location: | Mountain View, California, United States | Resolution: | 1024x768 |0 -
301 redirect + new website copy
Hi There, We are currently redeveloping our website and we're rewriting and optimising our many of our service pages. I think I may already know the answer but should we apply 301 redirects from our old services pages to the new versions? The content subject matter will be the same on the new versions, they will just be completely reworded. I would be interested to hear your views. Thanks, Stu
Technical SEO | | Stuart260 -
Some competitors have a thumbnail in Google search results
I've noticed that a few of my top competitors have a small photo (thumbnail) next to their listing. I'm sure it's not a coincidence that they are ranked top for the search phrase too. Is this really a help and how can it be done? Many thanks, Iain.
Technical SEO | | iainmoran0 -
When will seomoz rank my website?
Hi all, I am really excited to be here. I joined seo moz three weeks ago. Seo moz crawled my website twice and still under competitive domain analysis my domain authority is 1 and everything else underneath is zero. I fixed some errors and warning after first crawl but still nothing in root domain metrics. Can anyone please explain whats happening? Thank you!
Technical SEO | | proaspirant0 -
Resurrecting a heavily duplicated Joomla website.
The site in question is stanwix.info. I set this up years ago as a community project before I had even heard of seo. It carries quite a bit of content but has appallingly "SEO Unfriendly" URLs some content is recorded as duplicate 3 or more times because of these dynamic URLs according to the crawl statistics returned by SEO Moz. Currently it ranks well for the keyword stanwix - not too surprising as the only significant local competition is a large commercial holiday complex located several miles away out on the coast. As a sort of showcase, I have been trying to come up with a strategy to re-optimise stanwix.info so that it can outdo the commercial site stanwix.com I am pretty sure that step 1 involcves upgrading from the current archaic version of Joomla to the latest release even though that will break some of the modules currently installed. My pal who actually coded the site did a fair bit of hacking of the modules to get them to work properly. OR do I simply bin it and start a fresh site consigning years worth of community content to the darkness and replace with fresh material - I'm not keen on this option as I have put a lot of heart and soul into this project. I am in a quandary here as the problems are so numerous that whatever I do will break the site for some time. The reason I want to keep the site is because the business directory provides a useful locally relevant source of links for other clients and I am also going to set up a separate website for the community centre on a subdomain - this time running in wordpress which I do have a fair bit of experience with. Your advice for my addled brain would be much appreciated.
Technical SEO | | SkiBum0