Measuring the size of a competitors website?
-
I think our website is too big, far too many indexed pages. I'd like to do some research on how big our competitors' websites are (how many indexed pages). Is there a way to do this?
Cheers,
Rhys
-
Thanks, both!
-
Xenu's Link Sleuth is free so you may want to check that out (not sure just now whether there are any limits with regard to website size) but I also recommend Screaming Frog - it's money well-spent, such a feature rich tool!
-
I highly recommend buying the license for Screaming Frog, at $100/year, you won't find a more valuable SEO tool for the money. You won't find a free (and trustworthy) that will crawl a site that large.
-
Hi Alick,
I tried that but I only have the free version so we're capped at 500 URLs. Also, the site:search provided 50,000 results, but I know we don't have that many pages. Are there any other tools?
Cheers,
Rhys
-
Hi,
Do a site: search on Google itself - like "site:google.com" - to return pages of SERPs containing the pages from your competitors site which Google has indexed.
I would also suggest you use screaming frog tool you will get more accurate value here.
Hope this helps.
Thanks
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does my website builder/host have an effect on my SEO?
My SEO ranking has been suffering over the last year despite all my efforts. Do you think my website builder/host could negatively effect my SEO? I'm using something called jigsy. They seem really good in the sense that they are very responsive to requests for help, but I have found them to be limiting at times.
Technical SEO | | joebordersmft
I cant:
-edit H1 and H2 tags on individual pages...the same ones are plastered throughout the site as part of a "theme"
-Do any link cannonicalization, which Moz Pro is marking me with 282 critical issues for.
-and I've had numerous times I've had to search out HTML code to paste into my page because they're missing something. ...I may have just answered my question myself, but I'm wondering how much of a problem all of this might be for my SEO? I was looking at switching to something like squarespace recently but it looks like Jigsy has thought of that and doesn't have any way for me to transfer my site to another service..... ugh! site:www.joeborders.com1 -
When do I change out my meta tags after a full website revamp?
We're creating a new version of our entire website - look and feel is completely different, though core functionality and results are the same. Just cleaner, faster.. etc. We're doing a temp redirect to the temporary url for testing and to slow roll the release to some of our users for a more friendly approach. Eventually, the new look and feel will be under the original url. I've researched best practices for the site transfer, including "make sure the meta tags for title and description are exactly the same". The concern I have is that Moz Analytics is detecting a lot of errors in the existing meta tags. They're too long, have changed and become inconsistent after being passed through different hands, & some have some keyword stuffing in there. I have plans to change them out and really clean them up... I'm just wondering, when is the best time to do that? Since the tags are bad, should I just do it now but make sure that the old and new are matching? Or should I wait (and for how long?) after the new site is switched over and everything is on the original URL?
Technical SEO | | SFMoz0 -
HUGE decrease in links since website redesign
We recently added several new pages pages to our website. These new pages were constructed on a dev site, and then pushed live. Since the new site has gone live I have seen a huge decline in links. My external followed links have dropped from 3000 to 500 and my total website links have fallen from 35,000 to 4,500. I have done some research, and I think there is a server side issue. Where multiple versions of my URL may be running. The majority of the links built were pointing to the homepage. That being said I do not have access to our in-house dev person this week, so I am trying to identify the problem myself. I have used screaming frog to crawl my site and did not see any errors which stand out. I realize I probably need to use 301 redirects to solve this problem, I just need some guidance on how to identify what I need to 301 redirect. Second question. If I move a landing page out of the global navigation but it can still be reached through other pages on the website , will this cause issues?
Technical SEO | | GladdySEO0 -
Website not ranking for noncompetitive terms
Hi, We've took over a website last July and no matter what we do we just can't get it ranking in Google, even for noncompetitive terms. here is the website in question: http://www.alignandsmile.co.uk Ideally the client would like to rank for Canary Wharf but that location is competitive, the site doesn't even rank for 'Dentist New Providence Wharf E14' despite it being included in the title tag on the home page and in the content throughout the website. Directories with Align and Smile's business information do rank however. I opened a case with google through Webmaster tools and they 'reviewed your site and found no manual actions by the webspam team that might affect your site's ranking in Google.' So I'm a bit stuck. The site ranks top for the keyphrase in Bing and Yahoo...we are really struggling with Google! Any help would be much appreciated. many thanks Marcus
Technical SEO | | dentaldesign0 -
2 websites 1 Google account?
quick question, I have set up my second website purely for seasonal stock so getting it online early ready for when the time is right. But i only have a single web master tools & ad words account, would there be any problem with the single accounts having the details for both websites? or would it be wise to have separate accounts for each site?
Technical SEO | | GarethEJones0 -
2 similar websites targetting different countries
I have a website that has a .com.au extension running on zencart. If I load up the exact same wesbite (with the same website name) on the .com, will my .com.au be penalised by Google? Thanks in advance.
Technical SEO | | theshining0 -
Generating a Sitemap for websites linked to a wordpress blog
Greetings, I'm looking for a way to generate a sitemap that will include static pages on my home directory, as well as my wordpress blog. The site that I'm trying to build this for is in a temporary folder, and can be accessed at http://www.lifewaves.com/Website 3.0 I plan on moving the contents of this folder to the root directory for lifewaves.com whenever we are go for launch. What I'm wondering is, is there a way to build a sitemap or sitemap index that will point to the static pages of my site, as well as the wordpress blog while taking advantage of the built in wordpress hierarchy? If so, what's an easy way to do this. I have generated a sitemap using Yoast, but I can't seem to find any xml files within the wordpress folder. Within the plugin is a button that I can click to access the sitemap index, but it just brings me to the homepage of my blog. Can I build a sitemap index that points to a sitemap for the static pages as well as the sitemap generated by yoast? Thank you in advance for your help!! P.S. I'm kind of a noob.
Technical SEO | | WaveMaker0 -
How do you measure content on a website?
I never thought of this question before. Maybe because i didn't focus myself on content but only on optimizing existing content from clients. So how do you measure the content on a specific page?
Technical SEO | | mosaicpro0