How to find 20 hidden 404s
-
Hello,
We have like twenty 404s left to find. How do you find these when:
1. They don't show up in Google Webmaster Tools
2. They don't have any other internal or external pages linking to them.
3. They don't show up in site:domain.com (We have 9000 pages and only 600 show up - I fixed those out of the 600).
4. They are probably causing high bounce rates.
5. They're not in the sitemap
Thanks!
-
You should be able to crawl the entire site without increasing the RAM, once you buy the paid version.
-
Right in the paid version wont stop! You can see in their website that the limit of urls will be remove once you buy the license. http://www.screamingfrog.co.uk/seo-spider/licence/
It should catch everything, maybe you can contact their support just to make sure, they are very good on support over twitter.
-
Yes, but if it only check 397 in the free version is it going to stop there in the paid version as well. Just making sure.
Also, will it catch everything?
-
Yes I just run a craw for 500 000 urls
-
The free version checked 397 URLs. Will the purchased version check all 9000?
-
You can try crawl the site using screamingfrog, make sure you check the box “Check Links Outside Folder” in the spider menu.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Sudden downfall of the results, intelligents can easily find the solution
Dear, previously my site got top rank results (first place in first page) for 1. "Vastu" (Landing page: https://www.subhavaastu.com/vastu.html) 2. "Vaastu" (Landing page: https://www.subhavaastu.com/vaastu.html) 3. "Vastu shastra" (Landing page: https://www.subhavaastu.com/about-vastu-shastra.html). 4. "Vastu Consultant", (Landing page: https://www.subhavaastu.com) Previously say about 4/5 years back, I got only 1/2 place in google for the above keywords. Now my site is not visible for the said above keywords. But for these below keywords I am getting very good rankings 5. "Vasthu" (Landing page: https://www.subhavaastu.com/vasthu.html) (3 rd position in first page) 6. "Vaasthu" (Landing page: https://www.subhavaastu.com/vaasthu.html) (2nd position in first page) I got good improvements with my attemps. Require to get again first page first rank for these keywords. Vastu, Vaastu, Vastu shastra, vastu consultant. Anybody can help please.
Intermediate & Advanced SEO | | SubhaVaastu0 -
How to find the supporting topics to talk about ?
Hello, How do I figure out which supporting topics to talk about in my content ? Are the supporting topics the questions people have ? Do I find those in the keyword tool ? Thank you,
Intermediate & Advanced SEO | | seoanalytics0 -
Best practice to redirect all 404s?
Hey is it best practice to redirect all 404 pages. For example if the 404 pages had 0 traffic and no links why would you need to redirect that page? Isn't it best practice just to leave as a 404? Cheers.
Intermediate & Advanced SEO | | kayl870 -
How to find all 404 deadlinks - webmaster only allows 1000 to be downloaded...
Hi Guys I have a question...I am currently working on a website that was hit by a spam attack. The website was hacked and 1000's of adult censored pages were created on the wordpress site. The hosting company cleared all of the dubious files - but this has left 1000's of dead 404 pages. We want to fix the dead pages but Google webmaster only shows and allows you to download 1000. There are a lot more than 1000....does any know of any Good tools that allows you to identify all 404 pages? Thanks, Duncan
Intermediate & Advanced SEO | | CayenneRed890 -
How to Find Competitors Traffic Sources
Is it possible to find out where traffic is coming from on someone else website?
Intermediate & Advanced SEO | | Hall.Michael0 -
What strategies can you use when you're optimizing for 10 locations x 20+ services?
We have a client site (a dentist) that has 10 locations and 20+ services (braces, teeth whitening, cosmetic dentistry, etc, etc.). We're trying to figure out the ideal approach to optimally cover all their locations and services, but each option we consider has drawbacks: Optimize service pages for service name + each location name (or at least the biggest location names), with service name and location names in the title tag. That results in a too long title tag, plus possible user confusion, since they are searching for "braces richmond" but the title tag lists other cities, some of which are in a different state. Optimize service pages for service name + each location name, but don't include the locations in the page title. This is the current option being used, but it appears to be hurting the rankings at least a bit not having the location name in the page title. Create a page for each service + location combo. That will be 200+ pages, which will mean the pages will be deeper in the site, with less link juice. Create new domains for each location/state covered. But then we have to start over building link juice. How have other sites dealt with this? What has worked best and what hasn't worked?
Intermediate & Advanced SEO | | AdamThompson2 -
Cannot find reason for drop in ranking
One of our clients is a lingerie retailer, that also sells swimwear and nightwear. They have a webshop, with landing pages such as /lingerie, /swimwear and /nightwear (only in Dutch). The nightwear page is doing ok (#5 in Google NL), but for the swimwear and lingerie pages, something strange has happened and I have no clue what it is. On May 7, the /swimwear page ranked 24 for swimwear in Google NL. In that period, the homepage was ranking at #40-50. One week later, on May 14, the homepage was ranked 24 for swimwear, and the /swimwear page was nowhere to be found. The homepage is currently ranking 17/18 for swimwear. Something similar seems to have happened for lingerie. The homepage was ranking at around 11-13 for a few weeks in April/May, the /lingerie page was ranking at 8 in May, and then after the 4th of June, both the homepage and the /lingerie page no longer seem to have any decent rank for lingerie. So, trying to find the problem: I checked the Moz On-Page Grader for all three pages/keywords. All pages get an A. Robots.txt hardly contains anything, and there's no robots meta tag to block the page. Checked Google Webmaster Tools just in case, nothing out of the ordinary. The page contains 342 URL's which is a lot, but that shouldn't be too problematic, I thought? I used the Moz Keyword Difficulty Tool to analyze the current top 10 for lingerie, and compared it to our client's stats. Page Authority in the top 10 is 37-68, our clients is 33. Domain Authority in the top 10 is 27-100 (wiki page), our clients is 43. MozRank for the top 10 is 6,6-8,0, our clients is 6,7. MozTrust for the top 10 is 7,0-7,1, our clients is 7,0. The basics all look fine! Now, the page could use some link building, the number of links is a little low compared to the top 10 entries. We're also in the process of redesigning the page, adding more products but also more content (text and images) to inspire visitors a little more. But being low on links doesn't seem a good explanation for such a relatively sudden change in ranking. As far as we can tell, looking back at commits by our developers, nothing changed around that time that could have this impact. Of course it's possible that we missed something, we're still looking. Also, it's strange that these sudden changes took place for swimwear and especially lingerie, but not for nightwear. I'd really appreciate any tips, hints etc. to find out what's going on here. Thanks in advance! Michel
Intermediate & Advanced SEO | | DocdataCommerce0 -
How else to find backlinks for training site
Hello, How would you recommend finding and gaining backlinks for nlpca(dot)com other than looking at the top 10 competitors? Also, we could do an infographic but the owners don't have time to produce a lot of additional articles. Thanks!
Intermediate & Advanced SEO | | BobGW0