500 and 508 pages?
-
Hi we just did a massive deepcrawl (using the tool deepcrawl.co.uk/) on the site: http://tinyurl.com/nu6ww4z
http://i.imgur.com/vGmCdHK.jpg
Which reported a lot of URLs as either 508 and 500 errors.
For the URLs as reported as either 508 or 500 after the deep crawl crawl finished we put them directly into screaming frog and they all came back with status code 200.
Could it be because Deep Crawl hammered the site and the server couldn't handle the load or something?
Cheers, Chris
-
Could it be because Deep Crawl hammered the site and the server couldn't handle the load or something?
Correct.
The server reached its max resource limit. Try to set a longer delay on requests, if this is a setting in deepcrawl.co.uk?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Product page as homepage
Hello, Is it ok that to use the homepage of website as a product page directly where you present all your products on your homepage or can it penalise you to do that ? and in that case, is it better to have a homepage that you don't rank and create a subpage for your product page. Thank you,
Intermediate & Advanced SEO | | seoanalytics1 -
What are best page titles for sub-domain pages?
Hi Moz communtity, Let's say a website has multiple sub-domains with hundreds and thousands of pages. Generally we will be mentioning "primary keyword & "brand name" on every page of website. Can we do same on all pages of sub-domains to increase the authority of website for this primary keyword in Google? Or it gonna end up as negative impact if Google consider as duplicate content being mentioned same keyword and brand name on every page even on website and all pages of sub domains? Thanks
Intermediate & Advanced SEO | | vtmoz0 -
Possible to Improve Domain Authority By Improving Content on Low Page Rank Pages?
My sites domain authority is only 23. The home page has a page authority of 32. My site consists of about 400 pages. The topic of the site is commercial real estate (I am a real estate broker). A number of the sites we compete against have a domain authority of 30-40. Would our overall domain authority improved if we re-wrote the content for several hundred of pages that had the lowest page authority (say 12-15)? Is the overall domain authority derived by an average of the page authority of each page on a domain? Alternatively could we increase domain authority by setting the pages with the lowest page authority to "no index". By the way our domain is www.nyc-officespace-leader.com Thanks, Alan
Intermediate & Advanced SEO | | Kingalan10 -
Role of Home Page Text
My company operates a commercial real estate web site in New York City. We are competing against brands that can spend hundreds of thousands of dollars per year on marketing and SEO. I am an independent without employees. I am trying to replace generic home page text (my web site is ww.nyc-officespace-leader.com) with more engaging language that will differentiate the site. In terms of SEO best practices, what constraints exist on home page text? Must it discuss the brand in a general way? Must it specifically describe the interior pages of a site? For new home page text, I wanted to take a practical approach and provide visitors with a checklist that would be useful for their search. The check list would be in the form 500-800 words or very practical advice, specific items they should be aware of before commencing a real estate search. No other site is taking this approach and it could save tenants time and grief. I am attaching a very rough mock up of the new text (forgive the grammar, really needs to be edited!). Is there any thing wrong with this approach? I may have stumbled on a good idea, however maybe nobody has taken this route because it is inappropriate for a home page. I would very much appreciate any comments or guidance anyone may have. Best, Alan Rosinsky 0d76Iv2
Intermediate & Advanced SEO | | Kingalan10 -
Tips for improving this page
I have made a content placeholder for a keyword that will gain significant search volume in the future. Until then I am trying to optimize the page to rank when the game launches and the keyword gains volume. http://hiddentriforce.com/a-link-between-worlds/walkthrough/ Is there anything I can do to improve the optimization for the phrase 'a link between worlds walkthrough' A lot of my competitors are already setting up similar placeholder pages and doing the same thing. I have 2 fairly large gaming sites that will place a banner for my walkthrough on their site. I did not pay for the links. I do free writing/ other services in exchange for this. I have been sharing the link socially. It has almost 200 likes and a handful of shares, tweets, g+ votes
Intermediate & Advanced SEO | | Atomicx0 -
Page not appearing in SERPs
I have a regional site that does fairly well for most towns in the area (top 10-20). However, one place that has always done OK and has great content is not anywhere within the first 200. Everything looks OK, canonical link is correct, I can find the page if I search for exact text, there aren't any higher ranking duplicate pages. Any ideas what may have happened and how I can confirm a penalty for example. TIA,
Intermediate & Advanced SEO | | Cornwall
Chris0 -
How Bad is it to Not Have a Home Page?
The site I'm currently developing is far different than any other project I've every worked on in that search traffic is likely to represent only a very small percentage of the total traffic. Because of this, I want to make sure I optimize the site for the people clicking from Facebook, Twitter, Reddit, etc more so than the BIG G. I can't for the life of me think of a reason to have a home page other than for SEO purposes. I'd much rather throw the user directly into the experience than have him be distracted by a home page. At the same time, I'd like to salvage any search engine traffic that I can. My plan is to 301 redirect chucklebot.com/ to /funny-memes/SOME_RANDOM_IMAGE and then put the content of the current home page at /about. Does that kill any possibility of the site ranking well? Or can the subpages (eg /meme-generator) still rank well if they are properly optimized? Thanks!
Intermediate & Advanced SEO | | PatrickGriffith0 -
Whats the point of a landing page?
I thought it is best to use your current site and build a new page targeting 2-3 key phrases max. Lets say I have a current site that is ranking for a few keywords, why would I build a landing page when I can just add a page to my site and target those same exact keywords?
Intermediate & Advanced SEO | | SEODinosaur0