Who wants to help go over my crawl diagnostics via skype?
-
I have run a crawl diagnostic on my site and have 194 errors and most of them are 404 errors in wordpress. Not sure why, but many of my pages had name changes (possibly a permalinks issue) but I have no idea how to fix it.
- I had 5 duplicate page titles, and 1 tile missing or empty.
- 72 crawl notices found (2 permanent redirect, 17 blocked by robots, 53 rel canonical)
- 19 Crawl warnings were found
Who wants to have some fun?
-
Alright. Having over 100 errors and warnings had me worried. Sounds like its not that big of a deal. I did notice some issues where it looks like my blog page and some other pages are not being indexed. Any insight on this?
-
Your site seems to be in decent shape, based on the screaming frog crawl i ran
- You've got 2 internal 404 errors due to erroneous links you placed in the code probably
- your dupe titles don't look like they're a problem - canonical and no index tags seem to have sorted the issue
- page with a missing title is .php?Action=sitemap - doesn't seem to be the end of the world
The spider follows robots.txt
All in all, I wouldn't worry bout the warnings.
Mark
-
http://starkseo.com/downloads/
my skype is dfwnerdherd
-
Instead of Skype, why don't you download the PDF and upload it to your server, and then share the link. I'd like to take a look.
-
Zack, what's your site? I can run it through Screaming Frog and take a look at the sources for the 404 errors, and export the data for you, so you'll be able to go in and fix the links.
-
Hi Zack,
Have you checked out our Help Hub, where we have a lot of information about the Crawl Diagnostics tool and a video that walks you through it some of the features?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why my site not crawl?
hi all me allow rogerbot in robots.txt but rogerbot can't crawl my site my site: toska-co.ir
Moz Pro | | jahanidawodi0 -
Site Crawl 4xx Errors?
Hello! When I check our website's critical crawler issues with Moz Site Crawler, I'm seeing over 1000 pages with a 4xx error. All of the pages that are showing to have a 4xx error appear to be the brand and product pages we have on our website, but with /URL at the end of each permalink. For example, we have a page on our site for a brand called Davinci. The URL is https://kannakart.com/davinci/. In the site crawler, I'm seeing the 4xx for this URL: https://kannakart.com/davinci/URL. Could this be a plugin on our site that is generating these URLs? If they're going to be an issue, I'd like to remove them. However, I'm not sure exactly where to begin. Thanks in advance for the help, -Andrew
Moz Pro | | mostcg0 -
Is it possible to block Moz from crawling sites?
Hi, is it possible to stop Moz from crawling a site at the server level? Not that I am looking to do this or anything, but here's why I'm asking. I have been crawling a site that is managed (currently by 2 parties), and I noticed that this week pages crawled went from 80 (last week) to 1 page!! I know, what? See my image attached... and the issues all went to zero "0"....! So is it possible that someone can't prevent Moz from crawling the site at the server level? I checked the robots.txt file on the site, but nothing there. I'm curious. dYNUwjd.jpg
Moz Pro | | co.mc0 -
Ajax4SEO and rogerbot crawling
Has anyone had any experience with seo4ajax.com and moz? The idea is that it points a bot to a html version of an ajax page (sounds good) without the need for ugly urls. However, I don't know how this will work with rogerbot and whether moz can crawl this. There's a section to add in specific user agents and I've added "rogerbot". Does anyone know if this will work or not? Otherwise, it's going to create some complications. I can't currently check as the site is in development and the dev version is noindexed currently. Thanks!
Moz Pro | | LeahHutcheon0 -
How I plan to go about getting business - what do you think?
I prepared a real professional looking website analysis packet. The emphasis is on it being VERY professional and classy, nothing cheesy about it. (If you want a copy send me a p.m. and I will email you one). It will take me about 8 minutes to look at their site and run it through a couple tools and and have a quick list of things that are missing. Another 10 minutes for my office manager to edit the template and print a good looking copy. My plan is to take out and deliver about 10 of these a day and call and follow up on them over the phone. My hope is that when they see the quality and professionalism of the report the chances are low it gets thrown in the trash and when I call I have a REASON to call and not some random idiot cold calling. **What do you think? Any suggestions? ** I have a lot of sales background and don't mind talking to people and I know the key will be in FOLLOWING UP which is what MOST people are NOT willing or able to bring themselves to do. I realize that giving away a 'free' report may devalue what I have to offer in some peoples minds...... thought about that. I am just getting started and only have a few clients but I HAVE produced great things for those few but I need to get the ball rolling a little quicker. Thanks for weighing in with your two cents! 🙂 Have an AWESOME week! Matthew
Moz Pro | | Mrupp440 -
Crawl reports, date/time error found
Hello! I need to filter out the crawl errors found before a certain date/time. I find the date and time the errors were discovered to be the same. It looks more like the time the report was generated. Fix?
Moz Pro | | AJPro0 -
Websites First Crawl - Over 2 Hour Suggested Wait
Hello SEOMoz! We recently signed up for a free trial and on the pro dashboard it states the following. "To get you started quickly Roger is crawling up to 250 pages on your site. You should see these results within two hours. The full crawl will complete within 7 days." It's been nearly 24 hours and we see no results under Crawl Diagnostics however we do under rankings. Is this normal? Thanks
Moz Pro | | hostsurfuk0 -
Initial Crawl Questions
Hello. I just joined and used the Crawl tool. I have many questions and hoping the community can offer some guidance. 1. I received an Excel file with 3k+ records. Is there a friendly online viewer for the Crawl report? Or is the Excel file the only output? 2. Assuming the Excel file is the only output, the Time Crawled is a number (i.e. 1305798581). I have tried changing the field to a date/time format but that did not work. How can I view the field as a normal date/time such as May 15, 2011 14:02? 3. I use the ™ symbol in my Title. This symbol appears in the output as a few ascii characters. Is that a concern? Should I remove the trademark symbol from my Title? 4. I am using XenForo forum software. All forum threads automatically receive a Title Tag and Meta Description as part of a template. The Crawl Test report shows my Title Tag and Meta Description as blank for many threads. I have looked at the source code of several pages and they all have clean Title tags and I don't understand why the Crawl Report doesn't show them. Any ideas? 5. In some cases the HTTP Status Code field shows a result of "3". Why does that mean? 6. For every URL in the Crawl Report there is an entry in the Referrer field. What exactly is the relationship between these fields? I thought the Crawl Tool would inspect every page on the site. If a page doesn't have a referring page is it missed? What if a page has multiple referring pages? How is that information displayed? 7. Under Google Webmaster Tools > Site Configurations > Settings > Parameter Handling I have the options set as either "Ignore" or "Let Google Decide" for various URL parameters. These are "pages" of my site which should mostly be ignored. For example a forum may have 7 headers, each on of which can be sorted in ascending or descending order. The only page that matters is the initial page. All the rest should be ignored by Google and the Crawl. Presently there are 11 records for many pages which really should only have one record due to these various sort parameters. Can I configure the crawl so it ignores parameter pages? I am anxious to get started on my site. I dove into the crawl results and it's just too messy in it's present state for me to pull out any actionable data. Any guidance would be appreciated.
Moz Pro | | RyanKent0
