Screaming frog, Xenu, Moz giving wrong results
-
Hello guys and gals,
This is a very odd one, I've a client's website and most of the crawlers I'm using are giving me weird/ wrong results.
For now lets focus on screaming frog, when I crawl the site it will list e.g. meta titles as missing (not all of them though), however going into the site the title is not missing, and Google seems to be indexing the site fine. The robots.txt are not affecting the site (I've also tried changing the user agent).
The other odd thing is SF gives a 200 code but as a status tells me "connection refused" even though it's giving me data.
I'm unable to share the clients site, has any one else seen this very odd issue? And solutions for it?
Many thanks in advanced for any help,
-
Thanks Dan!
-
^ That's customer service!
-
Cheers for the tweet Andy.
Chris, I'd recommend running through this list here in our FAQ -
http://www.screamingfrog.co.uk/seo-spider/faq/#17
In particular, I'd recommend reducing the crawl speed & adjusting the user-agent.
You can also pop it through to our support (http://www.screamingfrog.co.uk/seo-spider/support/) & we can advise. All confidential etc.
Cheers
Dan
-
I have shared this question with Dan from Screaming Frog for you
-Andy
-
Hi Chris
This is hard to answer without an example - do you have a URL or two that you can share with the community?
Thanks so much!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Moz Pro crawl signaling missing canonical which are not?
Hi,
Moz Pro | | rolandvintners
I'm trying MozPro considering using it.
One of the tool which is appealing is the crawl and insights.
After quick use, I really question many of the alerts, for instance, I got a "missing canonical tag" on this url: https://vintners.co/wine/grawu_gto#2020 but when I check my markup, there's clearly a canonical tag: <link rel="canonical" href="https://vintners.co/wine/grawu_gto"> Anybody can explain?
I asked Moz Pro staff when being onboarded but didn't get an answer...
Honestly, I'm questioning the value of these crawls, or may be I miss something?0 -
Moz Crawl Test error
Moz crawl test show blank report for my website test - guitarcontrol.com. Why??? Please suggest.
Moz Pro | | zoe.wilson170 -
Poor quality PDF exports from analytics.moz.com
The new reports look great http://analytics.moz.com/dashboard/overview/ But when I export to PDF, the text is low quality and images are low quality. Not as good as the old report. In fact, the PDF is such low quality we are not providing them to our customers. We're using the old reports. ETA for HQ PDF Export please?
Moz Pro | | OPUS-Cambodia0 -
On Moz and Google analytics are showing high numbers of unknown searches.
Its getting to be 40% to 60%. Clients ask what that is and why Data Not Provided Best answers please and any advice welcome
Moz Pro | | BraveThinking0 -
Moz crawl only shows 2 pages, but we have more than 1000 pages.
Hi Guys Is there anyway we can test Moz crawler ? it showing only 2 pages crawls. We are running website on HTTPS ? Is HTTPS is issues for Moz ?
Moz Pro | | dotlineseo0 -
Moz is incorrect
So i have had my latest crawl, and the keyword report is showing that using google.co.uk i have some keywords not within the top 50 - i have just done a spot check (coping & pasting) direct from Moz to google.co.uk and out of 4 i have checked 1 keyword i am number 4 and 1 keyword i am page 3 - therefore within the top 50. This leads me to believe that there is something wrong with Moz - here is 1 example "land in the cayman islands" i am showing in moz as not in the top 50 when i am showing on Google as number.4
Moz Pro | | OasisLandDevelopment0 -
GWT data v SEO Moz data
I'm sure there's a simple explanation but I can't find it- Looking through the GWT avg position data v SEOMoz ranking data and Market Samurai data there is a large discrepancy. For one term that we hold #1, and have held for a month or two GWTis showing that the avg position is 180 (and down 30). Any reason you know of why the GWT avg position data would be so out of whack with our SERP's and other data? Thanks.
Moz Pro | | MrPaulB0 -
Is there a beginners guide to using the tools and what do the results mean.
Great set of tools! But what would make them better is some type of guide to what the tools do (remember I am a new user) and how to maximize the results. Oh and while your at it what do the results mean.
Moz Pro | | marcreece0