Screaming frog, Xenu, Moz giving wrong results
-
Hello guys and gals,
This is a very odd one, I've a client's website and most of the crawlers I'm using are giving me weird/ wrong results.
For now lets focus on screaming frog, when I crawl the site it will list e.g. meta titles as missing (not all of them though), however going into the site the title is not missing, and Google seems to be indexing the site fine. The robots.txt are not affecting the site (I've also tried changing the user agent).
The other odd thing is SF gives a 200 code but as a status tells me "connection refused" even though it's giving me data.
I'm unable to share the clients site, has any one else seen this very odd issue? And solutions for it?
Many thanks in advanced for any help,
-
Thanks Dan!
-
^ That's customer service!
-
Cheers for the tweet Andy.
Chris, I'd recommend running through this list here in our FAQ -
http://www.screamingfrog.co.uk/seo-spider/faq/#17
In particular, I'd recommend reducing the crawl speed & adjusting the user-agent.
You can also pop it through to our support (http://www.screamingfrog.co.uk/seo-spider/support/) & we can advise. All confidential etc.
Cheers
Dan
-
I have shared this question with Dan from Screaming Frog for you
-Andy
-
Hi Chris
This is hard to answer without an example - do you have a URL or two that you can share with the community?
Thanks so much!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is there a tool on Moz or out on the internet that does bad link checker
I'm still pretty new to this and I was wondering if there is a free software, one of Moz or free out on the the internet that allows you to check bad links. I've done a lot of link building with citations and directories that for my clients industry. I just don't want to add their website and profile to a bad/risky directory and it penalizes my clients. I've seen a few out there, but I need one that is respectable and reliable. Any suggestions? I found one called bad neighborhood http://www.bad-neighborhood.com/text-link-tool.htm. Thanks Again, Benny
Moz Pro | | ACann0 -
Best Way to Seemlessly Use Moz and Google Analytics
Hi All, I have Moz Pro and I am beginning to explore Moz Analytics. I currently use Google Analytics for pretty much everything and I am almost at expert level at using the GA interface so I'm ready to learn a new tool and have a second source of data! My question is: what's the best way to get the most of Moz Analytics and GA congruently? Off hand I know that Moz's keyword, rank, and link data, including competitive insights, is more comprehensive than GA. But how else can I use Moz and get the most out of the Moz Analytics? Looking to really dive in and discuss how we can make use of both! Thanks - Vee
Moz Pro | | Symmetri0 -
Do I need a new moz campaign for a subdomain?
Will moz automatically track my new subdomain or do I need to set up a new campaign for it?
Moz Pro | | SamCUK0 -
On page analysis showing old results
Hi, My on page crawl analysis is showing that I have 38 duplicate content issues. These issues are because we had used tags in our blog. We remove all the tags 10+ day ago but the crawl that was done 5 days ago is still showing the tags as causing a duplicate content issue. Why would this be? We cannot correct is as it is already corrected. How do we get moz to crawl the correctly? Thanks Andrew
Moz Pro | | Studio330 -
Is SeoMOZ Crawl Diagnostics wrong here?
We've been getting a ton of critical errors (about 80,000) in SeoMoz' Crawl Diagnostics saying we have duplicate content in our client's E-commerce site. Some of the errors are correct, but a lot of the pages are variations like: www.example.com/productlist?page=1 www.example.com/productlist?page=2 However, in our source code we have used rel="prev" and rel="next" so in my opinion we should be alright. Would love to hear from you if we have made a mistake or if it is an error in SeoMoz. Here's a full paste of the script:
Moz Pro | | Webdannmark0 -
Why am I getting different ranking results on Google?
Because the rank checker on SEOMOZ is temporarily down for upgrade, I followed the link over to the other suggested rank checker on seobook.com which installs a plug-in to Firefox and it seems to be working fine….BUT my question is when I check out my two highest traffic keywords which are “Whitby holiday cottages” and “Whitby cottages” against my website www.endeavourcottage.co.uk it tells me I'm ranking position 2 on both Google.com and Google.co.uk but I don't think I am. When I do the same check using a proxy server called hidemyass.com to check my rankings again on Google.co.uk and .com I appeared to be lower down the rankings like position 8. Does anyone have any idea of which is the accurate reference to my rankings? What do you do to check your rankings ? And one last quick secondary question is when I searching Google chrome using same key words again I come at the top position A on the Google maps listing but using Firefox or Internet Explorer there is no Google maps visible ways that? At the end of the day out rankings are important but where are working towards more traffic...... Cheers
Moz Pro | | whitbycottages0 -
Has anyone noticed that there are no local results in their keyword rankings?
Is anyone else having this issue? The universal rankings are not populating in my keyword rankings tool for any of my clients. Is this something that SEOmoz changedrecently?
Moz Pro | | TippingPointMedia0 -
Filtering OSE Results
Issue: When I export OSE Linking Pages results to .CSV, I'd like to filter only unique domains. It seems to me that there should be a way to do this with Excel, perhaps pivot table. Anyone have a quick solution for this? Alternatively, I can use Linking Domains, which gives all unique roots, but then i lose follow/nofollow filter. Thoughts?
Moz Pro | | Gyi0