Screaming frog, Xenu, Moz giving wrong results
-
Hello guys and gals,
This is a very odd one, I've a client's website and most of the crawlers I'm using are giving me weird/ wrong results.
For now lets focus on screaming frog, when I crawl the site it will list e.g. meta titles as missing (not all of them though), however going into the site the title is not missing, and Google seems to be indexing the site fine. The robots.txt are not affecting the site (I've also tried changing the user agent).
The other odd thing is SF gives a 200 code but as a status tells me "connection refused" even though it's giving me data.
I'm unable to share the clients site, has any one else seen this very odd issue? And solutions for it?
Many thanks in advanced for any help,
-
Thanks Dan!
-
^ That's customer service!
-
Cheers for the tweet Andy.
Chris, I'd recommend running through this list here in our FAQ -
http://www.screamingfrog.co.uk/seo-spider/faq/#17
In particular, I'd recommend reducing the crawl speed & adjusting the user-agent.
You can also pop it through to our support (http://www.screamingfrog.co.uk/seo-spider/support/) & we can advise. All confidential etc.
Cheers
Dan
-
I have shared this question with Dan from Screaming Frog for you
-Andy
-
Hi Chris
This is hard to answer without an example - do you have a URL or two that you can share with the community?
Thanks so much!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
moz crawl is stopped?
moz stopped indexing the links due to some updates? can some one confirm me thanks
Moz Pro | | 42409300125323700 -
Moz Pro
Anyone felt that moz pro isn't accurate like in search volume of products and links data that its slow in it?
Moz Pro | | apcreativity0 -
Moz says I am missing titles and meta tags and have duplicate content
I just redesigned my website and suddenly traffic has dropped. Moz says I am missing titles, meta tag descriptions and have a lot of duplicate content. My site is http://skigenie.com and is full of unique and hand written content,. Are there any wordpress plugins that will add titles etc to my pages (some of the added ones are custom)? Any help would be much appreciated!
Moz Pro | | flexy0 -
Moz scores
Hi All, Could anyone please explain for me why the moz scores that show under SERPs in Google search show one set of values, but when i click on the SERP listing and go to that page, the Moz scores at the bottom of the tab the page is open in are completely different. I.E - SERP result Wireless Alarms <cite>www.wireless-alarms.net/</cite>Honeywell, Friedland, Response, Wireless house home intruder burglar alarms and wirefree doorbells chimes and accessories.<iframe class="SEOmoz-iframe" src="chrome-extension://eakacpaijcpapndcfffdgphdiccmpknp/html/serpbar.html#{" settings":{"dmr":false,"dmt":false,"mr":true,"mt":true,"serp-overlay":true,"toolbar-enabled":true,"subdomain-metrics":false,"serp-panel-open":true,"toolbar-position":"bottom"},"lsdata":{"feid":3,"fipl":3,"fmrp":2.0446037910058426,"fmrr":5.396862303226778e-12,"ftrp":1.8723654310590483,"ftrr":9.21604483751679e-12,"fuid":3,"pda":8.903939958502189,"peid":3,"pid":3,"pmrp":1.6026230610187469,"pmrr":1.3566326316606153e-10,"ptrp":1.025503845909542,"ptrr":1.4972548621304158e-11,"puid":3,"ueid":2,"uemrp":2.577887966559377,"uemrr":5.40110633420739e-13,"uid":2,"uipl":2,"ujid":2,"umrp":2.577887966559377,"umrr":5.40110633420739e-13,"upa":23.634692786039714,"utrp":4.9331532541404854,"utrr":1.9684091945588755e-16},"user":{"level":"pro","options":{},"proenabled":true,"aclurl":"http:="" moz.com="" users="" level?src="mozbar","loginURL":"https://moz.com/login","logoutURL":"https://moz.com/logout","apiRequest":"url-metrics","cols":"133146078688","expired":false,"accessId":"pro-RGFkZHlTbXVyZg%3D%3D","expires":1374925378,"signature":"tBSBXpLbBmk073ofsfBwnilmODw%3D","displayName":"DaddySmurf"},"serp":4,"host":"www.wireless-alarms.net"}"" scrolling="no"></iframe> Page result <label>Page:</label><label id="Page Authority" class="key lsdata">PA:</label> <label id="SEOmoz-data-PA" class="val lsdata">27</label><label id="mozrank" class="key lsdata" title="MozRank">mR:</label> <label id="SEOmoz-data-mR" class="val lsdata">5.30</label><label id="moztrust" class="key pro-only lsdata" title="MozTrust">mT:</label> <label id="SEOmoz-data-mT" class="val pro-only lsdata">5.61</label><label id="SEOmoz-data-uid">1,950</label> links from
Moz Pro | | DaddySmurf
<label id="SEOmoz-data-uipl">2</label> Root Domains<label>Root Domain:</label><label id="dom-pageauthority" class="key lsdata" title="Domain Authority">DA:</label> <label id="SEOmoz-data-DA" class="val lsdata">24</label><label id="SEOmoz-data-puid">100,262</label> links from
<label id="SEOmoz-data-pid">3</label> Domains<label>Subdomain:</label><label id="SEOmoz-data-fuid">19,953</label> links from
<label id="SEOmoz-data-fipl">3</label> DomainsThank you.Si0 -
What did I do wrong? What did they do right?
I have only been here a little over a week so bare with me if I am out of protocol by asking this here if there is a more appropriate place for me to have done so. Anyhow, i own the domain www.lowloans.com and just a few months ago, this domain was ranked 1 on Google for the search term "low loans" and "lowloans" Now, that domain is nowhere to be found. I don't even know where to go to begin to work on this. With respect to the search lowloans, the sites that get top spot don't have a lot of info that I have been able to find that would help me better my position. I must be doing something wrong in my campaign as all of top 3 sites on google, don't rank within my campaign "rankings" report. Ugh. Where to start? Is there some section within SEOmoz that would give me the info I need to reclaim the top spot for my desired search terms? I am still making my way through this site so if I am asking something obvious to you vets, please be patient with me.
Moz Pro | | FailuretoPlan1 -
UK Google Results .com V's .co.uk
In the UK lots of people use google.com rather than google.co.uk. See: http://weblogs.hitwise.com/robin-goad/2008/04/how_popular_is_googles_pages_from__the_uk_search_option.html The above data is a bit out of date but still I know lots of UK people who search on google.com. When I depersonalise the results and search there is a difference between what I see on google.com V's what I see on google.co.uk. Indeed one of the companies I work for ranks ok on google.co.uk, but not so well on google.com Questions: How would I best track ranking for UK based users who use google.com AND/OR google.co.uk using the SEOmoz tools (or other tools if appropriate)? I note that in "Google Webmaster Tools" you can change the setings to "Target users in United Kingdom". Given the fact that UK users use both google.com AND/OR google.co.uk would it be better to change this to unlisted or deselect the "Target users in" option? Thanks in advance. Justin
Moz Pro | | GrouchyKids0 -
Can social results be downloaded in graph format?
Hi, I love the functionality of SEOmoz, although I wondered if I am able to download the social results in another form other than an excel spreadsheet? Thanks, Adam
Moz Pro | | adamgthorndike0 -
Keyword Difficulty Tool on local results. Is this really working?
I've tried the Keyword Difficulty Tool on "consultant seo" in Romania (that is .ro) The tool says that it's Highly Competitive (59%), but I've got my website on #8 in 2 weeks. Question: Is this tool really working for local results? It seems way off... Actually I was kind of expecting for this keyword to be easy, what is confusing is the "59%" from the Keyword Difficulty results. Thanks for the answers!
Moz Pro | | wizant0