Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

SEO Web Crawler - Referrer Lists XML Sitemap URL

Moz Pro

959

MorpheusMedia last edited by

Hello!,

I recently ran the crawl tool on a client site. Opening up the file, I noticed that the referring URLs listed are my XML sitemaps and not (X)HTML pages.

Any reason or thoughts behind why this is happening?

Thanks!
1 Reply Last reply
Reply Quote 0

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

Missing Meta Description in Pop Up Image Gallery URL

Hi there, Moz has reported that I have a lot of missing meta description in the Pop Up Image Gallery. There are over 150 of these that are missing. The issue is that in our CMS I cannot add meta description to images. I am also not entirely sure why the images I am loading up are generating their own URL like the one below. Possibly that is why Moz is saying it needs a meta description when it is only an image?. An example of the link that has missing meta description that I can't add would be something like this: http://www.domianhere.com/products/PopUpImageGallery/93/1?iframe=true When clicking these links it is purely an image with no text. So basically I am asking how do you add a meta description to a Pop Up image Gallery photo URL and/or possibly why would an image create a custom URL so I have to put in a Meta Description? Hopefully that makes sense, thank you in advance for your help - much appreciated!
Moz Pro | | marketing-gal

0
Which URL to use for my campaign?

My outdated CMS redirects from a clean url root domain to an ugly url. Should I use the ugly one to start a my campaign? So when you type in www.site.com it redirects to www.site.com/site/c.leJRIROrEpH/b.5699537/k.BEF4/Home.htm Should I use the url it redirects to when starting a campaign?
Moz Pro | | mstanwyck

0
On-Page SEO Fixes - Are They Relative?

So, I'm implementing on-page fixes for a site that my company runs SEO services for (www.ShadeTreePowersports.com). However, I was wondering if there was a way to rank a pages' SEO quality, in general? As of now, it seems like the only way your recommendations can be consumed and altered is on a keyword basis. However, this seems be the reason I have a good amount of my F-Grades. Since my website sells powersports apparel and accessories, we cover a variety of applicable (but different) keywords like 'Motorcycle parts' or 'snow tubes,' because we sell so many different types of products. But, when I look at my F-Grades - SEOMoz is telling me my homepage is ranking poorly for a multitude of those pertinent keywords - but only because my page isn't catered specifically to each of them (IE: 'Snowmobile Parts' - 'Water Sport Apparel') But, with so many different types of products, catering to a specific one is impossible and would be detrimental. Is there a way to see how a page ranks, without factoring in those keywords? Or a better way that I can use these recommendations more efficiently? Thanks guys!
Moz Pro | | BrandLabs

0
Crawl Errors from URL Parameter

Hello, I am having this issue within SEOmoz's Crawl Diagnosis report. There are a lot of crawl errors happening with pages associated with /login. I will see site.com/login?r=http://.... and have several duplicate content issues associated with those urls. Seeing this, I checked WMT to see if the Google crawler was showing this error as well. It wasn't. So what I ended doing was going to the robots.txt and disallowing rogerbot. It looks like this: User-agent: rogerbot Disallow:/login However, SEOmoz has crawled again and it still picking up on those URLs. Any ideas on how to fix? Thanks!
Moz Pro | | WrightIMC

0
Why cant I hook up facebook to SEO Moz Campaign Tool?

Greetings from the digital epicentre otherwise known as Wetherby Uk 😉 I want to track sentiments ie mentions, slurs fliratations of a brand on Facebook. So to start out with I thought 'Id hook up SEO moz social tracking service as illustrated here: http://i216.photobucket.com/albums/cc53/zymurgy_bucket/cant-add-facebook-url.jpg But whilst i could add my twitter account I caount not add my favebook page:http://www.facebook.com/david.honan.98I added david.honan.98 in the url box and a number of other versions but none successfully hooked up. Am enetering the wrong url or is SEO moz socail media facebook plugin jinxed? Thanks in advance, David
Moz Pro | | Nightwing

0
URLs getting re-directed to double http:// URLs

The "Notices" section under "Crawl Diagnostics" shows that there are 435 issues on my website. I checked out a few URLs to verify this issue and found that most of these pages are working perfectly. For instance, the above mentioned report shows that http://policycomplaints.com/about redirects to http://http://policycomplaints.com/about/ . Then, http://policycomplaints.com/aegon-religare/mis-selling-of-policy-by-aegon-religare/ redirects to http://http://policycomplaints.com/aegon-religare/mis-selling-of-policy-by-aegon-religare/ . However, when I open these pages, they seem to be working perfectly. I didn't find them getting re-directed to somewhere else. So, as per the report, it seems that all of these 435 http://URLs are getting re-directed to http://http://URL versions which in reality is not true because all the http://URLs are working perfectly. So, is this a problem with SEOmoz software? If not, what is the reason for these issues and how can I adddress them. Do notify if any further information is required for the same. Thanks. bNiEm.png
Moz Pro | | unknownID1

0
Crawl test tool from SEOmoz - which URLs does it actually crawl?

I am using for the first time the crawl test tool from SEOmoz and I do not really understand which URLs the tool is going to crawl. First, it says "enter any subdomain" --> why can´t I do the crawl for the root domain? Second it says "we'll crawl up to 3,000 linked-to pages" --> does that mean that the tool crawls all internal links that it can find on the given domain? Thanks for your help!
Moz Pro | | Elke.GetApp

0
Can you release some sample documents for the budding SEO practitionar?

Hey guys, Would it be possible for you to release some sample documents, e.g. an 'initial proposal' example that can help us newbies when aiming to obtain prospective clients. I must admit I am much much more technical minded than articulate when it comes to these matters so a sample report would benefit me dearly that I could use as a starting point. My SEO services so far have been well.. totally free so far whilst I learn more about the techniques involved and determine whether it really is work I'd like to carry out in addition to my day to day development/design tasks. Now I am faced with a potential new client and after spending a fair number of hours Googling, I'm still not 100% sure how to structure the document and whether an initial audit should be carried out first to give me some statistics for the report.. Or whether the report should simply outline what I can offer. The samples I've found online, most of which are quite old, mostly tend to come from established SEO companies and have a corporate feel about them which doesn't reflect on myself as a single consultant. So if you could help out that would be fantastic and I'm sure would be a popular resource for others just starting out in the field. Thank you Dave
Moz Pro | | davebrown1975

0