Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

SEO Web Crawler - Referrer Lists XML Sitemap URL

Moz Pro

959

MorpheusMedia last edited by

Hello!,

I recently ran the crawl tool on a client site. Opening up the file, I noticed that the referring URLs listed are my XML sitemaps and not (X)HTML pages.

Any reason or thoughts behind why this is happening?

Thanks!
1 Reply Last reply
Reply Quote 0

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

Crawlers reporting upper case letter url versions although these have been 301'd to lower case !?

Hi I have a client e-com site who's dev platform is on a windows server Their product pages have been auto-named after the product title, with the first letter in each word being upper case, which has hence translated to the URL having upper cases instances too. I asked them to set up 301 redirects for all url's that had upper case instances to lower case versions, which they say they have done. However I'm still seeing url's with upper case instances showing up in webmaster tools and moz crawl reports but when I copy & paste them into a browser they do redirect to, & resolve in, the lower case version. Its also upper case versions reported in the Google cache! So how come webmaster tools & Moz etc are reporting the upper case versions, surely if redirected it should be the lower case versions All Best Dan
Moz Pro | | Dan-Lawrence

0
Spacing after list items in Q&A

Hey Moz The Q&A interface lacks any spacing after a HTML list item so it makes things look a bit messy. It looks right when being edited but wrong when posted so. example list more list list keeps going Paragraph after bullet list with no space. example list more list list keeps going Paragraph after number list with no space. Any chance of fixing that? It will make posts more readable and satisfy those of us fussy enough to go back in and edit posts so they are laid out correctly. (Sorry, I am English, I can't help myself). Cheers!
Marcus
Moz Pro | | Marcus_Miller

1
Is www.domain.com/page the same url as www.domain.com/page/ for Google? (extra slash at end of url)

Dear all, in open site explorer there is a difference the url's 'www.domain.com/page' and 'www.domain.com/page/' (extra slash at end). There can be different values in pageauthority etc. in the open site explorer tool, but is this also the case for Google? Thanks for replying, Regards, Ben
Moz Pro | | HMK-NL

0
Places to Find Good SEO Webinars

I've noticed that the Pro webinars on SEOMoz seems to have slowed considerably with the last one in April 2012. Are there other good places you would recommend to find good SEO webinars? Thanks!
Moz Pro | | ProjectLabs

0
What tools/software provide the most comprehensive list of backlinks to your domain?

We're currently looking for a product that has the capability of providing a comprehensive list of backlinks pointing to our domain, which currently has 400+ URLs. We've tried SEOMoz Pro, Google Webmaster Tools, and Majestic SEO. Does anyone have any recommendations or tips on getting the best report of backlinks?
Moz Pro | | Collegis_Education

0
SEO Moz ranking reports

I am confused. The SEO Moz ranking reports state that my site show show up in a specific position in SERP for a specific keyword yet when I google the keyword the ranking is different. Are these ranking reports merely indicative or are they supposed to be accurate?
Moz Pro | | casper434

0
Looking for a tool that can pull OSE stats for a bulk amount of URLs

I know that people have developed inhouse tools with the OSE API that can analyze thousands of URLs and pull metrics like PA, inbound links, etc. I need to analyze about 80k URLs and sort them by authority and I was hoping that someone could point me to a tool that can do this or let me use their tool. I'm willing to pay for access to it. We could build it inhouse, I imagine that it would be pretty easy, but our IT resources are stretched too thin right now.
Moz Pro | | Business.com

0
Rel Canonical issues for two urls sharing same IP address

Our client built a wordpress site on url A, then opted for a better url B. Rather than moving all the wordpress files/website over to the new url B, they just contacted GoDaddy, who hosted BOTH urls under the same IP address. When I do a term target on url B, I'm flagged for rel canonical use. I can only get a B grade for each keyword. (I've also tried using url A, but I get the same flag and B grade results). I'm not sure if this set-up will thwart our seo efforts for the site, because only the homepage comes up when you type in url B anyway. Every subsequent page displays the original url A. Somewhere, wordpress is also adding a rel canonical link on the homepage source to url A, too, which we can't seem to edit. So, question is: is it ok to leave this set up as is with both urls hosted on the same IP address, or should we move the whole site over to the desired url B? Thanks much!
Moz Pro | | GravitateOnline

0