Possible bug in Crawl Issues report?
-
Hi all -
My crawl issues report shows 3 pages with missing titles. These are just google verification files and the robot.txt file - shouldn't these be excluded?
Pages with Title Missing or Emptyas of May 11
URL Page Authority Linking Root Domains
https://www.mysite.com/googlea87e28121c071983.html
1 0
https://www.mysite.com/robots.txt
1 0
https://www.mysite.com/google9b9dc57478f61677.html -
Wow that is interesting. Thanks for the info and direction Lynn. I will look into that.
Matt
-
Hi Matthew,
I think you will find that those urls are included in your sitemap.xml and that is why they are being crawled. They are also being indexed by google - you can search for the name of the verification files and they show up in the results. Remove them from the sitemap and you should be ok!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why is on-demand crawl reporting numbers that are very different than the regualr site crawl by Moz?
When I look at the site crawl available through my dashboard, it reports 22.9K pages crawled. I just ran a on-demand crawl and it is only reporting 6K pages crawled. Why is the number so much lower?
Moz Bar | | ctripp10100 -
How can I find duplicate pages from a Moz Crawl?
We have many duplicate pages that show up on the Moz Crawl, and we're trying to fix these but it's very difficult because I can't see a way to isolate the code where the duplicate is found. For instance, http://experiencemission.org/immersion/ is one of our main pages, and the crawl shows one duplicate of http://experiencemission.org/immersion. It appears that one of our staff manually edited the source code in one of our pages but forgot the trailing slash. This would be an easy fix but the problem is that this page is linked to internally on our website 2423 times, so it's next to impossible to find the code that is incorrect. We have many other pages with this same basic problem. We know we have duplicates, but it's next to impossible to isolate them. So my question is this: When viewing the Moz Crawl data is there any way to see where a specific duplicate page link is located on our website? Thanks for any and all help!
Moz Bar | | expmission0 -
FollowerWonk Issue?
Used followerwonk to do a Comparison of followers of my brand and two competitors. the question I have is Retweets, Contacts, and URL tweets are broken in percentages all equaling 100%, but how are these calculated to begin with? are each of the three categories compared to social authority or to each other? Basically, I ran it on my brand and it says there are 0% of retweets, when I know there are at least 6 retweets done by the brand.
Moz Bar | | YeslerB2B_Geek0 -
Moz Crawl Test Tool - SEO Web Crawler showing up with no details
So basically I have ran the Moz Crawl Test tool twice for this url "bubblingwithenergy.info" and both times the report has listed 1 URL when there is obviously a lot more if you check the site. My question is, why is the Moz Crawl only reporting 1 URL when there are heaps? Is there a possibility it is being blocked and if so what would be blocking it? This website is using a CMS called Infusion and it is based off CMSMS (CMS Made Simple). Any answers would be greatly appreciated. Cheers
Moz Bar | | KBB_Digital0 -
How Can I print a report that shows the general results in the dashboard view?
I would like to print a report for a client, that looks like the dashboard report, more visual. Is there a print to PDF for the general info, which the dashboard provides? moz-screen-shot.png
Moz Bar | | jlmarketing1 -
Crawl Diagnostics - nofollow - reducing duplicate pages
Hi I'm looking at a crawl diagnostic report, I can see I have many duplicate pages, the reason for this is that when a brand filter is applied to a page. IE
Moz Bar | | chameleondm
www.mysite.com/mycategory - lets say this is the product listing page
www.mysite.com/category/mybrand - and this is the same page but with a brand filter applied
www.mysite.com/category/myotherbrand - and this is the same page but with a different brand filter applied I had intially appendeded the meta title, description and keywords with some extra content if a brand filter was applied, because the page on the whole does have different content. IE I would have a custom meta information, H1 tag and products on that page just for that specific brand.
However I am wondering if these two pages are really just competing with each other as lots of the content will be the same. Should I scrap that approach and use either nofollow on the brand filter link, or simply use a canonical. Thanks, James1 -
Moz.com Report a Problem or Provide Feedback
Two things. First, I could not find exactly where to report an issue or provide feedback about the website. I don't need to contact about Moz Analytics or any other products. I just want to provide feedback about the Moz Blog. I think it would be nice to be able to report an issue or provide feedback to "Roger" and have that item sent to the appropriate department for review. A lot of websites tend to use "webmaster@example.com" for this, but anything would work. My suggestion is to offer a feedback form on the Contact Moz page. Second, the issue I wanted to report has to do with blog comments. I left a comment early this morning and, with me being on Central Time and the timestamp for comments using Seattle local time, I was surprised to see that my comment had been posted "2 hours ago" immediately after I clicked "Submit." I presume this text is dynamic and that, in Seattle, you see "seconds ago" or something but, being in Wisconsin, I see "2 hours ago." This is confusing mainly because I have no idea how long ago other comments may have been posted. P.S. There isn't a question category for the Moz Blogs so I am choosing Moz - Other Research Tools. I view the blogs as a Product Moz provides so maybe adding "Moz - Blogs" to the Moz Product Help list of categories would be appropriate.
Moz Bar | | GeorgeAndrews0
