Too many on page links in sitemap.html
-
My crawl report is flagging an issue with too many links to one of my pages, this page is my sitemap.html. However, I have coded the page so that if required is specified it generates an .xml version of the page and if not then the html version is displayed. What is the best way to stop the crawl finding the html version whilst maintaining it on the site for clients navigation?
-
The thing to remember is that the HTML version should only ever be used for users and not to redirect robots if they hit a 404 on your .xml file. The reason for this is that search engines may still see the file as 404 after the redirect or a 301 redirect, if the later you then have an issue of search engines thinking it was there but is now the html page. Which of course is not a good thing.
I would advise ensuring the fall back never happens to robots / spiders - if the file is just a 404 SE's will return to it, they may not if it is 301 redirect.
-
Thanks for the response,
This was the first thought, but I wasn't 100% sure that hiding it in the robot.txt file should solely remove this issue and it is still early.
Thanks again.
-
hide it using a robots.txt file - though you could also use the noindex meta tag ... this being said search engines in general recognize sitemap pages and aren't too fussed by them, its a good jumping off point for them to find info.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
On Brand Queries Google does not shows my home page first instead of it shows internal pages.
Also on my brand query it doesn't shows sitelinks. What may be the reason?
On-Page Optimization | | vivekrathore0 -
Source page leading to a 404 pages in reports
Hi everybody, I wonder how to find and quickly correct 404 errors in my crawl reports : SeoMoz says me "http://domain.com/this-page-is-dead" is 404, but I can't figure out a source page where a link to that url appears. I tried a google link:http://domain.com/this-page-is-dead request, with no more luck. I imagine the trick is trivial, but I need it 🙂 Moreover, why do not show a list of pages referring to this 404 page on reports ? Thanks, Loïc
On-Page Optimization | | mandinga0 -
Duplicate Page Content and Duplicate Page Title
Hi All, I'm new in SEOMoz and have some questions after I have already spend 2-3 days trying to resolve the problems identified from Crawling one of my clients websites. I get quite a lot of Duplicate Page Conntent and Page Titles warnings and trying to find a workaround through the forums and posts. I continuously get this error on most of my pages: URL: http://domain.com/benefits with the same Page but with a WWW in front URL: http://www.domain.com/benefits Any advice will be highly appreciated. Thanks, Athos
On-Page Optimization | | athosk0 -
Internal linking
Background; selling childrens clothing (for norwegian market). main page is being optimized barneklær (children clothing) which is most used term. We ve been online for around 3 months and have gone from unranked to 25th spot on google for this term. We are selling clothes from 8 different producers which all have their own 'page' - were all their products are listed. e.g http://www.epleskrinet.no/dundelina/M_13 . This page i am optimizing for the producer which is dundelina. For this term i show up in spot 24, 25 and 44. My problem is that its not the producer page that show up but the 3 most popular products. The producer page isnt ranked at all. What ive done so far is to have to producer link to my page from their site and blog (a week ago) - they were linking to my home page earlier. Ive put anchor text dundelina --> takes me to producer page on 4 out of 7 products. This was also done about a week ago. I am planning a blog about dundelina pointing to the right URL. From our blog I am using. Ive posted a couple of pictures on facebook pointing to right URL. Do i just need to be patient for this to be picked up or is there anything else i should do ? Thanks ... Dan Lærum
On-Page Optimization | | danlae0 -
Duplicate Links
Hello, I am entering sitewide navigation that will go to primary seo pages. This is really for usability, not for link juice. I'm wondering if I should still link to these very important pages in my index page's content. Or if I should consider those navigation links strong enough. If I did link in the content, then I would have more than one link to the same page on my home page. Thanks Tyler
On-Page Optimization | | tylerfraser0 -
How many urls per page is to many
I know it used to be 100 urls per page, but recently Matt cutts has said that they can count a lot more now. I was wonder what you guys thought was how many was to many per page?
On-Page Optimization | | Gordian0 -
Linking Back to the Same Page
What are the other seo's opinions on linking the same keyword you are targeting lets take an example like Trampolines. So we have a Online shop selling trampolines would you feel it a good or bad thing to link the keyword trampolines from the homepage to the homepage almost creating a loop. Some SEO's say yes some say no ?
On-Page Optimization | | onlinemediadirect0 -
Link cannibalization
My on page report card gives me an "A" in every category but "link cannibalization". The key word is I am targeting is "home care". It says my links to "home care blog" and "in home care agency locator" are cannibalizing my home page. Am I indeed causing problems by using these modified versions of the keyword? Also is it okay to have the link "home care" for the home link in the main navigation bar? Thanks
On-Page Optimization | | mmaes0