Too many on page links in sitemap.html
-
My crawl report is flagging an issue with too many links to one of my pages, this page is my sitemap.html. However, I have coded the page so that if required is specified it generates an .xml version of the page and if not then the html version is displayed. What is the best way to stop the crawl finding the html version whilst maintaining it on the site for clients navigation?
-
The thing to remember is that the HTML version should only ever be used for users and not to redirect robots if they hit a 404 on your .xml file. The reason for this is that search engines may still see the file as 404 after the redirect or a 301 redirect, if the later you then have an issue of search engines thinking it was there but is now the html page. Which of course is not a good thing.
I would advise ensuring the fall back never happens to robots / spiders - if the file is just a 404 SE's will return to it, they may not if it is 301 redirect.
-
Thanks for the response,
This was the first thought, but I wasn't 100% sure that hiding it in the robot.txt file should solely remove this issue and it is still early.
Thanks again.
-
hide it using a robots.txt file - though you could also use the noindex meta tag ... this being said search engines in general recognize sitemap pages and aren't too fussed by them, its a good jumping off point for them to find info.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Homepage canonical url with splash or not with splash? All other links are without but logo links with splash
Hello, There is so much contradicting information about the homepage canonical URL. Many websites have all the links without the trailing splash but their homepage URL still contains the splash. Now Moz is an example with this. Their urls don't have the splash, and their canonical does not have the splash. Why is it so and why so much different ways people have it?
On-Page Optimization | | advertisingcloud0 -
Why isn't our site being shown on the first page of Google for a query using the exact domain, when its pages are indeed indexed by Google
When I type our domain.com as a query into Google, I only see one of our pages on the homepage, and it's in 4th position. It seems though, that all pages of the site are indexed by google when I type in the query "site:domain.com". There was an issue at the site launch, where the robots.txt file was left active for around two weeks. Would this have been responsible for the fact that another domain ranks #1 when we type in our own domain? It has been around a couple of months now since the site was launched. Thanks in advance.
On-Page Optimization | | featherseo0 -
Internal linking structure
howdy SEO moz people, I had a quick question about internal linking. I am using the WP platform for my website and on one of the widgets I have a category widget that shows all the pages, (on every page). I wanted to know that when if i make a new post or page does it matter if the internal anchor texts are on the content itself or is it suffice to have it on the side bar within the widget? Basically what im asking is does it matter if i have anchor text links on the content itself or is it ok to have it anywhere on the page. and if it does matter to have it on the content, please help out on any suggestions on where to place them. thanks
On-Page Optimization | | david3050 -
Faq page
We are redoing our faq page and we were trying to decide on the best format. 1. Create each question on a separate page 2. Create one page with all the question and have the questions expand 3. Create different faq category pages (like 4) and divide the questions between them From my perspective #1 seems the best ---. you can create hyper relevant content for the user and optimize each question really well Any experience with this?
On-Page Optimization | | Morris770 -
Too many links
Hello, sorry question 2! I run the report it says we have 120 links roughly per page. I know this is bad however I have question about an oscommerce site. I identified some links that can be deleted for example Product picture is a link then the title and then its says details (so I can delete the details and that should save about 15 links) Now I really can only delete the breadcrumb for example car>>ford>>spareparts>>engine If I delete the breadcrumb I would lose four links would you say thats a good idea? or leave the breadcrumb due to the seo benefits. Many thanks for your help. Sonja
On-Page Optimization | | reallyitsme0 -
Page title
So if we have a main category page on our site (mines an ecommerce site), do we go for more than that main keyword phrase for that category of products, or is it better to just keep it by itself, and not utilize the 65-70 characters available?
On-Page Optimization | | azguy0 -
Nofollowed internal links from the home page
Hi, I'm conducting an on-page review for someone and have noticed something I've not seen before. Some of the major internal links from the home page are marked as no follow. For example: <a <span="">href</a><a <span="">="</a>/customer-services" rel="nofollow">Customer Services This is on the top navigation bar and the content in this and all other sections are marked as no-follow but they should all be crawled. Is this an error or am I missing something? Any ideas guys? Thanks Bush
On-Page Optimization | | Bush_JSM1 -
SEO Value of Within-Page Links vs. Separate Pages
Title says it all. Assuming that you're talking about similar content (let's say, widgets), which is better: using within-page links for variations or using separate pages? I.e., do we have a widget page and then do in-page links to describe green, blue, and red widgets, or separate pages for each type of widget? In-page pro: more content on a single page, thus more keywords, key phrases, and general appearance of real content. In-page con: Jakob Neilsen says they're confusing. Also, for SEO, you only get one page title, rather than a separate page title for each. My personal bias is for in-page, since I hate creating dozens of short pages for what could be on one page, but my suspicion is that separate pages are better for SEO.
On-Page Optimization | | maxkennerly0