Xml sitemap only shows up sometimes (magento)
-
Hi Moz community,
I'm using Magento platform. I can generate a sitemap using their xml generator, but it will only pull up sometimes in web explorers, the rest of the time it will show a 404 page.
GWT also tells me that I get a 404 error when testing the sitemap, but sometimes it will acknowledge that it's there. Anyone had this problem before or know how to help. sitemap= www.ice.com/sitemap.xml
Let me know what other information I can provide to help.
Thanks!
-
Yeah that's definitely an issue we've had in the past (php execution time). It times out so quick for loading anything.
Hopefully it's just a server switch issue that we can upload directly as our robots.txt and sitemap.html aren't showing up either.
Thanks for leading me in the right direction. Very helpful.
-
It very well could. It seems like the generation time is too short for that many products. One thing I would try (I am not an expert with Magento) is to check what your php execution time limit is. If it is 30 seconds or 1 minute, I would try to increase it to something like 5 or 10 minutes and see if the regeneration works then. The script could be timing out.
-
It doesn't seem like the file is on the server, but I'm using the Magento sitemap generator which is supposed to automatically add it to the main directory. We just migrated our site from one Magento dev team to another so could this mean that our servers were switched over from Magento to a new one?
We've got ~40,000 total products and ~16,000-17,000 in-stock products.
It hardly takes any time to generate when I run it through Magento, maybe a minute at most. I've also tested out generators like Auditmypc.com (which has worked for every site except this one) and xml-sitemaps.com.
-
Can you verify if the file is actually on the server? It sounds like the sitemap generator you are using might have a problem. How many products are in the shop? How long does it run when you generate one?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Are HTML Sitemaps Still Effective With "Noindex, Follow"?
A site we're working on has hundreds of thousands of inventory pages that are generally "orphaned" pages. To reach them, you need to do a lot of faceting on the search results page. They appear in our XML sitemaps as well, but I'd still consider these orphan pages. To assist with crawling and indexation, we'd like to create HTML sitemaps to link to these pages. Due to the nature (and categorization) of these products, this would mean we'll be creating thousands of individual HTML sitemap pages, which we're hesitant to put into the index. Would the sitemaps still be effective if we add a noindex, follow meta tag? Does this indicate lower quality content in some way, or will it make no difference in how search engines will handle the links therein?
Intermediate & Advanced SEO | | mothner0 -
Does anyone know of any tools that can help split up xml sitemap to make it more efficient and better for seo?
Hello All, We want to split up our Sitemap , currently it's almost 10K pages in one xml sitemap but we want to make it in smaller chunks splitting it by category or location or both. Ideally into 100 per sitemap is what I read is the best number to help improve indexation and seo ranking. Any thoughts on this ? Does anyone know or any good tools out there which can assist us in doing this ? Also another question I have is that should we put all of our products (1250) in one site map or should this also be split up in to say products for category etc etc ? thanks Pete
Intermediate & Advanced SEO | | PeteC120 -
OSE link report showing links to 404 pages on my site
I did a link analysis on this site mormonwiki.com. And many of the pages shown to be linked to were pages like these http://www.mormonwiki.com/wiki/index.php?title=Planning_a_trip_to_Rome_By_using_Movie_theatre_-_Your_five_Fun_Shows2052752 There happens to be thousands of them and these pages actually no longer exist but the links to them obviously still do. I am planning to proceed by disavowing these links to the pages that don't exist. Does anyone see any reason to not do this, or that doing this would be unnecessary? Another issue is that Google is not really crawling this site, in WMT they are reporting to have not crawled a single URL on the site. Does anyone think the above issue would have something to do with this? And/or would you have any insight on how to remedy it?
Intermediate & Advanced SEO | | ThridHour0 -
Competitors Showing in Branded Search w/in Google FR
Hi All, When searching for our brand in Google France, I noticed that some of our major competitors show up beneath our Knowledge Graph listing. My managers and I are wondering if this is something Google just does as associated search or if there's a way that we can work around it. Thanks and please see attached image 🙂 2KYBeiT
Intermediate & Advanced SEO | | CSawatzky0 -
Can submitting sitemap to Google webmaster improve SEO?
Can creating fresh sitemap and submitting to Google webmaster improve SEO?
Intermediate & Advanced SEO | | chanel270 -
To list or not to list? Products that contain basic info only, yet show off product depth...
Some of our products on our site only have 40 characters of description... each item/category is it's own unique web page with basic info like Brand, Model, What it is, Price, & Quantity in stock. For searchers knowing what they want, they can quickly find us via the basic info & see that we have it in stock. But for someone surfing our site, it's not all that attractive or informative as you are scrolling down the category list. Collecting the picture & info can be a slow and time consuming process, but something we'd love to be all caught up on one day. Would it be wiser to take these pages off, or keep them on until they are fully updated with pic & more detail? (My thought is that even though they don't contain a lot of individual detail depth, they still add a substantial quantity of basic related content to the category page that they reside in. This basic info on these items are also given a chance to burn into the web search engines over a longer period of time. As time goes by and their content is improved, they will get re-crawled/re-indexed with their new information depth. Also, even though they don't look all that pretty, it shows off our product depth... if we only listed the items that looked spectacular, then a lot of our categories would only contain a wimpy 3 out of 30 items that we actually have for sale. That feels like a huge misrepresentation of how much selection we actually have to offer. But perhaps this is wrong thinking?) Thanks, Kevin
Intermediate & Advanced SEO | | Kevin_McLeish0 -
Magento Base Install 302 from non www to www , problems?
Using our crawl diagnostics report I am seeing a 302 redirect (temporary) from mydomain.com to www.mydomain.com. It is on an installation of magento with no modifications to the htaccess. This seems problematic, should I change to a 301 in .htaccess?
Intermediate & Advanced SEO | | Punkaj0 -
Old URL showing up in SERPs 4 months after Re-direct
Hi guys, I did a full site redirect back in October to a new URL, SERPS eventually changed to the new URL and everything was fine. However recently i have started to see the old URL showing up? Anyone else seeing this?
Intermediate & Advanced SEO | | Martin_Harris0