Xml sitemap only shows up sometimes (magento)
-
Hi Moz community,
I'm using Magento platform. I can generate a sitemap using their xml generator, but it will only pull up sometimes in web explorers, the rest of the time it will show a 404 page.
GWT also tells me that I get a 404 error when testing the sitemap, but sometimes it will acknowledge that it's there. Anyone had this problem before or know how to help. sitemap= www.ice.com/sitemap.xml
Let me know what other information I can provide to help.
Thanks!
-
Yeah that's definitely an issue we've had in the past (php execution time). It times out so quick for loading anything.
Hopefully it's just a server switch issue that we can upload directly as our robots.txt and sitemap.html aren't showing up either.
Thanks for leading me in the right direction. Very helpful.
-
It very well could. It seems like the generation time is too short for that many products. One thing I would try (I am not an expert with Magento) is to check what your php execution time limit is. If it is 30 seconds or 1 minute, I would try to increase it to something like 5 or 10 minutes and see if the regeneration works then. The script could be timing out.
-
It doesn't seem like the file is on the server, but I'm using the Magento sitemap generator which is supposed to automatically add it to the main directory. We just migrated our site from one Magento dev team to another so could this mean that our servers were switched over from Magento to a new one?
We've got ~40,000 total products and ~16,000-17,000 in-stock products.
It hardly takes any time to generate when I run it through Magento, maybe a minute at most. I've also tested out generators like Auditmypc.com (which has worked for every site except this one) and xml-sitemaps.com.
-
Can you verify if the file is actually on the server? It sounds like the sitemap generator you are using might have a problem. How many products are in the shop? How long does it run when you generate one?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
News articles on our website are being indexed, but not showing up for search queries.
News articles on distributed.com are being indexed by Google, but not showing up for any search queries. In Google Search, I can copy and paste the entire first paragraph of the article, and the listing still won't show up in search results. For example, https://distributed.com/news/dtcc-moves-closer-blockchain-powered-trades doesn't rank AT ALL for "DTCC Moves Closer to Blockchain-Powered Trades", the title of the article. We've tried the following so far: re-submitted sitemap to search console checked manual actions in search console checked for any no-index/no-follow tags Please help us solve this SEO mystery!
Intermediate & Advanced SEO | | BTC_Inc0 -
Mystery URLs showing in Analytics - All 404s
Hi Guys So we have a whole load of mystery urls showing in analytics .The urls are completely not relevant and have somehow been created However - when you click on the URLs - they all go to 404 pages - pages not found. The website is a travel website but is showing pages like /overcome-fatigue-during-mesothelioma-treatment/ in analytics. Webmaster is not showing any of these pages - but analytics is showing traffic for them??? My initial thought was that it was a spam URL injection - but they are not pages. They don't exist Our database is fine, WP admin seems fine - none of these supposed pages have been created on WP - so why are they showing on analytics as having driven traffic??? None of the urls are indexed on Google. Its a mystery!!!! Can anyone help? Has anyone seen this before????
Intermediate & Advanced SEO | | CayenneRed890 -
Are HTML Sitemaps Still Effective With "Noindex, Follow"?
A site we're working on has hundreds of thousands of inventory pages that are generally "orphaned" pages. To reach them, you need to do a lot of faceting on the search results page. They appear in our XML sitemaps as well, but I'd still consider these orphan pages. To assist with crawling and indexation, we'd like to create HTML sitemaps to link to these pages. Due to the nature (and categorization) of these products, this would mean we'll be creating thousands of individual HTML sitemap pages, which we're hesitant to put into the index. Would the sitemaps still be effective if we add a noindex, follow meta tag? Does this indicate lower quality content in some way, or will it make no difference in how search engines will handle the links therein?
Intermediate & Advanced SEO | | mothner0 -
Changing the XML Sitemap address
For technical reason we are having to change our XML sitemap URL's from domain.com/sitemap.xml to domain.com/sitemaps/sitemap.xml - What checklist do I need to do to make sure this transition goes smoothly and is there any problems that I might come across?
Intermediate & Advanced SEO | | JohnW-UK0 -
"No index" page still shows in search results and paginated pages shows page 2 in results
I have "no index, follow" on some pages, which I set 2 weeks ago. Today I see one of these pages showing in Google Search Results. I am using rel=next prev on pages, yet Page 2 of a string of pages showed up in results before Page 1. What could be the issue?
Intermediate & Advanced SEO | | khi50 -
Dtox showing 64% of backlinks are TOX1 but still ranking
A local business has been smashing the SERPs for a while now, but since May (updates) it has been sliding and search visibility has plummeted. They came to me for help, so I ran a Dtox report and it's showing a lot of bad links (2,863 links in total). TOX1 are deindexed website so it was being linked to from a huge private blog network. MY question is, with only 209 decent links pointing to them, are they ranking because Google hasn't picked up all the shitty links or DESPITE them? I assume that after Google deindexes a domain, that link is wiped out in their index? Which is the reason for the huge drop in rankings and visibility. However, they are still there or there abouts for 40% of their keywords. Whats the best course of action here, do you think? They haven't had a penalty (as far as I know). Should I proceed to disavow? Leave them to drop away and juts build quality links? I don't want to disrupt anything at the moment, they still do well in bing. They say their rankings are slowly sliding. Any ideas would be good!
Intermediate & Advanced SEO | | jasonwdexter1 -
Does a sitemap override Google parameter handling?
This question might seem silly, but I'll ask anyway. We have an eCommerce site with a ton of duplicate content, mostly caused by faceted navigation. In researching ways to reduce the clutter, I've decided to use Google parameter handling to stop Googlebot from crawling pages with certain parameters, like: sort order, page #, etc... Now my question: If I set all of these parameters so that Googlebot doesn't crawl the grids, how will they ever find the individual product pages? We do upload a sitemap with all of the product pages. Does this solve my issue? Or, should I handle the duplicate content with noindex, follow tag? Or, is there an even better way? Thanks
Intermediate & Advanced SEO | | rhoadesjohn0 -
How Do I Generate a Sitemap for a Large Wordpress Site?
Hello Everyone! I am working with a Wordpress site that is in Google news (i.e. everyday we have about 30 new URLs to add to our sitemap) The site has years of articles, resulting in about 200,000 pages on the site. Our strategy so far has been use a sitemap plugin that only generates the last few months of posts, however we want to improve our SEO and submit all the URLs in our site to search engines. The issue is the plugins we've looked at generate the sitemap on-the-fly. i.e. when you request the sitemap, the plugin then dynamically generates the sitemap. Our site is so large that even a single request for our sitemap.xml ties up tons of server resources and takes an extremely long time to generate the sitemap (if the page doesn't time out in the process). Does anyone have a solution? Thanks, Aaron
Intermediate & Advanced SEO | | alloydigital0