XML Sitemap that updates daily/weekly?
-
Hi,
I have a sitemap on my site, that updates but it isn't a XML sitemap. See here: http://www.designerboutique-online.com/sitemap/
I have used some free software to crawl the site and create a sitemap of pages, however I think that if I were to upload the sitemap, it would be out of date as soon as I listed new products on the site, so would need to rerun it.
Does anyone know how I can get this to refresh daily or weekly?
Or any software that can do it?
I have a web firm that are willing to do one, but our relationship is at an all time low and I don't want to hand over £200 for them to do one.
Anyone with any ideas or advice?
Thanks
Will
-
Hi Will,
The time required for installation and testing could vary according to whether there are compatibility issues to resolve on the server.
As an example - if we were to install an updated version of Wordpress for a client, that could be a 5 minute job, but the new version requires an updated version of PHP on the server and the age and configuration of the server may require patching (or even moving to a newer server) in order to install the correct version of PHP.
Then, with all of the software updated and the new version of WP installed, we would need to check and test the installation to ensure that the template is still good and nothing has broken.
So, a 5 minute job could easily turn into a 1 or 2 hour job and the need for the additional work will only become known when the installation is attempted (sucks to be us sometimes!)
For this reason, most web development companies will probably quote you a minimum of an hour to do the work. Having said that, the hourly rate you have quoted would be considered extremely high by our company.
I hope that helps,
Sha
-
Basically no one wants to touch the site, so were stuck with them for now.
They have come back to me with £100 for an hours work of testing the script, because they do not know what it contains.
How long does it take to install on server and do what you have to do to test it?
They are ripping us off, I know they are.
Cheers
-
Hi Will,
Ouch! That is a lot of money for what should be a straightforward task.
I think you may have missed what I said earlier in that the Unlimited version of XML-Sitemaps is ONLY available as a server install. You do not get a piece of software that enables you to generate the sitemaps externally and upload them.
There are other services around that enable you to generate externally via a web interface and upload. The paid version of freesitemapgenerator.com is one of these, but does require a verification file to be uploaded to the server before it can run. It is a simple text file that verifies ownership of the site.
In the end, if you are not happy with the service you are getting, you have the option to find another web development company who are a better fit for you. If you decided to do that, then the new company should be able to negotiate the change with the old company to minimize disruption.
It makes me a little sad to hear of clients who feel the way you do and I'm sorry that you have had a bad experience with our industry. Thankfully, there are plenty of good companies out there if you should decide that the situation is untenable for your business. For most of us, making things right for a customer who has not had the best of it is a priority.
I hope you can work it out without too much more stress
Sha
-
Hi, thanks for that. The reason I do not want to go with the company is because I think they are taking me for a ride. The website they designed is a rip off, over paid and under delivered. Something like this should have been included when it was set up, they quoted me £1200 to install PayPal as a checkout option, whereas a highly respected e-commerce designer firm quoted me £250.
It is not 2 hours work for them, no way. I would be happy with just using my defined update schedule, maybe every 3 days would be sufficient, even once a week is fine.
I have asked them can they upload etc.. so I will see what they say. I am more than likely to buy the software, generate myself and then they can upload it.
I mean, what harm can doing it myself do? It will work, it will deliver, just the same as it would if the web firm done it. As I see the only benefit of using the firm is so can put in fancy update features.
Thanks for your input.
Cheers
Will
-
Hi Will,
If their preference is to write their own script it is likely that they EITHER have had previous experience with a 3rd party script which proved difficult to configure OR they intend to add features or changes which would require a hack anyway.
As I see it you have 3 options:
-
Accept their offer to write a custom script. Given the fluid nature of your update schedule, the advantage of this would be that they may be able to add a "manual fire" option. This would effectively give you the ability to click a button and manually generate sitemaps (xml & html) and ping the search engines if you make updates more frequently than the auto-run schedule. If this were the case, the script could be configured to run weekly and you could update as needed.
-
You could ask them to install and configure the 3rd party script for you instead of using theirs. Given their preference for writing their own script, it is likely they may have internal issues which would influence whether they are willing or able to do this.
-
IF your site has less than 500 pages you could run the free version whenever products are updated and email the xml sitemap to your web development company for upload. While the use of the generator is free, the company is likely to set a fee for this service. Although a file upload is a very simple task, it can be very disruptive to production schedules to have to do this if it happens often. As a project manager I well understand the issues that this kind of small task can cause. I generally end up doing them myself because the company resources required to allocate and track the task are more than it is worth. End up with two or three clients who want a file uploaded once or twice a week and the novelty can wear off very quickly!
If it were me I would work from the assumption that the company has valid reasons for preferring to write a custom script and just ask them to explain it for you. What will the script do? How will it work? What are the benefits for you and for them?
In the end, you will need to make a judgement on what will be best for your business. If you can repair your relationship with the existing company there is no danger of disruption to your business through server change etc. Disruption can be avoided or minimized if sites are moved , but this requires co-operation from your current company and parting on a poor relationship sometimes doesn't inspire co-operation
Hope that helps,
Sha
-
-
They said they would be writing a script so the £200 is 2 hours work for them.
They will not provide me with FTP details, so all edits go through them. Only if I take the site away from their hosting will I have access to FTP.
What would you advise? Is the XML completely fine with that software and all the web design company would need to do is have it refreshed every week?
What refresh frequency would I be best having, daily, weekly? We have new products more than likely 1 or 2 times a week.
T
-
Hi Will,
You can just pay for the script and have your web company install it on the server. If you want to have it create image sitemap in addition to page structure sitemap there is a $5 image sitemaps add-on. So cost for both would be $24.99 US dollars plus whatever your web company charges to install the script.
To get the XML-sitemaps people to install it, all you have to do is provide them with your ftp login information. The advantage of this is that they know the script and how everything needs to be configured to make it work correctly.
Once the script is installed it will auto generate the sitemaps as scheduled (you would get them to configure frequency when they install it). Each time new sitemaps are generated the script then pings the search engines to notify that new sitemap is available for download.
The unlimited version only works as a server install. If you have less than 500 pages in your site you can run the free version and upload as often as you wish for no cost at all (as long as you have ftp access).
Not sure what the 200 pounds price is for, but my guess would be that they are either planning to write a script for you OR buy a 3rd party script like XML-Sitemaps & install & configure it for you.
Hope that helps,
Sha
-
Hi, the server is owned by the people who designed the site, so they host it. So I would need to get them to put it up.
How would XML-Sitemaps handle the installation if it is on the web companies server? Would they be able to?
If I can get the XML file ready, then I am sure the web company would upload it for free or maybe a small charge.
Let me ask you this to see if I am reading you correctly.
If I buy that software (of which I used the free version to generate 500 lines), it will create a sitemap for me, then once hosted on the server, will update everytime a new product/page is added to the site? Once updated it pings Google etc...?
Would it be worth including the images in the sitemap, as we have over 1000 images on the site, maybe 3-5 images per product. Would that then enable us to get our images into google images a lot easier?
Do you know what the difference between me using this and uploading it to server and paying a web design company £200 to do everything? Is there any?
Cheers
Will
-
Hi Will,
There are several companies out there which provide paid sitemap generation services by installing a script on your server which is set to automatically generate sitemaps and to ping the search engines whenever a new sitemap completes.
Probably one of the best that I know is the unlimited version offfered by XML-Sitemaps.com. The cost is only US$20 and if you cannot install it yourself they will handle installation for an extra $10.
There are others around and may even be some free scripts out there if you have the ability to install on your own server. There are also modules etc available for standard ecommerce platforms like Oscommerce etc.
Hope that helps,
Sha
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moving youtube videos between accounts/channels
Hi.
Web Design | | corn2015
If you have a youtube channel that has a lot of videos on it and need to move the videos to another channel, is there an easy method to do this without having to download and re-upload them?0 -
Pageless/Single Page Design and Migration Questions
Hello, We are starting a content audit and migration to a new CMS. We would like to take content and present more on a pageless/Single Page type design instead of having visitors drill down so many levels to find the content. What should we be aware of from an SEO perspective. Here is Example of current pages and structure: http://www.saintpetershcs.com/GraduateMedicalEducation/PediatricResidency/
Web Design | | sphcs
Subpages include: Overview, Curriculum, Faculty, Residents, Benefits, How to APply Here is example of what we would like to do:
http://themeforest.net/item/medicalpress-health-and-medical-wordpress-theme/full_screen_preview/7789703 As you scroll information is populated: Duke Medicine also has something similar. https://www.dukemedicine.org/treatments/cancer What are your thoughts?0 -
Responsive Site has "Not Found" Errors for mobile/ and m/ in Google Search Console
We have recently launched a new responsive website for a client and have noticed 2 "Not Found" errors within Google Search Console for /mobile and /m Both these URLs are not linked from anywhere within the site. However Google is reporting them as being linked from the homepage. This is not the first site we have seen in which Google has reported this error, however the other site was not a mobile friendly site. My thoughts are to 301 them back to the Homepage. Anybody else have any thoughts on this? or have recently received the same errors?
Web Design | | JustinTaylor881 -
Site with no ads hit by Page Layout update?
Hi there! Can a site that has no ads on it be hit by Google's latest Page Layout update? Can it be hit for just one or two keywords? My site (www.ink2paper.com) has a decline in Google organic traffic in early Feb so my suspicion is the Page Layout update. However I have no ads on the site. Digging into GWMT I find that it is only one or 2 keywords that seems to have taken a dive, mainly [photo paper]. I used to get around 80 imps a day for this term. Then on 6 Feb it was down to 50; 7 Feb = 34; 8 Feb just 4 impressions! I got a spike back at usual levels on 10 & 11 Feb, but since then it has been back down to only 5 or so impressions a day. [photographic paper] took a small hit at the start of February, but has nose dived since the start of April. The homepage performs well for Google organic traffic - low bounce (22%) and good ecom conversion rate (14%) - although this is likely to be largely branded traffic. I feel my site is a 'good' result for the search term [photo paper], although there is always room for improvement of course! Any suggestions as to why Google has stopped showing my site for these keywords? All help is greatly appreciated. Cheers,
Web Design | | SimonHogg
Simon0 -
Nesting <a>tag for rel="nofollow"</a>
I just wanted to quickly run this past someone. I have some footer links I want set to nofollow: <map <span="" class="webkit-html-tag">name</map>="Map"><area <span="" class="webkit-html-tag">shape="rect" coords="10,39,73,101" href="URL" target="_blank" alt="some text"> should this be <map <span class="webkit-html-tag">name</map <span>="Map"><area <span class="webkit-html-tag">shape</area <span>="rect" coords="10,39,73,101 <a <span class="webkit-html-tag">href="URL" rel="nofollow" target="_blank" alt="some text"></a <span> Want to check before I advise. If this is not the way how can I fix?
Web Design | | MickEdwards0 -
My site build in HTML has been badly hit this recent update and I have been toying on the idea of changing it to Wordpress
My site build in HTML has been badly hit this recent update and I have been toying on the idea of changing it to Wordpress. Would this help in my rankings? It seems the hit came only that last 2-4 days when business become much quieter. Frankly i have no idea on why the site fell in ranking all of a sudden. Been comparing to competitors and even a friend in the same industry and nothing makes sense so far (link profile, DA, PA etc) This site has been ranking well for 3 years prior to this. 2. My site has loads of content and visitors arrive from various landpages. But by changing it wordpress, the url of most of them would probably change. What should i do? 301 redirect all of them or is there a better method?
Web Design | | rester0 -
Comparing the site structure/design of my live site to my new design
Hi SEOmoz team, for the last few months I've been working on a new design for my website, the old, live design can be viewed at http://www.concerthotels.com - it is primarily focused on helping users find hotels close to concert venues throughout North America. The old structure was built in such a way that each concert venue had a number of different pages associated with it (all connected via tabs) - a page with information about the venue, a page with nearby hotels to the venue, a page of upcoming events, a page of venue reviews. An example of these pages can be seen at: http://www.concerthotels.com/venue/madison-square-garden/304484 http://www.concerthotels.com/venue-hotels/madison-square-garden-hotels/304484 http://www.concerthotels.com/venue-events/madison-square-garden-events/304484 http://www.concerthotels.com/venue-reviews/madison-square-garden-reviews/304484 The /venue-hotels/ pages are the most important pages on my website - and there is one of these pages for each concert venue - they are the landing pages for about 90% of the traffic on the website. I decided that having four pages for each venue was probably a poor design, since many of the pages ended up having little or no useful, unique content. So my new design attempts to bring a lot of the venue information together into fewer pages. My new website redesign is temporarily situated at: (not currently launched to the public) http://www.concerthotels.com/frontend The equivalent pages for Madison Square Garden are now: http://www.concerthotels.com/frontend/venue/madison-square-garden/304484 (the page above contains venue information, events and reviews) and http://www.concerthotels.com/frontend/venue-hotels/madison-square-garden-hotels/304484 I would really appreciate any feedback from you guys, based on what you think of the new site design compared to the old design from an SEO point of view. Of course, any feedback on site speed, easy of use etc compared to the old design would also be greatly appreciated. 🙂 My main fear is that when I launch the new design (the new URLs will be identical to the old ones), Google will take a dislike to it - I currently receive a large percentage of my traffic through Google organic search, so I don't want to launch a design that might damage that traffic. My gut instinct tells me that Google should prefer the new design - vastly reduced number of pages, each page now contains more unique content, and it's very much designed for users, so I'm hoping bounce rate, conversion etc will improve too. But my gut has been wrong in the past! 🙂 But I'd love to hear your thoughts, and thanks in advance for any feedback, Cheers Mike
Web Design | | mjk260 -
Need help setting up google analytics goals / tracking
I don't use Google analytics to see much more than how many visits I'm getting and what sort of keywords people are using to find our site. I'd like to step up my GA skills a bit. I'm wondring if you guys could give me some advice. I've never really set up any GA goals, or used it to track specific things, but I'd like to. Here are a few things off the top of my head that I would like to track. I'm wondring if these are posable in GA, and if someone could give me some feedback on how to track it / set up goals. Thanks.1 1. I'd like to know how many people click play on a video when they are on a page that has a video. 2. I'd like to know how many people are clicking "like" " google plus, etc.) 3. I'd like to know the path people are taking on our site. For instance, if they click a link from Facebook, and go to a landing page, what page are they visiting next..... 4. How long people are staying on the page I would really like to break this down further by people that visit a link I posted on Facebook, or twitter, or from the link on my twitter profile page, etc... Also if there are any other valuable goals / reports that would be useful for a blogger to track I'd appreciate your feedback. Thanks.
Web Design | | NoahsDad0