Should I submit a sitemap for a site with dynamic pages?
-
I have a coupon website (http://couponeasy.com)
Being a coupon website, my content is always keeps changing (as new coupons are added and expired deals are removed) automatically.I wish to create a sitemap but I realised that there is not much point in creating a sitemap for all pages as they will be removed sooner or later and/or are canonical.
I have about 8-9 pages which are static and hence I can include them in sitemap.
Now the question is....
If I create the sitemap for these 9 pages and submit it to google webmaster, will the google crawlers stop indexing other pages?
NOTE: I need to create the sitemap for getting expanded sitelinks.
-
Hi Anuj -
I think you are operating from a very false assumption that is going to hurt your organic traffic (I suspect it has already).
The XML sitemap is one of the the very best ways to tell the search engines about new content on your website. Therefore, by not putting your new coupons in the sitemap, you are not giving the search engines one of the strongest signals possible that new content is there.
Of course, you have to automate your sitemap and have it update as often as possible. Depending on the size of your site and therefore the processing time, you could do it hourly, every 4 hours, something like that. If you need recommendations for automated sitemap tools, let me know. I should also point out that you should put the frequency that the URLs are updated (you should keep static URLs for even your coupons if possible). This will be a big win for you.
Finally, if you want to make sure your static pages are always indexed, or want to keep an eye on different types of coupons, you can create separate sitemaps under your main sitemap.xml and segment by type. So static-pages-sitemap.xml, type-1-sitemap.xml, etc. This way you can monitor indexation by type.
Hope this helps! Let me know if you need an audit or something like that. Sounds like there are some easy wins!
John
-
Hello Ahuj,
To answer your final question first:
Crawlers will not stop until they encounter something they cannot read or are told not to continue beyond a certain point. So your site will be updated in the index upon each crawl.
I did some quick browsing and it sounds like an automated sitemap might be your best option. Check out this link on Moz Q&A:
https://moz.com/community/q/best-practices-for-adding-dynamic-url-s-to-xml-sitemap
There are tools out there that will help with the automation process, which will update hourly/daily to help crawlers find your dynamic pages. The tool suggested on this particular blog can be found at:
http://www.xml-sitemaps.com/standalone-google-sitemap-generator.html
I have never used it, but it is worth looking into as a solution to your problem. Another good suggestion I saw was to place all removed deals in an archive page and make them unavailable for purchase/collection. This sounds like a solution that would minimize future issues surrounding 404's, etc.
Hope this helps!
Rob
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Steps to Improve Page Rank and Domain Authority
Hi If the quality of web pages is very good I believe rankings should reflect this. My domain is at least 3 years old.
White Hat / Black Hat SEO | | SEOguy1
What steps would you recommend short term and long term in terms of how to improve page rank and domain authority? Thanks.0 -
Am I over "Optimising My Site" or following "Best Practice"
Hi We're developing our site an wanted to ask if we are "over optimising" or following best practice. Maybe you have some recommendations. I've provided 4 examples below. Eventually we'll use Moz on page grader but as a new start up, I'd appreciate your help. Thank you, Faye. 1. URL: http://www.thewoodgalleries.co.uk/engineered-wood/browns/cipressa/ PAGE TITLE: Cipressa | Engineered Brown Wood | The Wood Galleries H1: Cipressa – Engineered Brown Wood KEYWORD: Engineered Brown Wood META: Buy Cipressa Brown Engineered Wood, available at The Wood Galleries, London. Provides an Exceptional Foundation for Elegant Décor & Extravagant Furnishings. IMAGE TAG: Brown Engineered Flooring KEYWORD IN BODY CONTENT: YES (1) 2. URL: http://www.thewoodgalleries.co.uk/engineered-wood/beiges/mauro/ H1: Mauro | Beige Engineered Wood | The Wood Galleries PAGE TITLE: Mauro – Beige Engineered Wood KEYWORD: Beige Engineered Wood META: Buy Mauro Beige Engineered Wood Flooring, available at The Wood Galleries, London. Designed to deliver Rich, Dark Undertones with Light hues of Muted Brown. IMG TAG: Beige Wood Flooring KEYWORD IN BODY CONTENT: YES (2) **3. URL: http://www.thewoodgalleries.co.uk/engineered-wood/beiges/vela-oak/ ** H1: Vela – Beige Engineered Oak PAGE TITLE: Vela | Beige Engineered Oak | The Wood Galleries KEYWORD: Beige Engineered Oak META: Buy Vela Beige Engineered Oak Wood, available at The Wood Galleries, London. Crafted from the most widely respected hardwoods in the world. IMG TAG: Engineered Oak Flooring KEYWORD IN BODY CONTENT: YES (1) 4. URL: http://www.thewoodgalleries.co.uk/engineered-wood/darks-blacks/ciro-rustic/ H1: Ciro – Engineered Rustic Wood PAGE TITLE: Ciro | Engineered Rustic Wood | The Wood Galleries KEYWORD: Engineered Rustic Wood META: Buy Ciro Engineered Rustic Wood, at The Wood Galleries, London. Its stylishly classic oak look exudes a sense of luxury that is simply undeniable. IMG TAG: Dark Wood Flooring, The Wood Galleries KEY WORD IN BODY CONTENT: YES (2)
White Hat / Black Hat SEO | | Faye2340 -
Am i getting backlink benefits from sites i design and host
I own & host over 300 domains for as many businesses. They all link back to my site from every page. but seomoz shows only hundred. so do other seo tools. why is that?
White Hat / Black Hat SEO | | nooptee0 -
Switching site content
I have been advised to take a particular path with my domain, to me it seems "black hat" but ill ask the experts: Is it acceptable when one owns an exact match location domain eg london.com, to run as a tourist information site, gathering links from wikipedia,bbc,local paper/radio/sports websites etc, then after 6 - 12 months, switch the content to a business site? What could the penalties be? Please advise...
White Hat / Black Hat SEO | | klsdnflksdnvl0 -
Should I redirect old pages
I have taken over SEO on a site. The old people built thousands of pages with duplicate content. I am converting site to wordpress and was wondering if I should take the time to 301 redirect all 10,000 or so pages with duplicate content. The 10,000 pages all have links back to different to different pages as well as to the homepage. Should I just let them go to a 404 page not found.
White Hat / Black Hat SEO | | Roots70 -
Google SEVERE drop as of last week (oct 10) on long standing .org site
Hello Experts Wanted some imput if possible. I own a .org informational site that has been #1 in its category for Google Yahoo and Bing under a major keyword for years. The site is aged back to 2005 and all of the sudden it dropped on August 10 (Google only- Yahoo and Bing still #1)) but remained atop the primary keywords that it is namesaked for .org (xxxxyyyzzz.org) and then Oct 9-10 it dropped from the page 1 top ranking it had for years on that primary keyword to page 13. I dont know where to begin to look. Any ideas how something like this could happen and what "Stones" I should turn. We purchased the website and are not SEO gurus so just not sure. Any help would be appreciated
White Hat / Black Hat SEO | | TBKO1 -
Should we add our site to Google Webmaster Tools
Hello, Should we add our site nlpca(dot)com to google webmaster tools? Everything's very white hat but we do have a section on each of our 4 sites for "Our other Sites" that link to the others. It's been there for many years. We're looking for clues as to why we've dropped in rank Thanks!
White Hat / Black Hat SEO | | BobGW0 -
Page Rank is 0
Hi. Can you please point me in the right direction concerning a site whose default page has a PR of 0? There does not appear to be any errors in the robots.txt file (that I can tell). When I ran a duplicate content check by searching the title tag and first sentance in quotes it did not return more than 2 sites. When I ran a site: it is reporting 287,000 results. Does this mean that they purchased links and have now been penalized? Or where should I go from here? Thank you for any feedback and assistance.
White Hat / Black Hat SEO | | JulB0