Data Structure, Indexing and Canonicals
-
I was wondering if anyone would be able to share some data structure/indexing best practices. We have a site that has pages designed to display National/State/City level data - all pages have slight variations in the data and descriptions - but we're seeing google index some of the city level data for national level keywords.
the URL structure is www.mysite.com/Country/State/City/Topic.html
For example - if the query was "what is the price of beans?" we're seeing Google pick up localized versions - i.e. mysite.com/US/CA/San_Francisco/price-of-beans.html - when it should be picking up mysite.com/US/price-of-beans.html
I've toyed with the idea of using the national level page as the canonical for the state/city pages - but I don't want to hurt state/city level keywords.
Because some of the pages have only slight variances - we are also seeing a lot of soft 404 errors - We're assuming that Google is seeing the pages as duplicates even though the content is different.
Any insight/suggestions are appreciated.
-
Of course anytime. If you would like to give me other examples for a look at the site I can give you a lot more information.
Glad to be of help!
Tom
-
Thank You Tom! This is a lot of information to digest - I will review and let you know if I have any additional questions - but I wanted to thank you for your prompt response!
-
I have underlined and italicized your questions and answer them the best I can this hour. I also gave you all references and I hope you will start using topic clusters and pillar pages or hub pages there are a few words these. Below I have outlined what I would do with the URL structure remember simple as possible.
Please let me know if you have any questions I know the information I'm giving you is a lot. I want to answer your question thoroughly and I know if you go through this you will have a much better understanding.
You want to create relevancy and make sure you're not going to deep or more than three clicks away from the homepage. You can also use tools like deep crawl to tell you the deep rank this is a score that is provided to show you the power of your internal links. You can use Oncrawls INscore to do the same thing.
Saving you a lot of the work described in the information below. At the end of the day, you want to build a pillar page and have topic clusters
- https://www.distilled.net/difference-between-url-structure-and-information-architecture/
- https://www.slideshare.net/dohertyjf/id2013-optimizing-your-websites-architecture-for-seo
- https://www.getcredo.com/talk-website-architecture-seo/
- https://moz.com/blog/15-seo-best-practices-for-structuring-urls
- https://support.google.com/webmasters/answer/76329?hl=en&ref_topic=4617741
- https://blog.hubspot.com/marketing/pillar-page-examples
"National/State/City level data - all pages have slight variations in the data and descriptions - but we're seeing Google index some of the city level data for national level keywords".
Are you going after more than one country?
_www.mysite.com/Country/State/City/Topic.html _ ( do not use capitals when making URLs. It makes a separate URL entirely)
You do not to the country unless you are using hreflang? remember if you're not you can determine the country you want to target in Google search console the old version these are the instructions https://support.google.com/webmasters/answer/6059209?hl=en
-
remember mobile first means shorter URLs
-
hostname/2 letter country or language/state (abbreviation)/city
-
ideally/category = tx or (the state of Texas)/city
-
/products/category/sub-category/slug
-
Decisions about URL structures and decisions about the IA of your website both involve questions about grouping and hierarchies of pages. For example:
URL: should the path of an individual product be:
/product-slug
/products/slug
/products/category/slug
/products/category/sub-category/slug -
IA: how should we group our product pages and link between them:
Should there be a link “up” to the parent category?
How many “levels” of sub-category page types should there be?
How do we link between sibling products in the same (sub-)category?
How many products can we reach in (e.g.) 3 clicks from the homepage? -
then as you add more things to the city of Dallas you can keep them in a pillar page
the categories to track are:
- Page URL
- Cluster topic
- Subcluster (if applicable)
- Keyword to rank for
- Is it linked to the pillar page? (Y/N)
- Is it relinked (if applicable)? (Y/N)
- Any other other actions needed
- Has the other action been taken yet? (Y/N)
- Links out to pages 1, 2, 3, and/or 4
- Is it also a sub-pillar page (if applicable)? (Y/N)
( if you do not do business outside of the United States do not place the country's name in the URL)
If you are getting good results with the "state/city pages" referenced below and replace their conical tag it will not index
_"I've toyed with the idea of using the national level page as the canonical for the state/city pages - but I don't want to hurt state/city level keywords." _
If you replace the state/city pages with the national level pages and the state/city pages are ranking well they will cease to rank well because you will have no index them.
I will add more to this tomorrow I hope this is better for help,
respectfully
Tom
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Discourage search engines from indexing this site AFTER a site launch
Hi, I have unticked "Discourage search engines from indexing this site" a few months before the initial release of my website. I don't want to be found by search engines until the official release (still a few months left). Do you think that ticking this box again will harm the website's long-term ranking or have any repercussion on the website? Do you have any additional advice to avoid being temporarily ranked until the official release which won't harm the website in SERPs? Thanks for your answers.
Local Website Optimization | | Juvo0 -
No Index, No Follow Short *but relevant) content?
One of the sections of our blog is "Community Involvement." In this section, we post pictures of the event, what it was for, and what we did to help. We want our clients, and potential clients, to see that we do give back to our local community. However, thee are all very short posts (maybe a few hundred words). I'm worried this might look like spam, or at the very least, thin content to google, so should I no index no follow the posts or just leave them as is? Thanks, Ruben
Local Website Optimization | | KempRugeLawGroup0 -
Google still indexing home page even after with 301 - Ecommerce Website
Hi all,
Local Website Optimization | | David1986
We have a 301 redirect problem. Google seems to continue indexing a 301 redirect to our old home page. Even after months. We have a multiple language domain, with subfolders: www.example.com (ex page, now with a redirect to the right locale in the right country) www.example.com/it/home (canonical) www.example.com/en/home (canonical) www.example.com/es/home (canonical) www.example.com/fr/home (canonical) www.example.com/de/home (canonical) We still see the old page (www.example.com) in Google results, with old metadata in English and, just in some countries (i.e.: France), we see the correct result, the "new" homepage, www.example.com/fr/home in first position.
The real problem is that Google is still indexing and showing www.example.com as the "real" and "trusted" URL, even if we set: a 301 redirect the right language for every locale in Google Search Console a canonical tag to the locale url an hreflang tag inside the code a specific sitemap with hreflang tag specified for the new homepages Now our redirect process is the following (Italy example).
www.example.com -->301
www.example.com/en/home --> default version --->301
www.example.com/it/home --> 200 Every online tool, from Moz to Bot simulators see that there is a 301. So Correct. Google Search Console says that: on www.example.com there is a 301 (correct) in the internal link section of Google Search Console the www.example.com is still in first position with 34k links. Many of these links are cominig from property subdomains. Should we change those links inside those third level domain? From www.example.com to www.example.com/LOCALE/home? the www.example.com/LOCALE/home are the real home page, they give 200 code Do you know if there's a way to delete the old home page from Google results since this is 301? Do you think that, even after a 301 redirect, if Google sees too many internal links decides to ignore the 301? Thanks for your help! Davide0 -
Should I use Rel-Canonicals links for a News site with similar articles each year
Our small town news site provides coverage in a lot of seasonal areas, and we're struggling with the current year's content ranking above previous years. For instance, every year we cover the local high school football team, and create 2-3 articles per game. We'll also have some articles preseason with upcoming schedule and general team "talk". We've seen where articles from past seasons will rank higher than the current season, presumably because the older articles have more links to them from other sources (among other factors). We don't want to delete these old articles and 301 them to the newer article, since most articles include information/stories about specific players...and their families don't want the article to ever come down. Should we rel-canonical the older articles to the newer one, or perhaps to the "high school football" category page? If to the category page, should we rel-canonical even the new articles to that main category page? Thanks for the help.
Local Website Optimization | | YourMark.com0 -
Structured Data Question: Is there any value in "Custom Search Result Filters" structured data?
I have been doing a structured data test for a client who is looking to improve their local SEO. After running several tests in Google Developer Tools structured data testing tool I have been noticing data sets for "Custom Search Result Filters" and "Unspecified Type" structured data properties. I have plans to apply Organization and Local Business schematic markup. However my question is this: do the "Custom Search Result Filters" and "Unspecified Type" offer any value at all? I would like to have a response to our client if they ever ask about this. I attached a snapshot of what this looks like. ydu32k6.jpg?1
Local Website Optimization | | RosemaryB0 -
How best to clean up doorway pages. 301 them or follow no index ?
Hi Mozzers, I have what is classed as doorway pages on my website. These have historically been location specific landing pages for some of our categories but from speaking to a number of different webmasters , then general consensus is that they are not in google guidelines so I will be getting punished by having them. My options are : I can 301 the pages back to their original category pages . This will conserve some link juice to pass back to the respective category page. I can set these as Follow No index. Not sure what will happen here with regards to link value etc. What would be best ?... Some of the pages do currently rank "fairly well" for some of the locations so I am getting traffic from them but I also know I will be getting a algorithmic penalty for having them so how best I clean these up ?. Also , by cleaning up the site structure , would I see any benefit here ? or will I have to wait for a new panda update/ refresh ? I thought the panda refresh won't use a new dataset thanks Pete
Local Website Optimization | | PeteC120 -
What to do with localised landing pages on listings website - Canonical question
Hi Run a pet listings website and we had tonnes of duplicate content that we have resolved. But not sure what to do with the localised landing pages. We have everything pointing back back to the main listings URL http://www.dogscatsandpets.co.uk/for-sale-stud-and-adoption/ but haven't pointed the URLs that show pets for specific towns and cities eg http://www.dogscatsandpets.co.uk/for-sale/dogs-and-puppies/in-city-of-london/ back to the main url. Obviously this is giving us duplicate content issues, but these pages do rank in local search and drive traffic into the site. So my question is should we canonicalise the local pages back to the main url and if we do will this mean our local landing pages will no longer rank? Is there any alternatives?
Local Website Optimization | | dogscatsandpets0 -
International Site Geolocation Redirection (best way to redirect and allow Google bots to index sites)
I have a client that has an international website. The website currently has IP detection and redirects you to the subdomain for your country. They have currently only launched the Australian website and are not yet open to the rest of the world: https://au.domain.com/ Google is not indexing the Australian website or pages, instead I believe that the bots are being blocked by the IP redirection every time they try to visit one of the Australian pages. Therefore only the US 'coming soon' page is being properly indexed. So, I would like to know the best way to place a geolocation redirection without creating a splash page to select location? User friendliness is most important (so we don't want cookies etc). I have seen this great Whiteboard Friday video on Where to Host and How to Target, which makes sense, but what it doesn't tell me is exactly the best method for redirection except at about 10:20 where it tells me what I'm doing is incorrect. I have also read a number of other posts on IP redirection, but none tell me the best method, and some are a little different examples... I need for US visitors to see the US coming soon page and for Google to index the Australian website. I have seen a lot about JS redirects, IP redirects and .htaccess redirects, but unfortunately my technical knowledge of how these affect Google's bots doesn't really help. Appreciate your answers. Cheers, Lincoln
Local Website Optimization | | LincolnSmith0