New folder structure
-
We are in the process of relaunching one of our website's that will use a totally need folder structure.
Previously we used mydomain.com/content/country/region/city/district/hotel_name/
Now we are changing to make the URL shorter, more precise - since we are using a new CMS, to be mydomain.com/gb_Hotel-Name/
My question is currently we've in the region of 10,000 pages indexed in Google. So we are going to have to create 301 permanent redirects from the old URLs to the new URLs.
From your previous experience, is this the correct way of approaching the task.
-
Hi Neil.
The sites we have done are all new but from experience dealing with moving to new urls the best thing to do is create a mapping document in excel. It'squite easy if you know that for example:
www.domain.com/berlin-hotel is moving to www.domain.com/de/berlin-hotel.
Then all you need to do is put in the 301s based on the mapping and monitor WMT for issues - you will always miss something.
From what you are saying however there is no logical structure to your site - which will make this harder. I have had to deal with this in the past too, you might just need to identify all of the more important pages and 301 these first and go via mechanical turk of get an intern in or something to just plough away and find all of your urls.
If you have an XML sitemap you should be able to get them all pretty quickly and map from here.
Hope this helps.
-
Hi ASR, can you advise more on how you moved to the new folder structure ? Did you leave old pages in place, launch new site, then go through all old URLs and 301 them to the new URL ?
The problem I have is the new folder structure is not a standard pattern, so any 301 will need to be done manually.
-
either way, it would not hurt to 301 all.
-
Ooops, should have said link juice.
As you can all see Alan and I have different views on this but at least you have a range of views Tommo!
Good luck - hope it all goes well.
-
"A 301 will pass 80% of the page authority over."
No a 301 will pass 85% of its incomming link juice, you are redireceting the inomming links not the page
A 301, passes 85% of its PR from the page to another page though a link from the page.
But if the page no longer exists it can not. Once you delete that page, it no longer has any page rank, but the pages that may link to the old page are still passing PR, so in that case you can redirect those links to the new page. But you cannot redirect the non existing page or any authority it had to the new page.
Read Google’s algorithm, I assure that is not how it works.
http://www.webworkshop.net/pagerank.html
By the way, all links pass 85% of link juice it has though its links, if the link hits a 301 redirect, it loses 15% again. This is so you don’t get infinite loops.
Imagine if you could move a page and somehow gets its PR by doing a 301 redirect. You could keep moving it and it would keep getting more PR.
If I could use an analogy
If you have a store and Bob has a store, and Bob closes down, but puts a sign on his door telling his customers to go to your store, you will get his customers, but you don’t get his stock. And if he had no customers you get nothing.
Anyhow if you read the link you will see that I am correct -
A 301 will pass 80% of the page authority over. You also don't leave any 404s.
I'm not sure why you are so against 301s? It's tidier, "best practice" and not hard to do. Why risk missing something out that might prove the difference?
-
They will reindex them, you dont need to 301 then to get them reindexed.
But they dont have any page rank if the no longer exist. you can only pass link juice though a link, if the page no longer exists then you can not link from it, and there is no link juce juice to pass.
If that were true, you could keep moving a page and its link juice would keep rising.
-
I would 301 all the pages; it's "best practice," IMO.. The old pages had juice just from the fact that they existed; ie. inbound links aren't the only value you want to preserve. And, as ASR points out, best to avoid the 404s. The redirects are not just for the PageRank, but to allow search engines to easily reindex the content.
-
"The pages will still have some authority even without links"
they would if they were still there, but they no longer are, its just a ref to them in the index,
sure if they have some like or links, I agree
If they are in another lingo, they maybe, I dont know, but if they are in the same lingo, I still say they will be duplicate content
-
The pages will still have some authority even without links, so I would definitely pass any little bit there. Social signals too if there are any that might not have been picked up. And I would also worry that while some tools say there are no links, I don't know one 100% reliable tool to tell you page X has no links.
If the local sites are in DE, FR, ES, or whatever, then they are not duplicate, they are local language. IBM, Apple to name a couple certainly do this route also.
Matt Cutts may say that, but we certainly do not suffer from this problem in the least. Another Cutts "we do this but really don't" comment maybe?!
-
I agree it would of worked, but if they had no incomming links, then it was un-necessary.
-
Why must you 301 it, if they have no in comming links. There is no link juice to keep.
As for theTLD's, if they are duplicate content websites, which I assume they are, then you will have duplicate content problems. How will you get around that?
If yopu listen to the Matt Cutts video again, he says at the beginging, if the are all on the same TLD you will be pinged for DC
-
Disagree with you on that one Alan. We have no issue with duplicate content and it is also what everyone (including those at MOZcon this year) recommend.
In fact I have an email from SEOMoz themselves recommending it.
TLD will get better over time but from experience running 7 sites (6 country sites) I would only ever use folders now.
I also disagree with your comments below about not 301ing all old content. You must do this when re-launching.
-
I have to disagree, using the TLD's you dont need to worry about duplicate content.
See Matt Cutts
-
You are having to link build to multiple sites, they are start from zero in a search engines eyes (no matter how strong your current site is), your marketing materials cannont just mention domain.com etc.
Our use of folders with our strong domain strength has seen them launch and a month later be at the top of local search engines for hard to rank for search terms.
I cannot recommend strongly enough that going down the folder route is much better for SEO.
-
Yes, the other .de site for example will be 100% in the local language. What pitfalls do you feel we will have if we went the route of many TLD sites ?
-
Yes that is what I am saying. Definitely head down the domain.com/country-folder ie domain.com/uk
This has a lot of advantages around marketing, all of the links to this one domain help strengthen the entire site instead of having to having to link building to a number of new sites (which are starting from scratch in Google's eyes).
And you can still target them in GWMT by country too - which will definitely work. I am presuming they will be in local language as well?
Hope this helps.
A
-
Currently our domain is domain.com.
But we were thinking about having domain.de, domain.com.cn, domain.es etc. Are you saying this isn't the way to go ? We were looking to host these sites in the TLD country e.g domain.de hosted in Germany.
Examples where this has worked very well is TripAdvisor.
-
Okay. That makes sense but I would stick to one TLD if you could as you can run with folders and all of the country country sites (in the folder) will inherit all of the your one TLD strenght, makes things like link building easier too.
I would strongly recommend this. We have 6 international sites now and three are TLD (before I got here) and three folders and all of the folder sites are doing so much better than the TLD - the difference is amazing.
Even if you go with the new TLD I would miss out the GD_ bit - you don't need that at all if you have a TLD and makes no sense to me. I would rather have domain.com/city-hotels/hotel-name and optimise around this. You can then have landing pages around city hotels ie berlin hotels and pull in traffic this way.
Just a thought!
-
For the new site we will be having international TLD like mydomain.de. Re the GB this is so we initially know what country the hotel is located in, and in some instances hotels have the same name, but in different countries.
-
I would 301 all of the pages - to relevant new pages otherwise you will end up with a heap of 404s too if the old content just disappears. Blogs etc will have linked to them etc, you want to make the US as good as possible.
Mapping out the 301s will take time but be worth it in the long run.
I have done a website with 500,000 pages and mapped it and it worked well.
A
-
i would only bother 301 redirecting those that had incomming links or you will have a mess on your hands.
If you take a short cut and try to 301 on mass to the one page, bing for one will just ignore them as far as link juice goes.
also up untill recenly Matt Cutts said that _ or - were a matter of choice, but now he has stated to use -, cant remember the reason.
After 301ing all pages with in-links, i would just go to google and and remove site (enter root domain). This way yopu get rid of all the old pages and aviod duplicate content.
Others will proabaly not agree. but this is how i do it. Block the site with robots.txt, then remove site in GWMT by entering the domain name in remove url.
Wait a day till its removed, then remove robots.txt block.dont woory, you need to leave a block in place for 90 days to really remove from index. doing this all the pages that still exist will be back in a few days, the rest that 404 will be removed from index.
-
Hi Tommo.
Sounds like the clean up is a great idea. I wonder if you still need the GB at all? Is this for language or country? If you are doing country/language I would have a folder for each ie
domain/en/us/title-of-hotel
You can then geo-target these to country specific areas in GWMT as well - which would be helpful.
And definitely 301 them all - this is a must.
A
-
Yes this is correct, the 301 redirect will forward all juice to the new structure and Google will find this change pretty fast.
If you have a sitemap you could also submit that map to google through webmaster tools, that would update the index faster. Good luck!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Migration to a new domain
Hi everyone, So i have one project where I'm planning to move current content on new domain, two reasons: 1. It seems current domain has some google penalty (backlink related, not manual) 2. Client wants rebranding and already has domain with new brand name. So as content is high quality and there is no content related penalty from google, what would be the best way to migrate existing content without passing any penalty AND without Google treating it as duplicate content. If i do 301 i suspect any penalty there is might follow, if i just copy existing content it won't be original content, what is the best solution here? Thanks
Intermediate & Advanced SEO | | joelsemy0 -
Have I set up my structured data correctly, the testing tool suggests not?
Hi, I've recently marked up some Events for a client in hope that they'll appear as rich snippets in ther SERPS. I have access to their Google Search Console so used the Data Highlighter facility to mark them up, rather than the Raven plugin available for WordPress sites like this. I completed this on 10th July and the snippets are yet to appear - I understand that this can take time and there are no guarantees - but as a novice it would be reassuring if someone can advise that I have done this correctly. We did incidentally resubmit a sitemap after completing this task, but I'm not sure if that makes any difference. I've read that it's the structured data testing tool that I need to use to test my markup, but when I input the urls below, the tool doesn't tell me a lot, which either suggests I've marked it up incorrectly, or don't know how to read it! http://www.ad-esse.com/events/19th-august-2015-reducing-costs-changing-culture-improving-services/
Intermediate & Advanced SEO | | nathangdavidson
http://www.ad-esse.com/events/160915-reducing-costs-changing-culture-improving-services-london/
http://www.ad-esse.com/events/151015-reducing-costs-changing-culture-improving-services-london/ Any guidance welcomed! Many thanks,
Nathan0 -
Wordpress Blog in 2 languages. How to SEO or structure it?
Hi Moz community, I have got a wordpress blog currently in the spanish language. I want to create the same blog content but in english version. (manually translate it to english instead of using translation service such as Google Translate). How should i structure the blog for SEO? How will it work? Any structure markups i should know about? Any examples? Thanks
Intermediate & Advanced SEO | | WayneRooney0 -
Rankings Tanked since new Site redesign land new url Structure ? Anything Glaringly Obvious I need to check ?
Hi All, I've just checked my rankings and everything on my eCommerce Site has pretty much tanked really badly since my new URL structure and site redesign was put in a place 2 weeks ago. My url structure was originally long and had underscores but we have now made it clean, shorter and use hyphens. We also have location specific pages and we have incorporated these into the new url structure.Basically it now pretty much follows the breadcrumb trail on our website. We were originally a general online hire site but now we have become niche and only concentrating on one types of products, so we got rid of all the other categories/products and pages we do not deal with anymore. Our Rankings issue , was only bought to light in the most recent MOZ Ranking report so it's looking site google hates our new store. Someone mentioned the other day, that Google may have been doing a Panda/Penguin refresh last weekend, but I am surprised to have dropped like 20 to 50 places for most of my keywords. We have set up the 301 redirects, We have also made the site alot smaller and set up a few thousand 404's to get rid of a lot of redundant pages . We have cut down massively on the thin/duplicate content and have lots of good new content on there. We did new sitemaps , set up schema.org. , increase text to code ratio . Setup our H1-H5 tags on all our pages. made site mobile responsive.. Basically , we are trying to do everything right. Is there anything glaringly obvious , I should be checking ?. I attach a Short url link if anyone wants to have a quick glance- http://goo.gl/7mmEx i.e Could it be a problem with the new urls or anything else that I should be looking at ?.. I.e how can I check to make sure the link juice is being passed on to the new url ? Or is all this expected when doing such changes ? Any advice greatly appreciated .. Pete
Intermediate & Advanced SEO | | PeteC120 -
PDFs and images in Sub folder or subdomain?
What would you recommend as best practice? Our ecommerce site has a lot of PDFs supporting the product page. Currently they are kept in a sub domain and so are all images. Would it be better to keep them all in a subfolder? I've read about blogs being hosted on a subfolder to be better than subdomain but what about pdfs and images? thoughts?
Intermediate & Advanced SEO | | Bio-RadAbs0 -
Best url structure
I am making a new site for a company that services many cities. I was thinking a url structure like this, website.com/keyword1-keyword2-keyword3/cityname1-cityname2-cityname3-cityname4-cityname5. Will this be the best approach to optimize the site for the keyword plus 5 different cities ? as long as I keep the total url characters under the SeoMoz reccomended 115 characters ? Or would it be better to build separate pages for each city, trying to reword the main services to try to avoid dulpicate content.
Intermediate & Advanced SEO | | jlane90 -
Product URL structure for a marketplace model
Hello All. I run an online marketplace start-up that has around 10000 products listed from around 1000+ sellers. We are a similar model to etsy/ebay in the sense that we provide a platform but sellers to list products and sell them. I have a URL structure question. I have read http://www.seomoz.org/q/how-to-define-best-url-structure-for-product-pages which seems to show everyone suggests to use Products: products/category/product-name Categories: products/category as the structure for product pages. Because we are a marketplace (our category structure has multiple tiers sometimes up to 3) our sellers choose a category for products to go in. How we have handled this before is we have used: Products: products/last-tier-category-chosen/product-name (eg: /products/sweets-and-snacks/fluffy-marshmallows) Categories: products/category (eg: /products/sweets-and-snacks) However we have two issues with this: The categories can sometimes change, or users can change them which means the links completely change and undo any link building work built up. The urls can get a bit long and am worried that the most important data (the fluffy marshmallow that reflects in the page title and content) is left till too late in the URL. As a result we plan to change our URL structure (we are going through a rebuild anyhow so losing old links is not an issue here) so that the new structure was: Products: products/product-name(eg: /products/fluffy-marshmallows) Categories: products/category (eg: /products/sweets-and-snacks) My concern about doing this however, and question here, is whether this willnegatively impact the "structure" of pages when google crawls our marketplace.Because "fluffy marshmallows" will no longer technically fit into the url structure of "sweets and snacks". I dont know if this would have a negative impact or not. FYI etsy (one of the largest marketplace models in the world) us the latter approach and do not have categories in product urls, eg: listing/42003836/vintage-french-industrial-inspired-side Any ideas on this? Many thanks!
Intermediate & Advanced SEO | | LiamPatterson0 -
10,000 New Pages of New Content - Should I Block in Robots.txt?
I'm almost ready to launch a redesign of a client's website. The new site has over 10,000 new product pages, which contain unique product descriptions, but do feature some similar text to other products throughout the site. An example of the page similarities would be the following two products: Brown leather 2 seat sofa Brown leather 4 seat corner sofa Obviously, the products are different, but the pages feature very similar terms and phrases. I'm worried that the Panda update will mean that these pages are sand-boxed and/or penalised. Would you block the new pages? Add them gradually? What would you recommend in this situation?
Intermediate & Advanced SEO | | cmaddison0