Aren't domain.com/page and domain.com/page/ the same thing?
-
Hi All,
A recent Moz scan has turned up quite a few duplicate content notifications, all of which have the same issue. For instance: domain.com/page and domain.com/page/ are listed as duplicates, but I was under the impression that these pages would, in fact, be the same page.
Is this even something to bother fixing or a fluke scan? If I should fix it does anyone know of an .htaccess modification that might be used?
Thanks!
-
Wow, thanks guys! This is indeed an enterprise level site, so especially thanks to CleverPhD for the breakdown on trailing slash v. no trailing slash. Redirecting as we speak.
-
You bet Jesse - thank you. I do work at the enterprise level and so it would make sense that this would become a bigger issue on larger sites. I would still say it could become an issue on smaller sites as people do tend to add the slash at the end and so you end up with a duplicate issue.
Full disclosure, I run sites due to legacy issues do not end with the slash. They run just fine. The key is to be consistent.
P
-
Interesting Clever, thanks for posting that. To be honest your points all make perfect sense. I've just never had that situation come up. To Frank's point, organization with or without slash doesn't matter much for smaller sites but as you said I can see how using the slash could make your analytics tracking much easier.
Perhaps it depends on the size of the site, but either way I hadn't thought of it in that detailed-a-manner and am glad you posted it.
Thanks as always !
-
As others have already mentioned, it is typically considered a separate page. Whether you choose with the slash or without is your preference. If a site is small I will typically opt for with/without the slash, but if a site is large and there are many different pages and the structure gets quite large I default to using the slash.
Not sure if the site you are mentioning is Wordpress based or not, if so there there are plugins that can help with this issue as well.
-
They are different and you need to setup 301s to correct, also check all your menus etc to make sure that you use them consistently - this includes in emails etc - consistency is the key.
You can go with slashes or no slashes, as long as you are consistent, I have run sites both ways.
I will disagree with Jesse one thing - I would strongly recommend using the ending slash. I have several reasons why.
-
The url ending in a slash traditionally represents a folder with pages/documents/images inside that folder. Used to be that we would use a URL like /folder/index.htm with index.htm being the default page. It used to be that if you did not designate any file as an index file, assuming the permissions on the folder were set correctly, you would see all the content in that folder. Later, you could designate a default index file and so when you left it blank by ending in a slash it would show the content of the default page without needing the index.htm to be included. Now this issue can cause duplicate content problems (but that is another story).
-
Knowing all that above, many of your web analytic and other reporting software would create reports using a given folder Google Analytics is a good one. If you use the conent drilldown tool, it automatically organizes your reports by looking at the slashes and then grouping pageviews and visits according to the folder structure.
3) Separately, you had development code that used the folder system in the url as a way to parse what the user wants and then deliver a page. This is why you can now have a url like /article/file and you do not need a .htm or .php or .html at the end as the server knows what to do with it without seeing the final extensions.
What happens then is that you end up with URLs like this
/toys/age6-8
/toys/age6-8/redball
/toys/age6-8/blueball
/toys/age9-10
/toys/age9-10/remote-car
/toys/age9-10/remote-control-train
You can see this is a toy store and they are grouping toys by age. Balls are better for younger children vs remote vehicles for older children. In your GA reporting, if you assume that a slash indicates a new folder
/toys/age6-8 would not be included in the report with the products as it would be seen as a page within the /toys/ folder. Same thing with /toys/age9-10
You have your most important page not grouped with all the products it contains.
This is one of the reasons that I prefer ending with the slash. Can you do it the other way, sure, but it just adds more hassle. The folder ending in a slash is a convention that most people follow and frankly, you will find that users also tend to end in a slash when they put in a url. You end up with links to your site where they have a slash and one is needed.
Old habits are hard to break and so this is why I recommend going with the ending slash.
-
-
As for the htaccess fix, a simple 301 redirect from one to the other will do it. I recommend going with the no-slash format.
-
Technically they are different URLs.
http://googlewebmastercentral.blogspot.com/2010/04/to-slash-or-not-to-slash.html
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
URL Parameters causing duplicate content - Login/Registration page
All, I just recently acquired a new client and right away I noticed an abundance of duplicate content being recorded after the moz crawl diagnostics was completed. After a quick digest of the issue, it seems that the majority (90%) of the outlined duplicated content is stemming from the client's Login/Registration page. Upon clicking (without being logged-in) any asset or forum discussion board link within the site, the user is automatically redirected to the Login/Registration page, which seems to create this massive redirect loop associated with dynamic url parameters. Ex. After clicking on a select internal link (asset or discussion board) the user is redirected to the Login/Register page which presents the page and a URL that looks a lot this this: Ex. 1 https://www.clientsite.com/register-login?ReturnUr...xxxx%xxxx%xxxx%...... Ex. 2 https://www.clientsite.com**/register-login?returnurl=/register-login?returnurl=/register-login?returnurl=/page-titl**e/ These URLs seem to becoming larger and larger... The client wants to ensure users have to Login/Register within their site before they're allowed to view the content. This process doesn't allow for any type of preview page to be viewed by a user prior to clicking on the internal link, which in turn doesn't allow any preview pages to be indexed. Right now, Moz is picking up all of the redirect and labeling them as duplicate page content/duplicate page titles based on the Login/Registration page. Questions/Comments: Would it be wise to create preview pages for the asset pages and discussion board pages to allow for proper indexing? - Could this be a CMS issue? Current being used on this is, Kentico. There are thousands of pages being recorded in the crawl as duplicate, however only 14 seem to be indexing with duplicate title tags. 301 or canonical redirect strategy? Moz crawl data issue? Again, this is my first look at this issue, so more information is bound to come out soon! Please let me know if anyone has run into this issue and if you have a possible solution to get rid of this redirect loop process. Thanks! -T
Moz Pro | | MattLacuesta0 -
Rogerbot crawls my site and causes error as it uses urls that don't exist
Whenever the rogerbot comes back to my site for a crawl it seems to want to crawl urls that dont exist and thus causes errors to be reported... Example:- The correct url is as follows: /vw-baywindow/cab_door_slide_door_tailgate_engine_lid_parts/cab_door_seals/genuine_vw_brazil_cab_door_rubber_68-79_10330/ But it seems to want to crawl the following: /vw-baywindow/cab_door_slide_door_tailgate_engine_lid_parts/cab_door_seals/genuine_vw_brazil_cab_door_rubber_68-79_10330/?id=10330 This format doesn't exist anywhere and never has so I have no idea where its getting this url format from The user agent details I get are as follows: IP ADDRESS: 107.22.107.114
Moz Pro | | spiralsites
USER AGENT: rogerbot/1.0 (http://moz.com/help/pro/what-is-rogerbot-, rogerbot-crawler+pr1-crawler-17@moz.com)0 -
Moz Crawl Test: WordPress sites with and without /feed and /trackback entires?
I have multiple WP websites and on some of the websites, on my Moz Crawl test, I see an entry for every blog post but also entries for /feed and /trackback for that single blog post. For example, www...com/someArticle www....com/someArticle/feed www...com/someArticle/trackback 1. Can anyone explain why the Crawl test is picking up the /feed and /trackback items? Is it simply because they are 301 redirects to the original post (www...com/someArticle)? 2. What setting(s) in WordPress are making this information appear? Or is it just that the site(s) that have the /feed and /trackback are displaying "normal" behavior for a WP site with a lot of trackbacks and feed entires? 3. Should /fee and /trackback, as well as /author be blocked in robots.txt? Thanks in advance for your advice and input!
Moz Pro | | Titan5520 -
Not all pages are being crawled
I am set up on the PRO plan, I was under the impression that it would crawl up to 10,000 pages. My site has just over 200 pages, but whenever I am crawled it only crawls 121 pages. Is this normal? It's hard to know how reliable my data is because a significant amount of pages are missing.
Moz Pro | | KristinHarding0 -
Error on duplicated content, but when checking shouldn't been possible
Dear all, Every week I look at the different crawl reports for our website, since the start of my SeoMoz membership the Errors for duplicated content and duplicated Title is rising. But if I take out the .csv file and look in more detail, and select a pages which is marked as duplicated content, a canonical is actually existing on this page. So it shouldn't be an warning, I have no idea what the issue could be. For example pagesare marked as duplicated content, <colgroup><col width="966"></colgroup>
Moz Pro | | Letty
| http://www.zylom.com/es/descargar-juegos/3-en-raya/?sortby=2 |
| http://www.zylom.com/es/descargar-juegos/3-en-raya/?startnumber=60&sortby=2 |
| http://www.zylom.com/es/descargar-juegos/3-en-raya/?startnumber=80&sortby=2 | the parameters after '?' (question mark) are necessary for our internal system. To overcome duplicated content we coded that a canonical tag onis placed on every page with parameters and the main page is http://www.zylom.com/es/descargar-juegos/3-en-raya/ but it doesn't seem to work, because my error warnings are still rising. Please advice me Kind regards, Ms Letty van Eembergen0 -
How to Optimize a Home Page?
Can anyone advise on what is the best way to optimise the home page? Many websites I see include the target(focus) keywords from other pages on the home page. Is this self competition? "Avoid Keyword Self-Cannibalization- It's a best practice in SEO to target each keyword with a single page on your site" If an e-commerce website has 4 levels in the SEO architecture. Home Page, Brand Pages(Category), Range pages(sub-category) and individual product pages. It would seem that the main keywords would be within the category(brands) level of a website. However many websites I see include these on the home page as well. Could someone please clarify this? I do not recall seeing the report card saying Self-Cannibalization when these keywords(category level) are listed on the home page. However I could be wrong, Please could someone advise on what SEO MOZs recommendations are for best practise on optimizing a home page so that it does not compete with category pages, or other pages on the website. Thanks
Moz Pro | | WMA0 -
I'm trying to get 'tigi bed head' up most of all...
I'm 87th ish with this term and I don't know why?! crap result I know. With every other phrase I use 'cheap tigi bed head' 'buy tigi bed head online' etc etc, we are on the first page all day long, pls help this worthy cause? I am www.thehairroom.co.uk, free hair products for the best results. Thank You.
Moz Pro | | smoki6660 -
Duplicate page title
I own a store www.mzube.co.uk and the scam always says that I have duplicate page titles or duplicate page. What happens is thn I may have for example www.mzube.co.uk/allproducts/page1. And if I hve 20 pages all what will change from each page is the number at the end and all the rest of the page name will be the same but really the pages are if different products. So the scans think I have 20 pages the same but I havent Is this a concern as I don't think I can avoid this Hope you can answer
Moz Pro | | mzube0