Www and non www / duplicate content / redirects / www resolve issue
-
I am not getting docked for these specific errors, but I am getting docked for 1 page has a WWW resolve issue and 1 wrong URL in the sitemap... (SEM Rush) but when I use moz, it's not showing any issues.
So I have these things set up so far:
- In .htaccess i have a command that removes the www.
- 301 redirect from www version to the non www (homepage)
- canonical on index.html pointing to non www version, I also set up a canonical tag for each page on the site
- search console with non www, www, https www, https non www all set to non www preference.
Also, when I fetch the www version in google search console it says it's being 301 redirected to non www version which is basically what I want.Is there anything that i'm missing? These errors on SEM Rush are giving me anxiety lol.
-
How many pages have your website?
-
Hey there! Tawny from Moz's Help Team here.
Unfortunately, I don't know that I'm actually equipped to answer your question. I can speak to how Moz's tools determine duplicate content, but I don't know how you'd go about implementing solutions for errors you're seeing with SEMrush. Sorry about that!
Hopefully one of our wonderful community members will have more insight than I do. Sorry I couldn't be more help!
If you do have questions about Moz's tools, feel free to give us a shout at help@moz.com and we'll see what we can do.
-
That is the jyst of it, I removed some of the 301's when I pasted it here, just because it was long.
-
Options -Indexes +FollowSymLinks -Multiviews
RewriteEngine on
RewriteBase /Remove "www."
RewriteCond %{HTTP_HOST} ^www.(.)$ [NC]
RewriteRule ^(.)$ http://%1/$1 [R=301,L]RewriteCond %{HTTPS} on
RewriteRule (.*) http://%{HTTP_HOST}%{REQUEST_URI} [R=301,L]Remove ".html"
RewriteCond %{THE_REQUEST} .html
RewriteRule ^(.*).html$ /$1 [R=301,L]Redirect "home" and "index" to document root
> Here, the expression (home|index) means "home or index"
RewriteRule ^(home|index)/?$ / [R=301,L]
Redirect any requests for html files to index
RewriteRule ^(.+).html index.php?page=$1 [L]
Rewrite any request for subdirectories to index
RewriteCond %{REQUEST_FILENAME} !-f
RewriteRule ^(.+)$ index.php?page=$1 [L,QSA]EXPIRES CACHING
<ifmodule mod_expires.c="">ExpiresActive On
ExpiresByType image/jpg "access 1 week"
ExpiresByType image/jpeg "access 1 week"
ExpiresByType image/gif "access 1 week"
ExpiresByType image/png "access 1 week"
ExpiresByType text/css "access plus 1 month"
ExpiresByType application/pdf "access plus 1 month"
ExpiresByType text/x-javascript "access plus 1 month"
ExpiresByType application/x-shockwave-flash "access plus 1 month"
ExpiresByType image/x-icon "access plus 1 year"
ExpiresDefault "access plus 2 days"</ifmodule>EXPIRES CACHING
<ifmodule mod_expires.c="">ExpiresActive On
ExpiresDefault "access plus 7200 seconds"
ExpiresByType text/javascript "access plus 2592000 seconds"
ExpiresByType application/javascript A2592000
ExpiresByType application/x-javascript "access plus 2592000 seconds"</ifmodule>6 month for most static assets
<ifmodule mod_headers.c=""><filesmatch ".(jpg|jpeg|png|gif|gs|ico)$"="">Header set Cache-Control "max-age=1576800, public"</filesmatch></ifmodule>
Cache-Control Headers
<ifmodule mod_headers.c=""><filesmatch ".(js)$"="">Header set Cache-Control "max-age=2592000, private"</filesmatch></ifmodule>
-
I'll send you a pm...
-----EDIT nevermind the formatting was really bad over pm.
-
Can you post your .htaccess rules here?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz Pro: Redirect Chain warning given to pages that don't have redirects
When I look up crawl errors for a page, I'm always told the page suffers from redirect chaining. However, when I do a redirect check (in this case, using the Redirect Path Chrome extension), it indicates that my page does not use a redirect. Why would Moz detect redirects, while no other redirect checker resource does? For example, this URL gets Moz's redirect chain warning: https://www.aem.org/news/january-2018/5-reasons-iot-projects-fail/ But there is no redirect associated with this URL.
Moz Bar | | jrichter0 -
Site Crawl report show strange duplicate pages
Beginning in early in Feb, we got a big bump in duplicate pages. The URLs of the pages are very odd: Example URL:
Moz Bar | | Neo4j
http://firstname.lastname@website.com/dir/page.php
is duplicate with http://website.com/dir/page.php I checked though the site, nginx conf files, and referral pages, and could not find what is prefixing the pages with 'http://firstname.lastname@'. Any ideas? The person whose name is 'Firstname Lastname' is stumped as well. Thanks.0 -
Unusual "internal links" causing SEO issues?
Hi all, I'm working on an ecommerce site which has been around for almost 20 years. Over the years it has started to suffer in Google's search results and the decision was recently made to completely overhaul the site. We're now very happy with the website's design, and care was taken to maintain page rank via 301s, etc. However, the site has just fallen off the bottom of Google's first search result page (for the first time in years) for our main keyword. I signed up here in the hope of using Moz's SEO tools to help us return to our former glory, but I'm seeing some confusing results: I've run a crawl test on our site, as well as on our two biggest competitors. One thing that really stood out was that we have over 1000 "internal links" to our homepage, whereas our competitors both have around 20-30 (both of which appear at the top of the first SR page). Since the rest of the "on-page SEO" looks OK, I suspect that this could be causing our problems, but I don't understand where this "internal links" number is coming from. Links to our competitor's homepage appear in the navigation bar on every single one of their product pages (which they have about 500 of), yet your report only claims that they have 30 links. The only link to the homepage appears in the site's main navigation bar (which obviously appears on every product page - exactly as it does on our competitors' sites). Additionally, almost every other page on our site apparently has 0 "internal links" and 0 page authority. Is this a problem with Moz's crawl test tool, or is our site actually at fault? The above has been asked directly to Moz staff, but I haven't had a reply. I'd hugely appreciate any words of wisdom from the community. Many thanks in advance. Nick
Moz Bar | | nick45010 -
I update content and then craw but the MOZ spider still shows old content. Do I need to update something else?
"This shows but was replaced a day before I ran Moz crawer: | We provide a full service for low cost automated phone calls, robocalls, Bulk SMS service, Political robo calls without needing computer skills | "
Moz Bar | | ThomasDaBomb
I look in the link on website and see:
<title>Our customers talk about: Currently the tremendous growth of organi</title> Why does the craw not reflect the current content? Thanks.
Thomas0 -
Duplicate Home Page in Moz Report
I recently ran a crawl report in MOZ for www.laddersfree.co.uk and it has picked duplicate pages for my home page. The two pages are www.laddersfree.co.uk and www.laddersfree.co.uk The CMS System my developer is using is Concrete5. If you look at the source code there is a Canonical <link rel="<a class="attribute-value">canonical</a>" href="http://www.laddersfree.co.uk/" /> I am very confused as to why there are two pages picked up in the crawl. Can someone offer any advice please? Thank you. Jason
Moz Bar | | gymmad0 -
WP 4.0 Update Causing Major Duplicate Content Errors?
According to my moz analytics, my site has went through the roof with duplicate content. There's a nice Mozzer named Abe looking into this with me, but I'm wondering if it could be due to the WP 4.0 update. Has anyone else experienced an uptick like this before? I've never had any problems with the other updates. Thanks, Ruben
Moz Bar | | KempRugeLawGroup0 -
Moz Crawl Showing Duplicate Content But It's Not?!
Unfortunately I can't give out the URL, but here's the deal... I have two URL's which have completely different content on them but are being crawled as duplicate content. Any Idea how that would happen? I'm not seeing any errors in WMT's. Has anyone seen this before? Is the duplicate content reporting based on a % of the page content matching as the same?
Moz Bar | | Swarm-SEO0 -
Crawl Diagnostics - nofollow - reducing duplicate pages
Hi I'm looking at a crawl diagnostic report, I can see I have many duplicate pages, the reason for this is that when a brand filter is applied to a page. IE
Moz Bar | | chameleondm
www.mysite.com/mycategory - lets say this is the product listing page
www.mysite.com/category/mybrand - and this is the same page but with a brand filter applied
www.mysite.com/category/myotherbrand - and this is the same page but with a different brand filter applied I had intially appendeded the meta title, description and keywords with some extra content if a brand filter was applied, because the page on the whole does have different content. IE I would have a custom meta information, H1 tag and products on that page just for that specific brand.
However I am wondering if these two pages are really just competing with each other as lots of the content will be the same. Should I scrap that approach and use either nofollow on the brand filter link, or simply use a canonical. Thanks, James1