SEOMOZ crawler ignoring redirect?
-
My crawl report for www.poker-coaching.net show a number of duplicate content warnings.
First, it shows a warning for www.poker-coaching.net and www.poker-coaching.net/, although there is a redirect in place for this, and for non-www. to www. as well. So IMO there is no duplicate content here, so why the error message?
Next, it shows a duplicate content warning for a number of pages, but when I click the number on the right, there is no info an which pages contain the duplicate content. Will this info be there later when the crawl is completed?My problem is that this is my oldest site, but since over one year it seems to have a penalty which I can't get rid of - I cannot identify the reason for the penalty. I already rebuilt the site from scratch once, but I still do not see results.
If a membership at SEOMOZ would be able to help me bring this site back on track, that would already be worth one years membership fees, so I'd really be very thankful if someone could take a look at the site and give me an idea about what needs to be done here.
-
I just want to make myself a little bit clearer here. While I appreciate any advice on why the site's rankings might be (mildly) affected, I am more interested in finding out why the site might have been penalized (which is most probably the case).
Here are my suspicions:- I had three articles that were 45% duplicate - thanks to one of my writers, may he rest in peace ;)), but they were removed/rewritten 2 months ago
- I had a guy build some links for me about a year ago and he set up a link wheel without my consent, so the link profile might be a problem (too many similar links?)
- Duplicate content because same article exists on my site with different URLs?
- Too many links from main page (as suggested by your colleague, although I doubt very much that this can cause a penalty)
- Panda related - although my content is of good quality
- Site structure for the multiple languages (.net for german is one Joomla installation, and the other /xlang/ is a separate Joomla install where I use Joomfish for the various translation
Any ideas?
-
Think of it this way...
If you got a link from the New York Times, it would boost your rankings. But then imagine the New York Times was caught buying links from terrorist, turns into a porn site, and is penalized by Google (extreme example). Your site wouldn't be penalized by this, but you'd loose the huge boost you once had from the link.
So those links that were once helping you, if those sites were penalized then the links are less valuable. You aren't being penalized, you just aren't getting the good link juice you once had.
Just a possibility.
On the affiliate links... I completely agree with you, and have used a similar technique myself with no problem. I'd simply add a nofollow just to be safe.
-
Duplicate URL: but I do have a redirect in place from with / to without, that's why I was surprised to see this pop up as an error? Actually I redirected http://poker-coaching.net, http://poker-coaching.net/ and http://www.poker-coaching.net/; all point to http://www.poker-coaching.net (suing the function of AceSEF module for this).
Per 1.: Ok this is something I will consider.
Per 2.: I use those redirects on all my sites, never had any problems with those? It's a very common thing with affiliate sites btw.
Per 3.: Isn't it agreed upon that your site cannot be hit with a penalty because a bad neighborhood site links to you (as opposed to me linking to such a site, which of course can be a big problem)? Webmasters don't have control over sites that give them links. If Google were to penalize me for that, would we all be google-bowling our competitors sites?
I can see problems with a link profile where maybe too many links have the same title and thus look unnatural, when you look at my link profile would you say that might be the case?This site has given me so much problem I was considering "selling" it to someone else, host/rebuild it on a different server and do a reconsideration request telling Google I am the new owner... Tried regular reconsideration requests several times, but G always tell me there is no manual penalty, so I must have tripped some algorithm. Question is, which one?
-
Hi Catfish,
Technically, www.poker-coaching.net and www.poker-coaching.net/ are 2 separate URLs. One with the trailing backslash, the other without. To be perfectly compliant, you would want to make sure that one redirects to the other. You can use a tool like this: http://www.seoconsultants.com/tools/check-server-headers-tool/ to check. For example, see how the homepage of SEOmoz does a 301 redirect when it contains a trailing slash - http://www.seomoz.org/ redirects to http://www.seomoz.org
That said, Google has said this isn't that big of deal. So fixing it would make you technically correct, but it probably won't have that big of difference.
On the the penalty... I see 2 potential problems.
1. Huge number of links on each page. The drop down navigation is huge. I've seen Google crack down on sites like this with lots and lots of nav links above the fold. I'd cut those in 1/2 and see what happens.
2. Meta Refresh. You have a lot of affiliate links that redirect via meta refresh. I see that you have blocked these pages with robots.txt, but you might want to add rel="nofollow" to those links as well.
3. A lot of your backlinks are from poker related sites (which is good, in a way) but it is possible that they were hit by penalties as well. If the folks linking to you were devalued, you suffer as well. I'm not saying this is definitely the case, but building a more robust link profile never hurt.
Hope this helps! best of luck.
-
Thanks a lot!
-
Hey Catfish,
Today I have a full scheduled day, but tomorrow I can take a look what is happening over them. We'll keep in touch.
Istvan
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Redirect Code Needed.
Hi, Please help me redirect the following pages in htaccess. https://www.mydomain.com/FolderA/FolderB/number-of-pages.html to **https://www.mydomain.com/FolderA/FolderC/FolderB/number-of-pages.html ** I want to redirect atleast 50 pages like this. Please help Thanks
On-Page Optimization | | Kashif-Amin0 -
How to redirect subdomain to new blog directory
I have moved my wordpress blog from a subdomain to a subdirectory /blog/ on my site. What is the best way to setup a redirect from the subdomain to the new /blog/ directory? Or should I just delete the subdomain blog and wait for google to index it on /blog/. I need to do one or the other so as not to run into duplicate content issues.
On-Page Optimization | | SamCUK0 -
Google crawler showing cache of another page
For the page http://www.thinkdigit.com/top-products/Laptops-and-PCs/top-10-laptops-124.php google is showing another page in cache (http://www.thinkdigit.com/top-products/Ultrabooks/top-10-ultrabooks-153.php). Please let me know how this happened and how to correct it.
On-Page Optimization | | 9dot90 -
Too Many On-Page Links Reported By SEOmoz
Hi, I recently did run a crawl report for my blog dapazze.com, and found that SEOmoz is reporting many pages on my blog having more than 100 internal links. I opened OSE, and made a search for one of my pages which was reported to contain more than 100 links. And I found it to contain 464 internal links. Here is the link: http://www.opensiteexplorer.org/links?page=1&site=dapazze.com%2F2012%2F10%2Fwin-a-commentluv-premium-single-site-and-multi-site-license-worth-about-154-giveaway-of-october%2F&sort=page_authority&filter=&source=internal&target=page&group=0 Please have a look at it. I have chosen - Show "All" links from "only internal" pages to "this page" option in OSE, which reports me this. I see almost every page in my blog linking to every page. This is not the problem for me. I have also tried to make a search for some popular bloggers, like ProBlogger.net, ShoutMeLoud.com, HellBoundBloggers.com, etc, and all of them have the same problem. Should I be worrying about this problem? What is the problem actually?
On-Page Optimization | | rahulchowdhury0 -
Telephone numbers on page getting classed as 404s by SEOMoz
Hi there, I have a number of clients who have their telephone numbers on their sites (understandably of course!) and SEOmoz is classing them as links and therefore a 404 in the crawl software. The protocol is added in the code so if viewing the page on a mobile you can call the client. Should I be doing anything else? Webmaster does not pick these up as 404s so I am wondering if this is an SEOmoz bug or that I should be adding a no-follow? Thanks jT
On-Page Optimization | | Switch_Digital0 -
Brand Name URL Redirecting to Actual URL
So we have already built a site under a parent company's URL: parentcompany.com And now we have their branded product lines in directories: parentcompany.com/brand-name1, and parentcompany.com/brand-name2 We also own the actual URL Brand Name 1 (which is also the exact description of the product): brandname1.com We do not yet own the URL for Brand Name 2 (which is also the exact description of the product): brandname2.com. This is because a squatter is sitting on it and is asking $10,000+ for it. What we are trying to determine is how valuable these brand name URLs are since they will be redirecting and not the actual site's primary domain name. Anybody know how much of an effect owning those and redirecting has on ranking for those brand names that are also very descriptive of the products? Would we be smarter to spend $10,000 on adwords or 10,000 on the domain? Thanks!
On-Page Optimization | | grayloon1 -
Redirect and page ranking
We used to have a good page rank of Google, but now our page rank dropped to zero. A few months ago we did a redirect from our www.???.com to non-www.???.com, because non-www.???.com is now our main website. We also have a number of other domains which we redirect to our main website non-www.???.com Do you think these redirects are causing the problem, and if so what can we do to fix it? Thanks!
On-Page Optimization | | poupette0 -
301 redirect (www.domain.com/index to www.domain.com)
Hello, Please let me know what are the exact right steps in order to get rid of the duplicate content issues related with: www.domain.com/index.html same as www.domain.com without creating an infinite loop. Do you have a step by step guide posted within seomoz including 301 redirect for non www to www for all urls and index.whatever to main domain name without going into a infinite loop ? btw how to you spot the loop ? is it obvious like never ending refresh of the home page ? thanks a lot !
On-Page Optimization | | eyepaq2