Google sees redirect when there isn't any?
-
I've posted a question previously regarding the very strange changes in our search positions here http://www.seomoz.org/q/different-pages-ranking-for-search-terms-often-irrelevant
New strange thing I've noticed - and very disturbing thing - seems like Google has somehow glued two pages together. Or, in other words, looks like Google sees a 301 redirect from one page to another.
This, actually, happened to several pages, I'll illustrate it with our Flash templates page.
URL: http://www.templatemonster.com/flash-templates.php
Has been #3 for 'Flash templates' in Google.Reasons why it looks like redirect:
Reason #1
Now this http://www.templatemonster.com/logo-templates.php page is ranking instead of http://www.templatemonster.com/flash-templates.php
Also, http://www.templatemonster.com/flash-templates.php is not in the index.
That what would typically happen if you had 301 from Flash templates to logo templates page.Reason #2
If you search for cache:http://www.templatemonster.com/flash-templates.php Google will give the cahced version of http://www.templatemonster.com/logo-templates.php!!!
If you search for info:www.templatemonster.com/flash-templates.php you again get info on http://www.templatemonster.com/logo-templates.php instead!Reason #3
In Google Webmaster Tools when I look for the external links to http://www.templatemonster.com/logo-templates.php I see all the links from different sites, which actually point to http://www.templatemonster.com/flash-templates.php listed as "Via this intermediate link: http://www.templatemonster.com/flash-templates.php" As I understand Google makes this "via intermediate link" when there's a redirect? That way, currently Google thinks that all the external links we have for Flash templates are actually pointing to Logo templates?The point is we NEVER had any kind of redirect from http://www.templatemonster.com/flash-templates.php to http://www.templatemonster.com/logo-templates.php
I've seen several similar situations on Google Help forums but they were never resolved.
So, I wonder if anybody can explain how that could have happened, and what can be done to solve that problem?
-
Funny, we had that self-pointing canonical tag since July 8th - just removed it less than a day ago as we thought it might be harmful. So, that means that it didn't help as it was there all the time.
-
It is perfectly standard for the "real" page to show a canonical to itself. For example, look at the code for this Q&A question. It has a canonical tag pointing to itself.
A loop would be created only if you made an error. If you set the canonical for Page A as B, then you set the canonical for Page B as A, then you would have created a loop which should be fixed. If you designate the canonical for Page A as B, and the canonical for Page B as B, that would be perfectly valid.
In summary, yes I am suggesting that all pages involving /flash-templates.php including the page itself should use the canonical tag. At the very least add it to both the flash-templates.php page and the logo-templates.php page, each pointing to themselves.
-
Actually, we do use canonical on pages with parameters such as this one:
http://www.templatemonster.com/flash-templates.php?aff=affiliate
or this
http://www.templatemonster.com/flash-templates.php?from=2&type=9Do you suggest that we place canonical on the page itself, won't it create some kind of infinite loop? If http://www.templatemonster.com/flash-templates.php refers to itself as canonical?
-
I noticed you still have not added the canonical tag to your pages. If you do not wish to add them to all the pages in your site would you consider at least adding it to a couple of your affected pages to see if there is any impact?
You wont notice any difference until the pages are crawled again, but if you don't make any change at all this issue may remain.
I would also suggest your site requires a higher level of security then most e-commerce sites. Your audience and customers are often developers with various levels of experience. Any unhappy customer or developer will often have at least some knowledge related to website security, not to mention your competitors.
If you use a solid backup system you can compare the files from your current site with the files from a backup taken in June to see if you have any infected files.
-
Can you determine whether this is happening to any other pages right now?
Whenever we see this type of thing, we look at the development schedule to see which dev changes have recently been implemented. As everyone else has noted, I don't see anything out of place either but sometimes it's easier to look at specific recent dev changes.
Has the page been crawled since last cache? If not, maybe it would be a good idea to 'help' google crawl it a little more quickly to see if things get resolved.
-
A few other points.
site:templatemonster.com/flash-templates.php
Doesn't show anything, (except the few items which you have blocked by robots.txt, so that is normal) which leads me to believe you had an issue as Ryan said on July 19th. Luckily they kept you in the results for "Flash templates" even with a different page.
I would also advise to add descriptions to all pages at the same time you are adding canonicals. Why does the 'Problem' page flash-templates.php not have a description tag? Perhaps a coding issue that is causing this issue as well?
-
I have looked at your page header codes, anchor links, html code on both pages along with the robots.txt for your site. There is no apparent reason for this issue.
The google cache URL for your logo-templates page is: http://webcache.googleusercontent.com/search?q=cache:http://www.templatemonster.com/flash-templates.php
Your Google cache is clearly displaying the wrong page as it appeared on July 19th.
You have two options. You can do nothing and see if the issue resolves itself after the next Google update. Another choice, which I would recommend, is to add the canonical tag to all your pages. The canonical tag is helpful for numerous reasons. I add the tag to every page. That tag should clear up any confusion that occurred.
-
P.S. have you tried using the Fetch as Googlebot tool in WMT?
-
So you are certain that you never had any type of redirect or canonical tag that might account for this. Hmmm, this looks weird.
After looking at this issue and your previous question, I'm stumped. I don't see any redirects, canonicals, etc that could cause this. My best suggestion is to try to get the ear of someone at Google (maybe try Matt Cutts?).
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is it worth keeping a decades-old domain that's merely 301 redirecting to the main domain?
Hi fellow Moz SEOs, We have a bigger client who we just did an SEO Site Audit for, and it was discovered that they have several domain names that are simply 301 redirecting to their main domain name. One of their domains in particular is decades old, and the client is asking if there is any value in keeping it (and the others), or simply leaving them as-is. Considering the domain age, does anyone have any recommendations? Much appreciated, Zack Barton
Intermediate & Advanced SEO | | Zack
Barton Interactive
(833) 442.6853 // office
(408) 910.7750 // mobile
https://bartoninteractive.com0 -
Crawl and Indexation Error - Googlebot can't/doesn't access specific folders on microsites
Hi, My first time posting here, I am just looking for some feedback on a indexation issue we have with a client and any feedback on possible next steps or items I may have overlooked. To give some background, our client operates a website for the core band and a also a number of microsites based on specific business units, so you have corewebsite.com along with bu1.corewebsite.com, bu2.corewebsite.com. The content structure isn't ideal, as each microsite follows a structure of bu1.corewebsite.com/bu1/home.aspx, bu2.corewebsite.com/bu2/home.aspx and so on. In addition to this each microsite has duplicate folders from the other microsites so bu1.corewebsite.com has indexable folders bu1.corewebsite.com/bu1/home.aspx but also bu1.corewebsite.com/bu2/home.aspx the same with bu2.corewebsite.com has bu2.corewebsite.com/bu2/home.aspx but also bu2.corewebsite.com/bu1/home.aspx. Therre are 5 different business units so you have this duplicate content scenario for all microsites. This situation is being addressed in the medium term development roadmap and will be rectified in the next iteration of the site but that is still a ways out. The issue
Intermediate & Advanced SEO | | ImpericMedia
About 6 weeks ago we noticed a drop off in search rankings for two of our microsites (bu1.corewebsite.com and bu2.corewebsite.com) over a period of 2-3 weeks pretty much all our terms dropped out of the rankings and search visibility dropped to essentially 0. I can see that pages from the websites are still indexed but oddly it is the duplicate content pages so (bu1.corewebsite.com/bu3/home.aspx or (bu1.corewebsite.com/bu4/home.aspx is still indexed, similiarly on the bu2.corewebsite microsite bu2.corewebsite.com/bu3/home.aspx and bu4.corewebsite.com/bu3/home.aspx are indexed but no pages from the BU1 or BU2 content directories seem to be indexed under their own microsites. Logging into webmaster tools I can see there is a "Google couldn't crawl your site because we were unable to access your site's robots.txt file." This was a bit odd as there was no robots.txt in the root directory but I got some weird results when I checked the BU1/BU2 microsites in technicalseo.com robots text tool. Also due to the fact that there is a redirect from bu1.corewebsite.com/ to bu1.corewebsite.com/bu4.aspx I thought maybe there could be something there so consequently we removed the redirect and added a basic robots to the root directory for both microsites. After this we saw a small pickup in site visibility, a few terms pop into our Moz campaign rankings but drop out again pretty quickly. Also the error message in GSC persisted. Steps taken so far after that In Google Search Console, I confirmed there are no manual actions against the microsites. Confirmed there is no instances of noindex on any of the pages for BU1/BU2 A number of the main links from the root domain to microsite BU1/BU2 have a rel="noopener noreferrer" attribute but we looked into this and found it has no impact on indexation Looking into this issue we saw some people had similar issues when using Cloudflare but our client doesn't use this service Using a response redirect header tool checker, we noticed a timeout when trying to mimic googlebot accessing the site Following on from point 5 we got a hold of a week of server logs from the client and I can see Googlebot successfully pinging the site and not getting 500 response codes from the server...but couldn't see any instance of it trying to index microsite BU1/BU2 content So it seems to me that the issue could be something server side but I'm at a bit of a loss of next steps to take. Any advice at all is much appreciated!0 -
Ranking for keyword I don't optimize for & Other oddities
Hi Moz Community! I've been working with a clients website for about a year now. They were hit with the original Panda update because of some spammy links from a shady SEO firm. We've made a decent climb back but not a full recovery. There are some weird things happening that I would love some insight into. 1. Ranking for keywords we don't optimize for: I noticed some low keyword volume for a keyword term that is close to our main term, but is slightly different. We don't optimize for this term at all on our website. We rank third for this term, and actually show site links in the result, which doesn't happen for any of our other pages. 2. Index not found when doing site: search: Other oddity is that when you search site:www.mywebsite.com, I see all the pages within the site except the homepage. Not sure whats going on here, but when I fetch the homepage in GWMT, it returns the homepage. When you query the homepage by itself, it also ranks. Any help would be appreciated! Regards, J
Intermediate & Advanced SEO | | artscienceweb0 -
Can't crawl website with Screaming frog... what is wrong?
Hello all - I've just been trying to crawl a site with Screaming Frog and can't get beyond the homepage - have done the usual stuff (turn off JS and so on) and no problems there with nav and so on- the site's other pages have indexed in Google btw. Now I'm wondering whether there's a problem with this robots.txt file, which I think may be auto-generated by Joomla (I'm not familiar with Joomla...) - are there any issues here? [just checked... and there isn't!] If the Joomla site is installed within a folder such as at e.g. www.example.com/joomla/ the robots.txt file MUST be moved to the site root at e.g. www.example.com/robots.txt AND the joomla folder name MUST be prefixed to the disallowed path, e.g. the Disallow rule for the /administrator/ folder MUST be changed to read Disallow: /joomla/administrator/ For more information about the robots.txt standard, see: http://www.robotstxt.org/orig.html For syntax checking, see: http://tool.motoricerca.info/robots-checker.phtml User-agent: *
Intermediate & Advanced SEO | | McTaggart
Disallow: /administrator/
Disallow: /bin/
Disallow: /cache/
Disallow: /cli/
Disallow: /components/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /layouts/
Disallow: /libraries/
Disallow: /logs/
Disallow: /modules/
Disallow: /plugins/
Disallow: /tmp/0 -
Should I include www in url, or doesn't it matter?
Hello Mozzers, I was just wondering whether Google prefers www or non www URLs? Or doesn't it matter? Thanks in advance!
Intermediate & Advanced SEO | | McTaggart0 -
Redirecting external blog to main website blog - two questions I'm struggling with
Hiya Mozzers - I have a blog separate from main website which is duplicating the blog on the main website. This separate blog is duplicating the main website blog, so it needs to be closed down and redirected. There are some 200 pages of separate blog (identified via Screaming Frog). So I am suggesting the blog pages should be 301 redirected from the separate blog to the equivalent blog pages on the main website. Q1) Should the root domain of the separate blog be 301 redirected to the main www.mainwebsite.com/blog page, or to the root domain of the main website? Q2) Should the blog pages, which lack equivalent content on the main website, be 301 redirected to the main www.mainwebsite.com/blog page, or to the root domain of the main website? Thanks for your help on this one, Luke
Intermediate & Advanced SEO | | McTaggart1 -
My homepage doesn't rank anymore. It's been replaced by irrelevant subpages which rank around 100-200 instead of top 5.
Hey guys, I think I got some kind of penalty for my homepage. I was in top5 for my keywords. Then a few days ago, my homepage stopped ranking for anything except searching for my domain name in Google. sitename.com/widget-reviews/ previously ranked #3 for "widget reviews"
Intermediate & Advanced SEO | | wearetribe
but now....
sitename.com/widget-training-for-pet-cats/ is ranking #84 for widget reviews instead. Similarly across all my other keywords, irrelevant, wrong pages are ranking. Did I get some kind of penalty?0 -
OOPS!! My website links the most to me, I can't get it??
Today, I have checked Google webmaster tools to get answer of following question. Who links the most to my website? I was assumed that Google webmaster tools provide me list of external website where I have created my text links. But, I can't get it when see my own website links the most to me. (4652??) I checked my other websites which are integrated in Google webmaster tools. They also developed on same platform as well as same internal linking structure. But, I am not able to find out similar issue over there. That's why I am quite confuse with Vista Store. How can I solve it? Does it really matter? "Open Site Explorer is my favorite one and always using that to get it done. But, Google webmaster tools is also active & free so why should I not jump in to... 🙂 "
Intermediate & Advanced SEO | | CommercePundit0