MozBar > General Attributes > Meta Robots > noindex
-
I'm having a hard time figuring out where the noindex value for Meta Robots is coming from so I can fix it. Can anybody spot the issue or point me to some docs that show were the MozBar finds this information http://www.produnkhoops.com
-
You sir are a genius. Thank you very much.
Also mad props to the MozBar for picking up on this.
Some observations...
-
We've had these noindex tags on there for almost a year and just now Google found them or decided to honor them.
-
We had a recent situation where Google was basically probing our website with fake URLs to see if anything turned up. Source? incorrectly parsed URLs from JavaScript on houzz.com. I think they are making some big changes on how they crawl JavaScript recently.
-
One of these "problem" pages has some links pointing at it with a query string. Nothing changes on the site because of these. Google indexed the page with a query string despite the noindex. Weird. I guess Google does not always honor the noindex directive.
-
One of these "problem" pages would come up when looking up the cached version in Google but could not be found in the index. Odd again.
Lesson to me is don't count on the meta robots tag for two reasons ...
-
Google inconsistently implements it
-
It's dangerous as a little bad code can take your whole site out of the index.
-
-
If you check the page using (for example) Chrome's Developer Tools, you can clearly see that the rendered page includes no-index directives in each photo album
. (screenshot below)
Google is clear that it will honour no-index directives it finds anywhere in the page, not just in the .
You need to figure how and why those meta-robots noindex tags are getting added by your gallery implementation and get them removed asap.
Hope that helps?
Paul
P.S. You have to use something like Developer Tools, rather than just View Source to inspect the page. That way you're inspecting the DOM (the actual rendered page) rather than just the source code.
-
Yes, these pages...
Home Page: http://www.produnkhoops.com
Other Pages
http://www.produnkhoops.com/basketball_goals/adjustable_in_ground/
http://www.produnkhoops.com/basketball_goals/adjustable_in_ground/pro_dunk_diamond.php
http://www.produnkhoops.com/basketball_goals/adjustable_in_ground/pro_dunk_platinum.php
http://www.produnkhoops.com/basketball_goals/adjustable_in_ground/pro_dunk_gold.php
http://www.produnkhoops.com/basketball_goals/adjustable_in_ground/pro_dunk_silver.phpScreen shot attached.
I'd ignore this but Google seems to see the same thing. You'll see a query using the site operator does not return any of these pages.
.htaccess looks okay to me but take a look for yourself...
RewriteEngine on
RewriteBase /Allows for php caching of images
RewriteRule ^cache_image/([^/.]+).gif?$ img.php?img=$1 [L]
#TEMP Get crawlers to the correct new parts page - Remove in Fall 2015
RewriteRule ^basketball_goals/parts/index.php(.?)$ http://www.produnkhoops.com/parts/ [R=301,L]
RewriteRule ^basketball_goals/parts(.?)$ http://www.produnkhoops.com/parts/ [R=301,L]
RewriteRule ^basketball_goals/parts/pole_padding.php(.?)$ http://www.produnkhoops.com/parts/ [R=301,L]
RewriteRule ^basketball_goals/parts/backboard.php(.?)$ http://www.produnkhoops.com/parts/ [R=301,L]
RewriteRule ^basketball_goals/parts/backboard_padding.php(.?)$ http://www.produnkhoops.com/parts/ [R=301,L]
RewriteRule ^basketball_goals/parts/pier_kit.php(.?)$ http://www.produnkhoops.com/parts/ [R=301,L]
RewriteRule ^basketball_goals/parts/rim.php(.?)$ http://www.produnkhoops.com/parts/ [R=301,L]Retain Link Juice
RewriteRule ^giveaway(.?)$ http://www.produnkhoops.com [R=301,L]
Force www version of site
RewriteCond %{HTTP_HOST} !^www.
RewriteRule ^(.*)$ http://www.%{HTTP_HOST}/$1 [R=301,L] -
I can't actually see anything myself Ryan - is this being found on the homepage? Or can you tell me what page this is seen on? The only ones I can see are:
http://www.produnkhoops.com/photos/albums/sean-56x65-hercules-diamond-basketball-system-137/
http://produnkhoops.com/photos/albums/sean-56x65-hercules-diamond-basketball-system-137/
If it isn't those, could it be something in your .htaccess file?
-Andy
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Cannot download Mozbar
What's up with Mozbar? I cannot access extension download page from neither Chrome of Firefox (I get 404 error when I click on the download button).
Moz Bar | | ioteam1 -
New verison / update on MozBar. What are the changes from the changes (new additions) from the previous version?
MozBar has a new Version update: 3.1.189 in Google Chrome Web Store (updated on Jan 20, 2016). Has anyone observed any big changes / additions? Or, is it just a routine version update?
Moz Bar | | w1t0 -
How to stop Mozbar ha crashing Firefox and Chrome
I normally use Mozbar in Firefox (latest version 40.0.3) on Windows 7 64-bit. I've never had any problems with it before but just at the start of September I started getting multiple crash events in Firefox - it would crash, restart, instantly crash and so on. I worked through all plugins and turned them off one by one. Nothing worked - if the Mozbar was active Firefox crashed. I then switched to Chrome and installed Mozbar (and nothing else). The same thing started to happen - Chrome now crashes all the time. I've also do a complete virus scan with up to date software and nothing was found. This is seriously starting to do my head in as I can't work without Mozbar but it's just constantly crashing. Any ideas? Suggestions?
Moz Bar | | JCN-SBWD0 -
Will robots.txt override a Firewall for Rogerbot?
Hey everybody. Our server guy, who is sorta difficult, has put these ridiculous security measures in place which lock people out of our website all the time. Basically if I ping the website too many times I get locked out, and that's just on my own, doing general research. Regardless, all of our audits are coming back with 5xx errors and I asked if we could add rogerbot to the robots.txt. He seems to be resistant to the idea and just wants to adjust the settings to his firewall... Does anybody know if putting that in the Robots.txt will override his firewall/ping defense he has put in place? I personally think what he has done is WAY too overkill, but that is besides the point. Thanks everybody.
Moz Bar | | HashtagHustler0 -
How to change the search profiles in the new mozbar
Hi, I want to change the search profiles in the new mozbar, but clicking the + Add new profile does nothing. Is this a browser issue? I'm using chrome Version 35.0.1916.114 m Any light on this would be great because there's no point in me checking US results because my site is only geared towards UK customers, being a mortgage broker we can't target other countries except to cater for expats. Thanks, Amelia xx
Moz Bar | | CommT0 -
Meta Description issue
Hi Guys, I'm going through my campaign report and i seem to have an excessive amount of missing Meta descriptions. How ever when i check the backend the descriptions seem to be present http://www.health2000.co.nz/shop/allergies/lung-zone/p5152/c55 Can any one explain to me why this is occurring?
Moz Bar | | Hardley1110 -
Moz just did my weekly "crawl" and claims my meta titles and descriptions are "missing," but they aren't. What's up with this?
I can check for my titles and descriptions in the source. They are there, always have been. what in the hell?
Moz Bar | | LifeisRosie0