MozBar > General Attributes > Meta Robots > noindex
-
I'm having a hard time figuring out where the noindex value for Meta Robots is coming from so I can fix it. Can anybody spot the issue or point me to some docs that show were the MozBar finds this information http://www.produnkhoops.com
-
You sir are a genius. Thank you very much.
Also mad props to the MozBar for picking up on this.
Some observations...
-
We've had these noindex tags on there for almost a year and just now Google found them or decided to honor them.
-
We had a recent situation where Google was basically probing our website with fake URLs to see if anything turned up. Source? incorrectly parsed URLs from JavaScript on houzz.com. I think they are making some big changes on how they crawl JavaScript recently.
-
One of these "problem" pages has some links pointing at it with a query string. Nothing changes on the site because of these. Google indexed the page with a query string despite the noindex. Weird. I guess Google does not always honor the noindex directive.
-
One of these "problem" pages would come up when looking up the cached version in Google but could not be found in the index. Odd again.
Lesson to me is don't count on the meta robots tag for two reasons ...
-
Google inconsistently implements it
-
It's dangerous as a little bad code can take your whole site out of the index.
-
-
If you check the page using (for example) Chrome's Developer Tools, you can clearly see that the rendered page includes no-index directives in each photo album
. (screenshot below)
Google is clear that it will honour no-index directives it finds anywhere in the page, not just in the .
You need to figure how and why those meta-robots noindex tags are getting added by your gallery implementation and get them removed asap.
Hope that helps?
Paul
P.S. You have to use something like Developer Tools, rather than just View Source to inspect the page. That way you're inspecting the DOM (the actual rendered page) rather than just the source code.
-
Yes, these pages...
Home Page: http://www.produnkhoops.com
Other Pages
http://www.produnkhoops.com/basketball_goals/adjustable_in_ground/
http://www.produnkhoops.com/basketball_goals/adjustable_in_ground/pro_dunk_diamond.php
http://www.produnkhoops.com/basketball_goals/adjustable_in_ground/pro_dunk_platinum.php
http://www.produnkhoops.com/basketball_goals/adjustable_in_ground/pro_dunk_gold.php
http://www.produnkhoops.com/basketball_goals/adjustable_in_ground/pro_dunk_silver.phpScreen shot attached.
I'd ignore this but Google seems to see the same thing. You'll see a query using the site operator does not return any of these pages.
.htaccess looks okay to me but take a look for yourself...
RewriteEngine on
RewriteBase /Allows for php caching of images
RewriteRule ^cache_image/([^/.]+).gif?$ img.php?img=$1 [L]
#TEMP Get crawlers to the correct new parts page - Remove in Fall 2015
RewriteRule ^basketball_goals/parts/index.php(.?)$ http://www.produnkhoops.com/parts/ [R=301,L]
RewriteRule ^basketball_goals/parts(.?)$ http://www.produnkhoops.com/parts/ [R=301,L]
RewriteRule ^basketball_goals/parts/pole_padding.php(.?)$ http://www.produnkhoops.com/parts/ [R=301,L]
RewriteRule ^basketball_goals/parts/backboard.php(.?)$ http://www.produnkhoops.com/parts/ [R=301,L]
RewriteRule ^basketball_goals/parts/backboard_padding.php(.?)$ http://www.produnkhoops.com/parts/ [R=301,L]
RewriteRule ^basketball_goals/parts/pier_kit.php(.?)$ http://www.produnkhoops.com/parts/ [R=301,L]
RewriteRule ^basketball_goals/parts/rim.php(.?)$ http://www.produnkhoops.com/parts/ [R=301,L]Retain Link Juice
RewriteRule ^giveaway(.?)$ http://www.produnkhoops.com [R=301,L]
Force www version of site
RewriteCond %{HTTP_HOST} !^www.
RewriteRule ^(.*)$ http://www.%{HTTP_HOST}/$1 [R=301,L] -
I can't actually see anything myself Ryan - is this being found on the homepage? Or can you tell me what page this is seen on? The only ones I can see are:
http://www.produnkhoops.com/photos/albums/sean-56x65-hercules-diamond-basketball-system-137/
http://produnkhoops.com/photos/albums/sean-56x65-hercules-diamond-basketball-system-137/
If it isn't those, could it be something in your .htaccess file?
-Andy
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
In MozBar Page Analysis under General Attributes Country is empty or wrong
Some of our clients sites have a top level domain for Mexico, but in the Mozbar they doesn't show any country, is this related to a known bug? https://www.edacom.mx/ https://www.dropbox.com/s/a8jgr7ztk1im15k/Captura de pantalla 2019-08-15 12.41.10.png?dl=0 https://www.cliento.mx/ https://www.dropbox.com/s/a8jgr7ztk1im15k/Captura de pantalla 2019-08-15 12.41.10.png?dl=0 In the search console: "International Targeting report" the target is Ok to Mexico.
Moz Bar | | Andrea_Ugalde1 -
Limit MOZ crawl rate on Shopify or when you don't have access to robots.txt
Hello. I'm wondering if there is a way to control the crawl rate of MOZ on our site. It is hosted on Shopify which does not allow any kind of control over the robots.txt file to add a rule like this: User-Agent: rogerbot Crawl-Delay: 5 Due to this, we get a lot of 430 error codes -mainly on our products- and this certainly would prevent MOZ from getting the full picture of our shop. Can we rely on MOZ's data when critical pages are not being crawled due to 430 errors? Is there any alternative to fix this? Thanks
Moz Bar | | AllAboutShapewear2 -
I can't login to the Mozbar in Chrome. Just takes me to the homepage?
So, every time I press log in on the Mozbar, it takes me to the Moz home page which I'm already logged in to but there is no change on the status of the Mozbar? What should I do to remedy this? Thanks!
Moz Bar | | soapmed4 -
Moz On-Page Grader doesn't pick up my Title, URL, Meta, H1, Body, IMG ALT's....does this mean Google won't?
Good morning, As my title says, 'Moz On-Page Grader doesn't pick up my Title, URL, Meta, H1, Body, IMG ALT's....does this mean Google won't?' My URL is www.refusedcarfinance.com and I'm currently targeting the Keyword 'bad credit car finance'. I am using Yoast SEO and have the keyword in my title, meta, content, h1's etc. Any advice would my much appreciated. Kindest regards, Joshua
Moz Bar | | RocketStats0 -
Learn how to use MozBar to find local citations. Get your Daily SEO Fix!
Citations are mentions of your business and address on webpages other than your own such as an online yellow pages directory or a local business association page. They are a key component in search engine ranking algorithms so building consistent and accurate citations for your local business(s) is a key Local SEO tactic. In today’s Daily SEO Fix, Tori shows you how to use MozBar to find citations around the web. Check out the video and go give this tip a try! Don't have MozBar? No problem! You can download it for free here. This video wraps up The Moz Daily SEO Fix--Moz tool tips and tricks in under two minutes. Thank you SO much to everyone who has been following this campaign, we really appreciate your support. To watch all of our "Fixes," visit The Moz Daily SEO Fix playlist on YouTube. And, be sure to keep an eye out tomorrow for our wrap-up blog post...there may be a pretty hilarious blooper reel! 😉
Moz Bar | | kellyjcoop3 -
I'm getting, "you're not using the rel="canonical" META attribute" in my crawl diagnotic
I'm running a campaign crawler through Moz on this particular page: http://www.henley.ac.uk/executive-education/leadership-and-management-programmes/ but I'm getting a notifcaiton from Moz saying, "you're not using the rel="canonical" META attribute" I don't understand what this means!! Has anyone else had this problem, or can they help me understand what this means and how to fix it? Oh, and Happy Thanksgiving from the UK! Virginia
Moz Bar | | blackboxideas0 -
Ambiguities In The MozBar Keyword Difficulty Checker
Hi, This is more of an observation rather than a real issue. But I noticed that when I check a keyword difficulty in Google by pressing the button that appears I get a different % result to the same keyword placed in the campaign. I suspect that it is something to do with being in the UK, however, If for instance I go to google.co.uk and place in the search bar IT support company Portsmouth I get the result 44% appear but in the keyword difficulty tool I get the result 34%. It seems to do this on all the keywords I have checked. I also checked both US and UK results in the campaign but neither of these came up within the 10% difference of the toolbar. Like I mentioned though, not a criticism, just an observation, its still a very handy little tool. EDIT 06/18/14: I thought I would just add that I am now getting some seriously odd results. For instance, if I put in the keyword 'hairy blue widgets for sale in Outer Mongolia' it returns a difficulty level of 71% ??? Thanks
Moz Bar | | southcoasthost0 -
OnPage Reports - Duplicate titles and meta descriptions
Hi Moz, I know you guys changed your interface awhile back but I have a question about the new reports. On the old interface, I used to use a report that would automatically run when I created a new account letting me know where the dup titles and meta descriptions were on an entire site. Where can I find this report on the new interface? Thanks Carla
Moz Bar | | Carla_Dawson1