MozBar > General Attributes > Meta Robots > noindex
-
I'm having a hard time figuring out where the noindex value for Meta Robots is coming from so I can fix it. Can anybody spot the issue or point me to some docs that show were the MozBar finds this information http://www.produnkhoops.com
-
You sir are a genius. Thank you very much.
Also mad props to the MozBar for picking up on this.
Some observations...
-
We've had these noindex tags on there for almost a year and just now Google found them or decided to honor them.
-
We had a recent situation where Google was basically probing our website with fake URLs to see if anything turned up. Source? incorrectly parsed URLs from JavaScript on houzz.com. I think they are making some big changes on how they crawl JavaScript recently.
-
One of these "problem" pages has some links pointing at it with a query string. Nothing changes on the site because of these. Google indexed the page with a query string despite the noindex. Weird. I guess Google does not always honor the noindex directive.
-
One of these "problem" pages would come up when looking up the cached version in Google but could not be found in the index. Odd again.
Lesson to me is don't count on the meta robots tag for two reasons ...
-
Google inconsistently implements it
-
It's dangerous as a little bad code can take your whole site out of the index.
-
-
If you check the page using (for example) Chrome's Developer Tools, you can clearly see that the rendered page includes no-index directives in each photo album
. (screenshot below)
Google is clear that it will honour no-index directives it finds anywhere in the page, not just in the .
You need to figure how and why those meta-robots noindex tags are getting added by your gallery implementation and get them removed asap.
Hope that helps?
Paul
P.S. You have to use something like Developer Tools, rather than just View Source to inspect the page. That way you're inspecting the DOM (the actual rendered page) rather than just the source code.
-
Yes, these pages...
Home Page: http://www.produnkhoops.com
Other Pages
http://www.produnkhoops.com/basketball_goals/adjustable_in_ground/
http://www.produnkhoops.com/basketball_goals/adjustable_in_ground/pro_dunk_diamond.php
http://www.produnkhoops.com/basketball_goals/adjustable_in_ground/pro_dunk_platinum.php
http://www.produnkhoops.com/basketball_goals/adjustable_in_ground/pro_dunk_gold.php
http://www.produnkhoops.com/basketball_goals/adjustable_in_ground/pro_dunk_silver.phpScreen shot attached.
I'd ignore this but Google seems to see the same thing. You'll see a query using the site operator does not return any of these pages.
.htaccess looks okay to me but take a look for yourself...
RewriteEngine on
RewriteBase /Allows for php caching of images
RewriteRule ^cache_image/([^/.]+).gif?$ img.php?img=$1 [L]
#TEMP Get crawlers to the correct new parts page - Remove in Fall 2015
RewriteRule ^basketball_goals/parts/index.php(.?)$ http://www.produnkhoops.com/parts/ [R=301,L]
RewriteRule ^basketball_goals/parts(.?)$ http://www.produnkhoops.com/parts/ [R=301,L]
RewriteRule ^basketball_goals/parts/pole_padding.php(.?)$ http://www.produnkhoops.com/parts/ [R=301,L]
RewriteRule ^basketball_goals/parts/backboard.php(.?)$ http://www.produnkhoops.com/parts/ [R=301,L]
RewriteRule ^basketball_goals/parts/backboard_padding.php(.?)$ http://www.produnkhoops.com/parts/ [R=301,L]
RewriteRule ^basketball_goals/parts/pier_kit.php(.?)$ http://www.produnkhoops.com/parts/ [R=301,L]
RewriteRule ^basketball_goals/parts/rim.php(.?)$ http://www.produnkhoops.com/parts/ [R=301,L]Retain Link Juice
RewriteRule ^giveaway(.?)$ http://www.produnkhoops.com [R=301,L]
Force www version of site
RewriteCond %{HTTP_HOST} !^www.
RewriteRule ^(.*)$ http://www.%{HTTP_HOST}/$1 [R=301,L] -
I can't actually see anything myself Ryan - is this being found on the homepage? Or can you tell me what page this is seen on? The only ones I can see are:
http://www.produnkhoops.com/photos/albums/sean-56x65-hercules-diamond-basketball-system-137/
http://produnkhoops.com/photos/albums/sean-56x65-hercules-diamond-basketball-system-137/
If it isn't those, could it be something in your .htaccess file?
-Andy
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
MozBar: Page Title (and other data) inconsistent with HTML
In using the MozBar Chrome extension, I have noticed that the data about a page that MozBar displays is sometimes inconsistent with the "head" tag in the HTML of the page. Am I misunderstanding where MozBar is getting the data it is displaying? Other SEO extensions like "META SEO inspector"do not display these inconsistencies. EupH5sG
Moz Bar | | clayjones0 -
Moz On-Page Grader doesn't pick up my Title, URL, Meta, H1, Body, IMG ALT's....does this mean Google won't?
Good morning, As my title says, 'Moz On-Page Grader doesn't pick up my Title, URL, Meta, H1, Body, IMG ALT's....does this mean Google won't?' My URL is www.refusedcarfinance.com and I'm currently targeting the Keyword 'bad credit car finance'. I am using Yoast SEO and have the keyword in my title, meta, content, h1's etc. Any advice would my much appreciated. Kindest regards, Joshua
Moz Bar | | RocketStats0 -
Learn how to use MozBar to find local citations. Get your Daily SEO Fix!
Citations are mentions of your business and address on webpages other than your own such as an online yellow pages directory or a local business association page. They are a key component in search engine ranking algorithms so building consistent and accurate citations for your local business(s) is a key Local SEO tactic. In today’s Daily SEO Fix, Tori shows you how to use MozBar to find citations around the web. Check out the video and go give this tip a try! Don't have MozBar? No problem! You can download it for free here. This video wraps up The Moz Daily SEO Fix--Moz tool tips and tricks in under two minutes. Thank you SO much to everyone who has been following this campaign, we really appreciate your support. To watch all of our "Fixes," visit The Moz Daily SEO Fix playlist on YouTube. And, be sure to keep an eye out tomorrow for our wrap-up blog post...there may be a pretty hilarious blooper reel! 😉
Moz Bar | | kellyjcoop3 -
Learn how to use MozBar to analyze competitors' schema markup. Get you Daily SEO Fix!
Schema markup helps Google and Bing identify what your (and your competitors') website pages are all about and as a result, helps search engines better index them. Better indexing can lead to better rankings for relevant keywords and phrases and herein lies the opportunity. In today's Daily SEO FiX, Jordan shows you how to use MozBar to analyze the schema markup of the competition and optimize your own site and pages for rich snippets. If you don't have MozBar, no worries! You may download it for free here. This video is part of The Moz Daily SEO Fix tutorial series--Moz tool tips and tricks in under 2 minutes. To watch all of our videos so far, and to subscribe to future ones, make sure to visit the Daily SEO Fix channel on YouTube.
Moz Bar | | kellyjcoop1 -
I'm getting a Crawl error 605 Page Banned by robots.txt, X-Robots-Tag HTTP Header, or Meta Robots Tag
The website is www.bigbluem.com and is a wordpress site. I'm getting the following error: 605 Page Banned by robots.txt, X-Robots-Tag HTTP Header, or Meta Robots Tag But what is weird is the domain it lists below that is http://None/BigBlueM.com Any advice?
Moz Bar | | TumbleweedPDX1 -
OnPage Reports - Duplicate titles and meta descriptions
Hi Moz, I know you guys changed your interface awhile back but I have a question about the new reports. On the old interface, I used to use a report that would automatically run when I created a new account letting me know where the dup titles and meta descriptions were on an entire site. Where can I find this report on the new interface? Thanks Carla
Moz Bar | | Carla_Dawson1 -
Mozbar - SERP Control Panel - Export to CSV - Update
Hi I asked a question on 22nd Sep and 16th October about Mozbar: "I have been exporting SERP results using the Mozbar, but I don't get PA and DA data even though this is shown in the SERP overlay. The data is shown in excel as being 'undefined'. Anyone else having this problem?" I was told that this was a known issue and a fix would be available within weeks. Is there any update on when this update is likely? Thanks again for your assistance. Neil
Moz Bar | | mccormackmorrison0 -
Mozbar showing 0 links for pages in the main nav.
I'm working on a site where the mozbar is showing 0 links for every page in the main nav menu but home. A crawl of the site isn't showing any issues with blocked or nofollowed meta robots. Is this simply a bug in mozbar? What else could be causing this? If this is a problem with on page seo what is the solution?
Moz Bar | | Kairos_Internet_Marketing0