No Index Meta
-
Good Morning,
So the company who redesigned our website forgot to take off any of the no-index stuff that was put onto the site once it went live. I removed everything in the robots.txt and the privacy settings in wordpress but I am still seeing
Any suggestions on changing this or if its even necessary to change would be great! Thank you
-
I think i got it taken care of, I'm not entirely where the problem lied, I think it was a combo of all of the above, but as for right now, it looks like everything is ok.... but it seemed to just sorta vanish all of the sudden....
I also alerted the dev team at the design studio, so I have a feeling they may have made a change that did it... but at least it seems ok.
Thanks guys!
-
Was this fixed? I didn't see that tag on the home page in the source code any longer.
-
Odds are the errant meta robots tag is in header.php. You should be able to find the file in the back end under Appearance/Editor. With that said, be very careful - make a backup if you must 'cowboy code'- then work with a text editor (Sublime, Komodo, Notepad++, Notepad, etc.) to copy and paste your work.
-
Its been unchecked! I that was the first thing I did!
-
In the WordPress dashboard, go to Settings > Reading.
Find "Search Engine Visibility." Is "Discourage search engines from indexing this site" checked? If so, uncheck it.
-
Hmm, can you PM me the website?
-
Yes, I am using Yoast, I looked through that as well... But nothing stood out...
-
Hello HashtagHustler,
Sorry to hear that your web developer forgot a fundamental part of pushing a website live - and such an important piece of the process too (if you want to be listed in the search engines)!
Are you using any specific WP SEO plugins, such as Yoast SEO? It could be applying the noindex tag to specific pages.
You're on the right track by updating your robots.txt and general WP settings, now I would look into specific plugins.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SEO Effect of inserting No indexed Contents in normal Pages (Nextgen Gallery)
Hello Dear Community, I'm running a photography website and have a question about the indexability of "No indexed Content" inserted on indexable pages. Background : I read everywhere that best practice is to "no index" all useless pages with few content, what I did with Yoast plugin : I no indexed all my nextgen galleries and "ngg_tags" since they create single pages for every photo, tags or slideshow. I did the same for all my porfolio-posts, price lists, testimonials and so on... Nevertheless, I inserted these galleries and portfolios on SEO optimized page for my target keywords. + Nextgen plugin automatically adds these images in the page sitemap. My idea is to have only my Seo optimized page showing in Google and not the others. Problem: I've been checking the results in Google Search Console, filtering by images : I discovered that most of the images featured in these Masonry galleries are not showing in google, and actually almost all the images indexed are the Wordpress from media gallery. I double checked with Screaming Frog, and the software doesn"t see images on these pages. My question is: Is the low indexablilty of these contents are related to the No indexation of the original contents ??? Does somebody has experienced the same issue that these contents doesn't show on Google ? in advance many thanks for your help
Reporting & Analytics | | TristanAventure0 -
How to Diagnose "Crawled - Currently Not Indexed" in Google Search Console
The new Google Search Console gives a ton of information about which pages were excluded and why, but one that I'm struggling with is "crawled - currently not indexed". I have some clients that have fallen into this pit and I've identified one reason why it's occurring on some of them - they have multiple websites covering the same information (local businesses) - but others I'm completely flummoxed. Does anyone have any experience figuring this one out?
Reporting & Analytics | | brettmandoes2 -
Clicks, impressions, CTR, & position decreased after adding meta descriptions
A website that I was working on did not have meta descriptions, had poorly optimized meta titles, and URL structure. I created optimized descriptions and titles for each page. I also updated the URL structure of select pages and created 301 redirects. Since I did this I noticed that my clicks, impressions, CTR, and position all decreased on Google Search Console (I just setup Search Console so I only have 1-week of data). Traffic on Google Analytics is about the same. Is this normal?
Reporting & Analytics | | rx3000 -
Sudden Increase In Number of Pages Indexed By Google Webmaster When No New Pages Added
Greetings MOZ Community: On June 14th Google Webmaster tools indicated an increase in the number of indexed pages, going from 676 to 851 pages. New pages had been added to the domain in the previous month. The number of pages blocked by robots increased at that time from 332 (June 1st) to 551 June 22nd), yet the number of indexed pages still increased to 851. The following changes occurred between June 5th and June 15th: -A new redesigned version of the site was launched on June 4th, with some links to social media and blog removed on some pages, but with no new URLs added. The design platform was and is Wordpress. -Google GTM code was added to the site. -An exception was made by our hosting company to ModSecurity on our server (for i-frames) to allow GTM to function. In the last ten days my web traffic has decline about 15%, however the quality of traffic has declined enormously and the number of new inquiries we get is off by around 65%. Click through rates have declined from about 2.55 pages to about 2 pages. Obviously this is not a good situation. My SEO provider, a reputable firm endorsed by MOZ, believes the extra 175 pages indexed by Google, pages that do not offer much content, may be causing the ranking decline. My developer is examining the issue. They think there may be some tie in with the installation of GTM. They are noticing an additional issue, the sites Contact Us form will not work if the GTM script is enabled. They find it curious that both issues occurred around the same time. Our domain is www.nyc-officespace-leader. Does anyone have any idea why these extra pages are appearing and how they can be removed? Anyone have experience with GTM causing issues with this? Thanks everyone!!!
Reporting & Analytics | | Kingalan1
Alan1 -
Not many pages being indexed on google
Hi I am putting in to Google: site:www.mysite.com to see the pages listed on Google - the figure Google is coming back with is much lower than the actual pages, I have no crawer warning etc... What could the problem be? Thanks
Reporting & Analytics | | acumenadagency0 -
Dup Meta dscsriptions
I keep getting this condition in Google Webmaster Tools HTML improvements under Duplicate meta descriptions <a id="zip_6-anchor" class="zippedsection_title">Hawaii Vacation Blog has all the information you'll need to plan your Hawaii vacation. We have tips</a>
Reporting & Analytics | | AlohaBruce
/blog/page/4//blog/page/4/?level=album&id=0&sortby=caption&sortdir=ASC/blog/page/4/?level=album&id=14&sortby=caption&sortdir=desc/blog/page/4/?level=picture&id=143/blog/page/4/?level=picture&id=147/blog/page/4/?level=picture&id=166/blog/page/4/?level=picture&id=171/blog/page/4/?level=picture&id=213/blog/page/4/?level=picture&id=52/blog/page/4/?level=picture&id=87
The problem is that this cannot be duplicate meta descriptions because all of this is one page.
Anyone have this situation before or can explain why Google see a single page with duplicate meta descriptions?
0 -
Indexed URLs in Webmaster Tools
Hi everybody! I've been looking at my Webmaster Tools stats, and it looks like not all the URLs in the sitemap tree have been indexed, according to WMT at least. Is this reliable, and if so, is it worth investigating further? | Sitemap | Status | Type | Downloaded | URLs submitted | URLs in web index |
Reporting & Analytics | | neooptic
| | /ISitemap1.xml | | Sitemap | Dec 15, 2011 | 2,000 | 1,309 |
| | /isitemap.xml | | Index | Dec 15, 2011 | 8,695 | 4,127 |
| | /isitemap2.xml | | Sitemap | Dec 15, 2011 | 2,000 | 998 |
| | /isitemap3.xml | | Sitemap | Dec 15, 2011 | 2,000 | 819 |
| | /isitemap4.xml | | Sitemap | Dec 15, 2011 | 2,000 | 719 |
| | /isitemap5.xml | | Sitemap | Dec 15, 2011 | 695 | 282 | Thanks!0 -
Meta Robots Tag - What's it really mean?
I used on a handful of pages recently and noticed that they're still popping up in the Google search index. I'd like to keep these from appearing, so I figured I needed a directive statement with stronger semantic meaning. From what I understand, is what I'm looking for. Using this will keep Google from not only crawling the page, but indexing the page, as well. I decided to see what the official robotstxt.org website said about it, so I checked (link here): the NOFOLLOW directive only applies to links on this page. It's entirely likely that a robot might find the same links on some other page without a NOFOLLOW (perhaps on some other site), and so still arrives at your undesired page. So, is their explanation saying that the page itself will be indexed, but the content / links on it won't be followed / indexed? Let me hear your thoughts, mozzers.
Reporting & Analytics | | mudbugmedia0