No Index Meta
-
Good Morning,
So the company who redesigned our website forgot to take off any of the no-index stuff that was put onto the site once it went live. I removed everything in the robots.txt and the privacy settings in wordpress but I am still seeing
Any suggestions on changing this or if its even necessary to change would be great! Thank you
-
I think i got it taken care of, I'm not entirely where the problem lied, I think it was a combo of all of the above, but as for right now, it looks like everything is ok.... but it seemed to just sorta vanish all of the sudden....
I also alerted the dev team at the design studio, so I have a feeling they may have made a change that did it... but at least it seems ok.
Thanks guys!
-
Was this fixed? I didn't see that tag on the home page in the source code any longer.
-
Odds are the errant meta robots tag is in header.php. You should be able to find the file in the back end under Appearance/Editor. With that said, be very careful - make a backup if you must 'cowboy code'- then work with a text editor (Sublime, Komodo, Notepad++, Notepad, etc.) to copy and paste your work.
-
Its been unchecked! I that was the first thing I did!
-
In the WordPress dashboard, go to Settings > Reading.
Find "Search Engine Visibility." Is "Discourage search engines from indexing this site" checked? If so, uncheck it.
-
Hmm, can you PM me the website?
-
Yes, I am using Yoast, I looked through that as well... But nothing stood out...
-
Hello HashtagHustler,
Sorry to hear that your web developer forgot a fundamental part of pushing a website live - and such an important piece of the process too (if you want to be listed in the search engines)!
Are you using any specific WP SEO plugins, such as Yoast SEO? It could be applying the noindex tag to specific pages.
You're on the right track by updating your robots.txt and general WP settings, now I would look into specific plugins.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Drop in indexation but increase in organic traffic
We've had a puzzling drop in indexed pages on our ecommerce website. My crawl returns just over 25k items. Until 19/6 we had about 23-24k indexed. Then we experienced a sudden drop from 19/6 to 26/6: from 23,400 to 18,999, losing 4.4k pages from one week to the next. At the same time, our organic traffic has not decreased, it actually increased, however, it's only been a couple of weeks so that may be coincidence. A few things that have happened during the past few weeks: 31/5: we implemented pagination on category pages to avoid issues with duplicate content - could it be that this led to a decrease in indexed pages 3 weeks later? However, I can only find about 1.5k pages in my crawl that are page 2+ 18-19/6: we had some website outages over the weekend; as a B2B business, we don't get much traffic over the weekend, so I can't see an impact to traffic. However, the following week, indexation dropped by another 250 (then stayed the same this past week), so I don't think this was a factor. 21/6: we retired another website and migrated it to our main website. However, all pages were redirected to existing pages so no new pages were created for the migration. This doesn't really explain a decrease in indexation, but may account for some of the increase in organic traffic; however not all as the retired website hardly got any organic traffic. So, should we be worried? As our website is quite large, it would probably be quite difficult to pin point exactly which pages dropped off the index, but a loss of 19% of pages is quite significant. Then again, it doesn't appear to have negatively impacted organic traffic... Have you got any suggestions for what I should be looking at to find out what happened? Should I be worried at this point? I will definitely continue to have an eye on how our organic traffic (and indexation) develops but I am not sure if there is anything I can do at this point. I'd appreciate your advice on this, to make sure I am not missing something blindingly obvious. Thanks! RmWaNib JJm4tC3
Reporting & Analytics | | ViviCa10 -
Shall I 301 a Url that has a discontinued product or shall we remove from Googles index
My web site sells shoes. These items go out of fashion and are replaced. Shall I 301 a Url that has a discontinued product or shall we remove from Googles index using webmaster tools. I seem to have a massive 301 list that carries on growing and Im concerned that to carry on doing 301s is not the right way.
Reporting & Analytics | | weddingshoesandaccessories0 -
Sudden Increase In Number of Pages Indexed By Google Webmaster When No New Pages Added
Greetings MOZ Community: On June 14th Google Webmaster tools indicated an increase in the number of indexed pages, going from 676 to 851 pages. New pages had been added to the domain in the previous month. The number of pages blocked by robots increased at that time from 332 (June 1st) to 551 June 22nd), yet the number of indexed pages still increased to 851. The following changes occurred between June 5th and June 15th: -A new redesigned version of the site was launched on June 4th, with some links to social media and blog removed on some pages, but with no new URLs added. The design platform was and is Wordpress. -Google GTM code was added to the site. -An exception was made by our hosting company to ModSecurity on our server (for i-frames) to allow GTM to function. In the last ten days my web traffic has decline about 15%, however the quality of traffic has declined enormously and the number of new inquiries we get is off by around 65%. Click through rates have declined from about 2.55 pages to about 2 pages. Obviously this is not a good situation. My SEO provider, a reputable firm endorsed by MOZ, believes the extra 175 pages indexed by Google, pages that do not offer much content, may be causing the ranking decline. My developer is examining the issue. They think there may be some tie in with the installation of GTM. They are noticing an additional issue, the sites Contact Us form will not work if the GTM script is enabled. They find it curious that both issues occurred around the same time. Our domain is www.nyc-officespace-leader. Does anyone have any idea why these extra pages are appearing and how they can be removed? Anyone have experience with GTM causing issues with this? Thanks everyone!!!
Reporting & Analytics | | Kingalan1
Alan1 -
Index.php and /
Hello, We have a php system and in the MOZ error report our index.php shows up as a duplicate for / (home page). I instituted a rel canonical on the index.php because the / gets better rank than the other. This said, the error report through MOZ still shows them as duplicates. Should I be using a 301 instead? Please help! Also, I would love a good technical SEO book (for bridging the gap between SEO and programmer) if someone can recommend one? Thanks in advance!
Reporting & Analytics | | lfrazer0 -
Mod_pagespeed lazy load meta redirects, is it a problem?
Google's mod_pagespeed has a lazy image loading facility which is great, but it uses meta refresh to auto disable itself for people without javascript and the moz crawler says it is not good for seo, but we are not using them for that, example code <noscript><meta HTTP-EQUIV="refresh" content="0;url='http://www.example.com/?ModPagespeed=noscript'" /><style><!--table,div,span,font,p{display:none} --></style><div style="display:block">Please click <a href="http://www.example.com/?ModPagespeed=noscript">here</a> if you are not redirected within a few seconds.</div></noscript> Will this cause SEO problems? If not then is there anyway to filter the warnings out of moz, it finds this issue with every page
Reporting & Analytics | | Fammy0 -
Automatic Checking indexation of websites
Hi Guys, do you know a tool that can check al list of websites (directorys) wich automatically checks if the website are indexed in Google. The list is very long and I would like to have a tool wich checks them all with only CnP them once. thankx a lot der.rabauke
Reporting & Analytics | | Lincus0 -
Google URL Builder Extension showing up as indexed pages.
Hello, I was reviewing my PRO member campaign report. I see that I am getting warnings for too long of URLs. However, these URLs are my website URL with the Google URL builder tracking code that I set up for my marketing campaings. Why are these being indexed? For example: www.website.com/?utm_source=Oct+Newsletter&utm_medium=e.... Thank you, Kristen
Reporting & Analytics | | KLFeichtner0 -
Links and index missing from Google Webmaster Tools!
I've been using a wordpress blog and using google analytics and webmaster tools. I'd never done very much optimizing of my site, my strategy had always been to just keep writing relevant posts and let google do the rest. At some point I installed a SEO plugin to wordpress and did a tiny amount of tweaking, but I noticed that in my webmaster tools page, all my "links to this site" links are gone! My site map says 42 pages submitted, 42 pages indexed, but all the links that I've built over the past few years are missing, and I also notice that I can't find my main landing page in the index anymore. I know there are indexed sites out there that link to me, but they aren't being reflected anymore. Did I anger google by using SEO plugins within wordpress? I'm fairly certain I wasn't doing anything sketchy. Http://brodiegraphics.com RTOH6.png
Reporting & Analytics | | HELPeR0