Is there a tool or other way to see which of my website pages employ noindex tag?
-
Hi guys
I am checking my website for possible technical issues and was wondering if there is a tool or other way to see which of my pages employ the head noindex tag if any. Do you happen to know?
Thanks
Lily
-
-
Hi Lily,
You can find this information in your moz crawl reports. If you export the report and look for the column 'Blocked by meta-robots' this should give you a list of the pages that have this tag (they will be flagged true in this column). You can also use the screaming frog tool which should give you this information in the meta and canonical tab.
-
Then you might be looking for something like this,
-
Hi
Thanks for adding up. My question is more about a tool which will list all pages which employ the noindex, not to check them one by one individually.
Thanks
-
Hello Lily,
One option is to View source of the Page and find the no-index tag there, if there is any then remove them.. or if you have fairly large site to check then its better If you use PHP, it should be fairly easy to write a script that goes through the sites, fetches the page and parses them for 'nofollow'.
Regards
Sherry
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Blog archive pages are meta noindexed but still flagged as duplicate
Hi all. I know there several threads related to noindexing blog archives and category pages, so if this has already been answered, please direct me to that post. My blog archive pages have preview text from the posts. Each time I post a blog, the last post on any given archive page shifts to the first spot on the next archive page. Moz seems to report these as new duplicate content issues each week. I have my archive pages set to meta noindex, so can I feel good about continuing to ignore these duplicate content issues, or is there something else I should be doing to prevent penalties? TIA!
Technical SEO | | mkupfer1 -
How to rank 1 page for multiple keywords in the new way
Hi There It has been a little while since I was involved with KW's in earnest. 1.5 years ago and beyond I did really well with SEO. I'm not in a hugely competitive market but we found our keywords, we wrote great web pages for 1,2,3 keywords and when we found more great keywords that we built a new page to rank for. For example: One big hitting keyword was "Rugged PDA", we created a category page for Rugged PDA's. Another was "Rugged Handheld" so we had a new page for that. We then long tailed "semi rugged PDA", "waterproof rugged PDA" etc etc and built sub category pages. We were legit, did lots of content marketing, ran a blog tweeted etc and we did really well to be honest. However these days it's not working, One of Rand's whiteboard sessions stated that you need to build bigger topic based pages that delivered on more keywords (The one about shoes!). This is great as we love that idea as we can have 1 big category page that offers great value to the visitor, however I am struggling to work out how we target a bigger list of keywords to the one page or to fewer pages. To underline this the MOZ page rankers also still seem to work in the same way where they expect 1 or 2 KW's per page to get A ranks to them, so I'm confused!! For example Rugged PDA is an old term, Google trends is showing that it's glory days are over and we know that the term "Rugged Smartphone" is the one to use as we all use smartphones not PDAs these days. However we also see a lot about Rugged + Phone, Mobile, Cell, Handheld, tablet, device, phablet... all relevant to one big category page. So I run these KW's through google search to see if the same pages come up as a test to see if Google thinks they all mean the same, I get a few, but not much overlap. How do we therefore have 1 page that talks about all kinds of great stuff about the "Rugged smartphone" but one that also targets rugged handheld, rugged android device etc etc? I've spent 2 days catching up, i'm none the wiser on this specific element but i'm sure I am just missing one key element of common sense here and any help is very much appreciated. Regards Dave
Technical SEO | | Raptor-crew0 -
When we have 301 page is a Rel=Canonical needed or should we make 1 Noindex?
Hi, When we have a page as 301 (Permanent Redirect) is a Rel=Canonical needed or should we make 1 Noindex? Example http://www.Somename.com/blog/138760 when clicked goes to http://www.Somename.com/blogs/whenittyam Should i noindex the below pages http://www.Somename.com/blog/138760 and add Rel=Canonical Thanks
Technical SEO | | mtthompsons0 -
My landing pages just dropped to zero in webmaster tools
According to google webmaster tools my landing pages just dropped from 1300 impressions 2 days ago to zero for the past 2 days. Have attached snippet of graph, URL of website is http://www.cheapcentralheating.co.uk - I have no idea whats happened here, and if anyone can advise or help I would be extremely grateful. landing_pages.jpg
Technical SEO | | nicklemonpromotions0 -
Noindex Pages indexed
I'm having problem that gogole is index my search results pages even though i have added the "noindex" metatag. Is the best thing to block the robot from crawling that file using robots.txt?
Technical SEO | | Tedred0 -
Does page speed affect what pages are in the index?
We have around 1.3m total pages, Google currently crawls on average 87k a day and our average page load is 1.7 seconds. Out of those 1.3m pages(1.2m being "spun up") google has only indexed around 368k and our SEO person is telling us that if we speed up the pages they will crawl the pages more and thus will index more of them. I personally don't believe this. At 87k pages a day Google has crawled our entire site in 2 weeks so they should have all of our pages in their DB by now and I think they are not index because they are poorly generated pages and it has nothing to do with the speed of the pages. Am I correct? Would speeding up the pages make Google crawl them faster and thus get more pages indexed?
Technical SEO | | upper2bits0 -
Canonical tag used on several pages?
Is it a bad idea to use rel=canonical from several pages back to one (if you are planning on no-indexing them)? Does this concentrate the “link juice” from those several pages back to one?
Technical SEO | | nicole.healthline0 -
My website pages (www.ommrudraksha.com) is getting good rank slowly. But no good sales ?
My website has been doing good slowly. I have been using seomoz recommendations. And it is a great help to see that my pages are slowly coming to the first page. I am also running PPC on google. I see there are many visitors to my website. But i do not get good conversion - or not getting customer buying products. My website : www.ommrudraksha.com My target keyword is : rudraksha
Technical SEO | | Ommrudraksha0