Why isn't Google indexing this site?
-
Hello, Moz Community
My client's site hasn't been indexed by Google, although it was launched a couple of months ago.
I've ran down the check points in this article https://moz.com/ugc/8-reasons-why-your-site-might-not-get-indexed without finding a reason why.
Any sharp SEO-eyes out there who can spot this quickly?
The url is: http://www.oldermann.no/
Thank you
INEVO, digital agency -
Yeap it's really rare. Even more rare that WMT doesn't scream any error.
To check my mistake, i've run a screaming frog too. Sorry.
-
It shouldn't do as its just an iframe, if that were the case then every site that that used addthis would have a problem (which I know for a fact isn't true as two large sites I work with use it and have no issues).
As far as I'm aware, iframes do not pass on any of their attributes through to a website showing an iframe. The main reason I was curious about your reply was that screaming frog hadn't had any issues, I can understand myself having a small slip up, but a bit of software rarely does.
Back to the original question though, it is curious why there's no indexing by Google, Bing seems to have picked it up, and three days ago atleast. i can't see reason (in my brief look earlier) as to why it shouldn't be. So I came to the conclusion it hadn't been crawled or it had incredibly poor content (which I can't verify as I don't know Norwegian)
-
Damn it. You're right.
I'll retract my self.
Dispite my mistake, is there a chance that the add this iframe may be harming that site?
-
A friend just confirmed it, as you're using developer tools, what you're seeing is actually the fully loaded page, including iframes. So the noindex you have found is addthis. https://gyazo.com/abbdecc7e3d6a2d1f4d3acf65a48e65b
To actually check the source code, right click then click view source. That's the code for the specific site instead of loading all of the extra code you've been seeing. I would strongly advise you do like that from now onwards as the way you are doing is incorrect.
-
You know what, I don't think I am wrong.
Have a look at this source code from Bing's cache, can you see it there? http://cc.bingj.com/cache.aspx?q=site%3Ahttp%3A%2F%2Fwww.oldermann.no%2F&d=4558460857156532&mkt=en-GB&setlang=en-GB&w=Zicz6YAWVXgY8u0BPAR9qKRHF8OEn7o5 (Disclaimer I got my friend to check as I'm on a mobile)
This gyazo was just taken for example: https://gyazo.com/93c71c3767c57b74cb9f8b482c23c38
Just ran it through this too, showing the same thing: http://www.seoreviewtools.com/bulk-meta-robots-checker/
oh oh and so you know I think I know why you've found the noindex, you're looking at the for addthis.
-
I disagree Thomas. You're wrong.
I retract myself. Thomas has it right.
I've chequed 2 pages and both have the meta robots to nofollow and noindex.
http://www.oldermann.no/
http://www.oldermann.no/kompetanseCheck the image attached
To check that, go to the page source (F12 in chrome) and make a search (clicking in the source code then crtl+F) of 'robots' there you'll find your problem. Just erase that line of code and you'll be just fine.
Best Luck.
GR. -
I've had a quick look, I've been able to crawl it without any issues, the meta robots and robots.txt doesn't seem to be conflicting with anything at all.
It just doesn't look like it's even been found by Google.
Bing doesn't look to be having any issues indexing it: http://www.bing.com/search?q=site%3Aoldermann.no&go=Submit&qs=n&form=QBLH&pq=site%3Aoldermann.no&sc=0-17&sp=-1&sk=&cvid=B677970FF39F4A62A9B040806CF19EE0
What's the quality of the content on the site like? Have you "fetched as google" in the search console?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
In Google Search Results ....Is it a site link or what? How to get this?
Hello Experts, When I search in google any keyword like abcd in search results for one website after meta description there are showing few links of website ( image attached ) Can you please let me know what is this & how to achieve such type of links? Thanks! mdJBLYb
Intermediate & Advanced SEO | | wright3350 -
Google Not Indexing App Content
Hello Mozzers I recently noticed that there has been an increase in crawl errors reported in Google Search console & Google has stopped indexing our app content. Could this be due to the fact that there is a mismatch between the host path name mentioned within the android deeplink (within the alternate tag) and the actual URL of the page. For instance on the following desktop page http://www.example.com.au/page-1 the android deeplink points to http://www.example.com.au/android-app://com.example/http/www.example.com.au/4652374 Please note that the content on both pages (desktop & android) is same.Is this is a correct setup or am I doing something wrong here? Any help would be much appreciated. Thank you so much in advance.
Intermediate & Advanced SEO | | InMarketingWeTrust0 -
Googlebot Can't Access My Sites After I Repair My Robots File
Hello Mozzers, A colleague and I have been collectively managing about 12 brands for the past several months and we have recently received a number of messages in the sites' webmaster tools instructing us that 'Googlebot was not able to access our site due to some errors with our robots.txt file' My colleague and I, in turn, created new robots.txt files with the intention of preventing the spider from crawling our 'cgi-bin' directory as follows: User-agent: * Disallow: /cgi-bin/ After creating the robots and manually re-submitting it in Webmaster Tools (and receiving the green checkbox), I received the same message about Googlebot not being able to access the site, only difference being that this time it was for a different site that I manage. I repeated the process and everything, aesthetically looked correct, however, I continued receiving these messages for each of the other sites I manage on a daily-basis for roughly a 10-day period. Do any of you know why I may be receiving this error? is it not possible for me to block the Googlebot from crawling the 'cgi-bin'? Any and all advice/insight is very much welcome, I hope I'm being descriptive enough!
Intermediate & Advanced SEO | | NiallSmith1 -
Changing Hosting Companies - Site Downtime - Google Indexing Concern
We are getting ready to switch to a new hosting company. When we make the switchover, our sites will be offline for a couple of hours and in some cases perhaps as long as 12 hours while DNS is configured -- should we be worried about Google trying to index pages and finding them unavailable? Any fear of Google de-indexing pages. Our guess was that Google would not de-index anything after just a short period of not being able to find pages -- it would have to be over an extended period of time before GOOGLE or BING would de-index pages -- CORRECT? Just want to gut check this before pulling the trigger on switch over to new hosting company. We appreciate input on this and/or any other thoughts regarding the switch over to new hosting company that we may not have thought of. Thanks, Matt
Intermediate & Advanced SEO | | MWM37720 -
Indexing non-indexed content and Google crawlers
On a news website we have a system where articles are given a publish date which is often in the future. The articles were showing up in Google before the publish date despite us not being able to find them linked from anywhere on the website. I've added a 'noindex' meta tag to articles that shouldn't be live until a future date. When the date comes for them to appear on the website, the noindex disappears. Is anyone aware of any issues doing this - say Google crawls a page that is noindex, then 2 hours later it finds out it should now be indexed? Should it still appear in Google search, News etc. as normal, as a new page? Thanks. 🙂
Intermediate & Advanced SEO | | Alex-Harford0 -
Understanding Google's keyword tool...
When I type in Google a keyword like : boot camp I get results that show Bootcamp (one word) traffic in the tens of thousands. I see many words combined. Does this mean that tens of thousands of people every month are misspelling that keyword? How should I interpret this in terms of anchor texting? I would hate to deliberately misspell it on my website just to get traffic. For those interested, my website is: http://ultimatebasictraining.com/admin/ (currently revaming my http://ultimatebasictraining.com website)
Intermediate & Advanced SEO | | StreetwiseReports0 -
Export list of urls in google's index?
Is there a way to export an exact list of urls found in Google's index?
Intermediate & Advanced SEO | | nicole.healthline0 -
Removing URLs in bulk when directory exclusion isn't an option?
I had a bunch of URLs on my site that followed the form: http://www.example.com/abcdefg?q=&site_id=0000000048zfkf&l= There were several million pages, each associated with a different site_id. They weren't very useful, so we've removed them entirely and now return a 404.The problem is, they're still stuck in Google's index. I'd like to remove them manually, but how? There's no proper directory (i.e. /abcdefg/) to remove, since there's no trailing /, and removing them one by one isn't an option. Is there any other way to approach the problem or specify URLs in bulk? Any insights are much appreciated. Kurus
Intermediate & Advanced SEO | | kurus1