How to make google crawl our repository to make our site rank but make sure users dont go to our repository ?
-
We have a website that has links to documents related to various sectors. But the challenge is we do not have the documents on the website itself and they are linked to our document repository that has been blocked to google. We have put nofollow and noindex to the repository. Since Google can not read those documents, it has resulted in an impact in our SEO ranking. What would be the best way to make Google crawl the PDF documents in the repository at the same time make it invisible the "repo" not appear in the search engines. Would dofollow and noindex sequence work ?
-
Playing with indexation tags can be dangerous (same goes for robots.txt). Google should still be able to read the repo even if it is no-indexed, as long as you haven't also blocked the repo in robots.txt. Robots.txt is telling Google what to crawl, no-index is telling Google what it can or can-not put in its search results
Of course, if your docs were ranking because of PageRank passed from the repo, the no-index tag will kill the PageRank of the repo (and thus all the docs which it links to, as they are not being 'fed' any more). If a page is no-indexed, it's seen as unimportant for Google and the PageRank is often nullified. Although Google can crawl no-indexed URLs, they crawl them WAY slower as they're seen as really unimportant with no PageRank (at the bottom of the internet)
Why not just put all your PDF docs in a PDF sitemap ans submit to Google in Search Console:
https://stackoverflow.com/questions/1072880/should-i-list-pdfs-in-my-sitemap-file
This will let Google see them all. But if their parent is no-indexed with no PageRank, they may still not rank as well as before...
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is The Moz Community Rankings broken?
Not as active as I would have liked recently but still visit and login, answering a question now and again, yet I can see my profile is still listed as unranked. until recently I was somewhere around 45-49 and have been for many years - the criteria appears to be what it has for the last ten years or so. I see people with lower moz points outranking members with far more points. I can even see one with 0 points now appearing in the top 50 so my question is - is the moz community rankings broken or have I missed something? I know once before I pointed it out and it had to be fixed...input from all welcome 🙂
SEO Learn Center | | Matt-Williamson2 -
Google Analytics setup tips and tricks?
I want to see (and possibly compile) other marketers tips and tricks when it came to setting up their Google Analytics. I feel like I sometimes get into a rut when I setup GA for clients and I want to make sure that I'm not getting rusty with it. Some of the things I'm interested in (but not limited to): How do you use dashboards? What funnels do you setup? How do you utilize goals? What are your favorite metrics to report to clients? What are the top items on your checklist when setting up GA? And many others I could include here... I'd be interested in seeing what other marketers include in their GA setup and reporting. These can be super simple or expert level tips and tricks. It's a personal curiosity I have so that I make sure I'm staying up to date with everything but if there is enough participation I will compile everything into a YouMoz post or something as a guide for us to use and share. So please share this question with others if you can. Thanks!
SEO Learn Center | | HashtagJeff2 -
How much dev knowledge as an seo do I need to know in order to make small changes on websites?
Hi mozzers I am considering learning some dev just to be able to make minor changes on websites. I love seo but will never want to be a programmer. I get sometimes frustrated that I have to request my dev colleague to make minor changes such as adding a small piece of codes to a website for verification purposes or adding rich snippet or modifying the ga code to get more out of it. I know some HTML and understands the core elements and attributes. My first question would be: what should I learn without learning A-Z of programming? My guess would be some php and? My second question: based on your answer where can I learn about these programs? Any interactive learning services such as team treehouse ? Any online courses? Thanks!
SEO Learn Center | | Ideas-Money-Art1 -
My Wordpress Organic Blog traffic disappeared and Google is indexing Viagra and Online Med titles for some articles. How to fix that?
Hello, I'm worried that all my organic traffic has disappeared according to Analytics from past friday and now Google is showing results from my title tags in the last days as you can see here: http://goo.gl/QFSgy Is there any additional resources I can read apart from Google Clean Your site Guidelines here https://support.google.com/webmasters/answer/163634 or the Wordpress FAQ for hacked sites here? http://codex.wordpress.org/FAQ_My_site_was_hacked Very much appreciated all of your help! Regards.
SEO Learn Center | | viventuraSEO0 -
SEO Ads On Third Party Job Sites?
Hello all, I seriously doubt I will get a reply to this as I'm guessing no one has experience with it. if you do though then I would appreciate any information either via comment or PM. Basically, I need to know how I can improve the rankings of job posts within the third party sites. An example would be totaljobs.com, how can I improve the rankings of advertisements that are posted there or is it simply ranked by date and location?. When I had my eBay business, I did a lot of research on eBay SEO and discovered some important factors for ranking within the eBay website. I'm basically wanting to do the same here on job board websites for job ads posted to them. Their algorithms won't be as advanced as Google etc so I'm guessing if they do they will be open for higher keyword density levels and that kind of thing.. I've googled it quite a bit and can't find any information at all on it. Thanks.
SEO Learn Center | | LukeHutchinson0 -
Best way to utilize an infographic...... do I have the makings of one?
I have read the REALLY great post on YouMoz about HOW to push an infographic but I wanted to throw this out for discussion: I operate an seo / Internet marketing company but I am also a partner in a party rental business here in Wichita. I have the material for a GREAT infographic (I think) a copy of our party rental yellow page ad with a tracking # in the ad (provided by yellowbook to see how many calls we receive every month) a report from yellowbook showing we received 277 calls in a YEAR from that ad a screenshot of Google analytics showing we received 16,000 visits during the same time period. (12k unique visits) 300 calls vs 12,000 unique visits Of those 12,000 contacts we had 3,700 of them get online quotes and provide their name, address, email and phone number. Yellow pages = 300 calls / 150-200 actual sales Internet = 12,000 unique visits, 3700 leads and ... ? ... probably 800 sales This proves in black and white right from yellowbook themselves what an AMAZING difference there is in the value of SEO vs old school phone book ads. Does this have the making of a good infograph? Can you see where this would be helpful to show potential clients? How would you use this to promote your business? Thanks for your thoughts and opinions. If this can help others I would be happy to share more specifics. Matthew
SEO Learn Center | | Mrupp440 -
Top Domain Authority Sites
Is there a list like the IR500, but for the top domain authority sites? If not, could you build one?
SEO Learn Center | | adam-1869630 -
For Newbies! | Matt Cutts on "How does Google use human raters in web search?"
I answer many questions here in Q&A. Instead of helping one individual, I thought this would help many newbies understand how Google uses human raters for web search. Watch Matt and learn why you should not SPAM or make sorry titles. http://youtu.be/nmo3z8pHX1E?hd=1 I hope this short video helps you! Leave a comment if you wish.
SEO Learn Center | | Francisco_Meza2