How to make google crawl our repository to make our site rank but make sure users dont go to our repository ?
-
We have a website that has links to documents related to various sectors. But the challenge is we do not have the documents on the website itself and they are linked to our document repository that has been blocked to google. We have put nofollow and noindex to the repository. Since Google can not read those documents, it has resulted in an impact in our SEO ranking. What would be the best way to make Google crawl the PDF documents in the repository at the same time make it invisible the "repo" not appear in the search engines. Would dofollow and noindex sequence work ?
-
Playing with indexation tags can be dangerous (same goes for robots.txt). Google should still be able to read the repo even if it is no-indexed, as long as you haven't also blocked the repo in robots.txt. Robots.txt is telling Google what to crawl, no-index is telling Google what it can or can-not put in its search results
Of course, if your docs were ranking because of PageRank passed from the repo, the no-index tag will kill the PageRank of the repo (and thus all the docs which it links to, as they are not being 'fed' any more). If a page is no-indexed, it's seen as unimportant for Google and the PageRank is often nullified. Although Google can crawl no-indexed URLs, they crawl them WAY slower as they're seen as really unimportant with no PageRank (at the bottom of the internet)
Why not just put all your PDF docs in a PDF sitemap ans submit to Google in Search Console:
https://stackoverflow.com/questions/1072880/should-i-list-pdfs-in-my-sitemap-file
This will let Google see them all. But if their parent is no-indexed with no PageRank, they may still not rank as well as before...
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How would you go about influencer marketing in the b2b space?
Hi Mozzers, I have conducted some b2c micro influencer marketing campaigns in my previous gig by reaching out to blogger and having them promote some content we created. I am now working in a Fintech company (b2b) and would like to get a few ideas on how can I leverage the influencer marketing channel within the Fintech industry. Can you share some ideas on different b2b influencer marketing strategies? What are good processes to follow besides cold email, meetups, events? Any influencer marketing softwares you have used and recommending it in that space? Thanks!
SEO Learn Center | | Taysir0 -
What should I place in the code to connect my html 5 website to Facebook, Google+ etc...?
I know most people use a CMS these days but I created a html 5 website for my small business using Dreamweaver. I'd like to know what, if anything, I should place in the code to link my website with my social media accounts like Facebook, Google+, Twitter, and Pinterest? I've found information about plugins that are useful if you're using a CMS but I'm not. I placed social media buttons on all of the pages of my website already, and when you click on those buttons they go to my social media accounts. But is there anything that should be placed in the code? Thanks for your help
SEO Learn Center | | Ophelia6190 -
I changed the {Site Name} of our domain by capitalizing a letter. 48 hours later our SEO rankings are bad. How long does it take to rebound our prior rankings. The {site name} was at the end of every page title.
I changed the {Site Name} of our domain slightly and capitalized a letter. The impact 48 hours later on SEO is really, really bad. How long does it take to recapture our prior rankings and should I change the site name back to the original? The {site name} was at the end of every page title. Thanks for any help/advice on this. We worked so hard to get our business on the first page for many keywords and "POOF" we are gone now.
SEO Learn Center | | LinckB0 -
SEO Stratergy for new ecom site
Hello Experts, I need expert advice for my ecom site. My site is www nsale dot in , domain is 2 years old, we just revamped the site. Its currently under testing. Dev activity will be complete in another 2-3 day and product addition will start in a week. we are targeting all major categories of product. I am not sure about how to start the SEO and social media marketing. Can someone help on how to plan and execute inorder to get targeted traffic and also steady increase in traffic ? Targetted traffic is India. PR is currently 0. Thanks in advance.
SEO Learn Center | | nsale0 -
Google plus provides dofollow or nofollow backlinks?
I see my webmaster full of backlinks coming from sites like Google.com(plus) Twitter.com(tweets) Stumbleupon chime Scoop.it 1.Are these backlinks follow or nofollow? 2.Follow or nofollow backlinks surely do not pass PR effect but do the nofollow backlink helpful in rank or not?
SEO Learn Center | | csfarnsworth0 -
SEO Ads On Third Party Job Sites?
Hello all, I seriously doubt I will get a reply to this as I'm guessing no one has experience with it. if you do though then I would appreciate any information either via comment or PM. Basically, I need to know how I can improve the rankings of job posts within the third party sites. An example would be totaljobs.com, how can I improve the rankings of advertisements that are posted there or is it simply ranked by date and location?. When I had my eBay business, I did a lot of research on eBay SEO and discovered some important factors for ranking within the eBay website. I'm basically wanting to do the same here on job board websites for job ads posted to them. Their algorithms won't be as advanced as Google etc so I'm guessing if they do they will be open for higher keyword density levels and that kind of thing.. I've googled it quite a bit and can't find any information at all on it. Thanks.
SEO Learn Center | | LukeHutchinson0 -
WP Permalinks, categories, and organic ranking impact
Hello. this is my first post here, so I hope it to be a question with an easy answer... I am working on a site that has an established domain, but has recently suffered significant ranking decline. one of the problems I have found involves over-use of categories and tags - making the actual content 3 to 4 clicks deep within any given post URL. My question involves the restructuring of category / tag use for improved page content and SEO organic rank impact. Here is an example: domain.com/blue-shoes/blue-shoes-tampa I want to target this specific post and optimize for "blue shoes tampa". I have used the Wordpress SEO plugin by Yoast to help achieve balanced optimization on the on-page post content itself, but now am struggling with the best approach for the URL... also, the site has about 80 (62 posts and 18 pages) total items with similar issues, , so I am hoping that any answer / opinion offered here might also be applicable to the rest of the site. thanks in advance for your time & comments.
SEO Learn Center | | MindSpark0
