How to make google crawl our repository to make our site rank but make sure users dont go to our repository ?
-
We have a website that has links to documents related to various sectors. But the challenge is we do not have the documents on the website itself and they are linked to our document repository that has been blocked to google. We have put nofollow and noindex to the repository. Since Google can not read those documents, it has resulted in an impact in our SEO ranking. What would be the best way to make Google crawl the PDF documents in the repository at the same time make it invisible the "repo" not appear in the search engines. Would dofollow and noindex sequence work ?
-
Playing with indexation tags can be dangerous (same goes for robots.txt). Google should still be able to read the repo even if it is no-indexed, as long as you haven't also blocked the repo in robots.txt. Robots.txt is telling Google what to crawl, no-index is telling Google what it can or can-not put in its search results
Of course, if your docs were ranking because of PageRank passed from the repo, the no-index tag will kill the PageRank of the repo (and thus all the docs which it links to, as they are not being 'fed' any more). If a page is no-indexed, it's seen as unimportant for Google and the PageRank is often nullified. Although Google can crawl no-indexed URLs, they crawl them WAY slower as they're seen as really unimportant with no PageRank (at the bottom of the internet)
Why not just put all your PDF docs in a PDF sitemap ans submit to Google in Search Console:
https://stackoverflow.com/questions/1072880/should-i-list-pdfs-in-my-sitemap-file
This will let Google see them all. But if their parent is no-indexed with no PageRank, they may still not rank as well as before...
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can you check my Quran site and its technical issues?
Hi, Hope you are doing good, I saw many Quran websites working fine. I have a blog that has online Quran classes of Arabic and Tajweed related courses as well. Can you please check that if all is okay in terms of technical issues? Here is the website: https://learnquran.academy
SEO Learn Center | | ShirleyLemons0 -
Trying to rank my personal business website
Hi, Guys I run a small company in england. I've been constantly ripped off by other seo companies. Im have my 1st child and really cannot afford the cost of a company to do this. I have just joined SEO mom look like a really great platform. Is there any advice on how i can rank my website. I am willing to put the time in myself and can devote late nights to try and succeed. Any advice on where to start links etc would be really greatly received. Thank you all.
SEO Learn Center | | letsrent0 -
Google Analytics setup tips and tricks?
I want to see (and possibly compile) other marketers tips and tricks when it came to setting up their Google Analytics. I feel like I sometimes get into a rut when I setup GA for clients and I want to make sure that I'm not getting rusty with it. Some of the things I'm interested in (but not limited to): How do you use dashboards? What funnels do you setup? How do you utilize goals? What are your favorite metrics to report to clients? What are the top items on your checklist when setting up GA? And many others I could include here... I'd be interested in seeing what other marketers include in their GA setup and reporting. These can be super simple or expert level tips and tricks. It's a personal curiosity I have so that I make sure I'm staying up to date with everything but if there is enough participation I will compile everything into a YouMoz post or something as a guide for us to use and share. So please share this question with others if you can. Thanks!
SEO Learn Center | | HashtagJeff2 -
How to ask Google to remove old pages that don't exist
I have moved a site to a new location. There are a number of pages that date back to 2012 and 2011 and we do not want them anymore. Is there a way to ask Google to remove these pages entirely.
SEO Learn Center | | mayanksaxena0 -
SEO Ads On Third Party Job Sites?
Hello all, I seriously doubt I will get a reply to this as I'm guessing no one has experience with it. if you do though then I would appreciate any information either via comment or PM. Basically, I need to know how I can improve the rankings of job posts within the third party sites. An example would be totaljobs.com, how can I improve the rankings of advertisements that are posted there or is it simply ranked by date and location?. When I had my eBay business, I did a lot of research on eBay SEO and discovered some important factors for ranking within the eBay website. I'm basically wanting to do the same here on job board websites for job ads posted to them. Their algorithms won't be as advanced as Google etc so I'm guessing if they do they will be open for higher keyword density levels and that kind of thing.. I've googled it quite a bit and can't find any information at all on it. Thanks.
SEO Learn Center | | LukeHutchinson0 -
Remove image URL from a google crawl
hello one of the warnings Im getting is that one of my urls has too many on page links here's the page: http://cheap-airport-taxis.com/airport-cab/?show=gallery but the url is being auto generated due to the wordpress plugin NextGen Gallery anyway I can exclude these from the site crawl. This page has no purpose, as the core path shows these images anyway. James
SEO Learn Center | | smashseo0 -
Does Server Speed Effect SEO Rankings?
I was told by a website developer that Google ranks sites higher if they are hosted on faster servers. Is this true? For example my site is currently limited because it is a Quick Shopping Cart site hosted by Godaddy. He said that if I hosted my research chemical site with a different company with faster servers I could get better ranking immediately. I linked to my site. I think it loads ok. However Godaddy probably isn't the fastest service around.
SEO Learn Center | | chronicle0 -
Subdomain Structure vs Top Level Domain Site; An Actual Case
A major non-profit with 360 locations just completed a new program. The non-profit has updated its site at URL www.mysite.com. Each of the 360 locations has a subdomain site with URL http://mylocation.mysite.com which reflects the branding of www.mysite.com and has a Drupal content management system. The company is asking each location to transition the top level domain of each location ( example www.mysite.com to http://mylocation.mysite.com). The subdomain location sites are tied to a CRM system, which initially hasn't worked. But the long term objective is to gather CRM data via the subdomain location sites. The main site has an Alexa Global Rank of 30,400 and a US Rank of 7900. The main site has 2600 backlinks, and is a pretty powerful site. Some individual locations in large metropolitan areas have decent backlinks, but most don't. The PR of most local sites is 3 to 6. The SEO experts at www.mysite.com have maintained that the power and authority of the main site www.mysite.com would propel the local rank of each location to a position of high visibility. Using Market Samuari and Majestic SEO, a test on each of the 360 location subdomains was performed. It was determined that Page Rank did pass from the main site to the local site in 15% of the cases. However, 85% of the subdomain sites had 0 Page Rank. Page Rank did vary from 2 to 5 on the 15% that passed rank, but there was no cross checking to see if the subdomain location had the same page rank as the locations top level domain. Referring Domains Domain (RDD) was usually -1; Referring Domains Page (RDP) was usually 0; Page Backlinks (BLP) was usually 0; Back Links to Domain (BLD) was usually 0; Google Cache age was all over the map from unknown to 58 days. Questions: Anyone suspect why some sites pass Page Rank and others don't; Should we continue on the path towards using the subdomain sites, or should each location keep its top level site and work on improving their local search visibility there? There is no way to check Google Analytics (GA) on the subdomain sites without having to access GA on the main site www.mysite.com. Right? Will Google Places and Bing Local honor the subdomain URLs for their respective Local Search pages. Would there be a compelling reason or reasons to abandon the subdomain sites? Thanks much for your comments!!
SEO Learn Center | | VernonWanner0