Launching Website
-
We are developing a new website and thinking google would not find it because of the directory we put it in (no homepage yet) and because there are no links to it. For example, we are building it in this directory example.com/wordpress/ but somehow google found it and indexed pages not ready to be indexed.
What should we do to stop this until we are ready to launch? Should we just use a robots.txt file with this in it?
User-agent: *
Disallow: /Will this create repercussions when we officially launch?
-
Thank you
-
Thanks!
-
You are correct with your approach.
And as Paddy states, once you launch, remove the disallow and the crawlers will find you.
I would also suggest that once you launch that you submit a sitemap to all of the major search engines to be found even quicker and to help ensure that all of your site pages are crawled.
Mike
-
yes, use the robots file to deindex, once your ready to launch remove the disallow, and the next time google crawls your site you should get indexed.
you must have been linked from somewhere for google to find you, so it means google will find you quicker once you ready to launch ( you already have a backlink)
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Website homepage temporarily getting removed from google index
hi, website: www.snackmagic.com The home page goes out of google index for some hours and then comes back. We are not sure why our home page is getting de-indexed temporarily. This doesn't happen with other pages on our website. This has been happening intermittently in the gap of 2-3 days. Any inputs will be very useful for us to debug this issue Thanks
Technical SEO | | manikbystadium0 -
Question Regarding Website Architecture
Hello All, Our website currently has a general solutions subdirectory, which then links to each specific solution, following the path /solutions/ => /solutions/solution1/. As our solutions can be quite complex, we are adding another subdirectory to target individuals by profession. I would like to link from our profession pages to the varying solutions that help. As both subdirectories will be top level pages in the main menu, would linking from our professions to **solutions **be poor architecture? In this case the path would look like: /professions/ => /professions/profession1/ => /solutions/solution1/. Thanks!
Technical SEO | | Tom3_150 -
My android website not showing on results
my website will index good،and its top on some few keywords but its not top for many keywords . << some time it showed on results but will be hidden after some time >> what you thing??? url is https://android-apk.org
Technical SEO | | moztabliq10 -
CSS and Javascipt files - website redesign project
UPDATED: We ran a crawl of the old website and have a list of css and javascript links as are part of the old website content. As the website is redesigned from scratch, I don't think these old css and javascipt files are being used for anything on the new site. I've read elsewhere online that you redirect "all" content files if launching/migrating to a new site. We are debating if this is needed for css and javascript files. Examples (A) http://website.com/wp-content/themes/style.css (B) http://website.com/wp-includes/js/wp-embed.min.js?ver=4.8.1
Technical SEO | | CREW-MARKETING0 -
Thoughts on different base URLs for different website language?
Hello mozzers, Currently in the process of setting up a new website for a new entity. I was wondering what your thoughts were on using different base urls for different languages. Example: ABCgroup.com -> English
Technical SEO | | yacpro13
groupeABC.com -> French I've never done this before; I've been one to prefer using a subfolder structure. However, for this case, the expected visitors are truly split between 2 languages, and therefore having a base url in the visitor's language is appealing. Would this approach be detrimental if all pages have a proper hreflang tag? Thanks!0 -
My website's pages are not being indexed correctly
Hi, One of our websites, which is actually a price comparison engine, facing indexing problem at Google. When we check “site:mywebsite.com “, there are lots of pages indexed which are not from mywebsite.com but from merchants websites. The index result page also shows merchant’s page title. In some cases the title is from merchant’s site but when the given link is accessed it points to mywebsite.com/index. Also the cache displays the merchant’s product page as the last indexed version rather than showing ours. The mywebsite.com has quite few Merchants that send us their product feed. Those products are listed on comparison page with prices. The merchant’s links on comparison page are all no-follow links but some of the (not all) merchant’s product pages are indexed against mywebsite.com as mentioned above instead of product comparison page of mywebsite.com How can we fix the issue? Thanks!
Technical SEO | | digitalMSB0 -
Sitemap for dynamic website with over 10,000 pages
If I have a website with thousands of products, is it a good idea to create a sitemap for this website for the search engines where you show maybe 250 products on a page so it makes it easy for the search engine to find the part and also puts that part closer to the home page? Seems like google likes pages that are the closest to the home page (less clicks the better)
Technical SEO | | roundbrix0 -
Website completely dropped off Google in our top keywords
Over the weekend, our website (http://www.esdandassociates.com) completely dropped off the google database in our top keywords. The only way that our site can be found is if you specifically type in the company name. Other search engines were unaffected and rankings remained the same or rose for the week. Previous keywords that we ranked in the first couple of positions (san antonio advertising agency, san antonio public relations) are now not in the top 50. We have not made any recent changes to our site besides basic content updates and all appears normal regarding crawler access. I have also not been able to find anything irregular in webmaster tools. Any ideas?
Technical SEO | | eriksimpson0