Launching Website
-
We are developing a new website and thinking google would not find it because of the directory we put it in (no homepage yet) and because there are no links to it. For example, we are building it in this directory example.com/wordpress/ but somehow google found it and indexed pages not ready to be indexed.
What should we do to stop this until we are ready to launch? Should we just use a robots.txt file with this in it?
User-agent: *
Disallow: /Will this create repercussions when we officially launch?
-
Thank you
-
Thanks!
-
You are correct with your approach.
And as Paddy states, once you launch, remove the disallow and the crawlers will find you.
I would also suggest that once you launch that you submit a sitemap to all of the major search engines to be found even quicker and to help ensure that all of your site pages are crawled.
Mike
-
yes, use the robots file to deindex, once your ready to launch remove the disallow, and the next time google crawls your site you should get indexed.
you must have been linked from somewhere for google to find you, so it means google will find you quicker once you ready to launch ( you already have a backlink)
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can we re rank our Penalyzed website in Google?
Hello This is Maqbul, from India. I have a jobs portal blog [ bharatrecruit.com]. It was getting around 50K to 100K Views a Day and made me $100 a day. But after a few months, my competitor made negative SEO with 12,000 Spammy backlinks. Suddenly my site was hit by Google and now it is getting 200 to 300 Pageviews a day. So the question is I did not disavow bad links for a long time like 3 to 4 months. Now I disavow all the bad links but the website is not ranking. Can we re-rank this site or create another website. Please reply must. None of the bloggers can answer this. Thanks, Regards Maqbul
Technical SEO | | vinaso960 -
Website dropping in ranking
Hello My website is www.invitationsforless.ie and on google Ireland it was ranking no 6 for the keyword "wedding invitations" and I was doing quite well from this but it has now has moved down along the rankings to no 10 and I have gone from the first page on google to the second page which is very disappointing. I did recently change the blurb on my homepage - would this have effected it. Please help I don't know what to do Thanks Linda
Technical SEO | | invitationsforless0 -
Redirects for new website
Hi Moz community,
Technical SEO | | JSimmons17
I'm a fairly new SEO Specialist with a brand new website. We initially had a very basic holding website until the fully functional website was completed. I have to do some redirects as we have both .html and .php files & we don't want to lose SEO value for specific pages (like the index, news, etc). I also want to redirect from a www url to a non-www url. I am trying to accomplish redirects with the following code: RewriteEngine on
RewriteCond %{HTTP_HOST} ^www.mywebsite.com [NC]
RewriteRule (.*) http://mywebsite.com/$1 [R=301,L] RedirectMatch 301 /index.html (.*).(php|html) http://mywebsite.com/index.php RedirectMatch 301 /cupcakes-slideshow/glutenfree-slideshow.html (.*).(php|html) http://mywebsite.com/gluten-and-glutenfree.php RedirectMatch 301 /press.html (.*).(php|html) http://mywebsite.com/news-and-reviews.php Please let me know if I am on the right track. Thanks so much in advance!0 -
Add Small Relevant Posts to website?
Hello Everyone, I'm starting a new WordPress-based community site WP Temple. As a part of this site, i'm going to be adding a "Code Snippets" Section which will show visitors how to do very specific things on their site. These snippets, by nature, will be small articles but contain highly-relevant for search. Should this content be indexed and followed, as well as added to my XML sitemap? I appreciate the feedback! Zach
Technical SEO | | Zachary_Russell0 -
How long does it take to reindex the website
Generally speaking, how long does it take for Google to recrawl/reindex an (ecommerce) website? After changing a number of product subcategories from 'noindex' back to 'index', I regenerated the sitemap and have fetched as Google in WMT. This was a couple of weeks ago and no action yet. Second question: Does Google treat these pages as if they're brand new? I 'noindexed' them back in April, and they were ranking ok then. (I had noindexed them on the back of advice from my SEO, due to concerns about these pages being seen as duplicate content). Help!
Technical SEO | | Coraltoes770 -
My website internal pages are not getting cached with latest data
In our website we have sector list, in home page main category list is displayed click on main category user has to select sub category and reach the result page. EX: Agriculture->Agribusiness->Rice Agriculture page is indexed,but Agribusiness and Rice page is not getting cached,it is showing old indexed date as 23 July 2013,but i have submitted the sitemaps after this 4 times, and some url i have submitted manually in web master tool, but after this also my pages are not cached recently, Please suggest the solution and what might be the problem Thank you In Advance, Anne
Technical SEO | | Vidyavati0 -
Canonicalization on my website
I am kind of new to all this but I would like to understand canonicalization. I have a website which when you arrive on it is www.mysite.com but once inside and flicking back to the homepage it reverts to www.mysite.com/index.html. Should I be doing something re canonicalization? If so what? Will the link juice be diluted by having two home page versions? Thanks
Technical SEO | | FCAbroad0 -
I have found a website on my dedicated server which is not mine
Hi i have found a website on my dedicated server that is not mine by using a number of tools including http://www.yougetsignal.com/tools/web-sites-on-web-server/ the site that i found that was not mine is buycostumes.com i contacted my hosting company and told them and this is the reply i got back We have checked the issue and it appears there have a bug/glitch in this site, because after we checked the mentioned domain we found that this website respond on IP which is not our and is not assisgned in your Dedicated server as you may preview below: Found 3 domains hosted on the same web server as buycostumes.com (66.45.3.44). buycostumes.com (linkback) target.com (linkback) www.certifigroup.com (linkback) Thus if you find any issues on your web server, please mention them in this ticket and we will be glad to provide you with further assistance on this matter. Please feel free to contact us if you have any further technical difficulties. Best regards, Now they have not said if they are going to do anything about this and to be honest i am getting fed up with the hosting company because i am being told that the slow speed i was receiving for my website www.in2town.co.uk was down to it taking a long time to reach my server before reaching my site. Now not sure if this is correct or not but with all the help i have received off semoz i have managed to increase the speed to my site but now i have found this problem. Can anyone tell me if i am being played and also can anyone recommend a professional UK hosting company. Also is this site affecting my spped and my site performance.
Technical SEO | | ClaireH-1848860