Why is the Site indexed?
-
Hi,
I'm trying to test a few things for which I've registered and set up new domains.
For the set up I used Wordpress.
Each Site has about three articles in it but no links pointing to them. Also I didn't take any measures to get my site indexed.
However, one week later all my sites were indexed. Why is that and how can it be?
I'm thankful for any answer since the problem is really ruining my test environment.
The only clue I have, as to why this could be happening, is that I didn't remove the ping sites.Is that the reason? Or are there also other reasons?
Thanks
-
I'd defiinitely recommend a password protect or IP included list at .htaccess. From experience I've found that Google tends to ignore no index when you're trying to keep a test environment under wraps. Even worse, if your site is large you can end up with visitors accessing this in error. Maybe add it to GWT but ensure that it is clearly marked to be excluded from the index. Add the .htaccess with an IP allowed list only and add the no-index clearly to each page.
-
What we do for our test environments is password protect the root directory with .htaccess, this can be a test directory on a live domain, or it can be the whole domain depending on needs. This works great when its just you and a handful of people who need access to the site.
-
It'll be because, as you say, you didn't stop them from being pinged. You should have set up the websites robot.txt to prevent any premature crawling. You can also do this in the WP dashboard, under settings, I believe.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Open Site Explorer Date of Links obtained
Hi is there anyway to compare a competitors profile over two time periods ie, 6 months ago, then today for example. I have the sites within a current campaign, i would like for example to find a competitors back-links they have obtained in the last 6 months. As some of my competitors have 1000s of links to its difficult to see what they have been upto thanks
Competitive Research | | Will_Craig1 -
How much time takes Google to Index a page in the search?
Hello all, I have created a page and published it 2 days ago and it does not appear in the Google Search.How much time can usually/on average take to index a page by Google in order to appear in the search results of a web search? I have check the Google Webmaster tools and neither no urls have been reported to be blocked nor the content should be blocked. Thank you very much, Best regards, Antonio
Competitive Research | | aalcocer20030 -
Keyword Search - another site bypassed me and they are not ranked well...
I was trying to optimize the keywords "music for kids" . This is a no brainer because my URL is "musicforkids" My On-Page Report Card for "music for kids" gives my site a "A". The on page report card for the other site gets an "F". But the other site comes up number ONE in the organic Google search and my site comes up number three. The two sites above me receive a crappy on page Keyword report for the key words "music for kids" but they still come up above me for that search term. What's the deal?
Competitive Research | | musicforkids1 -
Best way to check a sites traffic that you dont own. (Canadian Site)
We are looking for a way to get the estimated traffic for some sites in our niche. Usually we use compete.com or spyfu, but they only track traffic in the US. Does anyone know a way we can get traffic estimates in Canada? Thanks in advance.
Competitive Research | | ClaytonKendall0 -
Is it possible to see bounce rate on external sites?
Are there any tools that will let you see your competitor's bounce rates?
Competitive Research | | nicole.healthline0 -
How many Page Rank 8 sites are there?
Anyone have any estimate of how many Page Rank 8 sites are out there? Best, Steve
Competitive Research | | Aggie0 -
Site redirect
Hi, Our site www.suncamp.nl has, for language reasons, 2 redirects So : www.suncamp.nl is redirected with a 301 to www.suncamp.nl/nl/nl and is than redirected 301 to http://www.suncamp.nl/nl/nl/home/uc19-l1-n804/ My question is; is this bad for our SEO? Recently we've been doing a lot of linkbuilding and SEO copywriting, but in comparison with our competitors were lagging behind. So I'm looking for other bottlenecks. Kind regards, Dennis Overbeek My email: dennis@acsi.eu ACSI
Competitive Research | | SEO_ACSI0 -
My client has shown me a similar site, though not a competitor. He wants to know what sites they are linked from that give them such a good Google rank for certain kewords. Can SEOMoz tell me this?
When using google.com.au and searching for "travel to france", www.frenchtravel.com.au is the 3rd organic result. (the 1st two are not travel businesses, they are non profit travel guides) My client, who runs www.visituk.com.au, an Australian site that organises tours of the UK, said "so we just need to add these sort of words to the site?" I said, yes, but it doesn't end there. The real task is to have a link to your site on other sites surrounded with the words "travel" and "UK". He asked if he could see a list of the sites the french site was being referred by relevant to the search phrase. Is there an SEOmoz tool for this? Or is there another way I can generate that list? Thanks Simon
Competitive Research | | electrik0