Why is the Site indexed?
-
Hi,
I'm trying to test a few things for which I've registered and set up new domains.
For the set up I used Wordpress.
Each Site has about three articles in it but no links pointing to them. Also I didn't take any measures to get my site indexed.
However, one week later all my sites were indexed. Why is that and how can it be?
I'm thankful for any answer since the problem is really ruining my test environment.
The only clue I have, as to why this could be happening, is that I didn't remove the ping sites.Is that the reason? Or are there also other reasons?
Thanks
-
I'd defiinitely recommend a password protect or IP included list at .htaccess. From experience I've found that Google tends to ignore no index when you're trying to keep a test environment under wraps. Even worse, if your site is large you can end up with visitors accessing this in error. Maybe add it to GWT but ensure that it is clearly marked to be excluded from the index. Add the .htaccess with an IP allowed list only and add the no-index clearly to each page.
-
What we do for our test environments is password protect the root directory with .htaccess, this can be a test directory on a live domain, or it can be the whole domain depending on needs. This works great when its just you and a handful of people who need access to the site.
-
It'll be because, as you say, you didn't stop them from being pinged. You should have set up the websites robot.txt to prevent any premature crawling. You can also do this in the WP dashboard, under settings, I believe.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How can stie A be outranking site B?
Hi everyone. I seem to have a lot of questions the past couple of days! Take a look at these two URLs: Site A: http://www.peachstateaudio.com/products/Mixing_Consoles/Digital_Consoles/Roland/peachstate-audio-roland-m200i Site B: http://www.ccisolutions.com/StoreFront/product/roland-m-200i-digital-mixer I will mail 2-dozen homemade chocolate chip cookies to anyone who can tell me why Site A massively outranks Site B for the term "roland m-200i" - Seriously. Thanks in advance!
Competitive Research | | danatanseo0 -
Finding new links to site
Is there a way to find sites that linked to my site during a certain time period? Say in the past 2 weeks or from March 1-March 15th ?
Competitive Research | | priceseo0 -
How does this site get a youtube backlink?
http://www.youtube.com/watch?v=dzMdpgJ-7Is is a video with a clickable external link to their website. How do they do this??
Competitive Research | | brianw100 -
Best way to check a sites traffic that you dont own. (Canadian Site)
We are looking for a way to get the estimated traffic for some sites in our niche. Usually we use compete.com or spyfu, but they only track traffic in the US. Does anyone know a way we can get traffic estimates in Canada? Thanks in advance.
Competitive Research | | ClaytonKendall0 -
How to check the Pr and Da of a thousand sites
Hi, I have a list of a thousand sites. I want to qualify the sites based on Pr and Da so that I can do my outreach. Pls advice how this can be done without manually putting each site in ose. Cheers, Vishal
Competitive Research | | vishalkhialani0 -
Keywords in URL structure for Large Site
We are creating a national real estate website which will contain 2mil+ listings. Our aim is to compete with the National leaders in the field. We are trying to lock down a url structure and it basically comes down to if we should put a major keyword in the url structure or not. The structure would have regional keywords naturally. Its the addition of a more descriptive key word which is in question. Our domain name has no keywords in it. For the sake of this example, we would be targeting "city real estate"... oursite.com/real-estate/state/city/ or oursite.com/state/city/ Here is what the big sites use as an example: http://www.zillow.com/homes/for_sale/New-York-NY/ http://www.trulia.com/NY/New_York/ http://www.trulia.com/real_estate/New_York-New_York/ http://www.realtor.com/realestateandhomes-search/New-York Id love to not have to throw keywords in there and be as clean as possible but i also dont want to shoot myself in the foot. The big boys do add additional keywords in the url, does that mean we should? Id much rather be a leader than a follower but again, I dont want to mess this up from the start and these guys have probably tested this (or have they?). Input would be greatly appreciated.
Competitive Research | | cobbsfriedman0 -
How can my site not ranked on easy keyword while it currently ranked 1 on difficult keyword??
The site in question is http://ikt.co.id The site is perfectly optimized (or even over optimized) for keyword "Bikin Website Murah" (in Indonesia it means "develop an affordable website") currently if you search on both google.co.id AND google.com, it ranked on #10 (on google.co.id) and it ranked on #7 (on google.com), and both term only return 1.3 million results I have A LOT OF pages that started with 'bikin website' , or 'website murah' ... there are a lot of them, and i have had a lot of backlinks on those pages too (have been manually building a lot of links, starting from creating a tutorial article and blog submission and many other way) .. the site has been perfectly optimized for that keyword For example we have http://ikt.co.id/blog-category/bikin-website-murah-promo-terbaru.html (for newest promotion) http://ikt.co.id/blog/bikin-website-seo-murah-discount-40-sampai-31-juli-2011.html (for discount 40% promo that lasted untill 31 juli 2011) AND YET, if you search on google.co.id for keyword "2000 likes facebook" , our lone page that i created when our facebook likes reached that amount, RANKED #1!! , and please let me tell you this term return 400 million results++ (on google.com this keyword ranked #19, on 500 million results++). And let me tell you it take that SINGLE page (which has absolutely 0 backlinks) 2 days to ranked #1 .... and her brother if you searched "1000 likes facebook" also show similar result (though not better then the sister) How ?!? and Why ?!? , i dont understand this at all.... my domain does not contain any keyword, they uses the same engine and yet that lone pages which have absolutely no backlink ranked so well on a very competitive keyword, while my Target Keyword ranked poorly.... And what is even more bizzare? "Bikin website murah" might not rank good, but "bikin website" ranked better x_x ... arghh i dont get it... why my site ranked poorly on easy keywords and ranked high on difficult keywords :(( .... Why I am not smiling because those easy keyword is actually my primary keywords 😞
Competitive Research | | IKT0 -
My client has shown me a similar site, though not a competitor. He wants to know what sites they are linked from that give them such a good Google rank for certain kewords. Can SEOMoz tell me this?
When using google.com.au and searching for "travel to france", www.frenchtravel.com.au is the 3rd organic result. (the 1st two are not travel businesses, they are non profit travel guides) My client, who runs www.visituk.com.au, an Australian site that organises tours of the UK, said "so we just need to add these sort of words to the site?" I said, yes, but it doesn't end there. The real task is to have a link to your site on other sites surrounded with the words "travel" and "UK". He asked if he could see a list of the sites the french site was being referred by relevant to the search phrase. Is there an SEOmoz tool for this? Or is there another way I can generate that list? Thanks Simon
Competitive Research | | electrik0