Why is the Site indexed?
-
Hi,
I'm trying to test a few things for which I've registered and set up new domains.
For the set up I used Wordpress.
Each Site has about three articles in it but no links pointing to them. Also I didn't take any measures to get my site indexed.
However, one week later all my sites were indexed. Why is that and how can it be?
I'm thankful for any answer since the problem is really ruining my test environment.
The only clue I have, as to why this could be happening, is that I didn't remove the ping sites.Is that the reason? Or are there also other reasons?
Thanks
-
I'd defiinitely recommend a password protect or IP included list at .htaccess. From experience I've found that Google tends to ignore no index when you're trying to keep a test environment under wraps. Even worse, if your site is large you can end up with visitors accessing this in error. Maybe add it to GWT but ensure that it is clearly marked to be excluded from the index. Add the .htaccess with an IP allowed list only and add the no-index clearly to each page.
-
What we do for our test environments is password protect the root directory with .htaccess, this can be a test directory on a live domain, or it can be the whole domain depending on needs. This works great when its just you and a handful of people who need access to the site.
-
It'll be because, as you say, you didn't stop them from being pinged. You should have set up the websites robot.txt to prevent any premature crawling. You can also do this in the WP dashboard, under settings, I believe.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Non ecommerce site with high DA, being outranked by lower DA sites with ecommerce - help?
I have a website that we look after, up until January this year the rankings were really strong - the site has a much higher domain authority than the competitors, much more links and much more relevant content (all measured with moz's tools). About 6 months ago the rankings started to dive for national search terms. Now one thing ive noticed is that nearly all of the other sites in the search sell products online where we have no such function - could this be correlated - has anyone else experienced this?
Competitive Research | | rhysc1 -
I need Ecommerce Site who have implemented J-Son Schema for Blog
Hi All, Just I need few sites who have implemented J-son schema on there blog. Looking for ecommerce blog. Hope you guys share with me good site. Thanks in advance.
Competitive Research | | amu1232 -
What tool can I use to find the top traffic-driving keyword for a batch of pages from multiple sites?
I thought I might be able to use Ahref's Batch Analysis for this, but that just gives stats on backlinks. I have a several lists of thousands of pages scraped for particular sets of keywords, but what I need is some way to automate fetching the biggest keyword that each page ranks for - biggest being the keyword that is estimated to drive the most organic traffic. Is there a tool out there that does something like this?
Competitive Research | | helenlorettahasan0 -
Finding most popular sites within a category - who offers that information?
Hello Mozzers - I am researching the most popular sites within a category - are there any services that identify the most popular sites within a category - I noticed Alexa do offer a service but I have no idea who else offers such a service (Majestic, perhaps?). Thanks in advance, Luke
Competitive Research | | McTaggart0 -
2 sites with low DA and PA and unoptimised <title>outranking everyone for competitive search term - How ?</title>
Im doing some keyword research for a new client, Ive found 2 anomalies for competitive search terms where sites with unoptimised <title>tags, poor backlinks and other stats, (compared to the other sites listed in the SERP) are out ranking everyone and claiming the #1 spot</p> <p> The 2 search terms are :</p> <ul> <li dir="ltr"> <p dir="ltr"><a href="https://www.google.co.uk/search?q=interior+designers+london&oq=interior+designers+london&aqs=chrome..69i57j69i65j69i60j69i65l2j69i60.2784j0j1&sourceid=chrome&ie=UTF-8">Interior designers London</a>- #1 new-id.co.uk - <a href="https://moz.com/researchtools/ose/links?site=new-id.co.uk&filter=&source=external&target=page&group=0&page=1&sort=page_authority&anchor_id=&anchor_type=&anchor_text=&from_site=">OSE info</a></p> </li> <li dir="ltr"> <p dir="ltr"><a href="https://www.google.co.uk/search?q=interior+designers+london&oq=interior+designers+london&aqs=chrome..69i57j69i65j69i60j69i65l2j69i60.2784j0j1&sourceid=chrome&ie=UTF-8#q=interior+designer+london">Interior designer London</a>- #1 nstudio.co.uk - <a href="https://moz.com/researchtools/ose/links?site=http%3A%2F%2Fnstudio.com%2F&filter=&source=external&target=page&group=0&page=1&sort=page_authority&anchor_id=&anchor_type=&anchor_text=&from_site=">OSE info</a></p> </li> </ul> <p> (interestingly they hardly rank at all for any modification of those search terms)</p> <p> The only thing i could think of is that they both had some really good links using that exact anchor text, but ive been checking OSE for the past month both in the backlinks and the just discovered but couldnt see anything like that.</p> <p>I conducted the SERP checking from a laptop with a broadband connection based in London, although im not very local to either of these locations im about an 8th of the cities distance away from one of those location and about half a cities distance away from the other. So i dont think its a local skew thats causing the SERP rankings.</p> <p>For both sites i can see they had old domains which now redirect to the them :</p> <ul> <li dir="ltr"> <p dir="ltr"><span data-mce-mark="1">New-id.co.uk = </span><span data-mce-mark="1"><a href="http://newidinteriors.com/">newidinteriors.com</a> - <a href="https://moz.com/researchtools/ose/links?site=http%3A%2F%2Fnewidinteriors.com&no_redirects=1&filter=&source=external&target=page&group=0&page=1&sort=page_authority&anchor_id=&anchor_type=&anchor_text=&from_site=">OSE info</a> - PA1, DA1</span></p> </li> <li dir="ltr"> <p dir="ltr"><span data-mce-mark="1">Nstudio.co.uk = intarya.com - <a href="https://moz.com/researchtools/ose/links?site=www.intarya.com&filter=&source=external&target=page&group=0&page=1&sort=page_authority&anchor_id=&anchor_type=&anchor_text=&from_site=">OSE info</a> - Da 32, PA43</span></p> </li> </ul> <p> Although the intarya domain was quite strong with good backlinks (but nothing above par comapred to the other sites the nstudio.co.uk site is now outranking, the anchor text was mostly natural with only some keyword anchor text from PA1 pages. </p> <p>The <a href="http://newidinteriors.com/">newidinteriors.com</a> didnt seem to have a backlink profile, both PA1 and DA1.</p> <p> Ive taken screenshots of the SERP pages below, but feel free to dig further</p> <p>Any idea what's going on here ?</p> <a download="HWkjmDf.png" class="imported-anchor-tag" href="http://i.imgur.com/HWkjmDf.png" target="_blank">HWkjmDf.png</a> <a download="A70jXse.png" class="imported-anchor-tag" href="http://i.imgur.com/A70jXse.png" target="_blank">A70jXse.png</a></title>
Competitive Research | | mike8780 -
How on earth is this site ranking so highly?
I'm trying (& struggling) to rank for the keyword property in italy. Yet in the past 5 weeks I've seen this site -- betterpropertyitaly (dot) com -- rocket from about #30 to #2 for the keyword and am trying to figure out why. The obvious is that it's in the domain name, but that can't be the be-all-and-end-all, surely? It's a 2 yr 9 mth old site, so why the sudden spurt? I look in Open Site Explorer and the metrics look pretty weak: Domain Authority: 17 Page Authority: 29 Linking Root Domains: 9 Absolutely zero social shares. Good luck to him and all -- but I'm trying to figure out what he's doing right and I'm not. My site apart, he's beating some pretty big-hitters.
Competitive Research | | Jeepster0 -
Is there a way to establish how old a link to a site is?
I wonder if anyone has any insight on the above question.
Competitive Research | | InTouchMarketing560 -
How to check the Pr and Da of a thousand sites
Hi, I have a list of a thousand sites. I want to qualify the sites based on Pr and Da so that I can do my outreach. Pls advice how this can be done without manually putting each site in ose. Cheers, Vishal
Competitive Research | | vishalkhialani0