Why is the Site indexed?
-
Hi,
I'm trying to test a few things for which I've registered and set up new domains.
For the set up I used Wordpress.
Each Site has about three articles in it but no links pointing to them. Also I didn't take any measures to get my site indexed.
However, one week later all my sites were indexed. Why is that and how can it be?
I'm thankful for any answer since the problem is really ruining my test environment.
The only clue I have, as to why this could be happening, is that I didn't remove the ping sites.Is that the reason? Or are there also other reasons?
Thanks
-
I'd defiinitely recommend a password protect or IP included list at .htaccess. From experience I've found that Google tends to ignore no index when you're trying to keep a test environment under wraps. Even worse, if your site is large you can end up with visitors accessing this in error. Maybe add it to GWT but ensure that it is clearly marked to be excluded from the index. Add the .htaccess with an IP allowed list only and add the no-index clearly to each page.
-
What we do for our test environments is password protect the root directory with .htaccess, this can be a test directory on a live domain, or it can be the whole domain depending on needs. This works great when its just you and a handful of people who need access to the site.
-
It'll be because, as you say, you didn't stop them from being pinged. You should have set up the websites robot.txt to prevent any premature crawling. You can also do this in the WP dashboard, under settings, I believe.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Problem on my site
Hello, thank you for guiding me
Competitive Research | | kaajshop 0
I had a problem with the speed of the site. I do not know how to solve this problem
this page:https://kaajshop.com/cat/700 -
Looking for traffic estimator for specific pages or subdomains on a site I do not control
I'm looking for a free traffic estimator that allows me to look at monthly visits for specific pages or subdomains on a site I do not control. So far I've found trafficestimate.com, but that only lets me look at domains. I'd like to see estimates for subdomains or specific pages. Does this even exist?
Competitive Research | | JGoldberg0 -
Site Architecture for a Services Company
Hey everyone, I'm doing the keyword research for a new virtual assistant services website that I am building. Being that there's almost a limitless number of services that a customer can outsource to a virtual assistant, I have a lot of service keyword options. Here's the problem: I don't know how to layout my services in a scalable fashion so that I can continue to add onto the services list (each with their own unique and helpful page) after the website is published. I have two options: 1. Create a service page with categories, each with links to the individual services. Like on my competitor: http://www.virtualemployee.com/services but with links to pages focused on the individual service keyword (ex. virtual receptionist services). 2. Don't have a services page, but include the services as blog posts like on my competitor's website: http://www.virtualstafffinder.com/blog. Obviously, the blog would be much more "scalable" in the terms of adding more services. It also reduces a lot of clutter on my website. However, it's not categorized like the average service or e-commerce website. Not sure if this is necessarily a bad thing. What do you think? Your help would be greatly appreciated!
Competitive Research | | Stryde0 -
Open Site Explorer Date of Links obtained
Hi is there anyway to compare a competitors profile over two time periods ie, 6 months ago, then today for example. I have the sites within a current campaign, i would like for example to find a competitors back-links they have obtained in the last 6 months. As some of my competitors have 1000s of links to its difficult to see what they have been upto thanks
Competitive Research | | Will_Craig1 -
How can I find the pages on my site with the highest page rank?
I have a lot pages on my site and I'm wondering if there is a tool out there that will find all the pages with the highest pagerank for me? Also, it would be helpful to find that on competitors sites as well. Any ideas?
Competitive Research | | shawn810 -
Site Ranks Better than Comp...but why?
My site is ranking better than some of the competition sites even though the Moz Rank and Moz Trust are lower, anyone know why?
Competitive Research | | CalgaryRealtor390 -
Best place to view referral traffic on a third party site?
What is the best site / tool to use to view referral traffic on a third party site?
Competitive Research | | nicole.healthline0 -
IP Address Of Site
Hi there, really new to seo and loving being able to research everything on seo moz. I have a question about the ip address of my site: I use a company that sells templated real estate websites (I'm a realtor) and I'm noticing all of their websites show as having the same ip address. There are probably 100's of sites on their server targeting the same keywords as I am, would this affect my ranking at all? I'm just considering switching to a Wordpress site with a unique IP address, so I'm curious to find out how the seomoz members would answer this question. Cheers, Adrian
Competitive Research | | adrianaldous0