Why is the Site indexed?
-
Hi,
I'm trying to test a few things for which I've registered and set up new domains.
For the set up I used Wordpress.
Each Site has about three articles in it but no links pointing to them. Also I didn't take any measures to get my site indexed.
However, one week later all my sites were indexed. Why is that and how can it be?
I'm thankful for any answer since the problem is really ruining my test environment.
The only clue I have, as to why this could be happening, is that I didn't remove the ping sites.Is that the reason? Or are there also other reasons?
Thanks
-
I'd defiinitely recommend a password protect or IP included list at .htaccess. From experience I've found that Google tends to ignore no index when you're trying to keep a test environment under wraps. Even worse, if your site is large you can end up with visitors accessing this in error. Maybe add it to GWT but ensure that it is clearly marked to be excluded from the index. Add the .htaccess with an IP allowed list only and add the no-index clearly to each page.
-
What we do for our test environments is password protect the root directory with .htaccess, this can be a test directory on a live domain, or it can be the whole domain depending on needs. This works great when its just you and a handful of people who need access to the site.
-
It'll be because, as you say, you didn't stop them from being pinged. You should have set up the websites robot.txt to prevent any premature crawling. You can also do this in the WP dashboard, under settings, I believe.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What tool can I use to find the top traffic-driving keyword for a batch of pages from multiple sites?
I thought I might be able to use Ahref's Batch Analysis for this, but that just gives stats on backlinks. I have a several lists of thousands of pages scraped for particular sets of keywords, but what I need is some way to automate fetching the biggest keyword that each page ranks for - biggest being the keyword that is estimated to drive the most organic traffic. Is there a tool out there that does something like this?
Competitive Research | | helenlorettahasan0 -
Comparing 3 sites and their ranks
I am looking at 3 sites and what they have going for them and why they are ranking how they are. I would like to get some of your feedback on why certain sites are above other ones. One of these sites is a client of mine, I will not point out which one. The other 2 are just competitors. http://www.cornhole-game.org/cornhole-bags.html http://www.samscornholebags.com/ http://www.ajjcornhole.com/cornhole-bags.php I have compared them in OSE and they have PA of 39, 29, and 58 respectively. AJJ has a ton of links, many of which are spammy and irrelevant. It looks like a link package was bought at some point. The other two have a similar number of links but www.cornhole-game.org/cornhole-bags.html has more anchor text themed links. None of which seem to be overly optimized. http://www.samscornholebags.com/ seems to have a lot of company branded anchor text links compared to keyword links. http://www.ajjcornhole.com/cornhole-bags.php as I said obviously bought links and has a ton of stuffed keyword links on poor sites http://www.ajjcornhole.com/cornhole-bags.php has minimal social shares http://www.cornhole-game.org/cornhole-bags.html has about 30 shares http://www.samscornholebags.com/ has about 30 shares but a good number of likes and some other social signals. All 3 sites have an A grade using the on page grade tool here on this site. All 3 got dinged for keyword stuffing. http://www.samscornholebags.com/ ranks the highest with the least amount of links and PA http://www.ajjcornhole.com/cornhole-bags.php ranks next with a really poor link profile and the least amount of social activity http://www.cornhole-game.org/cornhole-bags.html ranks the lowest with anchor text links that are not spammed and some social activity So with all of this in mind, would anybody care to weigh in on why they think any of these sites are ranking where they are in comparison to one another.
Competitive Research | | Atomicx0 -
How can stie A be outranking site B?
Hi everyone. I seem to have a lot of questions the past couple of days! Take a look at these two URLs: Site A: http://www.peachstateaudio.com/products/Mixing_Consoles/Digital_Consoles/Roland/peachstate-audio-roland-m200i Site B: http://www.ccisolutions.com/StoreFront/product/roland-m-200i-digital-mixer I will mail 2-dozen homemade chocolate chip cookies to anyone who can tell me why Site A massively outranks Site B for the term "roland m-200i" - Seriously. Thanks in advance!
Competitive Research | | danatanseo0 -
SEO's done, 301s in place, old site STILL outranks new site. What to do?
Since Sep 2010 I have had a site up with minimal SEO optimization (www.chrisbrushmusic.com). Oct 29, 2012, I launched a new site on a new domain (www.chrisbrushdrums.com) with more content and tons of SEO work behind it. The content of the new site is significantly different from the old site, and I wish to keep the old site around. I have 301's in place for specific URLs on the old site that point to the new site. I have submitted xml sitemaps for the new site. As of now, the old site still outranks the new site (i.e. Google search for "nashville session drummer" and my old site is #9 - my new site is nowhere). What should I do? Thanks.
Competitive Research | | cbrush0 -
Indexed?
Simple question: Is this page indexed? http://www.dmoz.org/Business/Financial_Services/Insurance/Agents_and_Marketers/Automotive/United_States/California/
Competitive Research | | raph39880 -
How much time takes Google to Index a page in the search?
Hello all, I have created a page and published it 2 days ago and it does not appear in the Google Search.How much time can usually/on average take to index a page by Google in order to appear in the search results of a web search? I have check the Google Webmaster tools and neither no urls have been reported to be blocked nor the content should be blocked. Thank you very much, Best regards, Antonio
Competitive Research | | aalcocer20030 -
How can I find the pages on my site with the highest page rank?
I have a lot pages on my site and I'm wondering if there is a tool out there that will find all the pages with the highest pagerank for me? Also, it would be helpful to find that on competitors sites as well. Any ideas?
Competitive Research | | shawn810 -
In Open Site Explorer, what does it mean when a linking page does not contain any reference to the URl entered?
When running Open Site Explorer on a particular URL, I get a list of linking pages. Many of these pages have a high Page Authority. I am assuming that this is a list of pages that presumably link to the URL I entered. First, is this correct? Next, when I click on an entry in the list I don't see any reference to the URL on the page, even viewing the page source. What does this mean and why is the link in the list?
Competitive Research | | jkenyon1