Why is the Site indexed?
-
Hi,
I'm trying to test a few things for which I've registered and set up new domains.
For the set up I used Wordpress.
Each Site has about three articles in it but no links pointing to them. Also I didn't take any measures to get my site indexed.
However, one week later all my sites were indexed. Why is that and how can it be?
I'm thankful for any answer since the problem is really ruining my test environment.
The only clue I have, as to why this could be happening, is that I didn't remove the ping sites.Is that the reason? Or are there also other reasons?
Thanks
-
I'd defiinitely recommend a password protect or IP included list at .htaccess. From experience I've found that Google tends to ignore no index when you're trying to keep a test environment under wraps. Even worse, if your site is large you can end up with visitors accessing this in error. Maybe add it to GWT but ensure that it is clearly marked to be excluded from the index. Add the .htaccess with an IP allowed list only and add the no-index clearly to each page.
-
What we do for our test environments is password protect the root directory with .htaccess, this can be a test directory on a live domain, or it can be the whole domain depending on needs. This works great when its just you and a handful of people who need access to the site.
-
It'll be because, as you say, you didn't stop them from being pinged. You should have set up the websites robot.txt to prevent any premature crawling. You can also do this in the WP dashboard, under settings, I believe.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is my client's site penalized and if not, why are other lesser quality sites ranking with lower metrics than my client's?
Hello, I'm trying to explain to a client, as to why certain websites that appear in the top 50 listings for a keyword are there when they don't have very good backlink profiles, and for this keyword, seems you need a high PA above 20 or DA above 25, just to page for page 2 - 3. Running a full SERPs report, I have seen that backlinks to the page that's ranking seems to be as high of a factor as PA, followed by DA and overall backlink profile. Having a high score in one of these 4 areas seems to increase your ranking. However, going into page 3 and beyond, seems that things kinda take a weird turn. After comparing the client's site to those ranking on page 2 I could see that all of them had better PA and more links to the page ranking for that keyword, so page 2 I understand why we don't rank on yet. However, looking at page 3, I see that the client's site in question has better PA, DA, links to page and overall links to domain. Which leaves me to think we have a penalty that's keeping us ranking 50 or beyond. Since our metrics across the boards for what MOZ is showing as ranking factors. The more odd issue is that looking at the line graph, shows right at the time we implemented sitewide https our ranking for this one keyword dropped, while rankings for our other keywords increased. Am I to assume it's a keyword density penalty? What penalties are there with a outcome of ranking limits?
Competitive Research | | Deacyde0 -
Our site is slow..
We have noticed that our site is much slower than many of our competitors and expect that this is affecting our organic ranking. We are on dedicated UK Fast server with [20/08/2013 16:44:35] Tony Jackson: Operating System: CentOS 6 64-bit
Competitive Research | | seanmccauley
CPU: 1x Intel Xeon E5-2620 @ 2.0GHz
Memory: 8x 8GB DDR3 RDIMM
Hard Drive: 4x 128GB SSD RAID10
[20/08/2013 16:46:28] Tony Jackson: Nginx, percona, tomcat/solr, Magento CE, cat: 25200 products I could really do with your thoughts on this page for example http://www.pretavoir.co.uk/sunglasses/ray-ban-sunglasses.html0 -
Comparing 3 sites and their ranks
I am looking at 3 sites and what they have going for them and why they are ranking how they are. I would like to get some of your feedback on why certain sites are above other ones. One of these sites is a client of mine, I will not point out which one. The other 2 are just competitors. http://www.cornhole-game.org/cornhole-bags.html http://www.samscornholebags.com/ http://www.ajjcornhole.com/cornhole-bags.php I have compared them in OSE and they have PA of 39, 29, and 58 respectively. AJJ has a ton of links, many of which are spammy and irrelevant. It looks like a link package was bought at some point. The other two have a similar number of links but www.cornhole-game.org/cornhole-bags.html has more anchor text themed links. None of which seem to be overly optimized. http://www.samscornholebags.com/ seems to have a lot of company branded anchor text links compared to keyword links. http://www.ajjcornhole.com/cornhole-bags.php as I said obviously bought links and has a ton of stuffed keyword links on poor sites http://www.ajjcornhole.com/cornhole-bags.php has minimal social shares http://www.cornhole-game.org/cornhole-bags.html has about 30 shares http://www.samscornholebags.com/ has about 30 shares but a good number of likes and some other social signals. All 3 sites have an A grade using the on page grade tool here on this site. All 3 got dinged for keyword stuffing. http://www.samscornholebags.com/ ranks the highest with the least amount of links and PA http://www.ajjcornhole.com/cornhole-bags.php ranks next with a really poor link profile and the least amount of social activity http://www.cornhole-game.org/cornhole-bags.html ranks the lowest with anchor text links that are not spammed and some social activity So with all of this in mind, would anybody care to weigh in on why they think any of these sites are ranking where they are in comparison to one another.
Competitive Research | | Atomicx0 -
What's causing this site to rank better than another?
As I work on getting a grasp for what causes sites to rank better than others, I'm a bit stumped with two of our competitors. When you search Google for "essay editing" you get these results: 1. Ivyeyesediting.com 2. papercheck.com 3. gradesaver.com 4. scribendi.com 5. essayedge.com When you put these in OSE, it seems crazy that Ivyeyes is anywhere near the top. For example, essayedge creams these guys on EVERY single category. As a new SEO here, what am I missing. This makes absolutely no sense to me. Not only that, it's pretty discouraging seeing essayedge so far down the SERPS with what appears to be some really great numbers. Can anyone shed some light on this?
Competitive Research | | Kibin0 -
SEO's done, 301s in place, old site STILL outranks new site. What to do?
Since Sep 2010 I have had a site up with minimal SEO optimization (www.chrisbrushmusic.com). Oct 29, 2012, I launched a new site on a new domain (www.chrisbrushdrums.com) with more content and tons of SEO work behind it. The content of the new site is significantly different from the old site, and I wish to keep the old site around. I have 301's in place for specific URLs on the old site that point to the new site. I have submitted xml sitemaps for the new site. As of now, the old site still outranks the new site (i.e. Google search for "nashville session drummer" and my old site is #9 - my new site is nowhere). What should I do? Thanks.
Competitive Research | | cbrush0 -
How much time takes Google to Index a page in the search?
Hello all, I have created a page and published it 2 days ago and it does not appear in the Google Search.How much time can usually/on average take to index a page by Google in order to appear in the search results of a web search? I have check the Google Webmaster tools and neither no urls have been reported to be blocked nor the content should be blocked. Thank you very much, Best regards, Antonio
Competitive Research | | aalcocer20030 -
Open Site Explorer is not showing dmT. Where do I go to get this metric.
Just trying to understand the video I watched on Link Building w/ Open Site Explorer. I'm not seeing the dmT metric in the live version. Has it been replaced by something else. Or is there someplace else I need to look for it?
Competitive Research | | AhmadS0 -
Keyword based link problem on site
So I think I might have identified an issue with a site that I'm trying to get ranked for a specific keyword but, wanted to get some opinions before I started making some big changes on the site. On my homepage I have the keyword that I would like to be ranked for in the title lets say "Blue Widgets - Company Name', also on the home page I have some descriptions of our services including the keywords. I also have a couple of the keyword based links within in the content, navigation and footer. But these keyword based links all point to another page on the site: blue-widgets.htm. If I really want my home page to rank for the keyword "Blue Widgets' should all of these links point to the home page instead of the sub page? I know there are a great number of other factors that contribute to rankings but looking at my competition, this is something that they seem to be doing. The keyword based links within the content, navigation or footer all point to the homepage. I also have a higher Domain Authority than some of the sites that rank higher than me so I'm not sure if building more links is the answer. Of course I always want to build natural links but these sites don't seem to be doing that either. Any comments, suggestions or input would be greatly appreciated.
Competitive Research | | TRICORSystems0