Why is the Site indexed?
-
Hi,
I'm trying to test a few things for which I've registered and set up new domains.
For the set up I used Wordpress.
Each Site has about three articles in it but no links pointing to them. Also I didn't take any measures to get my site indexed.
However, one week later all my sites were indexed. Why is that and how can it be?
I'm thankful for any answer since the problem is really ruining my test environment.
The only clue I have, as to why this could be happening, is that I didn't remove the ping sites.Is that the reason? Or are there also other reasons?
Thanks
-
I'd defiinitely recommend a password protect or IP included list at .htaccess. From experience I've found that Google tends to ignore no index when you're trying to keep a test environment under wraps. Even worse, if your site is large you can end up with visitors accessing this in error. Maybe add it to GWT but ensure that it is clearly marked to be excluded from the index. Add the .htaccess with an IP allowed list only and add the no-index clearly to each page.
-
What we do for our test environments is password protect the root directory with .htaccess, this can be a test directory on a live domain, or it can be the whole domain depending on needs. This works great when its just you and a handful of people who need access to the site.
-
It'll be because, as you say, you didn't stop them from being pinged. You should have set up the websites robot.txt to prevent any premature crawling. You can also do this in the WP dashboard, under settings, I believe.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to Find Another Site's robots.txt File?
An SEO report, not by SEOmoz, says my top two competitors have robots.txt files that disallows spidering. I suspect that their robots.txt file doesn't disallow all spidering. How do I find out what is in their robots.txt files?
Competitive Research | | lbohen0 -
Open Site Explorer Date of Links obtained
Hi is there anyway to compare a competitors profile over two time periods ie, 6 months ago, then today for example. I have the sites within a current campaign, i would like for example to find a competitors back-links they have obtained in the last 6 months. As some of my competitors have 1000s of links to its difficult to see what they have been upto thanks
Competitive Research | | Will_Craig1 -
SEO's done, 301s in place, old site STILL outranks new site. What to do?
Since Sep 2010 I have had a site up with minimal SEO optimization (www.chrisbrushmusic.com). Oct 29, 2012, I launched a new site on a new domain (www.chrisbrushdrums.com) with more content and tons of SEO work behind it. The content of the new site is significantly different from the old site, and I wish to keep the old site around. I have 301's in place for specific URLs on the old site that point to the new site. I have submitted xml sitemaps for the new site. As of now, the old site still outranks the new site (i.e. Google search for "nashville session drummer" and my old site is #9 - my new site is nowhere). What should I do? Thanks.
Competitive Research | | cbrush0 -
Why does my site get sandboxed but this one doesn't?
I'm currently working on an entire website redesign and restructuring. My current website is extremely spammy. I really worked on it before I knew much about SEO. Now that I have a better foundation I have been remaking my site to get rid of duplicate content and to have a much better UX. With this said, I still depend on the current site to bring in my income while I'm working on getting my new site up. Google seems to constantly kick me out for about a month at a time and then let me back in. The few other times I thought it was because the new site I have been working on is on a different domain and was exactly the same for a while (I don't want google to find this new domain it's just for testing purposes). So I removed the new domain from google and in a couple weeks my main site was back in. Problem is yesterday google hit me again. I'm out of google for all my search terms. Before I was ranking on the first page for just about every "keyword + city" phrase I was trying to rank for. I can find plenty of reasons why google would give me problems with my current site. For example I have TONS of duplicate pages with just the keyword/city changed. Pretty spammy. I did buy about 5 links a year ago or so but they are pretty nothing sites. My question is if google's going to ban me why don't they just do it? They keep taking me out and putting me back in. No messages in webmaster tools. My domain is below: http://yourmusiclessons.com Also when I just started out I got the idea of "keyword + city" from a competitor that ranks for EVERYTHING which is also found below: http://www.musikalessons.com All of the links I bought were the same links the above site bought. I tried buying a link from classical.net which has a high page rank and links to musikalessons.com on each page of their site. As soon as google found the links, I was kicked out. I had them remove it. My question is musika has basically the same "spammyness" as me just on a much larger scale and yet they never seem to be kicked out of google and still rank high. I've thought about reporting musika, but I'm afraid Google will ban me as well because my site is just as bad. Again I'm working all day on fixing my site and doing a 180, it's just taking a long time and I can't launch quite yet. I live off the income from my current site though, so it's very disheartening when this happens. Any ideas would be greatly appreciated!
Competitive Research | | BrianJenkins0 -
Is open site explorer running on your side
I am facing trouble to open the website http://www.opensiteexplorer.org/ please check on your side and let me know
Competitive Research | | 247Email0 -
My site is ranked in the top 5 for my keywords, but howcome I'm low in an organic search results for my key words?
Are the other factors such as page rank, Alexa rating and mozRank used to determine where I will show up in search results, over Goggle's key word rank for my key words?
Competitive Research | | allstatetransmission0 -
How a site only with Frame can be at #1 google in a competitive keyword?
Guys, I need help. I have a company in Brasil and due to lack of budget, I'm doing the SEO for my self. And for two years Im reading everything that I can to do my best in my website. I worked very hard, but the #1 in the most important keyword for my company is a very bad website only with frames. What they are doing? Could anyone give help? Keyword: "acampamento"
Competitive Research | | Naghirniac
Google Brazil (www.google.com.br)
#1 website: www.acampar.net My website: www.acampamentoaguiasdaserra.com.br Thank you in advance Miguel0 -
Should I link to this site or is it too spammy?
Hi all, I've been asked if I want to exchange links with http://www.myteetimesonline.com/ and I'm tempted but fearful that its link profile looks spammy. What do you guys think? I'm basically starting from scratch with my own site http://www.golfgear4you.com and have a Page Rank 0 and Domain authority 32. The guys that want to link to me are Page Rank 3 but Domain authority 35. Their content would be of interest to my site's users and vice versa but my biggest concern is their link profile looks awful because the sites that link to them don't appear to be very relevant. I've done a lot of reading on this and have found the resources on this site to be a goldmine. The generally message is avoid easy links to spammy sites because they could hurt credibility. I just want to check I've actually learnt something and my instincts about this site are correct. i.e leave it alone!! Thanks, Andy
Competitive Research | | getzen560