Why is the Site indexed?
-
Hi,
I'm trying to test a few things for which I've registered and set up new domains.
For the set up I used Wordpress.
Each Site has about three articles in it but no links pointing to them. Also I didn't take any measures to get my site indexed.
However, one week later all my sites were indexed. Why is that and how can it be?
I'm thankful for any answer since the problem is really ruining my test environment.
The only clue I have, as to why this could be happening, is that I didn't remove the ping sites.Is that the reason? Or are there also other reasons?
Thanks
-
I'd defiinitely recommend a password protect or IP included list at .htaccess. From experience I've found that Google tends to ignore no index when you're trying to keep a test environment under wraps. Even worse, if your site is large you can end up with visitors accessing this in error. Maybe add it to GWT but ensure that it is clearly marked to be excluded from the index. Add the .htaccess with an IP allowed list only and add the no-index clearly to each page.
-
What we do for our test environments is password protect the root directory with .htaccess, this can be a test directory on a live domain, or it can be the whole domain depending on needs. This works great when its just you and a handful of people who need access to the site.
-
It'll be because, as you say, you didn't stop them from being pinged. You should have set up the websites robot.txt to prevent any premature crawling. You can also do this in the WP dashboard, under settings, I believe.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Problem on my site
Hello, thank you for guiding me
Competitive Research | | kaajshop 0
I had a problem with the speed of the site. I do not know how to solve this problem
this page:https://kaajshop.com/cat/700 -
What tool can I use to find the top traffic-driving keyword for a batch of pages from multiple sites?
I thought I might be able to use Ahref's Batch Analysis for this, but that just gives stats on backlinks. I have a several lists of thousands of pages scraped for particular sets of keywords, but what I need is some way to automate fetching the biggest keyword that each page ranks for - biggest being the keyword that is estimated to drive the most organic traffic. Is there a tool out there that does something like this?
Competitive Research | | helenlorettahasan0 -
Why is this site ranking #1?
I've done extensive research into http://www.maggiesottero.com/ and cannot come up to any definitive conclusions as to why this site is ranking #1 for the term "wedding dresses." The page is not optimized for the keyword. **Any thoughts? **
Competitive Research | | craigsmith3330 -
Keyword based link problem on site
So I think I might have identified an issue with a site that I'm trying to get ranked for a specific keyword but, wanted to get some opinions before I started making some big changes on the site. On my homepage I have the keyword that I would like to be ranked for in the title lets say "Blue Widgets - Company Name', also on the home page I have some descriptions of our services including the keywords. I also have a couple of the keyword based links within in the content, navigation and footer. But these keyword based links all point to another page on the site: blue-widgets.htm. If I really want my home page to rank for the keyword "Blue Widgets' should all of these links point to the home page instead of the sub page? I know there are a great number of other factors that contribute to rankings but looking at my competition, this is something that they seem to be doing. The keyword based links within the content, navigation or footer all point to the homepage. I also have a higher Domain Authority than some of the sites that rank higher than me so I'm not sure if building more links is the answer. Of course I always want to build natural links but these sites don't seem to be doing that either. Any comments, suggestions or input would be greatly appreciated.
Competitive Research | | TRICORSystems0 -
Sites With Duplicate Content Ranking Way Higher
The site I am writing about is easendtorontohomes.com I don't get it. I see that some of my competitors have more inbound links and have been around longer. Their SEOmoz trust etc is also higher. But I don't get how many could possibly be ranking higher since they're sites are all template based site via Web Tech Design and the content is duplicated from one to the other. The other weird thing is that they do everything wrong - they stuff their keywords tag, some of them use the same keywords/meta data on every single page, some of them don't even have meta tags, some of them don't even have a blog with ANY original content. Apart from listings EastEndTorontoHomes.com has TONS of original, well-researched, and keyword rich content. I just don't get it. Is it possible that google has some sort of relationship with that company? Or am I totally missing something? Some of these sites include: tinasmith.ca, mikeclarke.com, teamkassen.com
Competitive Research | | annasus0 -
Should I link to this site or is it too spammy?
Hi all, I've been asked if I want to exchange links with http://www.myteetimesonline.com/ and I'm tempted but fearful that its link profile looks spammy. What do you guys think? I'm basically starting from scratch with my own site http://www.golfgear4you.com and have a Page Rank 0 and Domain authority 32. The guys that want to link to me are Page Rank 3 but Domain authority 35. Their content would be of interest to my site's users and vice versa but my biggest concern is their link profile looks awful because the sites that link to them don't appear to be very relevant. I've done a lot of reading on this and have found the resources on this site to be a goldmine. The generally message is avoid easy links to spammy sites because they could hurt credibility. I just want to check I've actually learnt something and my instincts about this site are correct. i.e leave it alone!! Thanks, Andy
Competitive Research | | getzen560 -
Why do some websites that have hardly any backlinks, poorly optimised get placed above sites that are doing all they can with SEO?
For example take these two websites. www.rfasecurity.co.uk is a site that Iam working on and have had some success with yet snifferdogs.org.uk seems to be poorly optimised with little backlinks and still gets place higher. is it due to the key word in the domian name? The key search word is sniffer dogs New at this so any help would be appreciated regards Dave
Competitive Research | | ThePod0 -
List of all outbound links to a specified site
For example, I want to search for every link to my site from stumbleupon. Is there a way to do this? Much thanks in advance!
Competitive Research | | TrevorMcKendrick0