Why is the Site indexed?
-
Hi,
I'm trying to test a few things for which I've registered and set up new domains.
For the set up I used Wordpress.
Each Site has about three articles in it but no links pointing to them. Also I didn't take any measures to get my site indexed.
However, one week later all my sites were indexed. Why is that and how can it be?
I'm thankful for any answer since the problem is really ruining my test environment.
The only clue I have, as to why this could be happening, is that I didn't remove the ping sites.Is that the reason? Or are there also other reasons?
Thanks
-
I'd defiinitely recommend a password protect or IP included list at .htaccess. From experience I've found that Google tends to ignore no index when you're trying to keep a test environment under wraps. Even worse, if your site is large you can end up with visitors accessing this in error. Maybe add it to GWT but ensure that it is clearly marked to be excluded from the index. Add the .htaccess with an IP allowed list only and add the no-index clearly to each page.
-
What we do for our test environments is password protect the root directory with .htaccess, this can be a test directory on a live domain, or it can be the whole domain depending on needs. This works great when its just you and a handful of people who need access to the site.
-
It'll be because, as you say, you didn't stop them from being pinged. You should have set up the websites robot.txt to prevent any premature crawling. You can also do this in the WP dashboard, under settings, I believe.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What tool can I use to find the top traffic-driving keyword for a batch of pages from multiple sites?
I thought I might be able to use Ahref's Batch Analysis for this, but that just gives stats on backlinks. I have a several lists of thousands of pages scraped for particular sets of keywords, but what I need is some way to automate fetching the biggest keyword that each page ranks for - biggest being the keyword that is estimated to drive the most organic traffic. Is there a tool out there that does something like this?
Competitive Research | | helenlorettahasan0 -
What to do about one site dominating search results? (multiple pages ranking)?
Anybody have thoughts on dealing with search results where the same site gets listed multiple times? "weebly vs wix" is one example (same site #1-3, repetitive articles, not crazy high authority), but I see this now and then. I know Google likes variety, so it's weird for me to see results like this dominating search results. Thoughts? What gets these sites to take over the top rankings for a specific term? Any way to rise up in this situation, outside of the usual? Any tips on duplicating this kind of success?
Competitive Research | | davidwaring0 -
Site Architecture for a Services Company
Hey everyone, I'm doing the keyword research for a new virtual assistant services website that I am building. Being that there's almost a limitless number of services that a customer can outsource to a virtual assistant, I have a lot of service keyword options. Here's the problem: I don't know how to layout my services in a scalable fashion so that I can continue to add onto the services list (each with their own unique and helpful page) after the website is published. I have two options: 1. Create a service page with categories, each with links to the individual services. Like on my competitor: http://www.virtualemployee.com/services but with links to pages focused on the individual service keyword (ex. virtual receptionist services). 2. Don't have a services page, but include the services as blog posts like on my competitor's website: http://www.virtualstafffinder.com/blog. Obviously, the blog would be much more "scalable" in the terms of adding more services. It also reduces a lot of clutter on my website. However, it's not categorized like the average service or e-commerce website. Not sure if this is necessarily a bad thing. What do you think? Your help would be greatly appreciated!
Competitive Research | | Stryde0 -
How can stale, poor quality sites rank above fresh, high quality sites?
Dear Community, How is it that a Google search for temperature sensors shows the second result as site **A **(http://goo.gl/zRS1L) in a higher positionthan site B (http://goo.gl/3Xy2O) which is on the 2nd page of the SERPs. Site A blatantly does not follow Google's webmaster guidelines and recommendations for design, content or code. Site B scores an 'A' for on page analysis using SEOmoz, it also has a much higher number of root domains in and Moz rank, we have checked that site B has only quality inbound links, and anchor text is natural, it follows Google's guidelines for content and code diligently, and it is on an older domain. We are satisfied that site B has not been penalised by Google, e.g Penguin algorithm updates. We have also done a website verification with Google. Site B has fresher content compared to site A. Site B also has a sitemap yet site A doesn't. We're satisfied that we can rule out the following Algorithm Factors: Penguin algorithm updates Google Notified penalties Dodgy Inbound links Dodgy Anchor text Website verification with Google Fresh vs. static content Sitemap present Server Speed Server location Domain age and about 170 other algorithm factors Does anyone have any ideas as to why site A is ranking higher than site B in Google.co.uk? Thanks in advance. CD.
Competitive Research | | chichesterdesign0 -
Identify keywords certain sites target
Hello, I've been asked to identify what keywords a group of blogs/communities might target so that we might gain some insight for our own SEM purposes. It's been several years since I used SEOmoz's tools, so they have changed a lot. I couldn't remember if you had such a tool, but it appears you do not--or at least not that I am finding. I was wondering if anyone could point me in the direction of such a tool where I can input a subdomain, and have a report stating which keywords are the ones the domain rates highly for. To be clear: I'm not looking for a traffic estimation or anything; simply a breakdown of what keywords a specific page or domain support most. P.S. I did a search on here for certain terms like "competitive keyword targets" and so forth, and saw no matching QA. I'm sorry if there is a duplicate! Thanks,
Competitive Research | | krisgosser
Kris0 -
List of all outbound links to a specified site
For example, I want to search for every link to my site from stumbleupon. Is there a way to do this? Much thanks in advance!
Competitive Research | | TrevorMcKendrick0 -
Why there is no even close correlation between MajesticSEO data and Open Site? Explorer?
I compared my site home page against my competitor homepage with Open Site Explorer and I found that according Open Site Explorer I have only 3 backlinks where in MajesticSEO I have more than 100 backlinks in 'Historic' data and more 90 in '30 days fresh data'. Why there is no even close correlation between MajesticSEO data and Open Site Explorer? How SEOMoz count backlinks?
Competitive Research | | eladlvy0 -
In Open Site Explorer, what does it mean when a linking page does not contain any reference to the URl entered?
When running Open Site Explorer on a particular URL, I get a list of linking pages. Many of these pages have a high Page Authority. I am assuming that this is a list of pages that presumably link to the URL I entered. First, is this correct? Next, when I click on an entry in the list I don't see any reference to the URL on the page, even viewing the page source. What does this mean and why is the link in the list?
Competitive Research | | jkenyon1