Why is the Site indexed?
-
Hi,
I'm trying to test a few things for which I've registered and set up new domains.
For the set up I used Wordpress.
Each Site has about three articles in it but no links pointing to them. Also I didn't take any measures to get my site indexed.
However, one week later all my sites were indexed. Why is that and how can it be?
I'm thankful for any answer since the problem is really ruining my test environment.
The only clue I have, as to why this could be happening, is that I didn't remove the ping sites.Is that the reason? Or are there also other reasons?
Thanks
-
I'd defiinitely recommend a password protect or IP included list at .htaccess. From experience I've found that Google tends to ignore no index when you're trying to keep a test environment under wraps. Even worse, if your site is large you can end up with visitors accessing this in error. Maybe add it to GWT but ensure that it is clearly marked to be excluded from the index. Add the .htaccess with an IP allowed list only and add the no-index clearly to each page.
-
What we do for our test environments is password protect the root directory with .htaccess, this can be a test directory on a live domain, or it can be the whole domain depending on needs. This works great when its just you and a handful of people who need access to the site.
-
It'll be because, as you say, you didn't stop them from being pinged. You should have set up the websites robot.txt to prevent any premature crawling. You can also do this in the WP dashboard, under settings, I believe.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Non ecommerce site with high DA, being outranked by lower DA sites with ecommerce - help?
I have a website that we look after, up until January this year the rankings were really strong - the site has a much higher domain authority than the competitors, much more links and much more relevant content (all measured with moz's tools). About 6 months ago the rankings started to dive for national search terms. Now one thing ive noticed is that nearly all of the other sites in the search sell products online where we have no such function - could this be correlated - has anyone else experienced this?
Competitive Research | | rhysc1 -
Can deceptive ads help sites to rank? Pogosticking effect involved...
Hello,
Competitive Research | | fablau
I have a question for you. I have noticed that many music sites that appear in the first top results for keywords our users search for, include all the same ads that deceive people by inviting them to "Download" or get the "Full Album" of what people may be search for. Look at the following websites that are often displayed at the first spots for keywords like "Christmas Sheet Music" (just an example): [....] They all have, most of the times, the same ads. Look at the following screenshots taken from the sites above (the ads are at the top of the page): http://www.virtualsheetmusic.com/storage/google/Shot1.jpg
http://www.virtualsheetmusic.com/storage/google/Shot2.jpg Those deceptive ads could engage users more than legitimate websites not showing those ads or not showing ads at all, making Google think that people are more engaged on those website showing those deceptive ads. If it is quality that Google is looking for, shouldn't they do something to avoid having sites ranking well just because of some deceptive ads that take users into action, but without any useful result? I am eager to know your ideas on this issue. Thanks! Fab.0 -
Why does this site atlantapestcontrol.com rank so high?
I have been doing competitive research on the keyword phrase "atlanta pest control" this website atlantapestcontrol.com is #1. Why? The number 2 website makes some sense for its rank, but this one does not.
Competitive Research | | SammyL300660 -
What's causing this site to rank better than another?
As I work on getting a grasp for what causes sites to rank better than others, I'm a bit stumped with two of our competitors. When you search Google for "essay editing" you get these results: 1. Ivyeyesediting.com 2. papercheck.com 3. gradesaver.com 4. scribendi.com 5. essayedge.com When you put these in OSE, it seems crazy that Ivyeyes is anywhere near the top. For example, essayedge creams these guys on EVERY single category. As a new SEO here, what am I missing. This makes absolutely no sense to me. Not only that, it's pretty discouraging seeing essayedge so far down the SERPS with what appears to be some really great numbers. Can anyone shed some light on this?
Competitive Research | | Kibin0 -
Confused about sites ranking when compared to each other
I'm looking at the keyword "snow guards" for two competitor websites: snogem dot com (SG) snoshield dot com (SS) I've been watching these two for about 4 months. SG stays in the top 5 SERPs consistently, while SS bounces around from 15-20 on Google. I've looked at the competitive link comparison and SS appears to have a much better link profile when it comes to DA. Page specific metrics in OSE show SS with a higher mozrank, moztrust, internal followed links, linking root domains, total linking root domains, and linking C Blocks. It appears to me that SG has many more links, but their links seem to be many site wide exact match keyword links, and paid for advertisements on a major site in the metal roofing industry. Honestly the linking profile of SG surprises me that they rank so much higher than SS after the Panda/Penguin updates. I have two questions: 1. When competing against these sites, should I model SG's link profile? I'm nervous to because of my previous statement thinking they will get hit with Panda/Penguin like updates. 2. What would it take to bounce SS to competing with SG on the first page? Is the number of links the only thing this site is missing, or is there something else to focus on.
Competitive Research | | kadesmith0 -
Working through the slides on my first seo project, I'm trying to determine the most popular content on competition sites.
From the video, I understand I should be looking for unique opportunities. But is there a baseline for product qualification, ie., a min. PA,LRD, Inbound LInks, social shares, etc. I guess I'm asking what I should be looking for in the data provided on each competing site? What determines THE most popular and unique product?
Competitive Research | | AhmadS0 -
How can I find the pages on my site with the highest page rank?
I have a lot pages on my site and I'm wondering if there is a tool out there that will find all the pages with the highest pagerank for me? Also, it would be helpful to find that on competitors sites as well. Any ideas?
Competitive Research | | shawn810 -
Why do some websites that have hardly any backlinks, poorly optimised get placed above sites that are doing all they can with SEO?
For example take these two websites. www.rfasecurity.co.uk is a site that Iam working on and have had some success with yet snifferdogs.org.uk seems to be poorly optimised with little backlinks and still gets place higher. is it due to the key word in the domian name? The key search word is sniffer dogs New at this so any help would be appreciated regards Dave
Competitive Research | | ThePod0