Strange Website Activity
-
Hello, I have been building websites for about 4 months now and finally had my first real success with a website.
I found a niche that I was able to get on the first page with. This site was fine and then boom it dropped to #17 around the time of the recent Google changes. So I just thought it was that, I decided to add it as a campaign on here.
This is when I noticed that the pages were not being crawled. So being new at all of this, I researched that. Of course, the main things were is the privacy and robots.txt. It is running on wordpress and I know not to set the blog to private, but I wasn't familiar with how to edit the robots.txt.
I found a good plugin that easily allowed me to set the text to allow all bots. It seemed to be set to the normal wordpress settings before, and I never had a problem with any of my websites not being crawled.
Anyway, once I just set it to allow all bots on ALL of my website, the pages started being crawled again.
My traffic went back up and I was on the first page all day yesterday.
Today, so far big drop off. So, I deleted the campaign and set up a new one. Sure enough no pages crawled yet.
I made some security changes using Bulletproof Security and another plugin to see if that effects it. Nothing yet.
I am just really confused as to what is going on, so if any of you have any ideas that would be great.
It is a simple site, and I made some changes like theme when I was trying to figure out why the pages weren't being crawled. So it is not the most beautiful design right now. Also, I try my best to put up well-written useful content, so I don't think that is the issue for the rankings drops.
I don't have many if any actual backlinks yet because of the newness of my site, could be the reason for it acting strange BUT none of that explains the pages not being crawled at the same time my site drops?????
Sorry so long but had to explain it all! Thanks in advance to anyone who has anything to say about this situation!
Edit: I should clarify, I put the the security plugins on yesterday while I was on the first page and have deleted them to see if that allows the pages to be crawled. Sorry if I wasn't clear.
-
Thank you both! These are great answers and probably true in this case but I guess that would lead me to a secondary question.
I have seen questions in here about pages not being crawled with the SEOMOZ Campaign tool. So I hate to now post the question, "why are my pages not being crawled?"
But that is the mystery. As soon as I made the new allow all robots text file and submitted it, I checked and instantly my pages were being crawled again. Now nothing again, it just sits at N/A. As well as the traffic dropped off...
Confusing. But I am just going to give it awhile to look for overall patterns or maybe it is a glitch with the SEOMOZ tool that just happens to be corresponding with the traffic dips. LOL, I know strange things like this do occur in this business.
Thanks and if anyone has anymore ideas I am happy to hear them. I was worried I had some sort of malware or whatever the hackers do to your site????!!!!
-
Pretty much everything William said.
If you do notice your rankings fluctuating, this is just the Google Dance - every new site sees it and you will appear higher to start with and drop when Google figures where you should be placed.
I would suggest using the webmaster tools, get a sitemap in there and get it submitted. I know there are always going to be horror stories and coincidences and people will start worrying, but if you do everything right, you really have no need to
Andy
-
Thanks for your response! As for campaign I just mean the campaign tool here on seo moz. It is what keeps saying the pages aren't being crawled at the same time my traffic drops. Then when I see the traffic it also says the pages are being crawled on the campaign settings.
Sorry if all of this is wording confusingly, I am struggling to explain exactly what is going on here.
It could all just be coincidental. I probably will have to just wait and see, like you say, traffic is going to be up and down.
I haven't used any Google tools on this website, just because I have been paranoid of the big G lately and read about keeping some data private from them by not using those tools.
Paranoia maybe, so I might consider using those tools just to see if anything strange pops up.
-
It sounds like you are doing everything you can at this moment to get back to the rankings you once saw.
? Have you set up Google Webmaster Tools Yet?
As for your question about a campaign are you bidding on keywords? And is this where you are seeing the flux? If so I would check your landing page quality score to see what Google Rates that landing page and as well find a way to increase and improve the page for better conversion opportunities.
I also noticed you are not using the FREE Google Analytics tool so you can track this type of information that will give you a better idea of what your visitors are doing and where they came from.
Last you mentioned that this is a new website, and with that you will see traffic flux until a few months goes buy for a permanent position however when I say permanent it is dependent on your freshness of content and quality of all.. You will need links and in time those will come, however first focus on User Experience and then you can really start going after the SEO type factors.
I hope this helps a bit.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
WEbsite cannot be crawled
I have received the following message from MOZ on a few of our websites now Our crawler was not able to access the robots.txt file on your site. This often occurs because of a server error from the robots.txt. Although this may have been caused by a temporary outage, we recommend making sure your robots.txt file is accessible and that your network and server are working correctly. Typically errors like this should be investigated and fixed by the site webmaster. I have spoken with our webmaster and they have advised the below: The Robots.txt file is definitely there on all pages and Google is able to crawl for these files. Moz however is having some difficulty with finding the files when there is a particular redirect in place. For example, the page currently redirects from threecounties.co.uk/ to https://www.threecounties.co.uk/ and when this happens, the Moz crawler cannot find the robots.txt on the first URL and this generates the reports you have been receiving. From what I understand, this is a flaw with the Moz software and not something that we could fix form our end. _Going forward, something we could do is remove these rewrite rules to www., but these are useful redirects and removing them would likely have SEO implications. _ Has anyone else had this issue and is there anything we can do to rectify, or should we leave as is?
Moz Pro | | threecounties0 -
Are there any free (or paid) tools available online that download Meta Tags for ALL URL's of a website?
Hi, I am looking to run an On-Site audit for a website and I'm wondering if there are any tools available online that take the existing Meta Tags on ALL pages of a website and downloads them to a .CSV or .XLS. Would need Meta Title and Meta Description for all pages at the very least. Any suggestions are appreciated - looking for Free or Paid options. Thanks.
Moz Pro | | SEO5Team0 -
Google has a penalty on my website? How to resolve?
I recently purchases Moz pro, hoping to find out why my website isn't ranking on specific keywords. I'm done analytics on myself and my competition and it seems that I rank better than them on 95% of the categories (using OpenSiteExplorer and keyword research tools). So I purchases Moz Pro hoping I'd find the glaring error in my ways. I found a few small issues I was having, and have dealt with them. Overall however, they were small issues, and have led me to believe Google as a penalty in place for my website (SEO friend have also suspected this). In my Google Webmaster tools, nothing is marked under Manual Actions. So does anyone have a way to contact Google and have them directly look at my website to insure there is no errors in their system?
Moz Pro | | ZSuttonPhoto10 -
Problem in doing seo for a German medical website?
Hi We have been doing seo for http://www.internetapotheke-holland.com/ since last 4 month including onpage and offpage process like link building etc. but not getting a proper output keywords are as follow: xenical holland rezeptfrei xenical Xenical Ohne Rezept Xenical Bestellen Xenical Kaufen Rezeptfrei bestellen Rezeptfrei kaufen Tramadol TropfenRezeptfrei Please could you add some more cool tips so that we can help our client. Thanks & Regards
Moz Pro | | expertvillagemedia0 -
How to force SeoMoz to re-crawl my website?
Hi, I have done a lot of changes on my website to comply with SeoMoz advices, now I would like to see if I have better feedback from the tool, how can I force it to re-crawl a specific campaign? (waiting another week is too long :-))
Moz Pro | | oumma0 -
Why is the SEOmoz crawler crawling the old version of our website?
Hello, I'm a new SEOmoz member. On Dec. 2nd, after completely redesigning our website, we migrated to a new hosting company by switching our DNS to the new server. The vast majority of the URLs have changed and we configured redirects of the old URLs to the new ones. Although, this task is not completed yet. After the migration, I created an account on SEOmoz to be able to track our progress and find the issues to fix to optimize our SEO. For some reason, in the SEOmoz reports it is the old URLs that show up. Unless the crawler does not actually crawl the pages and only uses the indexed pages to generate its report, I don't understand how could this possible. Anyone has a clue? When will the new URLs be indexed by SEOmoz and the major search engines? Thanks for your help!
Moz Pro | | Gestisoft-Qc0 -
Crawling a website with redirects
Hi, I started a campaign for a website which uses multiple redirects before showing the real content. in the crawling report only one page is crawled. Is there a way to let the crawler pass the redirects to get usefull reports? The website is www.cegeka.be Thank you
Moz Pro | | Cegeka0 -
A tool for seeing all the keywords a website ranks for
As title, is there a tool out there that will allow you to see all the keywords a website ranks for in the first few pages of a particlur search engine? I would be particularly interested for keywords in the first 10 pages of Google. Thanks
Moz Pro | | blagger0