Strange Website Activity
-
Hello, I have been building websites for about 4 months now and finally had my first real success with a website.
I found a niche that I was able to get on the first page with. This site was fine and then boom it dropped to #17 around the time of the recent Google changes. So I just thought it was that, I decided to add it as a campaign on here.
This is when I noticed that the pages were not being crawled. So being new at all of this, I researched that. Of course, the main things were is the privacy and robots.txt. It is running on wordpress and I know not to set the blog to private, but I wasn't familiar with how to edit the robots.txt.
I found a good plugin that easily allowed me to set the text to allow all bots. It seemed to be set to the normal wordpress settings before, and I never had a problem with any of my websites not being crawled.
Anyway, once I just set it to allow all bots on ALL of my website, the pages started being crawled again.
My traffic went back up and I was on the first page all day yesterday.
Today, so far big drop off. So, I deleted the campaign and set up a new one. Sure enough no pages crawled yet.
I made some security changes using Bulletproof Security and another plugin to see if that effects it. Nothing yet.
I am just really confused as to what is going on, so if any of you have any ideas that would be great.
It is a simple site, and I made some changes like theme when I was trying to figure out why the pages weren't being crawled. So it is not the most beautiful design right now. Also, I try my best to put up well-written useful content, so I don't think that is the issue for the rankings drops.
I don't have many if any actual backlinks yet because of the newness of my site, could be the reason for it acting strange BUT none of that explains the pages not being crawled at the same time my site drops?????
Sorry so long but had to explain it all! Thanks in advance to anyone who has anything to say about this situation!
Edit: I should clarify, I put the the security plugins on yesterday while I was on the first page and have deleted them to see if that allows the pages to be crawled. Sorry if I wasn't clear.
-
Thank you both! These are great answers and probably true in this case but I guess that would lead me to a secondary question.
I have seen questions in here about pages not being crawled with the SEOMOZ Campaign tool. So I hate to now post the question, "why are my pages not being crawled?"
But that is the mystery. As soon as I made the new allow all robots text file and submitted it, I checked and instantly my pages were being crawled again. Now nothing again, it just sits at N/A. As well as the traffic dropped off...
Confusing. But I am just going to give it awhile to look for overall patterns or maybe it is a glitch with the SEOMOZ tool that just happens to be corresponding with the traffic dips. LOL, I know strange things like this do occur in this business.
Thanks and if anyone has anymore ideas I am happy to hear them. I was worried I had some sort of malware or whatever the hackers do to your site????!!!!
-
Pretty much everything William said.
If you do notice your rankings fluctuating, this is just the Google Dance - every new site sees it and you will appear higher to start with and drop when Google figures where you should be placed.
I would suggest using the webmaster tools, get a sitemap in there and get it submitted. I know there are always going to be horror stories and coincidences and people will start worrying, but if you do everything right, you really have no need to
Andy
-
Thanks for your response! As for campaign I just mean the campaign tool here on seo moz. It is what keeps saying the pages aren't being crawled at the same time my traffic drops. Then when I see the traffic it also says the pages are being crawled on the campaign settings.
Sorry if all of this is wording confusingly, I am struggling to explain exactly what is going on here.
It could all just be coincidental. I probably will have to just wait and see, like you say, traffic is going to be up and down.
I haven't used any Google tools on this website, just because I have been paranoid of the big G lately and read about keeping some data private from them by not using those tools.
Paranoia maybe, so I might consider using those tools just to see if anything strange pops up.
-
It sounds like you are doing everything you can at this moment to get back to the rankings you once saw.
? Have you set up Google Webmaster Tools Yet?
As for your question about a campaign are you bidding on keywords? And is this where you are seeing the flux? If so I would check your landing page quality score to see what Google Rates that landing page and as well find a way to increase and improve the page for better conversion opportunities.
I also noticed you are not using the FREE Google Analytics tool so you can track this type of information that will give you a better idea of what your visitors are doing and where they came from.
Last you mentioned that this is a new website, and with that you will see traffic flux until a few months goes buy for a permanent position however when I say permanent it is dependent on your freshness of content and quality of all.. You will need links and in time those will come, however first focus on User Experience and then you can really start going after the SEO type factors.
I hope this helps a bit.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Question About creating seperate websites or using a subdomain or just subfolders...Thanks!
I am working with a company who has created a reservation software...We have been advertising this software aggressively and have been doing well with companies coming on board...Let's call the company ABC and the url was ABC.com...Now they are launching a customer facing side of things that will have all the clients listed for consumers to book at their location...So an online marketplace...Like VRBO or AirBnB...They are taking the name of the software company and making it the url for the marketplace site...So now the marketplace is ABC.com and we need to figure out if we go with a new site for the software side or if we use subdomains or a subfolder.... Do we go with ABCSoftware.com - New root domain ABC.software.com - Subdomain ABC.com/software - Subfolder There are a few other intricacies with this...Not all the companies that use the software will be on the marketplace side...And people who book through the company but using the software have a url embedded on their site that books there directly...This booking costs the company less than a booking that comes through the marketplace so this needs to be kept separate... Thanks for the help everyone!
Moz Pro | | TheMarketingInitiative1 -
Moz isn't recognizing content on our website hosted on bubble.is
Hi all. We have a bubble.is site and it's difficult to get Moz to recognize the text on the site (even though Google seems to recognize it most of the time). The pages are recognized...just not the text. **In case you want to play around: ** https:getmarlow.com/about https://getmarlow.com/article/gather-data-on-where-your-time-and-energy-go-1579415891021x868278876529492000
Moz Pro | | Marlow20 -
WEbsite cannot be crawled
I have received the following message from MOZ on a few of our websites now Our crawler was not able to access the robots.txt file on your site. This often occurs because of a server error from the robots.txt. Although this may have been caused by a temporary outage, we recommend making sure your robots.txt file is accessible and that your network and server are working correctly. Typically errors like this should be investigated and fixed by the site webmaster. I have spoken with our webmaster and they have advised the below: The Robots.txt file is definitely there on all pages and Google is able to crawl for these files. Moz however is having some difficulty with finding the files when there is a particular redirect in place. For example, the page currently redirects from threecounties.co.uk/ to https://www.threecounties.co.uk/ and when this happens, the Moz crawler cannot find the robots.txt on the first URL and this generates the reports you have been receiving. From what I understand, this is a flaw with the Moz software and not something that we could fix form our end. _Going forward, something we could do is remove these rewrite rules to www., but these are useful redirects and removing them would likely have SEO implications. _ Has anyone else had this issue and is there anything we can do to rectify, or should we leave as is?
Moz Pro | | threecounties0 -
Whether or not to remove a link from a website with high spam score on Open Site Explorer
Hello Moz! I just subscribed for your Moz Pro program. Amazing stuff! On open site explorer, I found a number of links to my site from a page called with a very high page authority and high domain authority, but also a high spam score (8 or 9, one with a 10). I say multiple spam scores, because it's strange, there are what appears variations of the same url, and each one is considered a link. For instance, there's an abc.linkstomysite.com and xyz.linktomysite.com, and 123.linktomysite.com... there are about 15 of these (all with the spam scores mentioned above)! This must have been some old SEO work done I payed for back in the prehistoric SEO days. However, my fear is the following: Removing these links, and then losing some potentially strong link juice. I don't have many high DA or PA links to my site, and these are some major ones. The domain in question "linktomysite.com", when entered into OSE, only has a spam score of 4, and it has a domain authority of 45 and page authority of 37. My site has a spam score of 2 and no messages from google regarding a penalty, but an overall reduction in google traffic over the years (just keeps slowly dropping... as if a weight is pulling me down?) What do you think, should I leave, or remove? The linkstomysite page is just a LONG page full of links, with short descriptions, nothing of value, but with a an old domain age (relatively). Most important for me is keeping at least some ranking/visibility, while I personally work on building quality links and helpful content. thanks!
Moz Pro | | DavidC.0 -
I have a new website and would like to use the keywords my competitors are using and was wondering the best way to take a look using Moz Pro?
The website is www.fapwrap.com - it's a new adult wall decals website. [editor's note: may not be safe for some workplaces] The wall decals we have are obviously a bit more niche than the bigger competitors, but I want to get into the first page to see how it helps us. I'm slowly taking over some kws like "xbox wraps" and "ps4 wraps" but those have low search volume and I feel like "wall decals" will help - though it's highly competitive. Suggestions? I just kinda want to plug in my competition and pick from their list of existing kws..... Ha.
Moz Pro | | JohnnyRoq0 -
Two PR 5 websites, but little to no link data in OSE. How??
As the title states - We've recently developed two sites for clients - within the last 4 months or so. With the Google PR update, both sites are sitting as PR 5 sites. I've tried to have a look in the OSE for the backlink profile of both websites, but I see nothing. Even Majestic SEO's fresh index doesn't provide much info. The DA of each site is 11-16. I would really love to see what's generating the link juice to these sites. Any ideas? The two sites are: https://bfore.co.za
Moz Pro | | Mark.RedGiant
http://ictjournalafrica.net0 -
How to download an entire Website (HTML only), ready to rehost
Hi all, I work for a large retail brand and we have lots of counterfeit sites ranking for our products. Our legal team seizes the websites from the owners who then setup more counterfeit sites and so forth. As soon as we seize control of a website, the site content is deleted and subsequently it falls out of the SERPs to be immediately replaced by the next lot of counterfeit sites. I need to be able to download a copy of the site before it is seized, so that once I have control of it I can put the content back and hopefully quickly regain the SERPs (with an additional 'counterfeit site' notice superimposed on that page in JS). Does anyone know or can recommend good software to be able to download an entire website, so that it can be easily rehosted? Thanks FashionLux (Edited title to reflect only wanting to download html, CSS and images of site. I don't want the sites to actually be functional - only appear the same to Google)
Moz Pro | | FashionLux0