Schoolboy error!
-
We ( I) blocked google by accident! using a robots text that had been on our test site...
To correct this I:
1 - created and uploaded a new sitemap and submitted
2 - fixed my robots text: http://www.camperbug.co.uk/robots.txt
The problem is, I try to fetch as googlebot in WMT but it says: Denied by robots.txt despite the fact it's fixed!
Does anyone have any ideas as to when google will reindex by robots text as WMT says I have critical health issues and i don't want keyword deindexing. Thanks!
-
Should take a day or so. Everyone who has done enough sites has made a mistakes like this (believe it or not, Google is eventually forgiving on most things). The tough part is waiting...
-
Just give it 24hrs, you should be good by same time tomorrow. As you said, you have already submitted the XML sitemap and also updated the robots.txt and that should be it.
-
You site can be crawl. Like everyone said, just wait for big G.
I did noticed a few 404 errors on your site. I have them on a cvs file. Here's the link
http://dl.dropbox.com/u/58098579/client_error_(4xx)_links.csv
-
Just did it today but the critical error in WMT is scary. Hopefully I don't get de-indexed as a result!
-
Sounds to me like you just need to wait until Google crawls your website again.
-
Has the new index been crawled? It usually takes about a day fr google to update your new sitemap. When did you resubmit your sitemap?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Next scheduled update?
Hello my new website is showing everything at minimum like domain and page rating and backlinks, when will the next update will be?
Algorithm Updates | | raffaelegurrieri0 -
Mobile Usability Issues after Mobile Frist
Hi All A couple months ago we got an email from google, telling us - Mobile-first indexing enabled for https://www.impactsigns.com/ Ran the test on MOZ, Mobile usability shows 100% Last week got an email from google - New Mobile usability issues detected for impactsigns.com Top new issues found, ordered by number of affected pages: Content wider than screen Clickable elements too close together I can not seem to figure out what those issues are, as all content is visible. How important are these 2 issues? Since we are now on the mobile first side?
Algorithm Updates | | samoos0 -
What does it mean to build a 'good' website.
Hi guys. I've heard a lot of SEO professionals, Google, (and Rand in a couple of whiteboard Friday's) say it's really important to build a 'good' website if you want to rank well. What does this mean in more practical terms? (Context... I've found some sites rank much better than they 'should' do based on the competition. However, when I built my own site (well-optimised (on-page) based on thorough keyword research) it was nowhere to be found (not even top 50 after I'd 'matched' the backlink profile of others on page 1). I can only put this down to there being 'good quality website' signals lacking in the latter example. I'm not a web developer so the website was the pretty basic WordPress site.)
Algorithm Updates | | isaac6630 -
Google inaccurate results: Common or error?
Hi all, While searching for our primary keyword, I can see 2 websites on second page results which are non-related to the keyword or industry but their company name is this keyword. Like if I want to rank and searching for "SEO", there are 2 websites which called "seo trucks" and "seo paints". I wonder how Google is ranking these websites for high competition keyword with 1 million searches per month. So the keyword in URL and this keyword mentioned across the website being their brand name taking over the other potential ranking factors like backlinks, relevant content, user clicks, etc..... Thanks
Algorithm Updates | | vtmoz0 -
Why is the AMP tool saying I have invalid structured data when the structured data tool shows no errors?
Why is the AMP tool saying there's missing or invalid structured data on http://www.tasteofhome.com/recipes/flavorful-chicken-fajitas/amp when the structured data tool shows no errors? In addition, I'm not able to see a preview of the rich card in the AMP tool like I can for other recipes like https://allrecipes.com/recipe/19621/eggs-on-the-grill/amp/. If you check https://allrecipes.com/recipe/19621/eggs-on-the-grill/amp in the AMP tool, we get this message: "Page has valid structured data. This page is eligible for extended AMP features." Google has instructions on how to get rich cards for recipes (https://developers.google.com/search/docs/data-types/recipes), but i'm not sure if we're violating anything other than image aspect ratio. Thanks!
Algorithm Updates | | dianedragan0 -
I'm Pulling Hairs! - Duplicate Content Issue on 3 Sites
Hi, I'm an SEO intern trying to solve a duplicate content issue on three wine retailer sites. I have read up on the Moz Blog Posts and other helpful articles that were flooded with information on how to fix duplicate content. However, I have tried using canonical tags for duplicates and redirects for expiring pages on these sites and it hasn't fixed the duplicate content problem. My Moz report indicated that we have 1000s of duplicates content pages. I understand that it's a common problem among other e-commerce sites and the way we create landing pages and apply dynamic search results pages kind of conflicts with our SEO progress. Sometimes we'll create landing pages with the same URLs as an older landing page that expired. Unfortunately, I can't go around this problem since this is how customer marketing and recruitment manage their offers and landing pages. Would it be best to nofollow these expired pages or redirect them? Also I tried to use self-referencing canonical tags and canonical tags that point to the higher authority on search results pages and even though it worked for some pages on the site, it didn't work for a lot of the other search result pages. Is there something that we can do to these search result pages that will let google understand that these search results pages on our site are original pages? There are a lot of factors that I can't change and I'm kind of concerned that the three sites won't rank as well and also drive traffic that won't convert on the site. I understand that Google won't penalize your sites with duplicate content unless it's spammy. So If I can't fix these errors -- since the company I work conducts business where we won't ever run out of duplicate content -- Is it worth going on to other priorities in SEO like Keyword research, On/Off page optimization? Or should we really concentrate on fixing these technical issues before doing anything else? I'm curious to know what you think. Thanks!
Algorithm Updates | | drewstorys0 -
JSON-LD parsing error
I was wondering if anyone had a NON-SCHEMA MARK-UP solution for the following... I ran my Wordpress homepage HTML (after I implemented schema mark-up) in the structured data testing tool and received an error parsing the JSON-LD... it came at the beginning of the code and I know it is from the slider banner plugin... We are trying to see if there as an alternative to implementing schema with in the js... also does anyone know if the actual Google search will simply skip over the code and parse the rest of HTML? Thank you for your help.
Algorithm Updates | | ReunionMarketing0 -
Website traffic dropped 50% after 14th November same day GWT reported a DNS error
HI there. On 14th November GWT reported a DNS error on my site I checked with my hosts but they said there was nothing wrong. I then went searching for answers and found it happened to lot of people on that specific day see http://moz.com/blog/was-there-a-november-14th-google-update. After that time my website traffic dropped by 50% over the period of a week and is still sitting on 50% of what it was. I then moved the site to VPS, had a few DNS errors - that were the cause of my hosts - so i moved back to shared hosting last weekend and now DNS issues are solved. However the original DNS issue is still unknown I dont know what went wrong and want to rectify issue. I dont sell ads and write original content 4 times a day. I have a miniscule bounce rate, my site speed is okay and i dont stuff keywords in my content although i was careless with my <alt tags="">so they could be considered keyword stuffing (and i have up to 10 images on one post). But i have been removing all the keywords in my images theres over 3000 posts so its taking time). My impressions have dropped from 10,000 a day to 2,500 and I have no idea why.</alt> My website has been building traffic consistently for the last 2 years. Only now has it crashed a bit. Have you any advice on what I can do to solve this problem or rather find the cause of the issue. Im not a pro seo person and do this blog in my free time so am not an expert on data analyzing etc.... thanks alot
Algorithm Updates | | mutant20080