Web page is showing up on Google but doesn't show when it was cached, so is it indexed?
-
I was working on the structure and content on the new site and I set the robots.txt to disallow.
When i finished i set the robots.txt file to allow again but its been a week but someone the changes are not been index in google and when i check the cached it say 404 error in google,
i think the robots.txt file it ok but not sure why my old pages got indexed and why its taking a long time for the new pages to get index.
On webmaster in my sitemap it show 26 submited and 1 index, and on block url it shows that it has downloaded the robots.txt file 12 hours ago.
i cant figure out if there is some issues with the site , Can anyone have a look at it please.
-
Thanks very much Kane for your answer
-
The robots.txt that I would use for a Wordpress site would be this:
User-Agent: * Disallow: /wp-content/plugins/
There is a setting in Wordpress to keep the site private (nofollowed and noindexed to be specific), but it is off for your site, so that's not a problem.
If it's a new site, it's gonna take some link building and credibility before Google gives you much crawl bandwidth. You have 26 pages, and from a quick check of the sitemap, Google has most of them indexed. So, I don't understand what you think is problematic? To me, there are no crawling issues here.
I personally would fix any 404s that show up in Google Websmaster Tools and then refocus on creating content and building links, and you'll be fine.
-
they are all pages no new pages are been index also its a new domain new site all the other links dont have any juice and the reason i had block bots to crawl cause i dint want them to index while i was working on the content but strangly it did.
GWT is not showing any error but the 404 i was referring is of google see link
Is my robots.txt file correct?
is there a setting in wp that might causing my pages to not indexed.
-
I show 73 pages indexed when I search for site:willowstairlifts.co.uk.
Your sitemap.xml only shows 26 pages, as you mentioned GWT is showing.
You need to add a redirect plug-in, such as Redirection, and 301 redirect old URLs like this one (http://www.willowstairlifts.co.uk/new-type/straight-stairlifts/) to the new version of that page on the site. Is Google Webmaster Tools reporting a bunch of new crawl errors (404s)? That's the list of URLs you need to redirect and/or recreate.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Was there some sort of Google SE update on Jun6, 2014
Hi, Around June 6th, 2014 my google traffic took a sudden hit for my landing pages main keyword., my page jumped from pos 8 page 1 to page 20+, thanks,
Industry Events | | robdob120 -
Who knows when the next Google Page rank update will happen?
Google updates Toolbar Page rank every 3 or so months, but it didn't happen from last 6 months. Following are the Page rank updates Google made. 4 February 2013 7 November 2012 2 August 2012 2 May 2012 7 February 2012 7 November 2011 1st Week August 2011 JULY 2011 JUNE 2011 JANUARY 2011 April 2010 Dec 31, 2009 30 October 2009
Industry Events | | goldfish12340 -
How many updates google do ?
I'd like to know something about google updates, google do updates for backlinks assume every 3 days, and updates for PR every 3 month, and some of penguin over panda, but what about keywords , and the daily updates, I like to know about that plz.
Industry Events | | engmtamous0 -
Need help replicating Richard Baxter's Keyword research
A few years ago(maybe it was last year?), Richard Baxter gave a live demo of some fancy keyword research techniques at MozCon. I've been using those methods for a while,but can't figure out how to pull all the keywords from a list that match keywords in a table. I know it's either a VLookup or an Array formula. Does anyone here remember that presentation? Able to help out? Thanks in advance, Chris
Industry Events | | chris.kent0 -
Lost Ranking For My Primary Page
I've been consistently ranked about 8 on Google for my home page, home-theater-design-concepts.com for the keyword "home theater design". The last few days, I'm not ranked at all. I had made some minor adjustments based on the Moz in page report. Which has consistently rated the page as an "A". Any suggestion about what I should do, should I wait a few more days to see what happens?
Industry Events | | Ledrim0 -
Google Weather
I am trying to find out when Google introduced their new weather content when searching for a location based search e.g. London Weather - Google seem to take up all above the fold coverage - anyone help? Thanks Simon
Industry Events | | simonsw0 -
I'm trying to track down Jessica Bowman's Keyword Research ROI Excel template from this year's MozCon. Does it exist?
This presentation was awesome - and I've just encountered a pitch that would be ideal for this type of analysis. In looking through my notes from MozCon I don't see a download link - nor can I find one in the presentation. It was the 11:30 - 12:00pm timeslot on day 3 of MozCon: http://www.seomoz.org/mozcon-live/agenda Can someone point me in the right direction? Cheers, J
Industry Events | | JonClark151