Web page is showing up on Google but doesn't show when it was cached, so is it indexed?
-
I was working on the structure and content on the new site and I set the robots.txt to disallow.
When i finished i set the robots.txt file to allow again but its been a week but someone the changes are not been index in google and when i check the cached it say 404 error in google,
i think the robots.txt file it ok but not sure why my old pages got indexed and why its taking a long time for the new pages to get index.
On webmaster in my sitemap it show 26 submited and 1 index, and on block url it shows that it has downloaded the robots.txt file 12 hours ago.
i cant figure out if there is some issues with the site , Can anyone have a look at it please.
-
Thanks very much Kane for your answer
-
The robots.txt that I would use for a Wordpress site would be this:
User-Agent: * Disallow: /wp-content/plugins/
There is a setting in Wordpress to keep the site private (nofollowed and noindexed to be specific), but it is off for your site, so that's not a problem.
If it's a new site, it's gonna take some link building and credibility before Google gives you much crawl bandwidth. You have 26 pages, and from a quick check of the sitemap, Google has most of them indexed. So, I don't understand what you think is problematic? To me, there are no crawling issues here.
I personally would fix any 404s that show up in Google Websmaster Tools and then refocus on creating content and building links, and you'll be fine.
-
they are all pages no new pages are been index also its a new domain new site all the other links dont have any juice and the reason i had block bots to crawl cause i dint want them to index while i was working on the content but strangly it did.
GWT is not showing any error but the 404 i was referring is of google see link
Is my robots.txt file correct?
is there a setting in wp that might causing my pages to not indexed.
-
I show 73 pages indexed when I search for site:willowstairlifts.co.uk.
Your sitemap.xml only shows 26 pages, as you mentioned GWT is showing.
You need to add a redirect plug-in, such as Redirection, and 301 redirect old URLs like this one (http://www.willowstairlifts.co.uk/new-type/straight-stairlifts/) to the new version of that page on the site. Is Google Webmaster Tools reporting a bunch of new crawl errors (404s)? That's the list of URLs you need to redirect and/or recreate.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is It Possible To Use Multiple Promotional Codes for Google AdWords?
I am managing two separate Google AdWords accounts and with one I was able to add 3 different promotional codes so I got $300 of Google AdWords for free. I signed up for Google AdWords for another business with a separate login e-mail address. I used the code that I was able to generate and a few days later I recieved an additional code in the mail. I tried to use this code and it said I was only able to use one promotional code per account. Does anyone know why Google has this inconsistency? Was I just lucky the first time or is it possible to use multiple vouchers? Thanks
Industry Events | | DR700950 -
Was there some sort of Google SE update on Jun6, 2014
Hi, Around June 6th, 2014 my google traffic took a sudden hit for my landing pages main keyword., my page jumped from pos 8 page 1 to page 20+, thanks,
Industry Events | | robdob120 -
Google Webmaster Tools Search Traffic->Manual Actions shows "No Manual WebSpam Actions Found" but is it right?
Hi, a couple of years ( 2012 )upon contacting google I was notified that I had a manual penalty against my site for unnatural links, Today I just checked the WMT->Search Traffic-->Manual Actions and it says "No Manual WebSpam Actions Found", is this right and I no longer have a penality or is this misinformation? thanks,
Industry Events | | robdob120 -
Who knows when the next Google Page rank update will happen?
Google updates Toolbar Page rank every 3 or so months, but it didn't happen from last 6 months. Following are the Page rank updates Google made. 4 February 2013 7 November 2012 2 August 2012 2 May 2012 7 February 2012 7 November 2011 1st Week August 2011 JULY 2011 JUNE 2011 JANUARY 2011 April 2010 Dec 31, 2009 30 October 2009
Industry Events | | goldfish12340 -
How many updates google do ?
I'd like to know something about google updates, google do updates for backlinks assume every 3 days, and updates for PR every 3 month, and some of penguin over panda, but what about keywords , and the daily updates, I like to know about that plz.
Industry Events | | engmtamous0 -
RSS feed to Google App Field Trip'- how to maximise SEO?
Hi guys, quick question- I have a bar review website and google field trip app asked us to be partners. I guess this can only be positive but how can I make sure i optimise SEO from this partnership? I have to submit info via rss feed. Any suggestions on this?thanks
Industry Events | | HolyPenguin0 -
Google Weather
I am trying to find out when Google introduced their new weather content when searching for a location based search e.g. London Weather - Google seem to take up all above the fold coverage - anyone help? Thanks Simon
Industry Events | | simonsw0 -
Is it good to use co-citation links in guest posts after the latest Google upfdates?
Is it good to use co-citation links in guest posts after the latest Google upfdates?
Industry Events | | SBRMarketing0