Web page is showing up on Google but doesn't show when it was cached, so is it indexed?
-
I was working on the structure and content on the new site and I set the robots.txt to disallow.
When i finished i set the robots.txt file to allow again but its been a week but someone the changes are not been index in google and when i check the cached it say 404 error in google,
i think the robots.txt file it ok but not sure why my old pages got indexed and why its taking a long time for the new pages to get index.
On webmaster in my sitemap it show 26 submited and 1 index, and on block url it shows that it has downloaded the robots.txt file 12 hours ago.
i cant figure out if there is some issues with the site , Can anyone have a look at it please.
-
Thanks very much Kane for your answer
-
The robots.txt that I would use for a Wordpress site would be this:
User-Agent: * Disallow: /wp-content/plugins/
There is a setting in Wordpress to keep the site private (nofollowed and noindexed to be specific), but it is off for your site, so that's not a problem.
If it's a new site, it's gonna take some link building and credibility before Google gives you much crawl bandwidth. You have 26 pages, and from a quick check of the sitemap, Google has most of them indexed. So, I don't understand what you think is problematic? To me, there are no crawling issues here.
I personally would fix any 404s that show up in Google Websmaster Tools and then refocus on creating content and building links, and you'll be fine.
-
they are all pages no new pages are been index also its a new domain new site all the other links dont have any juice and the reason i had block bots to crawl cause i dint want them to index while i was working on the content but strangly it did.
GWT is not showing any error but the 404 i was referring is of google see link
Is my robots.txt file correct?
is there a setting in wp that might causing my pages to not indexed.
-
I show 73 pages indexed when I search for site:willowstairlifts.co.uk.
Your sitemap.xml only shows 26 pages, as you mentioned GWT is showing.
You need to add a redirect plug-in, such as Redirection, and 301 redirect old URLs like this one (http://www.willowstairlifts.co.uk/new-type/straight-stairlifts/) to the new version of that page on the site. Is Google Webmaster Tools reporting a bunch of new crawl errors (404s)? That's the list of URLs you need to redirect and/or recreate.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is It Possible To Use Multiple Promotional Codes for Google AdWords?
I am managing two separate Google AdWords accounts and with one I was able to add 3 different promotional codes so I got $300 of Google AdWords for free. I signed up for Google AdWords for another business with a separate login e-mail address. I used the code that I was able to generate and a few days later I recieved an additional code in the mail. I tried to use this code and it said I was only able to use one promotional code per account. Does anyone know why Google has this inconsistency? Was I just lucky the first time or is it possible to use multiple vouchers? Thanks
Industry Events | | DR700950 -
Google Webmaster Tools Search Traffic->Manual Actions shows "No Manual WebSpam Actions Found" but is it right?
Hi, a couple of years ( 2012 )upon contacting google I was notified that I had a manual penalty against my site for unnatural links, Today I just checked the WMT->Search Traffic-->Manual Actions and it says "No Manual WebSpam Actions Found", is this right and I no longer have a penality or is this misinformation? thanks,
Industry Events | | robdob120 -
Google keywords in Webmaster Tools
While analyzing the Google Webmaster, we found several keywords that are ranked in the top 10 search results with words such as: they, was, mai, and chiang. .. After reviewing the pages shown under the keyword "they", we did not find that keyword or its variant "them" repeated in the content of the page even once. I am not sure why "they" is ranking so high and of course, the word "they' is not effective for finding significant content. Also the words Chiang Mai are never used separately but yet the two words are ranking far apart from each other? Mai is ranked at 5 and chiang is ranked at 11? Impossible it would seem? I would think that the rankings would be very close together since the two words are usually used in conjunction with one another. Can anyone please help explain what may be happening please?
Industry Events | | jimmyzig0 -
Who knows when the next Google Page rank update will happen?
Google updates Toolbar Page rank every 3 or so months, but it didn't happen from last 6 months. Following are the Page rank updates Google made. 4 February 2013 7 November 2012 2 August 2012 2 May 2012 7 February 2012 7 November 2011 1st Week August 2011 JULY 2011 JUNE 2011 JANUARY 2011 April 2010 Dec 31, 2009 30 October 2009
Industry Events | | goldfish12340 -
How many updates google do ?
I'd like to know something about google updates, google do updates for backlinks assume every 3 days, and updates for PR every 3 month, and some of penguin over panda, but what about keywords , and the daily updates, I like to know about that plz.
Industry Events | | engmtamous0 -
Lost Ranking For My Primary Page
I've been consistently ranked about 8 on Google for my home page, home-theater-design-concepts.com for the keyword "home theater design". The last few days, I'm not ranked at all. I had made some minor adjustments based on the Moz in page report. Which has consistently rated the page as an "A". Any suggestion about what I should do, should I wait a few more days to see what happens?
Industry Events | | Ledrim0 -
RSS feed to Google App Field Trip'- how to maximise SEO?
Hi guys, quick question- I have a bar review website and google field trip app asked us to be partners. I guess this can only be positive but how can I make sure i optimise SEO from this partnership? I have to submit info via rss feed. Any suggestions on this?thanks
Industry Events | | HolyPenguin0