Web page is showing up on Google but doesn't show when it was cached, so is it indexed?
-
I was working on the structure and content on the new site and I set the robots.txt to disallow.
When i finished i set the robots.txt file to allow again but its been a week but someone the changes are not been index in google and when i check the cached it say 404 error in google,
i think the robots.txt file it ok but not sure why my old pages got indexed and why its taking a long time for the new pages to get index.
On webmaster in my sitemap it show 26 submited and 1 index, and on block url it shows that it has downloaded the robots.txt file 12 hours ago.
i cant figure out if there is some issues with the site , Can anyone have a look at it please.
-
Thanks very much Kane for your answer
-
The robots.txt that I would use for a Wordpress site would be this:
User-Agent: * Disallow: /wp-content/plugins/
There is a setting in Wordpress to keep the site private (nofollowed and noindexed to be specific), but it is off for your site, so that's not a problem.
If it's a new site, it's gonna take some link building and credibility before Google gives you much crawl bandwidth. You have 26 pages, and from a quick check of the sitemap, Google has most of them indexed. So, I don't understand what you think is problematic? To me, there are no crawling issues here.
I personally would fix any 404s that show up in Google Websmaster Tools and then refocus on creating content and building links, and you'll be fine.
-
they are all pages no new pages are been index also its a new domain new site all the other links dont have any juice and the reason i had block bots to crawl cause i dint want them to index while i was working on the content but strangly it did.
GWT is not showing any error but the 404 i was referring is of google see link
Is my robots.txt file correct?
is there a setting in wp that might causing my pages to not indexed.
-
I show 73 pages indexed when I search for site:willowstairlifts.co.uk.
Your sitemap.xml only shows 26 pages, as you mentioned GWT is showing.
You need to add a redirect plug-in, such as Redirection, and 301 redirect old URLs like this one (http://www.willowstairlifts.co.uk/new-type/straight-stairlifts/) to the new version of that page on the site. Is Google Webmaster Tools reporting a bunch of new crawl errors (404s)? That's the list of URLs you need to redirect and/or recreate.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is It Possible To Use Multiple Promotional Codes for Google AdWords?
I am managing two separate Google AdWords accounts and with one I was able to add 3 different promotional codes so I got $300 of Google AdWords for free. I signed up for Google AdWords for another business with a separate login e-mail address. I used the code that I was able to generate and a few days later I recieved an additional code in the mail. I tried to use this code and it said I was only able to use one promotional code per account. Does anyone know why Google has this inconsistency? Was I just lucky the first time or is it possible to use multiple vouchers? Thanks
Industry Events | | DR700950 -
Was there some sort of Google SE update on Jun6, 2014
Hi, Around June 6th, 2014 my google traffic took a sudden hit for my landing pages main keyword., my page jumped from pos 8 page 1 to page 20+, thanks,
Industry Events | | robdob120 -
Google Webmaster Tools Search Traffic->Manual Actions shows "No Manual WebSpam Actions Found" but is it right?
Hi, a couple of years ( 2012 )upon contacting google I was notified that I had a manual penalty against my site for unnatural links, Today I just checked the WMT->Search Traffic-->Manual Actions and it says "No Manual WebSpam Actions Found", is this right and I no longer have a penality or is this misinformation? thanks,
Industry Events | | robdob120 -
Thoughts of google not updating PR toolbar
What are your thoughts of google not updating the PR toolbar? So many people rely on it to evaluate websites. As time goes on with no update, good sites that could have good PR will be looked at as bad sites to link on or outreach to. With google continuing not to make an official announcement, people will continue to rely on this method of checking how much a website is worth to them. Just to make this clear, I know a lot of people don't use PR to evaluate a site but I also know a lot of writers who don't follow SEO as much will use PR to check if your site is good or not. I just feel it would be nicer to have it officially announced that they are removing it or keeping it. Also read here about it: http://www.seroundtable.com/google-pagerank-no-update-17276.html Apparently google had no comment at the moment.
Industry Events | | ToddFosterSEO0 -
Lost Ranking For My Primary Page
I've been consistently ranked about 8 on Google for my home page, home-theater-design-concepts.com for the keyword "home theater design". The last few days, I'm not ranked at all. I had made some minor adjustments based on the Moz in page report. Which has consistently rated the page as an "A". Any suggestion about what I should do, should I wait a few more days to see what happens?
Industry Events | | Ledrim0 -
RSS feed to Google App Field Trip'- how to maximise SEO?
Hi guys, quick question- I have a bar review website and google field trip app asked us to be partners. I guess this can only be positive but how can I make sure i optimise SEO from this partnership? I have to submit info via rss feed. Any suggestions on this?thanks
Industry Events | | HolyPenguin0 -
Google Weather
I am trying to find out when Google introduced their new weather content when searching for a location based search e.g. London Weather - Google seem to take up all above the fold coverage - anyone help? Thanks Simon
Industry Events | | simonsw0 -
I'm trying to track down Jessica Bowman's Keyword Research ROI Excel template from this year's MozCon. Does it exist?
This presentation was awesome - and I've just encountered a pitch that would be ideal for this type of analysis. In looking through my notes from MozCon I don't see a download link - nor can I find one in the presentation. It was the 11:30 - 12:00pm timeslot on day 3 of MozCon: http://www.seomoz.org/mozcon-live/agenda Can someone point me in the right direction? Cheers, J
Industry Events | | JonClark151