What can i do to get google to visit my site more often
-
Hi, i am having serious problems since i upgraded my website from joomla 1.5 to 3.0
We have dropped down the rankings from page one for the word lifestyle magazine, and we have dropped down in rankings for other very important words including gastric band hypnotherapy and i am starting to regret having the site upgraded.
i am finding the google is taking its time visiting my site, i know this for two reasons, one i have checked the cache and it is showing the 2nd july and i have checked articles that we have written and they are still not showing.
example if i put this article name in word for word it does not come up,
Carnival Divert Ships In The Caribbean Due To bad Weather
this was an article that was done yesterday. in the old days before the upgrade that would have been in google now.
these problems are costing us the loss of a great deal of traffic, we are losing around 70% of our traffic since the upgrade and would be grateful if people could give me advice on how to turn things around.
we add articles all the time. each day we add a number of articles, i was considering changing the front page in the middle and having a few paragraphs of the latest story to get google to visit more often. i know this would look messy but i am running out of ideas.
any help would be great
-
hi, i have just got a reply from my hosting company
To use the If-Modified-Since HTTP header, you need to have both mod_expires and mod_headers enabled as Apache modules on your server. I have just checked that for you and I can confirm that both of the modules are enabled and you will be able to use If-Modified-Since HTTP headers.
Gyi, how would i know use these if the hosting company does offer the service
-
our home was number one in google for a long time and then dropped to around number four, since the upgrade we are on page nine, same as the term gastric band hypnotherapy, showbiz gossip and so on.
not sure if we should be doing more to optimize the main pages so google understand what the pages are about.
i do know our traffic has dropped by 70% since the upgrade and we need the get the traffic back. the site was updated around two months ago.
before the update, if we had a story on our site which we had just put on then within hours it would be in google but now it is taking days to show up which is causing us problems
-
thank for this.
I have a site map in my webmaster tools and i update my content each day, we add lots of content but concerned that the home page only has links and a small intro and wondering if i should show the first two paragraphs of a new story on the home page to get google to crawl the home page more often.
i am working on the site speed at the moment, not sure if you think about our site speed at present. before we had the site updated we finally got it to load in about 1,1 sec and under but not managed that at the moment.
can you explain what this means please as i have never come across it
Make sure your web server supports the If-Modified-Since HTTP header.
you said about making sure all pages are reachable from a link, we have around two thousand pages so not sure this is possible
many thanks for the great help.
-
Tim,
Did this drop happen after your website update or was the update in response to a drop in your rankings?
From your other comments, I think it's only been a month so since you transitioned to your new site so you can still chalk this all up to that transition.
Due to the redesign, those previously ranking pages may now be buried deeper within your architecture, you may link to them differently, or your redesign may have overlapped with an algorithm update reduced your visibility. Have you verified that you were not penalized?
If things don't change, you could take a look back at which pages were ranking for the keywords you specified and 2. verify that either you're using the same URL or that the old URL is 301'd to the new one (you should have done that already); 3. look at your old site (maybe using the waybackmachine) to review your internal linking to those previously-ranking pages (how many internal links, the anchor text and from what pages) and verify that the new site does the same.
edit: not being crawled often is a symptom of not having enough authority as meets your needs or architecture that leads to sporadic crawling intervals. If those money pages are linked to from the home page, you might rule out the latter.
-
Crawls are based on many factors such as PageRank, links to a page, and crawling constraints such as the number of parameters in a URL. Any number of factors can affect the crawl frequency of individual sites.
So:
- Build links
- Make sure all pages are reachable from a link.
- Make sure your web server supports the If-Modified-Since HTTP header.
- Update your content often and regularly.
- Take steps to increase site speed.
- Eliminate duplicate content.
- Limit 400 errors.
- Add a sitemap.
You could also adjust the crawl rate in Google Webmaster Tools, but you shouldn't have to.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Site redesign makes Moz Site Crawl go haywire
I work for an agency. Recently, one of our clients decided to do a complete site redesign without giving us notice. Shortly after this happened, Moz Site Crawl reported a massive spike of issues, including but not limited to 4xx errors. However, in the weeks that followed, it seemed these 4xx errors would disappear and then a large number of new ones would appear afterward, which makes me think they're phantom errors (and looking at the referring URLs, I suspect as much because I can't find the offending URLs). Is there any reason why this would happen? Like, something wrong with the sitemap or robots.txt?
Technical SEO | | YYSeanBrady1 -
My site Has Penalized By google Search Result Without Any Spam Score.
I Recently Make a Site Gizmocombot.com. tHE aITE has NO spam Record NO lousy BACKLINK.it has all unique article can anyone tell us how we can unpenalized our site from google webmaster and google search Result. i attcead a screenshot as well yoou need. 3nzmALp
Technical SEO | | litoginamaaba3332 -
Mobile site content and main site content
Help, pls! I have one main site and a mobile version of that site (m.domain.com). The main site has more pages, more content, different named urls. The main site has consistently done well in Google. The mobile site has not: the mobile site is buried. I am working on adding more content to the mobile site, but am concerned about duplicate content. Could someone pls tell me the best way to deal with these two versions of our site? I can't use rel=canonical because the urls do not correspond to the same names on the main site, or can I? Does this mean I need to change the url names, offer different content (abridged), etc? I really am at a loss as to how to interpret Google's rules for this. Could someone please tell me what I am doing wrong? Any help or tips would GREATLY appreciated!!!!! Thanks!
Technical SEO | | lfrazer0 -
Google having trouble accessing my site
Hi google is having problem accessing my site. each day it is bringing up access denied errors and when i have checked what this means i have the following Access denied errors In general, Google discovers content by following links from one page to another. To crawl a page, Googlebot must be able to access it. If you’re seeing unexpected Access Denied errors, it may be for the following reasons: Googlebot couldn’t access a URL on your site because your site requires users to log in to view all or some of your content. (Tip: You can get around this by removing this requirement for user-agent Googlebot.) Your robots.txt file is blocking Google from accessing your whole site or individual URLs or directories. Test that your robots.txt is working as expected. The Test robots.txt tool lets you see exactly how Googlebot will interpret the contents of your robots.txt file. The Google user-agent is Googlebot. (How to verify that a user-agent really is Googlebot.) The Fetch as Google tool helps you understand exactly how your site appears to Googlebot. This can be very useful when troubleshooting problems with your site's content or discoverability in search results. Your server requires users to authenticate using a proxy, or your hosting provider may be blocking Google from accessing your site. Now i have contacted my hosting company who said there is not a problem but said to read the following page http://www.tmdhosting.com/kb/technical-questions/other/robots-txt-file-to-improve-the-way-search-bots-crawl/ i have read it and as far as i can see i have my file set up right which is listed below. they said if i still have problems then i need to contact google. can anyone please give me advice on what to do. the errors are responce code 403 User-agent: *
Technical SEO | | ClaireH-184886
Disallow: /administrator/
Disallow: /cache/
Disallow: /components/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /libraries/
Disallow: /media/
Disallow: /modules/
Disallow: /plugins/
Disallow: /templates/
Disallow: /tmp/
Disallow: /xmlrpc/0 -
Why Can't I Get on Google?
I've employed many of the suggestions of SEOMoz and getting a Grade "A" on a particular keyword. I'm now #4 on Yahoo and Bing. However, my site hasn't cracked the top 50 in Google. Why? I see a similar pattern with other keywords, many on yahoo and bing but only a few of my subpages get #45-48 on Google. Any ideas? http://www.gospelebooks.net
Technical SEO | | mrjgardiner0 -
When is the last time Google crawled my site
How do I tell the last time Google crawled my site. I found out it is not the "Cache" which I had thought it was.
Technical SEO | | digitalops0 -
Google has not been visiting my site
Hi I am working on a site at the moment http://www.cheapflightsgatwick.com and i had the site using a different template and in the search engines for the search term cheap flights gatwick we were fourth and for the term holiday magazine we were 12th in google but now we are not even in google on the first page for the search terms. But now after changing the template in joomla our rankings have gone out of the window. It took me about a day to sort out the site with the new template so i was not expecting any problems with the search engines but for some reason there is. If you put into the search engine www.cheapflightsgatwick.com then you will see that google has not visited the site for four days and also it is not showing the description and instead it is showing details about joomla. Can anyone let me know if there is anything i need to do to sort this out and why google is taking so long to visit my site
Technical SEO | | ClaireH-1848860 -
I have found this on a site that i have seen many times where can i get one from
Hi i have seen this great map system that i have seen on many sites which i think makes a site look great but i have tried looking for the past few weeks but cannot find where i can get one from. http://www.hypnoslimmer.co.uk/consultant.html does anyone know how these sites do it and where you can get the product from. I use joomla for all my sites Any help would be great
Technical SEO | | ClaireH-1848860