Only 1 Page Being Crawled
-
I have a website I'm tracking www.alhi.com. But my report is saying that only 1 page is being crawled each update. My campaign is set up for the sub domain www.alhi.com, so I'm not sure why I would have this issue. Can you help? Thanks!
-
THANKS SO MUCH! I had my developer add this to our dev site but apparently it was added to both.
-
<META NAME="robots" CONTENT="noindex, nofollow, noarchive, noimageindex"> I would start here
-
May be I am not seeing properly but where is your sitemap?
Also, do you add fresh content deeper pages frequently? These intelligent little bots crawl a good deal initially but they tend to 'learn' the frequency of your content updates and update their re-visit schedule accordingly. As busy as these little ones are, you have to feed them something worth devouring and do it so frequently, so their frequent visits to your site is worth their time. If they keep visiting your site and don't find nothing new..they have just spent all their energies for nothing and hence they become lazy for future visits, and this could explain delay to deeper pages. Just my thought... there could be something to else to it too.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
If Product Pages Perform Well In Google then Is It Possible That Category Page Can perform Well In Google?
Hi All, For my ecommerce site I have optimized my product pages very nicely like good images, detailed information about products, good reviews, implemented schema for my product and reviews and very perfect onpage. Now my query is if my products pages performing well in google then there are chances that my category page rank well in google too? Thanks!
On-Page Optimization | | wright3350 -
301, Canonical, and Page Authority
I have been trying to find an answer to this question for awhile now but I am having trouble. I have a clients site that I need to redirect and Canonical the pages to correct duplicate content issues and title tags however, the issue with this client is that some of the www. pages have a higher PA than non-www and the reverse is true. I am wondering if there is an issue with chasing the PA to get the highest PA per page (even if this means the site is going to be a mix of www. and non-www. pages)? I am extremely new to SEO so I apologize ahead of time if I missed this in the forum.
On-Page Optimization | | Highline_Ideas0 -
Pages or Blog posts?
Hi, I am currently building content for a customer's website. There are approximately 50 new content pages I am building about the business, products they serve, how-tos and tips and advice. The website is built on Wordpress so my question is would it be best to post this content as a different blog posts or as separate pages in Wordpress and link them up to a 'hub page' as mentioned on this post about How to rank (point 16) Thanks for any advice.
On-Page Optimization | | btiffin0 -
Which pages on my site should I back link to
The majority of the back links I have been creating link directly to our home page and to the store page. Is this the best approach or should I be trying to spread the links throughout our site to include product categories and subcategories etc?
On-Page Optimization | | Hardley0 -
Too Many On-Page Links
If a page has more than 100 links, rather than splitting up the page into multiple pages, is it ok to use name="robots" content="noindex, follow" />? The page in question lists links to articles so the page itself isn't that important to appear in serps, but the articles are the helpful content pages: www.ides.com/articles/processing/injection-molding/
On-Page Optimization | | Prospector-Plastics0 -
Blog page outranks static page for KW -- why?
Blog page ranks 10 in Google, while the static page is on page 7. What makes it more interesting is that the blog page scores an "F" with the Term Target tool while the static page scores an "A". Static page has more inbound links and a mR/mT of 3.89/ 4.54 vs. 3.71/ 4.14 for the blog page. Any ideas on how to approach this one?
On-Page Optimization | | 540SEO0 -
Page title structure?
From an SEO and user perspective what structure do you recommend for page titles. For example (given that they shouldn't ideally be more than 70 characters) :- Keywords (maybe two or three) | Company Name | more keywords I understood the best place for the company name was about second place. Is this now the considered view taking into consideration 'branding' which has been flagged up as the way forward. Keywords are separated by the vertical bar | - any thoughts? For 'house keeping' pages such as Privacy Policy - should this be optmised or simply stated as 'privacy policy' Thanks
On-Page Optimization | | PH2920 -
Avoiding "Duplicate Page Title" and "Duplicate Page Content" - Best Practices?
We have a website with a searchable database of recipes. You can search the database using an online form with dropdown options for: Course (starter, main, salad, etc)
On-Page Optimization | | smaavie
Cooking Method (fry, bake, boil, steam, etc)
Preparation Time (Under 30 min, 30min to 1 hour, Over 1 hour) Here are some examples of how URLs may look when searching for a recipe: find-a-recipe.php?course=starter
find-a-recipe.php?course=main&preperation-time=30min+to+1+hour
find-a-recipe.php?cooking-method=fry&preperation-time=over+1+hour There is also pagination of search results, so the URL could also have the variable "start", e.g. find-a-recipe.php?course=salad&start=30 There can be any combination of these variables, meaning there are hundreds of possible search results URL variations. This all works well on the site, however it gives multiple "Duplicate Page Title" and "Duplicate Page Content" errors when crawled by SEOmoz. I've seached online and found several possible solutions for this, such as: Setting canonical tag Adding these URL variables to Google Webmasters to tell Google to ignore them Change the Title tag in the head dynamically based on what URL variables are present However I am not sure which of these would be best. As far as I can tell the canonical tag should be used when you have the same page available at two seperate URLs, but this isn't the case here as the search results are always different. Adding these URL variables to Google webmasters won't fix the problem in other search engines, and will presumably continue to get these errors in our SEOmoz crawl reports. Changing the title tag each time can lead to very long title tags, and it doesn't address the problem of duplicate page content. I had hoped there would be a standard solution for problems like this, as I imagine others will have come across this before, but I cannot find the ideal solution. Any help would be much appreciated. Kind Regards5