Only 1 Page Being Crawled
-
I have a website I'm tracking www.alhi.com. But my report is saying that only 1 page is being crawled each update. My campaign is set up for the sub domain www.alhi.com, so I'm not sure why I would have this issue. Can you help? Thanks!
-
THANKS SO MUCH! I had my developer add this to our dev site but apparently it was added to both.
-
<META NAME="robots" CONTENT="noindex, nofollow, noarchive, noimageindex"> I would start here -
May be I am not seeing properly but where is your sitemap?
Also, do you add fresh content deeper pages frequently? These intelligent little bots crawl a good deal initially but they tend to 'learn' the frequency of your content updates and update their re-visit schedule accordingly. As busy as these little ones are, you have to feed them something worth devouring and do it so frequently, so their frequent visits to your site is worth their time. If they keep visiting your site and don't find nothing new..they have just spent all their energies for nothing and hence they become lazy for future visits, and this could explain delay to deeper pages. Just my thought... there could be something to else to it too.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Page Optimization Error
Hi, I am trying to track a page optimization feature for one of my project, https://shinaweb.com but i keep getting this below error: "PAGE OPTIMIZATION ERROR
On-Page Optimization | | shinawebnavid
There was a problem loading this page. Please make sure the page is loading properly and that our user-agent, rogerbot, is not blocked from accessing this page." I checked robots.txt file, it all looks fine. Not sure what is the problem? Is it a problem with Moz or the website?0 -
Which Is More Important? Building a web page for customer reviews or a careers page?
Hello, I am wondering which would be more important to have on a website a customer review page or a careers page? And as far an SEO advantage which is more important and why?
On-Page Optimization | | Nicks1230 -
Is it better to keep a glossary or terms on one page or break it up into multiple pages?
We have a very large glossary of over 1000 industry terms on our site with links to reference material, embedded video, etc. Is it better for SEO purposes to keep this on one page or should we break it up into multiple pages, a different page for each letter for example? Thanks.
On-Page Optimization | | KenW0 -
Error is not going away and crawling
I have fixed an error but its still showing in red as error. Im totally new to SeoMoz and to SEO in general so im not sure how this tool works. Did I fix it correctly or not if its still showing? It was a broken link and now it links up to another page. Do I just have to wait? My website only has 8 pages and on the dashboard it says crawled 8 pages but it takes up to a week for a full crawl? Im really confused. Thank you in advanced!
On-Page Optimization | | Pixeltistic0 -
How to avoid duplicate page content
I have over 5.000 duplicate page content because my urls contains ?district=1&sort=&how=ASC¤cy=EUR. How can I fix this?
On-Page Optimization | | bruki0 -
Page Title
My website was hacked last November and then again last week. Prior to the hacking we were at number one in Google.co.uk for our main search term "nile cruises' for years. After last November's hacking we dropped to about position 4 and after last week we are at position 7. Ima rebuilding the lost data and I am having to create new Title and Description meta data for each of the indexed pages. I am taking the opportunity to try and ensure my titles and descriptions are good and the correct length, etc but wondered about the best title format. I set our home page title over the weekend as: Nile Cruise | Leading ABTA & ATOL Bonded UK Nile Cruise Specialist I was going to try and cover 3 keyphrases in the title like this: Nile Cruise | Nile Cruises | Nile Cruise Bargains But I thought that might look a bit spammy because the 3 phrases are very similar. I wondered what anyone else might suggest? Thanks, Colin
On-Page Optimization | | NileCruises0 -
How to fix duplicate page content and page titles?
Apologies in advance if this has already been answered (it probably has) - I'm just not seeing it. Is there a guide on here for how to fix the issues brought up by the crawler - specifically, things like duplicate page content, or duplicate page titles? A lot of these seem to have been created by wordpress.org combos that I didn't anticipate - i.e., category pages, author pages, etc. The crawler brings up the problems, but I don' t know where to start to go about fixing them. Also, any guide on best SEO practices or fixing optimization problems, specifically for wordpress.org blogs, would be greatly appreciated. Thanks!
On-Page Optimization | | prospects1 -
Duplicate pages
Hi, I am using a CMS that generates dynamic urls that according to the SeoMoz tool will be indexed as duplicate pages. The pages in questions are forms, blog-posts etc. that are not crucial to achieve ranking for. I do worry though about the consequences of having 20 (non-duplicate)pages with static urls and about 100 pages that are duplicates with dynamic urls. What consequences will this have for the speed that the robots crawl the site and could there be negative effects on ranking for the entire domain?
On-Page Optimization | | vibelingo0