Pages crawled
-
I noticed there is a limited in the number of pages crawled on galena.org? Will this number increase over time?
-
How many pages are on your site? I'm seeing over 500 indexed on Google. Trying to get a feel for how many pages aren't indexed.
Do you use a sitemap file at all? If you have one in place, and submit it via Google Webmaster Tools, it will show you how many pages are in your sitemap and how many of those pages Google has indexed.
A secondary note though that some of those pages are Ajax File Manager pages, which you probably want to exclude from being crawled via robots.txt.
-
It is advisable to check through Google webmaster tools for any crawl errors. If there is any, try to fix ASAP.
Don't have high hope on other site audit tools.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Where to position a new page?
Hi there 🙂
On-Page Optimization | | Enrico_Cassinelli
Our website is about a particular region in Italy, the Langhe area, famous for food and wine (barolo and barbaresco are produced here). We need to rollout a few new pages about cellar/winery tours: one main page with the list of tours, and the various subpages for each tour. We already have a page about travel, and a page about wine (with a sub-page about wineries). The URLs looks like:
langhe.net/travel/
langhe.net/wine/wineries/
(Note: i'm translating from italian here) Now, I'm wondering where is better to position the new pages:
langhe.net/travel/winery-tours/name-of-tour/ or
langhe.net/wine/wineries/tours/name-of-tour/ From an SEO perspective (within my limited experience) the first option has a shorter URL, but the second feels more "natural" to me. What do you think? Thanks 🙂
Best0 -
Why are my pages de-indexed?
<form id="form-t3_37nfib9dz" class="usertext" action="http://www.reddit.com/r/SEO/comments/37nfib/why_were_my_pages_deindexed/#"> Hello all, I am very new to SEO. For some reason many of the pages on my site were de-indexed. Specifically the ones linked from this page: However other pages, like the ones linked from this page and this page were not de-indexed. http://www.lawyerconnection.ca/practice-areas/car-accident-injury-lawyers/[1] However the pages linked from this page were not de-indexed: http://www.lawyerconnection.ca/practice-areas/slip-and-fall-lawyers/[2] http://www.lawyerconnection.ca/podcastresources/[3] That first page itself was not de-indexed, just the site that it links to. It just happened today, so maybe I am jumping the gun but I doubt it. When I enter the page into google webmaster tools again and press fetch, one of the child pages, it re-indexes. What could be the problem here? I had someone re-write the content for every city but I have a feeling that there is less differences in the car accidents pages? Is this considered duplicated content do you think? Am I making some other mistake I can't think of? Is it just a one day blip (I doubt it) Let me know, thanks. </form>
On-Page Optimization | | RafeTLouis0 -
Is a resource page bad for SEO
This is the page http://www.christoit.com/free-resources/articles. While this page isn't what I would consider to be a "resource page" (there are no downloads or any other resources) The question is, does a page like this that just has links to articles, hurt the overall ranking of the site. If you have any examples to support your opinion that would be great! Thanks so much for all awesome threads and answers on this site. There are some really smart people all in one place!
On-Page Optimization | | Britewave0 -
Duplicate Page Content on Empty Manufacturer Pages
I work for an internet retailer that specializes in pet supplies and medications. I was going through the Crawl Diagnostics for our website, and I saw in the Duplicate Page Content section that some of our manufacturer pages were getting flagged. The way our site is set up is that when products are discontinued we mark them as discontinued and use 301 redirects to redirect their URLs to other relevant products, brands, or our homepage. We do the same thing with brand and manufacturer pages if all of their products are discontinued. 90% of the time, this is a manual process. However, the other 10% of the time certain products come and go automatically as part of our inventory system with one of our fulfillment partners. This can sometimes create empty manufacturer pages. I can't redirect these empty pages because there's a chance that products will be brought back in stock and the page will be populated again. What can we do so that these pages won't get marked as duplicates while they're empty? Write unique short descriptions about the companies? Would the placement of these short descriptions matter--top of the page under the category name vs bottom of the page underneath where the products would go? The links in the left sidebar, top, and in the footer our part of our site architecture, so those are always going to be the same. To contrast, here's what a manufacturer page with products looks like: Thanks! http://www.vetdepot.com/littermaid-manufacturer.html
On-Page Optimization | | ElDude0 -
We have 5 postions on page 2 in a google search, but none on page 1\. How can we fix this?
For one of our most important key phrases we have 5 listings on page 2 but none on page 1. We are an ecommerce company, the key phrase we're trying for is a Top Level Category name for us, so the 5 links we have on googles second page for the key phrase (in order) are the appropriate top level category page, the sites home page and than three sub categories of that top level category. So while that all makes sense, can't we convince google to concentrate all that link power/juice into just the top level category page? Hopefully bumping it to first page rank? The 5 ranks are 11-15
On-Page Optimization | | absoauto0 -
Multiple silos/products/landing pages. How to design the root page for conversion?
Hi everyone, First post. Tried a few awkward searches on the topic but I must be using bad keywords. I'm re-designing a site that has multiple products and matching multiple audiences. This means we have multiple sillos for multiple groups of keywords with the supporting pages for each silo landing page. Currently I'm working on updating the look and text of those landing pages for each silo to increase conversion. This leaves me with the root web page. We get quite a lot of search traffic from people searching our brand name - so this results in clicks straight through to our root domain. There are no product specific landing pages because it could be any one of the 3-5 different personas we have hitting the site from that source. Does anyone have any good examples of where a site has had multiple products and needed to segregate their audience on a root top page? I'd like to see some examples and hear peoples thoughts. At the moment I'm thinking I need to fill that page up with trust factors as to why people should use us as a company, along with navigational elements in relation to each and every product so they can click through to the proper landing page. The main way I can see on executing that is to have a rotating banner with the same tag line "this is what we do" but be alternating between banners relating to each product.. with their own click through button to go to the respective landing page. Thoughts anyone? Example of sites doing this well?
On-Page Optimization | | specific0 -
Testing page load speed
Anyone have a recommendation for a simple way to measure page load speed?
On-Page Optimization | | dschreib_greenpeace.org0 -
Authority of a page
What factors contribute towards the authority of a page ? No. of links to a page ?
On-Page Optimization | | seoug_20050