Pages crawled
-
Hi
I've created a campaign for my own website and added 3 competitor sites. Under the campaign it says that 53 pages have been crawled but my site has less than 10 pages. Are the other pages from my competitor sites?
Thanks
James
-
Hi James,
Did you see the number of pages crawled reduced? Do you have any questions on this issue still?
-
I believe so, it should...
-
I'm going to make the change to my pages. Do you think I will see the number of pages crawled reduce?
Thanks
James
-
Hi James,
www and non-www are already 2 paths, www.example.com/ and www.example.com are another two. You can play with the idea
Also, you can focus more the link juice.
For ex. let's have Fritzy and Googgly, two visitors who would like to link you product page.
Fritzy will link to www.example.com/product/ -> with anchor text "product" (cool, eh'? We wish all of our links would look like this)
Then comes Googgly and links to the same product with the URL http://example.com/product/
Now you will have duplicate content linked separately and you wasted the link juice.
Just add a canonical to example.com/product/ which point the link juice to www.example.com/product/ -> you will transfer aprox 85% of link juice gained on example.com/product/ + it will not be duplicate content.
- another good part of canonicals is that you don't have two pages competing for the same keyword with same content.
I hope I didn't mass up here something
Another thing that you could do is just to 301 non-www to www or vice versa.
Gr., Istvan
-
Hi Istvan
Thanks for the information and the link to the blog article which I have read. I've got no problem adding the canonical link but I don't see why it should improve the situation becuase all my pages are linked using the same parameters. From what I understand from the blog article is that this fixes an issue when the search engines keep coming back to the same page but thinks it is a different page becuase the URL it uses to reach the page is different. Am I understanding this correctly?
Thanks
James
-
Hi James,
So I have just took a quick look at the code. You don't use the canonicals at all.
Maybe you should check the following article by Rand Fishkin http://www.seomoz.org/blog/canonical-url-tag-the-most-important-advancement-in-seo-practices-since-sitemaps
It will help you eliminate dup. content from the site. After you implement the to the site you should have less pages indexed.
Feel free to ask if something was not clear enough.
Cheers,
Istvan
-
-
Hi James,
Are you sure you don't have any duplicate content issue?
For ex.usage of canonicals can save you from having your pages as duplicate content.
example.com and www.example.com are the same, but in the "eyes" of Search Engines, bots, spiders, etc they are different pages with duplicate content.
Maybe you should provide a link to your site, and I will check on it later.
I hope this helps,
Istvan
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Analytic - Avg load Time - Page Timing Sometimes Graph goes suddenly up why?
Hello All, I have attached the avg load time screenshot for my ecommerce site for 1 month. Screenshot is for Mobile site. If you check the graph then only one day graph gone very high. Now again I have attached that particular day graph too. My query is why graph gone high 1) Is it my site not performed well on particular one day on particular device for single visitor? because for desktop and tablet graph showing normal 2) so here if site restart or down then it can be a problem for desktop, tablet too right? Can anyone give me any clue? Z4hX1 IanuP
Reporting & Analytics | | pragnesh96390 -
Webmaster Tools Pages and Queries
In Google Webmaster Tools, under Search Analytics, what is the difference between positions in queries and positions in pages?
Reporting & Analytics | | CostumeD0 -
Google Web Master Tools show that my site has been crawled, but search results show old title tags, ect.
Does the index report reflect what will be displayed on Google results? Google seems to be indexing my site every Sunday...
Reporting & Analytics | | 928shopper0 -
Webmaster Tools Indexed pages vs. Sitemap?
Looking at Google Webmaster Tools and I'm noticing a few things, most sites I look at the number of indexed pages in the sitemaps report is usually less than 100% (i.e. something like 122 indexed out of 134 submitted or something) and the number of indexed pages in the indexed status report is usually higher. So for example, one site says over 1000 pages indexed in the indexed status report but the sitemap says something like 122 indexed. My question: Is the sitemap report always a subset of the URLs submitted in the sitemap? Will the number of pages indexed there always be lower than or equal to the URLs referenced in the sitemap? Also, if there is a big disparity between the sitemap submitted URLs and the indexed URLs (like 10x) is that concerning to anyone else?
Reporting & Analytics | | IrvCo_Interactive1 -
Landing page URL appearing as keyword
Hi Mozers, I've recently experienced the URLs of my key landing pages coming up as keywords. This has been on the rise since early July (when it was relatively insignificant) to the current position (see image below) where they make up the majority of my top keywords. Drilling down into a bit more detail, this seems to be almost exclusively Desktop traffic but in terms of Technology there are no clear standouts (seems to be mostly Windows OS and Chrome). Has anyone else been experiencing this?
Reporting & Analytics | | mopland0 -
Get a list of robots.txt blocked URL and tell Google to crawl and index it.
Some of my key pages got blocked by robots.txt file and I have made required changes in robots.txt file but how can I get the blocked URL's list. My webmaster page Health>blocked URL's shows only number not the blocked URL's.My first question is from where can I fetch these blocked URL's and how can I get them back in searches, One other interesting point I see is that blocked pages are still showing up in searches.Title is appearing fine but Description shows blocked by robots.txt file. I need urgent recommendation as I do not want to see drop in my traffic any more.
Reporting & Analytics | | csfarnsworth0 -
Google Analytics Organic search queries aren't being updated, even though I'm still seeing results in all our typical results pages.
We pushed some new changes to the site and Google Analytics is no longer updating the Organic Search queries listing, even though traffic is consistent and and we're still landing results in all our typical keyword searches. Any ideas?
Reporting & Analytics | | unclekaos0 -
Subdomain and relative link paths cause crawl errors
I have a Wordpress blog on our subdomain and we use relative paths on our domain. It appears as though Google bot is crawling from the subdomain categories back to the domain relative paths. This of course results in hundreds of 404 pages. Any suggestions as to how to resolve this issue without changing the relative path structure of our domain? I can provide more information if need be. While I realize these issues are not that pressing, I'd obviously like to remove as many errors as possible. If anyone has encountered this problem, especially in Wordpress I'd really like to hear your solution or lack there of. Thank you in advance.
Reporting & Analytics | | BethA0