Pages crawled
-
Hi
I've created a campaign for my own website and added 3 competitor sites. Under the campaign it says that 53 pages have been crawled but my site has less than 10 pages. Are the other pages from my competitor sites?
Thanks
James
-
Hi James,
Did you see the number of pages crawled reduced? Do you have any questions on this issue still?
-
I believe so, it should...
-
I'm going to make the change to my pages. Do you think I will see the number of pages crawled reduce?
Thanks
James
-
Hi James,
www and non-www are already 2 paths, www.example.com/ and www.example.com are another two. You can play with the idea
Also, you can focus more the link juice.
For ex. let's have Fritzy and Googgly, two visitors who would like to link you product page.
Fritzy will link to www.example.com/product/ -> with anchor text "product" (cool, eh'? We wish all of our links would look like this)
Then comes Googgly and links to the same product with the URL http://example.com/product/
Now you will have duplicate content linked separately and you wasted the link juice.
Just add a canonical to example.com/product/ which point the link juice to www.example.com/product/ -> you will transfer aprox 85% of link juice gained on example.com/product/ + it will not be duplicate content.
- another good part of canonicals is that you don't have two pages competing for the same keyword with same content.
I hope I didn't mass up here something
Another thing that you could do is just to 301 non-www to www or vice versa.
Gr., Istvan
-
Hi Istvan
Thanks for the information and the link to the blog article which I have read. I've got no problem adding the canonical link but I don't see why it should improve the situation becuase all my pages are linked using the same parameters. From what I understand from the blog article is that this fixes an issue when the search engines keep coming back to the same page but thinks it is a different page becuase the URL it uses to reach the page is different. Am I understanding this correctly?
Thanks
James
-
Hi James,
So I have just took a quick look at the code. You don't use the canonicals at all.
Maybe you should check the following article by Rand Fishkin http://www.seomoz.org/blog/canonical-url-tag-the-most-important-advancement-in-seo-practices-since-sitemaps
It will help you eliminate dup. content from the site. After you implement the to the site you should have less pages indexed.
Feel free to ask if something was not clear enough.
Cheers,
Istvan
-
-
Hi James,
Are you sure you don't have any duplicate content issue?
For ex.usage of canonicals can save you from having your pages as duplicate content.
example.com and www.example.com are the same, but in the "eyes" of Search Engines, bots, spiders, etc they are different pages with duplicate content.
Maybe you should provide a link to your site, and I will check on it later.
I hope this helps,
Istvan
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
High Temporary Redirects: Login required pages
Noticed something interesting, a high temporary redirect report from Moz. Reviewing the pages they are caused by the user having to login and getting redirected. I can see the returnto query in the URL too. My thoughts: Since a login is required and the user is being redirected, these should remain 302 and not 301. I tested my Google Analytics account to **Exclude URL Query Parameter **returnto, just to see if it affected traffic. It didn't, I mean I don't see urls duplicated with the parameter anymore, just grouped together, so traffic is still being counted. I'm going to wait 1 more day and see what impact the GA traffic is before applying the exclusion to my true Google Analytics profile. This got me thinking, I should probably exclude this parameter from Google and Bing Webmaster Tools, that way Google/bing won't read those urls. Now does Moz's crawler follow that? Do you think that would change my moz crawl diagnostic report because I told Google/Bing crawlers to exclude that parameter. What do you think of my approach to reduce these high temporary redirects reported by Moz? Will it work? Has it plagued you?
Reporting & Analytics | | Bio-RadAbs0 -
How can I easily combine moz page difficulty, google search volume and SERPS position?
I want to produce an excel spreadsheet that I can use to identify the best use of my content Writing time. So Looking at a keyword list I want Current SERPS to show me where I am now? moz page difficulty score to show how hard I'll have to work google traffic estimate so that I can see the potential payoff. I can can generate all these separately but combining them is a huge time waster as invariably the results don't come back in quiet the same order and a line by line check is required. Part of the reason for doing this is keyword exploration so that we can find new niches by generating hundreds or thousands of keywords to test.
Reporting & Analytics | | Zippy-Bungle0 -
Duplicate page content
I'm seeing duplicate page content for tagged URLs. For example:
Reporting & Analytics | | DolbySEO
http://www.dolby.com/us/en/about-us/careers/landing.html
http://www.dolby.com/us/en/about-us/careers/landing.html?onlnk=al-sc as well as PPC campaigns. We tag certain landing pages purposefully in order to understand that traffic comes from these pages, since we use Google Analytics and don't have the abiility to see clickpaths in the package we have. Is there a way to set parameters for crawling to exclude certain pages or tagged content, such as those set up for PPC campaigns?0 -
Figuring Out the Source of "direct traffic" by looking at landing page parameters
I have a client who runs an e-commerce website, and I noticed that 40% of his traffic and 25% of his sales are all attributable to Direct Traffic. At first, I tried to solve this problem by tagging all of the previously untagged links in his e-newsletter, which I expect to be very helpful. However, then I looked at the landing pages for his direct traffic, and I see that it is almost entirely filled with thousands of unique URLs that begin with a question mark followed by the name of his e-newsletter or shopping cart vendor. It would be the equivalent of having a url like the following: "www.willmarlow.com/?constantcontact=keya;sldkfjsdlfkjdf;sldkjf" If we have this amount of information in the link, shouldn't there be a way to add additional parameters to the URL to move this traffic out of the Direct column? Has anyone encountered this before? Thanks.
Reporting & Analytics | | williammarlow0 -
Moz Rank & Trust | Page vs Sub vs Root
Hey guys, Just need some help deciphering my OSE link metrics for my site theskimonster.com . Page MozRank: 5.51 (highest among my competitors) Page MozTrust: 5.74 (#2 among my competitors) Subdomain MozRank: 4.19 (#4 among my competitors) Subdomain MozTrust: 4.63 (#2 among my competitors) Root Domain MozRank: 3.89 (#5 or last place among competitors) Root Domain MozRank: 4.1 (#5 or last place among competitors) What does this mean? What am I doing right, what do I need to do?
Reporting & Analytics | | Theskimonster1 -
Run Crawl Diagnostics
hi i have fix some error refering the error list how to re-run crawl diagnostics immediate again to check the error ? thanks
Reporting & Analytics | | AlfredLim0 -
Magic UVs - PPC landing pages delivering organic traffic by magic...
I have checked and double checked this. GA is showing over the last couple of weeks mysite.com/ppc/landingpage1 as a landing page for organic traffic, where it shouldn't. Main facts: The entire /ppc/ folder is blocked from the googlebot, and doesn't appear on any internal site maps. As far as I can tell, these pages have never been cached for the main index. I cannot recreate any of the organic searches myself (i.e. typing in keywords that triggered the traffic, even the almost unique long-tail ones). We just don't appear in the organic listings with these pages. The analytics and adwords accounts are linked. We are not paying for this mystery traffic through our PPC - these keywords are not appearing in our AdWords account (though other keywords / traffic are). The traffic is real - we have received phone calls from these pages, tracked to the visits recorded as organic These pages should only receive PPC traffic. They are receiving organic traffic also, but I can't recreate it. Can anyone suggest what's going on? I'm concerned about duplicate content issues and also skewing the analysis of the PPC campaign. Thanks
Reporting & Analytics | | RobPell0 -
Never Crawled!
This page has not been crawled for five months: http://www.flowerpetal.com/index.jsp?info=13 1/2 that time it was linked to from the homepage of a pr5 site: http://flowerpetal.com/ Why is this the case?
Reporting & Analytics | | tylerfraser0