Pages crawled
-
Hi
I've created a campaign for my own website and added 3 competitor sites. Under the campaign it says that 53 pages have been crawled but my site has less than 10 pages. Are the other pages from my competitor sites?
Thanks
James
-
Hi James,
Did you see the number of pages crawled reduced? Do you have any questions on this issue still?
-
I believe so, it should...
-
I'm going to make the change to my pages. Do you think I will see the number of pages crawled reduce?
Thanks
James
-
Hi James,
www and non-www are already 2 paths, www.example.com/ and www.example.com are another two. You can play with the idea
Also, you can focus more the link juice.
For ex. let's have Fritzy and Googgly, two visitors who would like to link you product page.
Fritzy will link to www.example.com/product/ -> with anchor text "product" (cool, eh'? We wish all of our links would look like this)
Then comes Googgly and links to the same product with the URL http://example.com/product/
Now you will have duplicate content linked separately and you wasted the link juice.
Just add a canonical to example.com/product/ which point the link juice to www.example.com/product/ -> you will transfer aprox 85% of link juice gained on example.com/product/ + it will not be duplicate content.
- another good part of canonicals is that you don't have two pages competing for the same keyword with same content.
I hope I didn't mass up here something
Another thing that you could do is just to 301 non-www to www or vice versa.
Gr., Istvan
-
Hi Istvan
Thanks for the information and the link to the blog article which I have read. I've got no problem adding the canonical link but I don't see why it should improve the situation becuase all my pages are linked using the same parameters. From what I understand from the blog article is that this fixes an issue when the search engines keep coming back to the same page but thinks it is a different page becuase the URL it uses to reach the page is different. Am I understanding this correctly?
Thanks
James
-
Hi James,
So I have just took a quick look at the code. You don't use the canonicals at all.
Maybe you should check the following article by Rand Fishkin http://www.seomoz.org/blog/canonical-url-tag-the-most-important-advancement-in-seo-practices-since-sitemaps
It will help you eliminate dup. content from the site. After you implement the to the site you should have less pages indexed.
Feel free to ask if something was not clear enough.
Cheers,
Istvan
-
-
Hi James,
Are you sure you don't have any duplicate content issue?
For ex.usage of canonicals can save you from having your pages as duplicate content.
example.com and www.example.com are the same, but in the "eyes" of Search Engines, bots, spiders, etc they are different pages with duplicate content.
Maybe you should provide a link to your site, and I will check on it later.
I hope this helps,
Istvan
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved URL Crawl Reports providing drastic differences: Is there something wrong?
A bit at a loss here. I ran a URL crawl report at the end of January on a website( https://www.welchforbes.com/ ). There were no major critical issues at the time. No updates were made on the website (that I'm aware of), but after running another crawl on March 14, the report was short about 90 pages on the site and suddenly had a ton of 403 errors. I ran a crawl again on March 15 to check if there was perhaps a discrepancy, and the report crawled even fewer pages and had completely different results again. Is there a reason the results are differing from report to report? Is there something about the reports that I'm not understanding or is there a serious issue within the website that needs to be addressed? Jan. 28 results:
Reporting & Analytics | | OliviaKantyka
Screen Shot 2022-03-16 at 3.00.52 PM.png March 14 results:
Screen Shot 2022-03-15 at 10.31.22 AM.png March 15 results:
Screen Shot 2022-03-15 at 4.06.42 PM.png0 -
How do I create a segment that shows me all pages using a certain keyword? But nothing that doesn't have that keyword?
There must be an easy answer to this, but I can't seem to find it. All I want to do is create a segment in Google Analytics that shows all pages and search strings with "orthopaedics" in the title, with pageviews, uniques etc. If I simply navigate to "All Pages" in Google Analytics and then click Advanced Filters and do an Include Page Contains "orthopaedics" it works just fine. (See attached Screen Shot) But when I try to recreate this as a segment, it pulls in all other pages the users visited before arriving on the orthopaedics page I want to include, which I don't want. I can manually exclude each URL I don't want, but this is tedious and I feel there must be a simpler method I'm just missing. At the end of the day, I'm trying to create a list of every page and dynamically created query string that includes the word "orthopaedics" to say doctor X, your orthopaedics section generated X views, and here's a list of the pages. Mm6YTKa
Reporting & Analytics | | Patrick_at_Nebraska_Medicine0 -
How to Diagnose "Crawled - Currently Not Indexed" in Google Search Console
The new Google Search Console gives a ton of information about which pages were excluded and why, but one that I'm struggling with is "crawled - currently not indexed". I have some clients that have fallen into this pit and I've identified one reason why it's occurring on some of them - they have multiple websites covering the same information (local businesses) - but others I'm completely flummoxed. Does anyone have any experience figuring this one out?
Reporting & Analytics | | brettmandoes2 -
Apple.com showing in Google Analytics "My Top Active Pages" - Why?
Hi Mozzers This has more than likely been asked before but my searches have left me empty handed so I have asked on here ( sorry! ) Please see attached screenshot, do you have any idea why apple.com is showing in my top pages? I'm just curious more than anything as this isn't the first time I've noticed it. Anybody know? Happy Friday people, cheers Jamie CiTCA5b.png
Reporting & Analytics | | SanjidaKazi1 -
Sudden Increase In Number of Pages Indexed By Google Webmaster When No New Pages Added
Greetings MOZ Community: On June 14th Google Webmaster tools indicated an increase in the number of indexed pages, going from 676 to 851 pages. New pages had been added to the domain in the previous month. The number of pages blocked by robots increased at that time from 332 (June 1st) to 551 June 22nd), yet the number of indexed pages still increased to 851. The following changes occurred between June 5th and June 15th: -A new redesigned version of the site was launched on June 4th, with some links to social media and blog removed on some pages, but with no new URLs added. The design platform was and is Wordpress. -Google GTM code was added to the site. -An exception was made by our hosting company to ModSecurity on our server (for i-frames) to allow GTM to function. In the last ten days my web traffic has decline about 15%, however the quality of traffic has declined enormously and the number of new inquiries we get is off by around 65%. Click through rates have declined from about 2.55 pages to about 2 pages. Obviously this is not a good situation. My SEO provider, a reputable firm endorsed by MOZ, believes the extra 175 pages indexed by Google, pages that do not offer much content, may be causing the ranking decline. My developer is examining the issue. They think there may be some tie in with the installation of GTM. They are noticing an additional issue, the sites Contact Us form will not work if the GTM script is enabled. They find it curious that both issues occurred around the same time. Our domain is www.nyc-officespace-leader. Does anyone have any idea why these extra pages are appearing and how they can be removed? Anyone have experience with GTM causing issues with this? Thanks everyone!!!
Reporting & Analytics | | Kingalan1
Alan1 -
Can a 100% bounce rate page hurt whole website?
Hello, So with trying to figure out what I can do to better my website, I noticed a post on here that mentioned bounce rates. So I went to my Google analytics pages and listed my bounce rates. My average is 44% But I have a picture page that is 100% and a contact page that is 80% Can pages like this cause an algo penalty that could hurt a whole site? Thank you for your valuable insights
Reporting & Analytics | | Berner0 -
How to get crawled pages indexed?
Hi, I've got over 1k pages crawled but approx 100 pages indexed. Although, i submit them on Google Fetch and the links are indexable,they are not indexed. What shall i do the get max pages indexed? Any input highly appreciated. Thanks!
Reporting & Analytics | | Rubix0 -
OSE shows URLs redirecting to our custom created error page, is this a problem?.
When I check the link metrics for my product pages in OSE, it shows a message saying that the page redirects to our custom error page. This page was recently created to display when there is an error with the website. Do I need to be concerned that OSE is seeing all product pages as redirecting to this error page? Will it affect page authority etc,? I have attached a screen shot of the message that OSE displays for reference. YWbpM.jpg
Reporting & Analytics | | pugh0