Unsolved URL Crawl Reports providing drastic differences: Is there something wrong?
-
A bit at a loss here. I ran a URL crawl report at the end of January on a website( https://www.welchforbes.com/ ). There were no major critical issues at the time. No updates were made on the website (that I'm aware of), but after running another crawl on March 14, the report was short about 90 pages on the site and suddenly had a ton of 403 errors. I ran a crawl again on March 15 to check if there was perhaps a discrepancy, and the report crawled even fewer pages and had completely different results again.
Is there a reason the results are differing from report to report? Is there something about the reports that I'm not understanding or is there a serious issue within the website that needs to be addressed?
Jan. 28 results:
March 14 results:
March 15 results:
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Duplicate Content with TranslatePress Plugin
Hello, I am using a plugin named translatepress, however whenever I activate it the moz crawl gives my site as having duplicate content on it. How do I avoid this? I would like to have a website version in English and Portuguese? Thanks
Getting Started | | SilvinoFernandes0 -
Unsolved URL dynamic structure issue for new global site where I will redirect multiple well-working sites.
Dear all, We are working on a new platform called [https://www.piktalent.com](link url), were basically we aim to redirect many smaller sites we have with quite a lot of SEO traffic related to internships. Our previous sites are some like www.spain-internship.com, www.europe-internship.com and other similars we have (around 9). Our idea is to smoothly redirect a bit by a bit many of the sites to this new platform which is a custom made site in python and node, much more scalable and willing to develop app, etc etc etc...to become a bigger platform. For the new site, we decided to create 3 areas for the main content: piktalent.com/opportunities (all the vacancies) , piktalent.com/internships and piktalent.com/jobs so we can categorize the different types of pages and things we have and under opportunities we have all the vacancies. The problem comes with the site when we generate the diferent static landings and dynamic searches. We have static landing pages generated like www.piktalent.com/internships/madrid but dynamically it also generates www.piktalent.com/opportunities?search=madrid. Also, most of the searches will generate that type of urls, not following the structure of Domain name / type of vacancy/ city / name of the vacancy following the dynamic search structure. I have been thinking 2 potential solutions for this, either applying canonicals, or adding the suffix in webmasters as non index.... but... What do you think is the right approach for this? I am worried about potential duplicate content and conflicts between static content dynamic one. My CTO insists that the dynamic has to be like that but.... I am not 100% sure. Someone can provide input on this? Is there a way to block the dynamic urls generated? Someone with a similar experience? Regards,
Technical SEO | | Jose_jimenez0 -
How to add multiple locations to an existing GBP
Hi, I'm having trouble finding the option to add multiple locations to an existing GBP account. Can somebody help me?
Local Listings | | Trendi
I believe it can be done throught Google &/or MOZ.
Thank you,0 -
Technical URL SEO question
Hi All, We sell a product on our site which is displayed in cubic metres, from an SEO perspective is it ok to have /3m³ in the URL or should I use 3m3. Thanks All
Technical SEO | | Redooo0 -
Unsolved CSV export does not work
Export to csv spam links or other links does not work. Can you help me? And I already posted this question but it seems it was deleted. Without this option I do not see why I should continue moz subscription.
Product Support | | netcomsia
alt text0 -
How get rid of 403 crawl error?
My wordpress website has 162 crawl 403 errors. Based on what I read it means that the server is denying crawlers to access the pages. The pages itself will load so guessing it's just an issue with crawlers only. How do I go about fixing this issue?
On-Page Optimization | | emrekeserr30 -
Google Crawl Stats
Hi all Wondering if anyone could help me out here. I am seeing massive variations in WMT of google crawl stats on a site I run. Just wondering if this is normal (see attached image). The site is an eccommerce site and gets a handful of new products added every couple of weeks. The total no of products is about 220k so this is only a very small %. I notice in WMT I have an amber warning under Server connectivity. About 10 days back I had warnings under DNS, Server and Robots. This was due to bad server performance. I have since moved to a new server and the other two warnings have gone back to green. I expect the Server connectivity one to update any day now. Ive included the graph for this incase it is relevant here. Many thanks for assistance. Carl crawlstats.png connect.png
Reporting & Analytics | | daedriccarl0 -
Google Analytics Custom Reports eMails only one reporting tab
Goog Morning from 18 degrees C mostly cloudy Wetherby UIK 🙂 I'm on a mission to get away from manual reporting and move over to eMailing custom Google analytics reports. Thanks to this tutorail http://searchenginewatch.com/article/2175001/7-Time-Saving-Google-Analytics-Custom-Reports Ive made good progress but ive hit a snag. The snag being when i email the report the recipient only recieves one 1 report tab of data. This causes a problem when you eMail a report that has multiple reporting tabs like this: http://i216.photobucket.com/albums/cc53/zymurgy_bucket/tab-export-custom-problemcopy.jpg So my question is please..."When you eMail a recipient a custom report how can you ensure they receive "All" the reporting tabs data and not just one"? Any insights welcome 🙂
Reporting & Analytics | | Nightwing0