Unsolved Crawled 404's
-
Hello, I've receiving these very weird 404's that seem to be crawled by Moz. I contacted rankmath first but they told me to turn to you. So how are the url's crawled? Because these seemed to be 'glued' together. They start with myurl.nl/PAGE/NUMBER/myurl.nl again. These are two existing pages that are now stuck together and are causing 404's. Please help
-
@loes2911 said in Crawled 404's:
Hello, I've receiving these very weird 404's that seem to be crawled by Moz. I contacted rankmath first but they told me to turn to you. So how are the url's crawled? Because these seemed to be 'glued' together. They start with myurl.nl/PAGE/NUMBER/myurl.nl again. These are two existing pages that are now stuck together and are causing 404's. Please help
These “glued” 404 URLs likely result from malformed internal links or redirects. Moz's crawler may be picking up on these if a plugin or incorrect URL structure is causing two URLs to combine into one. Start by inspecting any internal links and redirects on your site, especially near the affected areas, as a misconfiguration could be causing this issue. If you’re using any plugins that dynamically generate URLs, check their settings to ensure they aren’t inadvertently creating these concatenated URLs. This should help prevent future 404s.
-
https://goofyahhpictures.us/goofy-ahh-haircuts/ > This is my website and one of the page showing crawled 404 erors in images, anyone can help?
-
Hi everyone,
I received 243 "404 Not Found" errors on my patent services website. Are these harmful to my site? If so, how can I resolve this issue?
Image URL: 404 error image -
@LE200 I've tried everything except for adjusting the robot.txt. Could you please help me with how to adjust the robot.txt?
-
my site is showing 404 error now tell me what should i do how can i ressolve them here is my website:https://topfollowerpro.com
-
@LE200 Hi, thank you so much for you response! I've tried everything except for updating my robot.txt. How should I adjust it to block those urls?
-
This post is deleted! -
Our web design company, also uses Moz, and also Screaming Frog to find broken links, causing 404 page errors.
-
Are the 404s appearing also in your companies GSC account? have your web designers deleted many pages recently?
-
@loes2911
The 404 errors you're seeing likely result from malformed URLs being crawled by Moz, where two URLs are combined incorrectly. Here’s how to address it:Check Your Links: Review your site's internal links and sitemap for any improper URL structures.
Canonical Tags: Ensure each page has a proper canonical tag to prevent merging.
Redirects: Look into your redirect settings to confirm there are no misconfigurations.
Crawl Settings: Update your robots.txt file to manage how crawlers like Moz access your site.
I was facing the same issue on my site vnapp and solved it by following these steps.
If the issue persists, reach out to Moz for additional support.
-
@loes2911
The 404 errors you're encountering may be due to malformed URLs being crawled by Moz. These URLs seem to merge two existing pages, leading to invalid links.Here are a few quick steps
Check Sitemap and Links: Review your sitemap and internal links for any errors.
Canonical Tags: Ensure canonical URLs are correctly set on each page to prevent confusion.
Redirects: Investigate any misconfigured redirects in your .htaccess or server settings.
Robots.txt: Adjust your robots.txt to block invalid URLs.
If the issue continues, contact Moz for further guidance.For mobile video editing, you can try VN Video Editor here.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Crawling error emails
Recently we start having random error messages about crawling issue:
Product Support | | DTashjian
2024-08-30 edweek:Ok
2024-08-29 marketbrief:Err. advertise: Err, edweek:Err, topschooljobs:Ok
2024-08-23 edweek:Ok
2024-08-22 marketbrief:Err. advertise: Err, edweek:Err
2024-08-21 topschooljobs:Ok, edweek:Ok
2024-08-15 marketbrief:Ok. advertise:OK
2024-08-13 edweek:Ok
2024-08-12 marketbrief:Ok
2024-08-08 marketbrief:Ok, advertise:Ok
2024-08-03 edweek:Ok, topschooljobs:Ok
All for 2024-07 - are Ok Yesterday I set 2 more crawls for the same sites (edweek and marketbrief) and I get a morning email about original edweek site is ok (still have some problem but crawl occurs and all is fine) but for test crawl for the same site "EW Test" I just got error email.
Also I suppressed ALL email communications and frankly surprised by this email. Can you please check what is wrong with a crawler or stat collection or I don't know who produced the issues.0 -
Unsolved Crawling only the Home of my website
Hello,
Product Support | | Azurius
I don't understand why MOZ crawl only the homepage of our webiste https://www.modelos-de-curriculum.com We add the website correctly, and we asked for crawling all the pages. But the tool find only the homepage. Why? We are testing the tool before to suscribe. But we need to be sure that the tool is working for our website. If you can please help us.0 -
Unsolved Moz crawler not crawling on my site
Hi all, im facing an issue where moz crawler is unable to crawl my site. The following error keeps showing Our crawler was banned by a page on your site, either through your robots.txt, the X-Robots-Tag HTTP header, or the meta robots tag. This is my robots.txt file : https://www.wearefutureheads.com/robots.txt I'm not sure what else am I missing.. can anyone help
Product Support | | teikh0 -
Unsolved Strange "?offset" URL found with content crawl issues
I recently recieved a slew of content crawl issues via Moz for URL's that I have never seen before For example:
Moz Pro | | HannahPalamara
Standard URL: https://skilldirector.com/news,
Newly identified URL: https://skilldirector.com/news?offset=1469542207800&category=Competency+Management). Does anyone know where the URL comes from and how to fix it?0 -
How get rid of 403 crawl error?
My wordpress website has 162 crawl 403 errors. Based on what I read it means that the server is denying crawlers to access the pages. The pages itself will load so guessing it's just an issue with crawlers only. How do I go about fixing this issue?
On-Page Optimization | | emrekeserr30 -
Unsolved Moz can't crawl my site
Moz is being blocked from crawling the following site - https://www.cleanchain.com. When looking at Robot.txt, the following is disallowing access but don't know whether this is preventing Moz from crawling too? User-agent: *
Moz Pro | | danhart2020
Disallow: /adeci/
Disallow: /core/
Disallow: /connectors/
Disallow: /assets/components/ Could something else be preventing the crawl?0 -
Unsolved /%25s
Hi Community, has anyone else had a 404 error reported by Moz, where the end of the domain is /%25s? The error comes from my blog home page https://kaydee.net/blog/ But when I look at the source code, I can't see anything that has a space at the end of the URL. I wonder if it is to do with the WordPress search? Thanks in advance for any insight.
Moz Pro | | kaydeeweb0 -
Identify Page Not Found Visits
Hello everyone! I have always known enough about Google Analytics and SEO to be dangerous, but was not a focus for me. I am working on a project were I am looking at stuff where my knowledge is limited. The scenario is that the domain I am looking at will serve a 404 error, but keeps the url, I guess for tracking purposes. At the same time, there is a page "Page_Not_Found" that has elevated visits. I am not sure how to tell where the visits are coming from to the PNF since the Previous Page is mostly identified as "(entrance)" Is the PNF correlated to the process of serving an error page but not changing the URL? Ideally, I am looking to identify and improve the 404 visits. I hope that I provided clear enough information. Happy to provide more as needed.
Intermediate & Advanced SEO | | HankHoffmeier0