How To Stop Moz Crawl From Prepending /blog/ on all our site urls that it crawls
-
Hello,
At some time in the past our WP site had urls like this:
www.oursite.com/blog/post-title-pretty-link
The site has not used that url structure for quite some time, but Moz crawl is still hitting every post with /blog/prepended and as a result is generating thousands of 404s. When the /blog/ is removed from the url, then the urls work fine.
Where are those old urls being stored and how can we update them?
How do we address this issue?
Any assistance will be appreciated.
Thanks!
-
Hi there!
Sam from Moz's Help Team here!
Could you pop an email about this over to help@moz.com along with the name of the affected campaign? We'll be able to take a look at the specific site then and find out where we're locating those URLS:).
Thank you!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I added a privacy policy link to my footer and now Moz is showing thousands of 4xx errors
My website didn't have a privacy policy so I added one and put the link in the footer menu. When I did this, Moz came back telling me that there are a lot of new errors on the site. Is this a bad thing? Do I need to address it? HY59Iks sYyAHCB
Moz Bar | | elisa175910 -
Does Moz have a way to export full SERPs yet?
I don't like being restricted to tracking only three competitors' rankings so I'm wondering if I could just export the full SERPs like I can on Ahrefs and SEMrush.
Moz Bar | | QLP20040 -
Canonical in Moz crawl report
I'm wondering if the moz bot is seeing my rel="canonical" on my pages. There are 2 notices that are bothering me: Overly Dynamic URL Rel Canonical Overly Dynamic URL - This notice is being generated by urls with query strings. On the main page I have the rel="canonical" tag in the header. So every page with the query string has the canonical tag that points to the page that should be indexed. So my question...Why the notice? Isn't this being handled properly with the canonical tag? I know I can use my robots.txt or the tool in Google search console but is it really necessary when I have the canonical on every page? Here is one of the links that has the "Overly Dynamic URL" notice, as you can see the the canonical in the header points to the page without the query string: https://www.vistex.com/services/training/traditional-classroom/registration-form/?values=true&course-title=DMP101 – Data Maintenance Pricing – Business Processes&date=March 14, 2016 Rel Canonical - Every page in my report has this notice "Using rel=canonical suggests to search engines which URL should be seen as canonical". I'm using the rel="canonical" tag on all of my pages by default. Is the report suggesting that I don't do this? Or is it suggesting that I should? Again...why the notice?
Moz Bar | | Brando160 -
How can I find duplicate pages from a Moz Crawl?
We have many duplicate pages that show up on the Moz Crawl, and we're trying to fix these but it's very difficult because I can't see a way to isolate the code where the duplicate is found. For instance, http://experiencemission.org/immersion/ is one of our main pages, and the crawl shows one duplicate of http://experiencemission.org/immersion. It appears that one of our staff manually edited the source code in one of our pages but forgot the trailing slash. This would be an easy fix but the problem is that this page is linked to internally on our website 2423 times, so it's next to impossible to find the code that is incorrect. We have many other pages with this same basic problem. We know we have duplicates, but it's next to impossible to isolate them. So my question is this: When viewing the Moz Crawl data is there any way to see where a specific duplicate page link is located on our website? Thanks for any and all help!
Moz Bar | | expmission0 -
Cannot Crawl ... 612 : Page banned by error response for robots.txt.
I tried to crawl www.cartronix.com and I get this error: 612 : Page banned by error response for robots.txt. I have a robots.txt file and it does not appear to be blocking anything www.cartronix.com/robots.txt Also, Search Console is showing "allowed" in the robots.txt test... I've crawled many of our other sites that are similarly set up without issue. What could the problem be?
Moz Bar | | 1sixty80 -
How is the Moz keyword limit for each plan determined?
I'm sure it's explained somewhere in here but I haven't found it yet so hoping someone can help: I'm on the Pro Basic plan, which allows me 300 keywords. How is the 300 keywords counted? For example, if I've uploaded 100 keywords in the Keyword Difficulty tool, and am also Rank Tracking an additional 75 keywords for a client, is that 75 kw's, 100 kw's, or 175 kw's? Put another way, if I hypothetically do rank tracking for 300 keywords, does that mean I'm not able to enter additional keywords in the Keyword Difficulty tool without deleting some of the kw's from existing accounts? Thanks for the help!
Moz Bar | | flyntime_tx
Mike0 -
Moz Rank Tracker - showing deleted subdomains results for entered keywords
We have recently deleted subdomains because they were causing duplicate page errors but now the Moz rank tracker is showing the subdomain key word results even instead of the exact url we entered. So for example wine cellar is showing up for a deleted subdomain (winecellar.vigilantinc.com) instead of the entered exact url of (vigilantinc.com/winecellars/) Please advise. Thanks!
Moz Bar | | KristyFord0 -
Duplicate Page Content Report on MOZ
Hi, I am just wondering as to the accuracy of this report - does it pick up all the duplicate on page content? Or is there a limit? We have an ecommerce store with a lot of copied and pasted descriptions - just wondering if there is a limit on how much the moz crawler picks up? In other words, once we fix what MOZ has detected, will there be more detected because it is limited to display say up to 200?? Hope you understand what I mean. Thanks
Moz Bar | | bjs20100