Remove false urls
-
Hi,
we are using expressionengine as our CMS. Every url that gets tracked, which does not lead to a real page, gets directed to the home page. This gives us a lot of duplicate content. For every wrong link, we get +1 in duplicate content.
Is there a way to list the false urls, so Moz does not use them anymore in the statistics, or that Google does not crawl them anymore?
Where would be the best place to do this?
All help appreciated,
Michel -
Hi,
thank you for taking the time to respond. The issues with broken paths are fixed, but those pages seem to be still alive in Google/Moz. I guess adjusting the robots file will be the best option here.
Thanks,
Michel -
It's been a few years since I was good at EE, but this problem plagued me as well.
There's no easy workaround to my knowledge, but erhaps the most direct way is to exclude those URLs via your robots.txt file, and then use Google's URL removal tool to wipe them from the index.
Adding them to your robots.txt file should take care of your duplicate content problems in Moz, and the removing them from Google's index should help with the rest.
Another option is to redirect these through your .htaccess file via 301. I won't get into the technicalities here, but it's another route to consider.
-
Hi Michel,
I guess my first suggestion would be to fix the issue at the source - so you no longer have the broken linking in the first place.
If that is not an option and you can access the broken pages in EE, you could use the rel="canonical" to specify the preferred version of the duplicate page or use "noindex" on those pages to tell Moz and Google to not crawl those pages anymore.
If you cannot access the broken pages, you could set up 301 redirects so that the homepage content isn't being duplicated on other URLs... but that the broken links just permanently redirect to the homepage URL.
Does that make sense?
Mike
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
URL Length
I have a simple question. How many characters can a URL be before Moz flags it as too long?
Getting Started | | BuyMachineryNow1 -
Moz not recognising url to setup a new account
I am attempting to setup a new account for my client but Moz is having a problem and not registering the url http://www.esc.uk.net/. I get the "oops" message & read the info on the FAQ page it refers to. Why do I keep getting an "Oops" message when I type and submit my campaign URL? To create a campaign, we need to receive a valid HTTP response from the web server hosting your site. While the site may be accessible from a standard web browser, other user-agents and search engine bots may receive a different response. If you receive this error, we recommend running a test by sending an HTTP response using any online HTTP tool. Using an online HTTP tool I believe I received an HTTP response. What else can I do? Regards Terry
Getting Started | | Buzzin0 -
Fixing Non-Valid URL - Oops! This does not appear to be a valid URL. Please try again.
Edit - Turns out I can't delete a question. I ended up finding out I'm supposed to email the Moz team at help@moz.com. I did a search regarding the issue, but I only found answers for people using AWS. The results say the .htaccess isn't setup correctly, but I don't know how to fix that file. Any help would be greatly appreciated. Thanks.
Getting Started | | MattHarris0 -
MOZ Removes WWW
I just signed up for Moz... Created my campaign. I'm noticing Moz is removing the www* from my domain. When they do analysis its wrong. when i go to google and type site:www.domain.com i have 350,000 + pages. MOZ is telling me i have 1,277 pages because its getting the external links by using *domain.com and not www.domain.com how do i force MOZ to read my domain as www.domain.com and not *.domain.com
Getting Started | | CarlosJaa0 -
How do I interpret Duplicate Content in a Crawl Report, when it only gives me a URL? How do I know what is duplicated on that page somewhere else?
I need help interpreting the Crawl Report for Duplicate Content. It gives me the URLs of pages that have duplicate content, but how do I know what content exactly is duplicated elsewhere? And how do I figure out where it is duplicated? Also, are there Moz Analytics articles or videos teaching you how to use each component of the analytics programs? Thanks!
Getting Started | | NancyBryan0 -
Duplicate Pages...where are both URLs?
Just ran my Site Crawl Report...which was awesome! But It says there are over 50 Duplicate Content Pages, and the list of links only shows the PAGE that is supposedly "duplicate content"...but where is the other URL that these pages are duplicates of? Would be nice to be able to double-check if it is in fact duplicate and decide which to edit. Pls help! Thanks Moz!
Getting Started | | DerekM42420 -
Oops! This doesn't appear to be a valid URL. Please try again.
Hi everyone! Looking for a bit of help here. This message keeps popping up when I try to put in my url (www.qltyctrl.com). I've tried qltyctrl.com, www.qltyctrl.com, and http://www.qltyctrl.com and nothing works. Can someone help me out here?
Getting Started | | Nimble.Keith0 -
How to remove campaign from Moz.com
I've accidentally created a duplicate campaign, which I am unable to delete, please help
Getting Started | | shopperlocal_DM0