Remove false urls
-
Hi,
we are using expressionengine as our CMS. Every url that gets tracked, which does not lead to a real page, gets directed to the home page. This gives us a lot of duplicate content. For every wrong link, we get +1 in duplicate content.
Is there a way to list the false urls, so Moz does not use them anymore in the statistics, or that Google does not crawl them anymore?
Where would be the best place to do this?
All help appreciated,
Michel -
Hi,
thank you for taking the time to respond. The issues with broken paths are fixed, but those pages seem to be still alive in Google/Moz. I guess adjusting the robots file will be the best option here.
Thanks,
Michel -
It's been a few years since I was good at EE, but this problem plagued me as well.
There's no easy workaround to my knowledge, but erhaps the most direct way is to exclude those URLs via your robots.txt file, and then use Google's URL removal tool to wipe them from the index.
Adding them to your robots.txt file should take care of your duplicate content problems in Moz, and the removing them from Google's index should help with the rest.
Another option is to redirect these through your .htaccess file via 301. I won't get into the technicalities here, but it's another route to consider.
-
Hi Michel,
I guess my first suggestion would be to fix the issue at the source - so you no longer have the broken linking in the first place.
If that is not an option and you can access the broken pages in EE, you could use the rel="canonical" to specify the preferred version of the duplicate page or use "noindex" on those pages to tell Moz and Google to not crawl those pages anymore.
If you cannot access the broken pages, you could set up 301 redirects so that the homepage content isn't being duplicated on other URLs... but that the broken links just permanently redirect to the homepage URL.
Does that make sense?
Mike
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
A lot of duplicate content issues - does Moz understand canonical URL?
Hi, Since I subscribed to Moz my Magento store has given a lot of duplicate content issues. However, I did have a problem with Canonical URL at the time. It has been settled for a couple of weeks by now and although I had 302 redirects before, I configured Magento to 301 today. Since Moz has been crawling and showing duplicate content for exactly the same Magento pages but with endings like store=us, store=aus etc (since I have several store views enabled), I am wondering whether canonical URL does actually help Google to skip these versions of the duplicate pages and does Moz also understand it and will it reduce the amount of duplicate content errors once the 301 redirects and canonical URLs have been properly set for a week or so? Thanks!
Getting Started | | speedbird12290 -
Fixing Non-Valid URL - Oops! This does not appear to be a valid URL. Please try again.
Edit - Turns out I can't delete a question. I ended up finding out I'm supposed to email the Moz team at help@moz.com. I did a search regarding the issue, but I only found answers for people using AWS. The results say the .htaccess isn't setup correctly, but I don't know how to fix that file. Any help would be greatly appreciated. Thanks.
Getting Started | | MattHarris0 -
Https not sticking on competitor URL
One of our competitors uses Https:// on thier search results and when we add and save it, it removes the s - we know their site ranks on specific keywords, we know this from manually searching before we got moz but moz is not showing them because it is looking for http:// not https:// How can i fix this. Also - when we first set it up, we did not add the www. and our analytics are setup as such so we show no traffic on our dashboard, but it wont let me edit to change it. Thanks
Getting Started | | HansSchlamadinger
Tom1 -
How do I edit my website URL in a Campaign?
The option to change the URL is grayed out. Is there a way to do this or do I have to create a whole new campaign?
Getting Started | | mathamatix0 -
This does not appear to be a valid URL.
Hi Guys, Just tried to Create a Campaign in the form of: www.example.tv and I get the following message: Oops.. This does not appear to be a valid URL. any idea what's next !? [Edited to remove NSFW URL]
Getting Started | | mvag0 -
In Open site explorer the page title and Url show in the left hand column. Why do some of my pages have no data for page title?
I am a first time user. Newly updated site using Drupal and having lots of SEO problems. Under site explorer, several pages list NO DATA for the page title. This doesn't seem right. Any suggestions on what this means?
Getting Started | | IV-Debbie0 -
Oops! This doesn't appear to be a valid URL. Please try again.
Hi everyone! Looking for a bit of help here. This message keeps popping up when I try to put in my url (www.qltyctrl.com). I've tried qltyctrl.com, www.qltyctrl.com, and http://www.qltyctrl.com and nothing works. Can someone help me out here?
Getting Started | | Nimble.Keith0 -
Oops! This doesn't appear to be a valid URL. Please try again.
Hi, I just started with using MOZ and at my first attemp I can not start a new campaign because my url doesn't appear to be valid.. I tried http://www.mydomain.nl , www.mydomain.nl and mydomain.nl.. It's a Dutch extension (.nl). Can this be the problem? Excuse me my spelling and typo's. I'm Dutch 🙂
Getting Started | | SWP0