Site Crawl report show strange duplicate pages
-
Beginning in early in Feb, we got a big bump in duplicate pages. The URLs of the pages are very odd:
Example URL:
http://firstname.lastname@website.com/dir/page.php
is duplicate with http://website.com/dir/page.phpI checked though the site, nginx conf files, and referral pages, and could not find what is prefixing the pages with 'http://firstname.lastname@'.
Any ideas? The person whose name is 'Firstname Lastname' is stumped as well.
Thanks.
-
I will send details to help@moz.com
Thank you.
-
-
Could you share an actual url? Can you see in the crawl which pages are linking to these strange url's? You could try to replicate the crawl locally (with Screaming Frog) to see if the problem is replicated
Did you check your url rewriting? Maybe you're trying to clean your url structure & the parameter is translated the wrong way?
Dirk
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why is the Moz tool bar page analysis saying my website is from Romania when we are in the United States?
So when I go to my client's website, https://www.paracore.com/ and on the home page, I use the Moz toolbar. From there I then use the "Page Analysis." If you look at the "URL" line there is a Romanian flag next to the site name. Then I scroll down within the page analysis and the "Country" line says Romania. This is a WordPress site, and the company is based in Arizona. Can anyone explain to me if this is code that I can find and change or remove? Any insight would be greatly appreciated.
Moz Bar | | Striventa1 -
Page Authority drop to Zero with new Moz crawl
My Site having page authority about 15 to 17 and i added many new pages in end of November. Everything is fine in December Moz Crawl update (Page Authority - Domain Authority) but in recent update my DA id drop 3 points and all my pages authority vanished drop to 1. Can anyone help me out to understand whats going on there!!!
Moz Bar | | signsny0 -
Should I be concerned our FWE Mentions report shows tons of non-relevant results?
Our brand name also happens to be a common German word and when I ran FWE for the first time this week, I was surprised to see hundreds of returns for the German word rather than our brand name. Does this affect our SEO in anyway and if so, what can we do to mitigate this? Appreciate any insights! Thanks in advance.
Moz Bar | | karrabarron0 -
What is Considered Duplicate Content by Crawlers?
I am asking this because I have a couple of site audit tools that I use to crawl a site I work on every week and they are showing duplicate content issues (which I know there is a lot on this site) but some of what is flagged as duplicate content makes no sense. For example, the following URL's were grouped together as duplicate content: | https://www.firefold.com/contact-us | https://www.firefold.com/gabe | https://www.firefold.com/sale | | | How are these pages duplicate content? I am confused on what site audit tools are considering duplicate content. Just FYI, this is data from Moz crawl diagnostics but SEMrush site auditor is giving me the same type of data. Any help would be greatly appreciated. Ryan
Moz Bar | | RyanRhodes0 -
MOZ On Page Grader Not Seeing Changes
Hello all, I've been doing some SEO work recently and using the really handy A-F rating on MOZ on page grader as a guide. It's worked great so far on my sites up until today. I've made some small changes to a site such as the title and MOZ isn't seeing these changes. For example if I were to put 'banana' in the title of one of my other sites and re-run the on page grader with 'banana' as a keyword, instantly MOZ would say this keyword is used in the title once. I've done the same to another site and the same thing hasn't happened. I did a test and wrote all the keywords from the title in the on page grader and it still said they appear 0 times in the title. Am I missing something here? The site is different from the others, it's flat html and not CMS, but the SEO changes I've made are still the same. Thanks!
Moz Bar | | HB170 -
Crawl Report Internal Links Count
We recently ran a crawl report on www.phase1tech.com. Some of the pages are coming back with a large amount of 'internal links'. These 2 pages for example are showing 800 internal links: http://www.phase1tech.com/Upcoming-Events
Moz Bar | | AISEO
http://www.phase1tech.com/Contact At best there are approximately 70 links on the page. Where is the 800 number coming from?0 -
On-Page grader
Hi Have you changed criteria for onpage grader recently since i see a page a havn't touched/changed has dropped from an A to B ? Cheers Dan
Moz Bar | | Dan-Lawrence0