I'm doing a crawl analysis for a website and finding all these duplicate URLs with "null" being added to them and have no clue what could be causing this.
-
Does anyone know what could be causing this? Our dev team thinks it's caused by mobile pages they created a while ago but it is adding 1000's of additional URLs to the crawl report and being indexed by Google. They don't see it as a priority but I believe these could be very harmful to our site.
examples from URL string:
uruguay-argentina-chilenullnull/days
rainforests-volcanoes-wildlifenullnull/reviews
of-eastern-europenullnullnullnull/hotels -
Hi there,
This looks to be something to do with a URL generator that is dynamically creating URLs based on certain categories being present.
The downside being that those categories look to have been removed, hence the 'null' values being passed through.
I would push this back to your developers as a serious issue, there could be a large amount of duplication occurring if you're not careful.
All the best,
Sean
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google analytic's API information
I have multiple websites and instead of having to log in to each google analytics I want to create a dashboard inside my MIS that has the audience overview graph, is there any way to use API to do this? Is there a way to
Web Design | | BobAnderson0 -
HTML and XML sitemaps for one website.
Hi all, First, we have created a HTML sitemap for our wordpress website. Then we again generated XML sitemap and submitted same in search console. It's been more than a week and still new XML sitemap has not been indexed yet. I can still only see HTML sitemap for search results "company sitemap". Also search console do have only XML sitemap. Both sitemaps are accessible but only HTML has been indexed. Is there anything wrong having 2 sitemaps? Why XML sitemap not been indexed? Thanks
Web Design | | vtmoz0 -
How does Google look at strings added to a URL
For example: http://localhost:3000/en-US/app/a-knsmtrhqrqs/personal where knsmtrhqrqs is a string Can Google tell this is a string and what's their policy? Will it hurt rankings? Thank you.
Web Design | | RoxBrock0 -
How to provide product information without duplicate content?
Hi all, I have an ecommerce website with approx 400 products, these are quite technical products and i use to have helpful information about the products on the product pages... My SEO company told me to remove all this, as i had lots of duplicate content issues... I have since had content writers re-write all product descriptions (about 250 words per product)... and now i am trying to figure out a way of getting the "helpful" information back on but in some kind of dynamic way... There is basically about 5 or 6 blocks of information, that can be added to each product page, these overlap hundreds of products. i was thinking of perhaps creating a separate static page for each block of useful information, and putting links on the product pages to this... however, ideally i would prefer to not keep sending customers to other pages... so wanted to see if others had come across similar issues themselves and how they went about having this "content" available to the user but in such a way it was not duplicate content... Please note using images would not be any good here, as the content varies in size but most of it is text based... regards James
Web Design | | isntworkdull1 -
Can google crawl text in jquery sliders?
We are redesigning our website and want to present a fair amount of text within jquery sliders. Will google crawl this text or is it treated the same way as actual script? Perhaps there is a way to just have the text as plain html but use jquery to display it?
Web Design | | Netboost0 -
Meta author. Is it relevant for website design company in its seo?
We don't usually add the meta author in the websites that we develop. I wonder if it would have any positive effect in our seo. We usually add a link in the footer like this "Diseño Web Vigo "(Website Development in Vigo). I am worry about this links. I'm not sure if they are positive because they are in the footer and so the link appears in all of the pages. Besides all these websites we develop are hosted in two different servers, and google could easily think that it is manipulative thing. What do you think? Thanks!!! 🙂
Web Design | | teconsite.com0 -
Do iFrames embedded in a page get crawled?
Do iFrames embedded in a page get crawled? I have an iFrame which prints a page hosted by another company embedded in my page. Their links don't include rel=nofollow attributes, so I don't want Google to see them. Do spiders crawl the content in iFrames, or do I have to ensure that the links on this page include the nofollow attribute?
Web Design | | deuce1s0 -
Old SEO keyword "articles", are they hurting rankings?
Hello, About two years ago, the company I work for hired an SEO firm to improve organic rankings on our site. The SEO company's primary method for doing this was producing "articles" that are not really articles but keyword stuffed pages with lots of hidden, internal links to other legitimate pages on our site. Examples: http://www.creamright.com/Isi-Chargers-articles.html http://www.creamright.com/How-To-Make-Whipped-Cream-article.html http://www.creamright.com/Cream-Whipper-articles.html Obviously, this strategy wasn't greatly successful and we cancelled our work with the firm. However, we still have all of the "articles" on the site (about 50-60 pages total) and each page is navigable from the html and XML sitemaps. Additionally, the SEO firm we used built a lot of useless links to these pages from BS directory sites which are all still active. The question I have is whether we should remove these "article" pages or should leave them alone? Although I'm sure they aren't helping any of our SEO efforts, could deleting the pages after two years negatively impact our search rankings? Thanks in advance for any help on this, Doug M.
Web Design | | Loganshark1