Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
WP Events Calendar Creates URLs Too Long in Site Crawler
-
My travel/tourism site is on WP and using an Events plugin that ads a calendar of events to many pages. The MOZ crawler is indexing almost 46K links with a URL too long, but the site only has about 3.8K pages indexed in Google. I can tell MOZ is indexing the same pages over and over again but just adding a random calendar month and year. Here are some examples.
- https://www.visitcurrituck.com/four-day-stay/?full=1&long_events=1&country[0]=US&ajaxCalendar=1&mo=10&yr=2003
- https://www.visitcurrituck.com/four-day-stay/?full=1&long_events=1&country%5B0%5D=US&ajaxCalendar=1&mo=10&yr=2034
- https://www.visitcurrituck.com/beach-houses-family-time/?full=1&long_events=1&country%5B0%5D=US&ajaxCalendar=1&mo=1&yr=1873
Any advice on how to prevent MOZ from indexing this way? I don't believe that Google is seeing this also, but maybe they are. I just know my site has over 63K issues and I'm sure at least 75% or more is because of the way they are picking up on the events calendar.
Thanks!
-
Pretty sure it would be:
- User-agent: Rogerbot
- Disallow: /*?ajaxCalendar
- Disallow: /*&ajaxCalendar
That would pretty much handle OPs concern there
-
Hi there!
Thanks so much for the great question! Sorry for the trouble here. If you're looking to keep rogerbot from crawling and reporting issues on those calendar pages all together, you could block us from those pages using a disallow directive in your robots.txt file. It may look something like this:
User-agent: Rogerbot
Disallow: /?fullor whatever tag you're wanting to block us from crawling. I have a guide here that talks more about rogerbot and this technique that may be helpful, as well. I would recommend also checking your robots file in a robots.txt checker after making changes just so that no surprises come up!
If you'd like us to look into where we're finding these links or if you have any other questions, please feel free to email us at help@moz.com with the Campaign you're working.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Google redirect backlink created. Do I have to ping this for Moz to recognize it?
Google redirect backlink created. Do I have to ping this for Moz to recognize it?
Link Explorer | | dlwnsh05100 -
Ranking keywords are not showing for my site
Hi, I have started my website 6 months ago and many of my site's keywords are ranking but when I explore my site Get YoWhatsApp in Moz site explorer, it doesn't show ranking keywords there, I'm a little bit confused about this, when my site's keywords will be shown there? Atqd4Bf
Link Explorer | | GetYoWhatsApp0 -
How long will it take to reach DA 2?
Hello, I have a local website (https://iescobill.pk) where I am getting good organic traffic, and also social traffic, and so far my page authority (PA) has reached #13, but DA still 1? Is it normal?
Link Explorer | | iescobill0 -
Spam Score and crawling of my site
Hello, I'm trying to analyze the spam score of my site which is 9/17 Actually I have few backlinks and all of them have a low spam score (max 4/17, just one). I think there's some kind of issue with the crawler since I get strange spam factors: Large Site with Few Links (likely true, I recently deleted a lot of tags used once) Low Number of Pages Found (wasn't it a "Large Site"??) Low Number of Internal Links (I got a considerable number) No Contact Info (I have a link to my facebook in the menu and a "contacts" page) Thin Content (It's just a blog with min 300 words per post, why thin?) Site Link Diversity is Low (likely true) Ratio of Followed to Nofollowed Subdomains (likely true) Low MozTrust or MozRank Score (true) Ratio of Followed to Nofollowed Domains (likely true) Can you please help me to understand it, is it a crawling problem or similar? If needed I will post the url of the website. Thank you so much Marco
Link Explorer | | MarcoBP0 -
Do other sites linking to my page with a low domain authority affect my rankings?
Hello, my page authority 30, I see other page with an authority of 21 for example linking to us. Is this good or bad, does this affect our ranking? A lot of these don't have anchor text, I'm guessing we should reach out to these webmaster to include anchor text with the keywords we want to drive traffic to this page or make as descriptive as possible? Thanks! Laura
Link Explorer | | lauramrobinson320 -
Changed URL from HTTP to HTTPS - 99% of my backlinks don't know though
Hi Moz community, I've got a question about all old backlinks pointing to the http version of my site: Firstly, how it impacts my site's backlinks for SEO and secondly, why does Moz and if you know why Majestic have different metric report values for the different URLs. The Back Story Two months ago I bought an SSL for my personal domain and changed my URL from http to the https version. I 301'd it and can verify that on Majestic SEO using the old http URL. I did this sitewide for an eCommerce site that I'm working and did see a lift in traffic; that was the main reason based on Google talking about sites moving to the SSL Web. I'm No Stranger to 301s Of course all the URLs on my site have been 301'd. I used a HTTPS Redirect plugin for my WordPress site and there's been no issue. I also installed a 404 Checker plugin to log broken external links to my site where I can create a redirect right away in case the HTTPS plugin missed something along the way. I'm comfortable knowing that doing when you change the domain name for a site or just a page going from one URL to another will transfer all the link equity over time. What's Causing the Confusion What's a little confusing is that when I use tools like OSE or Majestic's Explorer, the data doesn't match. For instance in OSE, the https version of my domain has a DA of 1 and PA of 1. But, the http version of my site has a DA of 25 and PA of 36. With Majestic (BTW, please feel free to stop me from asking questions about another tool on Moz, but since we're all part of the same SEO community, I thought I'd ask it here anyway) the Trust and Citation flow values are definitely closely matched but still different values nonetheless. My Question Will I ever see the DA and PA the same for the https & http versions in the future? Does OSE catch the fact that there is a 301 redirect to the https version or does it only recognize that it redirects from http://kingrosales.com to http://www.kingrosales.com when in fact it redirects to https://www.kingrosales.com? My second question is, what about the backlinks? Is it because they are different URLs that OSE doesn't have a way to recognize this and display links from the old http version to the new https version? How will I know the true PA and DA of the https version of my site even with a perfectly executed 301 redirect? lol Let me know if you need more clarification. Thanks
Link Explorer | | KingRosales3 -
Open Site Explorer
I have entered my site (patioenjoyment.com) a few different times into the OSE and it never seems to find it, MOZ has found it because it has done the crawl test for me a few times, found some issues and I have been working on those. But I assume that if it is able crawl my site it should find it to run the OSE. It has come back with "**It looks like we haven't discovered established link data for this URL yet." everytime. ** Thanks, Julie
Link Explorer | | patioenjoyment0 -
301 Redirects: How long for Google to recognize? How long for Moz/OSE to recognize?
I redirected a few pages that had funky URL issues (capitals and underscores and useless words) to the same page renamed with proper URLs. The sitemaps were changed also, and re-submitted. Like this: mydomain.com/Not_Pertinent_Words.html >>> mydomain.com/good-words.html Google seems to have found them and changed the search engine results listing in about 8 days. But it's been about a month now and Moz and OSE still have not transferred all the strength and link data from the old URLs to the new ones. Question 1: How long does it usually take Google to transfer all the link and strength data for a 301? Question 2: How long does it take Moz and OSE to do the same? Is there something I need to do to tell them about the changes?
Link Explorer | | GregB1230