WP Events Calendar Creates URLs Too Long in Site Crawler
-
My travel/tourism site is on WP and using an Events plugin that ads a calendar of events to many pages. The MOZ crawler is indexing almost 46K links with a URL too long, but the site only has about 3.8K pages indexed in Google. I can tell MOZ is indexing the same pages over and over again but just adding a random calendar month and year. Here are some examples.
- https://www.visitcurrituck.com/four-day-stay/?full=1&long_events=1&country[0]=US&ajaxCalendar=1&mo=10&yr=2003
- https://www.visitcurrituck.com/four-day-stay/?full=1&long_events=1&country%5B0%5D=US&ajaxCalendar=1&mo=10&yr=2034
- https://www.visitcurrituck.com/beach-houses-family-time/?full=1&long_events=1&country%5B0%5D=US&ajaxCalendar=1&mo=1&yr=1873
Any advice on how to prevent MOZ from indexing this way? I don't believe that Google is seeing this also, but maybe they are. I just know my site has over 63K issues and I'm sure at least 75% or more is because of the way they are picking up on the events calendar.
Thanks!
-
Pretty sure it would be:
- User-agent: Rogerbot
- Disallow: /*?ajaxCalendar
- Disallow: /*&ajaxCalendar
That would pretty much handle OPs concern there
-
Hi there!
Thanks so much for the great question! Sorry for the trouble here. If you're looking to keep rogerbot from crawling and reporting issues on those calendar pages all together, you could block us from those pages using a disallow directive in your robots.txt file. It may look something like this:
User-agent: Rogerbot
Disallow: /?fullor whatever tag you're wanting to block us from crawling. I have a guide here that talks more about rogerbot and this technique that may be helpful, as well. I would recommend also checking your robots file in a robots.txt checker after making changes just so that no surprises come up!
If you'd like us to look into where we're finding these links or if you have any other questions, please feel free to email us at help@moz.com with the Campaign you're working.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Java scripts creating 404
I have noticed that Moz crawler is unable to understand javascript links like this: https://www.olympus-ims.com/en/solutions/#!chooser[industries]=Mining-Geology Is there a workaround for my reports?
Link Explorer | | eoin-ossa0 -
GTLDs in Open Site Explorer
Curious to know if anyone has run into a similar problem - I entered a site containing a gTLD (.dog extensions) in OSE and it gave me an error (screenshot attached). I checked another tool (ahrefs.com) and was able to extract some data. Does anyone know if these type of domains are not included in OSE and/or why there was an error? Appreciate any insight! RSA04bYsL
Link Explorer | | ATShock0 -
Why Aren't All My Backlinks Appearing in Open Site Explorer?
Cross-referenced on Google Webmaster Tools and it looks like MOZ isn't pulling all my links. Any reason why? Thanks in advance!
Link Explorer | | Dental-Care-Allilance0 -
Open Site Explorer Messge - Mysite.com redirects to www.mysite.com
Hello All, When I plug in my site's URL http://mysite.com ( Not my actual URL of-course) into the OpenSiteExplorer tool I get the following message: "You entered the URL http://Mysite.com which redirects to http://www.Mysite.com/.
Link Explorer | | jjimen03
Because it's likely to have more accurate metrics, we're showing data for the redirected URL instead.
Click here to analyze http://Mysite.com instead?" Not sure why I am getting this message. On my hosting server, I have defined my preferred domain to be the non-www. version. I have also used a Canonical Tag on Mysite.com/index.html file ( ). In addition, on Google Search Console ( Webmaster Tools ) , I have added both the www. and non-www. properties, where on both property settings, I have defined the non-www. version as my preferred one. Also, on my server, I have not implemented any 301 redirects at all. So my questions are: Why am I receiving this message when plugging in my non-www. URL version of my website into OpenSiteExplorer? Is my DA or PA possibly being split up between the two versions as a result? Should I be concerned? How can I fix this? Thanks in advance.0 -
Page Authority dropped to 1 for subdirectory in my site
Hey, one of my sites https://www.automationanywhere.com/testing has had all it's pages drop to a page authority of 1 in Moz and the campaign doesnt appear to be indexing any pages from this directory. We launched a new site in this directory on the 12th and havent been getting any moz love since. The pages are indexable and followable, and are being indexed by google and others. The site on the root domain has been unaffected. Please help me get my moz campaign back on track. Thanks!
Link Explorer | | aatethys0 -
Open site explorer
Hi, I am a little confused how open site explorer updates (not sure its working as aspected). It shows the recent discovered links but these then disappear and do not show in the main list (Inbound links) after a few days. Plus the links in the inbound links tab has not changed for nearly 10 weeks, my other tools are showing the new links..... Does it update on a certain data, if so where can i check the status? Thanks
Link Explorer | | 720digital0 -
Open Site Explorer
Confused by the results displayed in Open Site Explorer. Want to know the Total Links into a site. As such typed in the site address and received the result 28 Total Links from 1 Root Domain. Filter Set to This Page. Therefore, changed the filter to **Pages on This Root Domain. **All other filters set to All (i.e. internal and external links). I would assume this should give me ALL LINKS coming into all pages. I received results of 79 Total Links from 28 root domains. Raven and other tools advise a Total number of links in excess of 2,000. External Backlinks 200+. I have experienced this problem on a number of sites over the past month, in what way am I interpreting the data incorrectly? Why is there such disparity? Please advise. Kind regards
Link Explorer | | Arkix0 -
Is there an option that's more precise over Open Site Explorer?
I've had folks explain to me before that OpenSiteExplorer is just an estimation, etc. but there are some fairly easy statistics that seem to be different and it makes me nervous that either its wrong or I'm doing something wrong. As you can see in the image, moz isn't read social metrics correctly. It actually used to be pretty spot on, but as you can see with Google+'s its off. Maybe not a big deal right? But for my clients new Moz Analytic print outs it makes somewhat of a difference. Any help? UlwQs3w
Link Explorer | | jonnyholt0