WP Events Calendar Creates URLs Too Long in Site Crawler
-
My travel/tourism site is on WP and using an Events plugin that ads a calendar of events to many pages. The MOZ crawler is indexing almost 46K links with a URL too long, but the site only has about 3.8K pages indexed in Google. I can tell MOZ is indexing the same pages over and over again but just adding a random calendar month and year. Here are some examples.
- https://www.visitcurrituck.com/four-day-stay/?full=1&long_events=1&country[0]=US&ajaxCalendar=1&mo=10&yr=2003
- https://www.visitcurrituck.com/four-day-stay/?full=1&long_events=1&country%5B0%5D=US&ajaxCalendar=1&mo=10&yr=2034
- https://www.visitcurrituck.com/beach-houses-family-time/?full=1&long_events=1&country%5B0%5D=US&ajaxCalendar=1&mo=1&yr=1873
Any advice on how to prevent MOZ from indexing this way? I don't believe that Google is seeing this also, but maybe they are. I just know my site has over 63K issues and I'm sure at least 75% or more is because of the way they are picking up on the events calendar.
Thanks!
-
Pretty sure it would be:
- User-agent: Rogerbot
- Disallow: /*?ajaxCalendar
- Disallow: /*&ajaxCalendar
That would pretty much handle OPs concern there
-
Hi there!
Thanks so much for the great question! Sorry for the trouble here. If you're looking to keep rogerbot from crawling and reporting issues on those calendar pages all together, you could block us from those pages using a disallow directive in your robots.txt file. It may look something like this:
User-agent: Rogerbot
Disallow: /?fullor whatever tag you're wanting to block us from crawling. I have a guide here that talks more about rogerbot and this technique that may be helpful, as well. I would recommend also checking your robots file in a robots.txt checker after making changes just so that no surprises come up!
If you'd like us to look into where we're finding these links or if you have any other questions, please feel free to email us at help@moz.com with the Campaign you're working.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does moz pro standard give access to open site explorer & keyword explorer?
Does moz pro standard give access to open site explorer & keyword explorer?
Link Explorer | | SearchOpt1 -
Java scripts creating 404
I have noticed that Moz crawler is unable to understand javascript links like this: https://www.olympus-ims.com/en/solutions/#!chooser[industries]=Mining-Geology Is there a workaround for my reports?
Link Explorer | | eoin-ossa0 -
Can you compare social profiles (FB, Twitter, Instagram, Linkedin) for sites - in a similar way you can compare sites using OSE
Can you compare social profiles (FB, Twitter, Instagram, Linkedin) for competitors sites - in a similar way to how you can compare sites stats - (DA, PA, Backlinks etc) using OSE's compare tool?
Link Explorer | | mike8780 -
How can I get a Moz crawl report of 404 errors on my site
I have a Moz subscription and I see dead links on my website that link externally. Is there a Moz crawl report which will show me these 404 errors and which pages on my site those 404 links are on?
Link Explorer | | Marbanasin0 -
Why is my website providing no feedback on the Open Site Explorer?
Basically, whenever i type in my URL, http://www.locksmithplusincportlandor.com, I am presented with the following message: "It looks like we haven't discovered established link data for this URL yet." I have gone through all of the reasons why this could be, and none of them apply to my current situation. Any help would be much appreciated. Thank you!
Link Explorer | | Meier0 -
Open site explorer
Hi, I am a little confused how open site explorer updates (not sure its working as aspected). It shows the recent discovered links but these then disappear and do not show in the main list (Inbound links) after a few days. Plus the links in the inbound links tab has not changed for nearly 10 weeks, my other tools are showing the new links..... Does it update on a certain data, if so where can i check the status? Thanks
Link Explorer | | 720digital0 -
Removing the clutter of site-wide links
I have a multi-part question with regard to the moz link index and some presentation suggestions. Firstly I would be interested to know how the link index treats site-wide links with regard to metrics such as DA, and PA. We all know that it is highly likely that SE's are unlikely to pass full link value across from sitewide links, and therefore it would make sense for Moz values to account for this as well - if they do not already. One annoying thing that also relates to sitewides is that they tend to clutter the much of the information presentation in a few of the tools (you can't see wood for trees as it were). This is most prominent in the "Just Discovered" page - if you have a sitewides on a large site, you can often find that this screen is just totally filled with these links as they are found. It would be very useful to be able to filter these out, as they are of little interest - currently I can't see a way of filtering them out. A further value where they create to much noise is the 'Total Links' value. Where sitewides are included in this value, the value actually becomes pretty meaningless as you can find that the majority of that value is sitewides. It would therefore be useful if there was another value for 'Total Links - Excluding Sitewides' where maybe value of 1 was just added to the count for a site wide
Link Explorer | | James770 -
Open Site Explorer
Confused by the results displayed in Open Site Explorer. Want to know the Total Links into a site. As such typed in the site address and received the result 28 Total Links from 1 Root Domain. Filter Set to This Page. Therefore, changed the filter to **Pages on This Root Domain. **All other filters set to All (i.e. internal and external links). I would assume this should give me ALL LINKS coming into all pages. I received results of 79 Total Links from 28 root domains. Raven and other tools advise a Total number of links in excess of 2,000. External Backlinks 200+. I have experienced this problem on a number of sites over the past month, in what way am I interpreting the data incorrectly? Why is there such disparity? Please advise. Kind regards
Link Explorer | | Arkix0