WP Events Calendar Creates URLs Too Long in Site Crawler
-
My travel/tourism site is on WP and using an Events plugin that ads a calendar of events to many pages. The MOZ crawler is indexing almost 46K links with a URL too long, but the site only has about 3.8K pages indexed in Google. I can tell MOZ is indexing the same pages over and over again but just adding a random calendar month and year. Here are some examples.
- https://www.visitcurrituck.com/four-day-stay/?full=1&long_events=1&country[0]=US&ajaxCalendar=1&mo=10&yr=2003
- https://www.visitcurrituck.com/four-day-stay/?full=1&long_events=1&country%5B0%5D=US&ajaxCalendar=1&mo=10&yr=2034
- https://www.visitcurrituck.com/beach-houses-family-time/?full=1&long_events=1&country%5B0%5D=US&ajaxCalendar=1&mo=1&yr=1873
Any advice on how to prevent MOZ from indexing this way? I don't believe that Google is seeing this also, but maybe they are. I just know my site has over 63K issues and I'm sure at least 75% or more is because of the way they are picking up on the events calendar.
Thanks!
-
Pretty sure it would be:
- User-agent: Rogerbot
- Disallow: /*?ajaxCalendar
- Disallow: /*&ajaxCalendar
That would pretty much handle OPs concern there
-
Hi there!
Thanks so much for the great question! Sorry for the trouble here. If you're looking to keep rogerbot from crawling and reporting issues on those calendar pages all together, you could block us from those pages using a disallow directive in your robots.txt file. It may look something like this:
User-agent: Rogerbot
Disallow: /?fullor whatever tag you're wanting to block us from crawling. I have a guide here that talks more about rogerbot and this technique that may be helpful, as well. I would recommend also checking your robots file in a robots.txt checker after making changes just so that no surprises come up!
If you'd like us to look into where we're finding these links or if you have any other questions, please feel free to email us at help@moz.com with the Campaign you're working.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why I am seeing only 2 internal links in Site explorer?
Their are lot of links on my site but site explorer showing only 2 internal links. I don't know why. Can anyone help me please?
Link Explorer | | HSgr1000 -
What do we know about Open Site Explorer?
Any clear answer for this result? Google get penalty from Google for it's own website? Please refer to the attached picture below. vsgKw
Link Explorer | | BBT-Digital0 -
Page Authority different between Moz Open Site Explorer and On Page analyser
I have a client who has an old URL with 3 linking root domains and 4 links, with a PA of 24. This is on the open site explorer. There is a 301 redirect in place to direct this old url to the new url. When he uses the Moz bar on page, it shows that he has a PA of only 1 with no LRDs or inbound links? Can anyone please explain why this is happening and if this could affect further page links across his site? It would be appreciated. Kind regards
Link Explorer | | lisa_rothery0 -
Difference on full and partial URLs in Open Site Explorer?
Hi, I am pretty new to SEO and it might show. Here is my question, regarding the difference on "full and partial" urls in Open Site Explorer (OSP). That is, the difference on http://www.mywebsite.com and http://mywebsite.com. I get very similar results for the two variations, but not exactly the same. That suggest to me that OSP most of the time find the same links regardless of whether the url put into the search field is full or partial. But not all the time. Can anyone clarify? Thx in advance
Link Explorer | | plovski0 -
Open Site Explorer -> Just Discovered -> Internal Links: Only shown 1 url link per day
Hi, We have a page that have like 10-15 new content/pages per day.
Link Explorer | | Inspiringinterns
eg. domain.com/post-id-01/, omain.com/post-id-02/, omain.com/post-id-03/ etc
But somehow, under Just-Discovered, internal links only show 1 per day when it suppose to display like 10-15.
The layout for each pages is exact same except for the content changes and the url's ID changes. Our competitor on the other hand, they have like 5 new page per day, but somehow Moz shows their internal links as 25 per days. Each of their new url have 4 more prefix number.
Eg:
new-page-01?track=990
new-page-01?track=991
new-page-01?track=992 etc
The above example url is technically as 1 page if without the "?" affix. Whiles all our new pages/url have unique id, but Moz only show 1 a day. Please advise on how to get Moz to shows all the new pages in Just-Discovered (internal link). Thanks, Cam0 -
I crawled my site, but an old crawl report still is visible
I crawled my site recently, but an old crawl report still is still all I can see
Link Explorer | | Bigjim0 -
Page Authority dropped to 1 for subdirectory in my site
Hey, one of my sites https://www.automationanywhere.com/testing has had all it's pages drop to a page authority of 1 in Moz and the campaign doesnt appear to be indexing any pages from this directory. We launched a new site in this directory on the 12th and havent been getting any moz love since. The pages are indexable and followable, and are being indexed by google and others. The site on the root domain has been unaffected. Please help me get my moz campaign back on track. Thanks!
Link Explorer | | aatethys0 -
Open Site Explorer does not show my website backlinks
My website URL - packforcity.com I have backlinks from pinterest, flickr, yahoo, etc. but open site explorer does not show any in backlinks. my pinterest PA is 47.??? any suggestions why it does not show in backlinks?
Link Explorer | | ross254sidney0