WP Events Calendar Creates URLs Too Long in Site Crawler
-
My travel/tourism site is on WP and using an Events plugin that ads a calendar of events to many pages. The MOZ crawler is indexing almost 46K links with a URL too long, but the site only has about 3.8K pages indexed in Google. I can tell MOZ is indexing the same pages over and over again but just adding a random calendar month and year. Here are some examples.
- https://www.visitcurrituck.com/four-day-stay/?full=1&long_events=1&country[0]=US&ajaxCalendar=1&mo=10&yr=2003
- https://www.visitcurrituck.com/four-day-stay/?full=1&long_events=1&country%5B0%5D=US&ajaxCalendar=1&mo=10&yr=2034
- https://www.visitcurrituck.com/beach-houses-family-time/?full=1&long_events=1&country%5B0%5D=US&ajaxCalendar=1&mo=1&yr=1873
Any advice on how to prevent MOZ from indexing this way? I don't believe that Google is seeing this also, but maybe they are. I just know my site has over 63K issues and I'm sure at least 75% or more is because of the way they are picking up on the events calendar.
Thanks!
-
Pretty sure it would be:
- User-agent: Rogerbot
- Disallow: /*?ajaxCalendar
- Disallow: /*&ajaxCalendar
That would pretty much handle OPs concern there
-
Hi there!
Thanks so much for the great question! Sorry for the trouble here. If you're looking to keep rogerbot from crawling and reporting issues on those calendar pages all together, you could block us from those pages using a disallow directive in your robots.txt file. It may look something like this:
User-agent: Rogerbot
Disallow: /?fullor whatever tag you're wanting to block us from crawling. I have a guide here that talks more about rogerbot and this technique that may be helpful, as well. I would recommend also checking your robots file in a robots.txt checker after making changes just so that no surprises come up!
If you'd like us to look into where we're finding these links or if you have any other questions, please feel free to email us at help@moz.com with the Campaign you're working.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz DA is not improving my site DA why?
Hello Moz community, I have created a lot of high domain authority backlinks for my official service website but my DA still less than 15, why my site DA does not increase as I have created huge backlinks.
Link Explorer | | Ijiubu7680 -
My Site Facing indexing issues
Hello, I am facing indexing issues on one of my which is about budget bushcraft knife , Four months have been passed I built my site and published almost 7 article so far. But i am worried no any single keyword ranked on google till yet as i checked through MOZ site explorer. Can anyone guide me what should I need to do now. Thanks
Link Explorer | | james112230 -
Drop in Domain Authority across 20 sites
Hi I monitor and track 20-25 sites. I got a -1 in DA across the board this month. Has anyone else experienced this. It's possible my server/cms guys have made a global change. Has anyone at Moz or anyone in the community experienced this?
Link Explorer | | Andrew-SEO0 -
How Do You Deal With Duplicate Content On A Retail Site
Hi Guys We make custom portfolios and boxes and every time we have a Moz site crawl, Rogerbot always returns a number of Duplicate Content Issues relating to different products. As per the image below (which I hope is visible?!) Rogerbot has flagged duplicate content onto one product that relates to 5 other different products. For instance there is duplicate content for an A4 Leather Portfolio and an A3 Leather Portfolio and an 11"x17" Leather Portfolio. I can't redirect or canonicalise to just the A4 Portfolio as they are all individually different products. The information on each page although similar, is relevant to each of the products, so rewriting a different blurb on each product page, will not be user friendly for our customers. I could ignore the duplicate content issues, but then that isn't good practise (and also makes for a very unsatisfactory looking Dashboard!) Any ideas?? Nick wzQLgBl
Link Explorer | | nick_HandCo1 -
Difference on full and partial URLs in Open Site Explorer?
Hi, I am pretty new to SEO and it might show. Here is my question, regarding the difference on "full and partial" urls in Open Site Explorer (OSP). That is, the difference on http://www.mywebsite.com and http://mywebsite.com. I get very similar results for the two variations, but not exactly the same. That suggest to me that OSP most of the time find the same links regardless of whether the url put into the search field is full or partial. But not all the time. Can anyone clarify? Thx in advance
Link Explorer | | plovski0 -
How does spammy linked site have zero spam score?
I came across a law firm site with hundreds of horrible spam links to it. Of the 3330 links, all but 231 links have anchor text that has to do with "jordan 11s for sale". I'm trying to see how useful the moz spam score is, but clearly it's not reliable if this site has a score of zero. Many of the obviously spammy sites linking to it also have low to zero spam scores, although there are plenty in the 5-10 range. (see attached image). I also noticed that many sites were legit sites, but if you look at the source code, there's tons of hidden spam links in the code (e.g., www.chickasawgardens.net) Why would this site have a zero spam score? If you're curious, put it into open site explorer and have a look. It's a law firm based in Pennsylvania, most anchor text has to do with jordan sneakers and most links are foreign: penn-criminallawyers.com Is the spam score too lenient? Is the moz tool unable to find spam links coming from legitimate sites with hidden spam links? DrokMbP
Link Explorer | | usDragons0 -
Why do I not see any data in Open site Explorer for my site www.mtg-sg.com
The PA and DA shows as one. The message is "It looks like we haven't discovered established link data for this URL yet." But its shows me that there are facebook shares. Therefore, it can't be the reasons stated below.
Link Explorer | | Dineshr840 -
Is there an efficient way to use Open Site Explorer to find unnatural or harmful links
We have a new client with 8 sites that we would like to 301 to a new site. However, before doing so we want to make sure that the backlinks are not unnatural or harmful in any way. Using open site explorer (other than just looking at exact anchor text vs brand anchor text ratio) is there a way to determine low quality inbound sites linking in? or any type of links google will find manipulative?
Link Explorer | | Bryan_Loconto0