WP Events Calendar Creates URLs Too Long in Site Crawler
-
My travel/tourism site is on WP and using an Events plugin that ads a calendar of events to many pages. The MOZ crawler is indexing almost 46K links with a URL too long, but the site only has about 3.8K pages indexed in Google. I can tell MOZ is indexing the same pages over and over again but just adding a random calendar month and year. Here are some examples.
- https://www.visitcurrituck.com/four-day-stay/?full=1&long_events=1&country[0]=US&ajaxCalendar=1&mo=10&yr=2003
- https://www.visitcurrituck.com/four-day-stay/?full=1&long_events=1&country%5B0%5D=US&ajaxCalendar=1&mo=10&yr=2034
- https://www.visitcurrituck.com/beach-houses-family-time/?full=1&long_events=1&country%5B0%5D=US&ajaxCalendar=1&mo=1&yr=1873
Any advice on how to prevent MOZ from indexing this way? I don't believe that Google is seeing this also, but maybe they are. I just know my site has over 63K issues and I'm sure at least 75% or more is because of the way they are picking up on the events calendar.
Thanks!
-
Pretty sure it would be:
- User-agent: Rogerbot
- Disallow: /*?ajaxCalendar
- Disallow: /*&ajaxCalendar
That would pretty much handle OPs concern there
-
Hi there!
Thanks so much for the great question! Sorry for the trouble here. If you're looking to keep rogerbot from crawling and reporting issues on those calendar pages all together, you could block us from those pages using a disallow directive in your robots.txt file. It may look something like this:
User-agent: Rogerbot
Disallow: /?fullor whatever tag you're wanting to block us from crawling. I have a guide here that talks more about rogerbot and this technique that may be helpful, as well. I would recommend also checking your robots file in a robots.txt checker after making changes just so that no surprises come up!
If you'd like us to look into where we're finding these links or if you have any other questions, please feel free to email us at help@moz.com with the Campaign you're working.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Why am I not seeing search.yahoo.com in my site's backlink profile?
When looking at the backlinks for a client's competitor I found that they had a backlink on search.yahoo.com/reviews and our domain (harmonyhit.com) did not. I was using the Link Explorer tool. However, when I go to yahoo Search I see that the website of harmonyhit.com is indexed in Yahoo search and has links to the site. Also, it's sitemap has been recently crawled in Bing webmaster tools which Yahoo uses. Why does our client have the backlink accounted for and we do not?
Link Explorer | | DigitalThirdCoast0 -
Why I am seeing only 2 internal links in Site explorer?
Their are lot of links on my site but site explorer showing only 2 internal links. I don't know why. Can anyone help me please?
Link Explorer | | HSgr1000 -
Drop in DA across multiple sites
Hi I monitor and track few Top sites that are Industry leaders. I got -1 to -3 in DA across this month. Has anyone else experienced this and the matter of fact is there has been rare or no change in the sites but the moz backlink data experienced a major drop "more then 100K backlinks were dropped for them in yesterday's report as compared to a 20 day old report". Has anyone at Moz or anyone in the community experienced the same
Link Explorer | | mr.ankit.manocha0 -
Campaign shows website links from Https. My site is not https but http:// HELP
When looking at my web campaign, I have inbound links pointing from every page located on my menu from https:// I do not have an https. website in any way. The weird part is that when I click on the link, it is a replica of my homepage, although in text only format. I have attached a picture for reference. Why and how could my top links be coming from this? I do not have any inbound links non https:// from my website Thank you! BNHHc5u
Link Explorer | | Morg56850 -
Spam Score and crawling of my site
Hello, I'm trying to analyze the spam score of my site which is 9/17 Actually I have few backlinks and all of them have a low spam score (max 4/17, just one). I think there's some kind of issue with the crawler since I get strange spam factors: Large Site with Few Links (likely true, I recently deleted a lot of tags used once) Low Number of Pages Found (wasn't it a "Large Site"??) Low Number of Internal Links (I got a considerable number) No Contact Info (I have a link to my facebook in the menu and a "contacts" page) Thin Content (It's just a blog with min 300 words per post, why thin?) Site Link Diversity is Low (likely true) Ratio of Followed to Nofollowed Subdomains (likely true) Low MozTrust or MozRank Score (true) Ratio of Followed to Nofollowed Domains (likely true) Can you please help me to understand it, is it a crawling problem or similar? If needed I will post the url of the website. Thank you so much Marco
Link Explorer | | MarcoBP0 -
My linked in profile is showing up the opensite exploer but not showing up in on page grader, any ideas why? the onpage grader says in url is in accessible
my linked on company profile ios not showing up in the on page grader tool, it return un accessible uRL? but we give me metrics in domain checker? its a new profile i set up about 8 hours ago,
Link Explorer | | maxmxmax0 -
Open Site Explorer doesn't show local directories or citation links?
Why is it that when I run a link analysis for my local business sites I don't see any links from Yelp, Google+, Facebook, any local citations? Regardless of them being follow or no follow isn't the hyperlink to a website from a Yelp profile considered a link? Same with any other local business directory? I know the company is listed on a few dozen because I can see it manually but it's not showing up in Moz? Why is it that all local directories and citations with website are omitted? And since it is not there, where is a good place to go to discover these things? I have tried whitespark. It was okay but honestly I wasn't terribly impressed. The data was good, the UI was just okay, but with smaller clients it was an initial check and then very occasional checks that needed to happen. We would go months without using it.
Link Explorer | | bricegump0 -
Why does the number of the total external links and the followed linking root domains between Open site explorer and the campaign in Moz pro doesn't match?
Opensiteexplorer returns 52.473 total external links and 715 followed linking root domains while my campaign in Moz analytics return 35.899 total external links and 1092 followed linking root domains. Does anyone knows how this is possible?
Link Explorer | | ConversionMobstars0