I have recently switzed to SSL on ramxpert.dk, now Moz is not able to crawl the site anymore
-
Hi Moz
I have recently switzed to SSL on ramxpert.dk, now Moz is not able to crawl anymore.
When I look at the crawl report there is just one fault displayed:
"403 : Received 403 (Forbidden) error response for page."
How can i solve this issue asap?
I was not aware that there would be any issues with moz when activating a SSL certificate on the site.
The campaign with the problem is: ramxpert.dk.
Regards
Jesper Nielsen -
Hi Jesper,
Jo here from the Moz support team.
As WebBoost has noted our crawler isn't compatible with SNI, but the good news is that our team has been working hard on a new crawler which is in Beta right now and can handle SNI. If you're interested in being a part of the beta testing, the link to the signup page is here: http://goo.gl/forms/LCvL9Ix8JDHfbAvr1. Once you fill out that form, you will automatically be added into the Beta during the next round.
We will be rolling the new crawler out to all of our users once it's out of it's Beta phase, but I don't have an exact timeframe of when that will be at this time as it's still being worked on.
You're welcome to reach out to us at help@moz.com if you get stuck :]
Cheers!
Jo -
Thanks BeadedSEO
It seems through that the issue is that ramxpert.dk uses SNI, which isn't supported by the moz crawler yet
I've decided to sign up for the beta version of the new crawler, which I found on the link below. Hopefully this will work while they work on the final version.
https://moz.com/community/q/moz-pro-our-web-crawler-and-sites-that-use-sni
-
Have you tried updating your robots.txt file to use this;
User-agent: rogerbot
Disallow:
User-agent: dotbot
Disallow:
It's best practise to Disalow: none, rather than Allow: /
I've tried crawling your site with SEO Spider and ran in to no issues.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Did Moz Bar change to have no Keyword capabilities?
I'm trying to use it during SEO training over here and the KW button goes to a "Get Page Optimization Score with MozBar Premium - Try Free", with a link that takes you to: https://hsinfo.moz.com/mozpro/mozbar/lander?utm_medium=cpc&utm_source=google&utm_campaign=Brand | NA&utm_adgroup=Brand - MozBar&utm_term=mozbar&gclid=CjwKCAjwxOCRBhA8EiwA0X8hi4Tx1YaOVwzWZaCGmzmYdBO4JEON8YlRMw52stp2AyfEBbH4uWDnARoCum0QAvD_BwE? Didn't this used to accept keywords and allow keyword checking? My training materials have the KW button behaving like this: [1] Do Keyword Research in MozBar.
Moz Bar | | EricaJorgensen
1. Click the icon with KW and a magnifying glass.
2. Enter a term related to your subject. For example, "cyber security".
There is a section telling you the keyword score, the relevancy to your page, and giving you optimizations that you can make to the page regarding this term.... Thus, I feel sure KW had useful and free features and not a button for a trial and paid Moz Bar Premium account. What is the pricing for this feature now? Or am I missing something? Thanks,
Tracy!0 -
Links on my website do not get highlighted by Moz bar in Chrome
I've used the Moz bar for many years to quickly figure out if a link is followed or no-followed. I recently used a Wordpress plugin to build lists of subjects and excerpts of pages with appropriate links. An example is at https://www.chicagotraveler.com/chicago-parks/ This is the main Parks section page. Below the map is a set of links and descriptions of each park in this section of the site. The problem is that when I use the Moz bar to look at this page, the links are not highlighted no matter which settings I click on. Followed, No-followed, External or Internal. I've looked at the code and while there is a bit of css nearby the links, they look fairly normal. Does this mean that moz thinks there is something wrong. Do you think google will also ignore these links? Should I scrap the plugin and build and maintain these lists manually?
Moz Bar | | EdKim0 -
Page Optimization problem in Moz
Hello there, I've been using Moz Pro for a year now, and encountered I've encountered small issues here and there (like some features not working currently, but they start working after a few hours tops) but now I have a bigger issue. Page Optimization feature stopped working and it's dead for five days now. Even my older research is gone. (check the images) Anyone else having this problem, or is it just me? It says that the crawler is blocked or the page isn't working, and when I check the pages in other platforms with crawlers it all goes smooth. All of the pages are working, and all of the crawlers (tested even in Google console) are doing fine. I even had the Moz crawler on 04.07.2019 as the standard week crawl and I got the results. Everything else is working just fine, I have a problem with the Page Optimization feature only. Thanks in advance, Ivan Ga4LKkQ
Moz Bar | | BMGEmployee0 -
How is the Moz keyword limit for each plan determined?
I'm sure it's explained somewhere in here but I haven't found it yet so hoping someone can help: I'm on the Pro Basic plan, which allows me 300 keywords. How is the 300 keywords counted? For example, if I've uploaded 100 keywords in the Keyword Difficulty tool, and am also Rank Tracking an additional 75 keywords for a client, is that 75 kw's, 100 kw's, or 175 kw's? Put another way, if I hypothetically do rank tracking for 300 keywords, does that mean I'm not able to enter additional keywords in the Keyword Difficulty tool without deleting some of the kw's from existing accounts? Thanks for the help!
Moz Bar | | flyntime_tx
Mike0 -
Perplexed by last MOZ crawling duplicate content errors
In the last crawler issues report from MOZ I can see many many pages listed as duplicate content with 0 duplicate urls. Like this: http://imgur.com/fbikRVq I am puzzled, what does it mean?
Moz Bar | | max.favilli0 -
Why is 410 (Gone) being classed as a high priority issue in crawl diagnostics?
Are high priority issues have suddenly soared by over 100 because Moz is classing 410s as high priority.
Moz Bar | | Melissabraz
Google doesn't class these as so serious, so we were wondering if anyone knows why Mos does?0 -
Why does the Moz Tool Bar show code as HTML text for my site?
When I run my site in the Moz Tool bar, all of the page elements are read correctly except for HTML text. Sample page: http://www.lifeionizers.com/blog/alkaline-water/electrolyzed-reduced-water Instead of the text on that page, the tool shows Javascript code: /* With a very high character count for text (14,247).
Moz Bar | | karasd0 -
Moz crawl sees meta description but there are none
I have a new site I have run a starter crawl on. The crawl came back saying some of the pages do indeed have meta descriptions. When I go to the same page and use the Moz Chrome toolbar it says they do not have meta descriptions. I also know they do not have meta descriptions. Are there any instances in which the Moz crawler would see them when they are not there?
Moz Bar | | SBXMedia0