seo moz crawl diagnosis
-
Hi seomozzers,
We are creating a brand new website for a client and I would like to run an seo moz crawl to fix what has been done wrong. So my question is it ok to run an SEO moz crawl with a dev URL? Are final URLs and dev URLs will give me the same results or not?
Basically, Should I wait for getting the final URL or is it ok to run a crawl under a dev URL such as www.dev2.example.com or http://183.2564.2864?
Thank you
-
Hi Kenny,
So I have made the Bot crawl this form of url http://183.2564.2864 and detected multiple errors. So are you saying that I shouldn't rely on what the crawlers has detected? should I then assign the dev team to provide me an actual dev url before sending them any recommendations to fix errors already detected by the bot?
Thanks
-
Hey,
You could use a dev subdomain (e.g. dev.example.com) to get a crawl but we cannot crawl a specific IP address. You will alos want to make sure that our user-agent rogerbot has permission to crawl your dev site.
Hope that helps!
Kenny
-
Even under this format: http://183.2564.2864?
-
you can run it on the dev, that would be ok. cant see why not, errors to do with domain may be askew but thats all.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why does Bing bot crawl so aggressively?
We observer that the Bing bot is crawling our site very aggressively. We set Bing's crawl control so that it should not crawl us during heavy traffic hours, but that did not change a thing. Does anyone have the problem and even better a solution?
Technical SEO | | Roverandom1 -
Relaunching website seo audit
Hi People, We are going to Relaunch the website(https://www.y-axis.com). Url remains the same; the website has good SEO (Ranking, Leads, Traffic...). Website skin (layout, content) is going to change.Hence, would like to know the precautions to secure SEO. Please provide us necessary SEO Checklist for the above request.
Technical SEO | | Anshul.S1 -
Robots and Canonicals on Moz
We noticed that Moz does not use a robots "index" or "follow" tags on the entire site, is this best practice? Also, for pagination we noticed that the rel = next/prev is not on the actual "button" rather in the header Is this best practice? Does it make a difference if it's added to the header rather than the actual next/previous buttons within the body?
Technical SEO | | PMPLawMarketing0 -
Google Crawling Issues! How Can I Get Google to Crawl My Website Regularly?
Hi Everyone! My website is not being crawled regularly by Google - there are weeks when it's regular but for the past month or so it does not get crawled for seven to eight days. There are some specific pages, that I want to get ranked but they of late are not being crawled AT ALL unless I use the 'Fetch As Google' tool! That's not normal, right? I have checked and re-checked the on-page metrics for these pages (and the website as a whole, backlinking is a regular and ongoing process as well! Sitemap is in place too! Resubmitted it once too! This issue is detrimental to website traffic and rankings! Would really appreciate insights from you guys! Thanks a lot!
Technical SEO | | farhanm1 -
Does Bing Last Crawl Update?
Do those of you using Bing Webmaster tools find your sitemap last crawl date gets updated? I noticed mine never updates, just shows the date of the last time I submitted it. It seems like it would update daily as it looks like bing crawls my site daily. See attached image. bing-screen-shot.png
Technical SEO | | Kyle Eaves0 -
SEO friendldy Site structure?
we are in the process or rewriting all the pages on one of our sites and will be changing some urls around. i was just wondering if dashes or underscores are better in the urls SEO wise? www.site.com/word-word-word/ or
Technical SEO | | 858-SEO
www.site.com/word_word_word/ i personally like the underscores better but some colleagues tell me that dashes are better, any tests out there on this issue?? Thanks0 -
Does server location impact SEO?
Hi, I am about to purchase hosting for my WordPress site which is primarily targeting the UK and wondered if server location still has an impact on SEO? Also can anyone recommend a reliable hosting provider with CPanel?
Technical SEO | | Wallander0 -
SEO Info Bing - Logo and Name
I was reading the "How Search Engines Work" which is chapter 1 of the Beginners Guide to SEO by SEOMOZ. Came across an interesting point: "Don’t put the text that you want indexed inside images. For example, if you want your company name or address to be indexed, make sure it is not displayed inside a company logo." Surely most people will alt text their images with keywords or am i missing something here?
Technical SEO | | stefanok0