seo moz crawl diagnosis
-
Hi seomozzers,
We are creating a brand new website for a client and I would like to run an seo moz crawl to fix what has been done wrong. So my question is it ok to run an SEO moz crawl with a dev URL? Are final URLs and dev URLs will give me the same results or not?
Basically, Should I wait for getting the final URL or is it ok to run a crawl under a dev URL such as www.dev2.example.com or http://183.2564.2864?
Thank you
-
Hi Kenny,
So I have made the Bot crawl this form of url http://183.2564.2864 and detected multiple errors. So are you saying that I shouldn't rely on what the crawlers has detected? should I then assign the dev team to provide me an actual dev url before sending them any recommendations to fix errors already detected by the bot?
Thanks
-
Hey,
You could use a dev subdomain (e.g. dev.example.com) to get a crawl but we cannot crawl a specific IP address. You will alos want to make sure that our user-agent rogerbot has permission to crawl your dev site.
Hope that helps!
Kenny
-
Even under this format: http://183.2564.2864?
-
you can run it on the dev, that would be ok. cant see why not, errors to do with domain may be askew but thats all.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Crawl rate dropped to zero
Hello, I recently moved my site in godaddy from cpanel to managed wordpress. I bought this transfer directly from GoDaddy customer service. in this process they accidentally changed my domain from www to non www. I changed it back after the migration, but as a result of this sites craw rate from search console fell to zero and has not risen at all since then. In addition to this website does not display any other errors, i can ask google manually fetch my pages and it works as before, only the crawl rates seems to be dropped permanently. GoDaddy customer service also claims that do not see any errors but I think, however, that in some way they caused this during the migration when the url changed since the timing match perfectly. also when they accidentally removed the www, crawl rate of my sites non www version got up but fell back to zero when I changed it back to www version. Now the crawl rate of both www and non www version is zero. How do I get it to rise again? Customer service also said that the problem may be related to ftp-data of search console? But they were not able to help any more than .Would someone from here be able to help me with this in anyway please?
Technical SEO | | pok3rplay3r0 -
Improving SEO Structure of a Page
Our site is an online Marketplace for Services. Naturally, we have a lot of unique content in the form of :
Technical SEO | | Ideas2life
a) Job Posts
b) Profiles of Service Providers We also have 2 very important pages:
a) The Job Listing Page
b) The Service Provider Page The Listing pages have very valuable H1 Titles, but everything else is duplicate content. To capture those keywords currently in H1, we have created a different landing page for each category page, and we`ll optimize around that, so these H1s are not that big of a deal any more. These landing pages are the key to our SEO strategy and we are building new content every day to help them rank I want to make the Listing Pages No Index Follow. This way they pass Juice to Jobs, and Profiles which have unique contents, but are not indexed themselves. Is this a bad idea? I have been thinking about doing this for over a year but it never felt important enough to be worth the risk of accidentally screwing up We `ll soon do a new on page flow optimization and that's why I am considering this again. Thank you so much in advance Argyris0 -
Sitemap and crawl impact
If I have two links in the sitemap (for example: page1.html and page2.html) but the web-site contains more pages (page1.html, page2.html and page3.html) is this a sign for Google to not to crawl other pages? I.e. Will Google index page3.html? Consider that any page can be accessed.
Technical SEO | | ditoroin0 -
SEO for Wordpress
I am sure you have been asked this many times... What is the BEST Wordpress Plug-in for SEO - Easy to Title Page, Meta Tags, etc... ?? Thanks
Technical SEO | | tab540 -
SEO advice when making a mobile site
Hi there, I'm current working on a site that is optimized for SEO and doing quite well in the rankings. We have noticed a big increase in mobile users to the site (mainly iOS and Android), so we have no started planning a mobile site as well. Do you guys have any recommendations we should keep in mind before we get started? One thing I'm still not sure of is whether we should aim to preserve all urls and cloak the pages (show mobile version to iOS and Android, and desktop version to everyone else) OR make a separate site for the mobile version (mobile.domain.com)? Would either solution affect the other? Regards,
Technical SEO | | KennethDreyer
Kenneth0 -
Does ViewState affect SEO Rankings
We are redesigning our website and looking at our large data in the viewstate hidden field. Our thoughts are to move to bottom of page but our developers are stating this is an old myth and no resent documentation if it improves our SEO. Does ViewState (big data in hidden fields ) effect SEO in any way? If ViewState (hidden field) is present at the end of HTML document instead of near the start of HTML document then will it increase our ranking in search engines? Does Google or any other engine read the hidden fields? or do they ignore them? Can you point me to some valid documentation to back this up? Feed back is appreciated. Cathy
Technical SEO | | SEO-Team0 -
Competiting In the Small Business SEO Market
I deal with primarily small businesses in the construction and maintenance industries and I'm looking for some advice. Traditionally in these categories you find absolutely awful websites with the below attributes, all ranking 1-5 in the SERPs. Weak/Limited content No blog Awful title tags Minimal backlinks Poor on-site optimization Ect. In most cases I am going to assume that these sites have been indexed for the last ten years, and that is why they are retaining such high rankings. My issue is trying to compete with them! So far I have worked to have my client's website submitted to and accepted by all of their competitor's backlinking site (which didn't take as long as you might think). I've also listed my client in several of the top paying and free directories (dmoz, joe ant, ect.) and still I see limited results. Lastly and most annoyingly my clients website, according to SEOmoz is currently leading the domain authority race in every category. Does anyone have a suggestion as to what is going on.
Technical SEO | | calin_daniel0
