How can you set SEOmoz to work with your dev site behind an htpasswd?
-
All sites need to be developed from the small to the grand - and this takes time. Development usually takes place on a subdomain different from our live domain. It is locked down behind an htpasswd during development so its not picked up by searching engines - that may create duplicate content issues if when the site goes live it has already scanned our site on the development server. Its also a security implementation to keep the site away from prying eyes before its ready for launch There could be security holes that have not been tweaked.
Whats the best strategy to get SEOmoz involved in this scenario. Its tools are invaluable to the SEO part of the build - but the seomoz crawler bot has a different IP address (being cloud based) - so we cannot just let a single IP address through our htpasswd.
Also is there a way to link the dev and live site in seomoz - so when it goes live to maintain all teh same logs without having to create two seperate site campaigns?
Thanks!
-
Hey Robert!
Yes, everything is good here, thanks. Just been hectic around here lately and yes, I've been feeling bad about missing my time in Q&A
-
Good answer there Sha. Glad to see your smiling face, thought you were hiding! Hope all is well down under.
-
Hi dseo241,
Given that your question specifically relates to Roger's ability to access your sites (both dev & production), I think you would be best to email the SEOmoz Help Team direct - help at seomoz.org.
I use the stand alone Crawl Test tool to run a base crawl of our dev sites, which are noindexed, but not behind an htpassword, so you would still need to ask the Help Team about accessibility. Incidentally, the SEOmoz User-agent is rogerbot.
Hope that helps,
Sha
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
403 error for a member site
Perhaps a stupid question but SEOmoz registers 403 errors for pages behind a membersite (ie. they are restricted on purpose). Should I noindex these pages or just let SEOmoz register these "errors"?
Moz Pro | | Crunchii0 -
I have a client with a bit over 100 inbound links but Open Site Explorer shows total links on Subdomain as over 66,000, how can this be?
I have a client www.woodard247.com that shows only a bit over 100 inbound links. using the Open Site Explorer, they are a well trafficed local site and are not doing any grey hat or black hat techniques. However the rankings for their main keywords have suffered recently and we cannot identify any duplicate content or keyword stuffing issues. We have never purchased links or used link building software. Now for the main question: When we run Open Site Explorer it shows only a bit over 100 inbound links on the page and the domain, but the subdomain shows over 66,000 total links! How can this be possible? Could this be a problem? How can I find out what these links are since Open Site Explorer and Seo Spyglass both show only a hundred or so?
Moz Pro | | tjkirgin0 -
How current is the data reflected in the SEOmoz toolbar?
Been using the SEOmoz toolbar for three weeks, yet nothing on my site seems to have changed in terms of rankings and metrics. How new or "fresh" is the data that the toolbar uses to come up with PA, mR, mT, DA, DmR, and DmT? How often does it update?
Moz Pro | | wlefevre0 -
SEOmoz Rank tracking
I think this tool is a bit off : ) This morning I checked my ranking for a keyword and every time I recheck it I see my results in a different place. I checked on word 5 times and got three different results. Is Google brocken or is the tracker doing its own thing? This is not the first time I am seeing this issue only today its really acting up. IMHO I think it would be best if the tool just says out of order 🙂 rather than 3, 10, 6 for one keyword phrase within ten minutes...
Moz Pro | | SEODinosaur0 -
Can I base a SEO campaign on a specific MLS listing inteads of full broker web site?
I have been ask to do a SEO campaign for one MLS listing: house for sale in the rosedale area in Toronto, and I am having difficulty to target one specific MLS listing . I don't want to do the SEO campaign on http://jimmymolloy.com but rather one specific listing http://jimmymolloy.com/feature/?mls=A_C2337646&listing=for-sale Google Analytic does not allow me to have a URL with a query.
Moz Pro | | pd20120 -
Can i give other accounts access
I would like to be able to give limited access to members of our team so they can see SEO campaign results and print off reports without being able to edit the campaigns. Is this possible?
Moz Pro | | wouldBseoKING0 -
How to Link build for our site
Hello, A client of mine has a site that gives advice to people. It's moderately competitive. It's a content site. Using Open Site explorer, I looked up competitor's top pages and backlinks, and there were things such as sites that were heavy on directories, sites heavily on editorial mension, sites on juicy topics that I don't want to cover, and the rest was pretty much junk. Just so that you know, I only link build with quality websites that look strong, long term, have a nice design, are high quality, and are not a directory (with a few exceptions) What's the standard way to link build with a site like this? We've got 7 articles of good content that is from me spending hours learning about the subject and using my skills as a life coach. Right now I'm just adding quality content and social media. I am not a top expert in the field, but I'm learning as much as possible. How do we link build?
Moz Pro | | BobGW0 -
Can I change the crawl day ?
Hi All I hope there is a simple solution to this - we have a number of campaigns setup which are all crawled, and therefore updated, on different days of the week. We review these weekly and it would be much easier if they were all crawled on the same day. Is it possible to change the crawl day for some campaigns? Thanks Roy
Moz Pro | | bluelogic0