SEO audit on a beta site
-
HI there, Is there much point conducting an SEO site audit on a site that has not yet launched and is protected behind a login? Presumably none of the usual SEO tools (Moz, Screaming Frog etc) can crawl this site becuase it is all locked behind a login. Would it be better to launch it and then do a site audit?
Thanks
-
Not sure if not yet lunched meaning it is a brand new site and domain or if this is going to be a new edsign/cms etc..
so, If the site never went live you should have no concerns google spider coming to crawl your site.
But if it is an updated version of an existing website, its better to create a subdomain.
This is the most common practice, you create something like test.domain.com and use robots.txt on this test domain to block all access.it is the safest way that i know
good luck
-
It isn't possible to do this when behind a login but I would definitely still spend the time doing what you can manually before pushing it live.
The other option you have is to push it "live" but block the whole site from crawlers with Robots.txt. Screaming Frog does give you the option to ignore the instructions in Robots so you could still crawl it. If this site is replacing an existing one that makes it a little more tricky. If that's the case, you could still do this but make sure that you get to work on your audit the second you push it live and get it done as quickly as possible.
If the site is up and blocked via Robots for 20 minutes it's unlikely to cause an issue. If you leave it that way for a week however... not such a good idea
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Keyword Cannibalization vs. Optimizing Site
I am in the process of optimizing our website and I am having a hard time reconciling two best practices I have found on Moz. 1. You should avoid having multiple pages focus on the same keyword because you will lose some control of which result will show. 2. You should identify your core keywords and weave these keywords multiple times (naturally) throughout your site. I have spent months identifying our top 7 keywords and am working through the site now. The first piece of advice keeps giving me pause. Can anyone weigh in with other considerations or advice on how I can reconcile these two strategies. Thank you
On-Page Optimization | | NikCall2 -
Metered paywall & seo
Hello In our site we are planning to add a metered paywall, a kind of soft paywall, in which users can see X pages on the site with no restriction, and then on the next page (X+1) they are blocked and need to register. How will this affect SEO? Should we cancel the block on search engine spiders? If the block is just JS popping up a full-screen popup, but the actual content is loaded, is that ok? or another method should be utilized? Thanks!
On-Page Optimization | | idosmaccount0 -
Word Count - Content site vs ecommerce site
Hi there, what are your thoughts on word count for a content site vs. an ecommerce site. A lot of content sites have no problem pushing out 500+ words per page, which for me is a decent amount to help you get traction. However on ecommerce sites, a lot of the time the product description only needs to be sub-100 words and the total word count on the page comes in at under 300 words, a lot of that could be considered duplicate. So what are your views? Do ecommerce sites still need to have a high word count on the product description page to rank better?
On-Page Optimization | | Bee1590 -
Seo for company services page?
I am creating a site for a Dentist with 30 pages of services in a mega menu. Other than the actual pages should there be a central page with all the services on it hyper linking to each one? Thanks Scott
On-Page Optimization | | scott3150 -
SEO for Online Auto Parts Store
I'm currently doing an audit for an online auto parts store and am having a hard time wrapping my head around their duplicate content issue. The current set up is this: The catalogue starts with the user selecting their year of vehicle They then choose their brand (so each of the year pages have listed every single brand of car, creating duplicate content) They then choose their model of car and then the engine And then this takes them to a page listing every type/category of product they sell (so each and every model type/engine size has the exact same content!) This is amounting to literally thousands of pages being seen as duplicates It's a giant mess. Is using rel=canonical the best thing to do? I'm having a hard time seeing a logical way of structuring the site to avoid this issue. Anyone have any ideas?
On-Page Optimization | | ATMOSMarketing560 -
Large Site - Advice on Subdomaining
I have a large news site - over 1 million pages (have already deleted 1.5 million) Google buries many of our pages, I'm ready to try subdomaining http://bit.ly/dczF5y There are two types of content - news from our contributors, and press releases. We have had contracts with the big press release companies going back to 2004/5. They push releases to us by FTP or we pull from their server. These are then processed and published. It has taken me almost 18 months, but I have found and deleted or fixed all the duplicates I can find. There are now two duplicate checking systems in place. One runs at the time the release comes in and handles most of them. The other one runs every night after midnight and finds a few, which are then handled manually. This helps fine-tune the real-time checker. Businesses often link to their release on the site because they like us. Sometimes google likes this, sometimes not. The news we process is reviews by 1,2 or 3 editors before publishing. Some of the stories are 100% unique to us. Some are from contributors who also contribute to other news sites. Our search traffic is down by 80%. This has almost destroyed us, but I don't give up easily. As I said, I've done a lot of projects to try to fix this. Not one of them has done any good, so there is something google doesn't like and I haven't yet worked it out. A lot of people have looked and given me their ideas, and I've tried them - zero effect. Here is an interesting and possibly important piece of information: Most of our pages are "buried" by google. If I dear, even for a headline, even if it is unique to us, quite often the page containing that will not appear in the SERP. The front page may show up, an index page may show up, another strong page pay show up, if that headline is in the top 10 stories for the day, but the page itself may not show up at all - UNTIL I go to the end of the results and redo the search with the "duplicates" included. Then it will usually show up, on the front page, often in position #2 or #3 According to google, there are no manual actions against us. There are also no notices in WMT that say there is a problem that we haven't fixed. You may tell me just delete all of the PRs - but those are there for business readers, as they always have been. Google supposedly wants us to build websites for readers, which we have always done, What they really mean is - build it the way we want you to do it, because we know best. What really peeves me is that there are other sites, that they consistently rank above us, that have all the same content as us, and seem to be 100% aggregators, with ads, with nothing really redeeming them as being different, so this is (I think) inconsistent, confusing and it doesn't help me work out what to do next. Another thing we have is about 7,000+ US military stories, all the way back to 2005. We were one of the few news sites supporting the troops when it wasn't fashionable to do so. They were emailing the stories to us directly, most with photos. We published every one of them, and we still do. I'm not going to throw them under the bus, no matter what happens. There were some duplicates, some due to screwups because we had multiple editors who didn't see that a story was already published. Also at one time, a system code race condition - entirely my fault, I am the programmer as well as the editor-in-chief. I believe I have fixed them all with redirects. I haven't sent in a reconsideration for 14 months, since they said "No manual spam actions found" - I don't see any point, unless you know something I don't. So, having exhausted all of the things I can think of, I'm down to my last two ideas. 1. Split all of the PRs off into subdomains (I'm ready to pull the trigger later this week) 2. Do what the other sites do, that I believe create little value, which is show only a headline and snippet and some related info and link back to the original page on the PR provider website. (I really don't want to do this) 3. Give up on the PRs and delete them all and lose another 50% of the income, which means releasing our remaining staff and upsetting all of the companies and people who linked to us. (Or find them all and rewrite them as stories - tens of thousands of them) and also throw all our alliances under the bus (I really don't want to do this) There is no guarantee this is the problem, but google won't tell me, the google forums are crap, and nobody else has given me an idea that has helped. My thought is that splitting them off into subdomains will have a number of effects. 1. Take most of the syndicated content onto subdomains, so its not on the main domain. 2. Shake up the Domain Authority 3. Create a million 301 redirects. 4. Make it obvious to the crawlers what is our news and what is PRs 5. make it easier for Google News to understand Here is what I plan to do 1. redirect all PRs to their own subdomain. pn.domain.com for PRNewswire releases bw.domain.com for Businesswire releases etc 2. Fix all references so they use the new subdomain Here are my questions - and I hope you may see something I haven't considered. 1. Do you have any experience of doing this? 2. What was the result 3. Any tips? 4. Should I put PR index pages on the subdomains too? I was originally planning to keep them on the main domain, with the individual page links pointing to the actual release on the subdomain. Obviously, I want them only in one place, but there are two types of these index pages. a) all of the releases for a particular PR company - these certainly could be on the subdomain and not on the main domain b) Various category index pages - agriculture, supermarkets, mining etc These would have to stay on the main domain because they are a mixture of different PR providers. 5. Is this a bad idea? I'm almost out of ideas. Should I add a condensed list of everything I've done already? If you are still reading, thanks for hanging in.
On-Page Optimization | | loopyal0 -
Is duplicate content harmful? Example from on my site
I'm not talking about content copied from another site but content unique to a site being used on several pages. I have a delivery tab that has precisely the same content as another product page. This content is on four product pages and the dedicated delivery page. Thanks
On-Page Optimization | | Brocberry0 -
Site Stucture Advice - Keyword Dillema
I am creating a new site and am looking for some advice on how to structure the site Using Google's keyword search tool it seems like I have a dilemma in that about 50% of the keyword pairs are contained in 10 keyword pairs that are similar The first two pairs have about 49% of the traffic and only differ between plural / singular, not quite sure how to handle that, or if google has a method to make these more or less synonomous The last 8 pairs are roughly similar in distribtuion As an example (not my case, just for visualization) Mountain Bike Classes Mountain Bike Instruction Mountain Bike Workshops Mountain Bike Training Etc ... which all more or less give the same results (yes some difference but they all deal with learning how to ride a mountain bike, again this is not my exact case, don't care a whit about mountain bikes 😉 I don't see giving each of those kinds of pairs their own page since the content would be pretty much the exact same, making it substantially different would also be problematic (if I am thinking about this correctly) I have a clean slate to work with from a site perspective so I am wondering how people here would, or better yet have handled similar situations
On-Page Optimization | | bThere0