Indexed sites
-
Hello I´m a newbie here on seomoz. My question is just simple but i need to be sure about that:Refering to the report which you can create in the "crawl diagnostic summary". Does the CSV export lists all and ONLY the URLS which are in the google index?If not: does a report is available where all and ONLY the URLS are listed which are in google index?Many thanks! Henrik
-
Hi Henrik,
Like Tom and Chris mentioned, our tools won't be able to tell you which of your pages are indexed by Google.
That being said, the crawl diagnostics will tell you if your redirected pages are reachable by search engines and OSE will tell you internal and external links. OSE is updated every few weeks so it might not show your most recent changes. Using a combination of your campaign crawls and OSE should be able to get you the data that you need to make sure you're in the best position for your site relaunch.
Hope this helps and good luck with relaunching your site!
Best,
Sam
Moz Helpster -
Use your OSE report to find pages that are being linked to from external sources and be sure to redirect all of those. Use your analytics report to find pages that are bring in search traffic and be sure to redirect those. The rest are neither being linked to nor bringing you any traffic so their priority is on the low end, anyway.
-
thanks for your answers, my question was more to get a full report with sites which are indexed by google. I´mgoing to make a relauch soon. In the new website i changed a lot of categories and URL´s. Now I want to make sure that all sites which are indexed are redirected to the new URL with 301. It would be very helpfull to have a file whith ALL Urls which are indexed by google now.
-
Hi goodcat, you'll see from the FAQs on this page http://www.seomoz.org/help/crawl-diagnostics that the report data is from seomoz's crawl. Your question was asked and some answeres provided not too long ago over here: http://www.seomoz.org/q/is-it-possible-to-get-a-list-of-pages-indexed-in-google.
-
Hi Henrik
I have just checked this for you and yes, SEOMoz will show you URLs that have been deindexed by Google. As proof, here is a URL that contains a link to a site I've worked with that has come up in the SEOMoz crawl, but you will see has been de-indexed by Google (as has the whole domain):
http://www.doublebitbd.com/otherservices.htm
I'm not sure if there is a tool that will show you links that only exist in the Google index, I'm afraid, although I could be wrong. I do know a tool that will tell you which links pointing to your website have been deindexed and that is the LinkDetox tool. It will show you which links on your site are "toxic", meaning the URLs they sit on have been deindexed. The remaining links will be ones that point to your website.
You could also export the URLs in the SEOMoz report and put them into this IndexCheckingTool. Not sure how accurate it is, but if it gives you URLs that are noindexed from your Moz list, you could manually filter them out.
Hope this helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
New Mozscape index released! Learn just what's been going on.
Hi everyone, I'm very, very pleased to announce that the latest Mozscape index has been released five days ahead of schedule, and it's back up to the quality you expect from Moz! It's no secret that we've struggled this year with our index. I can't overstate how much we appreciate everyone sticking with us—we know how hard this has been. The good news—well, apart from the early release—is that we've worked out the issue, and we expect to finally be back on track moving forward. Director of Engineering Martin York has shared a post to the Moz blog explaining just what's been going so wrong, and outlining our plan for the future. Thank you, from the bottom of our hearts, for being such an incredible community. As for the folks who are seeing Domain Authority and Page Authority drops since the index release, please see Rand's recent post for more.
Moz Pro | | MattRoney7 -
Woocommerce filter urls showing in crawl results, but not indexed?
I'm getting 100's of Duplicate Content warnings for a Woocommerce store I have. The urls are
Moz Pro | | JustinMurray
etc These don't seem to be indexed in google, and the canonical is for the shop base url. These seem to be simply urls generated by Woocommerce filters. Is this simply a false alarm from Moz crawl?0 -
404 : Errors in crawl report - all pages are listed with index.html on a WordPress site
Hi Mozers, I have recently submitted a website using moz, which has pulled up a second version of every page on the WordPress site as a 404 error with index.html at the end of the URL. e.g Live page URL - http://www.autostemtechnology.com/applications/civil-blasting/ Report page URL - http://www.autostemtechnology.com/applications/civil-blasting/index.html The permalink structure is set as /%postname%/ For some reason the report has listed every page with index.html at the end of the page URL. I have tried a number of redirects in the .htaccess file but doesn't seem to work. Any suggestions will be strongly appreciated. Thanks
Moz Pro | | AmanziDigital0 -
Google Webmaster Tools and Open Site explorer's links not matching up
My question is why do my GWT's links not match up to the ones on Open Site Explorer. I watched John Mueller's video, and he said that they had problems with the link counts recently. After checking my links today, I can see that the problem is fixed, but my link count differs from Open Site Explorer. On Web Master Tools I have 307 links, but on Open Site Explore I have 42. Has anyone dealt with this problem? thanks. Peter
Moz Pro | | PeterRota0 -
How can a site have a backlink from Barclays website?
Hi, I have entered a competitiors website www.my-wardrobe.com into Open Site to see who they get links from and to my surprise they have a load from Barclays Business Banking. When I visit the page I can not see the links. But if I search the pages source code for my-wardrobe, there I have it, a link to my-wardrobe.com. How have they done this? Surely Barclays haven't sold them it? And more so, why are they receiving link juice when you cant even see the link on the Barclays page in question - http://www.barclays.co.uk/BusinessBanking/P1242557952664 Thanks | |
Moz Pro | | YNWA
| | <a <span="">href</a><a <span="">="</a>http://www.my-wardrobe.com" class="popup" title="Link opens in a new window" rel='' onmousedown="dcsMultiTrack('DCS.dcsuri','BusinessBankingfromBarclays/Footer/wwwmywardrobecom', 'WT.ti', '','WT.dl','1');"> |
| | www.my-wardrobe.com |
| |
|
| | |0 -
Is anybody else having great difficulty in finding good link opportunities on Open Site Explorer?
I've been using OSE for a while now, and I'm struggling to see any value in it. When I search my competitors link profiles, I find just hundreds and hundreds of crappy reciprocal links, splogs or the like. I have to go through days and days (thousands of links) before I find anything worth using. Is anybody having this sort of problem? Thanks
Moz Pro | | kevinmorley0 -
Site not showing data in Open Site Explorer
I have run open site explorer for a couple of sites but I am getting the "no data available for this URL" message. I have read the reasons listed on the error message but none of these apply to the particular sites I am looking for data from. Any thoughts as to why this might be? Thanks, Kwan
Moz Pro | | SocialKwan0 -
Site is penalized yet Google WTC and SEOMOZ says it's ok!
My first question on this community.. A high traffic site of mine has been severely hit for over two months. I took a look at GWTC and noticed a lot of suggestions on the HTML suggestions tab, where I believed that one or a combination of these errors/notices might been causing the penalty. At the moment of typing GWTC shows no HTML suggestions and minor meaningless crawl errors. Checking on SEOMOZ reported issues, I see zero errors except for a high number of duplicate page titles resulting from tag pages being accessible in the same tag title in paginations (tag.html?page=x) which can be fixed easily by using rel=canonical but I just know it can't cause such penalty. For reported warnings, site has a decent amount of title element being too long and missing meta tag description tags. I have been very active in the past with 301 inner pages of the site to make pages URLs as unique as possible and results were great, but that was long time ago before taking the hit. The penalty the site suffers from is zero rankings for newly added contents and old contents as well. It has also lost all rankings for its money terms. Site is not banned and still ranking top for its name which is a good thing. I am not sure where else I should be looking and will appreciate any good advices. Thanks!
Moz Pro | | HossamHossny0