Indexed sites
-
Hello I´m a newbie here on seomoz. My question is just simple but i need to be sure about that:Refering to the report which you can create in the "crawl diagnostic summary". Does the CSV export lists all and ONLY the URLS which are in the google index?If not: does a report is available where all and ONLY the URLS are listed which are in google index?Many thanks! Henrik
-
Hi Henrik,
Like Tom and Chris mentioned, our tools won't be able to tell you which of your pages are indexed by Google.
That being said, the crawl diagnostics will tell you if your redirected pages are reachable by search engines and OSE will tell you internal and external links. OSE is updated every few weeks so it might not show your most recent changes. Using a combination of your campaign crawls and OSE should be able to get you the data that you need to make sure you're in the best position for your site relaunch.
Hope this helps and good luck with relaunching your site!
Best,
Sam
Moz Helpster -
Use your OSE report to find pages that are being linked to from external sources and be sure to redirect all of those. Use your analytics report to find pages that are bring in search traffic and be sure to redirect those. The rest are neither being linked to nor bringing you any traffic so their priority is on the low end, anyway.
-
thanks for your answers, my question was more to get a full report with sites which are indexed by google. I´mgoing to make a relauch soon. In the new website i changed a lot of categories and URL´s. Now I want to make sure that all sites which are indexed are redirected to the new URL with 301. It would be very helpfull to have a file whith ALL Urls which are indexed by google now.
-
Hi goodcat, you'll see from the FAQs on this page http://www.seomoz.org/help/crawl-diagnostics that the report data is from seomoz's crawl. Your question was asked and some answeres provided not too long ago over here: http://www.seomoz.org/q/is-it-possible-to-get-a-list-of-pages-indexed-in-google.
-
Hi Henrik
I have just checked this for you and yes, SEOMoz will show you URLs that have been deindexed by Google. As proof, here is a URL that contains a link to a site I've worked with that has come up in the SEOMoz crawl, but you will see has been de-indexed by Google (as has the whole domain):
http://www.doublebitbd.com/otherservices.htm
I'm not sure if there is a tool that will show you links that only exist in the Google index, I'm afraid, although I could be wrong. I do know a tool that will tell you which links pointing to your website have been deindexed and that is the LinkDetox tool. It will show you which links on your site are "toxic", meaning the URLs they sit on have been deindexed. The remaining links will be ones that point to your website.
You could also export the URLs in the SEOMoz report and put them into this IndexCheckingTool. Not sure how accurate it is, but if it gives you URLs that are noindexed from your Moz list, you could manually filter them out.
Hope this helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Our crawler was not able to access the robots.txt file on your site.
Good morning, Yesterday, Moz gave me an error that is wasn't able to find our robots.txt file. However, this is a new occurrence, we've used Moz and its crawling ability many times prior; not sure why the error is happening now. I validated that the redirects and our robots page are operational and nothing is disallowing Roger in our robots.txt. Any advice or guidance would be much appreciated. https://www.agrisupply.com/robots.txt Thank you for your time. -Danny
Moz Pro | | Danny_Gallagher0 -
Need advise/strategy for cleaning up backlinks to my site
I recently redesigned my website (studio35design.com), and with that, I'm finally paying attention to SEO. I used a few different tools to find the amount of backlinking domains I've built up through the 7 or so years. The numbers are the following: 52 Total Backlinking Domains (800+ links):
Moz Pro | | rubennunez
• 17 of those are from blog commenting - they are pretty much all NF
• 20 of those are from sitewide footer credits on websites I've built. They are all old, as I stopped adding sitewide links to my client sites over a year ago.
• 7 of those are from spam. My site was hacked last year which contributed to alot of it. I've since then completely scrapped my old site and built this one on webflow (Not self-hosted like my old WP site).
• The other 10 or so are from forums, and the odd photo credit. As you can tell, almost none of these backlinks links are really any good. I'm surprised that my DA is 27 really. So moving forward, I need to know the best strategy dealing with these "bad" links. For the spam, I'm going to disavow in google webmasters. As for the rest, here are my questions... QUESTION 1:
As for the sitewide links, would the best thing be to remove the link altogether from the footer of each one of those sites? Some I can't because they are really old, and I don't have access to them (I'll probably disavow), but the rest I can still go in and update. QUESTION 2:
Will removing a ton of links at once hurt my DA and my google ranking? I can probably eliminate 500-600 links within a few days just by removing the sitewide links. How quickly can I expect those links to drop off? A few months? QUESTIONS 3:
Should I disavow blog commenting links even though they are NF? Does it matter at all? QUESTION 4:
I noticed 5 or so of the domains I have links one aren't working domains anymore. How quickly can I expect those links to drop off? Thanks in advance for your help.0 -
My Campaign only crawled 3 pages on my site
On my first crawl of a new campaign, the software only crawled 3 pages. XXXaceXXXscholarships.org any ideas?
Moz Pro | | Santaur0 -
Where do I post this list of hacked sites?
Hey guys, Fairly new to SEOmoz but loving it so far. I was working on a new clients site a noticed some spammy links added right before the tag. Used Open site explorer to list the domains linking to the url and found nearly 300 unsuspecting domains. Some like heartresearch.com.au which just drives me craaazy, I have already emailed them. Below is the list. http://www.opensiteexplorer.org/links.html?group=0&page=3&site=www.rhcie.com Short of emailing every single person can anyone suggest a forum or such that would be helpful for posting this information ? I know it's just a few links but it is frustrating to me and If I can do something about it I would like to. Thanks in advance. Jason
Moz Pro | | RedshiftWebDesign0 -
Can I base a SEO campaign on a specific MLS listing inteads of full broker web site?
I have been ask to do a SEO campaign for one MLS listing: house for sale in the rosedale area in Toronto, and I am having difficulty to target one specific MLS listing . I don't want to do the SEO campaign on http://jimmymolloy.com but rather one specific listing http://jimmymolloy.com/feature/?mls=A_C2337646&listing=for-sale Google Analytic does not allow me to have a URL with a query.
Moz Pro | | pd20120 -
Open Site Explorer Page Authority
Hello, I ran a report on my website at http://www.opensiteexplorer.org/links?site=www.carrentalbuddy.com.au and noticed my page authority went to 1. I also noticed a lot of our results that were showing high page authority have dropped right down. I checked other sites and they all seemed fine but was wondering if this is a open site explorer issue or a a www.carrentalbuddy.com.au issue? Kindest Regards, Chris
Moz Pro | | kymodo0 -
SEOmoz PRO campaign fot HTTPS site
Hi all, I'm trying to configure a PRO campagin for a https website. Butt it won't work. The software says it found a one redirect (for http to https I guess), and that's it. So now I don't have any data.... Can anybody help me? Thnx! Martijn
Moz Pro | | Men4Media0 -
When does Open Site Explorer automatically follow a redirect?
Does anyone know what determines when Open Site Explorer will ask if you meant to type in the redirected URL or when it will automatically change the URL to the www version. example of a site I get asked the redirect question: http://www.opensiteexplorer.org/comparisons.html?site=checkbook.org Oh Hey! It looks like that URL redirects to www.checkbook.org/. Would you like to see data for <a class="clickable redirects">that URL instead</a>? example of a site that redirects automatically: http://www.opensiteexplorer.org/comparisons.html?site=healthleap.com
Moz Pro | | irvingw1