Indexed sites
-
Hello I´m a newbie here on seomoz. My question is just simple but i need to be sure about that:Refering to the report which you can create in the "crawl diagnostic summary". Does the CSV export lists all and ONLY the URLS which are in the google index?If not: does a report is available where all and ONLY the URLS are listed which are in google index?Many thanks! Henrik
-
Hi Henrik,
Like Tom and Chris mentioned, our tools won't be able to tell you which of your pages are indexed by Google.
That being said, the crawl diagnostics will tell you if your redirected pages are reachable by search engines and OSE will tell you internal and external links. OSE is updated every few weeks so it might not show your most recent changes. Using a combination of your campaign crawls and OSE should be able to get you the data that you need to make sure you're in the best position for your site relaunch.
Hope this helps and good luck with relaunching your site!
Best,
Sam
Moz Helpster -
Use your OSE report to find pages that are being linked to from external sources and be sure to redirect all of those. Use your analytics report to find pages that are bring in search traffic and be sure to redirect those. The rest are neither being linked to nor bringing you any traffic so their priority is on the low end, anyway.
-
thanks for your answers, my question was more to get a full report with sites which are indexed by google. I´mgoing to make a relauch soon. In the new website i changed a lot of categories and URL´s. Now I want to make sure that all sites which are indexed are redirected to the new URL with 301. It would be very helpfull to have a file whith ALL Urls which are indexed by google now.
-
Hi goodcat, you'll see from the FAQs on this page http://www.seomoz.org/help/crawl-diagnostics that the report data is from seomoz's crawl. Your question was asked and some answeres provided not too long ago over here: http://www.seomoz.org/q/is-it-possible-to-get-a-list-of-pages-indexed-in-google.
-
Hi Henrik
I have just checked this for you and yes, SEOMoz will show you URLs that have been deindexed by Google. As proof, here is a URL that contains a link to a site I've worked with that has come up in the SEOMoz crawl, but you will see has been de-indexed by Google (as has the whole domain):
http://www.doublebitbd.com/otherservices.htm
I'm not sure if there is a tool that will show you links that only exist in the Google index, I'm afraid, although I could be wrong. I do know a tool that will tell you which links pointing to your website have been deindexed and that is the LinkDetox tool. It will show you which links on your site are "toxic", meaning the URLs they sit on have been deindexed. The remaining links will be ones that point to your website.
You could also export the URLs in the SEOMoz report and put them into this IndexCheckingTool. Not sure how accurate it is, but if it gives you URLs that are noindexed from your Moz list, you could manually filter them out.
Hope this helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Automatically Check List of Sites For Links To Specific Domain
Hi all, Can anyone recommend a tool that will allow me to put in a list of about 200 domains that are then checked for a link back to a specific domain? I know I can do various link searches and use Google site: command on a site by site basis, but it would be much quicker if there was a tool that could take the list of domains I am expecting a link on and then find if that link exists and if so on what page etc. Hope this makes sense otherwise I have to spend a day doing it by hand - not fun! Thanks,
Moz Pro | | MrFrisbee
charles.0 -
Inherited a site - no progress being made, no authority?
Hi all, would really appreciate some input on this one. I've been given the task of optimising a website which was built by another company. It's a Wordpress site using Jigoshop. It wasn't in the best of states, and I don't claim that it is now, though we've done quite a bit of work on it. However, after months of work on it, I feel it's not going anywhere. Naturally my customer wants to see results, and they're not getting much. I've submitted the website to a couple of highly regarded directories, and I believe it's listed on some speciality directories (Asian clothing directories). I've also started them on the task of blogging, and I'm trying to get them involved with guest blogging. There's a DA of 1, OSE reports No Data Available for this URL. The Competitive Domain Analysis shows no links at all. I could understand if I started the campaign last week, but we got going in around January this year. One thing that's crossed my mind is that it's quite a slow-loading website. It's with GoDaddy on some cheap hosting plan (not my doing!!). I understand loading times can affect results - could this be the case? It's a bit disheartening really, because we've had really good success with a lot of local businesses' websites but with this one we just can't seem to get it anywhere! 😞 If anyone could shine a bit of light I'd really appreciate it. The URL is bangle-box.co.uk. Thanks in advance!
Moz Pro | | s7media0 -
404 : Errors in crawl report - all pages are listed with index.html on a WordPress site
Hi Mozers, I have recently submitted a website using moz, which has pulled up a second version of every page on the WordPress site as a 404 error with index.html at the end of the URL. e.g Live page URL - http://www.autostemtechnology.com/applications/civil-blasting/ Report page URL - http://www.autostemtechnology.com/applications/civil-blasting/index.html The permalink structure is set as /%postname%/ For some reason the report has listed every page with index.html at the end of the page URL. I have tried a number of redirects in the .htaccess file but doesn't seem to work. Any suggestions will be strongly appreciated. Thanks
Moz Pro | | AmanziDigital0 -
Google Webmaster Tools and Open Site explorer's links not matching up
My question is why do my GWT's links not match up to the ones on Open Site Explorer. I watched John Mueller's video, and he said that they had problems with the link counts recently. After checking my links today, I can see that the problem is fixed, but my link count differs from Open Site Explorer. On Web Master Tools I have 307 links, but on Open Site Explore I have 42. Has anyone dealt with this problem? thanks. Peter
Moz Pro | | PeterRota0 -
How does SEOMoz crawl sites? Does it follow the sitemap?
I only ask because in my report it returned a few "no follow" links. Was wondering how SEOMoz operates.
Moz Pro | | Pikimal0 -
Open site Explorer Findings??
On OSE, I am comparing two websites(A and B) and one has a page authority higher than the other (35(A) vs 36 (B)), but all the linking metrics are in favor for website A except for the linking C block (A has 11 and B has 12). The website B is ranked in page 1 for couple competitive keywords whereas the website A don't show up in the search at all. Why is that? Does B have better content and is more kw focused?
Moz Pro | | Ideas-Money-Art0 -
Tons of Crappy links in new OSE (Open Site Explorer)
I am starting to miss the old OSE. I've found that for a lot of the pages on our site, the new OSE is showing WAY more links and most of them are garbage nonsense links from China, Russia, and the rest of the internet Wild West. For instance, in the old OSE, this page used to show 9 linking domains: http://www.uncommongoods.com/gifts/by-recipient/gifts-for-him It now shows 454 links. Some of the new links (about 5 of them) are legitimate. The other 400+ are garbage. Some are porn sites, most of them don't even open a web page, they just initiate some shady download. I've seen this for other sites as well (like Urban Outfitters) This is making it much harder for me to do backlink analysis on bc I have no clue how many "Normal" links they have. Is anyone else having this problem ? Any way to filter all this crap out ? See attached screenshot of the list of links I'm getting from OSE. NHXnn
Moz Pro | | znotes1 -
Why is Open site Explorer showing: No Data Available for this URL
Hi there, Im having a few problems getting my site www.incarmotorfactors.co.uk up and running on SEOMoz and im not sure what im doing wrong.Firstly seomoz shows 2 links for my site... Which is wrong. Google shows alot more. However the most noticable problem so far is Opensite explorer. When i type in the web address it shows "No Data Available for this URL" The site is more then a year old and has a few links, can anybody tell me what the problem may be?
Moz Pro | | Ev840