Technical Question about tools available in market
-
Hi,
I am looking for a tool most probably web based tool like opensiteexplorer / majestic seo that gives me the list of URL
For example, on google we can do site:seomoz.org , and it's saying About 115,000 results.
I need to get list of those 115,000 URLS in any file whether it's csv or any other.
anybody care to share ?
-
SEOmoz use to have this option in the past days but recently when i checked its gone... but while research to answer this question i found this http://www.martinhurford.com/serp-downloader-bookmarklet.html
Check this out and see if it is powerful!
-
I agree that Screaming Frog is the best. http://www.screamingfrog.co.uk/seo-spider/
You can get a full list of URLs including data on the following:
- Errors – Client & server errors (No responses, 4XX, 5XX)
- Redirects – (3XX, permanent or temporary)
- External Links – All followed links and their subsequent status codes
- URI Issues – Non ASCII characters, underscores, uppercase characters, dynamic uris, long over 115 characters
- Duplicate Pages – Hash value / MD5checksums lookup for pages with duplicate content
- Page Title – Missing, duplicate, over 70 characters, same as h1, multiple
- Meta Description – Missing, duplicate, over 156 characters, multiple
- Meta Keywords – Mainly for reference as it’s only (barely) used by Yahoo.
- H1 – Missing, duplicate, over 70 characters, multiple
- H2 – Missing, duplicate, over 70 characters, multiple
- Meta Robots – Index, noindex, follow, nofollow, noarchive, nosnippet, noodp, noydir etc
- Meta Refresh – Including target page and time delay
- Canonical link element & canonical HTTP headers
- X-Robots-Tag
- File Size
- Page Depth Level
- Inlinks – All pages linking to a URI
- Outlinks – All pages a URI links out to
- Anchor Text – All link text. Alt text from images with links
- Follow & Nofollow – At link level (true/false)
- Images – All URIs with the image link & all images from a given page. Images over 100kb, missing alt text, alt text over 100 characters
Thanks
-
ScreamingFrog the best
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Using Keyword Tool Results
I love the keyword tool for giving me direction and helping to prioritize. My question: Once I have the prioritized keywords, do you recommend having a page for each of the top keywords, using the keyword as the page name? Or is it better to sprinkle the keywords into existing pages? Thank you.
Moz Pro | | bhsiao0 -
Page authority questions?
I've been analyzing some IT communities ...in order to check how relevant is the page authority vs PageRank. I found one main site which is organized by "communities'..and every community is a sub-domain. The root domain has an authority of 90/100 which it should be great......so the sub-domains "inherit" part of this authority.... Until here everything seems to be perfect. However, I went deeper and I picked one of these communities. Analyzing the "Linking Root Domain" I discovered it only has only 5 root domains pointing to its home page. Those 5 Root Domains have generated more than 134k links. That doesn't seem to be "natural". Checking those 5 Root Domains I discovered that they have been registered by the same Root Domain site. Ex: Main domain: Domain.com Community1.domain.com Community2.domain.com.... Linking Root Domains: DomainXY.com DomainABC.com DomainRST.com DomainFGH.com DomainOPQ.com It seems to me that it is easy to cheat the authority domain score. Just creating others sites developing the same topic and generating back links to your main domain
Moz Pro | | SherWeb0 -
Local SEO Rankings Report Tools (based on several locations)?
Hi, Just a quick question. I am looking for a Rankings Report tool that allows a user to not only provide a list of Keywords, but also a list of Locations for which to check Google UK's ranking results. In practice, I would like to be able to enter 6 names of Towns next to my keyword list and get "localised results". Many thanks in advance, Cheers Greg
Moz Pro | | GregoryTK
PS: first Q within the Q&A, so please apologise for any potential "stupid questions"1 -
Reliable Social Metrics Tool
Hi, Does anyone know of a reliable social metrics tool? So far I've tried Open Site Explorer, Tom Anthony's tools and SEO Quake With each one of them I get very, very different numbers. Cheers, Carlos
Moz Pro | | Carlos-R1 -
Are there plans for an API for the keyword difficulty tool?
I don't know about everyone else, but this would make me one happy pro member!
Moz Pro | | davidangotti0 -
The "Social Media Monitoring" tool in research tools
I used this tool once and noticed it provided nice links to where listed keywords were posted in articles, forums, blogs, etc..., since that time @3 weeks ago... it lists an "error" to links and/or doesn't provide them in a linkable list below to access. Is this tool being worked on or will it be available in the future? Thank you.
Moz Pro | | tylersmcc0 -
Is there a tool that will show me where links with a given anchor text are coming from?
In OSE I can see how many links there are with a given anchor text, but I can't see where those links come from.
Moz Pro | | seocraig-3101770 -
Where can I view all of the Questions that I have Answered?
AFAICT there's no way to filter questions to the ones that you have answered. Is there any plan to implement a filter like this? I realise there are email notifications available but no easy way to just go back and check on your answers. No doubt I'm just missing something here so if I'm completely wrong, please point me in the right direction 🙂 Thanks very much!
Moz Pro | | NickPateman811