Technical Question about tools available in market
-
Hi,
I am looking for a tool most probably web based tool like opensiteexplorer / majestic seo that gives me the list of URL
For example, on google we can do site:seomoz.org , and it's saying About 115,000 results.
I need to get list of those 115,000 URLS in any file whether it's csv or any other.
anybody care to share ?
-
SEOmoz use to have this option in the past days but recently when i checked its gone... but while research to answer this question i found this http://www.martinhurford.com/serp-downloader-bookmarklet.html
Check this out and see if it is powerful!
-
I agree that Screaming Frog is the best. http://www.screamingfrog.co.uk/seo-spider/
You can get a full list of URLs including data on the following:
- Errors – Client & server errors (No responses, 4XX, 5XX)
- Redirects – (3XX, permanent or temporary)
- External Links – All followed links and their subsequent status codes
- URI Issues – Non ASCII characters, underscores, uppercase characters, dynamic uris, long over 115 characters
- Duplicate Pages – Hash value / MD5checksums lookup for pages with duplicate content
- Page Title – Missing, duplicate, over 70 characters, same as h1, multiple
- Meta Description – Missing, duplicate, over 156 characters, multiple
- Meta Keywords – Mainly for reference as it’s only (barely) used by Yahoo.
- H1 – Missing, duplicate, over 70 characters, multiple
- H2 – Missing, duplicate, over 70 characters, multiple
- Meta Robots – Index, noindex, follow, nofollow, noarchive, nosnippet, noodp, noydir etc
- Meta Refresh – Including target page and time delay
- Canonical link element & canonical HTTP headers
- X-Robots-Tag
- File Size
- Page Depth Level
- Inlinks – All pages linking to a URI
- Outlinks – All pages a URI links out to
- Anchor Text – All link text. Alt text from images with links
- Follow & Nofollow – At link level (true/false)
- Images – All URIs with the image link & all images from a given page. Images over 100kb, missing alt text, alt text over 100 characters
Thanks
-
ScreamingFrog the best
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
API for On Page tool
I'm looking for a tool similar to On Page Grader (Moz) or Focus Keyword (Yoast) with API. We are building out or internal CRM system. Even though none of these tools can replace manual on page analysis, it will be used as a metric and to catch human mistakes.
Moz Pro | | OscarSE0 -
Any Other PAID Keyword Difficulty Tool?
Why is The Keyword Difficulty Tool so unreliable? Anyone know of another PAID Keyword Difficulty Tool? Right now I feel like I am getting ripped off for $99 a month for a tool that I have no confidence in...PLEASE HELP ANYONE
Moz Pro | | Local-Interactive0 -
How to change a Discussions post to a Question
I've opened two discussions recently but they really happen to be more like questions. They were both answered but both posts are still opened : http://www.seomoz.org/q/reading-suggestions-for-a-local-french-small-biz-website http://www.seomoz.org/q/should-i-block-wordpress-archive-and-tag How can I change them back to Question so I can mark them as close? Thanks 🙂
Moz Pro | | Akeif0 -
Crawl test tool from SEOmoz - which URLs does it actually crawl?
I am using for the first time the crawl test tool from SEOmoz and I do not really understand which URLs the tool is going to crawl. First, it says "enter any subdomain" --> why can´t I do the crawl for the root domain? Second it says "we'll crawl up to 3,000 linked-to pages" --> does that mean that the tool crawls all internal links that it can find on the given domain? Thanks for your help!
Moz Pro | | Elke.GetApp0 -
Internal link question - compared with my competitors
Dear all, I started to working on SEO on my website http://www.techstation.it and I have some thing that I would clarify. I see a lot of differences between internal links of my website and my competitors that usually are placed a bit better. (Please check attached image). They have A LOT of internal links, about 2.000+ instead 137 (mine), that's wrong in my SEOMOz dashboard. Every news and article page has 120-130 links to other contents. About teh external followed links: Mine: 1,674 #1: 2,018 #2: 316 (????) - this is placed really good for some competitive keywords #3 (best ranked): 7,905 links I have two more points that I would fix: Articles ranking We were one of the first 5-6 website that published at the launch day the review of Intel Core i7 3960X CPU and started with a ranking in the last first page results, a few days alter in the second and now we are at the end of the second page. This happens .. I think... every time 😕 All my article pages are graded with "A grade" in the control panel. So what should I do for increase my rankings? Thank you very much in advance! Alex
Moz Pro | | techstation0 -
DVD not available
Hi there, i do not manage to find how to buy your DVD set ? There is a page but no product to buy ... http://www.seomoz.org/store/4 Thanks
Moz Pro | | Sindicic_Alexis0 -
Clearing the Tool Reports You've Run
Is there anyway of clearing the 'Tool Reports You've Run' list on the Pro Dashboard, or setting certain reports not to be saved here?
Moz Pro | | BigMiniMan0 -
Way to Avoid Local Results in Keyword Difficulty Tool
I'm trying to use the Keyword Difficulty Tool to research some keywords. However, I keep getting local Seattle results in the SERPs. For example, if I search for "guitar lessons". At least 4 of the 10 results seem to be Seattle based (I guess because of SEOMoz ip addresses). Is there a way to eliminate local results?
Moz Pro | | nixforsix0