Technical Question about tools available in market
-
Hi,
I am looking for a tool most probably web based tool like opensiteexplorer / majestic seo that gives me the list of URL
For example, on google we can do site:seomoz.org , and it's saying About 115,000 results.
I need to get list of those 115,000 URLS in any file whether it's csv or any other.
anybody care to share ?
-
SEOmoz use to have this option in the past days but recently when i checked its gone... but while research to answer this question i found this http://www.martinhurford.com/serp-downloader-bookmarklet.html
Check this out and see if it is powerful!
-
I agree that Screaming Frog is the best. http://www.screamingfrog.co.uk/seo-spider/
You can get a full list of URLs including data on the following:
- Errors – Client & server errors (No responses, 4XX, 5XX)
- Redirects – (3XX, permanent or temporary)
- External Links – All followed links and their subsequent status codes
- URI Issues – Non ASCII characters, underscores, uppercase characters, dynamic uris, long over 115 characters
- Duplicate Pages – Hash value / MD5checksums lookup for pages with duplicate content
- Page Title – Missing, duplicate, over 70 characters, same as h1, multiple
- Meta Description – Missing, duplicate, over 156 characters, multiple
- Meta Keywords – Mainly for reference as it’s only (barely) used by Yahoo.
- H1 – Missing, duplicate, over 70 characters, multiple
- H2 – Missing, duplicate, over 70 characters, multiple
- Meta Robots – Index, noindex, follow, nofollow, noarchive, nosnippet, noodp, noydir etc
- Meta Refresh – Including target page and time delay
- Canonical link element & canonical HTTP headers
- X-Robots-Tag
- File Size
- Page Depth Level
- Inlinks – All pages linking to a URI
- Outlinks – All pages a URI links out to
- Anchor Text – All link text. Alt text from images with links
- Follow & Nofollow – At link level (true/false)
- Images – All URIs with the image link & all images from a given page. Images over 100kb, missing alt text, alt text over 100 characters
Thanks
-
ScreamingFrog the best
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is there a tool on Moz or out on the internet that does bad link checker
I'm still pretty new to this and I was wondering if there is a free software, one of Moz or free out on the the internet that allows you to check bad links. I've done a lot of link building with citations and directories that for my clients industry. I just don't want to add their website and profile to a bad/risky directory and it penalizes my clients. I've seen a few out there, but I need one that is respectable and reliable. Any suggestions? I found one called bad neighborhood http://www.bad-neighborhood.com/text-link-tool.htm. Thanks Again, Benny
Moz Pro | | ACann0 -
Migration tool from RavenTools
I like to migrate some web sites from RavenTools. Do you have any migration tool utility to do it?
Moz Pro | | awebdesign
what do you recommend agencies migrating from RavenTools to seomoz?
Thanks
Lewis0 -
Used a free WP theme and now Webmaster Tools has shown hundreds of broken links
Hello everyone, We've recently launched two new music instrument listing websites. One in the US http://www.yourinstrument.com One in AU http://www.yourinstrument.com.au While we're waiting for our custom, branded WP to be built, I went and put up one of the free themes with closely matching colors. Clearly, this was a mistake because now my WMT account has spit out around 200 'not found' errors and my Moz account is calling them around 282 'dupe page titles' and 'content'??? 1. Aren't WP outbound links supposed to be 'nofollow' ? / Why is my theme creating strange links? 2. Can I clean all these up with assigning rel=canonical to the original blog post? Do I need to wait for the new theme to be installed and then 301 the random URLs found by Moz and WMT ? weird link examples: http://imgur.com/Cm6pO5H Please help 😕
Moz Pro | | Beetlebum0 -
What is the best tool for checking do follow outbound links?
what is the best software for detecting "do follow" outbound links from my site? thanks all!
Moz Pro | | tm46150 -
Does SEOmoz have a tool to find mirror sites?
I heard from a company that is trying to get my clients SEO business that they discovered multiple sites mirroring our site's content. Does SEOmoz have a tool to find these websites? Or does Google?
Moz Pro | | thomas.wittine0 -
What SEO Tools Do You Use?
Things changed a bit for me when Raven Stopped using google and SemRush data and I haven't exactly found a solution I'm happy with so Just wanted to use what people use alongside SEOMoz, or what they use instead of certain parts of SEOMoz. Before I was using Raven Tools, Screaming Frog SEO Crawler but currently I'm using Screaming Frog SEO Crawler, SEOMoz (trial), and SerpIQ (trial).
Moz Pro | | GBabyWilson0 -
ETA On the Keyword Research Tool?
I'm trying to do some keyword research on Google UK but it hasn't been working for a couple of days now. I have a client waiting on a proposal that features this research heavily and might lose them if I can't use it soon! Is there any estimated time for the return of the service? Is the keyword tool down for everybody?
Moz Pro | | EssexGirl0 -
What is the best link building management tool ?
What is the best link building management tool that can automatically fill in content for submission for me, check whether my sites are submitted on other sites, propose new lists of submission sites, organize my link building (by date, anchor text, url, page rank, both back links, reciprocal, paid, etc), organize my social media profiles and connect them to each other ?
Moz Pro | | CretanDevelopments0