Technical Question about tools available in market
-
Hi,
I am looking for a tool most probably web based tool like opensiteexplorer / majestic seo that gives me the list of URL
For example, on google we can do site:seomoz.org , and it's saying About 115,000 results.
I need to get list of those 115,000 URLS in any file whether it's csv or any other.
anybody care to share ?
-
SEOmoz use to have this option in the past days but recently when i checked its gone... but while research to answer this question i found this http://www.martinhurford.com/serp-downloader-bookmarklet.html
Check this out and see if it is powerful!
-
I agree that Screaming Frog is the best. http://www.screamingfrog.co.uk/seo-spider/
You can get a full list of URLs including data on the following:
- Errors – Client & server errors (No responses, 4XX, 5XX)
- Redirects – (3XX, permanent or temporary)
- External Links – All followed links and their subsequent status codes
- URI Issues – Non ASCII characters, underscores, uppercase characters, dynamic uris, long over 115 characters
- Duplicate Pages – Hash value / MD5checksums lookup for pages with duplicate content
- Page Title – Missing, duplicate, over 70 characters, same as h1, multiple
- Meta Description – Missing, duplicate, over 156 characters, multiple
- Meta Keywords – Mainly for reference as it’s only (barely) used by Yahoo.
- H1 – Missing, duplicate, over 70 characters, multiple
- H2 – Missing, duplicate, over 70 characters, multiple
- Meta Robots – Index, noindex, follow, nofollow, noarchive, nosnippet, noodp, noydir etc
- Meta Refresh – Including target page and time delay
- Canonical link element & canonical HTTP headers
- X-Robots-Tag
- File Size
- Page Depth Level
- Inlinks – All pages linking to a URI
- Outlinks – All pages a URI links out to
- Anchor Text – All link text. Alt text from images with links
- Follow & Nofollow – At link level (true/false)
- Images – All URIs with the image link & all images from a given page. Images over 100kb, missing alt text, alt text over 100 characters
Thanks
-
ScreamingFrog the best
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Are there any free (or paid) tools available online that download Meta Tags for ALL URL's of a website?
Hi, I am looking to run an On-Site audit for a website and I'm wondering if there are any tools available online that take the existing Meta Tags on ALL pages of a website and downloads them to a .CSV or .XLS. Would need Meta Title and Meta Description for all pages at the very least. Any suggestions are appreciated - looking for Free or Paid options. Thanks.
Moz Pro | | SEO5Team0 -
On-page grader question
Hi there, Getting to know the Pro tools and can't find an answer to this. Can someone explain for me please? Using on page grader, I found a couple pages with an F. I scrolled downWTO where it shows the keyword phrases and under each, the URL. Clicking on the first keyword "Building site alarms"it tells me off essentially for not optimising the page for that term. The URL is "construction site security systems" which are different to building site alarms which also have their own page. I don't understand why is Moz associating this keyword with this page? I certainly haven't told it to. Please he
Moz Pro | | DaddySmurf0 -
How to un-answer a question?
Being new here I'm pressing all sorts of buttons and breaking things... I posted a question, liked someone's answer so click "good answer" thinking it was like a "thumbs up" but it actually set my question to "answered". How does one set their own question to un-answered?
Moz Pro | | eatyourveggies1 -
Another link profile tool available
SEOMoz Link Analysis tool apparently doesn't have any info on my clients site - www.tricitymech.com according to the response from Open Site Explorer. Is there a free tool available that doesn't use OSE that you could recommend?
Moz Pro | | DenverKelly0 -
SEO Moz Tools - too many on the page links result driving me nuts
A while back I remember Rand and I having a conversation about how many links on the page and up until that point I had followed the NO MORE THAN 100 links on a page rule - which is what the MOZ tools are telling me now in the campaigns I have running. But then during a seminar both of us were holding this 100 link rule question came up and Rand commented that this was probably old hat now as the search engines can crawl a much greater number of links in the page. I was encouraged by his answer especially where ecommerce websites are concerned. But the MOZ tool is driving me nuts telling me that this 100 link rule is still something to be adhered too. It is especially frustrating when we are discussing ecommerce website sites with editable mega menus. Examples to support this question are www.bohemiadesign.co.uk or www.flowersbuydelivery.co.uk which are 2 ecommerce sites I am aware of using such mega menus that are editable and give a link count greater than 100. and I am sure there are many more sites like this, even Amazon for example. So, how much notice do we take of this warning in MOZ tools that is telling me about excessive numbers of links on the pages it lists as needing corrected?
Moz Pro | | ICTADVIS0 -
Recommend SEOmoz PRO Tools on LinkedIn
Hey Moz Community, Because honest user reviews are the best way to inform people about SEOmoz PRO tools and benefits, we'd love for those of you who are on LinkedIn to leave a recommendation for our product: http://mz.cm/urHa1e If you do choose to leave a review, please be honest in what you say. Even if it's not 100% hearts & flowers, we'd rather you keep it real. Thanks!
Moz Pro | | EricaMcGillivray0 -
Looking for a tool that can pull OSE stats for a bulk amount of URLs
I know that people have developed inhouse tools with the OSE API that can analyze thousands of URLs and pull metrics like PA, inbound links, etc. I need to analyze about 80k URLs and sort them by authority and I was hoping that someone could point me to a tool that can do this or let me use their tool. I'm willing to pay for access to it. We could build it inhouse, I imagine that it would be pretty easy, but our IT resources are stretched too thin right now.
Moz Pro | | Business.com0 -
SEO pro tool ranking section
Hi, I look this morning on the rank checker for my site and it said 127 KW's had improved with 11 Declining. Just refreshed it..... 105 improved with 60 declining???? Why is this - i havent changed anything with the past wk!!!! thanks
Moz Pro | | wazza19850