Technical Question about tools available in market
-
Hi,
I am looking for a tool most probably web based tool like opensiteexplorer / majestic seo that gives me the list of URL
For example, on google we can do site:seomoz.org , and it's saying About 115,000 results.
I need to get list of those 115,000 URLS in any file whether it's csv or any other.
anybody care to share ?
-
SEOmoz use to have this option in the past days but recently when i checked its gone... but while research to answer this question i found this http://www.martinhurford.com/serp-downloader-bookmarklet.html
Check this out and see if it is powerful!
-
I agree that Screaming Frog is the best. http://www.screamingfrog.co.uk/seo-spider/
You can get a full list of URLs including data on the following:
- Errors – Client & server errors (No responses, 4XX, 5XX)
- Redirects – (3XX, permanent or temporary)
- External Links – All followed links and their subsequent status codes
- URI Issues – Non ASCII characters, underscores, uppercase characters, dynamic uris, long over 115 characters
- Duplicate Pages – Hash value / MD5checksums lookup for pages with duplicate content
- Page Title – Missing, duplicate, over 70 characters, same as h1, multiple
- Meta Description – Missing, duplicate, over 156 characters, multiple
- Meta Keywords – Mainly for reference as it’s only (barely) used by Yahoo.
- H1 – Missing, duplicate, over 70 characters, multiple
- H2 – Missing, duplicate, over 70 characters, multiple
- Meta Robots – Index, noindex, follow, nofollow, noarchive, nosnippet, noodp, noydir etc
- Meta Refresh – Including target page and time delay
- Canonical link element & canonical HTTP headers
- X-Robots-Tag
- File Size
- Page Depth Level
- Inlinks – All pages linking to a URI
- Outlinks – All pages a URI links out to
- Anchor Text – All link text. Alt text from images with links
- Follow & Nofollow – At link level (true/false)
- Images – All URIs with the image link & all images from a given page. Images over 100kb, missing alt text, alt text over 100 characters
Thanks
-
ScreamingFrog the best
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does Moz recognize rel next prev tags? Magento question
Howdy Mozzers! We are running a store in magento where we have many products in each category. Hence view all for category pages is not an option. We have applied rel next prev tags to our paginated pages in the following manner Example for page 2 in a category: The issue we are facing is that Moz suggests www.domain.com/category and www.domain.com/category?p=1 as duplicates, even though rel next prev tags are implemented. 1. Does nel next prev consolidate link juice?
Moz Pro | | MozAddict
2. Does Moz recognize the tags?
3. Will this work for us or should we implement canonical tags as well?0 -
Is There a Tool to Link Moz Keyword Rankings With Google Adwords Campaigns?
I wanted to know if there is a tool or other way to automatically link my Moz keyword rankings with my Google Adwords account for the purpose of allowing me to "pause" Adwords campaigns for keywords for which I rank well in the SERP's and to "activate" Adwords for keywords for which I do not rank well. Since these rankings can change from week to week, it would be great to be able to turn on and off Adwords for specific keywords depending upon my rankings that week.
Moz Pro | | hildebrandlaw0 -
Problem with the keyword difficulty tool
sorry if this has been asked/been written about previously, I had a search but couldn't find anything. I am using the keyword difficulty tool to narrow down on some keywords and whilst the % score for each keyword is being displayed, the Google Adwords data is blank. It just shows the animation as if it was pulling the data but after some ten mins or so not data is pulled, just the animation still running. Is there a problem with the tool or does the problem lay at my end? Thanks, Carl
Moz Pro | | Grumpy_Carl0 -
Www, non www, 301 redirects, Google webmaster tools & SeomozPro
arg! Any help on this topic would be greatly appreciated! This is in regards to sheffieldfurniture .com In October of 2011 I had our host set up a redirect for our site so all non www requests would be redirected to the www version and it works great (so it seems at least) Recently I signed up for SEOMOZPRO and when I started trying to track my organic results for various keywords I realized that Google has my site indexed in the non www format. Is this a problem? I’ve read you can tell google what your preferred domain is in Google Webmaster Tools, is that what I should be doing? Are there any negatives to doing that? I’m just confused as to why Google hasn’t noticed or acknowledged the redirect in 4 months. It makes me wonder if something isn’t working properly? I have since added a second SEOMOZPRO campaign with the non www version but I’m worried about having historical tracking issues if I then tell google to use the www version…
Moz Pro | | SheffieldMarketing0 -
Could SEOMOZ make a tool thats connected directly to Webmaster Tools?
Could SEOMOZ make a tool that Crawls Internal Links that's connected (or crawls) directly from Webmaster Tools? (So link metrics on our domains would get updates more often) This would eliminate the cost of crawling the entire internet. I hate having to wait a month to see updates on my domain metrics and links. I would like to see updates regularly on my own domain. I understand you can just look at Webmaster tools to see your latest links but they don't have any link metrics. So it’s difficult to see your best links. If this already exists please refer me? Otherwise please show your support for this being developed?
Moz Pro | | charles10 -
I need a tool/tools to extract keywords from say 50 sites in one niche and then check the rank tor those sites
This is for telemarketing of seo services I want to have some insight into an industry before I call them could this be done with the adwords keyword tool api and then exported to excel. It would also be nice to have data on backlinks say from seo moz opensite explorer.. Its just that the research you do before you even call a potential client is so time consuming and you can never really check to see how they are ranking for there main keywords manually. We are trying to automate as much of this initial research as possible... Any Idea's Thanks
Moz Pro | | duncan2740 -
On page optimisation tool issues
When viewing my campaign and looking at the on page optimisation tool, I have a few issues. I seems to only shows the keywords I want rankings for and how optimised my homepage is for those keywords. Is there any way I can get it to analyse permanently specifc keywords for specific pages because my homepage isnt optimised for some keywords which are on my list, which I have optimised other pages for, and because its looking at my homepage its getting a really low grade, and looks really bad and frustrates me because I cant work this out. Any help greatly appreciated.
Moz Pro | | CompleteOffice1 -
SEO pro tool ranking section
Hi, I look this morning on the rank checker for my site and it said 127 KW's had improved with 11 Declining. Just refreshed it..... 105 improved with 60 declining???? Why is this - i havent changed anything with the past wk!!!! thanks
Moz Pro | | wazza19850