Technical Question about tools available in market
-
Hi,
I am looking for a tool most probably web based tool like opensiteexplorer / majestic seo that gives me the list of URL
For example, on google we can do site:seomoz.org , and it's saying About 115,000 results.
I need to get list of those 115,000 URLS in any file whether it's csv or any other.
anybody care to share ?
-
SEOmoz use to have this option in the past days but recently when i checked its gone... but while research to answer this question i found this http://www.martinhurford.com/serp-downloader-bookmarklet.html
Check this out and see if it is powerful!
-
I agree that Screaming Frog is the best. http://www.screamingfrog.co.uk/seo-spider/
You can get a full list of URLs including data on the following:
- Errors – Client & server errors (No responses, 4XX, 5XX)
- Redirects – (3XX, permanent or temporary)
- External Links – All followed links and their subsequent status codes
- URI Issues – Non ASCII characters, underscores, uppercase characters, dynamic uris, long over 115 characters
- Duplicate Pages – Hash value / MD5checksums lookup for pages with duplicate content
- Page Title – Missing, duplicate, over 70 characters, same as h1, multiple
- Meta Description – Missing, duplicate, over 156 characters, multiple
- Meta Keywords – Mainly for reference as it’s only (barely) used by Yahoo.
- H1 – Missing, duplicate, over 70 characters, multiple
- H2 – Missing, duplicate, over 70 characters, multiple
- Meta Robots – Index, noindex, follow, nofollow, noarchive, nosnippet, noodp, noydir etc
- Meta Refresh – Including target page and time delay
- Canonical link element & canonical HTTP headers
- X-Robots-Tag
- File Size
- Page Depth Level
- Inlinks – All pages linking to a URI
- Outlinks – All pages a URI links out to
- Anchor Text – All link text. Alt text from images with links
- Follow & Nofollow – At link level (true/false)
- Images – All URIs with the image link & all images from a given page. Images over 100kb, missing alt text, alt text over 100 characters
Thanks
-
ScreamingFrog the best
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Questions about travel industry keywords
My question is regarding my current learning of SEO and keyword research. I have been leaning towards Keyword Everywhere, SEMrush, and Google Keyword Planner for keyword research. What do you recommend? I know you might suggest Moz, but I'm looking for something that will enhance and help me find valuable keywords for the travel niche. If I sign up with Moz, will someone from the team help me with keyword research for the travel niche and my website? I haven't found any resources or lessons specifically focused on travel websites and their keywords.
Moz Pro | | RavenBhutan0 -
Duplicate content report - question on best practice
Hello all, New to MOZ Pro and SEO - so lots to get my head round! I’m working through the Duplicate Content section of the Crawl report and am not sure what the best practice is for my situation. Background: We are a reference guide for luxury hotels around the world, but the hotels that are featured on the site vary year on year. When we add a new hotel page, it sets up the url as ourwebsite.com/continent/country/regionORcity/hotel. When the hotels come off, I redirect their URL to the country or region where we have other hotels. Example: http://www.johansens.com/europe/switzerland/zermatt/ The hotel in Zermatt has come off the site, showing 0 results on this landing page. Question: My duplicate content report is showing a number of these regional pages that are displaying the copy “0 places - Region’ because the hotel has come off, but the landing page is still live. Should I redirect the regional page back to the main country page? And then if I add a new hotel to the site from that region in the future, simply remove the redirect? Should I also delete the page? Any tips would be much appreciated!
Moz Pro | | CN_Johansens0 -
Can Moz tools help me with this effort?
I want to brainstorm different keywords, look for high search volumes, and low competition. Then I want to create landing page, rank them using seo techniques, and collect optin email addresses so I can communicate with interested users and build helpful products. With all the moz tools available to us, how can I accomplish the above mentioned goal? Have you done some thing similar? What are your experiences? Am I talking pie in the sky? Are there any practical examples where all these steps were executed? Thanks
Moz Pro | | zsyed0 -
Ranking Tool
We are considering purchasing your complete suite. Our question is regarding your Ranking Tool. We currently subscribe to Market Samurai and they provide us with keyword ranking abilities tied to our internal pages. Our domain, www.wklaw.com has hundreds of internal pages. (86 areas of law, each with 5 pages). will your ranking tool match our keywords to our internal pages? or does it only provide us ranks for the main domain? Thank you.
Moz Pro | | Wallin_Klarich0 -
Keyword rankings are not updating from past two weeks? Is there any issue in SEOmoz tool ?
I have added 215 keywords to my account. From past two weeks i am waiting to see the rankings, however it's not updating.
Moz Pro | | Sasank0 -
Social Media Marketing
Hello People, I hope everyone is well, this is bugging me because I cannot figure it out, my old website which I still have up ranks on page 2 or 3 for the keywords "social media marketing edinburgh" but when I check the URL's in particular the SMM page: http://www.fentonit.co.uk/index.php?option=com_content&view=article&id=3 and I know the URL's a mess but we have resolved all these issues with the new co. setup. Anyway the On page optimization for this page is an F for this phrase, yet it ranks highly, I am greatly puzzled as to why. Can some one please help shed some light on this? Thanks to everyones who may kindly take the time to assist here. Craig www.fenwaymedia.co.uk
Moz Pro | | craig_sepperro.com0 -
Are header directives such as X-Robots and Link supported by OSE/Linkscape/SEOMoz tools?
SEOMoz tool reports show lots of duplicate content where there are http header directives in place on pages to eliminate dupes. Googlebot obeys but Roger the robot doesn't. Are header directives such as X-Robots and Link (rel=canonical) supported by OSE/Linkscape? I'd like to put my mind and clients at ease. Thanks
Moz Pro | | Mediatorr0 -
Onpage Optimization Tool - Optimize it? :)
I've been using your on-page optimization tool allot lately, I must say it simply is a great checklist to run a page through and it forces you to think about it a bit more and you notice stuff that you might otherwise have overlooked (read forgot) . But! ('cause there's always a but..) I have noticed a few issues: it could be optimized to recognize plural endings, given this is a hard one since there's allot of languages.. but It would be awesome if it did.. right? (just like the SE's do) I would be more then willing to help with the Danish. Since you already specify what version of google you wanna target eg: ".DK" it might not be all that hard to implement plural? now that we are mentioning other languages.. It would be equally sweet if it would see the correlation between Ø and OE, Å and ÅÅ and so on.. (scandinavian chars for those of you who don't know) again the SE's do For German letters I expect (not sure though, I'm not German, I speak it a bit though, so if your German feel free to correct me 🙂 that the SE's would see the letter Ö as an OE.. Ü as UE, Ä as an AE and so on. Why is the above important? well because that many still use those versions of the letters in URL's. Even though all browsers/mail clients now a'days are able to understand punycode.
Moz Pro | | ReneReinholdt1