Technical Question about tools available in market
-
Hi,
I am looking for a tool most probably web based tool like opensiteexplorer / majestic seo that gives me the list of URL
For example, on google we can do site:seomoz.org , and it's saying About 115,000 results.
I need to get list of those 115,000 URLS in any file whether it's csv or any other.
anybody care to share ?
-
SEOmoz use to have this option in the past days but recently when i checked its gone... but while research to answer this question i found this http://www.martinhurford.com/serp-downloader-bookmarklet.html
Check this out and see if it is powerful!
-
I agree that Screaming Frog is the best. http://www.screamingfrog.co.uk/seo-spider/
You can get a full list of URLs including data on the following:
- Errors – Client & server errors (No responses, 4XX, 5XX)
- Redirects – (3XX, permanent or temporary)
- External Links – All followed links and their subsequent status codes
- URI Issues – Non ASCII characters, underscores, uppercase characters, dynamic uris, long over 115 characters
- Duplicate Pages – Hash value / MD5checksums lookup for pages with duplicate content
- Page Title – Missing, duplicate, over 70 characters, same as h1, multiple
- Meta Description – Missing, duplicate, over 156 characters, multiple
- Meta Keywords – Mainly for reference as it’s only (barely) used by Yahoo.
- H1 – Missing, duplicate, over 70 characters, multiple
- H2 – Missing, duplicate, over 70 characters, multiple
- Meta Robots – Index, noindex, follow, nofollow, noarchive, nosnippet, noodp, noydir etc
- Meta Refresh – Including target page and time delay
- Canonical link element & canonical HTTP headers
- X-Robots-Tag
- File Size
- Page Depth Level
- Inlinks – All pages linking to a URI
- Outlinks – All pages a URI links out to
- Anchor Text – All link text. Alt text from images with links
- Follow & Nofollow – At link level (true/false)
- Images – All URIs with the image link & all images from a given page. Images over 100kb, missing alt text, alt text over 100 characters
Thanks
-
ScreamingFrog the best
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Duplicate content report - question on best practice
Hello all, New to MOZ Pro and SEO - so lots to get my head round! I’m working through the Duplicate Content section of the Crawl report and am not sure what the best practice is for my situation. Background: We are a reference guide for luxury hotels around the world, but the hotels that are featured on the site vary year on year. When we add a new hotel page, it sets up the url as ourwebsite.com/continent/country/regionORcity/hotel. When the hotels come off, I redirect their URL to the country or region where we have other hotels. Example: http://www.johansens.com/europe/switzerland/zermatt/ The hotel in Zermatt has come off the site, showing 0 results on this landing page. Question: My duplicate content report is showing a number of these regional pages that are displaying the copy “0 places - Region’ because the hotel has come off, but the landing page is still live. Should I redirect the regional page back to the main country page? And then if I add a new hotel to the site from that region in the future, simply remove the redirect? Should I also delete the page? Any tips would be much appreciated!
Moz Pro | | CN_Johansens0 -
Can you create in the Keyword Difficulty Tool several separate reports?
If I go now to the Keyword Difficulty Tool and submit keywords, I get one list with all keywords (let's say 300), but I have actually say 30 keywords per segment/niche I wan't to view. Is is possible to have 10 separate reports?
Moz Pro | | TrendDevelopment1 -
I am experimenting with Raven Tools and have a question
Since I am an in-house SEO I'm a little slower to adopt some of the paid tools out there, but I am thinking of jumping in and opting for the paid version of Raven Tools. Can anyone who's currently using Raven Tools suggest how and where is the best place to export backlinks info for import into the Link Manager? I want something that will give me as much of the data as possible already filled in (i.e. PR, domain authority, anchor text, follow/no follow information etc.). I don't mind if I have to rearrange it, I just don't want to have to be inputting things like PR and anchor text one at a time by hand. I do have SEOMoz pro and I see that I can pull a CSV of backlinks and do two separate reports, one for followed and one for not followed links, etc. I'm just wondering if anyone has any additional suggestions. How about Ahrefs.com? Is anyone using the paid version of that tool in conjunction with Raven Tools for Link Management? Is there a better tool out there for Link Management than Raven Tools? (I just found this link in a Q & A thread for an open source SEO panel to try...http://www.seopanel.in/ - anyone using that one?) Thanks all!
Moz Pro | | danatanseo0 -
SEOmoz tools: Keyword Difficuty + On-page Analysis
To analyse the current KWD situation. I would want to see the top 10 results link metrics (as in Keyword Difficulty & SERP Analysis) and each page's On page score (as in On-page Analysis) for the keyword. Those two figures would give me a pretty good picture of the current situation. Kind regards,
Moz Pro | | OscarSE0 -
Why cant I hook up facebook to SEO Moz Campaign Tool?
Greetings from the digital epicentre otherwise known as Wetherby Uk 😉 I want to track sentiments ie mentions, slurs fliratations of a brand on Facebook. So to start out with I thought 'Id hook up SEO moz social tracking service as illustrated here: http://i216.photobucket.com/albums/cc53/zymurgy_bucket/cant-add-facebook-url.jpg But whilst i could add my twitter account I caount not add my favebook page:http://www.facebook.com/david.honan.98I added david.honan.98 in the url box and a number of other versions but none successfully hooked up. Am enetering the wrong url or is SEO moz socail media facebook plugin jinxed? Thanks in advance, David
Moz Pro | | Nightwing0 -
Two Questions
1) The PA in the SEOmoz toolbar for ldnwicklesscandles.com/scentsy-uk/ is completely different to http://www.ldnwicklesscandles.com/scentsy-uk. I think in link building I've occasionally left the / off and vice versa. Is google seeing these as two different sites and how can I combine the two so the PA is no longer different? I initially tried a 301 redirect from the less PA to the higher one but it didn't work. Suggestions please. I'm trying to rank for the term Scentsy UK. Was told on here that it was unnecessary to get a .co.uk and that if I just link build for my scentsy-uk site which I have been doing. Woke up this morning and my page ldnwicklesscandles.com/scentsy-uk was no where to be seen on Google. I can still do site: and Link: for my main .com and I'm still ranking first page for other things so don't think I've been penalised at all. However when I try the site: and link: on the .com/scentsy-uk its no where to be found. There was no messages in Google webmaster tools either. Is this an algorithm thing or have I been penalised? Also....its now pulling up <cite>www.ldnwicklesscandles.com/blog/tag/scentsy-uk</cite> for the higher ranking results. Have I confused google with having this blog tag as well? Any suggestions to help would be appreciated. Losing a lot of sleep on this website at the moment. x
Moz Pro | | cmjolley0 -
In Site Explorer My Blog.URL.com Shows "No Data Available for this URL"
Why when I use http://www.opensiteexplorer.org and I'm researching our Blog.URL.com's does the tool say "No Data Available for this URL"? Example: http://www.opensiteexplorer.org/links?site=blog.centurypayments.com
Moz Pro | | cfield_splashmedia.com0 -
Is there a beginners guide to using the tools and what do the results mean.
Great set of tools! But what would make them better is some type of guide to what the tools do (remember I am a new user) and how to maximize the results. Oh and while your at it what do the results mean.
Moz Pro | | marcreece0