Text Scraping Tool
-
Can anyone recommend an easy to use website or tool (ideally free) to scrape all the visible text from a website to use for SEO/SEM keyword research?
Thanks as always MOZ friends!
-
Thanks for the info - and of course always for good and not evil with these types of tools. What I'm hoping to do is just enter a URL, have it scrape the site, and then dump all of the text on the site into a document to put into a keyword density tool to gain perspective on new partner websites for industries where we are entering for the first time. All for SEO, content ideas, learning about value propositions and services as well as for keyword ideas for SEM.
Looks like doing some programming might be the best way to go here - was hoping someone may have already built this kind of functionality!
Thanks again!
-
If you know a bit of programming you can go to GitHub and find some basic python code to build a custom web scrapper and format it to grab html. Or Screaming frog and Scrapebox might do the trick. But use with care and don't abuse them.
Hope that helps some.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Are there free tools that would tell me the cpc for my keywords?
If not what tools do you recommend to use to get an accurate cpc $ for estimating budget?
Paid Search Marketing | | lina_digital0 -
Does having redirects in a Adwords text ad destination URL hurt quality scores?
I recently noticed that one of my clients had several redirects in their Adwords text ad destination URLs. I updated the destination URLS to land on the final location (thereby losing all the text ad history). However I'm wondering if this could have any impact on the text ad quality scores (none of them were disapproved).
Paid Search Marketing | | RosemaryB0 -
Can I dynamically add city name to my PPC ad text and URL based on the user's search?
I have looked into DKI (Dynamic Keyword Insertion), but have not found a solution and thought that some excellent Mozzer might be able to help. Here is the idea: We have landing pages for hundreds of cities. The local content on each of these cities changes page to page, however the keywords that we are going after are the same. So, I am trying to create a dynamic ad group that looks something like this: Headline: {City Name} {Keyword} Description: We cover {City Name} {Keyword}, get more info now! URL: http://www.website.com/{City Name} Please let me know if you can assist with this, B
Paid Search Marketing | | Reis_Inc.0 -
Why doesn't exact match appear to be working for me in Google AdWords tool?
Hi guys, I recently read Rand's article here and tried out the exact match symbols on my keywords. However, these don't appear to be working for me as the results aren't showing up as they do in the above SEOmoz article (attached screenshot). What am I doing wrong? Google_AdWords__Keyword_Tool-20130511-115528.jpg.jpg?resizeSmall&width=832
Paid Search Marketing | | featherseo0 -
Curious about Adwords keyword tool results.
Why the Google Adwords Keywords tool says there are 0 local monthly searches for a keyword or shows a dash, but in spite of this there's competition for those keywords (up to 0.42 in some cases) ? Thanks!!
Paid Search Marketing | | gerardoH0 -
Best keyword traffic analysis tool for long tail search terms?
Please bare with me, this might turn into a bit of a waffle, but I'll get to my question... I promise! I've just been looking at our CPC traffic for April and 2 search terms jumped out at me. I recognised them from previous keyword research because they are search terms that I expected to be high traffic (from past experience), but Google Adwords keyword tools showed them to have no potential traffic, and next to no potential traffic (literally 0 local searches and 12 local searches per month). Last month search term A had 46 visits, with 19:25 average time on site and 8.70% bounce rate and search term B had 10 visits with 14:47 average time on site and 0% bounce rate. For very boring reasons we are not currently able to measure conversions on these terms since (they are related to consumer finance and when a customer applies for finance it is all done on our finance providers website) but despite the low volume, these are pretty good figures for on site behaviour and so it got me thinking... Is there a more accurate tool to estimate traffic volume that we should be using rather than the Adwords tools? I appreciate that the estimates are probably made based on historic search behaviour and April's traffic could just be a one off, but these particular terms used to be insanely popular 4-5 years ago when I worked at a competing company.
Paid Search Marketing | | DWJames1 -
Recommended tools for PPC competitive intelligence?
Do you guys have any tools you recommend for spying on your PPC competition? Trying to figure out which competitive intelligence tool offers the most value. http://searchengineland.com/tips-for-spying-on-your-ppc-competitors-89988
Paid Search Marketing | | qlkasdjfw0 -
Tools to Discover the Keywords Competitors are Buying in Adwords
Is there a tool that you can use to find out what words a competitor is using for google adwords?
Paid Search Marketing | | jaredspencer1
