Is there a tool that will find a string from the source code from a list of URLs?
-
I need a tool that will run through a long list of URLs (from multiple domains), look for a specific string in the source code and then produce a CSV showing in which URLs the the string was found.
This is for legitimate research, not for any nefarious purposes
Any ideas of such a tool already exists?
-
Cheers Dirk
Didn't know Screaming Frog could do that. Works perfectly!
Screaming Frog is just the gift that keeps on giving
-
+1 for Screaming Frog
-Andy
-
If you have the list of url's you want to check in csv you could use Screaming Frog: put the string in a custom filter & crawl the urls based on the list. Applying the filter will only include the url's that contain the string in the source code.
rgds,
Dirk
-
H Danny,
I have never used it but ScrapeBox has a page scanner that sounds like it would work.
http://www.scrapebox.com/page-scanner
Hope that helps,
Don
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google web master tool - stats
Hello everyone! I have 2 questions : 1. does anyone come across this behavior ? (image 1). In the last week Page crawled per day behavior was quite wild and it wasn't affect directly on Time spent downloading a page. 2. I'm getting site map warning for high response time (image 2) i have 29M pages so I aware that 4 warning for 4 pages is almost negligible but still ? Thanks to all helpers 8OkgXp7 q3txRAb q3txRAb
Search Behavior | | Roi_Bar1 -
Is it better to find a page without the desired content, or not find the page?
Are there any studies that show which is best? If you find my page but not the specific thing you want on it, you may still find something of value. But, if you don't you may associate my site with poor results, which can be worse than finding what you want at a competitor site. IOW maybe it is best to have pages that ONLY and ALWAYS have the content desired. What do the studies suggest? I'm asking because I have content that maybe 1/3 of the time exists and 2/3 of the time doesn't...think 'out of stock' products. So, I'm wondering if I should look into removing the page from being indexed during the 2/3 or should keep it. If I remove it then my concern is whether I lose the history/age factor that I've read Google finds important for credibility. Your thoughts?
Search Behavior | | friendoffood0 -
When Googling site:mydomain.com what does listing order tell us?
To find all the pages on my site that are indexed by Google I can search using site:mydomain.com and it gives pages of results. But what does the order of results relate to? Is it page rank or strength? My list of pages doesn't appear to be in order of strength. And it's definitely not by age or alphabetical...
Search Behavior | | GregB1230 -
Would you instinctively mistrust a company that has the top 5 or more search listings?
I have seen a few "lucky"(?) companies dominate spots 1-5 of search results. When I see that, I generally go to #6, 7, or even 10 before clicking. My gut reaction is that the company with 1-5 has manipulated content just to pull me in - much like the guys on the streets of NYC or Vegas shoving handbills at you. Is there any evidence/research/poll about the consumer/user reaction when this occurs?
Search Behavior | | AMSVansSEOTeam0 -
Disvow Tool Question
Please forgive me if this is a silly question but I am an online retailer not an SEO man, If I was to upload a file with all the links I thought were spam links on and some weeks later I thought some of them were good links, if I uploaded another file with all of what I thought were good links removed would Google start taking these into account?
Search Behavior | | Palmbourne0 -
Google Webmaster Tools notice of detected unnatural links to our website
Hi, We have been using SEOmoz for a good few months now and have found it incredibly useful. Unfortunately however I think we may have slipped up a little bit as we have just received the following message in our Google Webmaster Tools: Google Webmaster Tools notice of detected unnatural links to http://www.refreshcartridges.co.uk/ I have a funny feeling I might know what the problem is but I'd like a confirmation before I potentially go off on a wild goose chase. We also own the domain name www.computerarticles.co.uk and recently started introducing the author at the bottom of the post along with both a link to the website homepage and a link to a deep, popular page on our website. For example, check out http://www.computerarticles.co.uk/twitter-time-saving-tools/ We genuinely didn't realise this was a bad thing and thought it would just provide Google with a way of deep linking straight in to popular areas of our site. I would really appreciate advice as to whether you think it might be these links that are causing the problem or whether there is something else that could be causing the problem. In the event it is these links that are causing the issue would you recommend removing the entire 'about the author' page (as we have published around 500 pages on that site) and simply put a link in the blog roll or simplify it to just link to the homepage. I appreciate in advance any help you could give. Regards Chris
Search Behavior | | ChrisHolgate0 -
Where can I find research into consumer behavior in URL input?
I have a hypothesis that the % of users that type URLs is decreasing. Instead I think users will be arriving at sites by clicking on links in emails, search and social. Where can I find data / research to back me up?
Search Behavior | | TomCritchlow0 -
"If a company has multiple practice areas, are there any advantages to having specialized local listings for each specific practice area?"
Hello Staff of SEOMoz! I just had a question regarding specialized local listings. Are there any advantages to having specialized local listings? (An example would be if we were a medical company, having a listing for family practice, one listing for women's health) If there are advantages, what are those advantages compared to having general medical listings? Thanks!
Search Behavior | | sixspokemedia0