Is there a tool that will find a string from the source code from a list of URLs?
-
I need a tool that will run through a long list of URLs (from multiple domains), look for a specific string in the source code and then produce a CSV showing in which URLs the the string was found.
This is for legitimate research, not for any nefarious purposes
Any ideas of such a tool already exists?
-
Cheers Dirk
Didn't know Screaming Frog could do that. Works perfectly!
Screaming Frog is just the gift that keeps on giving
-
+1 for Screaming Frog
-Andy
-
If you have the list of url's you want to check in csv you could use Screaming Frog: put the string in a custom filter & crawl the urls based on the list. Applying the filter will only include the url's that contain the string in the source code.
rgds,
Dirk
-
H Danny,
I have never used it but ScrapeBox has a page scanner that sounds like it would work.
http://www.scrapebox.com/page-scanner
Hope that helps,
Don
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Dark Traffic & Long URLs - Clarification
Hi everyone, I've been reading the 2017 report by Groupon and the 2017 article by Neil Patel r.e. dark traffic. Both of these articles work on the assumption that most long URLs are not direct traffic because people wouldn't type a long URL into their browser. However, what happens to me personally all the time is that I start typing a URL into the browser, and the browser brings up a list of pages I've visited recently, and I click on some super long URL that I didn't bookmark but have visited in the past. That is legitimate direct traffic, but it's a long URL. I'm just wondering if there's something flawed in my reasoning or in the reasoning of Patel and Groupon. Maybe most people aren't relying on browsers like I am, or maybe things have changed a lot in the past 3 years. What do you think? And are there any more recent resources/articles that you would recommend r.e. trying to parse out dark traffic? https://neilpatel.com/blog/dark-traffic-stealing-data/ Thanks!
Search Behavior | | LivDetrick0 -
Google web master tool - stats
Hello everyone! I have 2 questions : 1. does anyone come across this behavior ? (image 1). In the last week Page crawled per day behavior was quite wild and it wasn't affect directly on Time spent downloading a page. 2. I'm getting site map warning for high response time (image 2) i have 29M pages so I aware that 4 warning for 4 pages is almost negligible but still ? Thanks to all helpers 8OkgXp7 q3txRAb q3txRAb
Search Behavior | | Roi_Bar1 -
Direct 100+ URLs to our sister site?
Hi, We have two websites www.eurekasolutions.co.uk and www.eurekaaddons.co.uk - currently the eurekasolutions site has eureka addon products on it - we are thinking of re-directing these to www.eurekaaddons.co.uk instead (there are 100+ pages which are being ranked and picked up by google) Would it be foolish to re-direct these from eurekasolutions straight to eurekaaddons after them being on eurekasolutions for many many years? if so what is the best way to go about it and would this have a direct negative effect on our SEO? Both sites are serving for similar terms. Thanks,
Search Behavior | | EurekaSolutions0 -
Is it better to find a page without the desired content, or not find the page?
Are there any studies that show which is best? If you find my page but not the specific thing you want on it, you may still find something of value. But, if you don't you may associate my site with poor results, which can be worse than finding what you want at a competitor site. IOW maybe it is best to have pages that ONLY and ALWAYS have the content desired. What do the studies suggest? I'm asking because I have content that maybe 1/3 of the time exists and 2/3 of the time doesn't...think 'out of stock' products. So, I'm wondering if I should look into removing the page from being indexed during the 2/3 or should keep it. If I remove it then my concern is whether I lose the history/age factor that I've read Google finds important for credibility. Your thoughts?
Search Behavior | | friendoffood0 -
Tracking forwarding / vanity URLS
Buongiorno from 18 Degrees sunny wetherby UK 🙂 Am i right in thinking you can track a forwarding urls via Google analytics. Put another way if a site points www.kissmymelons.co.uk to www.lickmybanana.co.uk can you measure how many referrals where generated from kissmymelons.co.uk I'm 69% sure the referral data will appear in the referral source section in Google analytics but I need to be 100% sure 😉 Grazie tanto,
Search Behavior | | Nightwing
David0 -
Google Webmaster Tools notice of detected unnatural links to our website
Hi, We have been using SEOmoz for a good few months now and have found it incredibly useful. Unfortunately however I think we may have slipped up a little bit as we have just received the following message in our Google Webmaster Tools: Google Webmaster Tools notice of detected unnatural links to http://www.refreshcartridges.co.uk/ I have a funny feeling I might know what the problem is but I'd like a confirmation before I potentially go off on a wild goose chase. We also own the domain name www.computerarticles.co.uk and recently started introducing the author at the bottom of the post along with both a link to the website homepage and a link to a deep, popular page on our website. For example, check out http://www.computerarticles.co.uk/twitter-time-saving-tools/ We genuinely didn't realise this was a bad thing and thought it would just provide Google with a way of deep linking straight in to popular areas of our site. I would really appreciate advice as to whether you think it might be these links that are causing the problem or whether there is something else that could be causing the problem. In the event it is these links that are causing the issue would you recommend removing the entire 'about the author' page (as we have published around 500 pages on that site) and simply put a link in the blog roll or simplify it to just link to the homepage. I appreciate in advance any help you could give. Regards Chris
Search Behavior | | ChrisHolgate0 -
Can I use Google Analytics to find out actual times of visits during the day??
Hi, I'm a newbie at all this - I hope someone can help me. We're thinking of running time-specific offers to try and convert as many of our customer site visits as possible e.g. 15% discount if you call between, say, 2 and 5pm. It would be really helpful to me to find out what times of day people are visiting our site. I can't seem to find a way to do this on Google Analytics. Can anyone help? Thanks so much Sue
Search Behavior | | 3Amigos0 -
"If a company has multiple practice areas, are there any advantages to having specialized local listings for each specific practice area?"
Hello Staff of SEOMoz! I just had a question regarding specialized local listings. Are there any advantages to having specialized local listings? (An example would be if we were a medical company, having a listing for family practice, one listing for women's health) If there are advantages, what are those advantages compared to having general medical listings? Thanks!
Search Behavior | | sixspokemedia0