Is there a tool that will find a string from the source code from a list of URLs?
-
I need a tool that will run through a long list of URLs (from multiple domains), look for a specific string in the source code and then produce a CSV showing in which URLs the the string was found.
This is for legitimate research, not for any nefarious purposes
Any ideas of such a tool already exists?
-
Cheers Dirk
Didn't know Screaming Frog could do that. Works perfectly!
Screaming Frog is just the gift that keeps on giving
-
+1 for Screaming Frog
-Andy
-
If you have the list of url's you want to check in csv you could use Screaming Frog: put the string in a custom filter & crawl the urls based on the list. Applying the filter will only include the url's that contain the string in the source code.
rgds,
Dirk
-
H Danny,
I have never used it but ScrapeBox has a page scanner that sounds like it would work.
http://www.scrapebox.com/page-scanner
Hope that helps,
Don
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is there a tool for finding shared interests?
Do you know know if a tool exists that shows shared common interests? For example, people interested in Soccer are also interested in Cricket, beer and Scarlett Johansson. The data might could come from social media or search queries. Anyone seen a tool that does anything like this?
Search Behavior | | richdan1 -
Google smacked my site and dropped all rankings, can't find out why
I have checked out everything, I mean everything. We have no dupe content, our content is a little thin, but it is ours and accurate enough to help our customers.We follow all SEO guidelines and make sure we de-index any pages with no / little content (like privacy, or faq) All in all, we haven't done any major updates to the sites, and everything was great (page one on almost all kw) but beginning of the month, all kw wiped to the second page, than third, than back to one and now pretty much gone (rank 100-200) I really don't know what to do. We didn't receive a manual action, and the last algo update was nothing big to cause such a drastic change. Meanwhile our competition (multiple sites) are gaining in ranks and nothing happened to them (most of them have even less content and not even SSL) Negative SEO is out of question, I check all links via ahrefs every other day. Any help is appreciated Thanks
Search Behavior | | s-s0 -
Canonical url for eshop, to do or not to do?
Hello everyone, I'm having a headache right now in designing a url base for a eshop. I would be thankful for any suggestions. Just to be clear about my problem, I'll be using this product example:
Search Behavior | | donatasBart
Product name: Product
Categories: Sale, Women
Brand: Superbrand Basicly every name of product, category or brand will resolve as url, if I enter url: /product it will open Product page /superbrand it will open brand page /superbrand/product will open product page from superbrand page /superbrand/sale/product would open product page selected from superbrand, then category sales /superbrand/woman/product would open product page selected from superbrand, then category woman So I will have many variations how to reach the product page, and of course i should set canonical url for it. I could set it just to /product , but then I don't know if I won't loose in terms of seo for other more detailed urls. Will google still index my other urls for product if i will state the canonical url in each product page? I know, maybe it would be the best solution to create a link like this: /superbrand_sale_product , which I can, but however it will be a duplicate content issue, since there will me many url pointing to the same product, and the only difference between them will be category, brand or whatever else... Thanks for all your ideas!0 -
Disallow robots on a url effect?
Hello, I am using wordpress and on some of my top tag urls e.g : http://www.designzzz.com/tag/brushes/ there is an avg page rank of 4. I was reading somewhere that my huge jump in not selected count in index status in GWT is becuase of tags/categories urls. So i added disallow in my robots.txt for the url /tag What sort of effect will it have on my tag urls rankings or PR ?
Search Behavior | | wickedsunny10 -
Will creating sub folders for foreign versions of the website, remove rank juice from the main site?
Hi, We plan to create sub-folders for our german, spanish and italian language versions. If we do will this pass rank juice to the new sites, but at the same time badly effect our main site, regards link juice/serp? Or is this not such a huge factor in people's experience? Many thanks. James.
Search Behavior | | Quime1 -
Two sites with different URLs
I help organize an ecommerce site for a company that is named after the state that the company was founded in (ex: Florida Pipes). Our programmer is thinking about creating a duplicate site that would have a name that was more location agnostic so people shopping on the site would not think that they may be ordering from far away hence incurring extra shipping charges. He said that the site would only have a different URLs, name and homepage but would link to all of the same stuff that is on the site that is up now. He said that there would be no way to tell (possibly for the layperson) that the two sites were related. Is this a good practice? Would we be penalized in search results for having two URLs linking to the same content? (We are a 30 year old company that ranks very high for our main keyword) Thank you for your input!
Search Behavior | | Winoman0 -
Google Webmaster Tools notice of detected unnatural links to our website
Hi, We have been using SEOmoz for a good few months now and have found it incredibly useful. Unfortunately however I think we may have slipped up a little bit as we have just received the following message in our Google Webmaster Tools: Google Webmaster Tools notice of detected unnatural links to http://www.refreshcartridges.co.uk/ I have a funny feeling I might know what the problem is but I'd like a confirmation before I potentially go off on a wild goose chase. We also own the domain name www.computerarticles.co.uk and recently started introducing the author at the bottom of the post along with both a link to the website homepage and a link to a deep, popular page on our website. For example, check out http://www.computerarticles.co.uk/twitter-time-saving-tools/ We genuinely didn't realise this was a bad thing and thought it would just provide Google with a way of deep linking straight in to popular areas of our site. I would really appreciate advice as to whether you think it might be these links that are causing the problem or whether there is something else that could be causing the problem. In the event it is these links that are causing the issue would you recommend removing the entire 'about the author' page (as we have published around 500 pages on that site) and simply put a link in the blog roll or simplify it to just link to the homepage. I appreciate in advance any help you could give. Regards Chris
Search Behavior | | ChrisHolgate0 -
Where can I find research into consumer behavior in URL input?
I have a hypothesis that the % of users that type URLs is decreasing. Instead I think users will be arriving at sites by clicking on links in emails, search and social. Where can I find data / research to back me up?
Search Behavior | | TomCritchlow0