Is there a tool that I can use to scrape and see metatags?
-
Looking for a tool that allows me to scrape the websites off a page listing of Google and output a spreadsheet with the websites and their related meta-tag details (mainly title tag). Is there a tool out there that can conveniently allow me to do this?
-
Thanks for everyone's responses! Matt-Antonino, I'll look to implement that solution. Appreciate it!
-
Thanks for sharing Matt-Antonino.
That's good to know!
-
You can do this fairly easily with ImportXML in Google docs or xpath in Excel.
This is the guide that got me started:
https://www.distilled.net/blog/distilled/guide-to-google-docs-importxml/
If you use Chrome, finding the xpath is fairly simple and then you can just add it to your list.
The other way to do this is use Seer's Top 30 Results Scraper alongside the SEO Tools Excel plugin:
http://www.seerinteractive.com/blog/google-scraper-in-google-docs-update
In Excel tools simply use =htmltitle() and get the info you need.
-
Also keep in mind that search engines will change the title displayed in the SERP based on your query, so if you just get the info presented in the SERP, you may not be seeing the actual title tag.
-
Agreed Donna! It would be nice if Screaming Frog did that but it doesn't. I'm not sure of any existing tools that would do that.
You can run each site from the SERP through Screaming Frog to get all that data exported but that would take a good amount of time!
-
I don't think you can use Screaming Frog for that. It will certainly give you a ton of information about a single website, but it doesn't allow you to scrape Google search results and derive meta data for the top X results. Unless I'm missing something....
-
Screaming Frog is a great tool for this.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can I reuse meta description tag on another site?
Hi....lets say i sell widgets and on my site i have redWidgets, blueWidgets and greenWidgets. Each of these widget page's has a meta description tag that seems to help click through. I now have a different site that would like to do a right up about each widget and will dedicate a independent page to each widget. Can i safely provide them with the original meta descriptions (from my original site) for each widget i have on my site to then use on these "right up" pages (as they seem to work well and are informative of the subject matter). I am not sure if this is a seo issue or not. I would think not but would appreciate any input. thank you
On-Page Optimization | | nomad-2023230 -
We use Bigcommerce and want to make changes to our mobile site
Our current mobile site does not show the banners we use on the desktop site. Can anyone tell us how we can change the mobile site to show these banners.
On-Page Optimization | | CostumeD0 -
Duplicate content shown in Google webmaster tools for 301 redirected URLs.
Why does Google webmaster tools shows 5 URLs that have been 301 redirected as having duplicate meta descriptions?
On-Page Optimization | | Madlena0 -
Should you use Plural version of a keyword or singular
H If kw research shows that singular version of a keyword has higher search volume than plural version should you still use plural version in main on-page areas to try and catch both instances or focus on the singular ? cheers dan
On-Page Optimization | | Dan-Lawrence0 -
Anyone know of a tool to monitor site for outgoing links?
Is there any type of tool that can monitor a large website's outgoing links? I'm dealing with a huge site and was hoping there was something available that could check outgoing links without having to go through each page manually. (I'm looking to remove anything that links to a bad neighborhood). Thanks.
On-Page Optimization | | cakelady0 -
Can you help with quality and interesting content ideas?
Hi I'm ranking for "online biology degree" and "online wildlife biology degree" but I have bad content and I receive almost 100% bounce rate. Can you help me with ideas on good content and interesting information I can provide for people looking for "online wildlife biology degree" and "online biology courses" "biology degree online" Every idea would be appreciated. Yoseph
On-Page Optimization | | Joseph-Green-SEO0 -
Can PDFs on your website be picked up in search engines?
Can PDFs on your website be picked up in search engines? There's a ton of info online that says it can and can't be picked up.
On-Page Optimization | | JennH0 -
Is it ok to use encoded special characters in meta titles?
I've read blog posts stating that encoding special characters in title tags is both ok and not ok. Any definitive answer out there? Do the extra characters from adding encoding count towards the total number of characters that Google displays in SERPs? Or do they just count as one character?
On-Page Optimization | | BostonWright0