Is there a tool that I can use to scrape and see metatags?
-
Looking for a tool that allows me to scrape the websites off a page listing of Google and output a spreadsheet with the websites and their related meta-tag details (mainly title tag). Is there a tool out there that can conveniently allow me to do this?
-
Thanks for everyone's responses! Matt-Antonino, I'll look to implement that solution. Appreciate it!
-
Thanks for sharing Matt-Antonino.
That's good to know!
-
You can do this fairly easily with ImportXML in Google docs or xpath in Excel.
This is the guide that got me started:
https://www.distilled.net/blog/distilled/guide-to-google-docs-importxml/
If you use Chrome, finding the xpath is fairly simple and then you can just add it to your list.
The other way to do this is use Seer's Top 30 Results Scraper alongside the SEO Tools Excel plugin:
http://www.seerinteractive.com/blog/google-scraper-in-google-docs-update
In Excel tools simply use =htmltitle() and get the info you need.
-
Also keep in mind that search engines will change the title displayed in the SERP based on your query, so if you just get the info presented in the SERP, you may not be seeing the actual title tag.
-
Agreed Donna! It would be nice if Screaming Frog did that but it doesn't. I'm not sure of any existing tools that would do that.
You can run each site from the SERP through Screaming Frog to get all that data exported but that would take a good amount of time!
-
I don't think you can use Screaming Frog for that. It will certainly give you a ton of information about a single website, but it doesn't allow you to scrape Google search results and derive meta data for the top X results. Unless I'm missing something....
-
Screaming Frog is a great tool for this.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can you transcribe your youtube video to just google?
YouTube videos have been very effective for us on our site. The only problem is they have taken part of a fair amount of our content so to google our pages may seem to have minimal content. Transcribing each video and including that on the page would take away from the look of the page and clutter it. Is there a way to let google know the content without having to include it on the page? You can find an example page at https://www.waikoloavacationrentals.com/halii-kai-rentals/
On-Page Optimization | | RobDalton0 -
Using Schema markup for Feefo reviews
I am a little confused about whether or not it is ok to use Schema markup with reviews collected through Feefo. We use Feefo to collect reviews from our customers and these get displayed on our website. We get service ratings as well as product ratings through Feefo. My question is: Is it ok to use Schema markup for these? I would have thought they would fall under 3rd party reviews, but this article from the Feefo website seems to suggest that it would be ok to use markup in the way they recommend. Can anyone confirm how Google handles review markup like this? Thanks in advance!
On-Page Optimization | | ViviCa10 -
can we include iframe content if we properly reference the source in the url?
can we safely include iframe content if we properly source the source url. eg we have a travel company we are looking to produce another website, but use the same hotel descriptions in the hotel directory. can we do this?
On-Page Optimization | | Direct_Ram0 -
Webmaster Tools - How your data is linked?
This may be an easy questions, but I can't seem to find the answer anywhere and I never really looked into it before. In google webmaster tools, in the dashboard there is the section that says "How Your Data Is Linked". What does that refer to? Is that just using internal link anchor text, external link anchor text or a combination of both? I am pretty sure that it is a combination of both, but I just want to make sure before making some internal link changes so that the most common anchor text is no longer "Prices" and "Sign up". Thanks.
On-Page Optimization | | rayvensoft0 -
Alt image tags not being read by on-page optimization tool
Can bots see the keyword among other words in aIt image tags? For example, if the keyword is upholstery leather and the image tag says "our upholstery leather collection" will the keyword be recognized? Another example is buy leather. I have a image tag on a slide that reads "free samples before you buy leather" but an on-page analysis in moz does not show an alt tag title for buy leather? Same problem with an moz on-page analysis of the term upholstery leather. Thanks! Hunter
On-Page Optimization | | leatherhidestore0 -
How long does it take for Google to see Changes to a site?
Hi, I have a low PR site (PR 1) that I am starting to work on. Ingeneral when you make changes to my site how long would it take Google to recognize and index those changes? The reason I am wondering is because the site I am working on had a lot of duplicate content (around 700 pages), I got rid of it all, but I wasn't sure how long it would take Google to spider all these pages and re-index them since the site is low PR. Thanks, Ken
On-Page Optimization | | Jason_3420 -
Some of my pages are ranking for terms which I want other pages to rank for. What can I do to effectively switch the ranking?
Some of the pages are ranking for terms I have optimised other pages for. The pages which are ranking are quite rightly falling, because they aren't optimised for the terms they're showing for. However, I have pages which are optomised for those terms. How do I switch the SERPS to the page I want?
On-Page Optimization | | GlobalLingo1 -
How to use good keyword URL to help main site
Hi. I'm a long time ecommerce guy and starting a third business. The main site URL is the name of the new business but I also purchased a .com URL that is our #1 keyword to target. So I need to know the best strategy to use the keyword url for helping with getting a top ranking for that keyword. I'm curious if I can or should build out the keyword URL site for the search engines and use a 301 redirect. Can you get top ranking for a site that just redirects? Anyway, I guess you get my question. This keyword gets a ton of perfectly targeted traffic so seems like a goldmine if I work it right. Thanks very much.
On-Page Optimization | | jimmyseo1