Is there a tool that I can use to scrape and see metatags?
-
Looking for a tool that allows me to scrape the websites off a page listing of Google and output a spreadsheet with the websites and their related meta-tag details (mainly title tag). Is there a tool out there that can conveniently allow me to do this?
-
Thanks for everyone's responses! Matt-Antonino, I'll look to implement that solution. Appreciate it!
-
Thanks for sharing Matt-Antonino.
That's good to know!
-
You can do this fairly easily with ImportXML in Google docs or xpath in Excel.
This is the guide that got me started:
https://www.distilled.net/blog/distilled/guide-to-google-docs-importxml/
If you use Chrome, finding the xpath is fairly simple and then you can just add it to your list.
The other way to do this is use Seer's Top 30 Results Scraper alongside the SEO Tools Excel plugin:
http://www.seerinteractive.com/blog/google-scraper-in-google-docs-update
In Excel tools simply use =htmltitle() and get the info you need.
-
Also keep in mind that search engines will change the title displayed in the SERP based on your query, so if you just get the info presented in the SERP, you may not be seeing the actual title tag.
-
Agreed Donna! It would be nice if Screaming Frog did that but it doesn't. I'm not sure of any existing tools that would do that.
You can run each site from the SERP through Screaming Frog to get all that data exported but that would take a good amount of time!
-
I don't think you can use Screaming Frog for that. It will certainly give you a ton of information about a single website, but it doesn't allow you to scrape Google search results and derive meta data for the top X results. Unless I'm missing something....
-
Screaming Frog is a great tool for this.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Screaming Frog - What are your "go to" tasks you use it for?
So, I have just purchased screaming frog because I have some specific tasks that need completing. However, looking at Screaming Frog generally, there is so much information I was wondering for those who use it, what are the top key tasks you use it for. I mean what are your "go to" things you like to check, that perhaps are not covered by the Moz Crawl reports. Just looking for things I perhaps hadn't thought about, that this might be useful for.
On-Page Optimization | | TheWebMastercom0 -
New to MOZ and so far love tools but need some quick tips on title, keywords and descriptions
First of all:
On-Page Optimization | | nickcargill
I am excited about using all the MOZ tools! I just got back my webcrawl and have found
a lot of issues that I am working on. I am a Vacation Rental Property Manager with 150 properties, all different. 90% of my pages have the same keywords and descriptions and a lot of same page titles
too. I can change all of these by adding a few fields in my database and then
populating the meta information dynamically. For Example: <title>Big Bear Cabins | Big Bear Cabin Rentals - Chateau Alta Vista Cabin</title>
Chateau Alta Vista, Big Bear Cabins, Big Bear Cabin Rentals
Chateau ALta vista is a Big Bear Cabin with four bedrooms, three
bathrooms, it is Big Bear Luxury Property. If you notice the Title, keyword are dynamically populated from the database using the
property name of Chateau Alta Vista. The description is an extra field in the database that I just implemented that I can customize per property. I have a few questions, but here is more information: I also have 5 or 6 related pages
to each property. Pages Like general information, photos, calendars, book
Question 1): Is the best way of doing my titles, keywords and descriptions. Any concerns or recommendations. I have read, do not even use keywords anymore. Question 2) I have other pages that show maybe 8 or 10 photos. So is it ok to do the following; Title <photos of="" big="" bear="" cabin="" chateu="" alta="" vista<="" title="">Meta Keywords <photos of="" big="" bear="" cabins="" chateu="" alta="" vista="">Meta Description <check out="" photos="" of="" big="" bear="" cabin="" rentals,="" chateua="" <br="">Alta Vista, etc Currently, I have some archaic page naming with database driven url parameters such as</check></photos></photos> http://destinationbigbear.com/property_Detail_v.aspx?propid=669 and at worse http://destinationbigbear.com/Property_detail_v.aspx?propid=669&rate= $1,127.10&checkoutdate=07/13/2014&beds=4&firstnight=07/11/2014&nights=2 I do not have he ability to to full url encoding such as http://destinationbigbear.com/cabins/chateau-alta-vista but I can do http:/www.destinationbigbear.com/big-bear-cabin-info.aspx?cabin=chateau%alta%vista Question is what do I do... If I do change the page names I will lose the history of property_detail_V.aspx which only has a Page Authority of 21, but if I change the page name and dynamic navigation of my website will I not lose all my authorities, if so, is it worth doing it? My highest keyword ranking is 30 which is terrible. Nick0 -
Hi can anyone help me with navigating through my business admin page? having a little trouble. Many Thanks
It looks like this... The person that created it has put the term "Hand painted ceramics from spain - inspired ceramica" on every page title and i cant find where it is to delete it. If anyone can help that will be a real help. Many Thanks, Robbie oOU4YDY
On-Page Optimization | | allenr120 -
What automated tools produce a number score for A) On-Page Optimization and B) Domain Exact Match?
SEOMoz Community, -I currently use SEMRush, SEOMoz Open Site Explorer and Archive.org for the other Benefit and Opposition factors. -I’ve had to manually search pages for keyword use in the title, footer & body for on-page optimization. -I’ve also manually searched Google for Domain Exact Matches. Thanks! -Andrew
On-Page Optimization | | Todd_Kendrick0 -
Can I use Same Keyword for Multi pages Title Tags?
Hello All, I am working on client website and currently they are targeting One Keywords for multi pages. As I have search with Allintitle: Search query and Google display around 37 pages of website which carry same keyword in "Title Tags". I have told to client to change the "Title Tags" but they want that keyword for all relevant pages. So I want to know is that harm in Search Engine Ranking? Note: They have not done the link building activities for multi pages with same Keyword, they are using only in "Title Tags" only
On-Page Optimization | | jemindesai0 -
Using display: none in h1 tag
Hello, For the h1 tag on my landing page, I currently have 'Welcome to Edison Ford'. I was thinking of adding the keyword I'm targeting (property maintenance bristol) to the h1 tag which would look like this 'Welcome to Edison Ford Property Maintenance Bristol' Would it be a good idea to wrap the property maintenance bristol part in a span tag and add 'display: none;' to the styling? Thanks in advance.
On-Page Optimization | | PeterAllen910 -
Do you use <nofollow>and rel=nofollow?</nofollow>
I just read http://www.thoughtmechanics.com/does-nofollow-attribute-work-google-says-yes-studies-say-otherwise/ . Is it really better to avoid using nofollow for local links (from one site to itself)?
On-Page Optimization | | fleetway0 -
My blog title is getting added to my post title and I can't figure out how to remove it
Hello everyone, I am sure most of you guys know how to do this. I am finding that when my posts are listed in google, my blog title is added to my post title. 2 questions. 1. Is this hurting my rankings because the blog title is diluting my keywords making it look like I have a huge title? (the on page optimizer is dinging me for this. 2. I use a self hosted wordpress blog with the all in one seo plugin. Does anyone know how to remove the blog title from being appended to the post title? I thought I could do that in all in one seo by checking the rewrite title box and just having it say %post_title% but that didn't fix it. Also it was doing it before I checked that box as well. Any other ideas to try? Thanks
On-Page Optimization | | FastLearner0