Is there a tool that I can use to scrape and see metatags?
-
Looking for a tool that allows me to scrape the websites off a page listing of Google and output a spreadsheet with the websites and their related meta-tag details (mainly title tag). Is there a tool out there that can conveniently allow me to do this?
-
Thanks for everyone's responses! Matt-Antonino, I'll look to implement that solution. Appreciate it!
-
Thanks for sharing Matt-Antonino.
That's good to know!
-
You can do this fairly easily with ImportXML in Google docs or xpath in Excel.
This is the guide that got me started:
https://www.distilled.net/blog/distilled/guide-to-google-docs-importxml/
If you use Chrome, finding the xpath is fairly simple and then you can just add it to your list.
The other way to do this is use Seer's Top 30 Results Scraper alongside the SEO Tools Excel plugin:
http://www.seerinteractive.com/blog/google-scraper-in-google-docs-update
In Excel tools simply use =htmltitle() and get the info you need.
-
Also keep in mind that search engines will change the title displayed in the SERP based on your query, so if you just get the info presented in the SERP, you may not be seeing the actual title tag.
-
Agreed Donna! It would be nice if Screaming Frog did that but it doesn't. I'm not sure of any existing tools that would do that.
You can run each site from the SERP through Screaming Frog to get all that data exported but that would take a good amount of time!
-
I don't think you can use Screaming Frog for that. It will certainly give you a ton of information about a single website, but it doesn't allow you to scrape Google search results and derive meta data for the top X results. Unless I'm missing something....
-
Screaming Frog is a great tool for this.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does anyone know of a tool where you can get all of the keyword that any given landing page is ranking for?
I'd like to find out what landing pages are ranking for which keywords, but I haven't been able to find a tool that does it. I was hoping there would be something where I could submit the url and get a list of every keyword it is ranking for. Any thoughts or suggestions? Thanks!
On-Page Optimization | | Powerblanket0 -
How can I redirect anything after the article url to main article?
Hello everyone, When someone visits my websites article like http://www.website.com/article-title/lol , it give to 404 page error. But when someone http://www.website.com/article-title/ , it shows the article. The word "lol" can be changed to anything. I would like that to be redirected to the main article. Example: Someone visits website.com/article-title/lol, they should be redirected to website.com/article-title/ Is it possible to do so? If yes, please tell me how. Note: I'm using WordPress Thank you
On-Page Optimization | | hakhan2011 -
Can we use internal no-follow links without negatively affecting rankings
we are creating a site structure for a travel website. the site homepage has a top navigation bar with 8 top level links and a total link count of 33 links in this (within menus). There are also 10 footer and ad-hoc links As this top navigation bar is a site-wide navigation, when entering s specific "travel destination" page, the "travel destination" page has its own contextual links and reference links, making the total inks on the destination page approx 107. do you think its ok to make all links in the top navigation bar no follow on all pages except the homepage? how would you approach this to create less links to maintain effective link-juice flow to required pages
On-Page Optimization | | Direct_Ram0 -
Use of trademarks in tags and text
Does Google spider read registered trademarks (the 'R' or 'TM') or do these marks impede anything if they are featured in meta tags or text?
On-Page Optimization | | KnutDSvendsen0 -
Tool To Search For Duplicate Content
Hi Is there such a tool that can be use to search a website for duplicate content? Thanks
On-Page Optimization | | Bossandy0 -
How can I get on-page analysis reports ?
I started trying out seomoz' facilities as a way to give myself a checklist of things to do-and-don't while learning SEO. Faced with a ton of new and interesting information, I started optimizing my home page and writing some content that can tell a story to people in my business. So I started using on-page analysis tools. But the campaign opening screen is telling me to wait for reports approx. two weeks. There are some reports ( not so good ones, a lot to improve ) but not the one I need most: the on-page analysis one. I set up two campaigns and I have the same problem for both. Am I doing something wrong ? Can I change my pages to make this work ?
On-Page Optimization | | wiebe0 -
Does Google still see masked domains as duplicate content?
Older reads state the domain forwarding or masking will create duplicate content but Google has evolved quite a bit and I'm wondering if that is still the case? Not suggesting that a 301 is not the proper way to redirect something but my question is: Does Google still see masked domains as duplicate content? Is there any viable use for domain masking other than for affiliates?
On-Page Optimization | | TracyWeb0 -
Best meta tite - description writing tool
Hi I am in the process of writing meta titles and meta descriptions for a clients product portfolio. I have the complete list exported from the cms system in to excel. I know I can add some clever logic to build the meta information but for this purpose I want to do this manually. Does anyone have a editor online or an excel sheet that shows you the charactor limits when writing the titles and descriptions. This would be handy if someone has, otherwise it's a case of having to write the excel sheet to do this, not that hard to do but i thought i'd ask the question.
On-Page Optimization | | seohive-2227200