What is the best way to scrape serps for targeted keyword research?
-
Wanting to use search operators such as "KEYWORD inurl:blog" to identify potential link targets, then download target url, domain and keyword into an excel file. Then use SEOTools to evaluate the urls from the list. I see the link aquisition assistant in the Moz lab, but the listed operators are limited.
Appreciate any suggestions on doing this at scale,
thanks!
-
Thanks a bunch, Lavellester. Just finished Tom's post - exactly what I needed.
I appreciate your help,
H
-
Hi,
If I remember correctly this post by Tom Critchlow about agile SEO hacks should get you moving in the right direction.
Hope it helps.
L
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Keyword cannibalization
Hi, I have two questions regarding keyword cannibalization. 1. I am doing the SEO for a website that sells do-it-yourself packages for heating, bathrooms, ventilation and so on for new houses or for renovations. The most important pages are the product pages (e.g. example.com/products/bathrooms) but there is also a blog divided into categories per product (e.g. example.com/category/bathrooms). The difference is clear: the product page focuses on the product itself, and the blog category page contains all blog posts relating bathrooms (tips, new materials, new innovations,...). My question is if the product page and blog category page can compete with each other for the term bathrooms (although they have different content). Does it help or is it enough to direct internal links from separate blog posts to the most important page (being the product page) and back to avoid my category blog page to compete with my product page? Another possibility would be to use a canonical tag on the category page pointing to the product page, but this actually isn't good practice because it isn't really duplicate content. Third possibility would be to no index the category page. So what is the best solution of the three? 2. A second example of keyword cannibalization can be category archive pages for webshops. If you have a category page example.com/jeans and a subcategory page example.com/jeans/women, is it useful to optimize on both pages for different terms, being jeans for the first page and jeans for women for the second, or will Google not make this distinction because the keyword are too closely related? In other words, is it useful to write content specifically for jeans for women and make a landing page for this keyword, or will this page compete with the category page that has been optimized for just the keyword jeans? In large clothing webshops, you can see for example that there is an optimized page for Nike (content, headings,...) but not for Nike for women or Nike for men. Is this just laziness or is this done exactly to avoid keyword cannibalization? Looking forward to your comments!
Intermediate & Advanced SEO | | Mat_C0 -
Same language, Different countries. What would be the best way to introduce it?
Hello, We have a .com magento store with the US geo targeting We're going to launch a different versions soon, one for the US, and another one for Canada (we're going to add a Spanish and French versions later as well) The stores content will be same, except currency and contact us page. What would be a better strategy to introduce it to Google? What is better URL structure? example.com/ca/ , example.com/en-ca/ , or ca.example.com/ ? Should we stay with the original www.example.com/ (example.com) and just close an access to /ca/ and /us/ / or use rel=canonical / or use "alternate" hreflang to avoid duplicate content issues? Thanks in advance
Intermediate & Advanced SEO | | Meditinc.com0 -
URL Change Best Practice
I'm changing the url of some old pages to see if I can't get a little more organic out of them. After changing the url, and maybe title/desc tags as well, I plan to have Google fetch them. How does Google know that the old url is 301'd to the new url and the new url is not just a page of duplicate content? Thanks... Darcy
Intermediate & Advanced SEO | | 945010 -
Advanced SEO - What would you do after you run out of keywords?
Hello! Our company has been growing in terms of traffic and ranking well for a couple of years but we are now kind of stagnating because we just don't know what to do next. We have a good blog - and with our blogs, we have been targeting all major keywords with their related keywords as a bucket. - "keyword theme / page" for a long time. But it seems we now don't have any major keyword theme to write about. What is worse is that we don't see any traffic growth since 2014 September. (although we added many good blogs) So what would do you when you run out of keywords? or keyword themes? Would you just keep pumping in more blogs and hope that you get more clicks? or at some point, you just don't care about keywords and write whatever relevant to your site? Wouldn't it hurt our site if we create similar keyword themed pages? (like regurgitating our keywords?) or even same keyword targeting pages? You must have similar experience if you are an owner of a niche site. Can you please share your experience with this kind of headaches? Thank you and look forward to your comments.
Intermediate & Advanced SEO | | joony3 -
Massive SERP crash
I came in this morning to a swath of email updates from Moz. Our site had jumped in ranking in the four geographic regions we target and we were seeing (more or less) the best results we've ever had. Most of the jumps were only 1 - 4 places but they were for our most competitive keywords. Late this afternoon I did some spot checks on keywords to confirm that we were still holding roughly in the same positions and before I reported this to the wider business. We're not. What's more we have dropped off the first page for some terms and don't seem to be ranked at all for for others. The only keywords we're getting good rankings for are branded search terms. I can only assume this is due to a technical issues over the weekend our developers caused. I'm not completely across this but I at some point our sitemaps stopped working and a huge number of links on the site were broken. Could a massive surge in 404s cause this? I'm checking google analytics and I can't see a drop in organic traffic yet although I don't have the full figures for today. Thanks
Intermediate & Advanced SEO | | ahyde0 -
List of Best SEO forums
Could I please get some input on a list of the best SEO forums out there besides SEOmoz? (Both mainstream and non mainstream)
Intermediate & Advanced SEO | | Luia0 -
What are the best way to get a new subdomain ranked properly
Our main site (blog with 700 high quality articles) ranks pretty well and we recently launced a rapidly growing forum (55.000 posts in the first 11 weeks) on a subdomain. What would be a good strategy for ranking the forum quickly
Intermediate & Advanced SEO | | xpd1 -
Should I Decrease My Keyword Density
On SEOmoz's On-page tool it is telling me that I should cut the number of phrases for a specific key phrase almost in half, from 27 to 15. However my keyword density for this page is only 1.68%. I would have thought that was a good keyword density to have, if not even a little higher. Should I trust the tool and decrease this keyword phrase? Would love to hear from anyone with experience in this. If you want to see the page it is http://www.mybluedish.com/. The key phrase is "satellite internet"
Intermediate & Advanced SEO | | MyNet0