What is the best way to scrape serps for targeted keyword research?
-
Wanting to use search operators such as "KEYWORD inurl:blog" to identify potential link targets, then download target url, domain and keyword into an excel file. Then use SEOTools to evaluate the urls from the list. I see the link aquisition assistant in the Moz lab, but the listed operators are limited.
Appreciate any suggestions on doing this at scale,
thanks!
-
Thanks a bunch, Lavellester. Just finished Tom's post - exactly what I needed.
I appreciate your help,
H
-
Hi,
If I remember correctly this post by Tom Critchlow about agile SEO hacks should get you moving in the right direction.
Hope it helps.
L
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
ROI on Policing Scraped Content
Over the years, tons of original content from my website (written by me) has been scraped by 200-300 external sites. I've been using Copyscape to identify the offenders. It is EXTREMELY time consuming to identify the site owners, prepare an email with supporting evidence (screen shots), and following up 2, 3, 15 times until they remove the scraped content. Filing DMCA takedowns are a final option for sites hosted in the US, but quite a few of the offenders are in China, India, Nigeria, and other places not subject to DMCA. Sometimes, when a site owner takes down scraped content, it reappears a few months or years later. It's exasperating. My site already performs well in the SERPs - I'm not aware of a third party site's scraped content outperforming my site for any search phrase. Given my circumstances, how much effort do you think I should continue to put into policing scraped content?
Intermediate & Advanced SEO | | ahirai1 -
Slug best practices?
Hello, my team is trying to understand how to best construct slugs. We understand they need to be concise and easily understandable, but there seem to be vast differences between the three examples below. Are there reasons why one might be better than the others? http://www.washingtonpost.com/news/morning-mix/wp/2014/06/20/bad-boys-yum-yum-violent-criminal-or-not-this-mans-mugshot-is-heating-up-the-web/ http://hollywoodlife.com/2014/06/20/jeremy-meeks-sexy-mug-shot-felon-viral/ http://www.tmz.com/2014/06/19/mugshot-eyes-felon-sexy/
Intermediate & Advanced SEO | | TheaterMania0 -
Best way to fix 404 crawl errors caused by Private blog posts in WordPress?
Going over Moz Crawl error report and WMT's Crawl errors for a new client site... I found 44 High Priority Crawl Errors = 404 Not Found I found that those 44 blog pages were set to Private Mode (WordPress theme), causing the 404 issue.
Intermediate & Advanced SEO | | SEOEND
I was reviewing the blog content for those 44 pages to see why those 2010 blog posts, were set to private mode. Well, I noticed that all those 44 blog posts were pretty much copied from other external blog posts. So i'm thinking previous agency placed those pages under private mode, to avoid getting hit for duplicate content issues. All other blog posts posted after 2011 looked like unique content, non scraped. So my question to all is: What is the best way to fix the issue caused by these 44 pages? A. Remove those 44 blog posts that used verbatim scraped content from other external blogs.
B. Update the content on each of those 44 blog posts, then set to Public mode, instead of Private.
C. ? (open to recommendations) I didn't find any external links pointing to any of those 44 blog pages, so I was considering in removing those blog posts. However not sure if that will affect site in anyway. Open to recommendations before making a decision...
Thanks0 -
Best way to permanently remove URLs from the Google index?
We have several subdomains we use for testing applications. Even if we block with robots.txt, these subdomains still appear to get indexed (though they show as blocked by robots.txt. I've claimed these subdomains and requested permanent removal, but it appears that after a certain time period (6 months)? Google will re-index (and mark them as blocked by robots.txt). What is the best way to permanently remove these from the index? We can't use login to block because our clients want to be able to view these applications without needing to login. What is the next best solution?
Intermediate & Advanced SEO | | nicole.healthline0 -
The right way for review count?
Hi, I have a question that kinda bothers me for a while now and would love to hear you guys thoughts on this matter. One of the categories in my websites is services reviews, for example:
Intermediate & Advanced SEO | | Ouzan
http://www.websiteplanet.com/review/questionform/ Recently we upgraded the site and gave users the option to write their own review as well. Now as you can see, the way it works is that we write a very big and informative/professional review ourself and in addition we give users the option to write their own reviews and share their experience with the service. Now My question is:
There is the itemprop-review count thingy, now we did it so if 0 users wrote a review it will show 0 reviews on the count.
Is it correct? (Feel free to check the site code yourself)
Or is it wrong? because their is actually 1 review (our editors review) I hope I explained my self well...
If not, please let me know what is unclear. Thanks!0 -
Price Range: Top Notch Keyword Research
How many years would someone need to have to be experienced enough to provide a thorough job of providing me with keyword research? I am willing to pay for the best job but I don't want to be taken to the cleaners...especially by someone that may not be giving me the best effort or that is not qualified. ( I was just quoted $200 an hour from an 18 yr old today) We are getting ready to change our URL's and add keywords but I am not sure which terms to add and in what order. I have heard put the most important words first but I am not sure which are the most important. 🙂 By my research we only have about 5 keywords but I am not sure. (Excluding long tail)
Intermediate & Advanced SEO | | Boodreaux0 -
Best way to de-index content from Google and not Bing?
We have a large quantity of URLs that we would like to de-index from Google (we are affected b Panda), but not Bing. What is the best way to go about doing this?
Intermediate & Advanced SEO | | nicole.healthline0 -
Keyword Self-Cannibalization
Hi, Happy Friday! I was advised to look at the SEO strategy of a UK SEO company and copy a technique they used, however, I have doubts that this technique is any good. So mydomain.com targets My Domain For my main keyword phrase, I was told to place a link to a newly created inner page in my footer, targeting the main keyword and on this page, create unique content which points back to my homepage. Now I also have mydomain.com/my-domain.php which has a link to mydomain.com with anchor text My Domain. Based on the SEOMoz reports, this now seems to be Keyword Self Cannibalisation and I think that it is diluting link juice and the value of my SEO on my homepage for this term rather than helping. Can you advise if this technique is wrong?
Intermediate & Advanced SEO | | tdsnet0