Is there a tool to automatically gather website SEO data?
-
I am looking for a tool that will crawl a website and create a spreadsheet listing out all key data such as title, meta description, etc.
Anyone know of an available tool to do that?
-
+1 for Screaming Frog.
Paid version can do more more depth/links etc, but definitely worth it. Can even build a Sitemap for you if needed. A must in any SEOs toolbox.
Dan
-
One more tool to share.
http://www.internetmarketingninjas.com/seo-tools/google-sitemap-generator/
This is just an online version. Punch in your URL and hit submit.
I wouldn't hesitate to download Screaming Frog though, as I mentioned earlier. It is a fantastic tool that you will use a ton.
-
Check out SEO powersuite, that has a tool which will pull out quite an indepth seo report, it will also brand it with your logo aswell ready to send to clients.It doesn't export a spreadsheet though.
I don't use it anymore, however I did like its ability to create reports for clients.
-
Use Screaming Frog for this. It's a free tool and is very easy to use. Simply enter the URL to spider and hit start.
It will go through the site and create a spreadsheet listing of the pages, status code, Title, Title length, meta description and more.
The tool works on both PC and Mac. Download it here: http://www.screamingfrog.co.uk/seo-spider/
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Important updates on Google Analytics Data Retention and the General Data Protection Regulation (GDPR)
Hi Everyone, I'm sure many of you received the email from Google over the past few days with the subject line: [Action Required] Important updates on Google Analytics Data Retention and the General Data Protection Regulation (GDPR). I hope I'm not alone in not knowing what exactly this whole notification was in regards to. I realize it's for Data but are we no longer able to pull stats from the past? If anyone has a "dumbed down" explanation for what this update entails, I would be very interested - I don't want to miss out on any important updates and info, but I'm just not grasping this content. Below is the full email in its entirety for those who are interested as well: Dear Google Analytics Administrator,
Reporting & Analytics | | MainstreamMktg
Over the past year we've shared how we are preparing to meet the requirements of the GDPR, the new data protection law coming into force on May 25, 2018. Today we are sharing more about important product changes that may impact your Google Analytics data, and other updates in preparation for the GDPR. This e-mail requires your attention and action even if your users are not based in the European Economic Area (EEA).
Product Updates
Today we introduced granular data retention controls that allow you to manage how long your user and event data is held on our servers. Starting May 25, 2018, user and event data will be retained according to these settings; Google Analytics will automatically delete user and event data that is older than the retention period you select. Note that these settings will not affect reports based on aggregated data.
Action: Please review these data retention settings and modify as needed.
Before May 25, we will also introduce a new user deletion tool that allows you to manage the deletion of all data associated with an individual user (e.g. site visitor) from your Google Analytics and/or Analytics 360 properties. This new automated tool will work based on any of the common identifiers sent to Analytics Client ID (i.e. standard Google Analytics first party cookie), User ID (if enabled), or App Instance ID (if using Google Analytics for Firebase). Details will be available on our Developers site shortly.
As always, we remain committed to providing ways to safeguard your data. Google Analytics and Analytics 360 will continue to offer a number of other features and policies around data collection, use, and retention to assist you in safeguarding your data. For example, features for customizable cookie settings, privacy controls, data sharing settings, data deletion on account termination, and IP anonymization may prove useful as you evaluate the impact of the GDPR for your company’s unique situation and Analytics implementation.
Contract And User Consent Related Updates
Contract changes
Google has been rolling out updates to our contractual terms for many products since last August, reflecting Google’s status as either data processor or data controller under the new law (see full classification of our Ads products). The new GDPR terms will supplement your current contract with Google and will come into force on May 25, 2018.
In both Google Analytics and Analytics 360, Google operates as a processor of personal data that is handled in the service.
• For Google Analytics clients based outside the EEA and all Analytics 360 customers, updated data processing terms are available for your review/acceptance in your accounts (Admin ➝ Account Settings).
• For Google Analytics clients based in the EEA, updated data processing terms have already been included in your terms.
• If you don’t contract with Google for your use of our measurement products, you should seek advice from the parties with whom you contract.
Updated EU User Consent Policy
Per our advertising features policy, both Google Analytics and Analytics 360 customers using advertising features must comply with Google’s EU User Consent Policy. Google's EU User Consent Policy is being updated to reflect new legal requirements of the GDPR. It sets out your responsibilities for making disclosures to, and obtaining consent from, end users of your sites and apps in the EEA.
Action: Even if you are not based in the EEA, please consider together with your legal department or advisors, whether your business will be in scope of the GDPR when using Google Analytics and Analytics 360 and review/accept the updated data processing terms as well as define your path for compliance with the EU User Consent Policy.
Find Out More
You can refer to privacy.google.com/businesses to learn more about Google’s data privacy policies and approach, as well as view our data processing terms.
We will continue to share further information on our plans in the coming weeks and will update relevant developer and help center documentation where necessary.
Thanks,
The Google Analytics Team6 -
How do I track specific referral traffics journey through a website?
Hello, A client has asked us to track the journey each separate referral traffic visitor takes through out the website. I have had a look through analytics and am not sure how to ensure I can do this for all referral traffic visitors? Can anyone help? Thank you.
Reporting & Analytics | | mblsolutions0 -
Mismatch between analytics and webmaster tools
Hi, I've noticed that the Queries report in analytics gives a completely different answer (for impressions, clicks, CTR, Avg. position) to webmaster tools. What gives? Which would you use? Thanks, Amelia
Reporting & Analytics | | CommT0 -
False Conversion Data in GA
Hi all, I have a problem with Conversion Tracking in Google Analytics. Our contact form conversion completes when the user hits the Thank You page. Yesterday we had an increase in conversions that didn't correlate to form submission emails. It appears that one person filled out our form, then returned (hit the back button?) to the Thank You page another 8 times as there were 8 entrances to the Thank You page and it's currently no indexed. Is there a way to prevent this from happening? Or should I just note in Analytics that the Conversion data is wrong for that day and note how many? Thanks!
Reporting & Analytics | | nsauser0 -
Anyone else having webmaster tools delays?
My errors just stopped updating on April 25. Everything else is updating normal, did something change/
Reporting & Analytics | | EcommerceSite0 -
The client's website serves as the main referral?
Hi mozzers, I have this weird case where one of my client's first referral is its own website!! I am really confused especially that I have checked there www vs non www and the non www is redirected to the www. This means that it resolve to one version which is good! Any thoughts on why the main referral is its own site? Thanks
Reporting & Analytics | | Ideas-Money-Art0 -
Interpreting Keyword Difficulty Tool results
I have been running various reports using the Keyword Difficulty tool. The columns are color coded - are there one set of signals that are more important than others? I am trying to analylze why we are ranking where we are and where our competitors are weak enough to overcome in a short term. I cannot seem to find a formula for the top indicatators for moving up in ranking. One of my sites in ranking number 5 but is neck and neck with the number one site for results. The other site is number 6 for the same term but has virtually no strength in the data like links, mozrank, trust, Social, etc...The sites 7-10 are much stronger on data. Maybe since they are from the same C block that helps? Any advice or experience would be helpful.
Reporting & Analytics | | devonkrusich0 -
Data Overload! So . . . ..Confused . . .. !
Just when I think I'm starting to get it . . . info comes in that blows my mind. I'm using several tools at SeoMoz and others trying to keep track of my link building success, which has been largely me registering at related industries bulletin boards and forums and posting as well as making sure we are listed properly in any and all sites listing companies in our industry etc. I have to say I was a little frustrated with the results. I had seen SOME increase in the back links, but almost no move in the number of linking domains. NOW I just logged into googles webmaster tools . . . and their data says I have more than DOUBLE the number of linking domains as any other sites are suggesting. What's going on here? I can understand slight discrepancies due to when they crawl the data etc . .. but 22 linking domains compared to 9-10 from everyone else? What the heck?
Reporting & Analytics | | damon12120