SparkPost: Using Lambda to Archive Data from Redis to S3

Published on Apr 16, 2018

Learn more at - http://amzn.to/2o4IjBt. In this video, Jason from SparkPost describes how he created a Lambda function to archive customer email event data from Redis to S3. The Lambda function, which is written in Node.JS, runs periodically, like a cron job, to take user email event data (open or click events) from Redis, batch it up then write it to S3. Jason describes how they dealt with some of the challenges involved, such as what chunk size to use when writing data to S3 and how to create a data index using the S3 object name. Host: Toby Knight, Manager, Solutions Architecture Speaker: Jason Sorensen, Lead Data Scientist Subscribe: More AWS videos http://bit.ly/2O3zS75 More AWS events videos http://bit.ly/316g9t4 #AWS


2021