AWS Summit Tel Aviv 2016: Using Amazon CloudWatch Events, Lambda & Spark to Process EC2 Events

Published on Jul 14, 2016

Learn More: - - - - - - - - - - - - - - - - - Session Language: English Earlier this year, AWS introduced Amazon CloudWatch Events, a feature allowing customers to track changes to their AWS resources, such as Amazon EC2 lifecycle and Auto Scaling events. The purpose of this presentation is to show you how to route these events to an AWS Lambda function (which could be also responsible for initialization or cleanup tasks). Then, the function will push events to Kinesis Firehose for storage in Amazon S3, where they will be processed by a Spark Streaming job running in Amazon EMR. Who knows, this might give you some ideas to build a new real-time monitoring and alerting system.