Big Data on AWS introduces you to cloud-based big data solutions such as Amazon EMR, Amazon Redshift, Amazon Kinesis and the rest of the AWS big data platform. In this course, we show you how to use Amazon EMR to process data using the broad ecosystem of Hadoop tools like Hive and Hue. We also teach you how to create big data environments, work with Amazon DynamoDB, Amazon Redshift, Amazon Quicksight, Amazon Athena and Amazon Kinesis, and leverage best practices to design big data environments for security and cost-effectiveness.
This course is intended for:
Individuals responsible for designing and implementing big data solutions, namely Solutions Architects
Data Scientists and Data Analysts interested in learning about the services and architecture patterns behind big data solutions on AWS
By actively participating in this course, you will learn about the following:
Fit AWS solutions inside of a big data ecosystem
Leverage Apache Hadoop in the context of Amazon EMR
Identify the components of an Amazon EMR cluster
Launch and configure an Amazon EMR cluster
Leverage common programming frameworks available for Amazon EMR including Hive, Pig, and Streaming
Leverage Hue to improve the ease-of-use of Amazon EMR
Use in-memory analytics with Spark on Amazon EMR
Choose appropriate AWS data storage options
Identify the benefits of using Amazon Kinesis for near real-time big data processing
Leverage Amazon Redshift to efficiently store and analyze data
Comprehend and manage costs and security for a big data solution
Secure a Big Data solution
Identify options for ingesting, transferring, and compressing data
Leverage Amazon Athena for ad-hoc query analytics
Use visualization software to depict data and queries using Amazon QuickSight
Orchestrate big data workflows using AWS Data Pipeline
We recommend that attendees of this course have the following prerequisites:
Basic familiarity with big data technologies, including Apache Hadoop, MapReduce, HDFS, and SQL/NoSQL querying
Students should complete the free Big Data Technology Fundamentals web-based training or have equivalent experience
Working knowledge of core AWS services and public cloud implementation
Students should complete the AWS4501 - AWS Technical Essentials course or have equivalent experience
Basic understanding of data warehousing, relational database systems, and database design
Day 1
Overview of Big Data
Big Data Ingestion and Transfer
Big Data Streaming and Amazon Kinesis
Lab 1: Using Amazon Kinesis to Stream and Analyze Apache Server Log Data
Big Data Storage Solutions
Big Data Processing and Analytics
Lab 2: Using Amazon Athena to Query Log Data From Amazon S3
Day 2
Lab 3: Storing and Querying Data on Amazon DynamoDB
Using Amazon EMR
Hadoop Programming Frameworks
Lab 4: Processing Server Logs With Hive on Amazon EMR
Lab 5: Running Pig Scripts in Hue on Amazon EMR
Lab 6: Processing NY Taxi data using Spark on Amazon EMR
Day 3
Amazon Redshift and Big Data
Visualizing and Orchestrating Big Data
Lab 7: Using TIBCO Spotfire to Visualize Data
Managing Big Data Costs
Securing Your Amazon Deployments
Big Data Design Patterns
There is no exam directly relating to this course.
This training course provided by Skilltec is accredited through Global Knowledge Training Ltd. Global Knowledge Training Ltd are the authorised learning partner; all trademarks and partner statuses are provided through them.