
Data Engineering using AWS Data Analytics
Udemy · English
About this course
- Language
- English
- Category
- Provider
- Udemy
- Data updated
Data Engineering is all about building Data Pipelines to get data from multiple sources into Data Lakes or Data Warehouses and then from Data Lakes or Data Warehouses to downstream systems. As part of this course, I will walk you through how to build Data Engineering Pipelines using AWS Data Analytics Stack. It includes services such as Glue, Elastic Map Reduce (EMR), Lambda Functions, Athena, EMR, Kinesis, and many more. Here are the high-level steps which you will follow as part of the course. Setup Development EnvironmentGetting Started with AWSStorage - All about AWS s3 (Simple Storage Service)User Level Security - Managing Users, Roles, and Policies using IAMInfrastructure - AWS EC2 (Elastic Cloud Compute)Data Ingestion using AWS Lambda FunctionsOverview of AWS Glue ComponentsSetup Spark History Server for AWS Glue JobsDeep Dive into AWS Glue CatalogExploring AWS Glue Job APIsAWS Glue Job BookmarksDevelopment Life Cycle of PysparkGetting Started with AWS EMRDeploying Spark Applications using AWS EMRStreaming Pipeline using AWS KinesisConsuming Data from AWS s3 using boto3 ingested using AWS KinesisPopulating GitHub Data to AWS DynamodbOverview of Amazon AWS AthenaAmazon AWS Athena using AWS CLIAmazon AWS Athena using Python boto3Getting Started with Amazon AWS RedshiftCopy Data from AWS s3 into AWS Redshift TablesDevelop Applications using AWS Redshift ClusterAWS Redshift Tables with Distkeys and SortkeysAWS Redshift Federated Queries and SpectrumHere are the details about what you will be learning as part of this course. We will cover most of the commonly used services with hands-on pra…











