Udemy – Data Engineering Master Class using AWS Analytics Services 2022-4

Published on: 2022-08-30 18:21:37

Categories: 28

Description

Data Engineering Master Class using AWS Analytics Services is the name of the Data Engineering Master Class using AWS Analytics Services published by Udemy Academy.

Data engineering is all about creating data pipelines to get data from multiple sources into data lakes or data warehouses and then from the data lakes or data warehouses to downstream systems. As part of this course, I will walk you through how to build Data Engineering Pipelines using the AWS Data Analytics Stack. It includes services like Glue, Elastic Map Reduce (EMR), Lambda Functions, Athena, EMR, Kinesis and many others.

Here are the high-level steps which you will follow as part of the course.

Setup Development Environment
Getting Started with AWS
Storage – All about AWS s3 (Simple Storage Service)
User Level Security – Managing Users, Roles, and Policies using IAM
Infrastructure – AWS EC2 (Elastic Cloud Compute)
Data Ingestion using AWS Lambda Functions
Overview of AWS Glue Components
Setup Spark History Server for AWS Glue Jobs
Deep Dive into AWS Glue Catalog
Exploring AWS Glue Job APIs
AWS Glue Job Bookmarks
Development Life Cycle of Pyspark
Getting Started with AWS EMR
Deploying Spark Applications using AWS EMR
Streaming Pipeline using AWS Kinesis
Consuming Data from AWS s3 using boto3 ingested using AWS Kinesis
Populating GitHub Data to AWS Dynamodb
Overview of Amazon AWS Athena
Amazon AWS Athena using AWS CLI
Amazon AWS Athena using Python boto3
Getting Started with Amazon AWS Redshift
Copy Data from AWS s3 into AWS Redshift Tables
Develop Applications using AWS Redshift Cluster
AWS Redshift Tables with Distkeys and Sortkeys
AWS Redshift Federated Queries and Spectrum

Who is this course suitable for?

Beginner or Intermediate Data Engineers who want to learn AWS Analytics Services for Data Engineering
Intermediate Application Engineers who want to explore Data Engineering using AWS Analytics Services
Data and Analytics Engineers who want to learn Data Engineering using AWS Analytics Services
Testers who want to learn Databricks to test Data Engineering applications built using AWS Analytics Services

What you will learn in Data Engineering Master Class using AWS Analytics Services Course :

Data Engineering leveraging AWS Analytics features
AWS Essentials such as s3, IAM, EC2, etc
Understanding AWS s3 for cloud based storage
Understanding details related to virtual machines on AWS known as EC2
Managing AWS IAM users, groups, roles and policies for RBAC (Role Based Access Control)
Managing Tables using AWS Glue Catalog
Engineering Batch Data Pipelines using AWS Glue Jobs
Orchestrating Batch Data Pipelines using AWS Glue Workflows
Running Queries using AWS Athena – Server less query engine service
Using AWS Elastic Map Reduce (EMR) Clusters for building Data Pipelines
Using AWS Elastic Map Reduce (EMR) Clusters for reports and dashboards
Data Ingestion using AWS Lambda Functions
And…..

Course details :

Publisher: Udemy
Instructor: Durga Viswanatha Raju Gadiraju,Asasri Manthena ,Perraju Vegiraju
language : English
Training level: Advanced
Number of courses: 434
Training duration: 26 hours 15 minutes

Data Engineering Master Class using AWS Analytics Services Course Content:

Data Engineering using AWS Data Analytics Services Content

Requirements :

Programming experience using Python
Data Engineering experience using Spark
Ability to write and interpret SQL Queries
This course is ideal for experienced data engineers to add AWS Analytics Services as key skills to their profile