Udemy – Ultimate AWS Data Engineering Bootcamp: 15 Real-World Labs 2024-8

What you will learn:

In this course, you will delve deeply into the core aspects of data engineering, with a focus on batch and real-time data processing. You will gain hands-on experience with:

• Batch ETL and Processing with PySpark on AWS Glue and EMR: Learn to design, implement, and optimize scalable ETL pipelines and turn raw data into actionable insights.
• Real-time streaming with PySpark Streaming: Master real-time data processing and analysis to manage streaming data accurately and efficiently.
• Containerized Python Workloads with ECS: Discover how to manage and deploy containerized Python applications on AWS using ECS ​​for scalability and reliability.
• Data Coordination with Airflow and Step Functions: Coordinate complex workflows and automate data pipelines using the best data coordination tools.
• Event-driven and real-time processing with AWS Kinesis: Build robust event-driven architectures and process streaming data in real-time to ensure your data pipelines are always up-to-date.
• Data Warehousing with Amazon Redshift: Explore the intricacies of Redshift, AWS’s powerful data warehouse, to efficiently store and analyze massive data sets.
• Database management with MySQL Aurora and DynamoDB: Get hands-on with relational and NoSQL databases and optimize data storage and retrieval for different use cases.
• Serverless Data Processing with Lambda Functions: Harness the power of AWS Lambda to process data in real-time, creating workflows based on events.
• Glue Python Shell Tasks for Python Workloads: Use Glue Python shell tasks to run Python scripts in a managed environment, suitable for custom data processing tasks.
• Delta Lake on Spark: Understand the concepts behind Delta Lake and a lakehouse architecture and how to improve Spark to build reliable and scalable data lakes.
• CI/CD with GitHub Actions: Implement continuous integration and continuous delivery pipelines and automate your data engineering workflow with GitHub Actions.

This course is suitable for people who:

• Interested in mastering hands-on data engineering projects on the AWS cloud.
• Looking to gain hands-on experience with AWS as a promising Data Engineer.
• There are software developers and data analysts who plan to move into data engineering roles.
• Experienced Data Engineers looking to expand their knowledge of AWS services.

Installation guide

After Extract, view with your favorite Player.

Subtitle: None

Quality: 720p