Udemy – Data Engineering Essentials using SQL, Python, and PySpark 2023-7

Description

Data Engineering Essentials using SQL, Python, and PySpark is a project-oriented data engineering training course with SQL, Python and PySpark framework published by Udemy Academy. At the end of this training course, you will be able to create a data pipeline for processing and storing information and perform engineering and data analysis projects alone with the trained techniques and technologies. Data engineering is the process of filtering, storing and processing various data based on the needs and goals of a particular project or research. Data engineering is a general concept and includes many sub-disciplines. At the beginning of this training course, you will get acquainted with the principles and basics of Python and SQL programming languages, and after solving the exercises and projects in this section, you will refer to the next and more advanced topics.

What you will learn in Data Engineering Essentials using SQL, Python, and PySpark

• Construction of Data Pipeline with SQL
• Postgres database management system
• Initial installation of the database and performing simple operations on information such as adding, deleting, updating, etc.
• Write simple SQL queries and requests
• Filter, integrate and compress data with SQL
• Creating indexes and tables in a database environment with DDL commands and commands
• Partitioning and categorizing information in the database
• Predefined functions in SQL such as manipulating string values ​​and …
• Write complex and specific SQL queries with Postgresql
• Principles of Python Programming
• Implement and perform simple operations in the database with the Python programming language
• Conditional commands and loops in Python
• List and set in Python
• Data types and data types in Python programming
• Map and Reduce Libraries in Python
• Pandas Library
• Initial installation of data engineering application development environment
• Types of Spark dataframe APIs such as select, filter, groupBy, orderBy and …
• Using different files and formats such as Parquet, JSON, CSV, etc. to build data transmissions

Course specifications

Publisher: Udemy
Instructors: Durga Viswanatha Raju Gadiraju
Language: English
Level: Intermediate
Number of Lessons: 624
Duration: 56 hours

Course topics

Data Engineering Essentials using SQL, Python, and PySpark Prerequisites

Laptop with decent configuration (Minimum 4 GB RAM and Dual Core)

Sign up for GCP with the available credit or AWS Access

Setup self support lab on cloud platforms (you might have to pay the applicable cloud fee unless you have credit)

CS or IT degree or prior IT experience is highly desired

Pictures

Introduction Video

Installation guide

After Extract, watch with your favorite Player.

Subtitle: English

Quality: 720p

Previous title:

Data Engineering Essentials Hands-on – SQL, Python and Spark

Changes:

Version 2023/7 compared to 2021/11 has decreased the number of 14 lessons and the duration of 1 hours and 22 minutes.

Download Links

Download Part 1 – 3 GB

Download Part 2 – 3 GB

Download Part 3 – 3 GB

Download Part 4 – 3 GB

Download Part 5 – 3 GB

Download Part 6 – 420 MB

File password (s): www.abc.com

Size

15.4 GB