Published on: 2024-12-05 21:57:13
Categories: 28
Share:
Data Engineering Master Course: Spark/Hadoop/Kafka/MongoDB, name of the training course, comprehensive data and the tools and frameworks famous it, such as Apache Spark, Hadoop, etc. Sqoop., the Flume and Apache Hive is . In this course, you will first get acquainted with the distributed Hadoop file system and its application and learn the most common commands . Then how to entry data using Sqoop, etc. life cycle commands it. how to transfer data from Mysql to HDFS and Hive, and the use of different formats of files, compression, and jQuery are taught . In addition, you will also learn to get output from data using Sqoop (from HDFS and Hive to Mysql).
Continuing with the architecture of Apache Flume and use it to get data from Twitter and netcat and store in HDFS with the use of Flume Interceptors and Flume Consolidation will be familiar . The next section to Apache Hive, is devoted to that, tables, external and managed, work with various files such as Parquet and Avro, compression, upload, analyze in Hive, etc. functions, string and historical Hive, etc. partitions and buckets of data classification should come to you . Finally, with the framework Apache Spark, an overall view of the cluster ( Cluster ), the action and change the shape of along with example data sets distributed, flexible, or RDD, data forms, Spark, along with examples and work with extension and compression is also different, Spark SQL, and integration with Cassandra will be familiar .
Hadoop Distributed File System and Sqoop commands lifecycle
Sqoop commands to transfer data from MySQL to HDFS and Hive
Work with various file formats, compression and queries
Use incremental mode in Sqoop help data transfer
Get data from sources to help Flume
And …
Anyone who wants to get acquainted with the data macro in full detail
Publisher: Udemy
Lecturer: Navdeep Kaur
Language: English
Training level: from preliminary to advanced
Number of lessons: 151 lessons
Duration: 12h 11m
After the Extract with the Player your custom view.
Subtitles: English
Quality: 1080p
Changes:
Version 2023/12 compared to 2020/8 has increased the number of 40 lessons and the duration of 2 hours and 54 minutes.
The 2024/7 version has increased the number of lessons by 25 and the duration by 55 minutes compared to 2023/12. The course quality has also been increased from 720p to 1080p.
5.2 GB
Sharing is caring: