Udemy – Apache Spark for Java Developers 2019-4

Published on: 2024-09-15 20:08:43

Categories: 28

Descriptions

Apache Spark for Java Developers, Get started with the amazing Apache Spark parallel computing framework – this course is designed especially for Java Developers. If you’re new to Data Science and want to find out about how massive datasets are processed in parallel, then the Java API for spark is a great way to get started, fast. All of the fundamentals you need to understand the main operations you can perform in Spark Core, SparkSQL and DataFrames are covered in detail, with easy to follow examples. You’ll be able to follow along with all of the examples, and run them on your own local development computer. Included with the course is a module covering SparkML, an exciting addition to Spark that allows you to apply Machine Learning models to your Big Data! No mathematical experience is necessary. And finally, there’s a full 3 hour module covering Spark Streaming, where you will get hands-on experience of integrating Spark with Apache Kafka to handle real-time big data streams. We use both the DStream and the Structured Streaming APIs. Optionally, if you have an AWS account, you’ll see how to deploy your work to a live EMR (Elastic Map Reduce) hardware cluster. If you’re not familiar with AWS you can skip this video, but it’s still worthwhile to watch rather than following along with the coding.

What you’ll learn

Use functional style Java to define complex data processing jobs
Learn the differences between the RDD and DataFrame APIs
Use an SQL style syntax to produce reports against Big Data sets
Use Machine Learning Algorithms with Big Data and SparkML
Connect Spark to Apache Kafka to process Streams of Big Data
See how Structured Streaming can be used to build pipelines with Kafka

Who this course is for

Anyone who already knows Java and would like to explore Apache Spark
Anyone new to Data Science who want a fast way to get started, without learning Python, Scala or R!

Specificatoin of Apache Spark for Java Developers

Publisher : Udemy
Teacher : Richard Chesterwood , Matt Greencroft , Virtual Pair Programmers
Language : English
Level : All Levels
Number of Course : 142
Duration : 21 hours and 30 minutes

Content on 2021-2

Apache Spark for Java Developers

Requirements

Java 8 is required for the course. Spark does not currently support Java9+, and you need Java 8 for the functional Lambda syntax
Previous knowledge of Java is assumed, but anything above the basics is explained
Some previous SQL will be useful for part of the course, but if you’ve never used it before this will be a good first experience