Optimizing Apache Spark & Tuning Best Practices
The Netherlands
As data scales up, efficiently processing data becomes more crucial. Building on our experience as one of the world’s most significant Apache Spark users, this 2-day course provides an in-depth overview of the do’s and don’ts of one of the most popular analytics engines available.
Looking to upskill your team(s) or organization?
Juanette will gladly help you further with custom training solutions.
Juanette Evans
Data and AI Training Advisor
What will you learn?
After the training, you will be able to:
Explain what Apache Spark does under the hood.
Use best practices to write performant code.
Read and understand the query plans for your Spark applications.
Explain the Spark fundamentals, including the execution model: Driver/Executors.
Efficiently work with caching, shuffle service, and fair scheduling.
Troubleshoot optimization problems and memory issues.
Program
The trainer facilitates the content using notebooks hosted in a cloud environment. Each participant will have a Spark cluster to experiment with.
- Download & understand dataset used during training
- Theory about various Spark basics and Spark UI
- Apply optimisations in practice
This training is for you if:
You are comfortable using Spark but want to learn how optimizations can be applied to improve runtime
You want to learn how Spark works fundamentally – from text, to plan, to execution.
You are comfortable using Python.
This training is not for you if:
You don’t use Python with Spark (PySpark)
You want to learn how to transform notebook code into production-ready code (check out our Production-Ready Machine Learning course instead)
You want to learn how to use Databricks (this course is based on open-source Spark and is applicable to Databricks, but we are not covering Databricks concepts such as Jobs, Notebooks, Sharing, Repos, connectors, Databricks-Runtimes, etc.)
Why should I follow this training?
Learn about Apache Spark, using best practices to write performant code and tweaking and debugging Spark applications.
Grasp the Spark fundamentals, including the execution model: Driver/Executors, caching, shuffle service, and fair scheduling.
Learn from and network with Apache Spark data experts.
What else
should I know?
After registering for this training, you will receive a confirmation email with practical information. A week before the training, we will ask you about any dietary requirements and share literature if you need to prepare.
See you soon!
All literature and course materials are included in the price.
After registering for this course, you will receive a confirmation email with practical information.
Also interesting for you
View all trainingsMost AI problems inside organizations are leadership problems in disguise. This one-day program gives executives three practical frameworks the Nightmare Map, the North Star, and the Cube to recognize failure patterns, set vision before strategy, and make governance decisions they can act on immediately. No technical background required. No company disclosure needed.
The AI Translation Learning Journey prepares professionals to connect business needs, stakeholder perspectives and technical possibilities. You will learn how to identify valuable AI opportunities, frame them clearly and help multidisciplinary teams move from an initial idea towards experimentation, production and adoption.
