Optimizing Apache Spark & Tuning Best Practices
As data scales up, efficiently processing data becomes more crucial. Building on our experience as one of the world’s most significant Apache Spark users, this 2-day course provides an in-depth overview of the do’s and don’ts of one of the most popular analytics engines available.
Looking to upskill your team(s) or organization?
Surat will gladly help you further with custom training solutions.
Surat Wahal
Training Advisor
What will you learn?
After the training, you will be able to:
Explain what Apache Spark does under the hood.
Use best practices to write performant code.
Read and understand the query plans for your Spark applications.
Explain the Spark fundamentals, including the execution model: Driver/Executors.
Efficiently work with caching, shuffle service, and fair scheduling.
Troubleshoot optimization problems and memory issues.
Program
The trainer facilitates the content using notebooks hosted in a cloud environment. Each participant will have a Spark cluster to experiment with.
- Download & understand dataset used during training
- Theory about various Spark basics and Spark UI
- Apply optimisations in practice
This training is for you if:
You are comfortable using Spark but want to learn how optimizations can be applied to improve runtime
You want to learn how Spark works fundamentally – from text, to plan, to execution.
You are comfortable using Python.
This training is not for you if:
You don’t use Python with Spark (PySpark)
You want to learn how to transform notebook code into production-ready code (check out our Production-Ready Machine Learning course instead)
You want to learn how to use Databricks (this course is based on open-source Spark and is applicable to Databricks, but we are not covering Databricks concepts such as Jobs, Notebooks, Sharing, Repos, connectors, Databricks-Runtimes, etc.)
Why should I follow this training?
Learn about Apache Spark, using best practices to write performant code and tweaking and debugging Spark applications.
Grasp the Spark fundamentals, including the execution model: Driver/Executors, caching, shuffle service, and fair scheduling.
Learn from and network with Apache Spark data experts.
What else
should I know?
After registering for this training, you will receive a confirmation email with practical information. A week before the training, we will ask you about any dietary requirements and share literature if you need to prepare.
See you soon!
All literature and course materials are included in the price.
After registering for this course, you will receive a confirmation email with practical information.
