Scalable Data Processing with Python
Scalable Data Processing with Python
.MP4, AVC, 1280x720, 30 fps | English, AAC, 2 Ch | 55m | 134 MB
Instructor: Yasir Khan
.MP4, AVC, 1280x720, 30 fps | English, AAC, 2 Ch | 55m | 134 MB
Instructor: Yasir Khan
Learn to process large-scale data efficiently with Python. This course will teach you to leverage PySpark and Dask for scalable, parallel, and distributed data processing, and to optimize performance and handle real-world scaling challenges.
What you'll learn
Scalable data processing is essential for handling large datasets efficiently, yet many struggle with optimizing performance.
In this course, Scalable Data Processing with Python, you’ll gain the ability to process and manage large-scale data using PySpark and Dask.
First, you’ll explore the fundamentals of scalability, including parallel, distributed, and batch processing.
Next, you’ll discover how to use PySpark to process massive datasets with transformations, caching, and optimizations.
Finally, you’ll learn how to leverage Dask for parallel computation, optimizing execution with task graphs and lazy evaluation.
When you’re finished with this course, you’ll have the skills and knowledge to efficiently process large datasets and handle performance challenges in scalable data processing.
Scalable Data Processing with Python
