E-Books →Data Algorithms with Spark Recipes and Design Patterns for Scaling Up using PySpark

In each chapter, author Mahmoud Parsian shows you how to solve a data problem with a set of Spark transformations and algorithms. You'll learn how to tackle problems involving ETL, design patterns, machine learning algorithms, data partitioning, and genomics analysis. Each detailed recipe includes PySpark algorithms using the PySpark driver and shell script.
With this book, you will:Learn how to select Spark transformations for optimized solutionsExplore powerful transformations and reductions including reduceByKey(), combineByKey(), and mapPartitions()Understand data partitioning for optimized queriesBuild and apply a model using PySpark design patternsApply motif-finding algorithms to graph dataAnalyze graph data by using the GraphFrames APIApply PySpark algorithms to clinical and genomics dataLearn how to use and apply feature engineering in ML algorithmsUnderstand and use practical and pragmatic data design patterns