E-Books →Data Engineering Design Patterns Recipes for Solving the Most Common Data Engineering Problems, 3rd Early Release

Author Bartosz Konieczny guides you through the process of building reliable end-to-end data engineering projects, from data ingestion to data observability, focusing on data engineering design patterns that solve common business problems in a secure and storage-optimized manner. Each pattern includes a user-facing description of the problem, solutions, and consequences that place the pattern into the context of real-life scenarios.
Throughout this journey, you'll use open source data tools and public cloud services to see how to put each pattern into practice. You'll learn:
Challenges data engineers face and their impact on data systemsHow these challenges relate to data system componentsWhat data engineering patterns are forHow to identify and fix issues with your current data componentsTechnology-agnostic solutions to new and existing data projectsHow to implement patterns with Apache Airflow, Apache Spark, Apache Flink, and Delta Lake