In this practical book, author Bennie Haelen shows data engineers, data scientists, and data analysts how to get Delta Lake and its unique features up and running. The ultimate goal of building data pipelines and applications is to query processed data and gain insights from it. You'll learn how the choice of storage solution determines the robustness and performance of the data pipeline, from raw data to insights.
With this book, you will:Use modern data management and data engineering techniquesUnderstand how ACID transactions bring reliability to data lakes at scaleRun streaming and batch jobs against your data lake concurrentlyExecute update, delete, and merge commands against your data lakeUse time travel to roll back and examine previous versions of your dataBuild a streaming data quality pipeline following the medallion architecture