Data lakehouse architectures are gaining popularity due to the flexibility and cost effectiveness that they offer. The link that bridges the gap between data lake and warehouse capabilities is the catalog. The primary purpose of the catalog is to inform the query engine of what data exists and where, but the Nessie project aims to go beyond that simple utility. In this episode Alex Merced explains how the branching and merging functionality in Nessie allows you to use the same versioning semantics for your data lakehouse that you are used to from Git.
AnnouncementsThe intro and outro music is from The Hug by The Freak Fandango Orchestra / CC BY-SA
Sponsored By:
Support Data Engineering Podcast
Practical First Steps In Data Governance For Long Term Success
Data Migration Strategies For Large Scale Systems
Zenlytic Is Building You A Better Coworker With AI Agents
Release Management For Data Platform Services And Logic
Barking Up The Wrong GPTree: Building Better AI With A Cognitive Approach
Build Your Second Brain One Piece At A Time
Making Email Better With AI At Shortwave
Designing A Non-Relational Database Engine
Establish A Single Source Of Truth For Your Data Consumers With A Semantic Layer
Adding Anomaly Detection And Observability To Your dbt Projects Is Elementary
Ship Smarter Not Harder With Declarative And Collaborative Data Orchestration On Dagster+
Reconciling The Data In Your Databases With Datafold
When And How To Conduct An AI Program
Find Out About The Technology Behind The Latest PFAD In Analytical Database Development
Using Trino And Iceberg As The Foundation Of Your Data Lakehouse
Data Sharing Across Business And Platform Boundaries
Tackling Real Time Streaming Data With SQL Using RisingWave
Build A Data Lake For Your Security Logs With Scanner
Modern Customer Data Platform Principles
Create your
podcast in
minutes
It is Free
Insight Story: Tech Trends Unpacked
Zero-Shot
Fast Forward by Tomorrow Unlocked: Tech past, tech future
The Unbelivable Truth - Series 1 - 26 including specials and pilot
Lex Fridman Podcast