Apache Kafka® 3.0 is out! To spotlight major enhancements in this release, Tim Berglund (Apache Kafka Developer Advocate) provides a summary of what’s new in the Kafka 3.0 release from Krakow, Poland, including API changes and improvements to the early-access Kafka Raft (KRaft).
KRaft is a built-in Kafka consensus mechanism that’s replacing Apache ZooKeeper going forward. It is recommended to try out new KRaft features in a development environment, as KRaft is not advised for production yet. One of the major features in Kafka 3.0 is the efficiency for KRaft controllers and brokers to store, load, and replicate snapshots into a Kafka cluster for metadata topic partitioning. The Kafka controller is now responsible for generating a Kafka producer ID in both ZooKeeper and KRaft, easing the transition from ZooKeeper to KRaft on the Kafka 3.X version line. This update also moves us closer to the ZooKeeper-to-KRaft bridge release. Additionally, this release includes metadata improvements, exactly-once semantics, and KRaft reassignments.
To enable a stronger record delivery guarantee, Kafka producers turn on by default idempotency, together with acknowledgment delivery by all the replicas. This release also comprises enhancements to Kafka Connect task restarts, Kafka Streams timestamp based synchronization and more flexible configuration options for MirrorMaker2 (MM2). The first version of MirrorMaker has been deprecated, and MirrorMaker2 will be the focus for future developments. Besides that, this release drops support for older message formats, V0 and V1, as well as initiates the removal of Java 8 and Scala 2.12 across all components in Apache Kafka. The universal Java 8 and Scala 2.12 deprecation is anticipated to complete in the future Apache Kafka 4.0 release.
Apache Kafka 3.0 is a major release and step forward for the Apache Kafka project!
EPISODE LINKS
Towards Successful Apache Kafka Implementations ft. Jakub Korab
Knative 101: Kubernetes and Serverless Explained with Jacques Chester
Paving a Data Highway with Kafka Connect ft. Liz Bennett
Distributed Systems Engineering with Apache Kafka ft. Jun Rao
How to Write a Successful Conference Abstract | Streaming Audio Special
Streaming Call of Duty at Activision with Apache Kafka ft. Yaroslav Tkachenko
Confluent Platform 5.4 | What's New in This Release + Updates
Making Apache Kafka Connectors for the Cloud ft. Magesh Nandakumar
Location Data and Geofencing with Apache Kafka ft. Guido Schmutz
Multi-Cloud Monitoring and Observability with the Metrics API ft. Dustin Cote
Apache Kafka and Apache Druid – The Perfect Pair ft. Rachel Pedreschi
Apache Kafka 2.4 – Overview of Latest Features, Updates, and KIPs
Cloud-Native Patterns with Cornelia Davis
Ask Confluent #16: ksqlDB Edition
Machine Learning with Kafka Streams, Kafka Connect, and ksqlDB ft. Kai Waehner
Real-Time Payments with Clojure and Apache Kafka ft. Bobby Calderwood
Announcing ksqlDB ft. Jay Kreps
Installing Apache Kafka with Ansible ft. Viktor Gamov and Justin Manchester
Securing the Cloud with VPC Peering ft. Daniel LaMotte
ETL and Event Streaming Explained ft. Stewart Bryson
Create your
podcast in
minutes
It is Free
Insight Story: Tech Trends Unpacked
Zero-Shot
Fast Forward by Tomorrow Unlocked: Tech past, tech future
The Unbelivable Truth - Series 1 - 26 including specials and pilot
Acquired