Resilient Edge Infrastructure for IoT Using Apache Kafka ft. Kai Waehner

What is the internet of things (IoT), and how does it relate to event streaming and Apache Kafka®? The deployment of Kafka outside the datacenter creates many new possibilities for processing data in motion and building new business cases.

In this episode, Kai Waehner, field CTO and global technology advisor at Confluent, discusses the intersection of edge data infrastructure, IoT, and cloud services for Kafka. He also details how businesses get into the sticky situation of not accounting for solutions when data is running dangerously close to the edge. Air-gapped environments and strong security requirements are the norm in many edge deployments.

Defining the edge for your industry depends on what sector you’re in plus the amount of data and interaction involved with your customers. The edge could lie on various points of the spectrum and carry various meanings to various people. Before you can deploy Kafka to the edge, you must first define where that edge is as it relates to your connectivity needs. 

Edge resiliency enables your enterprise to not only control your datacenter with ease but also preserve the data without privacy risks or data leaks. If a business does not have the personnel to handle these big IT jobs on their own or an organization simply does not have an IT department at all, this is where Kafka solutions can come in to fill the gap. 

This podcast explores use cases and architectures at the edge (i.e., outside the datacenter) across industries, including manufacturing, energy, retail, restaurants, and banks. The trade-offs of edge deployments are compared to a hybrid integration with Confluent Cloud. 

EPISODE LINKS

• Kafka Summit: Processing IoT Data from End to End with MQTT and Apache Kafka
• End-to-End Integration: IoT Edge to Confluent
• Infrastructure Checklist for Apache Kafka at the Edge
• Use Cases and Architectures for Kafka at the Edge
• Architecture Patterns for Distributed, Hybrid, Edge, and Global Apache Kafka Deployments
• Building a Smart Factory with Apache Kafka and 5G Campus Networks
• Apache Kafka Is the New Black at the Edge in Industrial IoT, Logistics, and Retailing 
• Apache Kafka, KSQL, and Apache PLC4X for IIoT Data Integration and Processing 
• Streaming Machine Learning at Scale from 100,000 IoT Devices with HiveMQ, Apache Kafka, and TensorFlow 
• Join the Confluent Community
• Use 60PDCAST to get an additional $60 of free Confluent Cloud usage (details)