3 data engineering trends riding Kafka, Flink, and Iceberg [Video]

The Apache Kafka, Apache Flink, and Apache Iceberg communities are developing new ways for engineers to manage data and meet application needs.

Credit: Gorodenkoff / Shutterstock

Apache Kafka, Apache Flink, and Apache Iceberg are among the most popular technologies in the data ecosystem. While Kafka enables you to move data around in real time, Flink allows you to process data according to your needs and Iceberg helps you access stored data in a structured and navigable manner so that it’s ripe for querying. All three are influencing how we build data systems.

New features are continuously being added to each of the three tools by their open source software communities, often in collaboration with one another. This means that best practices are constantly evolving. And that means data professionals must stay on top of wider industry trends like the recent increased focus on data governance. 

Here are three trends I’ve been seeing lately around the …