Keynote: Flink Unveiled - Journeying from DataStream to Streamhouse

Keynote: Flink Unveiled - Journeying from DataStream to Streamhouse

In this presentation, Jing Ge, Head of Engineering at Ververica and Apache Flink® Committer, announces Streamhouse. Learn how Streamhouse significantly improves latency and allows for flexibility and real-time streaming while minimizing the costs usually associated with real-time streaming.  

Learn more about Streamhouse on the Ververica blog.  https://www.ververica.com/blog/stream...

Get all the recordings from Flink Forward Seattle 2023 free on-demand at Ververica Academy.  https://www.ververica.academy/app/videos

Ververica is proud to host Flink Forward! Curious about Sponsoring future Flink Forward events? Subscribe for updates. https://www.flink-forward.org/contact


CHAPTERS
00:00: Introduction Do you know what data streaming is?
00:50: Streamhouse
1:20 2023 SIGMOD Systems Award
1:42 Apache Flink
4:20 Lakehouse: Data Warehouse, Data Lakehouse, Data Stream
5:30 Data Processing Triangle: Cost, Latency and Data
7:48 Data Processing Architecture Evolution
8:40 Streamhouse
9:45 Streamhouse: Flink CDC, Flink, Paimon
10:16 Flink CDC for Streamhouse Data Ingestion
10:55 Flink for Streamhouse Data Computation
11:45 Flink - Checkpoint Duration Improvement
13:23 Flink - Adaptive Hybrid Shuffle
14:38 Flink 2.0 - Cloud Native Disaggregated State Management
15:50 Flink 2.0 - API Evolution
17:25 Flink - SQL
19:37 Streaming Data Lake Platform - Apache Paimon
21:30 Streamhouse - The Flexible FFP Architecture
23:32 Big Picture - LSR Data Processing Architecture
25:15 Ververica Cloud: Fully managed, flexible solution
28:04 Conclusion: Why Ververica Cloud?



About Ververica
Proud hosts of Flink Forward events, Ververica is the company founded by the original creators of the open source stream processing framework Apache Flink®. Ververica's mission is to power the core business of every company with cutting-edge real-time stream processing technology. In order to do that, the team at Ververica focuses on building the best technology available for stream processing, while at the same time creating a global and open community
around this technology.

We build and develop Ververica Platform, a stream processing platform that enables every enterprise to power their real-time business and use a production-grade streaming infrastructure while at the same time we actively contribute and participate in the open source Apache Flink community, the underlying technology framework of Ververica Platform itself.
https://www.ververica.com/

Follow Ververica on LinkedIn: LinkedIn: 5385380
Follow Ververica on X: Twitter: VervericaData
Learn more about Flink Forward: https://www.flink-forward.org/