Enriching your Data Stream Asynchronously with Apache Flink

When data comes into a streaming workload, it may be necessary to enrich it with external data sources like an external API, query to a database, or lookup from a key/value store like Redis. It is critical that this enrichment does not stall data flowing through the system and not impact upstream operators in the Directed Acyclic Graph. Asynchronous I/O for External Data Access solves this requirement by enabling the use of a data client that supports asynchronous requests, handles requests and responses concurrently, and maintains fault tolerance and exactly-once guarantees. In this session, we explain the RichAsyncFunction and how to enrich a data stream using Amazon Kinesis Data Analytics for Apache Flink.

• #science_technology
• #streaming_workloads
• #data_enrishment
• #flink
• #apache_flink
• #aws
• #amazon_kinesis
• #kinesis_data_analytics
• #asynchronous_io
• #concurrency
• #fault_tolerance
• #exactly_once_guarantees
• #exactly_once
• #stream_processing
• #real_time_data
• #event_streaming
• #data_streaming
• #real_time_analytics
• #flink_on_aws