Apache Flink's Edge in Stream Processing

Shekhar Rajak (@shekharrajak)

Source:buildingandinteriors

Datalake & Stream processing

Source:databricks blog

Pipelines

Source: Apache Hudi Doc

Stateful stream processing

Source-Book: Stream–Processing-with–Apache-Flink

scenerio

Distributed processing

Payment processer

Inventroy processer

Shipment processer

Orders

Raw/Native data

extract & load

end-end EOS

key: orderID

Event time

2PC

Source-Wikipedia

Source- Apache Flink docs

Source- Apache Flink docs

Source- Apache Flink docs

Source- alibabacloud blog

Flink Sink -> external storage

Thank you!

Shekhar Prasad Rajak (@Shekharrajak)

Linkedin @shekharrajak

Made with Slides.com