Skip to main content
Version: 1.0

Streaming Analytics Concepts

windowed-grouped-aggregation.png

Read: Windows

  • Tumbling Windows
  • Sliding Windows
  • Session Windows
    • (may not be available in all frameworks)

Read: Handling Lateness & Watermarking

Read: keyBy Splitting the stream logically for your domain

Read: State (using Flink as an example)

  • Keyed State vs Operator State
  • Managed Data Structures for State
    • ValueState
    • ListState
    • MapState

checkpoints.png

Read: Checkpointing

  • Making sure we can recover from failures seamlessly
  • Analogous to log based recovery for database systems