What is Kafka

• Distributed log
• Log split into Topics and partitions
• State awareness moved to producers and consumers
• Leverages Zookeeper for cluster activities
• Written by a team at LinkedIn who needed near-real-time updates
• Very low latency
• At least once delivery