Apache Storm for CAM Publishing

What is Apache Storm?

• Realtime computation system
• Processes streams of data

'Spouts' bring data in

'Bolts' process it

CAM Publishing bottleneck

Generalization of producer/consumer pattern

Benefits of Storm

• Massively scaleable
• Fault tolerant
• Fast parallelised distributed computation
• Designed for realtime processing

Storm vs Spark

• Spark is better for batch processing

  • Also does stream processing

• Storm is better for realtime, but can also do microbatches