Big Data 2018

Gabor Ratky
CTO at Secret Sauce Partners

Is Big Data Dead?

Data Lake is Dead

Track record

2016 technology 2016 predictions 2017
trends
EMR 4 Consolidation Storage
Spark SQL Compute
Zeppelin Tooling Serverless

+

Google

Amazon

Amazon SageMaker

Databricks Delta

Track record

2016 technology 2016 predictions 2017
trends
EMR 4 Consolidation Storage
Spark SQL Compute
Zeppelin Tooling Serverless

+

Track record

2016 technology 2016 predictions 2017
trends

Cloud

2018 cloud trends

Batch & stream converge

Apache Beam

Spark Structured Streaming

KSQL

Multi-cloud becomes easy & important

Kubernetes

Hybrid data warehouses

Amazon Athena + Glue

Databricks Delta

Redshift Spectrum

Past & future

2016 technology 2016 predictions 2017
trends
2018 predictions
EMR 4 Consolidation Storage Batch + stream
Spark SQL Compute Hybrid DW
Zeppelin Tooling Serverless Multi-cloud

+

+1: GDPR

😱

Happy new year!

@rgabo

gabor@secretsaucepartners.com

Made with Slides.com