Big Data 2018
Gabor Ratky
CTO at Secret Sauce Partners
Is Big Data Dead?
Data Lake is Dead
Track record
| 2016 technology | 2016 predictions | 2017 trends |
|---|---|---|
| EMR 4 | Consolidation | Storage |
| Spark | SQL | Compute |
| Zeppelin | Tooling | Serverless |
+
Amazon
Amazon SageMaker
Databricks Delta
Track record
| 2016 technology | 2016 predictions | 2017 trends |
|---|---|---|
| EMR 4 | Consolidation | Storage |
| Spark | SQL | Compute |
| Zeppelin | Tooling | Serverless |
+
Track record
| 2016 technology | 2016 predictions | 2017 trends |
|---|---|---|
Cloud
2018 cloud trends
Batch & stream converge
Apache Beam
Spark Structured Streaming
KSQL
Multi-cloud becomes easy & important
Kubernetes
Hybrid data warehouses
Amazon Athena + Glue
Databricks Delta
Redshift Spectrum
Past & future
| 2016 technology | 2016 predictions | 2017 trends |
2018 predictions |
|---|---|---|---|
| EMR 4 | Consolidation | Storage | Batch + stream |
| Spark | SQL | Compute | Hybrid DW |
| Zeppelin | Tooling | Serverless | Multi-cloud |
+
+1: GDPR
😱
Happy new year!
gabor@secretsaucepartners.com