But companies are now marching towards a world where data and artificial intelligence are embedded in myriad internal processes (...) This is the beginning of the era of the intelligent, automated enterprise – where company metrics are available in real time (...), churn is predicted, cyber threats are detected in real time, supply chains automatically adjust to demand fluctuations, etc.
1.DATA ENGINEERING
1.DATA ENGINEERING
Analytics Engineer
Data Analyst
1.DATA ENGINEERING
1.DATA ENGINEERING
"So what are you doing, again?"
To provide data tools and knowledge so that:
- Teams can self manage their data as a product, and spend more time debating what to do because of a number on a dashboard than verifying if that number is right.
2.OUR MISSION
To provide data tools and knowledge so that:
2.OUR MISSION
Data Eng.
Data
Our company is a successfully data-driven organization, connecting analytics to action in a reliable, fast, and profitable way.
2.OUR VISION
Your data is your product too
2. OUR VALUES
Interlude: removing columns
_
Remember your consumers
3. REMOVING COLUMNS
future
Remember your consumers
3. REMOVING COLUMNS
future
current
Remember your consumers
3. REMOVING COLUMNS
current
Remember your consumers
3. REMOVING COLUMNS
current
- Query last 30 day queries.
-
bigquery_logs_sink.bq_logs_with_metabase_data
-
- Announce your intention.
- Set it to NULL for some time.
- Remove it 🔥
A proper API for your data: views
3. REMOVING COLUMNS
query (EAC)
A proper API for your data: views
3. REMOVING COLUMNS
query (EFC)
view
A proper API for your data: views
3. REMOVING COLUMNS
The T in ELT
_
4. DBT
4. DBT
Version control
4. DBT
Version control
Test and document
4. DBT
Version control
Test and document
Develop
4. DBT
The modern data stack
... A tool to transform our models... into what?
5.DATA MODELING
❌
✔
5.DATA MODELING
Data Engineering's coming out
By Mario López Martínez
Data Engineering's coming out
Slides is a presentation platform for developers built on top of the reveal.js open source HTML presentation framework. We offer a wide range of developer-focused features like step-by-step code highlighting, a CSS editor, LaTeX typesetting and more.
