Bridging the Gap Between Data Professionals and DevOps Engineers

Ramon Perez, Mark Stent, and Alaa Abedrabbo

12 October 2022

Agenda

1. Set Up

2. Motivation

3. Bridging the Gap

4. Data Pipelines

3. Testing

4. Data Analytics

5. Continuous X

The Set Up

  1. Have you cloned the repo for the workshop? bit.ly/pycon-dad
  2. Is your environment working?
  3. Do you have your favorite IDE up and running? Please note that the preferred ones for the session are Jupyter Lab and VSCode

Motivation

To increase visibility into each other's line of work, collaboration between both groups, and adoption each other's best practices.

Data Professionals

Data Engineers

Data Analysts

Machine Learning Engineers

Many More

  • Machine Learning Researcher
  • Business Intelligence Analyst
  • Project Manager
  • Analytics Engineer

DevOps Engineers

Code

Build

Deploy

Manage

Learn

Data

Pipelines

Testing

Data Analytics

Continuous X

Before Today

You

Data

You

DevOps

After Today

Data

You

DevOps

Copy of deck

By ramongz

Copy of deck

  • 68