Florian Dambrine
I am a Freelance DevOps Engineer graduated from UTC (University of Technology of Compiègne) in 2014. I am a DevOps enthusiast embracing Cloud computing technologies to build automated infrastructure at large scale.
*Flow Pipelines
| Needs ? | Airflow | MLFlow |
|---|---|---|
| Features | Robust scalable scheduler | ML artifacts / models / runs tracking |
| Easy Infrastructure | Fully managed on Astronomer | Stateless Standalone Service (Plugs in RDS / S3) |
| Easy Contributions | Describing Pipelines as python actions | Writing experiments as python functions / Web UI |
| Easy Usage | Web UI showing logs / failed tasks / click and run | Simple but powerful API allowing better collaborations |
+
[1] Data preparation
[2] Data annotation
[3] Run jobs
[4] Record runs & store models / artifacts
[5] Notification
[*]Flow Pipelines
By Florian Dambrine
[*]Flow Pipelines
Design session around Airflow and MLFlow
