Feature Store

COE.EFficiency

  1. WHY - Ideal FS

  2. WHAT - FSs in market

  3. HOW - Levis FS v1.0

  4. Demo

WHY

Ideal FS

Ideal FS - DS headache

  1. Data
    • Search -> Access -> Understand -> DQ
  2. Online/Offline Skew
    • POC vs Prod
  3. Data freshness

Ideal FS

Bottleneck

Lighter, Faster, Stronger

Data Mesh

FS 2
(Data Mesh 2)
FS 3
(Data Mesh 3)
FS 1
(Data Mesh 1)

WHAT

FSs in market

Ideal FS - Databricks FS

Ideal FS - GCP Vertex AI

Ideal FS - GCP Vertex AI

Ideal FS - FEAST

Ideal FS

  • FS Databricks

  • Vertex AI - GCP

  • FEAST

  • etc.

  • Cost

  • Dependency

  • Customize 

  • Data Silos

HOW

FS v1.0

FS Ecosystem V1.0

FS Ecosystem V2.0

FS Ecosystem 3.0

Cloud Archi

Cloud Archi (Common Lib)

Airflow

Orchestration & Automation

Airflow

Orchestration & Automation

DEMO