Split Mixed Data using Dataflow

Split data with mixed schemas and ingest to BigQuery

Problem at hand

Solution

Flex Dataflow template

Dockerfile

Artifact Registry

Flex JSON

Run Flex Template