Jeff Taylor

Principal Data Consultant

Database Consulting, LLC

Azure Data Factory (ADF)

Your New SSIS

Jeff Taylor

Principal Data Consultant

Database Consulting, LLC

@ReviewMyDB

https://jefftaylor.io/blog

Jeff@JeffTaylor.io

Super Hero Suit

jssug.org

Every 3rd Wednesday 6-8pm

Except for May, November and December

https://sqlsaturday.com

https://sqlsaturday.com/jax

Annual Free Data Conference

May 2nd & 3rd, 2025

Thank you sponsors!

Jeff Taylor

Principal Data Consultant

Database Consulting, LLC

Azure Data Factory (ADF)

Your New SSIS

ADF - What is it?

Something Sweet!

Azure Data Factory is a 'code-free' (almost) cloud-based ETL/ELT data-driven integration service AT SCALE!

Extract, Load, Transform

You can still code if you want

ADF - What is it?

Something Sweet!

  • Ingest - 100+ Native connectors
     
  • Control flow - Pipelines
     
  • Data Flow - Transformations
     
  • Schedule
     
  • Monitor

ADF - What is it?

Top-level concepts

  • Pipelines - managing flow
     
  • Activities - tasks
     
  • Datasets - source and destination data
     
  • Linked services - connection strings
     
  • Data Flows - no-code transformations
     
  • Integrated Runtimes - execution - (on-premise or in cloud)

ADF - Activities

ADF - What is it?

Something Sweet!

Something Sweet!

ADF - What is it?

Something Sweet!

ADF - What is it?

Something Sweet!

ADF - What is it?

Something Sweet!

ADF - What is it?

Something Sweet!

ADF - What is it?

Something Sweet!

ADF - What is it?

Something Sweet!

ADF - What is it?

Something Sweet!

ADF - What is it?

Something Sweet!

ADF - What is it?

Something Sweet!

ADF - What is it?

Something Sweet!

ADF - What is it?

Something Sweet!

ADF - What is it?

Something Sweet!

ADF - What is it?

Something Sweet!

ADF - What is it?

Something Sweet!

ADF - What is it?

ADF - How?

What is needed...

  • A Resource Group - Manage and monitor costs
     
  • Code Repo - To store ADF source code - Azure DevOps
     
  • Data Storage - Azure Data Lake
     
  • Database - Serverless Azure SQL

ADF - SQL

Configuration

Large Serverless

Max 16 Cores

150GB

ADF - Data

Size

ADF - $

1 Month Cost

ADF - SQL

Configuration

Smaller Serverless

Max 16 Cores

32GB

ADF - Data

Size

ADF - $

8 month Cost

ADF - Demo

DEMO TIME

Questions

Thank you!

Jeff Taylor

@ReviewMyDB

https://jefftaylor.io/blog

Jeff@JeffTaylor.io

Thank you for attending my session today.
If you have any additional questions, please don't hesitate to reach out.