AWS Lake Formation

Hands-On

Demo

In this demo, we will:

  1. Set up AWS Lake Formation
  2. Create an S3 bucket for our data lake
  3. Register the S3 bucket as a data lake location
  4. Create a database using AWS Glue
  5. Create a table using AWS Glue Crawler
  6. Configure Lake Formation permissions
  7. Query data using Amazon Athena
  8. Test the setup
  9. Clean up resources

Agenda

Demo Overview

Create S3 Bucket

lake-formation-demo-983721

Choose an Amazon S3 location

Register S3 Location in Lake Formation

Register location

Register location

Permission mode

Create Database

Create database

Create database

demo_database

Choose an Amazon S3 location

Upload Sample Data to S3

id,name,department,salary
1,John Doe,HR,75000
2,Jane Smith,Engineering,95000
3,Bob Johnson,Marketing,80000
4,Alice Williams,Engineering,92000
5,Charlie Brown,Finance,85000

Sample Data

Upload File

Create Table

Create table using a crawler

employee-data-crawler

Set crawler properties

Choose S3 path

Add data source

Choose data sources and classifiers

AWSGlueServiceRole-GlueCrawlerRole

IAM role

Set output and scheduling

Run Crawler

Table Created in Lake Formation

Create IAM User

lake-formation-user-1
Awsuser@123

Create user

AthenaFullAccess

Add Athena permissions

S3FullAccess

Add S3 permissions

Grant Permissions to the Table

Grant data lake permissions

Give Super Access 

Grant

Data lake permissions

View Data

query result location

Create Bucket for Athena

Add S3 Bucket

Query as Root User

Login as Test User  

Awsuser@123
lake-formation-user-1

Successful Querying

Revoke Permission for User

Permissions Revoked

Table not visible

Clean Up

Delete Database

Delete Crawler

Remove Data Lake Locations

Delete IAM User

Delete IAM Roles

Delete Lake Formation Bucket

Delete Athena Bucket

Column 1 Column 2 Column 3
Data 1 Data 2 Data 3
Data 4 Data 5 Data 6
  1. Some Text Data

Heading 1

connects

🙏

Thanks

for

Watching