AWS Lake Formation
Hands-On
Demo
In this demo, we will:
- Set up AWS Lake Formation
- Create an S3 bucket for our data lake
- Register the S3 bucket as a data lake location
- Create a database using AWS Glue
- Create a table using AWS Glue Crawler
- Configure Lake Formation permissions
- Query data using Amazon Athena
- Test the setup
- Clean up resources
Agenda
Demo Overview
Create S3 Bucket
lake-formation-demo-983721
Choose an Amazon S3 location
Register S3 Location in Lake Formation
Register location
Register location
Permission mode
Create Database
Create database
Create database
demo_database
Choose an Amazon S3 location
Upload Sample Data to S3
id,name,department,salary
1,John Doe,HR,75000
2,Jane Smith,Engineering,95000
3,Bob Johnson,Marketing,80000
4,Alice Williams,Engineering,92000
5,Charlie Brown,Finance,85000
Sample Data
Upload File
Create Table
Create table using a crawler
employee-data-crawler
Set crawler properties
Choose S3 path
Add data source
Choose data sources and classifiers
AWSGlueServiceRole-GlueCrawlerRole
IAM role
Set output and scheduling
Run Crawler
Table Created in Lake Formation
Create IAM User
lake-formation-user-1
Awsuser@123
Create user
AthenaFullAccess
Add Athena permissions
S3FullAccess
Add S3 permissions
Grant Permissions to the Table
Grant data lake permissions
Give Super Access
Grant
Data lake permissions
View Data
query result location
Create Bucket for Athena
Add S3 Bucket
Query as Root User
Login as Test User
Awsuser@123
lake-formation-user-1
Successful Querying
Revoke Permission for User
Permissions Revoked
Table not visible
Clean Up
Delete Database
Delete Crawler
Remove Data Lake Locations
Delete IAM User
Delete IAM Roles
Delete Lake Formation Bucket
Delete Athena Bucket
Column 1 | Column 2 | Column 3 |
---|---|---|
Data 1 | Data 2 | Data 3 |
Data 4 | Data 5 | Data 6 |
- Some Text Data
Heading 1
connects
🙏
Thanks
for
Watching
AWS Lake Formation - Hands-On Demo
By Deepak Dubey
AWS Lake Formation - Hands-On Demo
AWS Lake Formation - Hands-On Demo
- 87