From CSV to DynamoDB

Serverless transforms that don't break the bank

ATX Serverless Workshop - March 2019

Julia Jacobs

  • AWS Associate Architect
  • Microsoft Bizspark Program - Azure 
  • Heroku Platform Engineer - Salesforce.com

https://github.com/jewelsjacobs

https://www.linkedin.com/in/juliajacobs/

jjacobs@neweracode.com

Chief Solutions Architect

New Era Code

Setup 

Node.js v6.5.0 or later. You can install the Binary, a version manager, Ie. nvm or OS package manager, Ie. homebrew:

Set-up your Provider Credentials -> Watch the video on setting up credentials

Serverless CLI v1.9.0 or later. You can run:

$ npm install -g serverless

An AWS account. If you don't already have one, you can sign up for a free trial

$ brew install node

Add the name of the serverless user profile to private.yml

Setup (cont) 

AWS Athena Settings:

Text

Query result location: s3://atxworkshop-athena-dev/results/

Setup  

$ git clone git@github.com:NewEraCodeRepo/atx-serverless-transforms-workshop.git
$ cd atx-serverless-transforms-workshop
$ npm i

Run  

$ serverless deploy --stage dev
$ serverless s3deploy --stage dev

Run locally  

$ export NODE_ENV="development"
$ chmod 755 env.sh
$ ./env.sh
$ docker-compose up -d
$ sls offline start

You will not be able to run the Athena lambdas locally. You will need to either comment them out in the serverless.xml and use mock files in the local s3 bucket or maintain a connection to Athena in AWS.

 

It will probably take some tweaking regardless.

Log into AWS And See .. 

  • Athena
  • Lambdas
  • DynamoDB
  • CloudWatch Logs
  • X-Ray

Thanks!

From CSV to DynamoDB

By Julia Jacobs

From CSV to DynamoDB

  • 223

More from Julia Jacobs