Terraform/Scripts/AWS CLI

Creates Clones of System

  • Manages Elastic Beanstalk, profiles, etc.
  • System-specific S3 buckets
  • Scripts manage Datomic CloudFormation stack

Global S3 Buckets

  • Deployment assets
  • Security credentials
  • Configurations (Datomic, systems, etc)

Multiple Systems

Admin CLI

Pret

System specific user tools

Candelabra

API Endpoint

IAM

Datomic
(DynamoDB)

Gaslight

Query Worker Service

GCP Auth

S3

Candelabra

  • Ingests datasets creating launch templates and AMIs
  • Manages branch instances
  • Submits query jobs to SQS

Elastic Beanstalk Web Tier

S3

User CLIs

Ingest DB

Datomic

EC2 instances from launch template

Branch DB

Datomic

Branch DB

Datomic

Branch DB

Datomic

Empty Dbs

DDB-backed

DDB-backed

OR

Candelabra

API Endpoint

Gaslight Query Service

Elastic Beanstalk Worker Tier

  • Executes long-running queries 
  • Jobs via SQS
  • Autoscaling via CloudWatch metrics published by Candelabra

SQS

CloudWatch

Datomic

User CLIs

Query Request

Query Job/CloudWatch Events

SQS Message, Job Coordination

Parker CANDEL July 2020

By gatewayspectacle

Parker CANDEL July 2020

  • 110