Skip to content

About

A recent takehome. Asked to build a pipeline of randomly generated data, and serve it with an API - was given specific AWS tools to work with

Resources

Stars

0 stars

Watchers

1 watching

Forks

Latest commit

 

History

17 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

See info.md for Design Decisions


How To run

Set up Parts 1-3 in AWS (lambda Functions, and DynamoDB)

The included terraform files will allow you to 1) simulate the site data Feed, 2) process the data feed data from S3 3) create the dynamo db it will be placed in

cd tf
terraform init
terraform plan # check to make sure 13 number of resources are being made
terraform apply

The user that terraform is using should at least have access t

API

First, install the required python packages, by setting up a local python environment

python -m venv venv
.\venv\Scripts\Activate.ps1 # source venv/bin/activate on unix
python -m pip install -r requirements.txt

I ran the API on python 3.10.11 on a Windows machine with Powershell

cd api
flask run

api output example

Visualization

Use the same python environment / requirements file.

cd visualization
python visualization.py

avg consumption vs generated per site

About

A recent takehome. Asked to build a pipeline of randomly generated data, and serve it with an API - was given specific AWS tools to work with

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

Packages

Used by

Contributors

Languages