This repo sets a rudimentary data stack to analyze logs from the National UFO Reporting Center. We construct a data cube using some basic dimensions associated with Canadian census divisions and dates.
-
Download the csv from the prompt into the
seeds/datafile. -
Start the database with
make up, you'll need Docker installed. -
Make the migrations and seeds with
make migrate,make seed -
Run
bash scripts/census_division.sh -
Build the transformations with
make build
By default, the dbt project stargazer points to the local database and any table can be dumped to a csv. Install stargazer/requirements.txt to your virtualenv to use the dbt CLI.
We use ObservableHQ to create some visualizations from the analytics.
Find examples here - Link