Blog about our data processing flow

[mimming]

Background

I hacked up a data flow diagram to help nail down some terms. It was originally intended to prep for ksf's internship contributions.

It turned out to be a useful experiment. Josh recommended that we expand it into a blog post.

Task

• Write up a blog post based on this slide
• Focus on the kind of data flowing around, and the volume of data we expect
• As a secondary thing, use it as a place to define some terminology relevant to our data pipeline

It's also a good opportunity to talk about the GCP involvement :)