notes.md

Random notes

Interesting tech

• OpenZL -- DAG and codecs for "universal encoding/decoding"
• 6cy -- "High-performance, streaming-first container format with per-block codec polymorphism"
  • Hacker news post
• Vortex -- "An extensible, state of the art columnar file format"
  • Article on optimizations / Hacker news post
• Lance -- "Lance is an open lakehouse format for multimodal AI"
• Rasteret
  • blog post
  • EO image datasets should be tables, not folders
• Croissant/GeoCroissant
  • Geo slide deck
• TACOspec
  • Slide deck 1
  • Slide deck 2
• F3: Future-proof File Format, a new columnar format
  • From pandas to Arrow: Wes McKinney on the Future of Data Infrastructure
  • repo
  • Self-Extracting F3