Extended Data Library

A collection of high-performance Python libraries and tools for data processing, configuration management, logging, and cloud integrations.

Packages

Package	Version	Description
extended-data-types		Typed utilities for YAML, JSON, TOML, HCL, Base64, file paths, strings, lists, and maps
lifecyclelogging		Lifecycle-aware logging with rich output, verbosity control, and message storage
directed-inputs-class		Transparent input handling from environment variables, stdin, and config files
vendor-connectors		Universal cloud and service connectors (AWS, GitHub, Slack, Vault, Anthropic, Cursor, Meshy)
secretssync		Enterprise-grade secret synchronization pipeline (Go)

Quick Start

# Python packages
pip install extended-data-types
pip install lifecyclelogging
pip install directed-inputs-class
pip install vendor-connectors

# Python integration for SecretSync workflows
pip install vendor-connectors[secrets]

# SecretSync CLI
go install github.com/jbcom/extended-data-library/packages/secretssync/cmd/secretsync@latest

Monorepo Structure

extended-data-library/
  packages/
    extended-data-types/   Python foundation utilities
    lifecyclelogging/      Structured logging library
    directed-inputs-class/ Configuration and input handling
    vendor-connectors/     Cloud and service connectors
    secretssync/           Secret sync pipeline (Go)
  docs/                    Documentation site (Astro + Sphinx)
  tox.ini                  Test orchestration
  justfile                 Developer task runner

Development

Prerequisites

• Python 3.10+
• uv (package manager)
• Go 1.25+ (only for secretssync)

Setup

git clone https://github.com/jbcom/extended-data-library.git
cd extended-data-library
uv sync

GitHub CLI

Use gh directly with your existing local authentication context.

gh auth status
gh pr list

Running Tests

# All Python packages
tox -e edt,logging,inputs,connectors

# Single package
tox -e edt

# Using just
just test

Linting and Formatting

tox -e lint

# Or directly
uvx ruff check packages/
uvx ruff format packages/

Commit Conventions

This project uses Conventional Commits with scoped types:

feat(edt): add new TOML parser        # minor bump for extended-data-types
fix(logging): handle empty messages    # patch bump for lifecyclelogging
feat!: breaking API change             # major bump

Documentation

Full documentation is available at extended-data.dev.

License

MIT -- Copyright (c) 2025 Extended Data Library