Skip to content

Add Lakebase Postgres Autoscaling skill#26

Merged
pkosiec merged 6 commits intomainfrom
pkosiec/lakebase-skill
Mar 10, 2026
Merged

Add Lakebase Postgres Autoscaling skill#26
pkosiec merged 6 commits intomainfrom
pkosiec/lakebase-skill

Conversation

@pkosiec
Copy link
Member

@pkosiec pkosiec commented Mar 4, 2026

⚠️ This PR needs to the next CLI release.

Summary

  • Add new databricks-lakebase skill for managing Lakebase Postgres projects, branches, endpoints, and databases via databricks postgres CLI commands.
  • Uses a dynamic CLI discovery approach (databricks postgres -h / <subcommand> -h) instead of hardcoding all commands, keeping the skill resilient to CLI changes during beta.
  • Bump minimum CLI version to v0.292.0 across all skills.
  • Register databricks-lakebase in the parent databricks skill's product list.

Design decisions

  • Dynamic over static: Instead of a 335-line hardcoded CLI reference, the skill instructs agents to run databricks postgres -h and databricks postgres <subcommand> -h to discover commands. This mirrors the pattern used in databricks-apps (which uses databricks apps manifest for discovery).
  • Kept conceptual content: Resource hierarchy, auto-provisioning behavior, copy-on-write branching, expiration policy gotchas, scale-to-zero defaults, and the "Build a Databricks App" integration workflow -- none of which are discoverable from --help.

Test plan

  • Verify databricks postgres -h returns expected subcommands with CLI >= v0.292.0
  • Validate manifest: python3 scripts/generate_manifest.py validate
  • Test skill with an agent: create a Lakebase project end-to-end using only the skill guidance

How I tested it?

As the skill needs an upcoming Databricks CLI, and also we couldn't test Lakebase + Apps creation fully, what I did is:

  • I symlinked the new Databricks CLI, asked to create an app
  • before deployment, I removed App Lakebase resource reference in DABs, deployed it, and then connected Lakebase via UI (the project/branch that Agent created)
  • after manual redeploy, everything worked

name: databricks-apps
description: Build apps on Databricks Apps platform. Use when asked to create dashboards, data apps, analytics tools, or visualizations. Invoke BEFORE starting implementation.
compatibility: Requires databricks CLI (>= v0.288.0)
compatibility: Requires databricks CLI (>= v0.292.0)
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Future version is not a mistake - the current CLI doesn't have list-databases command

@pkosiec pkosiec force-pushed the pkosiec/lakebase-skill branch 2 times, most recently from be27832 to 2290b2b Compare March 5, 2026 13:02
@pkosiec pkosiec marked this pull request as ready for review March 5, 2026 13:02
@pkosiec pkosiec requested review from a team and lennartkats-db as code owners March 5, 2026 13:03
@pkosiec pkosiec requested a review from arsenyinfo March 6, 2026 10:07
@pkosiec pkosiec force-pushed the pkosiec/lakebase-skill branch from 3c2fef3 to 2d0acf4 Compare March 10, 2026 09:41
- **Call ML model endpoint**: Use tRPC
- **Write/update data (INSERT/UPDATE/DELETE)**: Use tRPC
- **⚠️ NEVER use tRPC to run SELECT queries** — always use SQL files in `config/queries/`
- **⚠️ NEVER use tRPC to run SELECT queries against the warehouse** — always use SQL files in `config/queries/`
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we cover it with linters?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you mean preventing doing DB SQL queries not using the config/queries convention? No, I don't think so, and it would be tricky to implement, and also limiting to a user 🤔 some queries might be done via custom backend logic IMO

pkosiec and others added 6 commits March 10, 2026 12:32
Add new `databricks-lakebase` skill for managing Lakebase Postgres
projects, branches, endpoints, and databases. Uses a dynamic CLI
discovery approach (`databricks postgres -h`) instead of hardcoding
all commands, keeping the skill resilient to CLI changes during beta.

Also bump minimum CLI version to v0.292.0 across all skills and
register Lakebase in the parent databricks skill's product list.
- Fix list-databases inconsistency: use full resource path format in
  both the verification block and the What's Next step
- Add concrete update-branch + delete-branch examples with full resource
  paths; add production branch safety warning
- Rename section to "What's Next" and add "Other Workflows" subsection
  with brief snippets for connecting a Postgres client, managing roles,
  and adding a read-only endpoint
- Add brainstorm doc for the What's Next redesign decision

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
- Label Lakebase as "OLTP" in AppKit data pattern table for LLM clarity
- Add brief Lakebase description with Neon reference in SKILL.md
@pkosiec pkosiec force-pushed the pkosiec/lakebase-skill branch from 6b0acb4 to cfdf274 Compare March 10, 2026 11:33
@pkosiec pkosiec merged commit eba9053 into main Mar 10, 2026
1 check passed
@arsenyinfo arsenyinfo deleted the pkosiec/lakebase-skill branch March 10, 2026 11:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants