Skip to content

Update pipeline skills#31

Merged
lennartkats-db merged 2 commits intomainfrom
update/skills-2026-03-08
Mar 10, 2026
Merged

Update pipeline skills#31
lennartkats-db merged 2 commits intomainfrom
update/skills-2026-03-08

Conversation

@lennartkats-db
Copy link
Collaborator

Summary

Updates Lakeflow Spark Declarative Pipelines skill with a comprehensive decision tree, common traps guide, publishing modes, and full API reference tables. Adds new ForEachBatch Sink reference.

Changes

  • SKILL.md: Added Decision Tree, Common Traps, Publishing Modes, and comprehensive API Reference tables for all dataset, flow, CDC, and data quality APIs
  • python-basics.md: Added @dp.foreach_batch_sink() to Core Functions; streamlined by consolidating per-feature rules into SKILL.md
  • sql-basics.md: Clarified CREATE OR REFRESH as preferred convention; streamlined by consolidating per-feature rules into SKILL.md
  • foreach-batch-sink.md (new): Overview of ForEachBatch Sinks with use cases and language support
  • foreach-batch-sink-python.md (new): Python API reference with merge/upsert, multi-target, and enrichment patterns

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@lennartkats-db lennartkats-db requested a review from a team as a code owner March 8, 2026 13:55
@lennartkats-db lennartkats-db merged commit 7566ae9 into main Mar 10, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants