Commit 5ce4a22
Feature: Run audits concurrently using concurrent_tasks setting
When audit_only=True, all audit tasks across all snapshots are flattened
into a single thread pool instead of following DAG ordering. Since audits
are read-only SELECT queries with no side effects, DAG dependencies are
irrelevant and all concurrent_tasks worker slots stay filled.
Per-model audit concurrency is also plumbed through SnapshotEvaluator.audit()
via a new audit_concurrent_tasks parameter (defaults to sequential). The
cross-model path hardcodes this to 1 to avoid nested thread pool
multiplication.
The SnapshotEvaluator parameter ddl_concurrent_tasks is renamed to
concurrent_tasks to reflect its broader scope.
Closes #5468
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>1 parent cea8418 commit 5ce4a22
File tree
5 files changed
+985
-135
lines changed- sqlmesh/core
- snapshot
- tests/core
5 files changed
+985
-135
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
492 | 492 | | |
493 | 493 | | |
494 | 494 | | |
495 | | - | |
| 495 | + | |
496 | 496 | | |
497 | 497 | | |
498 | 498 | | |
| |||
0 commit comments