Improve restart recovery, snowflake batching, & CI#254
Merged
Conversation
Introduce restart-recovery improvements and various optimizations across the codebase. Key changes: reconcile and persist in-memory state-machine progress from persisted last_applied (KalamRaftStorage, RaftGroup, RaftManager) and emit clearer replication timeout details; commit last_applied while applying entries and return errors for apply failures to avoid silent progress. Add SnowflakeGenerator::next_ids_mapped to avoid intermediate allocations and wire it into system SeqId generation + new benchmarks and tests for mapped and concurrent generation. Fix embedded UI asset serving to avoid unnecessary copies, tweak websocket heartbeat handling, add deterministic initial-row sorting and tests, and adjust health monitor trimming logic. CI and developer tooling: set test env vars and add verification for TypeScript package test coverage in workflows, add new TypeScript ORM files and UI component updates, and change Docker base image to Ubuntu 24.04.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Introduce restart-recovery improvements and various optimizations across the codebase. Key changes: reconcile and persist in-memory state-machine progress from persisted last_applied (KalamRaftStorage, RaftGroup, RaftManager) and emit clearer replication timeout details; commit last_applied while applying entries and return errors for apply failures to avoid silent progress. Add SnowflakeGenerator::next_ids_mapped to avoid intermediate allocations and wire it into system SeqId generation + new benchmarks and tests for mapped and concurrent generation. Fix embedded UI asset serving to avoid unnecessary copies, tweak websocket heartbeat handling, add deterministic initial-row sorting and tests, and adjust health monitor trimming logic. CI and developer tooling: set test env vars and add verification for TypeScript package test coverage in workflows, add new TypeScript ORM files and UI component updates, and change Docker base image to Ubuntu 24.04.