Skip to content

Comments

Lit-node-monitor Updates#9

Draft
GTC6244 wants to merge 63 commits intomasterfrom
lit-node-monitor-update
Draft

Lit-node-monitor Updates#9
GTC6244 wants to merge 63 commits intomasterfrom
lit-node-monitor-update

Conversation

@GTC6244
Copy link
Contributor

@GTC6244 GTC6244 commented Nov 20, 2025

WHAT

WIP on the monitor for development & debugging.

@GTC6244 GTC6244 self-assigned this Nov 20, 2025
@github-actions
Copy link

github-actions bot commented Nov 20, 2025

PASS [ 43.609s] (3/3) lit_node::test toxiproxy::perf_tests::load_with_no_latency
PASS [ 43.688s] (2/3) lit_node::test toxiproxy::perf_tests::load_with_50ms_latency_single_link
PASS [ 88.606s] (1/3) lit_node::test toxiproxy::perf_tests::load_with_50ms_latency_all_links

GTC6244 and others added 26 commits November 20, 2025 10:50
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Better handling of shadow splicing.

* Update rust/lit-node/lit-node/src/tasks/fsm/epoch_change.rs

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* handle old peers

Signed-off-by: Michael Lodder <mike@litprotocol.com>

* Open v2.1.7

---------

Signed-off-by: Michael Lodder <mike@litprotocol.com>
Co-authored-by: Adam Reif <adam@litprotocol.com>
Co-authored-by: Brendon <95836911+GTC6244@users.noreply.github.com>
* Update test

* Update tests

* Update rust/lit-node/lit-node/src/tasks/fsm/epoch_change.rs

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* resync /w keysets feature.

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
GTC6244 and others added 30 commits December 17, 2025 20:51
* Update test

* Update tests

* Setup

* restore datil keys into a second keyset

* remove large binaries

* remove large zip

* cargo fmt

* Updates to DKG / Epoch change processes + correct saving of data to chain.

* fix actions in testnet

* cargo fmt

* patch epoch change retries.

* cargo fmt

* Fix failed DKGs when doing restores.
* Update test

* Update tests

* Setup

* restore datil keys into a second keyset

* remove large binaries

* remove large zip

* cargo fmt

* Updates to DKG / Epoch change processes + correct saving of data to chain.

* Add BLS decryption assertions

* Use correct keyset for assertion

* Update lit-node-testnet to work with ImportedDatilTestnet + start on PKP assertions across chain

This is incomplete.

* Add notes

* Add notes

* fix actions in testnet

* cargo fmt

* Add BLS decryption assertions

* Use correct keyset for assertion

* Update lit-node-testnet to work with ImportedDatilTestnet + start on PKP assertions across chain

This is incomplete.

* Add notes

* Add notes

* Update test to interact with ImportedDatilTestnet

* remove unneded code

* refactor & remove duplications

* Refactor & add datil node secrets

* Update rust/lit-node/lit-node/src/tasks/fsm/epoch_change.rs

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update rust/lit-node/lit-node/src/tss/common/restore/eks_and_ds.rs

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update rust/lit-node/Cargo.toml

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* cargo lock cleanup

* cargo.lock update + config.rs in the resolver formatting.

* patch epoch change retries.

* cargo fmt

* Fix failed DKGs when doing restores.

* cargo fmt

* fix tests

* Logging info for CI datil instances.

* Open ports for a second instance of anvil in the yml files.

* Load hex data from test state into anvil.

* remove unused file

* comment out #if false

* take 2?

* fix test reference

* Use HEX file to load state, rather than a JSON file.

* Refactor to insure that for Datil tests we don't rely on naga cache'd chain state.

* switch lit-recovery binaries for testing

* Remove keyset_identifier as an enum and clean up tests.

* fix datil backup selection of binary.

* cargo fmt

* yml test.

* if false yml

* comment out version upgrade

* yml update

* try a var for the upgrade workflow ?

* update lit-os cargo.lock

* update gitinfo

---------

Co-authored-by: Howard Tam <howard.tam.95@gmail.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
…to support pkps in both chains ) (#42)

* Update test

* Update tests

* Setup

* restore datil keys into a second keyset

* remove large binaries

* remove large zip

* cargo fmt

* Updates to DKG / Epoch change processes + correct saving of data to chain.

* Add BLS decryption assertions

* Use correct keyset for assertion

* Update lit-node-testnet to work with ImportedDatilTestnet + start on PKP assertions across chain

This is incomplete.

* Add notes

* Add notes

* fix actions in testnet

* cargo fmt

* Add BLS decryption assertions

* Use correct keyset for assertion

* Update lit-node-testnet to work with ImportedDatilTestnet + start on PKP assertions across chain

This is incomplete.

* Add notes

* Add notes

* Update test to interact with ImportedDatilTestnet

* remove unneded code

* refactor & remove duplications

* Refactor & add datil node secrets

* Update rust/lit-node/lit-node/src/tasks/fsm/epoch_change.rs

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update rust/lit-node/lit-node/src/tss/common/restore/eks_and_ds.rs

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update rust/lit-node/Cargo.toml

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* whole lotta shaking going on.  ( endpoints changed throughout )

* PKP sign works.

* cargo clippy

* cargo lock cleanup

* git merge fixes

* cargo toml update ( to trigger cargo.lock update )

* cargo.lock update + config.rs in the resolver formatting.

* cargo fmt

* fix panic when node was kicked (realmid = 0)

* patch epoch change retries.

* cargo fmt

* Expose underlying error when peer_connect attestation fails

* Fix failed DKGs when doing restores.

* cargo fmt

* fix tests !

* fix tests

* Logging info for CI datil instances.

* Open ports for a second instance of anvil in the yml files.

* Load hex data from test state into anvil.

* Feature/price setting script (#43)

* first pass at price setting script

* price setting script seems like it will work

* script works on dev and prod

* Update blockchain/contracts/scripts/generatePriceSettingTransactions.ts

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* remove unused map

* regen contracts

* 100x decrease for testnets when setting prices

* divide by 10000 when setting naga-test prices

* actually, made naga-test 100000x cheaper than naga prod

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Brendon <95836911+GTC6244@users.noreply.github.com>

* Fix: Add `correlation_id` to `lit-actions` spans (#25)

* Add spans for actions

* Add correlation_id to TracingMiddleware

* Checkout server.rs

* Extract correlation_id'

---------

Co-authored-by: Chris Cassano <1285652+glitch003@users.noreply.github.com>
Co-authored-by: Brendon <95836911+GTC6244@users.noreply.github.com>

* Refactors OsQuery metrics emission to use OpenTelemetry Gauges (#28)

* Add spans for actions

* Improve metrics

* first pass at adding request id to logs

* Update rust/lit-node/lit-node/src/main.rs

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* change how we set the request id on the span

* clippy

* Add correlation_id to TracingMiddleware

* Checkout server.rs

* Extract correlation_id'

* Fix clippy wanrning

* separate info from gauge metrics (#44)

* Revert "Merge branch 'inf-852-fix-tracing-lit-actions' into inf-753-olly-metrics"

This reverts commit b0a6d38, reversing
changes made to 4a58992.

* Revert "Merge remote-tracking branch 'origin/feature/NODE-4860-correlation-id-in-logs' into inf-753-olly-metrics"

This reverts commit 7be7bbe, reversing
changes made to b0a6d38.

* cargo fmt

---------

Co-authored-by: Chris Cassano <chris@litprotocol.com>
Co-authored-by: Chris Cassano <1285652+glitch003@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Adam Reif <adam@litprotocol.com>

* remove unused file

* comment out #if false

* take 2?

* fix test reference

* Use HEX file to load state, rather than a JSON file.

* Refactor to insure that for Datil tests we don't rely on naga cache'd chain state.

* switch lit-recovery binaries for testing

* Remove keyset_identifier as an enum and clean up tests.

* Fix up tests

* cargo fmt

* fix datil backup selection of binary.

* logging, shorten handshake challange value.

* fix "default" keyset bug :(

* cargo fmt

* yml test.

* if false yml

* comment out version upgrade

* yml update

* try a var for the upgrade workflow ?

* upgrade yml with default if statement.

* cargo clippy.

* Update lit-os cargo.lock

* update lit-os cargo.lock

* update gitinfo

* fix restore test to use Datil directly.

* cargo fmt

* patch so both long running restores work :(

* Update epoch change long to deal with keysets

* small shiva refactor

* difference between pkp & root key lookups when getting a keyset.

* remove datil from lit action testing.

* clean up integration test setup to account for keyset settings.

* limit caches to only active states.

* Fix Shadow splicing test, make some integration force builds

* update abis & lit-os lock file

* cargo fmt + minor cleanup

* Refactor one of the last timing related tests.

* ABI staleness, remove more testing feature flags

* Make the StakerAccountSetupMapper Send+Sync to allow Shiva to build.

* Clean up complaints.

* Update to determine key set for recovery (#58)

* update to determine key set for recovery

Signed-off-by: Michael Lodder <mike@litprotocol.com>

* add test when no key set is on chain

Signed-off-by: Michael Lodder <mike@litprotocol.com>

* update test

Signed-off-by: Michael Lodder <mike@litprotocol.com>

---------

Signed-off-by: Michael Lodder <mike@litprotocol.com>
Co-authored-by: Brendon <95836911+GTC6244@users.noreply.github.com>

* Better logging.

---------

Signed-off-by: Michael Lodder <mike@litprotocol.com>
Co-authored-by: Howard Tam <howard.tam.95@gmail.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Adam Reif <adam@litprotocol.com>
Co-authored-by: Adam Reif <stadamreif@gmail.com>
Co-authored-by: Chris Cassano <1285652+glitch003@users.noreply.github.com>
Co-authored-by: Abhi... <Kapoorabhishek24@gmail.com>
Co-authored-by: Chris Cassano <chris@litprotocol.com>
Co-authored-by: Michael Lodder <mike@litprotocol.com>
* fix invalid signature combination

Signed-off-by: Michael Lodder <mike@litprotocol.com>

* fix tests

Signed-off-by: Michael Lodder <mike@litprotocol.com>

---------

Signed-off-by: Michael Lodder <mike@litprotocol.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants