Leios EB inclusion

[bladyjoker]

input-output-hk/ouroboros-leios#774

DONE

• Ledger: [DO-NOT-MERGE] Leios prototype cardano-ledger#5626

  • New Block fields blockMayAnnouncedEb :: Maybe EbHash and blockCertifiesEb :: Bool(NOTE: Currently we keep this in the body and not the header)
  • ShelleyLedgerState in OuroborosConsensus is tracking the last announced EB
  • applyBlock for ConwayEra handles a Certificate Body.

• Forge: Issues a Block with EB announcement and Certificates

  • When the EB was produced it's marked in the forged LedgerBlock (blockMayAnnouncedEb)
  • When the previously announced EB is fully downloaded (entire tx closure is available) and (mock) certified, the use of that EB is marked in the new LedgerBlock (blockCertifiesEb)
  • !!! Mempool Partitioning !!! - We currently split the transactions in the Mempool in 2 parts, first part is for a Block with inlined transactions and second for an EB. However, that's a problem!
    When a Leader tries to forge a Block with a Certificate AND additionally wants to announce a new EB, the transaction in that EB are likely to be invalid wrt to the Ledger state induced by the application of the Certificate.
    Instead, when a Certified EB is available during Forge, Mempool needs to be "rebased" to a Ledger state after the Certified EB application (and the surviving transactions can go to an EB and be announced)
    • Skip announcement when certifying as an interim solution (see 02ef504)

• ChainDB: When the blk contains a Leios Certificate we must resolve its transaction closure in order to applyBlock

  • resolveLeiosBlock call (ResolveLeiosBlock blk class method) was introduced in a call chain to applyBlock to resolve the transactions if the blk contains a Leios Certificate
  • Shelley resolveLeiosBlock resolves the transaction closure and provides it to the Ledger

• Test

  • Test new LeiosDB queries
  • Test that a EB has been announced
  • Test that a Certificate has been included
  • Old ouroboros-consensus tests are passing?

• Sqlite implementation

  • Get tx closure by EB Point
  • Get certificate by EB Point

[bladyjoker]

Mempool partitioning with Certificates

forge leiosDb mempool = do
  mayCertifiedEb <- getCertifiedEb leiosDb
  case mayCertifiedEb of
    -- As is now
    Nothing -> do
      mempoolTxs <- snapshotMempool mempool    
      (inlinedTxs, restTxs) <- splitTxs praosCapacity mempoolTxs 
      ebTxs <- splitTxs ebCapacity restTxs
      forgeBlock (InlinedTxs inlinedTxs) ebTxs
    -- With the Certificates
    Just (cert, certifiedEbTxs) -> do
      rebaseAndApplyMempool mempool certifiedEbTxs -- magic
      mempoolTxs <- snapshotMempool mempool         
      (eb, restTxs) <- splitTxs ebCapacity mempoolTxs 
      forgeBlock cert ebTxs