Skip to content

firedancer-io/protosol

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

241 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Protosol

Protocol buffer definitions for the Solana Virtual Machine (SVM) testing harness in Agave. This crate provides Rust bindings for protobuf schemas used in fuzzing and testing the Solana blockchain's execution environment.

Overview

Protosol defines the data structures used to capture, serialize, and replay Solana blockchain execution contexts for testing and fuzzing purposes. These protocol buffers represent the complete state and execution flow of Solana transactions, blocks, and virtual machine operations.

What These Protocol Buffers Represent

Core Components

  • Transaction Processing: Complete transaction lifecycle from input to execution effects
  • Block Execution: Block-level context including transactions, account states, and consensus data
  • Virtual Machine State: SVM execution context, compute budgets, and program execution
  • Account Management: Account states, ownership, and data storage
  • Consensus Context: Slot information, epoch data, and leader schedules

Usage

As a Dependency

Add to your Cargo.toml:

[dependencies]
protosol = "X.Y.Z"

Basic Usage

use protosol::protos;

// Create a transaction fixture
let txn = protos::SanitizedTransaction {
    message: Some(protos::TransactionMessage {
        header: Some(protos::MessageHeader {
            num_required_signatures: 1,
            num_readonly_signed_accounts: 0,
            num_readonly_unsigned_accounts: 0,
        }),
        account_keys: vec![/* account keys */],
        recent_blockhash: vec![/* blockhash */],
        instructions: vec![/* instructions */],
        address_table_lookups: vec![],
    }),
    signatures: vec![vec![/* signature bytes */]],
};

// Create account state
let account = protos::AcctState {
    address: vec![/* 32-byte address */],
    lamports: 1000000,
    data: vec![/* account data */],
    executable: false,
    owner: vec![/* 32-byte owner */],
};

// Create block context for testing
let block_ctx = protos::BlockContext {
    txns: vec![txn],
    acct_states: vec![account],
    blockhash_queue: vec![/* recent blockhashes */],
    slot_ctx: Some(protos::SlotContext {
        slot: 12345,
        poh: vec![/* POH hash */],
        parent_bank_hash: vec![/* parent hash */],
        parent_lthash: vec![/* parent LT hash */],
    }),
    features: Some(protos::FeatureSet {
        features: vec![/* feature flags */],
    }),
    bank: None,

Testing and Fuzzing

These protocol buffers are designed for:

  1. Test Fixture Generation: Create reproducible test cases with complete blockchain state
  2. Fuzzing: Generate random but valid blockchain execution contexts
  3. State Capture: Record actual blockchain execution for later replay
  4. Regression Testing: Compare execution results across different SVM implementations

Integration with Agave

This crate is specifically designed for use with the anza-xyz/agave repository's testing infrastructure:

  • SVM Fuzzing: Generate test cases for the Solana Virtual Machine
  • Execution Testing: Validate transaction and block execution across different implementations
  • Performance Testing: Measure execution costs and resource usage
  • Compatibility Testing: Ensure different SVM implementations produce identical results

Usage

Add to your Cargo.toml:

[dependencies]
protosol = "6.0.0"

No system dependencies needed β€” pre-generated Rust code is included.

Development

Setup

git clone --recurse-submodules https://github.com/firedancer-io/protosol.git
cd protosol
cargo build                # Uses pre-generated code, no tools needed

Pre-commit hooks

git config core.hooksPath .githooks

Modifying proto schemas

If you change files in proto/, you must regenerate src/generated/:

./deps.sh    # Builds protoc from vendored submodule into opt/bin/
cargo build --features regenerate --locked

The exact pinned compiler revision comes from the submodule commit recorded in this repository (.gitmodules records its URL and branch hint). The deps.sh script builds from this vendored submodule. Prerequisites for deps.sh: CMake, Make, C++ compiler.

CI

CI runs on every push and pull request:

  • cargo fmt --check
  • cargo build --release --locked (default and solana-types features)
  • cargo clippy --all-features --locked -- -D warnings
  • Regenerates from source and verifies src/generated/ is up to date

File Structure

src/generated/           # Pre-generated Rust code (checked in, no tools needed to build)

proto/
β”œβ”€β”€ block.proto          # Block execution context and effects
β”œβ”€β”€ context.proto        # Account states and execution context
β”œβ”€β”€ elf.proto            # ELF loader fuzz fixtures
β”œβ”€β”€ gossip.proto         # Gossip protocol structures
β”œβ”€β”€ invoke.proto         # Program invocation context
β”œβ”€β”€ metadata.proto       # Test fixture metadata
β”œβ”€β”€ pack.proto           # Compute budget testing
β”œβ”€β”€ serialize.proto      # Serialization structures
β”œβ”€β”€ shred.proto          # Shred structures
β”œβ”€β”€ txn.proto            # Transaction structures
β”œβ”€β”€ vm.proto             # Virtual machine state
└── *.options            # Nanopb configuration files

shlr/
└── protobuf/            # Vendored protobuf compiler (submodule, pinned in .gitmodules)

License

Apache-2.0

Repository

https://github.com/firedancer-io/protosol

About

A repository for Protobuf definitions

Resources

License

Stars

Watchers

Forks

Packages

 
 
 

Contributors