bitnet-b158

Here are 2 public repositories matching this topic...

TQ1.0 ternary inference engine for BitNet b1.58 on CPU. Pack + run Falcon3-1B/3B/7B/10B, no GPU needed.

cpp high-performance simd avx2 quantization ternary bonsai inference-engine bitnet edge-ai ternary-weights cpu-inference local-llm llm-inference falcon3 1bit-llm bitnet-b158

First 1-bit (BitNet b1.58) recursive reasoner for Sudoku-Extreme - distilled from a 7M-param FP TRM teacher into a 1.4 MB ternary student

Add a description, image, and links to the bitnet-b158 topic page so that developers can more easily learn about it.

To associate your repository with the bitnet-b158 topic, visit your repo's landing page and select "manage topics."