We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 3b93787 commit 1f1f649Copy full SHA for 1f1f649
1 file changed
README.md
@@ -20,26 +20,16 @@ git clone --recursive https://github.com/DD-DuDa/BitDecoding.git
20
conda create -n bitdecode python=3.10
21
conda activate bitdecode
22
pip install -r requirements.txt
23
-python setup.py install
+bash install.sh
24
```
25
26
## Quick Start
27
-1. See benchmark/bench_single_decode.ipynb
28
-2. (Optional) Play with libtorch c++
29
- ```
30
- # download libtorch
31
-
32
- cd BitDecoding/csrc/bit_decode
33
- mkdir build && cd build
34
- cmake -DCMAKE_PREFIX_PATH=<libtorch_path> ..
35
- make -j12
36
37
38
-## Release Progress
39
40
-- [x] Page Implementation
41
-- [ ] End-2-end LLMs Inference
42
-- [ ] Hopper Implementation
+1. Run the GSM8K example
+ ```
+ cd evaluation
+ bash scripts/example.sh
+
43
44
45
## Citation
0 commit comments