Skip to content

Commit 05b7f1f

Browse files
committed
doc: fix endpoints
1 parent 78dceb2 commit 05b7f1f

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

ADVANCED_USAGE.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -69,7 +69,8 @@ Below are all the arguments for `bigcodebench.evaluate` for the remote evaluatio
6969
- `--tokenizer_legacy`: Whether to use the legacy tokenizer, default to `False`
7070
- `--samples`: The path to the generated samples file, default to `None`
7171
- `--no_execute`: Whether to not execute the samples, default to `False`
72-
- `--remote_execute_api`: The API endpoint for remote execution, default to `https://bigcode-bigcodebench-evaluator.hf.space/`, you can also use your own Gradio API endpoint by cloning the [bigcodebench-evaluator](https://huggingface.co/spaces/bigcode/bigcodebench-evaluator) repo and check `Use via API` at the bottom of the HF space page
72+
- `--e2b_endpoint`: The API endpoint for remote execution, default to `bigcodebench_evaluator`, you can also use your own E2B API endpoint by cloning the [bigcodebench-evaluator](https://huggingface.co/spaces/bigcode/bigcodebench-evaluator) repo and check `Use via API` at the bottom of the HF space page
73+
- `--gradio_endpoint`: The API endpoint for remote execution, default to `https://bigcode-bigcodebench-evaluator.hf.space/`, you can also use your own Gradio API endpoint by cloning the [bigcodebench-evaluator](https://huggingface.co/spaces/bigcode/bigcodebench-evaluator) repo and check `Use via API` at the bottom of the HF space page
7374
- `--pass_k`: The `k` in `Pass@k`, default to `[1, 5, 10]`, e.g. `--pass_k 1,5,10` will evaluate `Pass@1`, `Pass@5` and `Pass@10`
7475
- `--calibrated`: Whether to use the calibrated samples, default to `True`
7576
- `--save_pass_rate`: Whether to save the pass rate to a file, default to `True`

0 commit comments

Comments
 (0)