Skip to content

pin llama-cpp-python<=0.2.75#23

Open
lapp0 wants to merge 1 commit into
mainfrom
fix-llmaacpp-tests
Open

pin llama-cpp-python<=0.2.75#23
lapp0 wants to merge 1 commit into
mainfrom
fix-llmaacpp-tests

Conversation

@lapp0
Copy link
Copy Markdown
Owner

@lapp0 lapp0 commented May 27, 2024

No description provided.

@lapp0 lapp0 force-pushed the fix-llmaacpp-tests branch from 7116b94 to 07f98e3 Compare May 27, 2024 09:33
@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 27, 2024

Benchmark Suite Results:

Before [592c884] After [4808dd0] Ratio Benchmark (Parameter)
4.92±0.02s 4.98±0.05s 1.01 bench_numba_compile.NumbaCompileBenchmark.time_compile_numba
5.75±0.05s 5.78±0.03s 1.01 bench_regex_guide.RegexGuideBenchmark.time_regex_to_guide('complex_span_constrained_relation_extraction')
351±1ms 353±1ms 1.01 bench_regex_guide.RegexGuideBenchmark.time_regex_to_guide('date')
285±2ms 288±2ms 1.01 bench_regex_guide.RegexGuideBenchmark.time_regex_to_guide('email')
415±4ms 418±4ms 1.01 bench_regex_guide.RegexGuideBenchmark.time_regex_to_guide('url')
4.18±0.01s 4.20±0.02s 1 bench_json_schema.JsonSchemaBenchmark.time_json_schema_to_fsm('complex_schema')
592M 593M 1 bench_regex_guide.MemoryRegexGuideBenchmark.peakmem_regex_to_guide('complex_span_constrained_relation_extraction')
497M 497M 1 bench_regex_guide.MemoryRegexGuideBenchmark.peakmem_regex_to_guide('simple_phone')
621±2ms 622±4ms 1 bench_regex_guide.RegexGuideBenchmark.time_regex_to_guide('complex_phone')
243±2ms 244±2ms 1 bench_regex_guide.RegexGuideBenchmark.time_regex_to_guide('ip')

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant