Skip to content

Conversation

@Asymptotez
Copy link
Contributor

Description

  • Added support for 7B level language model learnwares.
  • Added llm workflow.
  • Bump version to 0.4.0.post1.

How has his PR been tested?

  • Please pass the test by running pytest tests/test_workflow under upper directory of learnware.
  • If you add new features, please test new features on your own test scirpts.

Types of changes

  • This PR fixes bugs
  • This PR adds new features
  • This PR updates documentations or fixes typos

GeneLiuXe and others added 30 commits January 17, 2024 22:15
[FIX, DOC] fix readthedocs config bug, modify framework svg
[MNT] update readthedocs config
[MNT] add sphinx_book_theme req
[FIX] fix readthedocs req with pip
[FIX] fix readthedocs req to install all
[DOC, FIX] update badge, update autodoc config, fix no logo in doc bug
@Asymptotez Asymptotez added documentation Improvements or additions to documentation enhancement New feature or request and removed documentation Improvements or additions to documentation enhancement New feature or request labels May 25, 2025
@Asymptotez Asymptotez requested review from Copilot and removed request for Copilot May 25, 2025 06:57
Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR adds support for 7B-level language model learnwares by introducing a new LLM workflow, benchmark configurations, and example task definitions, and bumps the package version to 0.4.0.post1.

  • Added YAML task definitions for various financial datasets (cra_*, convfinqa, cd, etc.)
  • Introduced examples/dataset_llm_workflow with eval_config.py, build_market.py, and updated benchmark code
  • Updated documentation (README, CHANGES.rst) to include new LLM results and versioning

Reviewed Changes

Copilot reviewed 100 out of 100 changed files in this pull request and generated 6 comments.

Show a summary per file
File Description
examples/dataset_llm_workflow/extra_tasks/flare/*.yaml New task definitions for LLM workflows
examples/dataset_llm_workflow/eval_config.py Configured benchmark sets for medical, math, and finance
examples/dataset_llm_workflow/build_market.py Added LLM market-building script
examples/dataset_llm_workflow/benchmark/config.py Updated LEARNWARE_FIN, commented task entries
examples/dataset_llm_workflow/benchmark/base.py New Benchmark class to manage learnware datasets
examples/dataset_llm_workflow/README.md Usage instructions and results for LLM workflow
README.md & README_zh.md Added LLM experimental results sections
docs/components/market.rst Fixed typo in add_learnware description
CHANGES.rst Bumped version and listed new LLM support
Comments suppressed due to low confidence (1)

examples/dataset_llm_workflow/extra_tasks/flare/convfinqa.yaml:2

  • [nitpick] Class name 'ConvFinQA' uses PascalCase while other task function references are lowercase. Ensure consistency of naming conventions across task definitions.
class: !function flare.ConvFinQA

@Asymptotez Asymptotez closed this May 26, 2025
@Asymptotez Asymptotez deleted the feature/llm branch May 26, 2025 11:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

8 participants