FEAT: PAAL-151 Add Testworkflows#3

Merged

62 commits merged intomainfrom

FEAT-PAAL-151-add-testworkflows

Nov 13, 2025

Commits on Oct 30, 2025

FEAT: PAAL-151 Add Testworkflows
MiaAppel
committed

Commits on Oct 31, 2025

FEAT: Add unit tests & test datasets
MiaAppel
committed

Commits on Nov 4, 2025

FIX: Plenty of fixes / small refactorings in coordination with @fmallmann
MiaAppel
committed
FIX: reposition the call to evaluate() from calculate_metrics to main, refactor calculate_metrics to convert_metrics and adjust test_evaluate.py accordingly
MiaAppel
committed

Commits on Nov 6, 2025

FEAT: Migrate metrics publishing from Prometheus Pushgateway to OpenTelemetry OTLP
fmallmann
committed
FIX: TokenUsageParser now functions correctly even when using Non-LLM Metrics or NVIDIA Metrics
MiaAppel
committed
FIX: remove unused veriable 'df'
MiaAppel
committed
FIX: remove unused variable 'results' in run.py
MiaAppel
committed
feat: initial tilt setup
fmallmann
committed
FEAT: added Bandit, MyPy, Import-Linter, Poe, Ruff
MiaAppel
committed
FIX: Formatting
MiaAppel
committed
FIX: Formatting
MiaAppel
committed
FIX: Add config for Import-Linter, Ruff & Bandit to pyproject.toml
MiaAppel
committed
FIX: Type Errors in run.py
MiaAppel
committed
FIX: Type Errors in setup.py
MiaAppel
committed
FIX: Remove unnecessary dependencies & add missing ones
MiaAppel
committed
FIX: Type Errors in evaluate.py
MiaAppel
committed
FIX: Add scripts/ to mypy_path
MiaAppel
committed
FIX: Adapt test_e2e.py as a Pytest and add it to the Workflows
MiaAppel
committed
FIX: Adapt test_publish.py to the OpenTelemetry OTLP, adjust Error in test_evaluate.py
MiaAppel
committed
FEAT: Use Python Version File to set Python Version
MiaAppel
committed
FIX: setup of test-testworkflows.yml
MiaAppel
committed
FIX: setup of test-testworkflows.yml
MiaAppel
committed
Merge remote-tracking branch 'origin/FEAT-PAAL-151-add-testworkflows' into FEAT-PAAL-151-add-testworkflows
MiaAppel
committed
FEAT: add Tiltfile to test-testworkflows.yml to properly test test_e2e.py
MiaAppel
committed
FEAT: add Tiltfile to test-testworkflows.yml to properly test test_e2e.py
MiaAppel
committed
FIX: Type Error in evaluate.py
MiaAppel
committed
FIX: Tiltfile Error in test-testworkflows.yml
MiaAppel
committed
FIX: Add GOOGLE_API_KEY Github Secret
MiaAppel
committed
FIX: wait for Test-Data-Server to start up before running Pytests
MiaAppel
committed
FEAT: Implement Test-Data-Server in Github Action (Tilt CI shuts it down)
MiaAppel
committed
FIX: no more double Test-Data-Server in CI
MiaAppel
committed
FIX: add OPENAI_API_KEY Placeholder so test_e2e.py can run
MiaAppel
committed
FIX: add Timeout to Request
MiaAppel
committed
FIX: up2date uv.lock
MiaAppel
committed
FIX: ignore various low-risk warnings
MiaAppel
committed
FEAT: Add Check Workflow that runs 'uv poe check'
MiaAppel
committed
FIX: incorrect path to python-version-file
MiaAppel
committed
FIX: incorrect working-directory in check-testworkflows.yml
MiaAppel
committed
Revert "FIX: incorrect working-directory in check-testworkflows.yml"
MiaAppel
committed
Revert "FIX: incorrect path to python-version-file"
MiaAppel
committed
Revert "FEAT: Add Check Workflow that runs 'uv poe check'"
MiaAppel
committed
REFACTOR: Adapt check-testworkflows.yml to run all checks instead of only Pytest
MiaAppel
committed
FIX: update pyproject.toml and uv.lock
MiaAppel
committed

Commits on Nov 11, 2025

REFACTOR: create e2e_tests/ directory
MiaAppel
committed
REFACTOR: add test_e2e to POE tasks
MiaAppel
committed
REFACTOR: adapt test-e2e.yml to run the testworkflow e2e test
MiaAppel
committed
REFACTOR: rename to check.yml and remove E2E-Test scaffolding
MiaAppel
committed
REFACTOR: replace Go Tests with Testworkflow Tests
MiaAppel
committed
FIX: Formatting
MiaAppel
committed
FIX: Rename E2E Test folder
MiaAppel
committed
REFACTOR: divide dependencies into dev and prod
MiaAppel
committed
FIX: wrong directory for test_e2e
MiaAppel
committed
FIX: adapt uv commands to dev & prod dependencies
MiaAppel
committed
FIX: use native Pytest functionality instead of importing Unittest
MiaAppel
committed
FIX: remove issues Linter & Bandit currently ignore
MiaAppel
committed
FIX: Formatting
MiaAppel
committed
FIX: Imports
MiaAppel
committed
FIX: Imports
MiaAppel
committed
FIX: Update uv.lock
MiaAppel
committed
FEAT: Documentation for Testworkflows
MiaAppel
committed

Commits on Nov 13, 2025

REFACTOR: restructure Dependencies & dependency groups
MiaAppel
committed