Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 1 addition & 7 deletions .github/workflows/testing.yml
Original file line number Diff line number Diff line change
Expand Up @@ -92,13 +92,7 @@ jobs:
run: poetry run ruff check --output-format=github
- name: Run type checks
run: poetry run mypy --show-error-codes --pretty
- name: Run tests with pandas backend
env:
VTL_ENGINE_BACKEND: pandas
run: poetry run pytest -n auto --verbose --tb=short --durations=10
- name: Run tests with duckdb backend
env:
VTL_ENGINE_BACKEND: duckdb
- name: Run tests
run: poetry run pytest --cov=vtlengine -n auto --verbose --tb=short --strict-markers --strict-config --durations=10
- name: Check coverage
run: poetry run coverage report --fail-under=85
7 changes: 1 addition & 6 deletions .github/workflows/ubuntu_test_24_04.yml
Original file line number Diff line number Diff line change
Expand Up @@ -91,12 +91,7 @@ jobs:
env:
PIP_BREAK_SYSTEM_PACKAGES: "1"

- name: Run tests (pandas backend)
env:
VTL_ENGINE_BACKEND: pandas
run: pytest --verbose --tb=short --strict-markers --strict-config --durations=10

- name: Run tests (duckdb backend)
- name: Run tests
env:
VTL_ENGINE_BACKEND: duckdb
run: pytest --verbose --tb=short --strict-markers --strict-config --durations=10
2 changes: 0 additions & 2 deletions docs/duckdb_engine.rst
Original file line number Diff line number Diff line change
Expand Up @@ -74,7 +74,6 @@ materialised in memory:
data_structures=data_structures,
datapoints=datapoints,
output_folder=Path("./vtl-output"),
use_duckdb=True,
)

When no ``output_folder`` is provided, the dataset values returned in ``run_result.data``
Expand Down Expand Up @@ -179,7 +178,6 @@ When ``use_duckdb=True`` you may pass S3 URIs as ``datapoints`` and as ``output_
data_structures=data_structures,
datapoints="s3://my-bucket/input/DS_1.csv",
output_folder="s3://my-bucket/output/",
use_duckdb=True,
)

Authentication uses the standard AWS environment variables (``AWS_ACCESS_KEY_ID``,
Expand Down
6 changes: 3 additions & 3 deletions src/vtlengine/API/_InternalApi.py
Original file line number Diff line number Diff line change
Expand Up @@ -217,7 +217,7 @@ def _load_single_datapoint(
raise InputValidationException(
code="0-1-1-2",
input=datapoint,
message="S3 URIs are only supported with use_duckdb=True.",
message="S3 URIs are not supported in this code path.",
)
# Converting to Path object
try:
Expand Down Expand Up @@ -297,7 +297,7 @@ def _load_datapoints_path(
raise InputValidationException(
code="0-1-1-2",
input=datapoint,
message="S3 URIs are only supported with use_duckdb=True.",
message="S3 URIs are not supported in this code path.",
)
if isinstance(datapoint, str) and not _is_url(datapoint):
datapoint = Path(datapoint)
Expand Down Expand Up @@ -745,7 +745,7 @@ def _check_output_folder(output_folder: Union[str, Path]) -> None:
raise InputValidationException(
code="0-1-1-2",
input=output_folder,
message="S3 URIs are only supported with use_duckdb=True.",
message="S3 URIs are not supported in this code path.",
)
try:
output_folder = Path(output_folder)
Expand Down
Loading
Loading