Skip to content

Removed pandas handling from Interpreter and Operators#718

Merged
javihern98 merged 18 commits into
mainfrom
cr-682
May 27, 2026
Merged

Removed pandas handling from Interpreter and Operators#718
javihern98 merged 18 commits into
mainfrom
cr-682

Conversation

@albertohernandez1995
Copy link
Copy Markdown
Contributor

Summary

  • Removed pandas from the Interpreter and Operators files.
  • evaluate() methods were deleted.
  • Refactored tests affected with these changes. Also, a bug was discovered in BOM that was solved by renaiming utf-8 to utf-8-sig
  • run(use_duckdb=...) parameter and VTL_ENGINE_BACKEND env var were removed.
  • Workflows were updated by deleting pandas references.
  • Reviewed dead code, like py_op methods, and removed them from code.
  • Updated error messages.

Checklist

  • Code quality checks pass (ruff format, ruff check, mypy)
  • Tests pass (pytest)
  • Documentation updated (if applicable)

Closes #682

albertohernandez1995 and others added 9 commits May 11, 2026 11:02
… Interpreter was refactored.

Removed _use_duckdb_backend() switch as it is not necessary anymore. Also, VTL_ENGINE_BACKEND was removed, as Duckdb is the only backend.
Refactored tests. Marked as skipped Viral ones because there is not an implementation in transpiler yet. Also, some ReferenceManual were failing and we need to keep an eye on them.
@albertohernandez1995 albertohernandez1995 requested review from a team, javihern98 and mla2001 May 13, 2026 12:40
@albertohernandez1995 albertohernandez1995 linked an issue May 13, 2026 that may be closed by this pull request
@albertohernandez1995 albertohernandez1995 marked this pull request as draft May 13, 2026 12:42
Copy link
Copy Markdown
Contributor

@javihern98 javihern98 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Missing some changes to remove the Pandas loading and saving methods, and validations,as well as removing the changes related to duckdb transpiler, as this branch should not include any change there.

Comment thread tests/VirtualAssets/test_virtual_counter.py Outdated
Comment thread vtl-output/DS_A.csv Outdated
Comment thread src/vtlengine/API/__init__.py Outdated
Comment thread src/vtlengine/API/__init__.py
@albertohernandez1995 albertohernandez1995 self-assigned this May 14, 2026
@albertohernandez1995 albertohernandez1995 marked this pull request as ready for review May 14, 2026 09:23
Copy link
Copy Markdown
Contributor

@mla2001 mla2001 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks fine! 😊

@albertohernandez1995 albertohernandez1995 removed the request for review from javihern98 May 27, 2026 13:46
@albertohernandez1995 albertohernandez1995 enabled auto-merge (squash) May 27, 2026 13:46
@javihern98 javihern98 merged commit 1050194 into main May 27, 2026
22 checks passed
@javihern98 javihern98 deleted the cr-682 branch May 27, 2026 14:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

(Duckdb) Duckdb fails to substitute component names in UDO Remove the pandas execution backend in favor of DuckDB

3 participants