Kedro pipeline#3

Open

VJausovec wants to merge 70 commits into

surveytoolsfrom

Commits on Feb 10, 2026

feat: Initialize rissk_kedro project structure with pipelines and documentation
VJausovec
committed
change raw folder to parameter rather than in data catalogue, small refactor on rissk/utils extract_zip to clean up password handling
VJausovec
committed

Commits on Feb 12, 2026

Commits on Feb 13, 2026

Refactor feature engineering pipeline and update test ingestion notebook
VJausovec
committed
- kedro ingestion: the initial data is passed as partitioned data in catalog not a raw path parameter
VJausovec
committed

Commits on Feb 15, 2026

Refactor data ingestion pipeline: update partition names, enhance zip extraction, change README and upgrade to python 3.13
VJausovec
committed

Commits on Feb 16, 2026

Refactor data ingestion pipeline:
VJausovec
committed

Commits on Feb 17, 2026

Commits on Feb 18, 2026

Refactor code structure for improved readability and maintainability
VJausovec
committed

Commits on Feb 23, 2026

Refactor import_utils_kedro.py for timestamp processing and error handling; update catalog.yml and globals.yml for dynamic data paths; modify parameters.yml to pull questionnaire config from global…
VJausovec
committed

Commits on Feb 26, 2026

Commits on Feb 28, 2026

Refactor transform_multi function for improved value normalization; update read_microdata_file to avoid direct import dependency on StataMissingValue; adjust globals.yml for questionnaire version c…
VJausovec
committed

Commits on Mar 1, 2026

Refactor feature creation and pipeline configuration; add missing features for comment handling and translation positions; update input parameters for nodes; enhance data validation logic in microd…
VJausovec
committed

Commits on Mar 4, 2026

Refactor feature processing functions for consistency; rename private functions to public; update pipeline and configuration files for legacy data handling; enhance parameters for new features.
VJausovec
committed

Commits on Mar 7, 2026

Refactor time and pause feature calculations for improved clarity; for testing add legacy microdata and paradata to catalog
VJausovec
committed

Commits on Mar 11, 2026

Commits on Mar 12, 2026

Refactor scoring pipeline and functions to improve handling of answer removal scores; introduce new stats utility functions and ensure legacy behavior is matched for deleted items.
VJausovec
committed

Commits on Mar 16, 2026

Commits on Mar 17, 2026

Refactor code structure for improved readability and maintainability
VJausovec
committed

Commits on Mar 21, 2026

Refactor feature processing and pipeline definitions to enhance handling of paradata; reintroduce filter_active_paradata_node for legacy compatibility and improve numeric mask functionality.
VJausovec
committed

Commits on Mar 24, 2026

Refactor event handling in add_item_time_features and feature functions to normalize roster_level for AnswerRemoved events; align numeric masks with legacy behavior for consistency in data processing.
VJausovec
committed

Commits on Mar 26, 2026

Commits on Mar 27, 2026

Enhance feature processing by adding questionnaire filtering; include qnr and qnr_version in item table and update aggregation logic for removed answers.
VJausovec
committed

Commits on Mar 29, 2026

Commits on Mar 30, 2026

Add consent filtering functionality to feature creation pipeline; refactor questionnaire loading and processing logic.
VJausovec
committed

Commits on Mar 31, 2026

changes to logging and clean-up
VJausovec
committed

Commits on Apr 2, 2026

Commits on Apr 3, 2026

Enhance GPS scoring logic; introduce s__gps flag in calculate_gps_score and update aggregation in unit processing to maintain legacy compatibility.
VJausovec
committed

Commits on Apr 5, 2026

Commits on Apr 6, 2026

Commits on Apr 7, 2026

Commits on Apr 29, 2026

Refactor get_numeric_mask function to remove commented-out code and suppress RuntimeWarnings in calculate_first_decimals_score for cleaner logging.

VJausovec
and
Copilot
committed

Commits on Apr 30, 2026

Refactor Kedro pipeline dependencies and update scoring logic

VJausovec
and
Copilot
committed

Commits on May 4, 2026

Enhance logging and error handling for data loading and processing functions; update environment configuration for clarity and maintenance.

VJausovec
and
Copilot
committed

Commits on May 6, 2026