Skip to content

Mc/3801/backend/scoring#3809

Merged
lsabor merged 1 commit intomc/3800/backend/option_historyfrom
mc/3801/backend/scoring
Jan 11, 2026
Merged

Mc/3801/backend/scoring#3809
lsabor merged 1 commit intomc/3800/backend/option_historyfrom
mc/3801/backend/scoring

Conversation

@lsabor
Copy link
Copy Markdown
Contributor

@lsabor lsabor commented Nov 16, 2025

closes #3801

creates support for scoring questions with changing options_history
adds multiple_choice_interpret_forecasts for interpreting forecasts into a full-optioned version for scoring
adds support for choosing the resolution bucket index from full optioned list
adds tests for relevant parts

see issue for TODOs

@lsabor lsabor force-pushed the mc/3801/backend/scoring branch from 8cc6144 to 232922d Compare November 19, 2025 19:57
@lsabor lsabor changed the base branch from mc/3800/backend/option_history to mc/3813/backend/forecasts November 20, 2025 17:08
@lsabor lsabor force-pushed the mc/3801/backend/scoring branch from bc36092 to 4ba50e0 Compare November 20, 2025 17:09
@lsabor lsabor force-pushed the mc/3813/backend/forecasts branch from 82b13c3 to f85f6c6 Compare November 21, 2025 15:42
@lsabor lsabor force-pushed the mc/3801/backend/scoring branch from e9fbef8 to bd20158 Compare November 21, 2025 15:42
@lsabor lsabor force-pushed the mc/3813/backend/forecasts branch from f85f6c6 to 7c67992 Compare November 22, 2025 18:13
@lsabor lsabor force-pushed the mc/3801/backend/scoring branch 2 times, most recently from 59dd6e7 to 72c745a Compare November 23, 2025 18:25
@lsabor lsabor changed the base branch from mc/3813/backend/forecasts to mc/3806/backend/aggregations November 23, 2025 18:26
@lsabor lsabor force-pushed the mc/3801/backend/scoring branch 2 times, most recently from 81424da to 7c13428 Compare November 23, 2025 20:40
@lsabor lsabor force-pushed the mc/3806/backend/aggregations branch from 3646bb7 to 6d99dcd Compare November 23, 2025 21:38
@lsabor lsabor force-pushed the mc/3801/backend/scoring branch 2 times, most recently from a21d018 to 792fe88 Compare November 23, 2025 23:14
@lsabor lsabor force-pushed the mc/3806/backend/aggregations branch from 7bb9e82 to 5e26c23 Compare November 23, 2025 23:26
@lsabor lsabor force-pushed the mc/3801/backend/scoring branch from 792fe88 to 6689806 Compare November 23, 2025 23:28
@lsabor lsabor force-pushed the mc/3806/backend/aggregations branch 3 times, most recently from afd6fe7 to 76bcb47 Compare November 30, 2025 22:22
@lsabor lsabor force-pushed the mc/3801/backend/scoring branch 2 times, most recently from df11e3f to abc10ab Compare November 30, 2025 23:30
@lsabor lsabor force-pushed the mc/3806/backend/aggregations branch 2 times, most recently from 237bd11 to c70aff2 Compare December 4, 2025 21:57
@lsabor lsabor force-pushed the mc/3801/backend/scoring branch from abc10ab to 367ece0 Compare December 4, 2025 21:58
@lsabor lsabor force-pushed the mc/3806/backend/aggregations branch 2 times, most recently from 15bf9cf to fb47026 Compare January 11, 2026 17:54
Base automatically changed from mc/3806/backend/aggregations to mc/3800/backend/option_history January 11, 2026 17:55
parent 76bcb47
author lsabor <lukesabor@gmail.com> 1763312248 -0800
committer lsabor <lukesabor@gmail.com> 1764541784 -0800

add OptionsHistoryType, multiple_choice_interpret_forecast, and test

update test for change to function

update string_location_to_scaled_location to accept all historical option values, and related test

multiple choice forecasts require interpretation before scoring

remove double written definition

support the new MC format scoring

tests for mc with placeholder values

add support for None values
@lsabor lsabor force-pushed the mc/3801/backend/scoring branch from 367ece0 to 40b6e40 Compare January 11, 2026 17:58
@lsabor lsabor merged commit cd383c4 into mc/3800/backend/option_history Jan 11, 2026
@lsabor lsabor deleted the mc/3801/backend/scoring branch January 11, 2026 18:03
lsabor added a commit that referenced this pull request Jan 11, 2026
mc/3801/scoring

add OptionsHistoryType, multiple_choice_interpret_forecast, and test
update test for change to function
update string_location_to_scaled_location to accept all historical option values, and related test
multiple choice forecasts require interpretation before scoring
remove double written definition
support the new MC format scoring
tests for mc with placeholder values
add support for None values
fix some linting errors left from previous commit
lsabor added a commit that referenced this pull request Jan 24, 2026
* mc/3800/backend/options_history

add options_history field to question model and migration
add options_history to question serialization
add options_history initialization to question creation
add helper functions to question/services/multiple_choice_handlers.py and add 'automatic' to forecast.source selection
fix build_question_forecasts import and remove options & options_history from admin panel edit
tests for question creation, multiple_choice_rename_option, multiple_choice_options_reorder,  multiple_choice_delete_options, multiple_choice_add_options
mark some expected failures
add options_history to openapi docs
add csv reporting support for options_history
update logic to play well with back/forward filling 0s
add all_options_ever to serializer and api docs
add current options to csv return
add support for datetime isoformat in options_history

* mc/3813/backend/forecasts (#3814)

fix file restructure
fix datetime iso format in history conflicts
add support for None values in MC predictions
fix tests and source logic
fix test_comment_edit_include_forecast to explicitly set forecast times
mark xfail tests

* mc/3806/backend/aggregations (#3818)

mc/3806/aggregations

adjust aggregations to play nicely with placeholders
improve test for comput_weighted_semi_standard_deviations
add support for None s in prediction difference for sorting plus tests
update prediction difference for display to handle placeholders
reactivate skipped tests

* Mc/3801/backend/scoring (#3809)

mc/3801/scoring

add OptionsHistoryType, multiple_choice_interpret_forecast, and test
update test for change to function
update string_location_to_scaled_location to accept all historical option values, and related test
multiple choice forecasts require interpretation before scoring
remove double written definition
support the new MC format scoring
tests for mc with placeholder values
add support for None values
fix some linting errors left from previous commit

* Mc/3802/backend/notifications (#3826)

mc/3802/backend/notifications

add notification logic
add mjml/html and update tasks to setup for notifications
add withdrawal notifications and bulletin deactivation
fix grace period end bug

* Mc/3804/options updating (#3827)

mc/3804/backend/updating

add admin form for changing options
add comment author and text to admin panel action and mc change methods

* Mc/3805/graphing (#3828)

mc/3805/frontend/graphing

forecast only current option values
aggregation explorer
disclaimer to forecast during grace period
add option reordering (should be in mc/3804)

* MC 3805 UI (#3951)

mc/3805/ui

Added tooltip and highlight for newly added MC options
Updated highlight method and message copy
grace period timer
translation strings

Co-authored-by: aseckin <atakanseckin@gmail.com>

* Cleanup:

update comment copy
prefill grace period end with now + 3 days
translations dedupe keys
small bug fixes
using question.get_forecasters()
add (deleted) to deleted options in legend
only show active options in tooltip
update emails
fix tests
update legend, prediction interface, and timeline to have labels (upcoming) and (deleted)
support translating suffix choice labels

---------

Co-authored-by: aseckin <atakanseckin@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants