Fix: CEM work session#188

Draft

Flix6x wants to merge 96 commits intomainfrom

dev/fix-handshake-handler

Contributor

Flix6x commented Feb 25, 2026 •

edited

Loading

Follow-up to #187.

Fix handshake handler now sending back two responses against a queue that is periodically flushed (every 0.3 seconds)
Docker-compose stack skips running toy tutorial every time -> this is actually just for devs at the moment, because the toy account is actually needed for the CEM to run; specifically, the CEM uses the toy user credentials
Ported the FRBC.FillLevelTargetProfile and FRBC.UsageForecast to the FRBCSimple handler.
Test CEM now configures its own data dashboard in FlexMeasures
Test CEM now polls FlexMeasures much faster, which is more suitable for simulations.
A few minor fixes to the SimpleFRBC handler to get to the point that FRBCInstructions are sent back.
Ported the FRBC.LeakageBehaviour to the FRBCSimple handler.
Support wrapped S2 messages in an envelope together with metadata containing the simulation time.
Made the start of the schedule equal to the most recent storage status

Stijn van Houwelingen and others added 29 commits

February 19, 2026 16:44


          refactor: migrate from tox/PyScaffold to uv for dependency management…

733ef40

…, consolidating all dependencies into pyproject.toml and a single uv.lock file.

This simplifies and speeds up the development setup greatly.

Changes:
- Switch build backend from setuptools to hatchling
- Remove setup.cfg, tox.ini, .isort.cfg and setup.py in favour of .flake8 and pyproject.toml
- Add Poethepoet tasks
- Upgrade main Python version (CI/CD, .python-version, etc.) to 3.12
- Deprecate Python 3.9
- Add .python-version for consistent Python version management
- Create separate Dockerfile for flexmeasures-client
- Replace pip-tools with uv in all CI/CD workflows
- Remove ci/run_mypy.sh in favour of Poethepoet task
- Update documentation

Signed-off-by: Stijn van Houwelingen <teadrinkingprogrammer@github.io>


          fix: fix whitespace issues

d661056

Signed-off-by: Stijn van Houwelingen <teadrinkingprogrammer@github.io>


          feat: move from pre-commit git repos to using uv for pre-commit scripts

cef07f3

Signed-off-by: Stijn van Houwelingen <teadrinkingprogrammer@github.io>


          dev: try using the _sending_queue instead

d63afe5

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          Revert "dev: try using the _sending_queue instead"

564b8f1

This reverts commit d63afe5.


          fix: give the sending task enough time to flush the queue before the …

2db7a4f

…connection shuts down

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          dev: use DEBUG logging level

35cc9ad

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          feat: await message sent rather than message queued

375b49c

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          fix: also close WS if closing CEM

14f7792

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          feat: skip setting up the toy account

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          feat: post prices in background task

89d4338

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          Revert "feat: skip setting up the toy account"

60ff6af

This reverts commit 4799585.


          chore: use modern method name

404ed6b

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          fix: fall back on now in case FRBCActuatorStatus.transition_timestamp…

5d4de10

… is missing

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          fix: actuator status unit

f8ea658

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          feat: skip setting up the toy account

d59f340

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          fix: copy-paste mistake

6abd2a1

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          fix: discharge unit

5328de9

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          docs: update instruction to run docker-compose stack

eae232b

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          Revert "fix: discharge unit"

0e72c25

This reverts commit 5328de9.


          fix: schedule power sensor instead of dimensionless discharge sensor

abb0a74

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          feat: trigger schedule with each storage status (not yet rate limited…

bbaac73

…) and make system_description_id optional

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          feat: post 1 year of data in background tasks

374e44a

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          Revert "feat: post 1 year of data in background tasks"

a1d6ba7

This reverts commit 374e44a.


          fix: set prior knowledge of prices and test with now

f8e0d62

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          fix: floor the schedule start

be6d8d3

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          fix: messages should now be routed through cem.send_message

5334c0c

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          fix: messages should now be routed through cem.send_message; update h…

…andlers accordingly

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          feat: roll 3 days of test prices

e01176d

Signed-off-by: F.N. Claessen <claessen@seita.nl>

Flix6x self-assigned this

Flix6x added 30 commits

March 10, 2026 15:20


          dev: remove todo (soc-at-start is now actually coming from the latest…

1abdd71

… storage status)

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          feat: derive consumption-capacity and production-capacity from operat…

9f20ab4

…ion mode elements

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          docs: update docstring

ea68aa0

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          feat: move to J and W as default energy unit and power unit, respecti…

605980a

…vely

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          fix: wrong conversion

c2bab5d

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          docs: clarify inline note

00f363a

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          refactor: prepare for more params

80b2f61

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          feat: support getting a schedule in a given unit

2cc3b75

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          feat: require minimum version for getting a schedule in a given unit

3a547b1

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          fix: get schedule in the assumed power unit

d29e64c

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          feat: note the current FM server version

fca2c5b

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          fix: actually requires v0.32.0

fb6d947

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          docs: clarify that the server ignores the parameter, not the client

7d4c0c0

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          style: black

cc28d77

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          fix: mistake while refactoring (or from running black?)

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          fix: misinterpreted the usage forecast scale

67cbd0b

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          fix: CEM should only relax soc-constraints (not capacity-constraints …

6ba2337

…and not site-capacity-constraints)

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          fix: stop flipping the values from the actuator status (now that we u…

2711aff

…se consumption_is_positive on the power sensor

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          feat: use local flexmeasures repo in server and worker

fbe2461

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          Merge remote-tracking branch 'origin/main' into refactor/uv-migration

9a2b131


          fix: release step was split off to separate release.yml

a273788

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          dev: expose dev-db on local port

b78bacf

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          Merge branch 'refactor/uv-migration' into dev/fix-handshake-handler

5664e2c

# Conflicts:
#	docker-compose.yml
#	src/flexmeasures_client/s2/cem.py


          fix: missing import

0e4489a

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          dev: fix db port exposure

f3114cc

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          dev: expose queue-db port, too

da7268a

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          fix: install missing packages for CEM

21d28a1

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          feat: add charging-efficiency sensor

78b87d5

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          refactor: rename variable

5e2e4ce

Signed-off-by: F.N. Claessen <claessen@seita.nl>


          docs: update developer note

72321d4

Signed-off-by: F.N. Claessen <claessen@seita.nl>

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

S2