Readers Behaviour on Connection issues

[ocacontrolroom]

Nats ConnectionClose. Default behavior? Ignore, Be cancelled nicelly?

from text-gui ocabox:

024-04-03 02:46:57,905 [WARNING] msg_reader: Consumer has gone, trying to recreate it on [PUSH]MsgJournalReader_1rOvPiJPQX [tic.journal.wk06.planner]
2024-04-03 02:46:57,906 [WARNING] msg_reader: Consumer has gone, trying to recreate it on [PUSH]MsgCallbackSubscriber_sxMmeUpxRX [tic.status.wk06.planner.status]
2024-04-03 02:49:24,480 [WARNING] msg_reader: Consumer has gone, trying to recreate it on [PUSH]MsgCallbackSubscriber_sxMmeUpxRX [tic.status.wk06.planner.status]
2024-04-03 05:06:08,792 [INFO] main_panel: Log file added at /home/observer/.oca/log_textui/wk06_textui.log
2024-04-03 05:06:10,971 [INFO] root: JetStream connected
2024-04-03 05:06:10,979 [INFO] communication_panel: Servers are connected.
2024-04-03 05:06:11,014 [INFO] messenger: Connected to NATS ['nats.oca.lan']:[4222]
2024-04-03 05:06:11,029 [INFO] comm_nats: Nats connected to nats.oca.lan:4222
2024-04-03 05:06:26,193 [INFO] cycle_time_data_clean: Data clean for telescope: wk06
2024-04-03 05:06:26,211 [INFO] cycle_time_data_clean: Data clean for telescope: zb08
2024-04-03 05:06:26,549 [INFO] cycle_time_data_clean: Data clean for telescope: jk15
2024-04-03 05:06:26,561 [INFO] cycle_time_train: Train all telescopes and all commands type
2024-04-03 05:06:27,800 [ERROR] task_manager: Task NATSASUB.telemetry.weather.davis failed: nats: connection closed
Traceback (most recent call last):
  File "/usr/lib/python3.10/asyncio/tasks.py", line 432, in wait_for
    await waiter
asyncio.exceptions.CancelledError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.10/asyncio/tasks.py", line 441, in wait_for
    await _cancel_and_wait(fut, loop=loop)
  File "/usr/lib/python3.10/asyncio/tasks.py", line 518, in _cancel_and_wait
    await waiter
asyncio.exceptions.CancelledError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/observer/.cache/pypoetry/virtualenvs/ocabox-cli-W84GY2n7-py3.10/lib/python3.10/site-packages/nats/aio/subscription.py", line 189, in next_msg
    msg = await future
asyncio.exceptions.CancelledError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/observer/.cache/pypoetry/virtualenvs/ocabox-cli-W84GY2n7-py3.10/lib/python3.10/site-packages/serverish/messenger/msg_callback_sub.py", line 64, in _task_body
    async for data, meta in self:
  File "/home/observer/.cache/pypoetry/virtualenvs/ocabox-cli-W84GY2n7-py3.10/lib/python3.10/site-packages/serverish/messenger/msg_reader.py", line 84, in __anext__
    data, meta = await self.read_next()
  File "/home/observer/.cache/pypoetry/virtualenvs/ocabox-cli-W84GY2n7-py3.10/lib/python3.10/site-packages/serverish/messenger/msg_reader.py", line 118, in read_next
    self.pull_batch = deque(await self.pull_subscription.fetch(batch=batch, timeout=timeout))
  File "/home/observer/.cache/pypoetry/virtualenvs/ocabox-cli-W84GY2n7-py3.10/lib/python3.10/site-packages/nats/js/client.py", line 937, in fetch
    msg = await self._fetch_one(expires, timeout, heartbeat)
  File "/home/observer/.cache/pypoetry/virtualenvs/ocabox-cli-W84GY2n7-py3.10/lib/python3.10/site-packages/nats/js/client.py", line 989, in _fetch_one
    msg = await self._sub.next_msg(timeout=deadline)
  File "/home/observer/.cache/pypoetry/virtualenvs/ocabox-cli-W84GY2n7-py3.10/lib/python3.10/site-packages/nats/aio/subscription.py", line 196, in next_msg
    raise errors.ConnectionClosedError
nats.errors.ConnectionClosedError: nats: connection closed
2024-04-03 05:06:27,802 [ERROR] task_manager: Task NATSASUB.tic.status.wk06.planner.static failed: nats: connection closed
Traceback (most recent call last):
  File "/usr/lib/python3.10/asyncio/tasks.py", line 432, in wait_for
    await waiter
asyncio.exceptions.CancelledError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.10/asyncio/tasks.py", line 441, in wait_for
    await _cancel_and_wait(fut, loop=loop)
  File "/usr/lib/python3.10/asyncio/tasks.py", line 518, in _cancel_and_wait
    await waiter
asyncio.exceptions.CancelledError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/observer/.cache/pypoetry/virtualenvs/ocabox-cli-W84GY2n7-py3.10/lib/python3.10/site-packages/nats/aio/subscription.py", line 189, in next_msg
    msg = await future
asyncio.exceptions.CancelledError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/observer/.cache/pypoetry/virtualenvs/ocabox-cli-W84GY2n7-py3.10/lib/python3.10/site-packages/serverish/messenger/msg_callback_sub.py", line 64, in _task_body
    async for data, meta in self:
  File "/home/observer/.cache/pypoetry/virtualenvs/ocabox-cli-W84GY2n7-py3.10/lib/python3.10/site-packages/serverish/messenger/msg_reader.py", line 84, in __anext__
    data, meta = await self.read_next()
  File "/home/observer/.cache/pypoetry/virtualenvs/ocabox-cli-W84GY2n7-py3.10/lib/python3.10/site-packages/serverish/messenger/msg_reader.py", line 118, in read_next
    self.pull_batch = deque(await self.pull_subscription.fetch(batch=batch, timeout=timeout))
  File "/home/observer/.cache/pypoetry/virtualenvs/ocabox-cli-W84GY2n7-py3.10/lib/python3.10/site-packages/nats/js/client.py", line 937, in fetch
    msg = await self._fetch_one(expires, timeout, heartbeat)
  File "/home/observer/.cache/pypoetry/virtualenvs/ocabox-cli-W84GY2n7-py3.10/lib/python3.10/site-packages/nats/js/client.py", line 989, in _fetch_one
    msg = await self._sub.next_msg(timeout=deadline)
  File "/home/observer/.cache/pypoetry/virtualenvs/ocabox-cli-W84GY2n7-py3.10/lib/python3.10/site-packages/nats/aio/subscription.py", line 196, in next_msg
    raise errors.ConnectionClosedError
nats.errors.ConnectionClosedError: nats: connection closed
2024-04-03 05:06:27,804 [ERROR] task_manager: Task NATSASUB.tic.status.wk06.planner.status failed: nats: connection closed

[MMiirrkk]

Cześć. Na swoim środowisku w domu dostałem takie coś (może coś ci to pomoże):
2025-06-24 07:38:54,351 [ERROR] task_manager: Task NATSASUB.tic.planner.dev.data.status failed: nats: ServiceUnavailableError: code=None err_code=None description='None' Traceback (most recent call last): File "/home/mirk/.cache/pypoetry/virtualenvs/ocabox-cli-rwKvqzq0-py3.12/lib/python3.12/site-packages/serverish/messenger/msg_callback_sub.py", line 64, in _task_body async for data, meta in self: File "/home/mirk/.cache/pypoetry/virtualenvs/ocabox-cli-rwKvqzq0-py3.12/lib/python3.12/site-packages/serverish/messenger/msg_reader.py", line 84, in __anext__ data, meta = await self.read_next() ^^^^^^^^^^^^^^^^^^^^^^ File "/home/mirk/.cache/pypoetry/virtualenvs/ocabox-cli-rwKvqzq0-py3.12/lib/python3.12/site-packages/serverish/messenger/msg_reader.py", line 119, in read_next self.pull_batch = deque(await self.pull_subscription.fetch(batch=batch, timeout=timeout)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/mirk/.cache/pypoetry/virtualenvs/ocabox-cli-rwKvqzq0-py3.12/lib/python3.12/site-packages/nats/js/client.py", line 1073, in fetch msg = await self._fetch_one(expires, timeout, heartbeat) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/mirk/.cache/pypoetry/virtualenvs/ocabox-cli-rwKvqzq0-py3.12/lib/python3.12/site-packages/nats/js/client.py", line 1139, in _fetch_one raise nats.js.errors.APIError.from_msg(msg) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/mirk/.cache/pypoetry/virtualenvs/ocabox-cli-rwKvqzq0-py3.12/lib/python3.12/site-packages/nats/js/errors.py", line 73, in from_msg raise ServiceUnavailableError

2025-06-24 07:35:49,460 [ERROR] task_manager: Task NATSASUB.telemetry.weather.davis failed: nats: ServiceUnavailableError: code=None err_code=None description='None' Traceback (most recent call last): File "/home/mirk/.cache/pypoetry/virtualenvs/ocabox-cli-rwKvqzq0-py3.12/lib/python3.12/site-packages/serverish/messenger/msg_callback_sub.py", line 64, in _task_body async for data, meta in self: File "/home/mirk/.cache/pypoetry/virtualenvs/ocabox-cli-rwKvqzq0-py3.12/lib/python3.12/site-packages/serverish/messenger/msg_reader.py", line 84, in __anext__ data, meta = await self.read_next() ^^^^^^^^^^^^^^^^^^^^^^ File "/home/mirk/.cache/pypoetry/virtualenvs/ocabox-cli-rwKvqzq0-py3.12/lib/python3.12/site-packages/serverish/messenger/msg_reader.py", line 119, in read_next self.pull_batch = deque(await self.pull_subscription.fetch(batch=batch, timeout=timeout)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/mirk/.cache/pypoetry/virtualenvs/ocabox-cli-rwKvqzq0-py3.12/lib/python3.12/site-packages/nats/js/client.py", line 1073, in fetch msg = await self._fetch_one(expires, timeout, heartbeat) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/mirk/.cache/pypoetry/virtualenvs/ocabox-cli-rwKvqzq0-py3.12/lib/python3.12/site-packages/nats/js/client.py", line 1139, in _fetch_one raise nats.js.errors.APIError.from_msg(msg) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/mirk/.cache/pypoetry/virtualenvs/ocabox-cli-rwKvqzq0-py3.12/lib/python3.12/site-packages/nats/js/errors.py", line 73, in from_msg raise ServiceUnavailableError

[MMiirrkk]

No i jeszcze dostaję jaki błąd jak nie ma NATS dostępnych a chcę się połączyć:

2025-06-25 07:35:23,858 [INFO] main_panel: Log file added at /home/mirk/.oca/log_textui/dev_textui.log
2025-06-25 07:35:24,487 [INFO] comm_nats: Trying to connect to nats...
2025-06-25 07:35:39,890 [WARNING] messenger: Time out connecting to NATS ['192.168.8.140']:[4222] after 5 seconds
2025-06-25 07:35:39,891 [ERROR] task_manager: Task Messenger wait for open 192.168.8.140:4222 failed:
Traceback (most recent call last):
File "/usr/lib/python3.12/asyncio/tasks.py", line 520, in wait_for
return await fut
^^^^^^^^^
asyncio.exceptions.CancelledError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/home/mirk/.cache/pypoetry/virtualenvs/ocabox-cli-rwKvqzq0-py3.12/lib/python3.12/site-packages/serverish/messenger/messenger.py", line 135, in _open
await self.opener_task.wait_for(timeout)
File "/home/mirk/.cache/pypoetry/virtualenvs/ocabox-cli-rwKvqzq0-py3.12/lib/python3.12/site-packages/serverish/base/task_manager.py", line 95, in wait_for
await asyncio.wait_for(t, timeout=timeout)
File "/usr/lib/python3.12/asyncio/tasks.py", line 519, in wait_for
async with timeouts.timeout(timeout):
File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in aexit
raise TimeoutError from exc_val
TimeoutError
2025-06-25 07:35:39,894 [INFO] messenger: Not connected in Nones. Backgrounding connection to NATS 192.168.8.140:4222
2025-06-25 07:35:39,897 [ERROR] comm_nats: Nats server is not reachable.

a mój kod taki:

self.mess = Messenger()
await self.mess.open(host=self.host, port=self.port, timeout=timeout)

@majkelx