Skip to content

Commit 1d3e95a

Browse files
authored
Merge pull request #1327 from datanav/IS-18513
IS-18513: documented new entities-reposted pump event and json format…
2 parents c093bce + 0ba9102 commit 1d3e95a

2 files changed

Lines changed: 89 additions & 4 deletions

File tree

hub/changelog.rst

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,13 @@
11
Changelog
22
=========
33

4+
.. _changelog_2026-01-08:
5+
6+
2026-01-08
7+
----------
8+
* Added a new type of event to the pump execution dataset. The ``entities-reposted`` :ref:`event <pump_execution_entities_reposted>` is now created/updated
9+
whenever a user reposts entities to the sink dataset.
10+
411
.. _changelog_2026-01-06:
512

613
2026-01-06

hub/documentation/operations/pump-execution.rst

Lines changed: 82 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -33,7 +33,7 @@ takes place.
3333
Prototype
3434
^^^^^^^^^
3535

36-
::
36+
.. code-block:: json
3737
3838
{
3939
"_id": "pump-started",
@@ -100,7 +100,7 @@ If the pump completes successfully, it will write a "pump-completed" entity to t
100100

101101
Prototype
102102
^^^^^^^^^
103-
::
103+
.. code-block:: json
104104
105105
{
106106
"_id": "pump-completed",
@@ -193,7 +193,7 @@ If the pump fails for some reason, it will write a "pump-failed" entity when it
193193
Prototype
194194
^^^^^^^^^
195195

196-
::
196+
.. code-block:: json
197197
198198
{
199199
"_id": "pump-failed",
@@ -509,6 +509,84 @@ Properties
509509
- String
510510
- Same as the traceback, but only the root message itself.
511511

512+
.. _pump_execution_entities_reposted:
513+
514+
The entities-reposted entity
515+
----------------------------
516+
The "entities-reposted" entity is written to the pump execution dataset when a user reposts entities to the dataset.
517+
It contains the ``_id``, ``_deleted`` and ``_updated`` properties of all the reposted entities.
518+
519+
Prototype
520+
^^^^^^^^^
521+
522+
.. code-block:: json
523+
524+
{
525+
"_id": "entities-reposted",
526+
"event_type": "entities-reposted",
527+
"event_time": "2022-01-04T13:20:28.630647Z",
528+
"entities": [
529+
{
530+
"_id": "entity1",
531+
"_deleted": false,
532+
"_updated": 101
533+
},
534+
{
535+
"_id": "entity2",
536+
"_deleted": true,
537+
"_updated": 100
538+
},
539+
],
540+
"num_entities": 2,
541+
"pipe_id": "some-pipe",
542+
"user": {
543+
"email": "some@user.com",
544+
"remote_addr": "127.0.0.1",
545+
"user_id": "some@user.com"
546+
}
547+
}
548+
549+
Properties
550+
^^^^^^^^^^
551+
552+
.. list-table::
553+
:header-rows: 1
554+
:widths: 10, 10, 60
555+
556+
* - Property
557+
- Type
558+
- Description
559+
560+
* - ``_id``
561+
- String
562+
- The ``_id`` value for pump-offset-set entities is fixed and will always be "pump-offset-set"
563+
564+
* - ``event_type``
565+
- String
566+
- The ``event_type`` value for pump-started entities is fixed and will always be "pump-offset-set"
567+
568+
* - ``event_time``
569+
- String
570+
- The ISO-formatted timestamp for the timestamp the pump offset was set ("YYYY-MM-DDTHH:mm:SS.fZ")
571+
572+
* - ``entities``
573+
- Object
574+
- A list of the entities that were reposted. Only the ``_id``, ``_deleted`` and ``_updated`` properties are
575+
included for each of the entities.
576+
577+
* - ``num_entities``
578+
- Integer
579+
- The number of entities that were reposted.
580+
581+
* - ``pipe``
582+
- String
583+
- The pipe id.
584+
585+
* - ``user``
586+
- Object
587+
- Information about the user that started the run, if available.
588+
589+
512590
The pump-offset-set entity
513591
--------------------------
514592

@@ -517,7 +595,7 @@ The "pump-offset-set" is written to the pump execution dataset when the pump off
517595
Prototype
518596
^^^^^^^^^
519597

520-
::
598+
.. code-block:: json
521599
522600
{
523601
"_id": "pump-offset-set",

0 commit comments

Comments
 (0)