Skip to content

User friendly way to output data from event based models #56

@chrisk314

Description

@chrisk314

Plugboard currently includes some builtin components for data egress such as FileWriter and SQLWriter. These components can be configured with a set of fields for which to receive data to output to a storage backend. Support for event based models has been introduced in #46. The implementation there does not provide any event based mechanism for triggering data persistence. As mentioned in the comments on that PR it would be good to have such an event based mechanism to facilitate data egress from purely event based models.

It would be nice to be able to save the output of event-driven components to CSV or similar. We could have event-driven versions of the FileWriter, SQLWriter components, but is there a way we could make these configurable so that they could be used in either mode?

FileWriter and SQLWriter inherit from DataWriter which has an IOController with fields configurable at runtime. A possible implementation could be to allowing passing a set of events as a separate argument to these constructors, and have some generic logic for writing event data which does not require specific implementations (event handler methods) to handle specific events.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions