Skip to content

Allow to return more info in poll batches method #179

@luoyuxia

Description

@luoyuxia

Search before asking

  • I searched in the issues and found nothing similar.

Description

Currently, we introduce poll_batches to allow to return RecordBatch directly. During implement duckdb plugin, I found it'll be better to return more information such as:

  • The bucket for the RecordBatch in one poll batch
  • The start/end log offset for the RecordBatch in one poll batch

@fresh-borzoni What do you think of it.

Willingness to contribute

  • I'm willing to submit a PR!

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions