Search before asking
Description
Currently, we introduce poll_batches to allow to return RecordBatch directly. During implement duckdb plugin, I found it'll be better to return more information such as:
- The bucket for the RecordBatch in one poll batch
- The start/end log offset for the RecordBatch in one poll batch
@fresh-borzoni What do you think of it.
Willingness to contribute