This repository was archived by the owner on Nov 16, 2023. It is now read-only.
This repository was archived by the owner on Nov 16, 2023. It is now read-only.
Evaluate performance improvement by using SupportsWriteInternalRow #44
Description
From the api docs:
A mix-in interface for DataSourceWriter. Data source writers can implement this interface to write InternalRow directly and avoid the row conversion at Spark side. This is an experimental and unstable interface, as InternalRow is not public and may get changed in the future Spark versions.