-
Notifications
You must be signed in to change notification settings - Fork 296
Open
Labels
bugSomething isn't workingSomething isn't workinggood first issueGood for newcomersGood for newcomersnative_datafusionSpecific to native_datafusion scan typeSpecific to native_datafusion scan typepriority:mediumFunctional bugs, performance regressions, broken featuresFunctional bugs, performance regressions, broken features
Description
Describe the bug
spark.range(10000000).repartition(20).write.parquet(location)
spark.read.parquet("location").show(false)
which are twice more than original. The issue seems to be for metric only, the actual file read only once
Steps to reproduce
No response
Expected behavior
No response
Additional context
No response
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't workinggood first issueGood for newcomersGood for newcomersnative_datafusionSpecific to native_datafusion scan typeSpecific to native_datafusion scan typepriority:mediumFunctional bugs, performance regressions, broken featuresFunctional bugs, performance regressions, broken features