Skip to content

Commit 05a3dca

Browse files
nonpoolasm0dey
andauthored
feat: UDF support
* copy code from #67 * remove hacked RowEncoder.scala * replace all schema(typeOf<R>()) to DataType.fromJson((schema(typeOf<R>()) as DataTypeWithClass).dt().json()) * add return udf data class test * change test * add in dataset test for calling the UDF-Wrapper * add the same exception link * refactor unWrapper * add test for udf return a List * make the test simpler * add License * add UDFRegister for 3.0 * remove useless import * resolved deprecated method * [experimental] add CatalystTypeConverters.scala for hacked it to implement UDF return data class * [experimental] implement UDF return data class * fix code inspection issue * Adds suppre unused Co-authored-by: can wang <can.wang@thoughtworks.com> Co-authored-by: Pasha Finkelshteyn <pavel.finkelshtein@gmail.com>
1 parent 9ef3809 commit 05a3dca

File tree

8 files changed

+3580
-1
lines changed

8 files changed

+3580
-1
lines changed

core/3.0/pom_2.12.xml

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,10 @@
1818
<artifactId>scala-library</artifactId>
1919
<version>${scala.version}</version>
2020
</dependency>
21-
21+
<dependency>
22+
<groupId>org.jetbrains.kotlin</groupId>
23+
<artifactId>kotlin-reflect</artifactId>
24+
</dependency>
2225
<!-- Provided dependencies -->
2326
<dependency>
2427
<groupId>org.apache.spark</groupId>

0 commit comments

Comments
 (0)