Skip to content

Latest commit

 

History

History
29 lines (21 loc) · 1.26 KB

File metadata and controls

29 lines (21 loc) · 1.26 KB

Assignment

How to build Assignment

sbt assembly

How to run Assignment

./spark-submit --class com.newday.Launcher --master local[*] ${path to assignment-1.0.jar} ${path to properties file}

Supported properties

Property Name Description
movies.input.filePath of the input movie file
movies.read.formatformat of the input movie file
movies.output.fileWrite path of the tranformed movie file
movies.write.formatformat of the transformed movie file
ratings.input.filePath of the input movie file
ratings.read.formatformat of the input movie file
ratings.output.fileWrite path of the tranformed ratings file
ratings.write.formatformat of the transformed ratings file
movie_ratings.output.fileWrite path of the tranformed movie_rating file
movie_ratings.write.formatformat of the transformed movie_rating file