Manu

#1#input.txt

@@ -0,0 +1,3 @@
+! TRAVIS input file
+! Created with TRAVIS version compiled at Jan 14 2018 01:39:14
+! Input file written at Sun Mar 15 23:30:44 2020.

#1#travis.log

@@ -0,0 +1,84 @@
+Command line:
+"travis setup codedeploy"
+
+
+   ________                                 __
+  /        |                               /  |
+  ########/ ______    ______    __     __  ##/    _______
+     ## |  /      \  /      \  /  \   /  | /  |  /       |
+     ## | /######  | ######  | ##  \ /##/  ## | /#######/
+     ## | ## |  ##/  /    ## |  ##  /##/   ## | ##      \
+     ## | ## |      /####### |   ## ##/    ## |  ######  |
+     ## | ## |      ##    ## |    ###/     ## | /     ##/
+     ##/  ##/        #######/      #/      ##/  #######/
+
+     TRajectory Analyzer and VISualizer  -  Open-source freeware under GNU GPL v3
+
+     Copyright (c) Martin Brehm      (2009-2017), University of Halle (Saale)
+                   Martin Thomas     (2012-2017)
+                   Barbara Kirchner  (2009-2017), University of Bonn
+
+     http://www.travis-analyzer.de
+
+     Please cite: M. Brehm, B. Kirchner: J. Chem. Inf. Model. 2011, 51 (8), pp 2007-2023.
+
+     There is absolutely no warranty on any results obtained from TRAVIS.
+
+  #  Running on manu-xps at Sun Mar 15 23:30:44 2020 (PID 13459).
+  #  Running in /media/manu/development/programming/projects/spark/UberAnalytics
+  #  Code version: Aug 12 2017, compiled at Jan 14 2018 01:39:14, compiler "7.2.0", GCC 7.2.0
+  #  Target platform: Linux, compile flags: DEBUG_ARRAYS 
+  #  Machine: int=4b, long=8b, addr=8b, 0xA0B0C0D0=D0,C0,B0,A0.
+  #  User home: /home/manu, executable: /usr/bin/travis
+  #  Input from terminal, Output to terminal
+
+ >>> Please use a color scheme with dark background or specify "-nocolor"! <<<
+
+    No configuration file found.
+    Writing default configuration to /home/manu/.travis.conf ...
+
+Unknown parameter: "setup".
+
+    List of supported command line options:
+
+      -p <file>       Loads position data from the specified trajectory file.
+                      The file format may be *.xyz, *.pdb, *.lmp (LAMMPS), HISTORY (DLPOLY), or *.prmtop/*.mdcrd (Amber).
+                      BQB format (*.bqb, *.btr, *.blist) is also supported.
+      -vel <file>     Reads atom velocities from file in addition to main trajectory.
+                      Currently, only .xyz format is supported for velocity data.
+      -i <file>       Reads input from the specified text file.
+
+      -config <file>  Load the specified configuration file.
+      -stream         Treats input trajectory as a stream (e.g. named pipe): No fseek, etc.
+      -showconf       Shows a tree structure of the configuration file.
+      -writeconf      Writes the default configuration file, including all defines values.
+
+      -verbose        Show detailed information about what's going on.
+      -nocolor        Executes TRAVIS in monochrome mode (suitable for white background).
+      -dimcolor       Uses dim instead of bright colors.
+
+      -credits        Display a list of persons who contributed to TRAVIS.
+      -help, -?       Shows this help.
+
+    If only one argument is specified, it is assumed to be the name of a trajectory file.
+    If argument is specified at all, TRAVIS asks for the trajectory file to open.
+
+
+    Note: To show a list of all persons who contributed to TRAVIS,
+          please add "-credits" to your command line arguments, or set the
+          variable "SHOWCREDITS" to "TRUE" in your travis.conf file.
+
+    Source code from other projects used in TRAVIS:
+      - lmfit     from Joachim Wuttke
+      - kiss_fft  from Mark Borgerding
+      - voro++    from Chris Rycroft
+
+    http://www.travis-analyzer.de
+
+    Please cite the following articles:
+
+  * "TRAVIS - A Free Analyzer and Visualizer for Monte Carlo and Molecular Dynamics Trajectories",
+    M. Brehm, B. Kirchner; J. Chem. Inf. Model. 2011, 51 (8), pp 2007-2023.
+
+*** The End ***
+

.gitignore

@@ -2,6 +2,8 @@
 .idea/
 *.iml
 *.iws
+*.log
+*.txt
 
 # Mac
 .DS_Store

.travis.yml

@@ -1,5 +1,27 @@
 language: scala
-sudo: false # faster builds
-
+sudo: false
 after_success:
-  - bash <(curl -s https://codecov.io/bash)
+- bash <(curl -s https://codecov.io/bash)
+deploy:
+- provider: s3
+  access_key_id: AKIA34Y37TCL4537N4EO
+  secret_access_key: &1
+    secure: MK/EvnPNH6bBHzwchZJxqLPJgsvI42PRx24R93XtQZaWpzqOm7gahoU7rGlxAirsFYl8xzJA87kkZpw5dtwpJ12QuXhMg6L7fBCGd0zw0VkQw5hUSfEONeold7YoNIuNHjvpIJgubV+4c2R8+3TdmgaxJEQL+e87G8DdavXkikGrJ05+zUcy47G3Ok40VzHEKeQrIdCdEkbEsblptI/dzExUCuqe//kv4FZ7Y0QszkzcNiTP3vLYkTek8dbmmsG+zRsDQ1zg0aOU6dWl96+ghkS8YYIPX42wJodWbj469z4/f0crJFCQh0qhSXOAHaztvMVI9yKExguUH35bL7RzEtiaItGc/rhu58izszJtqa77lpsMT7X6PjvXC5DmwaD7sgp+TGSqJPo5/SLGLbjruhvNiP4Rb1NXo1lpF5ayxdcV8jMyBSDqLQPyd5jM4NI3VDfAd8Am5NBMqoZV1aPQp3+kapawSp76ZhCjBC8jZt2GFOeALgQBqlbj1xJZFLp+vmDD8nB/hnlRHGLtPXiulWGmZ/WeemObqLss40gWASnYE2Rz96RIkTJWH2vAeURW/DTAJqQUFXNE9UrY1EQLfhHxosC1wu5V1RaLSs47Gj68U/j//5WN+nv+3FK+0ExETPPk4wEk3xaW/Kp9G/4OkX9uwdHauhyUoCP2TfQtjMs=
+  local_dir: dpl_cd_upload
+  skip_cleanup: true
+  on: &2
+    repo: manug25/UberAnalytics
+    branch: manu
+  bucket: manu.uberdata
+- provider: codedeploy
+  access_key_id: AKIA34Y37TCL4537N4EO
+  secret_access_key: *1
+  bucket: manu.uberdata
+  key: ''
+  bundle_type: jar
+  application: UberAnalytics
+  deployment_group: EC2CodeDeploy
+  on: *2
+before_deploy:
+- mkdir -p dpl_cd_upload
+- mv '' dpl_cd_upload/''

README.md

@@ -1,8 +1,8 @@
-# Cab Analytics
+# Uber Usecase Analytics
 [![Travis Build Status](https://travis-ci.org/GouravRusiya30/UberAnalytics.svg?branch=master)](https://travis-ci.org/GouravRusiya30/UberAnalytics)
 [![sonar](https://sonarcloud.io/api/project_badges/measure?project=GouravRusiya30_UberAnalytics&metric=alert_status)](https://sonarcloud.io/dashboard?id=GouravRusiya30_UberAnalytics)
 
-The purpose of this project is to gather data from online taxi cab and transportation network company, in our case Uber, from various sources, enrich the collected data
+The purpose of this project is to gather data from online taxi and transportation network company, in our case Uber, from various sources, enrich the collected data
 and deliver it to Data Science team for further analytics.
 
 

buildspec.yml

@@ -0,0 +1,21 @@
+version: 0.2
+  - name: "AWS CodeBuild run build" Action For GitHub Actions
+    uses: aws-actions/aws-codebuild-run-build@v1.0.1
+
+phases:
+  install:
+    runtime-versions:
+      java: corretto8
+  pre_build:
+    commands:
+      - echo Nothing to do in the pre_build phase...
+  build:
+    commands:
+      - echo Build started on `date`
+      - mvn install
+  post_build:
+    commands:
+      - echo Build completed on `date`
+artifacts:
+  files:
+    - target/uberanalytics-1.0.jar

input.txt

@@ -0,0 +1,3 @@
+! TRAVIS input file
+! Created with TRAVIS version compiled at Jan 14 2018 01:39:14
+! Input file written at Sun Mar 15 23:56:13 2020.

pom.xml

@@ -28,30 +28,31 @@
     </properties>
 
     <dependencies>
-        <!-- https://mvnrepository.com/artifact/org.apache.spark/spark-core_2.11 -->
+        <!-- https://mvnrepository.com/artifact/org.apache.spark/spark-core -->
         <dependency>
             <groupId>org.apache.spark</groupId>
-            <artifactId>spark-core_2.11</artifactId>
-            <version>2.3.2</version>
+            <artifactId>spark-core_2.12</artifactId>
+            <version>2.4.4</version>
         </dependency>
 
+        <!-- https://mvnrepository.com/artifact/org.apache.spark/spark-sql -->
         <dependency>
             <groupId>org.apache.spark</groupId>
-            <artifactId>spark-sql_2.11</artifactId>
-            <version>2.3.2</version>
+            <artifactId>spark-sql_2.12</artifactId>
+            <version>2.4.4</version>
         </dependency>
-
+        <!-- https://mvnrepository.com/artifact/org.apache.spark/spark-hive -->
         <dependency>
             <groupId>org.apache.spark</groupId>
-            <artifactId>spark-hive_2.11</artifactId>
-            <version>2.3.2</version>
+            <artifactId>spark-hive_2.12</artifactId>
+            <version>2.4.4</version>
             <scope>provided</scope>
         </dependency>
         <!-- https://mvnrepository.com/artifact/org.apache.spark/spark-streaming -->
         <dependency>
             <groupId>org.apache.spark</groupId>
-            <artifactId>spark-streaming_2.11</artifactId>
-            <version>2.3.2</version>
+            <artifactId>spark-streaming_2.12</artifactId>
+            <version>2.4.4</version>
             <scope>provided</scope>
         </dependency>
         <!-- https://mvnrepository.com/artifact/com.typesafe/config -->
@@ -60,11 +61,19 @@
             <artifactId>config</artifactId>
             <version>1.3.4</version>
         </dependency>
-        <!-- https://mvnrepository.com/artifact/org.apache.spark/spark-streaming-kafka-0-10 -->
+        <!-- https://mvnrepository.com/artifact/org.apache.spark/spark-sql-kafka-0-10 -->
+        <dependency>
+            <groupId>org.apache.spark</groupId>
+            <artifactId>spark-sql-kafka-0-10_2.12</artifactId>
+            <version>2.4.4</version>
+            <scope>provided</scope>
+        </dependency>
+        <!-- https://mvnrepository.com/artifact/org.apache.spark/spark-mllib -->
         <dependency>
             <groupId>org.apache.spark</groupId>
-            <artifactId>spark-streaming-kafka-0-10_2.12</artifactId>
+            <artifactId>spark-mllib_2.12</artifactId>
             <version>2.4.4</version>
+            <scope>runtime</scope>
         </dependency>
 
     </dependencies>

src/main/scala/resources/kafkaConfig.properties

@@ -5,4 +5,4 @@ valueSerializer=rg.apache.kafka.common.serialization.Serializer
 keyDeSerializer=org.apache.kafka.common.serialization.Deserializer
 valueDeSerializer=org.apache.kafka.common.serialization.Deserializer
 ackType=all
-retries=1
+retries=2

travis.log

@@ -0,0 +1,84 @@
+Command line:
+"travis encrypt --add deploy.secret_access_key"
+
+
+   ________                                 __
+  /        |                               /  |
+  ########/ ______    ______    __     __  ##/    _______
+     ## |  /      \  /      \  /  \   /  | /  |  /       |
+     ## | /######  | ######  | ##  \ /##/  ## | /#######/
+     ## | ## |  ##/  /    ## |  ##  /##/   ## | ##      \
+     ## | ## |      /####### |   ## ##/    ## |  ######  |
+     ## | ## |      ##    ## |    ###/     ## | /     ##/
+     ##/  ##/        #######/      #/      ##/  #######/
+
+     TRajectory Analyzer and VISualizer  -  Open-source freeware under GNU GPL v3
+
+     Copyright (c) Martin Brehm      (2009-2017), University of Halle (Saale)
+                   Martin Thomas     (2012-2017)
+                   Barbara Kirchner  (2009-2017), University of Bonn
+
+     http://www.travis-analyzer.de
+
+     Please cite: M. Brehm, B. Kirchner: J. Chem. Inf. Model. 2011, 51 (8), pp 2007-2023.
+
+     There is absolutely no warranty on any results obtained from TRAVIS.
+
+  #  Running on manu-xps at Sun Mar 15 23:56:13 2020 (PID 18394).
+  #  Running in /media/manu/development/programming/projects/spark/UberAnalytics
+  #  Code version: Aug 12 2017, compiled at Jan 14 2018 01:39:14, compiler "7.2.0", GCC 7.2.0
+  #  Target platform: Linux, compile flags: DEBUG_ARRAYS 
+  #  Machine: int=4b, long=8b, addr=8b, 0xA0B0C0D0=D0,C0,B0,A0.
+  #  User home: /home/manu, executable: /usr/bin/travis
+  #  Input from terminal, Output to terminal
+
+ >>> Please use a color scheme with dark background or specify "-nocolor"! <<<
+
+    Loading configuration from /home/manu/.travis.conf ...
+
+[Renaming existing File input.txt to #2#input.txt ...OK.]
+Unknown parameter: "encrypt".
+
+    List of supported command line options:
+
+      -p <file>       Loads position data from the specified trajectory file.
+                      The file format may be *.xyz, *.pdb, *.lmp (LAMMPS), HISTORY (DLPOLY), or *.prmtop/*.mdcrd (Amber).
+                      BQB format (*.bqb, *.btr, *.blist) is also supported.
+      -vel <file>     Reads atom velocities from file in addition to main trajectory.
+                      Currently, only .xyz format is supported for velocity data.
+      -i <file>       Reads input from the specified text file.
+
+      -config <file>  Load the specified configuration file.
+      -stream         Treats input trajectory as a stream (e.g. named pipe): No fseek, etc.
+      -showconf       Shows a tree structure of the configuration file.
+      -writeconf      Writes the default configuration file, including all defines values.
+
+      -verbose        Show detailed information about what's going on.
+      -nocolor        Executes TRAVIS in monochrome mode (suitable for white background).
+      -dimcolor       Uses dim instead of bright colors.
+
+      -credits        Display a list of persons who contributed to TRAVIS.
+      -help, -?       Shows this help.
+
+    If only one argument is specified, it is assumed to be the name of a trajectory file.
+    If argument is specified at all, TRAVIS asks for the trajectory file to open.
+
+
+    Note: To show a list of all persons who contributed to TRAVIS,
+          please add "-credits" to your command line arguments, or set the
+          variable "SHOWCREDITS" to "TRUE" in your travis.conf file.
+
+    Source code from other projects used in TRAVIS:
+      - lmfit     from Joachim Wuttke
+      - kiss_fft  from Mark Borgerding
+      - voro++    from Chris Rycroft
+
+    http://www.travis-analyzer.de
+
+    Please cite the following articles:
+
+  * "TRAVIS - A Free Analyzer and Visualizer for Monte Carlo and Molecular Dynamics Trajectories",
+    M. Brehm, B. Kirchner; J. Chem. Inf. Model. 2011, 51 (8), pp 2007-2023.
+
+*** The End ***
+