missions 13 - 19 parcomp

Author: damienfrancois

missions/parcomp/03_firstactualtiming/goal/en.txt

@@ -21,6 +21,6 @@ The time command will output three measurments:
 - sys: CPU time spent by the operating system to run the command
 
 The `user` part will be lower than `elapsed` if the command has
-spent some time waiting or sleep, and will be greater than `elapsed`
+spent some time waiting or sleeping, and will be greater than `elapsed`
 if it used multiple CPUs at the same time. The `sys` part refers to
 operations performed in `kernel mode` such as malloc or fread/fwrite.

missions/parcomp/06_xargsserial/goal/en.txt

@@ -22,7 +22,7 @@ command on each item in the list.
 
 For instance, you can run the following command to see the output.
 
-    ls d?.txt | xargs -I {} echo "I found {} here! I repeat. I found {}here!"
+    ls d?.txt | xargs -I {} echo "I found {} here! I repeat. I found {} here!"
 
 The `-I` argument denotes the place holder that can subsequently be used in the 
 command passed as argument. Any character sequence can be used, but {} is often

missions/parcomp/07_xargsparallel/goal/en.txt

@@ -8,8 +8,6 @@ command again.
 Now run the same line (including the `time`) but add `-P4` as first argument
 to `xargs` and observe the results.
 
-
-
 Useful commands
 ===============
 

missions/parcomp/09_fifo/goal/en.txt

@@ -7,10 +7,10 @@ start.
 
 Linux actualy allows creating "fake" files that can be written to and
 read from at the same time. The command that reads is blocked until the
-command that writes has writtent a line. This way, both commands can 
+command that writes has written a line. This way, both commands can 
 operate at the same time.
 
-To fulfil this mission, create such a file, called a 'fifo' file named
+To fulfill this mission, create such a file, called a 'fifo' file named
 `tmp.fifo` with the `mkfifo` command and use it instead of the regular
 file `tmp.txt` in the previous mission. Make sure to run the first 
 command *in the background* to allow the second one to start as soon

missions/parcomp/10_pipe/goal/en.txt

@@ -21,10 +21,6 @@ time { COMMAND1 | COMMAND2 ; }
   this will measure the time needed to run both commands in cases
   the second command is consuming output from the first one.
 
-mkfifo FILE
-  creates a "fake" fifo file that can be writtent to and read from
-  at the same time.
-
 Remarks
 -------
 

missions/parcomp/12_make/goal/en.txt

@@ -1,7 +1,7 @@
 Mission goal
 ============
 
-For this final mission, we will look at the case where we have both
+For this mission, we will look at the case where we have both
 multiple data files and multiple commands, and we suppose we have
 to use intermediate files. 
 

missions/parcomp/13_gnuparallel/Makefile

@@ -0,0 +1,41 @@
+SH_FILES=$(wildcard *.sh)
+EXCEPTIONS=
+OTHER_FILES=
+
+LANGUAGES=$(wildcard i18n/*.po)
+LANGUAGES:=$(filter-out i18n/en.po, $(LANGUAGES))
+SH_FILES:=$(filter-out $(EXCEPTIONS), $(SH_FILES))
+SORT=--sort-output
+OPTIONS=--indent --no-wrap --no-location
+
+all: i18n/en.po $(LANGUAGES)
+
+add-locations: SORT=--add-location --sort-by-file
+add-locations: all
+
+i18n/en.po: i18n/template.pot FORCE
+	@echo "msgen $@"
+	@msgen $(OPTIONS) $(SORT) i18n/template.pot --output=$@
+	@echo "# AUTOMATICALLY GENERATED -- DO NOT EDIT" | cat - $@ > $@~
+	@mv $@~ $@
+
+$(LANGUAGES):%.po: i18n/template.pot FORCE
+	@echo "msgmerge $@"
+	@msgmerge --update $(OPTIONS) $(SORT) $@ i18n/template.pot
+
+i18n/template.pot: $(SH_FILES) $(OTHER_FILES) FORCE
+	@mkdir -p i18n/
+	@echo "generating i18n/template.pot"
+	@xgettext --from-code=UTF-8 --omit-header $(OPTIONS) $(SORT) --join-existing --output i18n/template.pot $(SH_FILES) $(OTHER_FILES)
+	@echo "done"
+
+new: i18n/template.pot
+	@read -p "language code: " lang; \
+		[ -e "./i18n/$$lang.po" ] && echo "file i18n/$$lang.po already exists" && exit; \
+		echo "file i18n/$$lang.po created"; \
+		msgcat $(OPTIONS) --output i18n/$$lang.po i18n/template.pot
+
+clean:
+	rm -f i18n/*~
+
+.PHONY: all clean new FORCE

missions/parcomp/13_gnuparallel/auto.sh

@@ -0,0 +1,5 @@
+#!/usr/bin/env sh
+
+ml parallel
+
+gsh check

missions/parcomp/13_gnuparallel/check.sh

@@ -0,0 +1,12 @@
+#!/usr/bin/env bash -x
+
+
+
+
+if which parallel &>/dev/null
+then
+    true
+else
+        echo "Hum. The `parallel` command cannot be found. Is the module properly loaded?"
+        false
+fi

missions/parcomp/13_gnuparallel/goal/en.txt

@@ -0,0 +1,24 @@
+Mission goal
+============
+
+This time, we will look at a command which is not part of the set
+of basics Linux commands. Its name is GNU Parallel and is installed
+as an environment module on the clusters. The goal of this mission
+is to find this module and load it so that the `parallel` program
+is avaiable in the command line.
+
+Useful commands
+===============
+
+module spider PROGRAM
+  this command will look for PROGRAM across all software installed
+  on the cluster. It should already be familiar to any cluster
+  user. If not, please refer to the CECI documentation, the
+  CISM/CECI Youtube Channel, or the gameshell/module game.
+
+
+Remarks
+-------
+
+The `parallel` module might not be in the default release, so make
+sure to load the correct one before loading the module.