Home
start_dss, stop_dss and launch_dss can be used on both MacOS and AWS ec2 instance.
start_kub, stop_kub and launch_kub limited to only my MacOS.
optional script file set_env_variables used to set environment variables required by each services. This file is located in the same directory as the docker-compose.yml for each service. Current use of this script file is to set login credentials for the data science stack. Specific environment variables are stack specific. Example syntax,
# set required environment variables
export ENV_VARIABLE=the_value
Note: File permissions are handled differently when a container is running on MacOS vs Linux.
See guidance for connecting to AWS.
Bootstrap scripts are available to customize ec2 instances to run the docker images. There are two versions of the scrips. One is to be used for non-gpu ec2 instance. The other for gpu ec2 instances.
| Instance Type | Bootstrap script |
|---|---|
| non-gpu | bootstrap_awslinux_ami |
| gpu | bootstrap_deeplearning_ami |
Use the appropriate script for the User Data option when launching the ec2 instance.
git clone https://github.com/jimthompson5802/datascience_sample.git
After set up, create directory or git clone source code for data science experiments. Use start_dss, 'stop_dss`.