Skip to content

[postgres-backup-s3] Add option to prefix backup file name with custom string #113

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
przemyslaw-szurmak wants to merge 3 commits into
base: master
Choose a base branch
from
Open

[postgres-backup-s3] Add option to prefix backup file name with custom string #113

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
5c8d66b
Add new environment variable for specifying prefix before filename
przemyslaw-szurmak Mar 6, 2019
5cc6cad
Print backup filename to console
przemyslaw-szurmak Mar 6, 2019
6c9696b
Install just postgres client instead of whole app
przemyslaw-szurmak Mar 6, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions postgres-backup-s3/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@ ENV S3_PATH 'backup'
ENV S3_ENDPOINT **None**
ENV S3_S3V4 no
ENV SCHEDULE **None**
ENV DB_ENV_PREFIX **None**

ADD run.sh run.sh
ADD backup.sh backup.sh
Expand Down
3 changes: 2 additions & 1 deletion postgres-backup-s3/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ Backup PostgresSQL to S3 (supports periodic backups)

Docker:
```sh
$ docker run -e S3_ACCESS_KEY_ID=key -e S3_SECRET_ACCESS_KEY=secret -e S3_BUCKET=my-bucket -e S3_PREFIX=backup -e POSTGRES_DATABASE=dbname -e POSTGRES_USER=user -e POSTGRES_PASSWORD=password -e POSTGRES_HOST=localhost schickling/postgres-backup-s3
$ docker run -e S3_ACCESS_KEY_ID=key -e S3_SECRET_ACCESS_KEY=secret -e S3_BUCKET=my-bucket -e S3_PREFIX=backup -e POSTGRES_DATABASE=dbname -e POSTGRES_USER=user -e POSTGRES_PASSWORD=password -e POSTGRES_HOST=localhost -e DB_ENV_PREFIX=prod schickling/postgres-backup-s3
```

Docker Compose:
Expand All @@ -23,6 +23,7 @@ pgbackups3:
- postgres
environment:
SCHEDULE: '@daily'
DB_ENV_PREFIX: 'prod'
S3_REGION: region
S3_ACCESS_KEY_ID: key
S3_SECRET_ACCESS_KEY: secret
Expand Down
11 changes: 9 additions & 2 deletions postgres-backup-s3/backup.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,11 @@ else
AWS_ARGS="--endpoint-url ${S3_ENDPOINT}"
fi

if [ "${DB_ENV_PREFIX}" = "**None**" ]; then
echo "You need to set the DB_ENV_PREFIX environment variable."
exit 1
fi

# env vars needed for aws tools
export AWS_ACCESS_KEY_ID=$S3_ACCESS_KEY_ID
export AWS_SECRET_ACCESS_KEY=$S3_SECRET_ACCESS_KEY
Expand All @@ -61,8 +66,10 @@ echo "Creating dump of ${POSTGRES_DATABASE} database from ${POSTGRES_HOST}..."

pg_dump $POSTGRES_HOST_OPTS $POSTGRES_DATABASE | gzip > dump.sql.gz

echo "Uploading dump to $S3_BUCKET"
FILENAME=${DB_ENV_PREFIX}_${POSTGRES_DATABASE}_$(date +"%Y-%m-%dT%H_%M_%SZ").sql.gz

echo "Uploading dump named $FILENAME to $S3_BUCKET"

cat dump.sql.gz | aws $AWS_ARGS s3 cp - s3://$S3_BUCKET/$S3_PREFIX/${POSTGRES_DATABASE}_$(date +"%Y-%m-%dT%H:%M:%SZ").sql.gz || exit 2
cat dump.sql.gz | aws $AWS_ARGS s3 cp - s3://$S3_BUCKET/$S3_PREFIX/$FILENAME || exit 2

echo "SQL backup uploaded successfully"
2 changes: 1 addition & 1 deletion postgres-backup-s3/install.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ set -e
apk update

# install pg_dump
apk add postgresql
apk add postgresql-client

# install s3 tools
apk add python py2-pip
Expand Down