s3-multipart-upload

Upload files in a directory to s3 via multipart uploads. The uploaded parts are checkpointed to a local file for restarting purposes.

Overview

Arguemment	Description	Default Value
bucket	The bucket name to multipart upload too.	No Default
checkpoint	The directory to store the checkpoint files.	./.checkpoints
dir	The directory of all the files to multipart upload with. This directory will be mirrored into s3.	No Default
partSize	The size of each part to upload.	100MB

Installation

brew tap jmoney/aws
brew install s3-multipart-upload

Run Locally

go run cmd/cli/main.go -bucket test-bucket -dir sample

This will mirror the contents of the directory sample into the root of bucket test-bucket and store the checkpoint files for the multipart-uploads into the ./.checkpoints.