Skip to content

Add k8s deployment #112

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
pperzyna wants to merge 8 commits into
base: main
Choose a base branch
from
Draft

Add k8s deployment #112

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
5a0fe3c
add helm and new ci
pperzyna Oct 6, 2021
89e8f73
update pipeline
pperzyna Oct 6, 2021
da334df
update
pperzyna Oct 6, 2021
aa9a540
update base image
pperzyna Oct 6, 2021
0b983df
update aws provider
pperzyna Oct 6, 2021
d13eb60
update helm chart
pperzyna Oct 7, 2021
4c07305
update pipelines
pperzyna Oct 7, 2021
3d04fd0
update service
pperzyna Oct 7, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
75 changes: 46 additions & 29 deletions .github/workflows/facebook.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,13 +7,11 @@ on:
branches:
- "**"
paths:
- "dataplug/**"
- "build.sbt"
- "dataplug-facebook/**"
- ".github/workflows/facebook.yml"

env:
DATAPLUG: dataplug-facebook

jobs:
deploy:
runs-on: ubuntu-latest
Expand All @@ -27,6 +25,9 @@ jobs:
path: ~/.cache/coursier/v1/https
key: ${{ runner.OS }}-coursier-cache

- name: Cache - Resolvers
run: curl https://${{ secrets.ARTIFACTS_CACHE_BUCKET }}/resolvers.sbt --create-dirs -o ~/.sbt/resolvers.sbt

- name: Setup Java
uses: actions/setup-java@v2
with:
Expand All @@ -35,35 +36,51 @@ jobs:
java-package: jdk
architecture: x64

- name: Login to Docker Hub
uses: docker/login-action@v1
with:
username: ${{ secrets.DOCKER_HUB_USERNAME }}
password: ${{ secrets.DOCKER_HUB_ACCESS_TOKEN }}
- name: Container - Prepare
run: sbt "project dataplug-facebook" docker:stage

- name: Container Image Prepare
run: sbt "project $DATAPLUG" docker:stage
- name: Container - Setup QEMU
uses: docker/setup-qemu-action@v1

- name: Container Image Build
run: docker build -t hubofallthings/$DATAPLUG:$GITHUB_SHA $DATAPLUG/target/docker/stage/
- name: Container - Setup Buildx
uses: docker/setup-buildx-action@v1

- name: Container Image Push
run: docker push hubofallthings/$DATAPLUG:$GITHUB_SHA
- name: Container - Meta
id: meta
uses: docker/metadata-action@v3
with:
images: dataswift/dataplug-facebook
tags: |
type=match,prefix=v,pattern=facebook-v(\d.\d.\d),group=1
type=raw,value=latest,enable=${{ startsWith(github.ref, 'refs/heads/main') }}
type=sha,prefix=main-,format=long,enable=${{ startsWith(github.ref, 'refs/heads/main') }}
type=sha,prefix=dev-,format=long,suffix=-${{ github.run_id }}

- name: Extract Branch Name
run: |
echo "BRANCH=$(echo ${GITHUB_REF})" >> $GITHUB_ENV
- name: Container - Login DockerHub
uses: docker/login-action@v1
with:
username: ${{ secrets.DOCKERHUB_DATASWIFT_USER }}
password: ${{ secrets.DOCKERHUB_DATASWIFT_PASS }}

- name: Container Image Push - Master
if: contains(env.BRANCH, 'main')
run: |
docker tag hubofallthings/$DATAPLUG:$GITHUB_SHA hubofallthings/$DATAPLUG:main
docker push hubofallthings/$DATAPLUG:main
- name: Container - Build & Push
uses: docker/build-push-action@v2
with:
push: true
context: dataplug-facebook/target/docker/stage/
tags: ${{ steps.meta.outputs.tags }}
labels: ${{ steps.meta.outputs.labels }}
platforms: linux/amd64,linux/arm64
cache-from: type=registry,ref=ghcr.io/datasiwft/dataplug-facebook:latest

- name: Container Image Push - Tag
if: contains(env.BRANCH, 'tags')
run: |
docker tag hubofallthings/$DATAPLUG:$GITHUB_SHA hubofallthings/$DATAPLUG:$(echo $GITHUB_REF | sed -e "s/refs\/tags\///g")
docker push hubofallthings/$DATAPLUG:$(echo $GITHUB_REF | sed -e "s/refs\/tags\///g")
docker tag hubofallthings/$DATAPLUG:$GITHUB_SHA hubofallthings/$DATAPLUG:latest
docker push hubofallthings/$DATAPLUG:latest
- name: Slack
uses: lazy-actions/slatify@master
if: failure()
with:
type: ${{ job.status }}
job_name: "*${{ github.workflow }}*"
channel: "ci"
commit: true
mention: "here"
mention_if: "failure"
token: ${{ secrets.GITHUB_TOKEN }}
url: ${{ secrets.SLACK_WEBHOOK_URL }}
75 changes: 46 additions & 29 deletions .github/workflows/fitbit.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,13 +7,11 @@ on:
branches:
- "**"
paths:
- "dataplug/**"
- "build.sbt"
- "dataplug-fitbit/**"
- ".github/workflows/fitbit.yml"

env:
DATAPLUG: dataplug-fitbit

jobs:
deploy:
runs-on: ubuntu-latest
Expand All @@ -27,6 +25,9 @@ jobs:
path: ~/.cache/coursier/v1/https
key: ${{ runner.OS }}-coursier-cache

- name: Cache - Resolvers
run: curl https://${{ secrets.ARTIFACTS_CACHE_BUCKET }}/resolvers.sbt --create-dirs -o ~/.sbt/resolvers.sbt

- name: Setup Java
uses: actions/setup-java@v2
with:
Expand All @@ -35,35 +36,51 @@ jobs:
java-package: jdk
architecture: x64

- name: Login to Docker Hub
uses: docker/login-action@v1
with:
username: ${{ secrets.DOCKER_HUB_USERNAME }}
password: ${{ secrets.DOCKER_HUB_ACCESS_TOKEN }}
- name: Container - Prepare
run: sbt "project dataplug-fitbit" docker:stage

- name: Container Image Prepare
run: sbt "project $DATAPLUG" docker:stage
- name: Container - Setup QEMU
uses: docker/setup-qemu-action@v1

- name: Container Image Build
run: docker build -t hubofallthings/$DATAPLUG:$GITHUB_SHA $DATAPLUG/target/docker/stage/
- name: Container - Setup Buildx
uses: docker/setup-buildx-action@v1

- name: Container Image Push
run: docker push hubofallthings/$DATAPLUG:$GITHUB_SHA
- name: Container - Meta
id: meta
uses: docker/metadata-action@v3
with:
images: dataswift/dataplug-fitbit
tags: |
type=match,prefix=v,pattern=fitbit-v(\d.\d.\d),group=1
type=raw,value=latest,enable=${{ startsWith(github.ref, 'refs/heads/main') }}
type=sha,prefix=main-,format=long,enable=${{ startsWith(github.ref, 'refs/heads/main') }}
type=sha,prefix=dev-,format=long,suffix=-${{ github.run_id }}

- name: Extract Branch Name
run: |
echo "BRANCH=$(echo ${GITHUB_REF})" >> $GITHUB_ENV
- name: Container - Login DockerHub
uses: docker/login-action@v1
with:
username: ${{ secrets.DOCKERHUB_DATASWIFT_USER }}
password: ${{ secrets.DOCKERHUB_DATASWIFT_PASS }}

- name: Container Image Push - Master
if: contains(env.BRANCH, 'main')
run: |
docker tag hubofallthings/$DATAPLUG:$GITHUB_SHA hubofallthings/$DATAPLUG:main
docker push hubofallthings/$DATAPLUG:main
- name: Container - Build & Push
uses: docker/build-push-action@v2
with:
push: true
context: dataplug-fitbit/target/docker/stage/
tags: ${{ steps.meta.outputs.tags }}
labels: ${{ steps.meta.outputs.labels }}
platforms: linux/amd64,linux/arm64
cache-from: type=registry,ref=ghcr.io/datasiwft/dataplug-fitbit:latest

- name: Container Image Push - Tag
if: contains(env.BRANCH, 'tags')
run: |
docker tag hubofallthings/$DATAPLUG:$GITHUB_SHA hubofallthings/$DATAPLUG:$(echo $GITHUB_REF | sed -e "s/refs\/tags\///g")
docker push hubofallthings/$DATAPLUG:$(echo $GITHUB_REF | sed -e "s/refs\/tags\///g")
docker tag hubofallthings/$DATAPLUG:$GITHUB_SHA hubofallthings/$DATAPLUG:latest
docker push hubofallthings/$DATAPLUG:latest
- name: Slack
uses: lazy-actions/slatify@master
if: failure()
with:
type: ${{ job.status }}
job_name: "*${{ github.workflow }}*"
channel: "ci"
commit: true
mention: "here"
mention_if: "failure"
token: ${{ secrets.GITHUB_TOKEN }}
url: ${{ secrets.SLACK_WEBHOOK_URL }}
86 changes: 86 additions & 0 deletions .github/workflows/gcalendar.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,86 @@
name: Build gcalendar plug

on:
push:
tags:
- "gcalendar-v**"
branches:
- "**"
paths:
- "dataplug/**"
- "build.sbt"
- "dataplug-gcalendar/**"
- ".github/workflows/gcalendar.yml"

jobs:
deploy:
runs-on: ubuntu-latest
steps:
- name: Checkout
uses: actions/checkout@v2

- name: Cache - GHA
uses: actions/cache@v1
with:
path: ~/.cache/coursier/v1/https
key: ${{ runner.OS }}-coursier-cache

- name: Cache - Resolvers
run: curl https://${{ secrets.ARTIFACTS_CACHE_BUCKET }}/resolvers.sbt --create-dirs -o ~/.sbt/resolvers.sbt

- name: Setup Java
uses: actions/setup-java@v2
with:
distribution: adopt
java-version: 11
java-package: jdk
architecture: x64

- name: Container - Prepare
run: sbt "project dataplug-gcalendar" docker:stage

- name: Container - Setup QEMU
uses: docker/setup-qemu-action@v1

- name: Container - Setup Buildx
uses: docker/setup-buildx-action@v1

- name: Container - Meta
id: meta
uses: docker/metadata-action@v3
with:
images: dataswift/dataplug-gcalendar
tags: |
type=match,prefix=v,pattern=gcalendar-v(\d.\d.\d),group=1
type=raw,value=latest,enable=${{ startsWith(github.ref, 'refs/heads/main') }}
type=sha,prefix=main-,format=long,enable=${{ startsWith(github.ref, 'refs/heads/main') }}
type=sha,prefix=dev-,format=long,suffix=-${{ github.run_id }}

- name: Container - Login DockerHub
uses: docker/login-action@v1
with:
username: ${{ secrets.DOCKERHUB_DATASWIFT_USER }}
password: ${{ secrets.DOCKERHUB_DATASWIFT_PASS }}

- name: Container - Build & Push
uses: docker/build-push-action@v2
with:
push: true
context: dataplug-gcalendar/target/docker/stage/
tags: ${{ steps.meta.outputs.tags }}
labels: ${{ steps.meta.outputs.labels }}
platforms: linux/amd64,linux/arm64
cache-from: type=registry,ref=ghcr.io/datasiwft/dataplug-gcalendar:latest

- name: Slack
uses: lazy-actions/slatify@master
if: failure()
with:
type: ${{ job.status }}
job_name: "*${{ github.workflow }}*"
channel: "ci"
commit: true
mention: "here"
mention_if: "failure"
token: ${{ secrets.GITHUB_TOKEN }}
url: ${{ secrets.SLACK_WEBHOOK_URL }}
72 changes: 0 additions & 72 deletions .github/workflows/google-calendar.yml
View file
Open in desktop

This file was deleted.

Loading