Service diode-auth-bootstrap is keep restarting

[MUJTABA-HADI]

After executing the following commands:

sudo docker compose up -d

sudo docker compose ps

I noticed that the diode-auth-bootstrap container keeps restarting. The relevant output is

NAME IMAGE COMMAND SERVICE CREATED STATUS PORTS

diode-diode-auth-bootstrap-1 netboxlabs/diode-auth:latest "/bin/sh /etc/config…" diode-auth-bootstrap 42 seconds ago Restarting (1) 12 seconds ago

[mfiedorowicz]

Please provide more information, logs from that service probably would be a good start.

[MUJTABA-HADI]

Please provide more information, logs from that service probably would be a good start.

in docker-compose.yaml
( diode-auth-bootstrap:
image: netboxlabs/diode-auth:${DIODE_TAG:-latest}
pull_policy: always
command: ["/bin/sh", "/etc/config/oauth2/bootstrap-clients.sh"]
environment:
- HYDRA_ADMIN_URL=http://hydra:4445
volumes:
- /netbox-discovery/diode/oauth2/client:/etc/config/oauth2/client:ro
restart: on-failure
depends_on:
- hydra

volumes:
diode-redis-data:
driver: local
diode-postgres-data:
driver: local )

the result of sudo docker compose logs diode-auth-bootstrap --tail=50 is:

(diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
diode-auth-bootstrap-1 | ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
)

sudo docker run --rm -it -v /netbox-discovery/diode/oauth2/client:/test:ro alpine ls -l /test
total 0

[mfiedorowicz]

As the log says explicitly credentials file /etc/config/oauth2/client/client-credentials.json not found, did you run provided quickstart.sh as per https://github.com/netboxlabs/diode/blob/release/diode-server/README.md#getting-started ?

[MUJTABA-HADI]

I already executed quickstart.sh as below command:

./quickstart.sh http://127.0.0.1:8080

but the issue is still exist

[mfiedorowicz]

The client-credentials.json file (generated by the quickstart.sh) needs to be mounted into /etc/config/oauth2/client/client-credentials.json as per docker-compose file

[MUJTABA-HADI]

i updated docker-compose.yaml configuration like below for diode-auth-bootstrap

( ```
diode-auth-bootstrap:
image: netboxlabs/diode-auth:${DIODE_TAG:-latest}
pull_policy: always
command: ["/bin/sh", "/etc/config/oauth2/bootstrap-clients.sh"]
environment:
- HYDRA_ADMIN_URL=http://hydra:4445
volumes:
- /netbox-discovery/diode/oauth2/client/client-credentials.json:/etc/config/oauth2/client/client-credentials.json:ro
restart: on-failure
depends_on:
- hydra

volumes:
diode-redis-data:
driver: local
diode-postgres-data:
driver: local

(```
/netbox-discovery/diode$ sudo docker compose ps
NAME                           IMAGE                                COMMAND                  SERVICE                CREATED          STATUS                         PORTS
diode-diode-auth-1             netboxlabs/diode-auth:latest         "/usr/local/bin/diod…"   diode-auth             20 seconds ago   Up 18 seconds
diode-diode-auth-bootstrap-1   netboxlabs/diode-auth:latest         "/bin/sh /etc/config…"   diode-auth-bootstrap   20 seconds ago   Restarting (1) 3 seconds ago
diode-diode-ingester-1         netboxlabs/diode-ingester:latest     "/usr/local/bin/diod…"   diode-ingester         20 seconds ago   Up 13 seconds
diode-diode-reconciler-1       netboxlabs/diode-reconciler:latest   "/usr/local/bin/diod…"   diode-reconciler       20 seconds ago   Up 13 seconds
diode-hydra-1                  oryd/hydra:v25.4.0                   "hydra serve all --d…"   hydra                  20 seconds ago   Up 19 seconds                  4444-4445/tcp
diode-ingress-nginx-1          nginx:latest                         "/docker-entrypoint.…"   ingress-nginx          20 seconds ago   Up 13 seconds                  0.0.0.0:8080->80/tcp, [::]:8080->80/tcp
diode-postgres-1               docker.io/postgres:16-alpine         "docker-entrypoint.s…"   postgres               20 seconds ago   Up 19 seconds (healthy)        5432/tcp
diode-redis-1                  redis/redis-stack-server:latest      "sh -c 'redis-server…"   redis                  20 seconds ago   Up 19 seconds                  6379/tcp
/netbox-discovery/diode$ sudo docker logs diode-diode-auth-bootstrap-1
ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
ERROR: credentials file /etc/config/oauth2/client/client-credentials.json not found
```)


Could you please provide the correct steps to resolving this issue

[MUJTABA-HADI]

Is this issue causing this error (Failed to obtain access token: HTTPConnectionPool(host='127.0.0.1', port=8080): Max retries exceeded with url: /diode/auth/token (Caused by NewConnectionError("HTTPConnection(host='10.157.37.126', port=8080): Failed to establish a new connection: [Errno 111] Connection refused")) ) when i want to Generate Diode Client Credentials ?

[MUJTABA-HADI]

@mfiedorowicz , Hi, is there any solution for this issue?

[mfiedorowicz]

Is this issue causing this error (Failed to obtain access token: HTTPConnectionPool(host='127.0.0.1', port=8080): Max retries exceeded with url: /diode/auth/token (Caused by NewConnectionError("HTTPConnection(host='10.157.37.126', port=8080): Failed to establish a new connection: [Errno 111] Connection refused")) ) when i want to Generate Diode Client Credentials ?

You have two configuration issues:

• diode server is not configured with generated client credentials as per provided instructions in README
• diode plugin most likely is not configured properly (diode target URL) so cannot reach diode server

It's unknown what steps have you done so far and what's your actual setup/configuration, so it's difficult for me to provide anything else other than please follow instructions and set netbox and diode target URLs as required.

[MUJTABA-HADI]

I reinstalled the NetBox and Diode servers and followed all the steps in the official guide, but I am still facing the same issues.