diff --git a/Documentation/ips.md b/Documentation/ips.md index 7015646..798f85f 100644 --- a/Documentation/ips.md +++ b/Documentation/ips.md @@ -49,6 +49,11 @@ Proposal is to use 172.22.0.0/16 network for all ip addresing in the lab, and ha | 172.22.2.4 | | DH4 iDRAC | | | 172.22.4.4 | | Intel DYP imc | | | | | | | +| 172.22.1.5 | | DPU Host 5 | | +| 172.22.2.5 | | DH5 iDRAC | | +| 172.22.3.5 | | Nvidia BF3 | | +| 172.22.4.5 | | Nvidia BF3 bmc | | +| | | | | | 172.22.1.9 | | DPU Host 9 | | | 172.22.2.9 | | DH9 ??? | | | | | | | diff --git a/Documentation/server-setup.md b/Documentation/server-setup.md index 39119cc..e3c39a5 100644 --- a/Documentation/server-setup.md +++ b/Documentation/server-setup.md @@ -20,8 +20,8 @@ ansible-playbook -i inventory install_os.yml We have 2 installation options: -- `Official ISO` - only for `RHEL` and `ESXI`, while `UBUNTU` is still a pull request dell/dellemc-openmanage-ansible-modules#784. -- `Custom ISO` - first prepare and ISO manually as explained here [here](auto_install_ubuntu_iso.md) and then call same [playbook](../ansible/install_os.yml) +* `Official ISO` - only for `RHEL` and `ESXI`, while `UBUNTU` is still a pull request dell/dellemc-openmanage-ansible-modules#784. +* `Custom ISO` - first prepare and ISO manually as explained here [here](auto_install_ubuntu_iso.md) and then call same [playbook](../ansible/install_os.yml) ## Manual diff --git a/README.md b/README.md index 72a3e9d..469ccb3 100644 --- a/README.md +++ b/README.md @@ -50,6 +50,8 @@ We manage all passwords in - [DH2 - DPU Host 2 - HPE DL360](./hardware/dh2/README.md) - [DH3 - DPU Host 3 - HP RL300](./hardware/dh3/README.md) - [DH4 - DPU Host 4 - Dell R760](./hardware/dh4/README.md) + - [DH5 - DPU Host 5 - Dell R760](./hardware/dh5/README.md) + - [DH9 - DPU Host 9 - Dell R760](./hardware/dh9/README.md) - [A100G - 100G Switch - Arista DCS-7280CR](./hardware/A100G/README.md) - [TGEN1 - Traffic Generator 1 - Supermicro](./hardware/tgen1/README.md) - [Running the Test Cases](./Documentation/running-the-tests.md) diff --git a/ansible/inventory b/ansible/inventory index 95972ec..5d48350 100644 --- a/ansible/inventory +++ b/ansible/inventory @@ -5,6 +5,7 @@ dh1 ansible_host=172.22.1.1 ansible_connection=ssh ansible_user=root dh2 ansible_host=172.22.1.2 ansible_connection=ssh ansible_user=root dh3 ansible_host=172.22.1.3 ansible_connection=ssh ansible_user=root dh4 ansible_host=172.22.1.4 ansible_connection=ssh ansible_user=root +dh5 ansible_host=172.22.1.5 ansible_connection=ssh ansible_user=root dh9 ansible_host=172.22.1.9 ansible_connection=ssh ansible_user=root [hostbmcs] @@ -19,11 +20,13 @@ amd ansible_host=172.22.3.1 ansible_connection=ssh ansible_user=root bf2 ansible_host=172.22.3.2 ansible_connection=ssh ansible_user=root mrv ansible_host=172.22.3.3 ansible_connection=ssh ansible_user=root mev ansible_host=192.168.0.2 ansible_connection=ssh ansible_user=root ansible_ssh_common_args='-J root@172.22.4.4' proxy_env="{'http_proxy': 'http://192.168.0.1:3128', 'https_proxy': 'http://192.168.0.1:3128'}" +bf3 ansible_host=172.22.3.5 ansible_connection=ssh ansible_user=root [dpubmcs] bf2bmc ansible_host=172.22.4.2 ansible_connection=local ansible_user=root mrvbmc ansible_host=172.22.4.3 ansible_connection=local ansible_user=root mevbmc ansible_host=172.22.4.4 ansible_connection=ssh ansible_user=root +bf3bmc ansible_host=172.22.4.5 ansible_connection=local ansible_user=root [tgens] tgen1 ansible_host=172.22.1.100 ansible_connection=ssh ansible_user=root diff --git a/hardware/dh5/README.md b/hardware/dh5/README.md new file mode 100644 index 0000000..883bf4b --- /dev/null +++ b/hardware/dh5/README.md @@ -0,0 +1,19 @@ +# DPU Host 5 + +Dell R760ax + +## DPU + +Nvidia Blue Filed 3 + +## BIOS settings + +- change power to always on + +## Otel or telegraf + +Run telegraf container: + +```bash +sudo docker run -d --restart=always --network=host -v ./telegraf.d/telegraf.conf:/etc/telegraf/telegraf.conf docker.io/library/telegraf:1.31 +``` diff --git a/images/opi-lab-cabling.drawio.svg b/images/opi-lab-cabling.drawio.svg index 8f12c3e..b70db14 100644 --- a/images/opi-lab-cabling.drawio.svg +++ b/images/opi-lab-cabling.drawio.svg @@ -1,4 +1,4 @@ -
IP
VGA
USB
USB
P1
P2
NIC1
SW TGEN 1
RAX XS4-11S3-10G
IPMI
P1
P2
NIC2
tgen1
172.22.1.100
172.22.2.100
18
IP
IP
13
15
17
19
21
23
14
16
20
22
24
1
3
5
7
2
4
6
8
9
11
10
12
29
31
30
32
25
27
26
28
TS
18
IP
COM
13
15
17
19
21
23
14
16
20
22
24
1
3
5
7
2
4
6
8
9
11
10
12
ToR
KVM
DO NOT USE, RESERVED FOR AIRFLOW
DO NOT USE, RESERVED FOR AIRFLOW
1
2
3
4
5
6
7
8
9
10
11
12
EMPTY
13
EMPTY
14
EMPTY
15
EMPTY
16
EMPTY
17
EMPTY
18
EMPTY
19
20
21
DO NOT USE, RESERVED FOR AIRFLOW
22
DO NOT USE, RESERVED FOR AIRFLOW
23
24
EMPTY
25
EMPTY
26
EMPTY
27
EMPTY
28
EMPTY
29
EMPTY
30
EMPTY
31
EMPTY
32
EMPTY
33
EMPTY
34
EMPTY
35
EMPTY
36
EMPTY
37
EMPTY
38
EMPTY
39
EMPTY
40
EMPTY
41
42
DO NOT USE, RESERVED FOR AIRFLOW
43
DO NOT USE, RESERVED FOR AIRFLOW
44
NETWORK PDU
COM
IP
53
54
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
55
56
49
50
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
51
52
Arista DCS-7280CR-48-F
172.22.1.250
IP
SFP28
VGA
USB
USB
P1
P2
DPU
IP
SERVER DPU HOST 1
IP
SFP28
VGA
USB
USB
P1
P2
DPU
IP
SERVER DPU HOST 2
IP
SFP28
VGA
USB
USB
SERVER DPU HOST 3
Vertiv Avocent 8032DAC
Vertiv Avocent ACS8000
18
13
15
17
19
21
23
14
16
20
22
24
1
3
5
7
2
4
6
8
9
11
10
12
29
31
30
32
25
27
26
28
IP
IP
COM
USB
USB
LAN 2
LAN 1
MOD
SETUP
PDU1
PDU2
inf
USB
USB
USB
USB
VGA
COM
IP
AMD/Pensando DSC2-100
Nvidia BlueField2
24
23
22
21
20
19
18
17
16
15
14
13
12
11
10
9
8
7
6
5
4
3
2
1
.
172.22.0.20
Vertiv Geist GU2 rack PDU VP7N3001
172.22.0.10
172.22.0.1
172.22.1.2
172.22.1.3
172.22.3.1
172.22.3.2
iDRAC
iLO
iLO
dh1
dh2
dh3
18
COM
IP
13
15
17
19
21
23
14
16
20
22
24
1
3
5
7
2
4
6
8
9
11
10
12
old ToR unconnected
49
50
51
52
53
54
42
37
39
41
43
45
47
38
40
44
46
48
25
27
29
31
26
28
30
32
33
35
34
36
CON
FAIL
IP
IP
MGMT
USB
IP
IP
IP
IP
IP
IP
IP
IP
IP
IP
CON
FAIL
IP
IP
MGMT
USB
IP
IP
IP
IP
IP
IP
IP
IP
IP
IP
F5A
F5B
.
.
.
F5 BIGI-IP i4000
F5 BIGI-IP i4000
DCS-7280TR-48C6-R
172.22.0.5
P1
DPU
IP
Marvell CN106
USB
USB
USB
172.22.3.3
internet
IP
VGA
USB
USB
SERVER DPU HOST 4
Dell R760
172.22.1.4
iDRAC
dh4
P1
DPU
IP
Intel DYP
USB
172.22.3.4
P2
172.22.2.2
172.22.2.1
Dell PowerEdge R650
HPE DL360 Gen10+
172.22.2.3
172.22.2.4
HP RL300 Gen11
 \ No newline at end of file +
IP
IP
VGA
VGA
USB
USB
USB
USB
P1
P1
P2
P2
NIC
NIC
SERVER MGMT
SERVER MGMT
172.22.0.1
172.22.0.1
IPMI
IPMI
mgmt
mgmt
172.22.2.0
172.22.2.0
RAX QH4-11E4
RAX QH4-11E4
IP
IP
VGA
VGA
USB
USB
USB
USB
P1
P1
P2
P2
NIC1
NIC1
SW TGEN 1
SW TGEN 1
RAX XS4-11S3-10G
RAX XS4-11S3-10G
IPMI
IPMI
P1
P1
P2
P2
NIC2
NIC2
tgen1
tgen1
172.22.1.100
172.22.1.100
172.22.2.100
172.22.2.100
18
18
IP
IP
IP
IP
13
13
15
15
17
17
19
19
21
21
23
23
14
14
16
16
20
20
22
22
24
24
1
1
3
3
5
5
7
7
2
2
4
4
6
6
8
8
9
9
11
11
10
10
12
12
29
29
31
31
30
30
32
32
25
25
27
27
26
26
28
28
TS
TS
18
18
IP
IP
COM
COM
13
13
15
15
17
17
19
19
21
21
23
23
14
14
16
16
20
20
22
22
24
24
1
1
3
3
5
5
7
7
2
2
4
4
6
6
8
8
9
9
11
11
10
10
12
12
ToR
ToR
KVM
KVM
DO NOT USE, RESERVED FOR AIRFLOW
DO NOT USE, RESERVED FOR AIRFLOW
1
1
2
2
3
3
4
4
5
5
6
6
7
7
8
8
9
9
10
10
11
11
12
12
EMPTY
EMPTY
13
13
EMPTY
EMPTY
14
14
15
15
16
16
17
17
18
18
19
19
20
20
21
21
DO NOT USE, RESERVED FOR AIRFLOW
DO NOT USE, RESERVED FOR AIRFLOW
22
22
DO NOT USE, RESERVED FOR AIRFLOW
DO NOT USE, RESERVED FOR AIRFLOW
23
23
24
24
EMPTY
EMPTY
25
25
EMPTY
EMPTY
26
26
EMPTY
EMPTY
27
27
EMPTY
EMPTY
28
28
EMPTY
EMPTY
29
29
EMPTY
EMPTY
30
30
EMPTY
EMPTY
31
31
EMPTY
EMPTY
32
32
EMPTY
EMPTY
33
33
EMPTY
EMPTY
34
34
EMPTY
EMPTY
35
35
EMPTY
EMPTY
36
36
EMPTY
EMPTY
37
37
EMPTY
EMPTY
38
38
EMPTY
EMPTY
39
39
EMPTY
EMPTY
40
40
41
41
42
42
DO NOT USE, RESERVED FOR AIRFLOW
DO NOT USE, RESERVED FOR AIRFLOW
43
43
DO NOT USE, RESERVED FOR AIRFLOW
DO NOT USE, RESERVED FOR AIRFLOW
44
44
NETWORK PDU
NETWORK PDU
COM
COM
IP
IP
53
53
54
54
25
25
26
26
27
27
28
28
29
29
30
30
31
31
32
32
33
33
34
34
35
35
36
36
37
37
38
38
39
39
40
40
41
41
42
42
43
43
44
44
45
45
46
46
47
47
48
48
55
55
56
56
49
49
50
50
1
1
2
2
3
3
4
4
5
5
6
6
7
7
8
8
9
9
10
10
11
11
12
12
13
13
14
14
15
15
16
16
17
17
18
18
19
19
20
20
21
21
22
22
23
23
24
24
51
51
52
52
Arista DCS-7280CR-48-F
Arista DCS-7280CR-48-F
172.22.1.250
172.22.1.250
IP
SFP28
IP...
VGA
VGA
USB
USB
USB
USB
P1
P1
P2
P2
DPU
DPU
IP
IP
SERVER DPU HOST 1
SERVER DPU HOST 1
IP
SFP28
IP...
VGA
VGA
USB
USB
USB
USB
P1
P1
P2
P2
DPU
DPU
IP
IP
SERVER DPU HOST 2
SERVER DPU HOST 2
IP
SFP28
IP...
VGA
VGA
USB
USB
USB
USB
SERVER DPU HOST 3
SERVER DPU HOST 3
Vertiv Avocent 8032DAC
Vertiv Avocent 8032DAC
Vertiv Avocent ACS8000
Vertiv Avocent ACS8000
18
18
13
13
15
15
17
17
19
19
21
21
23
23
14
14
16
16
20
20
22
22
24
24
1
1
3
3
5
5
7
7
2
2
4
4
6
6
8
8
9
9
11
11
10
10
12
12
29
29
31
31
30
30
32
32
25
25
27
27
26
26
28
28
IP
IP
IP
IP
COM
COM
USB
USB
USB
USB
LAN 2
LAN 2
LAN 1
LAN 1
MOD
MOD
SETUP
SETUP
PDU1
PDU1
PDU2
PDU2
inf
inf
USB
USB
USB
USB
USB
USB
USB
USB
VGA
VGA
COM
COM
IP
IP
AMD/Pensando DSC2-100
AMD/Pensando DSC2-100
Nvidia BlueField2
Nvidia BlueField2
24
24
23
23
22
22
21
21
20
20
19
19
18
18
17
17
16
16
15
15
14
14
13
13
12
12
11
11
10
10
9
9
8
8
7
7
6
6
5
5
4
4
3
3
2
2
1
1
.
.
172.22.0.20
172.22.0.20
Vertiv Geist GU2 rack PDU VP7N3001
Vertiv Geist GU2 rack PDU VP7N3001
172.22.0.10
172.22.0.10
172.22.1.1
172.22.1.1
172.22.1.2
172.22.1.2
172.22.1.3
172.22.1.3
172.22.3.1
172.22.3.1
172.22.3.2
172.22.3.2
iDRAC
iDRAC
iLO
iLO
iLO
iLO
dh1
dh1
dh2
dh2
dh3
dh3
18
18
COM
COM
IP
IP
13
13
15
15
17
17
19
19
21
21
23
23
14
14
16
16
20
20
22
22
24
24
1
1
3
3
5
5
7
7
2
2
4
4
6
6
8
8
9
9
11
11
10
10
12
12
old ToR unconnected
old ToR...
49
49
50
50
51
51
52
52
53
53
54
54
42
42
37
37
39
39
41
41
43
43
45
45
47
47
38
38
40
40
44
44
46
46
48
48
25
25
27
27
29
29
31
31
26
26
28
28
30
30
32
32
33
33
35
35
34
34
36
36
CON
CON
FAIL
FAIL
IP
IP
IP
IP
MGMT
MGMT
USB
USB
IP
IP
IP
IP
IP
IP
IP
IP
IP
IP
IP
IP
IP
IP
IP
IP
IP
IP
IP
IP
CON
CON
FAIL
FAIL
IP
IP
IP
IP
MGMT
MGMT
USB
USB
IP
IP
IP
IP
IP
IP
IP
IP
IP
IP
IP
IP
IP
IP
IP
IP
IP
IP
IP
IP
F5A
F5A
F5B
F5B
.
.
.
.
.
.
F5 BIGI-IP i4000
F5 BIGI-IP i4000
F5 BIGI-IP i4000
F5 BIGI-IP i4000
DCS-7280TR-48C6-R
DCS-7280TR-48C6-R
172.22.0.5
172.22.0.5
P1
P1
DPU
DPU
IP
IP
Marvell CN106
Marvell CN106
USB
USB
USB
USB
USB
USB
172.22.3.3
172.22.3.3
internet
internet
IP
IP
VGA
VGA
USB
USB
USB
USB
SERVER DPU HOST 4
SERVER DPU HOST 4
Dell R760
Dell R760
172.22.1.4
172.22.1.4
iDRAC
iDRAC
dh4
dh4
P1
P1
DPU
DPU
IP
IP
Intel DYP
Intel DYP
USB
USB
172.22.3.4
172.22.3.4
P2
P2
172.22.2.2
172.22.2.2
172.22.2.1
172.22.2.1
Dell PowerEdge R650
Dell PowerEdge R650
HPE DL360 Gen10+
HPE DL360 Gen10+
172.22.2.3
172.22.2.3
172.22.2.4
172.22.2.4
HP RL300 Gen11
HP RL300 Gen11
IP
IP
VGA
VGA
USB
USB
USB
USB
SERVER DPU HOST 9
SERVER DPU HOST 9
ASUS ESC8000A-E12P
ASUS ESC8000A-E12P
172.22.1.9
172.22.1.9
BMC
BMC
dh9
dh9
172.22.2.9
172.22.2.9
IP
IP
VGA
VGA
USB
USB
USB
USB
SERVER DPU HOST ?
SERVER DPU HOST ?
Dell R760xa
Dell R760xa
172.22.1.4
172.22.1.4
iDRAC
iDRAC
dh5
dh5
P1
P1
DPU
DPU
IP
IP
Nvidia BlueField3
Nvidia BlueField3
USB
USB
172.22.3.5
172.22.3.5
P2
P2
172.22.2.5
172.22.2.5
P1
P1
DPU
DPU
IP
IP
P2
P2
EMPTY
EMPTY
EMPTY
EMPTY
EMPTY
EMPTY
EMPTY
EMPTY
EMPTY
EMPTY
EMPTY
EMPTY
EMPTY
EMPTY \ No newline at end of file