nics on rack of MOC-R4PAC08 are not getting saturated

[mosayyebzadeh]

I have been running some experiments on the rack of MOC-R4PAC08U29-S1 server. I am trying to read some data from this server by four other servers I have on that rack, including MOC-R4PAC08U37-S1C. Last month, I was able to saturate the network between them, but the last few days, I have noticed I cannot get a traffic higher than 2 Gbps out of MOC-R4PAC08U29-S1, regardless of the server. I checked the speed and NIC setup on all 5 servers, and they seem fine. I am wondering if anything has changed on the ESI side, such as a switch, network configuration, ...?

I tested the rack of MOC-R4PAC10U29-S1 node, and I can confirm that the second rack is fine and can saturate the NIC with 10 Gbps. So there is something wrong with the rack of node MOC-R4PAC08U29-S1. I also tried iperf and same results.

@hakasapl do you have any idea?

[mosayyebzadeh]

All the nodes I have,
192.168.52.98 MOC-R4PAC08U37-S1C
192.168.52.50 MOC-R4PAC08U37-S3A
192.168.52.106 MOC-R4PAC08U37-S3B
192.168.52.32 MOC-R4PAC08U37-S3C
are not able to pass the 2 Gbps network bandwidth usage, neither between them and MOC-R4PAC08U29-S1, nor between themselves.

[hakasapl]

Catching up slack:

Hakan Saplakoglu
Hmm all in a same chassis, could be a bad switch on that chassis

Amin
they were fine before maintenance shut down last week.

Hakan Saplakoglu
Yeah things break on these nodes if you sneeze in their general direction so it wouldn't surprise me 😞
Are there any available offers for nodes in other U's in that rack? I would be interested in seeing a test on nodes not in that chassis too which would confirm things

[mosayyebzadeh]

I tested with MOC-R4PAC08U31-S3C and MOC-R4PAC08U31-S3D. It seems network can get upto 10 Gbps.

[hakasapl]

@mosayyebzadeh I can try swapping the chassis switch tomorrow

[mosayyebzadeh]

@hakasapl Thank you!

[hakasapl]

@mosayyebzadeh there is another project using a node in this chassis, I am just confirming we can temporarily down their node before we try the part swap

[hakasapl]

For techsquare:

On the chassis R4PCC08-U37, please replace the chassis switch that is on board in the back (use the spare parts rack).

If this does not work I will also ask you to swap cables for this node.

[Jperez3313]

Hi Hakan,
This was swapped. Nodes should be powering back up now.
Cheers,
Jackson

[hakasapl]

@mosayyebzadeh please give your tests a try again

[mosayyebzadeh]

@hakasapl I ran the test again between all nodes. I still get at most 2.5 Gbps.

[hakasapl]

@mosayyebzadeh are you all set for now? I think some new nodes were assigned?