Failed Fake SAI test: HwTest.VlanApplyConfig, "Voq ID : 9 exceeds max supported CPU queues: 8"

[mattkim25]

Summary

I am trying to run a test in FBOSS' fake sai environment, and I am running into an error stating that I am exceeding the max supported CPU queues. I also get the same error when trying to run the test HwVlanTest.VlanApplyConfig. Are there any config files that I am missing besides agent.conf and fruid.json? In addition, I am curious if there are known bugs when running the fake sai tests that I should be aware of. Any help would be appreciated.

I'm testing on a GCP CentOS Stream 9 VM (16 vCPUs, 64 GB RAM) with an AMD Milan CPU. I have also used this VM to build the fboss_fake_agent_targets and fboss_fake_agent_test_targets. My commit hash that I am building off of is 3f8566c1b08d7317ac340dc86c9ac7c57d90339d Link.

If others have had success using a different VM setup, different commit hash, or any other changes that would be helpful to know.

Error Log

Here is the test I am running

[root@mkim-fboss fboss]# ./bin/sai_test-fake --gtest_filter=HwVlanTest.VlanApplyConfig

Log snippet with error

...

V1023 22:06:05.807665  9259 SaiRouteManager.cpp:108] set my interface ip route 2.2.2.2 class id to none
V1023 22:06:05.807687  9259 SaiRouteManager.cpp:108] set my interface ip route 2::2 class id to none
V1023 22:06:05.807717  9259 SaiRouteManager.cpp:108] set my interface ip route fe80::ff:fe00:1 class id to none
V1023 22:06:05.807874  9259 SaiHostifManager.cpp:578] set maxDynamicSharedBytes None for cpu voq \x00
V1023 22:06:05.807886  9259 SaiHostifManager.cpp:578] set maxDynamicSharedBytes None for cpu voq \x01
V1023 22:06:05.807890  9259 SaiHostifManager.cpp:578] set maxDynamicSharedBytes None for cpu voq \x02
V1023 22:06:05.807894  9259 SaiHostifManager.cpp:578] set maxDynamicSharedBytes None for cpu voq \x03
V1023 22:06:05.807897  9259 SaiHostifManager.cpp:578] set maxDynamicSharedBytes None for cpu voq \x04
V1023 22:06:05.807900  9259 SaiHostifManager.cpp:578] set maxDynamicSharedBytes None for cpu voq \x05
V1023 22:06:05.807904  9259 SaiHostifManager.cpp:578] set maxDynamicSharedBytes None for cpu voq \x06
V1023 22:06:05.807909  9259 SaiHostifManager.cpp:578] set maxDynamicSharedBytes None for cpu voq \x07
V1023 22:06:05.807919  9259 SaiHostifManager.cpp:578] set maxDynamicSharedBytes None for cpu voq \x08
unknown file: Failure
C++ exception with description "Voq ID : 9 exceeds max supported CPU queues: 8" thrown in the test body.
V1023 22:06:05.809887  9259 SaiQosMapManager.cpp:273] unable to find default QoS policy
V1023 22:06:05.809900  9259 SaiPortManager.cpp:2453] clear QoS policy null for port 112
V1023 22:06:05.809904  9259 SaiPortManager.cpp:2453] clear QoS policy null for port 105
V1023 22:06:05.809906  9259 SaiPortManager.cpp:2453] clear QoS policy null for port 84
V1023 22:06:05.809908  9259 SaiPortManager.cpp:2453] clear QoS policy null for port 77
V1023 22:06:05.809911  9259 SaiPortManager.cpp:2453] clear QoS policy null for port 56
V1023 22:06:05.809913  9259 SaiPortManager.cpp:2453] clear QoS policy null for port 33
V1023 22:06:05.809915  9259 SaiPortManager.cpp:2453] clear QoS policy null for port 28
V1023 22:06:05.809918  9259 SaiPortManager.cpp:2453] clear QoS policy null for port 5
V1023 22:06:05.809920  9259 SaiPortManager.cpp:2453] clear QoS policy null for port 102

...

V1023 22:06:05.811057  9259 SaiPortManager.cpp:2453] clear QoS policy null for port 38
V1023 22:06:05.811062  9259 SaiPortManager.cpp:2453] clear QoS policy null for port 19
V1023 22:06:05.811069  9259 SaiPortManager.cpp:2453] clear QoS policy null for port 2
V1023 22:06:05.811074  9259 SaiPortManager.cpp:2453] clear QoS policy null for port 0
V1023 22:06:05.813517  9259 HwTest.cpp:143]  Destroy singleton instances
V1023 22:06:05.813992  9259 HwTest.cpp:145]  Done destroying singleton instances
[  FAILED  ] HwVlanTest.VlanApplyConfig (60 ms)
[----------] 1 test from HwVlanTest (60 ms total)

[----------] Global test environment tear-down
[==========] 1 test from 1 test suite ran. (60 ms total)
[  PASSED  ] 0 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] HwVlanTest.VlanApplyConfig

 1 FAILED TEST

Setup Information

Commands I am running to build the fboss agent with fake sai (these are run within the FBOSS_DOCKER_CONTAINER)

time BUILD_SAI_FAKE=1 ./build/fbcode_builder/getdeps.py build \
  --allow-system-packages \
  --extra-cmake-defines='{"CMAKE_BUILD_TYPE": "MinSizeRel", "CMAKE_CXX_STANDARD": "20", "BUILD_SAI_FAKE": "ON"}' \
  --scratch-path /var/FBOSS/tmp_bld_dir \
  --num-jobs 8 \
  --cmake-target fboss_fake_agent_targets fboss


time BUILD_SAI_FAKE=1 ./build/fbcode_builder/getdeps.py build \
  --allow-system-packages \
  --extra-cmake-defines='{"CMAKE_BUILD_TYPE": "MinSizeRel", "CMAKE_CXX_STANDARD": "20"}' \
  --scratch-path /var/FBOSS/tmp_bld_dir \
  --num-jobs 8 \
  --cmake-target fboss_fake_agent_test_targets fboss

agent.conf

[root@mkim-fboss mkim]# cat /etc/coop/agent.conf
{
  "sw": {
    "version": 0,
    "ports": [],
    "vlans": [],
    "vlanPorts": [],
    "defaultVlan": 1,
    "interfaces": [],
    "switchSettings": {
      "switchIdToSwitchInfo": {
        "0": {
          "switchType": 0,
          "asicType": 1,
          "switchIndex": 0,
          "portIdRange": {
            "minimum": 0,
            "maximum": 65535
          },
          "connectionHandle": ""
        }
      }
    }
  }
}

fruid.json

[root@mkim-fboss mkim]# cat /var/facebook/fboss/fruid.json
{
  "Information": {
    "Product Name": "FAKE_SAI",
    "Product Version": "1",
    "Local MAC": "42:01:0a:8a:00:02",
    "Extended MAC Base": "11:22:33:44:55:66",
    "Extended MAC Address Size": "139"
  }
}