Draft PR : Multi Threading

[jhanm12]

Multi Threading

cd /ws/jhanm-sjc/yang-kit/yangkit/api_generator
source /ws/jhanm-sjc/yang-kit/yangkit/yangkit_venv/bin/activate <Yangkit Env>
./generate.py --bundle /auto/cafy/Yang/bundle.json --output-directory /auto/cafy/Yang/out -v -i

Resulting in Segmentation fault (core dumped):

Created models archive: /auto/cafy/Yang/out/cisco_ios_xr-bundle/cisco_ios_xr@24.2.1.tar.gz
Processing 1 of 1945 /auto/cafy/Yang/out/.cache/models/cisco_ios_xr@24.2.1/CISCO-ENTITY-FRU-CONTROL-MIB.yang
    Printing python module /auto/cafy/Yang/out/cisco_ios_xr-bundle/yangkit/models/cisco_ios_xr/CISCO_ENTITY_FRU_CONTROL_MIB.py
Processing 2 of 1945 /auto/cafy/Yang/out/.cache/models/cisco_ios_xr@24.2.1/Cisco-IOS-XR-8000-fib-platform-cfg.yang
Processing 3 of 1945 /auto/cafy/Yang/out/.cache/models/cisco_ios_xr@24.2.1/Cisco-IOS-XR-8000-lpts-oper.yang
    Printing python module /auto/cafy/Yang/out/cisco_ios_xr-bundle/yangkit/models/cisco_ios_xr/Cisco_IOS_XR_8000_fib_platform_cfg.py
    Printing python module /auto/cafy/Yang/out/cisco_ios_xr-bundle/yangkit/models/cisco_ios_xr/Cisco_IOS_XR_8000_lpts_oper.py
Processing 4 of 1945 /auto/cafy/Yang/out/.cache/models/cisco_ios_xr@24.2.1/Cisco-IOS-XR-8000-lpts-oper-sub1.yang
    Skipping module, because it does not contain top level containers
Processing 5 of 1945 /auto/cafy/Yang/out/.cache/models/cisco_ios_xr@24.2.1/Cisco-IOS-XR-8000-platforms-npu-evict-voq-buff-oper.yang
    Skipping module, because it does not contain top level containers
Processing 6 of 1945 /auto/cafy/Yang/out/.cache/models/cisco_ios_xr@24.2.1/Cisco-IOS-XR-8000-platforms-npu-evict-voq-buff-oper-sub1.yang
    Skipping module, because it does not contain top level containers
Processing 7 of 1945 /auto/cafy/Yang/out/.cache/models/cisco_ios_xr@24.2.1/Cisco-IOS-XR-8000-platforms-npu-memory-oper.yang
    Skipping module, because it does not contain top level containers
Processing 8 of 1945 /auto/cafy/Yang/out/.cache/models/cisco_ios_xr@24.2.1/Cisco-IOS-XR-8000-platforms-npu-memory-oper-sub1.yang
    Skipping module, because it does not contain top level containers
Processing 9 of 1945 /auto/cafy/Yang/out/.cache/models/cisco_ios_xr@24.2.1/Cisco-IOS-XR-8000-platforms-npu-resources-oper.yang
    Printing python module /auto/cafy/Yang/out/cisco_ios_xr-bundle/yangkit/models/cisco_ios_xr/Cisco_IOS_XR_8000_platforms_npu_resources_oper.py
Processing 10 of 1945 /auto/cafy/Yang/out/.cache/models/cisco_ios_xr@24.2.1/Cisco-IOS-XR-8000-platforms-npu-resources-oper-sub1.yang
    Skipping module, because it does not contain top level containers
Processing 11 of 1945 /auto/cafy/Yang/out/.cache/models/cisco_ios_xr@24.2.1/Cisco-IOS-XR-8000-qos-oper.yang
    Printing python module /auto/cafy/Yang/out/cisco_ios_xr-bundle/yangkit/models/cisco_ios_xr/Cisco_IOS_XR_8000_qos_oper.py
Processing 12 of 1945 /auto/cafy/Yang/out/.cache/models/cisco_ios_xr@24.2.1/Cisco-IOS-XR-8000-qos-oper-sub1.yang
    Skipping module, because it does not contain top level containers
Processing 13 of 1945 /auto/cafy/Yang/out/.cache/models/cisco_ios_xr@24.2.1/Cisco-IOS-XR-8000-qos-oper-sub2.yang
    Skipping module, because it does not contain top level containers
Processing 14 of 1945 /auto/cafy/Yang/out/.cache/models/cisco_ios_xr@24.2.1/Cisco-IOS-XR-Ethernet-SPAN-act.yang
Processing 15 of 1945 /auto/cafy/Yang/out/.cache/models/cisco_ios_xr@24.2.1/Cisco-IOS-XR-Ethernet-SPAN-cfg.yang
    Printing python module /auto/cafy/Yang/out/cisco_ios_xr-bundle/yangkit/models/cisco_ios_xr/Cisco_IOS_XR_Ethernet_SPAN_act.py
    Printing python module /auto/cafy/Yang/out/cisco_ios_xr-bundle/yangkit/models/cisco_ios_xr/Cisco_IOS_XR_Ethernet_SPAN_cfg.py
Processing 16 of 1945 /auto/cafy/Yang/out/.cache/models/cisco_ios_xr@24.2.1/Cisco-IOS-XR-Ethernet-SPAN-datatypes.yang
Segmentation fault (core dumped)
(yangkit_venv) [jhanm@sjc-ads-2280 api_generator]$ 

[akshansh237]

whats the use case ? does the generator take too much time?

[jhanm12]

whats the use case ? does the generator take too much time?

It usually takes around 5-8 mins. Nishant wanted it to be done within 1-2 mins using multi-threading. Not sure, why is this causing Segmentation Fault Issue. Need to debug it further.