Polygraphy: A Deep Learning Inference Prototyping and Debugging Toolkit
- generate .onnx from timm model
pip install torch
pip install onnx
pip install timm
pip install polygraphy
python onnx_export.py
// a file 'resnet18_cuda.onnx' will be generated in onnx directory.
- build tensorrt model and run
python onnx2trt.py
// a file 'resnet18_fp16.engine' will be generated in engine directory.