ONNX(Open Neural Network Exchange) 神經網络推理型模,支持『Python』同『C++』. 分『CPU』同『GPU』版.
裝ONNX Runtime-CPU版
| pip install onnxruntime |
裝ONNX Runtime-GPU版,適用cuda 11.x
| pip install onnxruntime-gpu |
裝ONNX Runtime-GPU版,適用cuda 12.x
| pip install onnxruntime-gpu –extra-index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/onnxruntime-cuda-12/pypi/simple/ |