Does gonnx supports GPU inference?

[deependujha]

As stated in the heading, is there a way to infer model on GPUs or TPUs?

[Swopper050]

Hi @deependujha , right now it is not supported out of the box in Gonnx. However, I believe that the Tensor package we use does support GPU inference so we will look into building this in the future (or feel free to try yourself).