by keithsheppard | Mar 27, 2020 | Lab Blog
We all know it’s important to use GPU resources efficiently, especially during inference. One easy and highly effective way to achieve this is to reorder some of your inference logic to exploit PyTorch’s asynchronous GPU operations. This becomes especially...
