The problem of GPU and memory sharing #11637
Description
When the model is too large, it may require GPU and memory sharing. Which one is working between GPU and CPU during inference? Or will they all be working?
{{ message }}
When the model is too large, it may require GPU and memory sharing. Which one is working between GPU and CPU during inference? Or will they all be working?