There have been some issues providing support for GPU compute in Cafe mainly because the CUDA packages on apt appear to be deprecated even for Ubuntu 18 LTS.
Additionally, in environments like RunPod there are additional flags and variables that get called on their other containers like Disco/Stable Diffusion which enable GPU compute for those processes but I am unsure which one of those I should add to the serverless runpod container to get the right results.
There have been some issues providing support for GPU compute in Cafe mainly because the CUDA packages on apt appear to be deprecated even for Ubuntu 18 LTS.
Additionally, in environments like RunPod there are additional flags and variables that get called on their other containers like Disco/Stable Diffusion which enable GPU compute for those processes but I am unsure which one of those I should add to the serverless runpod container to get the right results.