cuda on windows not working

[alosslessdev]

I downloaded the latest prebuilt cuda version from the releases page, and when i try to run it on windows, it doesn't seem to recognize the gpu even though i have the nvidia driver installed. I even tried downloading the latest cuda toolkit but nothing. How can i make cuda work with llama.cpp? I don't mind using the linux version...

[alosslessdev]

solved by using the winget version but it uses vulkan

[CISC]

Did you also download cudart-llama-bin-win-cuda-12.4-x64.zip to get the required DLLs?

[DocShotgun]

@alosslessdev What GPU are you using? If you're on a Blackwell GPU, the prebuilt Windows releases won't work because they are built against CUDA 12.4, while 12.8+ is required for Blackwell.

[CISC]

Would a CUDA 13 release help? #17839