Daniel Hiltgen d74ce6bd4f Detect very old CUDA GPUs and fall back to CPU ...

If we try to load the CUDA library on an old GPU, it panics and crashes
the server.  This checks the compute capability before we load the
library so we can gracefully fall back to CPU mode.

2024-01-06 21:40:29 -08:00

..

gpu_darwin.go

set num_gpu to 1 only by default on darwin arm64 (#1771)

2024-01-03 14:10:29 -05:00

gpu_info_cpu.c

Fix windows system memory lookup

2024-01-03 08:50:01 -08:00

gpu_info_cuda.c

Detect very old CUDA GPUs and fall back to CPU

2024-01-06 21:40:29 -08:00

gpu_info_cuda.h

Detect very old CUDA GPUs and fall back to CPU

2024-01-06 21:40:29 -08:00

gpu_info_rocm.c

Fix windows system memory lookup

2024-01-03 08:50:01 -08:00

gpu_info_rocm.h

Adapted rocm support to cgo based llama.cpp

2023-12-19 09:05:46 -08:00

gpu_info.h

Fix windows system memory lookup

2024-01-03 08:50:01 -08:00

gpu_test.go

Fix windows system memory lookup

2024-01-03 08:50:01 -08:00

gpu.go

Detect very old CUDA GPUs and fall back to CPU

2024-01-06 21:40:29 -08:00

types.go

Fix windows system memory lookup

2024-01-03 08:50:01 -08:00