ollama

History

Daniel Hiltgen 667a2ba18a Detect lack of AVX and fallback to CPU mode

We build the GPU libraries with AVX enabled to ensure that if not all
layers fit on the GPU we get better performance in a mixed mode.
If the user is using a virtualization/emulation system that lacks AVX
this used to result in an illegal instruction error and crash before this
fix.  Now we will report a warning in the server log, and just use
CPU mode to ensure we don't crash.

2024-01-26 11:36:03 -08:00

cpu_common.go

Mechanical switch from log to slog

2024-01-18 14:12:57 -08:00

gpu_darwin.go

Fix up the CPU fallback selection

2024-01-11 15:27:06 -08:00

gpu_info_cpu.c

calculate overhead based number of gpu devices (#1875 )

2024-01-09 15:53:33 -05:00

gpu_info_cuda.c

Fix crash on cuda ml init failure