Daniel Hiltgen de2fbdec99

Merge pull request #1819 from dhiltgen/multi_variant ...

Support multiple LLM libs; ROCm v5 and v6; Rosetta, AVX, and AVX2 compatible CPU builds

2024-01-11 14:00:48 -08:00

..

cpu_common.go

Always dynamically load the llm server library

2024-01-11 08:42:47 -08:00

gpu_darwin.go

Always dynamically load the llm server library

2024-01-11 08:42:47 -08:00

gpu_info_cpu.c

calculate overhead based number of gpu devices (#1875)

2024-01-09 15:53:33 -05:00

gpu_info_cuda.c

Harden GPU mgmt library lookup

2024-01-10 15:06:41 -08:00

gpu_info_cuda.h

Harden GPU mgmt library lookup

2024-01-10 15:06:41 -08:00

gpu_info_rocm.c

Support multiple variants for a given llm lib type

2024-01-10 17:27:51 -08:00

gpu_info_rocm.h

Support multiple variants for a given llm lib type

2024-01-10 17:27:51 -08:00

gpu_info.h

calculate overhead based number of gpu devices (#1875)

2024-01-09 15:53:33 -05:00

gpu_test.go

Merge pull request #1819 from dhiltgen/multi_variant

2024-01-11 14:00:48 -08:00

gpu.go

Build multiple CPU variants and pick the best

2024-01-11 08:42:47 -08:00

types.go

Support multiple variants for a given llm lib type

2024-01-10 17:27:51 -08:00