Daniel Hiltgen ec3764538d Probe GPUs before backend init ...

Detect potential error scenarios so we can fallback to CPU mode without
hitting asserts.

2024-01-21 15:59:38 -08:00

..

ext_server

Probe GPUs before backend init

2024-01-21 15:59:38 -08:00

generate

sign dylibs on macOS (#2101)

2024-01-19 19:24:11 -05:00

llama.cpp @ 584d674be6

Bump llama.cpp to b1842 and add new cuda lib dep

2024-01-16 12:53:52 -08:00

dyn_ext_server.c

Switch to local dlopen symbols

2024-01-19 11:37:02 -08:00

dyn_ext_server.go

Unlock mutex when failing to load model (#2117)

2024-01-20 20:54:46 -05:00

dyn_ext_server.h

Always dynamically load the llm server library

2024-01-11 08:42:47 -08:00

ggml.go

add max context length check

2024-01-12 14:54:07 -08:00

gguf.go

add max context length check

2024-01-12 14:54:07 -08:00

llama.go

remove unused fields and functions

2024-01-09 09:37:40 -08:00

llm.go

Mechanical switch from log to slog

2024-01-18 14:12:57 -08:00

payload_common.go

use gzip for runner embedding (#2067)

2024-01-19 13:23:03 -05:00

payload_darwin_amd64.go

Add multiple CPU variants for Intel Mac

2024-01-17 15:08:54 -08:00

payload_darwin_arm64.go

Add multiple CPU variants for Intel Mac

2024-01-17 15:08:54 -08:00

payload_linux.go

Add multiple CPU variants for Intel Mac

2024-01-17 15:08:54 -08:00

payload_test.go

Fix up the CPU fallback selection

2024-01-11 15:27:06 -08:00

payload_windows.go

Add multiple CPU variants for Intel Mac

2024-01-17 15:08:54 -08:00

utils.go

partial decode ggml bin for more info

2023-08-10 09:23:10 -07:00