Jeffrey Morgan 53da2c6965

llm: remove ambiguous comment when putting upper limit on predictions to avoid infinite generation (#5535)

2024-07-07 14:32:05 -04:00

..

ext_server

llm: allow gemma 2 to context shift (#5534)

2024-07-07 13:41:51 -04:00

generate

llm: add -DBUILD_SHARED_LIBS=off to common cpu cmake flags (#5520)

2024-07-06 18:58:16 -04:00

llama.cpp @ a8db2a9ce6

Update llama.cpp submodule to a8db2a9c (#5530)

2024-07-07 13:03:09 -04:00

patches

Update llama.cpp submodule to a8db2a9c (#5530)

2024-07-07 13:03:09 -04:00

filetype.go

…

ggla.go

llm: speed up gguf decoding by a lot (#5246)

2024-06-24 21:47:52 -07:00

ggml_test.go

llm: speed up gguf decoding by a lot (#5246)

2024-06-24 21:47:52 -07:00

ggml.go

gemma2 graph

2024-06-27 13:34:52 -07:00

gguf.go

llm: speed up gguf decoding by a lot (#5246)

2024-06-24 21:47:52 -07:00

llm_darwin_amd64.go

…

llm_darwin_arm64.go

…

llm_linux.go

…

llm_windows.go

…

llm.go

release: remove unwanted mingw dll.a files

2024-07-06 15:21:15 -04:00

memory_test.go

llm: speed up gguf decoding by a lot (#5246)

2024-06-24 21:47:52 -07:00

memory.go

handle asymmetric embedding KVs

2024-06-20 09:57:27 -07:00

payload.go

Fix corner cases on tmp cleaner on mac

2024-07-03 13:10:14 -07:00

server.go

llm: remove ambiguous comment when putting upper limit on predictions to avoid infinite generation (#5535)

2024-07-07 14:32:05 -04:00

status.go

fix error detection by limiting model loading error parsing (#5472)

2024-07-03 20:04:30 -04:00