Michael Yang 829ff87bd1

revert tokenize ffi (#4761) ...

* Revert "use `int32_t` for call to tokenize (#4738)"

This reverts commit 763bb65dbb88004cd046c8acc0c8e889816e1828.

* Revert "vocab only"

This reverts commit bf54c845e9ea63ec58762a991dcea78d2c934b47.

* Revert "use ffi for tokenizing/detokenizing"

This reverts commit 26a00a04108f6cae625802e69faa4b48480bc208.

2024-05-31 18:54:21 -07:00

..

ext_server

revert tokenize ffi (#4761)

2024-05-31 18:54:21 -07:00

generate

speed up tests by only building static lib (#4740)

2024-05-30 21:43:15 -07:00

llama.cpp @ 5921b8f089

Update llama.cpp submodule to 5921b8f0 (#4731)

2024-05-30 16:20:22 -07:00

patches

Update llama.cpp submodule to 5921b8f0 (#4731)

2024-05-30 16:20:22 -07:00

filetype.go

Add support for IQ1_S, IQ3_S, IQ2_S, IQ4_XS. IQ4_NL (#4322)

2024-05-23 13:21:49 -07:00

ggla.go

simplify safetensors reading

2024-05-21 11:28:22 -07:00

ggml.go

Update llm/ggml.go

2024-05-24 16:10:43 -07:00

gguf.go

simplify safetensors reading

2024-05-21 11:28:22 -07:00

llm_darwin_amd64.go

Switch back to subprocessing for llama.cpp

2024-04-01 16:48:18 -07:00

llm_darwin_arm64.go

Switch back to subprocessing for llama.cpp

2024-04-01 16:48:18 -07:00

llm_linux.go

Switch back to subprocessing for llama.cpp

2024-04-01 16:48:18 -07:00

llm_windows.go

Move nested payloads to installer and zip file on windows

2024-04-23 16:14:47 -07:00

llm.go

revert tokenize ffi (#4761)

2024-05-31 18:54:21 -07:00

memory.go

Move envconfig and consolidate env vars (#4608)

2024-05-24 14:57:15 -07:00

payload.go

Move nested payloads to installer and zip file on windows

2024-04-23 16:14:47 -07:00

server.go

revert tokenize ffi (#4761)

2024-05-31 18:54:21 -07:00

status.go

Switch back to subprocessing for llama.cpp

2024-04-01 16:48:18 -07:00