Michael Yang 829ff87bd1

revert tokenize ffi (#4761) ...

* Revert "use `int32_t` for call to tokenize (#4738)"

This reverts commit 763bb65dbb88004cd046c8acc0c8e889816e1828.

* Revert "vocab only"

This reverts commit bf54c845e9ea63ec58762a991dcea78d2c934b47.

* Revert "use ffi for tokenizing/detokenizing"

This reverts commit 26a00a04108f6cae625802e69faa4b48480bc208.

2024-05-31 18:54:21 -07:00

..

CMakeLists.txt

Switch back to subprocessing for llama.cpp

2024-04-01 16:48:18 -07:00

httplib.h

Import server.cpp as of b2356

2024-03-12 13:58:06 -07:00

json.hpp

Import server.cpp as of b2356

2024-03-12 13:58:06 -07:00

server.cpp

revert tokenize ffi (#4761)

2024-05-31 18:54:21 -07:00

utils.hpp

log clean up

2024-05-09 14:55:36 -07:00