History

Update submodule to 6efb8eb30e7025b168f3fda3ff83b9b386428ad6 (#1885 )

* update submodule to `6efb8eb30e7025b168f3fda3ff83b9b386428ad6`
* unblock condition variable in `update_slots` when closing server

2024-01-10 16:48:38 -05:00

CMakeLists.txt

Code shuffle to clean up the llm dir

2024-01-04 12:12:05 -08:00

ext_server.cpp

Update submodule to 6efb8eb30e7025b168f3fda3ff83b9b386428ad6 (#1885 )

2024-01-10 16:48:38 -05:00

ext_server.h

Code shuffle to clean up the llm dir

2024-01-04 12:12:05 -08:00

README.md

Code shuffle to clean up the llm dir

2024-01-04 12:12:05 -08:00

README.md

Extern C Server

This directory contains a thin facade we layer on top of the Llama.cpp server to expose extern C interfaces to access the functionality through direct API calls in-process