3 Commits

Author	SHA1	Message	Date
Josh Yan	a562b9069f	refactor error	2024-07-01 15:56:47 -07:00
Josh Yan	5d76e78c2f	add error message for unsupported arch	2024-07-01 15:43:03 -07:00
Daniel Hiltgen	58d95cc9bd	Switch back to subprocessing for llama.cpp ... This should resolve a number of memory leak and stability defects by allowing us to isolate llama.cpp in a separate process and shutdown when idle, and gracefully restart if it has problems. This also serves as a first step to be able to run multiple copies to support multiple models concurrently.	2024-04-01 16:48:18 -07:00