Bruce MacDonald fe6f3b48f7

do not reload the running llm when runtime params change (#840) ...

- only reload the running llm if the model has changed, or the options for loading the running model have changed
- rename loaded llm to runner to differentiate from loaded model image
- remove logic which keeps the first system prompt in the generation context

2023-10-19 10:39:58 -04:00

..

client.go

fix memory check

2023-10-13 14:47:29 -07:00

client.py

DRAFT: add a simple python client to access ollama (#522)

2023-09-14 16:37:38 -07:00

types.go

do not reload the running llm when runtime params change (#840)

2023-10-19 10:39:58 -04:00