Bruce MacDonald fe6f3b48f7
do not reload the running llm when runtime params change (#840)
- only reload the running llm if the model has changed, or the options for loading the running model have changed
- rename loaded llm to runner to differentiate from loaded model image
- remove logic which keeps the first system prompt in the generation context
2023-10-19 10:39:58 -04:00
..
2023-09-19 09:41:13 -07:00
2023-10-12 12:52:43 -07:00
2023-09-28 11:07:24 -07:00
2023-10-06 12:56:43 -07:00