ollama

norohind/ollama

Fork 0

forked from third-party-mirrors/ollama

Commit Graph

Author	SHA1	Message	Date
Daniel Hiltgen	354ad9254e	Wait for GPU free memory reporting to converge The GPU drivers take a while to update their free memory reporting, so we need to wait until the values converge with what we're expecting before proceeding to start another runner in order to get an accurate picture.	2024-05-09 14:56:01 -07:00
Daniel Hiltgen	fedd705aea	Mechanical switch from log to slog A few obvious levels were adjusted, but generally everything mapped to "info" level.	2024-01-18 14:12:57 -08:00
Daniel Hiltgen	39928a42e8	Always dynamically load the llm server library This switches darwin to dynamic loading, and refactors the code now that no static linking of the library is used on any platform	2024-01-11 08:42:47 -08:00

Author

SHA1

Message

Date

Daniel Hiltgen

354ad9254e

Wait for GPU free memory reporting to converge

The GPU drivers take a while to update their free memory reporting, so we need
to wait until the values converge with what we're expecting before proceeding
to start another runner in order to get an accurate picture.

2024-05-09 14:56:01 -07:00

Daniel Hiltgen

fedd705aea

Mechanical switch from log to slog

A few obvious levels were adjusted, but generally everything mapped to "info" level.

2024-01-18 14:12:57 -08:00

Daniel Hiltgen

39928a42e8

Always dynamically load the llm server library

This switches darwin to dynamic loading, and refactors the code now that no
static linking of the library is used on any platform

2024-01-11 08:42:47 -08:00

3 Commits