4 Commits

Author SHA1 Message Date
Jesse Gross
e4a091bafd runner.go: Support resource usage command line options
Command line options to the runner that control resource usage
(mmap, mlock, tensor split) are used by Ollama but not currently
implemented. This implements support for these while ignoring
others that have no meaning in this context.
2024-09-03 21:15:14 -04:00
jmorganca
a4d402c403 fix example 2024-09-03 21:15:13 -04:00
jmorganca
e1dfc757b3 revert llm changes 2024-09-03 21:15:13 -04:00
jmorganca
d12db0568e better example module, add port 2024-09-03 21:15:12 -04:00