4 Commits

Author SHA1 Message Date
Daniel Hiltgen
aa10cae558 Adapted rocm support to cgo based llama.cpp 2023-12-12 17:26:43 -08:00
Daniel Hiltgen
051a3d271c Add cgo implementation for llama.cpp
Run the server.cpp directly inside the Go runtime via cgo
while retaining the LLM Go abstractions.
2023-12-12 17:26:43 -08:00
Michael Yang
92d454ec5f update build_darwin.sh 2023-09-29 11:29:23 -07:00
Jeffrey Morgan
f997e29e45
Add Dockerfile.build for building linux binaries (#558)
Add `Dockerfile.build` for building linux binaries

---------

Co-authored-by: Michael Yang <mxyng@pm.me>
2023-09-22 15:20:12 -04:00