Jing Zhang 82b9b329ff

windows CUDA support (#1262) ...

* Support cuda build in Windows
* Enable dynamic NumGPU allocation for Windows

2023-11-24 17:16:36 -05:00

..

ggml @ 9e232f0234

subprocess llama.cpp server (#401)

2023-08-30 16:35:03 -04:00

gguf @ 0b871f1a04

update llama.cpp

2023-11-21 09:50:02 -08:00

patches

update llama.cpp

2023-11-21 09:50:02 -08:00

generate_darwin_amd64.go

consistent cpu instructions on macos and linux

2023-11-22 16:26:46 -05:00

generate_darwin_arm64.go

update llama.cpp

2023-11-21 09:50:02 -08:00

generate_linux.go

Disable CUDA peer access as a workaround for multi-gpu inference bug (#1261)

2023-11-24 14:05:57 -05:00

generate_windows.go

windows CUDA support (#1262)

2023-11-24 17:16:36 -05:00