Merge 84da3a39169e4ad00f5a3b4e00b1831b29f9a99e into d7eb05b9361febead29a74e71ddffc2ebeff5302

This commit is contained in:
Peter Pan 2024-11-14 13:57:46 +08:00 committed by GitHub
commit 38c7775663
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -0,0 +1,28 @@
# Deploy Ollama to Kubernetes Operator
### Prerequisites
- Install [Ollama-operator](https://github.com/nekomeowww/ollama-operator)
### Steps
1. create a `Model` CR, serving model `phi` as an example:
```
kubectl apply -f - << EOF
apiVersion: ollama.ayaka.io/v1
kind: Model
metadata:
name: phi
spec:
image: phi
EOF
```
2. forward the ports to access the model outside cluster:
```
kubectl port-forward svc/ollama-model-phi ollama
```
3. Install [ollama cli](https://github.com/ollama/ollama) and interact with the model with either API or ollama CLI( e.g. `ollama run phi` ).