add ollama-operator in example

Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
This commit is contained in:
Peter Pan 2024-05-10 16:03:34 +08:00
parent 23d23409a0
commit 84da3a3916

View File

@ -0,0 +1,28 @@
# Deploy Ollama to Kubernetes Operator
### Prerequisites
- Install [Ollama-operator](https://github.com/nekomeowww/ollama-operator)
### Steps
1. create a `Model` CR, serving model `phi` as an example:
```
kubectl apply -f - << EOF
apiVersion: ollama.ayaka.io/v1
kind: Model
metadata:
name: phi
spec:
image: phi
EOF
```
2. forward the ports to access the model outside cluster:
```
kubectl port-forward svc/ollama-model-phi ollama
```
3. Install [ollama cli](https://github.com/ollama/ollama) and interact with the model with either API or ollama CLI( e.g. `ollama run phi` ).