Merge 84da3a39169e4ad00f5a3b4e00b1831b29f9a99e into d7eb05b9361febead29a74e71ddffc2ebeff5302
This commit is contained in:
commit
38c7775663
28
examples/kubernetes-operator/README.md
Normal file
28
examples/kubernetes-operator/README.md
Normal file
@ -0,0 +1,28 @@
|
||||
# Deploy Ollama to Kubernetes Operator
|
||||
|
||||
|
||||
### Prerequisites
|
||||
|
||||
- Install [Ollama-operator](https://github.com/nekomeowww/ollama-operator)
|
||||
|
||||
### Steps
|
||||
|
||||
1. create a `Model` CR, serving model `phi` as an example:
|
||||
|
||||
```
|
||||
kubectl apply -f - << EOF
|
||||
apiVersion: ollama.ayaka.io/v1
|
||||
kind: Model
|
||||
metadata:
|
||||
name: phi
|
||||
spec:
|
||||
image: phi
|
||||
EOF
|
||||
```
|
||||
|
||||
2. forward the ports to access the model outside cluster:
|
||||
```
|
||||
kubectl port-forward svc/ollama-model-phi ollama
|
||||
```
|
||||
|
||||
3. Install [ollama cli](https://github.com/ollama/ollama) and interact with the model with either API or ollama CLI( e.g. `ollama run phi` ).
|
Loading…
x
Reference in New Issue
Block a user