2024-02-17 16:07:43 +08:00
|
|
|
### Installing Both Ollama and Open WebUI Using Kustomize
|
2024-01-01 07:10:33 +08:00
|
|
|
|
|
|
|
For cpu-only pod
|
|
|
|
|
|
|
|
```bash
|
|
|
|
kubectl apply -f ./kubernetes/manifest/base
|
|
|
|
```
|
|
|
|
|
|
|
|
For gpu-enabled pod
|
|
|
|
|
|
|
|
```bash
|
|
|
|
kubectl apply -k ./kubernetes/manifest
|
|
|
|
```
|
|
|
|
|
2024-02-17 16:07:43 +08:00
|
|
|
### Installing Both Ollama and Open WebUI Using Helm
|
2024-01-01 07:10:33 +08:00
|
|
|
|
|
|
|
Package Helm file first
|
|
|
|
|
|
|
|
```bash
|
|
|
|
helm package ./kubernetes/helm/
|
|
|
|
```
|
|
|
|
|
|
|
|
For cpu-only pod
|
|
|
|
|
|
|
|
```bash
|
|
|
|
helm install ollama-webui ./ollama-webui-*.tgz
|
|
|
|
```
|
|
|
|
|
|
|
|
For gpu-enabled pod
|
|
|
|
|
|
|
|
```bash
|
|
|
|
helm install ollama-webui ./ollama-webui-*.tgz --set ollama.resources.limits.nvidia.com/gpu="1"
|
|
|
|
```
|
|
|
|
|
|
|
|
Check the `kubernetes/helm/values.yaml` file to know which parameters are available for customization
|