jahanson/theshire
1
0
Fork 0
Code Issues 1 Pull requests 10 Projects Releases Packages Wiki Activity Actions

Lets keep those models loaded for a bit longer.

Browse source
This commit is contained in:
Joseph Hanson 2024-07-17 14:10:25 -05:00
parent ba9afaad72
commit 09642a8de9
Signed by: jahanson
SSH key fingerprint: SHA256:vy6dKBECV522aPAwklFM3ReKAVB086rT3oWwiuiFG7o
1 changed files with 2 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
kubernetes/apps/ai/ollama/app/helmrelease.yaml
View file

@ -43,6 +43,8 @@ spec:
value: "*" value: "*"
- name: OLLAMA_MODELS - name: OLLAMA_MODELS
value: &modelPath "/models" value: &modelPath "/models"
- name: OLLAMA_KEEP_ALIVE
value: "24h"
resources: resources:
requests: requests:
nvidia.com/gpu: 1 # requesting 1 GPU nvidia.com/gpu: 1 # requesting 1 GPU