Skip to content
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions DC-AI-deployment
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,6 @@ ADOC_POST=yes
ADOC_TYPE=book
ADOC_ATTRIBUTES=" --attribute env-daps=1"
ADOC_ATTRIBUTES+=" --attribute PROF_PRODUCT=suseai"
ADOC_ATTRIBUTES+=" --attribute PROF_PRODUCT=suseai"
ADOC_ATTRIBUTES+=" --attribute PROF_DEPLOYMENT=standard"

STYLEROOT="/usr/share/xml/docbook/stylesheet/suse2022-ns"
Expand All @@ -17,4 +16,5 @@ FALLBACK_STYLEROOT="/usr/share/xml/docbook/stylesheet/suse-ns"
DOCBOOK5_RNG_URI="http://docbook.org/xml/5.2/rng/docbookxi.rng"

#XSLTPARAM+=' --param toc.section.depth=2'
#XSLTPARAM+=' --param bubbletoc.section.depth=3 --param bubbletoc.max.depth=3'
#XSLTPARAM+=' --param bubbletoc.section.depth=3 --param bubbletoc.max.depth=3'
#XSLTPARAM+=' --stringparam generate.toc="book title" '
1 change: 0 additions & 1 deletion references/ollama-helmchart.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,6 @@ global:
ingress:
enabled: false
defaultModel: "gemma:2b"
runtimeClassName: nvidia
ollama:
models:
pull:
Expand Down
1 change: 0 additions & 1 deletion references/owui-helm-overrides.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -450,7 +450,6 @@ Following is an example of the `open-webui-pipelines-values.yaml` override file.

[source,yaml]
----
runtimeClassName: nvidia
global:
imagePullSecrets:
- application-collection
Expand Down
5 changes: 0 additions & 5 deletions references/pytorch-helm-overrides.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,6 @@ include::../snippets/helm-chart-overrides-intro.adoc[]
[source,yaml]
----
# pytorch_custom_overrides.yaml
runtimeClassName: nvidia
global:
imagePullSecrets:
- application-collection <.>
Expand Down Expand Up @@ -48,7 +47,6 @@ To create a ConfigMap, run the following command:
[source,yaml]
----
# pytorch_custom_overrides.yaml
runtimeClassName: nvidia
global:
imagePullSecrets:
- application-collection
Expand Down Expand Up @@ -82,7 +80,6 @@ Move the `entrypoint.sh` file plus any helper files under the `scripts/` directo
[source,yaml]
----
# pytorch_custom_overrides.yaml
runtimeClassName: nvidia
global:
imagePullSecrets:
- application-collection <.>
Expand Down Expand Up @@ -117,7 +114,6 @@ For production use, we recommend using a storage solution suitable for persisten
[source,yaml]
----
# pytorch_custom_overrides.yaml
runtimeClassName: nvidia
global:
imagePullSecrets:
- application-collection <.>
Expand Down Expand Up @@ -153,7 +149,6 @@ For production use, we recommend using a storage solution suitable for persisten
[source,yaml]
----
# pytorch_custom_overrides.yaml
runtimeClassName: nvidia
global:
imagePullSecrets:
- application-collection <.>
Expand Down
12 changes: 4 additions & 8 deletions references/vllm-helm-overrides.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -121,8 +121,7 @@ global:
imagePullSecrets:
- application-collection
servingEngineSpec:
runtimeClassName: "nvidia"
modelSpec:
modelSpec:
Comment thread
tbazant marked this conversation as resolved.
Outdated
- name: "llama3" <.>
registry: "dp.apps.rancher.io" <.>
repository: "containers/vllm-openai" <.>
Expand Down Expand Up @@ -263,8 +262,7 @@ global:
imagePullSecrets:
- application-collection
servingEngineSpec:
runtimeClassName: "nvidia"
modelSpec:
modelSpec:
Comment thread
tbazant marked this conversation as resolved.
Outdated
- name: "llama3"
registry: "dp.apps.rancher.io"
repository: "containers/vllm-openai"
Expand Down Expand Up @@ -383,8 +381,7 @@ global:
imagePullSecrets:
- application-collection
servingEngineSpec:
runtimeClassName: "nvidia"
modelSpec:
modelSpec:
Comment thread
tbazant marked this conversation as resolved.
Outdated
- name: "mistral"
registry: "dp.apps.rancher.io"
repository: "containers/lmcache-vllm-openai"
Expand Down Expand Up @@ -432,8 +429,7 @@ global:
imagePullSecrets:
- application-collection
servingEngineSpec:
runtimeClassName: "nvidia"
modelSpec:
modelSpec:
Comment thread
tbazant marked this conversation as resolved.
Outdated
- name: "mistral"
registry: "dp.apps.rancher.io"
repository: "containers/lmcache-vllm-openai"
Expand Down
3 changes: 1 addition & 2 deletions tasks/NVIDIA-Operator-installation.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -164,8 +164,7 @@ metadata:
namespace: default
spec:
restartPolicy: OnFailure
runtimeClassName: nvidia
containers:
containers:
Comment thread
tbazant marked this conversation as resolved.
Outdated
- name: cuda-container
image: nvcr.io/nvidia/k8s/cuda-sample:nbody
args: ["nbody", "-gpu", "-benchmark"]
Expand Down