Pre-installation Configuration

Install Alauda AI Essentials

Install Alauda AI

Upgrade from AI 1.3

Infrastructure Management

Device Management

About Alauda Build of Hami

About Alauda Build of NVIDIA GPU Device Plugin

About Alauda Build of Kueue

Namespace Management

Create WorkspaceKind

Create Workbench

Model Deployment & Inference

Inference Service

Inference Service

Extend Inference Runtimes

Configure External Access for Inference Services

Configure Scaling for Inference Services

Configure Accurately Scheduling Inference Services based on the CUDA version

Troubleshooting

Experiencing Inference Service Timeouts with MLServer Runtime

Inference Service Fails to Enter Running State

Model Management

Model Repository

Upload Models Using Notebook

Monitoring & Ops

Features Overview

Logging & Tracing

Resource Monitoring

Resource Monitoring

Install Label Studio

Kubernetes APIs

Inference Service APIs

ClusterServingRuntime [serving.kserve.io/v1alpha1]

InferenceService [serving.kserve.io/v1beta1]

Workspace Kind [kubeflow.org/v1beta1]

Workspace [kubeflow.org/v1beta1]

AmlNamespace [manage.aml.dev/v1alpha1]

AmlCluster [amlclusters.aml.dev/v1alpha1]

Infrastructure Management

Device Management

About Alauda Build of Hami

About Alauda Build of NVIDIA GPU Device Plugin

About Alauda Build of Kueue

1. Introduction to Alauda Build of Kueue
2. Installing Alauda Build of Kueue
3. Setup RBAC
4. Configuring quotas
5. Monitoring pending workloads
6. Using cohorts
7. Configuring fair sharing
8. Gang scheduling

Multi-Tenant

Guides

Previous pageUninstall Next pageDevice Management