Add Container

​

Prerequisites

• A container image hosted on Docker Hub, Depot, Nvidia NGC, or Quay.
• For private images: credentials configured in Shakti Studio (see Setting Up Registry Credentials).

​

Setting Up Registry Credentials

​

Adding Your Image

1

Open My Models

Go to My Models and click Bring Your Own Container.

2

Configure the model

Fill in the fields for your registry. Model Name and GPU Per Container apply to all registry types.

• Docker Hub
• Depot
• Nvidia NGC
• Quay

• Model Name: A descriptive name for your application.
• Platform Type: Select DockerHub from the dropdown.
• Registry Path: Your Docker Hub registry path (e.g. myorg/myimage).
• Container Image Tag: The image version or tag (e.g. latest).
• GPU Per Container: Number of GPUs per container. Default is 1; maximum is 8.
• Registry Credentials: Select the Docker Hub secret you created. Leave blank for public images.

First, locate your registry path in Depot:

1. Go to your Depot dashboard and navigate to Registry.
2. Find your image in the Image Reference column. It will look like:

registry.depot.dev/YOUR-ORG-ID:CONTAINER-IMAGE-TAG

Split the reference into two parts:

• Registry Path: everything before the : (e.g. registry.depot.dev/YOUR-ORG-ID)
• Container Image Tag: everything after the : (e.g. CONTAINER-IMAGE-TAG)

Then fill in the model fields:

• Model Name: A descriptive name for your application.
• Platform Type: Select Depot from the dropdown.
• Registry Path: The path copied from Depot.
• Container Image Tag: The tag copied from Depot.
• GPU Per Container: Number of GPUs per container. Default is 1; maximum is 8.
• Registry Credentials: Select the Depot secret you created.

• Model Name: A descriptive name for your application.
• Platform Type: Select NGC from the dropdown.
• Registry Path: The NGC image path (e.g. nvcr.io/nvidia/nim/meta/llama-3.1-8b-instruct).
• Container Image Tag: The image tag (e.g. latest).
• GPU Per Container: Number of GPUs per container. Default is 1; maximum is 8.
• Registry Credentials: Select the Nvidia NGC secret you created.

• Model Name: A descriptive name for your application.
• Platform Type: Select Quay from the dropdown.
• Registry Path: The Quay image path (e.g. quay.io/myorg/myimage).
• Container Image Tag: The image tag (e.g. latest).
• GPU Per Container: Number of GPUs per container. Default is 1; maximum is 8.
• Registry Credentials: Leave blank — only public Quay images are supported.

3

Configure the container

Expand Container Configuration to define how the platform interacts with your container. These settings carry over to the deployment step and can be overridden there.Click Add HTTP, Add gRPC, or Add Monitoring to enable the respective services.

• HTTP Service (Required): The port your server listens on (e.g. 8000).
  • Public Access: Enable to make the endpoint reachable externally. When disabled, the service is accessible only within the cluster.
• gRPC Service: Enable if your application uses gRPC. Must use a different port than HTTP.
• Monitoring Service: Enable for enhanced monitoring and observability.
• Health Check Configuration: If any field is filled, all fields are required.
  • Health Check Path: e.g. /health
  • Port: Must match your HTTP service port.
  • Initial Delay: Time in seconds before the first health check.
  • Period: Interval in seconds between checks.
  • Timeout: Maximum seconds to wait for a response.
• Environment Variables: Runtime key-value pairs injected into your container.
• Command Override: (Optional) Custom command to replace the container’s default startup command.
• Model Endpoint: (Optional) Inference path used for observability (e.g. /v1/chat/completions).

4

Add the model

Click Add Model. For Docker Hub, the image path is verified immediately. For other registries, the image is confirmed when the deployment starts.