Skip to main content

GPUs & VM Types

Hardware selection answers two different questions:

  • Choose a GPU type when the accelerator model and count matter and Anycloud may choose the provider instance.
  • Choose a VM type when you need an exact instance shape, including CPU-only machines.

They are mutually exclusive for one deployment.

Choose by GPU​

anycloud submit ghcr.io/acme/train:latest \
  --gpu-type h100:8 \
  --gpus all

h100:8 means eight H100 GPUs. A value without a count selects the GPU model while the resolved VM type determines the available count.

Choose an exact VM​

anycloud submit ghcr.io/acme/app:latest \
  --credentials my-aws \
  --vm-type g6e.xlarge
from anycloud.types import CloudConfig

config = CloudConfig(credentials="my-aws", vm_type="g6e.xlarge")
job = ac.submit("ghcr.io/acme/app:latest", cloud_config=config)

Exact VM names are provider-specific. Prefer GPU selection when portability matters more than a particular SKU.

Use ordered fallbacks​

Repeat a GPU or VM option to define an ordered pool. Anycloud tries the available targets while preserving your preference order:

anycloud submit ghcr.io/acme/train:latest \
  --gpu-type h100:8 \
  --gpu-type a100:8 \
  --spot

Ordered fallback pools are currently CLI-only. Python SDK submissions accept one GPU or exact VM target per Submission. Exact accepted types and precedence are in Configuration.

Credentials and regions​

Pin --credentials when a workload must run in one account. If compute credentials are omitted, Anycloud can choose among compatible saved named credentials. An unpinned compute pool also requires an unpinned region.

Leave --region unset for normal Jobs so Anycloud can rotate across healthy regions. Pin it only for data residency, quota testing, debugging, or another explicit constraint. Pinning prevents regional failover.

When a provider returns a capacity or quota error for an unpinned region, Anycloud temporarily blocks that (cloud, VM type, region) target and tries another. A literal zero quota or unavailable region is blocked longer because it normally requires account action.

Explore the catalog​

anycloud gpus --type H100 --spot
anycloud vm-types aws us-east-1 --accelerator H100
anycloud regions aws --vm-type p5.48xlarge
anycloud pricing aws p5.48xlarge --spot

Use JSON output for scripts and agents:

anycloud gpus --type H100 --json

See Catalog and pricing for all filters and output modes.

Check and request quota​

anycloud quota status --credential my-aws
anycloud quota request p5.48xlarge --credential my-aws

Repeated requests are deduplicated when an open provider case already exists. See quota reference.

Disk capacity and performance​

Root disk capacity and performance are separate:

anycloud submit ghcr.io/acme/train:latest \
  --gpu-type h100 \
  --disk-size 400 \
  --disk-tier high

medium is the default tier. high and ultra are supported on AWS and Azure; their provider mappings and constraints are documented in Configuration.

Use Buckets for durable datasets and results. Root disks belong to the workload VM and should not be treated as durable object storage.