Pod / Deployment / ReplicaSet

Appears in 1 tutorial

K8s units: the running container(s), and the controllers that keep N replicas alive (operationalizing data parallelism).

As used in LLM Infrastructure →

K8s units: the running container(s), and the controllers that keep N replicas alive (operationalizing data parallelism).