Namespace Details

Namespace litellm

Workloads

Containers

Details

+$0/hour

YAML for Recommended Settings

resources:
  requests:
    cpu: 15m
    memory: 1403Mi
  limits:
    cpu: 15m
    memory: 1403Mi

+$0/hour

YAML for Recommended Settings

resources:
  requests:
    cpu: 15m
    memory: 1182Mi
  limits:
    cpu: 15m
    memory: 1564Mi

Containers

Details

+$0/hour

YAML for Recommended Settings

resources:
  requests:
    cpu: 15m
    memory: 100Mi
  limits:
    cpu: 15m
    memory: 100Mi

+$0/hour

YAML for Recommended Settings

resources:
  requests:
    cpu: 15m
    memory: 100Mi
  limits:
    cpu: 15m
    memory: 100Mi

QoS: "QoS (Quality of Service) class is a designation assigned to a pod based on its resource requests and limits. Kubernetes uses QoS classes to make decisions about scheduling and evicting Pods." Kubernetes Documentation:
Configure Quality of Service for Pods
Guaranteed QoS: "For a Pod to be given a QoS class of Guaranteed:

Every Container, including init containers, in the Pod must have a memory limit and a memory request, and they must be the same.

Every Container, including init containers, in the Pod must have a CPU limit and a CPU request, and they must be the same."

Kubernetes Documentation:
Create a Pod That Gets Assigned a QoS Class of Guaranteed
Burstable QoS: "A Pod is given a QoS class of Burstable if:

The Pod does not meet the criteria for QoS class Guaranteed.

At least one Container in the Pod has a memory or CPU request."

Kubernetes Documentation:
Create a Pod That Gets Assigned a QoS Class of Burstable