Modelplane Modelplane docs
Version
main v0.1 v0.2 Latest

ModelService Custom Resource

On this page

Expose model endpoints via a unified OpenAI-compatible URL.

Concept guide: Expose a Model →

#Metadata

API version
modelplane.ai/v1alpha1
Kind
ModelService
Scope
Namespaced
Short names
ms

#Example

Manifest
apiVersion: modelplane.ai/v1alpha1
kind: ModelService
metadata:
  name: qwen-72b
  namespace: ml-team
spec:
  endpoints:
    - selector:
        matchLabels:
          modelplane.ai/deployment: qwen-72b

#Spec

# endpoints required object[] ≥ 1 items
# selector required object
# matchLabels required map[string]string
# weight optional integer 1–1000000 default: 1

Weight determines the share of traffic sent to this entry’s endpoints, relative to the other entries. An entry with weight 2 receives twice the traffic of an entry with weight 1. The weight is spread as evenly as possible across all endpoints the entry matches.

#Status

# address optional string

Public address where this service is reachable.

# conditions optional object[]