pytest: fail CI when a configured image model id isn't in Sume's list

Add one pytest that loads every model id your config file names and asserts each appears in the id list from GET /v1/images/models. A retired id fails CI the day you add it, and a catalog change that removes one fails the nightly run. It needs only an API key and takes one request.

This is a contract test for the id, not for output quality. It does not render anything, so it costs nothing.

The test

The catalog response is {"data": [{"id": ...}]}. The test accepts canonical ids and the legacy aliases Sume documents, so an old alias fails with a clear message to normalize it.

import json, os, urllib.request

import pytest

ALIAS_OK = {"gpt-image-2.5": "openai/gpt-image-2.5"}

def listed_ids():
    req = urllib.request.Request(
        "https://api.sume.com/v1/images/models",
        headers={"Authorization": "Bearer " + os.environ["SUME_API_KEY"]})
    with urllib.request.urlopen(req, timeout=30) as r:
        return {row["id"] for row in json.load(r)["data"]}

def configured_ids():
    with open("image-models.json") as f:
        return json.load(f)["ids"]

@pytest.mark.parametrize("model_id", configured_ids())
def test_model_id_is_listed(model_id):
    ids = listed_ids()
    canonical = ALIAS_OK.get(model_id, model_id)
    assert canonical in ids, f"{model_id} is not in GET /v1/images/models"

What it catches

Run it where it counts

Run the test on every pull request and on a nightly schedule, because the catalog can change without a commit in your repo. For a request-level check of parameters on top of the id, see the preflight post. For the same idea on the Sora side, see the mocked-Sora contract test.