Images in chat messages
v1.3.0 lets a chat message carry images. Requests that only send text behave as they did in v1.2.2.
Sending an image
A message's content can be a string, as before, or an array of content parts. A text part holds text and an image_url part holds an image, either as a base64 data: URL or as an https URL. Send base64 when you can: some of the providers behind onde-kkk do not fetch remote URLs, and a request that reaches one of them with an https image fails.
Which tiers read images
onde-large, onde-balanced, onde-fast, onde-pro, onde-air, onde-mini, onde-kkk, onde-flare, onde-aura, onde-zenith and onde-prism read images. onde-apex, onde-flux, onde-nova and onde-orbit are text-only, because the models behind them are.
Each model in /v1/models now has a vision field that says which kind it is, so a client can check before it offers an attachment.
What a text-only tier does with an image
It answers 400 with the code invalid_request and a message naming the model. Nothing is sent to a provider and the image is never dropped silently. Take the image out or pick a tier whose vision is true.
Failover with an image
Image support is decided per provider, not per tier, and a request that carries an image is only offered to providers that can read one. Today every provider behind an image tier can, so an image request fails over through the same providers as a text request on that tier.
Larger requests
/v1/chat/completions accepts a body of up to 32 MB, up from 2 MB, to leave room for base64 images.