Models
Currently supported providers: OpenAI, Google, Anthropic, Meta, and Mistral AI. See the Model Inclusion Policy for details on selection criteria.
| Model | Provider | Type | Input Modality | Output Modality | Context (tokens) | Deployment Option | Status | Release Date |
|---|---|---|---|---|---|---|---|---|
| GPT-4o Realtime | OpenAI | Multimodal | Text, Audio | Text, Audio | 32k | Hosted API only | Active | 2024-10-01 |
| omni-moderation | OpenAI | Moderation | Text, Image | Text | — | Hosted API only | Active | 2024-09-26 |
| Llama 3.2 11B Vision Instruct | Meta | Multimodal | Text, Image | Text | 128k | Self-hosted only | Active | 2024-09-25 |
| Llama 3.2 90B Vision Instruct | Meta | LLM | Text, Image | Text | 128k | Self-hosted only | Active | 2024-09-25 |
| Llama 3.2 3B Instruct | Meta | LLM | Text | Text | 128k | Self-hosted only | Active | 2024-09-25 |
| o1-mini | OpenAI | LLM | Text | Text | 128k | Hosted API only | Deprecated | 2024-09-12 |
| Gemma 2 (2B) | LLM | Text | Text | 8k | Self-hosted only | Active | 2024-07-31 | |
| Llama 3.1 405B Instruct | Meta | LLM | Text | Text | 128k | Self-hosted only | Active | 2024-07-23 |
| Llama 3.1 70B Instruct | Meta | LLM | Text | Text | 128k | Self-hosted only | Active | 2024-07-23 |
| Mistral Nemo 12B | Mistral AI | Multimodal | Text, Image | Text | 128k | Self-hosted + Hosted API | Active | 2024-07-18 |