Qwen3-Omni Captioner is a state-of-the-art, natively end-to-end multilingual omni-modal foundation model developed by Alibaba Cloud’s Qwen team. It supports diverse input modalities including text, images, audio, and video, and delivers real-time streaming responses in both natural text and speech. Qwen3-Omni maintains high performance across modalities without any degradation, making it a leading multimodal AI solution.
Qwen3-Omni achieves state-of-the-art results on 22 out of 36 audio and audio-visual benchmarks, outperforming strong closed-source models including Gemini 2.5 Pro and GPT-4o-Transcribe.
vs Gemini 2.5 Pro: Qwen3-Omni matches or exceeds Gemini’s performance on audio-video benchmarks and offers better open-source accessibility. Comparable ASR performance with lower latency in streaming speech generation.
vs Seed-ASR: Qwen3-Omni achieves superior or comparable word error rates while providing broader multimodal capabilities beyond audio.
vs GPT-4o: Qwen3-Omni excels in multimodal audio and video tasks while maintaining strong text tasks proficiency. Lower latency streaming audio output with native multi-codebook speech codec.
Accessible via AI/ML API. Documentation: available here.
import requests r = requests.post( "https://api.aimlapi.com/v1/chat/completions", headers={"Authorization": "Bearer " + AIMLAPI_KEY}, json={ "model": "alibaba/qwen3-omni-30b-a3b-captioner", "messages": [ { "role": "user", "content": "Hello!" } ] }, ) print(r.json())
const r = await fetch("https://api.aimlapi.com/v1/chat/completions", { method: "POST", headers: { Authorization: `Bearer ${process.env.AIMLAPI_KEY}`, "Content-Type": "application/json", }, body: JSON.stringify({ "model": "alibaba/qwen3-omni-30b-a3b-captioner", "messages": [ { "role": "user", "content": "Hello!" } ] }), }); console.log(await r.json());
curl -X POST https://api.aimlapi.com/v1/chat/completions \ -H "Authorization: Bearer $AIMLAPI_KEY" \ -H "Content-Type: application/json" \ -d '{"model":"alibaba/qwen3-omni-30b-a3b-captioner","messages":[{"role":"user","content":"Hello!"}]}'
OpenAI-compatible — swap the base URL and it works with your existing SDK.
| Type | Price |
|---|---|
| Input | |
| Output | |
| Model | Input | Output | Context | Best for |
|---|---|---|---|---|
Qwen3-Omni Captioner This page | Chat + assistants | |||
| Reasoning + agents | ||||
| Balanced coding + agents | ||||
| Long-context, multimodal & agentic workflows | ||||
| Reasoning + agents |
Qwen3-Omni Captioner has a 65,536 tokens context window and can return up to 32,768 tokens.
Qwen3-Omni Captioner takes audio as input and returns text.
Use alibaba/qwen3-omni-30b-a3b-captioner as the model id. Requests go to https://api.aimlapi.com/v1/chat/completions.
Qwen3-Omni Captioner became available on November 14, 2025.
Qwen3-Omni Captioner is priced at input $4.953 / 1M tokens, output $3.978 / 1M tokens.
Yes, Qwen3-Omni Captioner can stream responses as they are generated.
Qwen3-Omni Captioner was built by Alibaba Cloud.
It generates descriptive captions for audio content—covering speech, ambient sounds, music, and emotions—rather than producing a word-for-word transcription.
It supports audio input up to 40 minutes long.
Audio is converted at a rate of 1 second of audio equaling 25 tokens.
