> ## Documentation Index > Fetch the complete documentation index at: https://oxenai-eric-fix-queue-reference-claims.mintlify.site/llms.txt > Use this file to discover all available pages before exploring further. # Gemini Omni 1.1 Flash > Omni-modal video with keyframes, edit and extend Run this model interactively, tune parameters, and compare outputs. **Model ID:** `gemini-omni-1-1-flash` Gemini Omni 1.1 Flash is Google's omni-modal video model that handles text-to-video, first/last frame keyframing, reference-guided generation from images and short video clips, and video editing and extension in a single model. Every clip ships with synchronized native audio (dialogue, sound effects, and music directed from the prompt), and camera work is described in natural language. Each generation is a 3 to 10 second clip at 24 fps in 16:9 or 9:16, rendered at 360p (a fast, low-cost draft tier), 720p (the default), or upscaled to 1080p or 4K. Pin a first frame, or a first and last frame, to control a shot's start and end; add up to 3 reference images and up to 3 reference videos of at most 3 seconds each to carry a character, object, or style into the scene (audio in reference videos is ignored). Supply a video to edit it by instruction while preserving everything the prompt does not mention, or to extend it: extensions append 3 to 10 seconds at a time, use up to 10 seconds of prior footage as context, and can stack to a cumulative 40 seconds. ## Example request Use the [Workbench](https://www.oxen.ai/ai/workbench?model=gemini-omni-1-1-flash) as a request builder: configure parameters for this model in the UI, then open the **API** tab to copy the exact cURL or Python call. This blocks until the video is ready (typically 5-15 minutes). Prefer **Async** or **Async with SSE** for anything beyond quick experimentation. See the [video generation reference](/inference-api/reference/video_generation) for more details. ```bash cURL theme={null} curl -X POST https://hub.oxen.ai/api/ai/videos/generate \ -H "Content-Type: application/json" \ -H "Authorization: Bearer $OXEN_API_KEY" \ -d '{ "model": "gemini-omni-1-1-flash", "prompt": "" }' ``` ```python Python theme={null} import os import requests response = requests.post( "https://hub.oxen.ai/api/ai/videos/generate", headers={ "Content-Type": "application/json", "Authorization": f"Bearer {os.environ['OXEN_API_KEY']}", }, json={ "model": "gemini-omni-1-1-flash", "prompt": "" }, ) response.raise_for_status() print(response.json()) ``` ```bash cURL theme={null} curl -X POST https://hub.oxen.ai/api/ai/videos/generate \ -H "Content-Type: application/json" \ -H "Authorization: Bearer $OXEN_API_KEY" \ -d '{ "model": "gemini-omni-1-1-flash", "prompt": "", "input_image": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png", "tail_image_url": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png", "input_images": [ "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png" ], "input_videos": [ "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/winter_summer_ox.mp4" ], "input_video": "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/winter_summer_ox.mp4" }' ``` ```python Python theme={null} import os import requests response = requests.post( "https://hub.oxen.ai/api/ai/videos/generate", headers={ "Content-Type": "application/json", "Authorization": f"Bearer {os.environ['OXEN_API_KEY']}", }, json={ "model": "gemini-omni-1-1-flash", "prompt": "", "input_image": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png", "tail_image_url": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png", "input_images": [ "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png" ], "input_videos": [ "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/winter_summer_ox.mp4" ], "input_video": "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/winter_summer_ox.mp4" }, ) response.raise_for_status() print(response.json()) ``` ```bash cURL theme={null} curl -X POST https://hub.oxen.ai/api/ai/videos/generate \ -H "Content-Type: application/json" \ -H "Authorization: Bearer $OXEN_API_KEY" \ -d '{ "model": "gemini-omni-1-1-flash", "prompt": "", "input_image": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png", "tail_image_url": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png", "input_images": [ "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png" ], "input_videos": [ "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/winter_summer_ox.mp4" ], "input_video": "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/winter_summer_ox.mp4", "aspect_ratio": "16:9", "resolution": "720p", "duration": 8 }' ``` ```python Python theme={null} import os import requests response = requests.post( "https://hub.oxen.ai/api/ai/videos/generate", headers={ "Content-Type": "application/json", "Authorization": f"Bearer {os.environ['OXEN_API_KEY']}", }, json={ "model": "gemini-omni-1-1-flash", "prompt": "", "input_image": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png", "tail_image_url": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png", "input_images": [ "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png" ], "input_videos": [ "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/winter_summer_ox.mp4" ], "input_video": "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/winter_summer_ox.mp4", "aspect_ratio": "16:9", "resolution": "720p", "duration": 8 }, ) response.raise_for_status() print(response.json()) ``` See the [async queue reference](/inference-api/reference/async_queue) for more details. ```bash cURL theme={null} # Enqueue, capture the generation id. GEN_ID=$(curl -s -X POST https://hub.oxen.ai/api/ai/queue \ -H "Content-Type: application/json" \ -H "Authorization: Bearer $OXEN_API_KEY" \ -d '{ "model": "gemini-omni-1-1-flash", "prompt": "" }' | jq -r '.generations[0].generation_id') # Poll until the generation reaches a terminal status. while true; do STATUS=$(curl -s -H "Authorization: Bearer $OXEN_API_KEY" \ "https://hub.oxen.ai/api/ai/queue/$GEN_ID" | jq -r '.status') echo "Status: $STATUS" case $STATUS in succeeded|failed|cancelled) break;; esac sleep 5 done # Print the result. curl -s -H "Authorization: Bearer $OXEN_API_KEY" \ "https://hub.oxen.ai/api/ai/queue/$GEN_ID" | jq . ``` ```python Python theme={null} import os import time import requests HEADERS = { "Content-Type": "application/json", "Authorization": f"Bearer {os.environ['OXEN_API_KEY']}", } enqueue = requests.post( "https://hub.oxen.ai/api/ai/queue", headers=HEADERS, json={ "model": "gemini-omni-1-1-flash", "prompt": "" }, ) enqueue.raise_for_status() generation_id = enqueue.json()["generations"][0]["generation_id"] while True: data = requests.get( f"https://hub.oxen.ai/api/ai/queue/{generation_id}", headers=HEADERS, ).json() if data["status"] in {"succeeded", "failed", "cancelled"}: break time.sleep(5) if data["status"] == "succeeded": print(f"Result: {data['result_url']}") else: print(f"Generation {data['status']}: {data.get('error_message')}") ``` ```bash cURL theme={null} # Enqueue, capture the generation id. GEN_ID=$(curl -s -X POST https://hub.oxen.ai/api/ai/queue \ -H "Content-Type: application/json" \ -H "Authorization: Bearer $OXEN_API_KEY" \ -d '{ "model": "gemini-omni-1-1-flash", "prompt": "", "input_image": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png", "tail_image_url": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png", "input_images": [ "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png" ], "input_videos": [ "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/winter_summer_ox.mp4" ], "input_video": "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/winter_summer_ox.mp4" }' | jq -r '.generations[0].generation_id') # Poll until the generation reaches a terminal status. while true; do STATUS=$(curl -s -H "Authorization: Bearer $OXEN_API_KEY" \ "https://hub.oxen.ai/api/ai/queue/$GEN_ID" | jq -r '.status') echo "Status: $STATUS" case $STATUS in succeeded|failed|cancelled) break;; esac sleep 5 done # Print the result. curl -s -H "Authorization: Bearer $OXEN_API_KEY" \ "https://hub.oxen.ai/api/ai/queue/$GEN_ID" | jq . ``` ```python Python theme={null} import os import time import requests HEADERS = { "Content-Type": "application/json", "Authorization": f"Bearer {os.environ['OXEN_API_KEY']}", } enqueue = requests.post( "https://hub.oxen.ai/api/ai/queue", headers=HEADERS, json={ "model": "gemini-omni-1-1-flash", "prompt": "", "input_image": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png", "tail_image_url": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png", "input_images": [ "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png" ], "input_videos": [ "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/winter_summer_ox.mp4" ], "input_video": "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/winter_summer_ox.mp4" }, ) enqueue.raise_for_status() generation_id = enqueue.json()["generations"][0]["generation_id"] while True: data = requests.get( f"https://hub.oxen.ai/api/ai/queue/{generation_id}", headers=HEADERS, ).json() if data["status"] in {"succeeded", "failed", "cancelled"}: break time.sleep(5) if data["status"] == "succeeded": print(f"Result: {data['result_url']}") else: print(f"Generation {data['status']}: {data.get('error_message')}") ``` ```bash cURL theme={null} # Enqueue, capture the generation id. GEN_ID=$(curl -s -X POST https://hub.oxen.ai/api/ai/queue \ -H "Content-Type: application/json" \ -H "Authorization: Bearer $OXEN_API_KEY" \ -d '{ "model": "gemini-omni-1-1-flash", "prompt": "", "input_image": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png", "tail_image_url": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png", "input_images": [ "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png" ], "input_videos": [ "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/winter_summer_ox.mp4" ], "input_video": "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/winter_summer_ox.mp4", "aspect_ratio": "16:9", "resolution": "720p", "duration": 8 }' | jq -r '.generations[0].generation_id') # Poll until the generation reaches a terminal status. while true; do STATUS=$(curl -s -H "Authorization: Bearer $OXEN_API_KEY" \ "https://hub.oxen.ai/api/ai/queue/$GEN_ID" | jq -r '.status') echo "Status: $STATUS" case $STATUS in succeeded|failed|cancelled) break;; esac sleep 5 done # Print the result. curl -s -H "Authorization: Bearer $OXEN_API_KEY" \ "https://hub.oxen.ai/api/ai/queue/$GEN_ID" | jq . ``` ```python Python theme={null} import os import time import requests HEADERS = { "Content-Type": "application/json", "Authorization": f"Bearer {os.environ['OXEN_API_KEY']}", } enqueue = requests.post( "https://hub.oxen.ai/api/ai/queue", headers=HEADERS, json={ "model": "gemini-omni-1-1-flash", "prompt": "", "input_image": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png", "tail_image_url": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png", "input_images": [ "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png" ], "input_videos": [ "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/winter_summer_ox.mp4" ], "input_video": "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/winter_summer_ox.mp4", "aspect_ratio": "16:9", "resolution": "720p", "duration": 8 }, ) enqueue.raise_for_status() generation_id = enqueue.json()["generations"][0]["generation_id"] while True: data = requests.get( f"https://hub.oxen.ai/api/ai/queue/{generation_id}", headers=HEADERS, ).json() if data["status"] in {"succeeded", "failed", "cancelled"}: break time.sleep(5) if data["status"] == "succeeded": print(f"Result: {data['result_url']}") else: print(f"Generation {data['status']}: {data.get('error_message')}") ``` See the [async queue reference](/inference-api/reference/async_queue) for more details. ```bash cURL theme={null} # Enqueue, capture the generation id. GEN_ID=$(curl -s -X POST https://hub.oxen.ai/api/ai/queue \ -H "Content-Type: application/json" \ -H "Authorization: Bearer $OXEN_API_KEY" \ -d '{ "model": "gemini-omni-1-1-flash", "prompt": "" }' | jq -r '.generations[0].generation_id') # Stream the SSE channel, grab the data line that follows a # media_generation_completed event for our id, and pretty-print it. curl -sN -H "Authorization: Bearer $OXEN_API_KEY" https://hub.oxen.ai/api/events \ | awk -v id="$GEN_ID" ' /^event: media_generation_completed$/ { expect=1; next } /^data: / && expect { payload = substr($0, 7) if (index(payload, "\"generation_id\":\"" id "\"")) { print payload; exit } expect = 0 } ' | jq . ``` ```python Python theme={null} import json import os import requests API_KEY = os.environ["OXEN_API_KEY"] AUTH = {"Authorization": f"Bearer {API_KEY}"} enqueue = requests.post( "https://hub.oxen.ai/api/ai/queue", headers={**AUTH, "Content-Type": "application/json"}, json={ "model": "gemini-omni-1-1-flash", "prompt": "" }, ) enqueue.raise_for_status() generation_id = enqueue.json()["generations"][0]["generation_id"] with requests.get( "https://hub.oxen.ai/api/events", headers=AUTH, stream=True, ) as stream: event_name = None for line in stream.iter_lines(decode_unicode=True): if line.startswith("event: "): event_name = line.removeprefix("event: ") elif line.startswith("data: ") and event_name == "media_generation_completed": payload = json.loads(line.removeprefix("data: ")) if payload.get("generation_id") == generation_id: print(payload) break ``` ```bash cURL theme={null} # Enqueue, capture the generation id. GEN_ID=$(curl -s -X POST https://hub.oxen.ai/api/ai/queue \ -H "Content-Type: application/json" \ -H "Authorization: Bearer $OXEN_API_KEY" \ -d '{ "model": "gemini-omni-1-1-flash", "prompt": "", "input_image": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png", "tail_image_url": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png", "input_images": [ "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png" ], "input_videos": [ "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/winter_summer_ox.mp4" ], "input_video": "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/winter_summer_ox.mp4" }' | jq -r '.generations[0].generation_id') # Stream the SSE channel, grab the data line that follows a # media_generation_completed event for our id, and pretty-print it. curl -sN -H "Authorization: Bearer $OXEN_API_KEY" https://hub.oxen.ai/api/events \ | awk -v id="$GEN_ID" ' /^event: media_generation_completed$/ { expect=1; next } /^data: / && expect { payload = substr($0, 7) if (index(payload, "\"generation_id\":\"" id "\"")) { print payload; exit } expect = 0 } ' | jq . ``` ```python Python theme={null} import json import os import requests API_KEY = os.environ["OXEN_API_KEY"] AUTH = {"Authorization": f"Bearer {API_KEY}"} enqueue = requests.post( "https://hub.oxen.ai/api/ai/queue", headers={**AUTH, "Content-Type": "application/json"}, json={ "model": "gemini-omni-1-1-flash", "prompt": "", "input_image": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png", "tail_image_url": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png", "input_images": [ "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png" ], "input_videos": [ "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/winter_summer_ox.mp4" ], "input_video": "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/winter_summer_ox.mp4" }, ) enqueue.raise_for_status() generation_id = enqueue.json()["generations"][0]["generation_id"] with requests.get( "https://hub.oxen.ai/api/events", headers=AUTH, stream=True, ) as stream: event_name = None for line in stream.iter_lines(decode_unicode=True): if line.startswith("event: "): event_name = line.removeprefix("event: ") elif line.startswith("data: ") and event_name == "media_generation_completed": payload = json.loads(line.removeprefix("data: ")) if payload.get("generation_id") == generation_id: print(payload) break ``` ```bash cURL theme={null} # Enqueue, capture the generation id. GEN_ID=$(curl -s -X POST https://hub.oxen.ai/api/ai/queue \ -H "Content-Type: application/json" \ -H "Authorization: Bearer $OXEN_API_KEY" \ -d '{ "model": "gemini-omni-1-1-flash", "prompt": "", "input_image": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png", "tail_image_url": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png", "input_images": [ "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png" ], "input_videos": [ "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/winter_summer_ox.mp4" ], "input_video": "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/winter_summer_ox.mp4", "aspect_ratio": "16:9", "resolution": "720p", "duration": 8 }' | jq -r '.generations[0].generation_id') # Stream the SSE channel, grab the data line that follows a # media_generation_completed event for our id, and pretty-print it. curl -sN -H "Authorization: Bearer $OXEN_API_KEY" https://hub.oxen.ai/api/events \ | awk -v id="$GEN_ID" ' /^event: media_generation_completed$/ { expect=1; next } /^data: / && expect { payload = substr($0, 7) if (index(payload, "\"generation_id\":\"" id "\"")) { print payload; exit } expect = 0 } ' | jq . ``` ```python Python theme={null} import json import os import requests API_KEY = os.environ["OXEN_API_KEY"] AUTH = {"Authorization": f"Bearer {API_KEY}"} enqueue = requests.post( "https://hub.oxen.ai/api/ai/queue", headers={**AUTH, "Content-Type": "application/json"}, json={ "model": "gemini-omni-1-1-flash", "prompt": "", "input_image": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png", "tail_image_url": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png", "input_images": [ "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png" ], "input_videos": [ "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/winter_summer_ox.mp4" ], "input_video": "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/winter_summer_ox.mp4", "aspect_ratio": "16:9", "resolution": "720p", "duration": 8 }, ) enqueue.raise_for_status() generation_id = enqueue.json()["generations"][0]["generation_id"] with requests.get( "https://hub.oxen.ai/api/events", headers=AUTH, stream=True, ) as stream: event_name = None for line in stream.iter_lines(decode_unicode=True): if line.startswith("event: "): event_name = line.removeprefix("event: ") elif line.startswith("data: ") and event_name == "media_generation_completed": payload = json.loads(line.removeprefix("data: ")) if payload.get("generation_id") == generation_id: print(payload) break ``` ## Fetch model details The [models endpoint](/inference-api/reference/models/overview) returns the full model object, including its `json_request_schema`. ```bash theme={null} curl -H "Authorization: Bearer $OXEN_API_KEY" https://hub.oxen.ai/api/ai/models/gemini-omni-1-1-flash ``` ## Request parameters ### Required parameters | Field | Type | Default | Description | | -------- | -------- | ------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | `prompt` | `string` | — | Describe the video, or the edit or extension to apply to the input video. Refer to media as @FirstFrame, @LastFrame, @Image1, @Video1, etc. Describe audio and negatives in plain language. | ### Optional parameters | Field | Type | Default | Description | | ---------------- | --------------- | -------- | --------------------------------------------------------------------------------------------------------------------------------- | | `input_image` | `string` | — | Image the video starts on. Format: uri. | | `tail_image_url` | `string` | — | Image the video ends on. Requires a first frame. Format: uri. | | `input_images` | `array` | — | Up to 3 images of characters, objects, or styles to carry into the video. | | `input_videos` | `array` | — | Up to 3 clips of at most 3 seconds each for a character, motion, or camera move. Audio is ignored. | | `input_video` | `string` | — | Video of 10 seconds or less. Describe a change to edit it, or what happens next to extend it by the chosen duration. Format: uri. | | `aspect_ratio` | `string` | `"16:9"` | Aspect Ratio One of: 16:9, 9:16. | | `resolution` | `string` | `"720p"` | Resolution One of: 360p, 720p, 1080p, 4k. | | `duration` | `integer` | `8` | Duration Range: 3 – 10. |