Video Generation Provider Plugins
Video Generation مزوّدو النماذج Plugins
Start with meaning, then move to detail.
This lesson explains Video Generation Provider Plugins as part of Hermes internals and extension points. You will learn what it does, when it matters, and the smallest safe test that proves it works.
If you are new, do not memorize names. Focus on three questions: what problem does this solve, what access does it need, and how can you verify the result?
For practice, inspect the first example, identify its effects, run it on test data, and compare the result with the source claim.
For advanced readers, inspect The unified surface (one tool, two modalities), How discovery works, Directory structure, then verify failure modes and version compatibility.
Know Python, Git, and basic project structure before changing code.
A clear outcome before you read.
- Understand Video Generation Provider Plugins without assumed prior knowledge.
- Separate the source description from what still needs testing in your environment.
- Read the first command and identify its inputs and outputs before copying it.
Short definitions before the details.
- Provider
- The service that runs or provides access and authentication to a model.
- Tool
- A structured action the agent can call to read or change something.
How to build a video-generation backend plugin for Hermes Agent
What does the source say, and in what order?
- 01The unified surface (one tool, two modalities)
Start here to understand the core idea or structure.
- 02How discovery works
Read this after the foundation, then connect it to the previous step.
- 03Directory structure
Read this after the foundation, then connect it to the previous step.
- 04The VideoGenProvider ABC
Read this after the foundation, then connect it to the previous step.
- 05The plugin manifest
Read this after the foundation, then connect it to the previous step.
- 06The videogenerate schema
Read this after the foundation, then connect it to the previous step.
- 07Model families and endpoint routing (the FAL pattern)
Read this after the foundation, then connect it to the previous step.
- 08Selection precedence
Read this after the foundation, then connect it to the previous step.
- 09Response shape
Read this after the foundation, then connect it to the previous step.
- 10Where to save artifacts
Finish here to verify the result and special cases.
Copy only after you understand the effect.
plugins/video_gen/my-backend/
├── __init__.py # VideoGenProvider subclass + register()
└── plugin.yaml # Manifest with kind: backend## The plugin manifest## The `video_generate` schema
The tool exposes one schema across every backend. Providers ignore parameters they don't support.
| Parameter | What it does |
|---|---|
| `prompt` | Text instruction (required) |
| `image_url` | When set → image-to-video; when omitted → text-to-video |
| `reference_image_urls` | Style/character refs (provider-dependent) |
| `duration` | Seconds — provider clamps |
| `aspect_ratio` | `"16:9"`, `"9:16"`, `"1:1"`, ... — provider clamps |
| `resolution` | `"480p"` / `"540p"` / `"720p"` / `"1080p"` — provider clamps |
| `negative_prompt` | Content to avoid (PixversRead the first command and identify its inputs and outputs before copying it.
Match every command to your installed Hermes version, review the files and accounts it can reach, and use non-sensitive data for the first test. If this explanation differs from the source, the official source wins.