Repository: localaiLicense: other

MiniMax-H3 served by vllm.cpp, LocalAI's own C++ port of vLLM. It generates video AND audio jointly from a text prompt, so a clip comes back as an MP4 with a real soundtrack rather than a silent render: ask for speech in the prompt and the model lip-syncs it. This is the Q4_K_M quantisation of the FL2VA partition, which serves text-to-video (t2va) and first/last-frame conditioning (fl2va). Reference conditioning (ref2va) is a different checkpoint and is refused by this one. Roughly 40 GB of weights across five files, plus the two VAE configs that carry the latent statistics. The default canvas is 1344x768 at 124 frames and 24 fps, about 5.2 seconds. Generation is slow — measured at roughly 176 s per denoise step at that canvas on a 20-SM device, so the 50-step default is a multi-hour job. Muxing the finished frames needs ffmpeg on the host.
Links
Tags
Repository: localaiLicense: other

MiniMax-H3 served by vllm.cpp, LocalAI's own C++ port of vLLM. It generates video AND audio jointly, so a clip comes back as an MP4 with a real soundtrack rather than a silent render. This is the Q4_K_M quantisation of the Ref2VA partition, the one that takes REFERENCE conditioning: a reference image, a reference clip, or reference audio, prepended as their own blocks so the subject or style carries into the generated video. For plain text-to-video or first/last-frame conditioning use minimax-h3-fl2va-q4 instead - the two partitions are separate checkpoints and each refuses the other's tasks. Use this Q4_K_M build, NOT the NVFP4 Ref2VA weights: NVFP4 renders a multicolour patch grid, and it took three investigations upstream to establish that the fault is the quantisation rather than the reference path. On Q4_K_M the same code renders coherently. Roughly 40 GB of weights across five files, plus the two VAE configs that carry the latent statistics. The default canvas is 1344x768 at 124 frames and 24 fps, about 5.2 seconds. Generation is slow - roughly 176 s per denoise step at that canvas on a 20-SM device, so the 50-step default is a multi-hour job. Muxing the finished frames needs ffmpeg on the host.
Links
Tags