Alibaba HappyHorse 1.1 T2V
Upgraded text-to-video with improved motion dynamics, consistency, and audio generation
About model
HappyHorse 1.1 is the upgraded release of the video generation model from Alibaba's ATH AI Innovation Unit, generating video and synchronized audio together in a single pass. This text-to-video endpoint turns a written prompt into a finished clip with dialogue, ambient sound, and effects aligned to the on-screen action, driven by a motion engine tuned to respect real-world physics. Compared with HappyHorse 1.0, Alibaba reports improvements across motion dynamics, subject consistency, prompt adherence, visual quality, and audio generation. The 1.0 release topped both the text-to-video and image-to-video Elo rankings on the Artificial Analysis Video Arena at launch, and prompts are processed natively in multiple languages, including English, Chinese, and Japanese. Available on Together AI.
Improved
Alibaba-reported upgrades to motion dynamics, subject consistency, and prompt adherence
Native
Dialogue, ambient sound, and effects in the same pass as the video
Up to 1080p
Cinematic output with physics-consistent motion
- Prompt to Finished Clip: Generates video and matched sound from a single written prompt, with no separate audio pipeline
- Native Audio Generation: Dialogue, ambient sound, and effects generated in the same pass and aligned to on-screen action
- Upgraded Generation Quality: Alibaba-reported improvements to motion dynamics, subject consistency, prompt adherence, visual quality, and audio
- Production-Ready Infrastructure: 99.9% SLA, available on Together AI serverless infrastructure
API usage
Endpoint:
Model card
Architecture Overview:
• Unified generation of video and synchronized audio in a single pass, with no separate audio pipeline
• Motion engine designed around real-world physical constraints to reduce warping artifacts
• Native multilingual prompt processing, including English, Chinese, and Japanese
Training Methodology:
• Developed by Alibaba's ATH AI Innovation Unit (formerly the Taotian Future Life Lab)
• Debuted anonymously on the Artificial Analysis Video Arena before Alibaba confirmed it as the developer
Performance Characteristics:
• Alibaba-reported upgrades over HappyHorse 1.0 across motion dynamics, subject consistency, prompt adherence, visual quality, and audio generation
• HappyHorse 1.0 topped the Artificial Analysis Video Arena text-to-video and image-to-video Elo rankings at launch, based on blind human preference votes
Prompting
Together AI API Access:
• Access HappyHorse 1.1 T2V via Together AI APIs using the endpoint alibaba/happyhorse-1.1-t2v
• Authenticate using your Together AI API key in request headers
• Submit a text prompt and poll the video response until generation completes
• Prompts can be written natively in multiple languages, including English, Chinese, and Japanese
• Available on Together AI serverless infrastructure
Applications & use cases
E-Commerce & Product Video:
• Turn product imagery into showcase clips with matched sound effects by calling the Together endpoint
• Generate consistent brand visuals across multiple video variations for storefronts and listings
• Localize product videos with prompts written natively in English, Chinese, or Japanese
Marketing & Social Content:
• Produce short-form ads and social clips with dialogue and ambience generated in one pass
• Iterate on campaign concepts quickly without a separate audio or dubbing step
• Batch-generate platform-ready variations through the Together API
Narrative & Creative Production:
• Draft storyboards and previsualization clips with physics-consistent motion
• Build character-driven scenes with synchronized dialogue and sound
• Prototype creative directions before committing to full production
- Model providerAlibaba
- TypeVideo
- Resolution/DurationUp to 1080p
- DeploymentServerless
- Endpoint
- Input modalitiesText
- Output modalitiesVideo
- ReleasedJune 21, 2026
- CategoryVideo