Models / Alibaba
Video

Alibaba HappyHorse 1.1 T2V

Upgraded text-to-video with improved motion dynamics, consistency, and audio generation

About model

HappyHorse 1.1 is the upgraded release of the video generation model from Alibaba's ATH AI Innovation Unit, generating video and synchronized audio together in a single pass. This text-to-video endpoint turns a written prompt into a finished clip with dialogue, ambient sound, and effects aligned to the on-screen action, driven by a motion engine tuned to respect real-world physics. Compared with HappyHorse 1.0, Alibaba reports improvements across motion dynamics, subject consistency, prompt adherence, visual quality, and audio generation. The 1.0 release topped both the text-to-video and image-to-video Elo rankings on the Artificial Analysis Video Arena at launch, and prompts are processed natively in multiple languages, including English, Chinese, and Japanese. Available on Together AI.

Motion & Consistency

Improved

Alibaba-reported upgrades to motion dynamics, subject consistency, and prompt adherence

Audio Generation

Native

Dialogue, ambient sound, and effects in the same pass as the video

Output Resolution

Up to 1080p

Cinematic output with physics-consistent motion

Model key capabilities
  • Prompt to Finished Clip: Generates video and matched sound from a single written prompt, with no separate audio pipeline
  • Native Audio Generation: Dialogue, ambient sound, and effects generated in the same pass and aligned to on-screen action
  • Upgraded Generation Quality: Alibaba-reported improvements to motion dynamics, subject consistency, prompt adherence, visual quality, and audio
  • Production-Ready Infrastructure: 99.9% SLA, available on Together AI serverless infrastructure
  • API usage

    • cURL
    • Python
    • Typescript

    Endpoint:

    alibaba/happyhorse-1.1-t2v

    curl --request POST \
      --url https://api.together.xyz/v2/videos \
      --header "Authorization: Bearer $TOGETHER_API_KEY" \
      --header "Content-Type: application/json" \
      --data '{
        "model": "alibaba/happyhorse-1.1-t2v",
        "prompt": "some penguins building a snowman"
      }'
    
    from together import Together
    
    client = Together()
    
    # Create a video generation job
    job = client.videos.create(
        prompt="A serene sunset over the ocean with gentle waves",
        model="alibaba/happyhorse-1.1-t2v"
    )
    
    import Together from "together-ai";
    
    const together = new Together();
    
    async function main() {
      // Create a video generation job
      const job = await together.videos.create({
        prompt: "A serene sunset over the ocean with gentle waves",
        model: "alibaba/happyhorse-1.1-t2v"
      });
    
  • Model card

    Architecture Overview:
    • Unified generation of video and synchronized audio in a single pass, with no separate audio pipeline
    • Motion engine designed around real-world physical constraints to reduce warping artifacts
    • Native multilingual prompt processing, including English, Chinese, and Japanese

    Training Methodology:
    • Developed by Alibaba's ATH AI Innovation Unit (formerly the Taotian Future Life Lab)
    • Debuted anonymously on the Artificial Analysis Video Arena before Alibaba confirmed it as the developer

    Performance Characteristics:
    • Alibaba-reported upgrades over HappyHorse 1.0 across motion dynamics, subject consistency, prompt adherence, visual quality, and audio generation
    • HappyHorse 1.0 topped the Artificial Analysis Video Arena text-to-video and image-to-video Elo rankings at launch, based on blind human preference votes

  • Prompting

    Together AI API Access:
    • Access HappyHorse 1.1 T2V via Together AI APIs using the endpoint alibaba/happyhorse-1.1-t2v
    • Authenticate using your Together AI API key in request headers
    • Submit a text prompt and poll the video response until generation completes
    • Prompts can be written natively in multiple languages, including English, Chinese, and Japanese
    • Available on Together AI serverless infrastructure

  • Applications & use cases

    E-Commerce & Product Video:
    • Turn product imagery into showcase clips with matched sound effects by calling the Together endpoint
    • Generate consistent brand visuals across multiple video variations for storefronts and listings
    • Localize product videos with prompts written natively in English, Chinese, or Japanese

    Marketing & Social Content:
    • Produce short-form ads and social clips with dialogue and ambience generated in one pass
    • Iterate on campaign concepts quickly without a separate audio or dubbing step
    • Batch-generate platform-ready variations through the Together API

    Narrative & Creative Production:
    • Draft storyboards and previsualization clips with physics-consistent motion
    • Build character-driven scenes with synchronized dialogue and sound
    • Prototype creative directions before committing to full production

Related models
  • Model provider
    Alibaba
  • Type
    Video
  • Resolution/Duration
    Up to 1080p
  • Deployment
    Serverless
  • Input modalities
    Text
  • Output modalities
    Video
  • Released
    June 21, 2026
  • Category
    Video