← Key papers

Paper review · November 14, 2026

PhysLoop: A Harness That Uses LLMs' Physics Knowledge to Help Video Generation Models Self-Improve

PhysLoop: Harnessing LLMs' Physics Awareness for Self-Improving Video Generation Models

Generative mediaAgentsData & evaluation Intermediate Upvotes 42 cs.CV DAGroup-PKU

By having an LLM agent build and verify scenes with a physics simulator, the authors obtained 100,000 physically consistent videos and a local video repair capability.

Problem

Video generation models look realistic but often make physical and causal errors, such as objects disappearing or awkward collision responses. Fixing this requires physics training data with controlled conditions and reliable error judgments. However, collecting such data at scale through real filming is difficult. LLMs have physics knowledge but have not been able to guide video generation reliably.

Method

A code agent (LLM) handles the work using harness tools. It turns the user's request into a task specification, acquires 3D assets and writes the scene program. Physics computation is handled by Unreal Engine (with Taichi and Genesis as backups). A verifier checks the simulation state and video against the event requirements and, on failure, sends the evidence back to the agent for revision. Simulation videos that pass are polished to the desired appearance by a video generation model (refiner), and the final video is verified again. This flow is used both to build training data and for repair work that replaces only the erroneous segments of existing videos.

Results

Limitations

The Win metric was calculated from 301 pairs compared by a single author without blinding. The evaluation sets are small: 100 for generation and 50 for repair. Because the refiner can change motion, the simulation annotations (depth, segmentation) do not match the final video at the pixel level. The effect of a recursive self-improvement loop that retrains the model on generated data is not confirmed in the provided text.

Why it matters

It is a practical pipeline that uses a physics simulator as a verifier to ensure the physical accuracy of video generation data. The ability to pick out and fix only the erroneous segments of a generated video can be used directly in video production.

Key terms

Harness
An execution framework that bundles the tools and verification steps an LLM agent will use, guiding and constraining the agent's behavior.
Recursive self-improvement (RSI)
An approach in which a model creates its own training data, evaluates it and retrains on it, repeating the process with minimal human involvement.
Physics-IQ
An external benchmark that evaluates how well the later part of a generated video matches actually recorded physical events.

Original

Authors: Yuxuan Chen, Xiaojie Li, Hao Chen, Juncheng Ma, Kewei Zhang, Zhongjing Du, Guoqiang Wei, Fangfang Wang, et al. · Posted 2026-11-12 · License CC BY 4.0 · Based on the full text

This review is an AI-written summary of the paper. Please treat the original paper as the reference.