Vol. I · No. 199WED, NOV 4, 2026
Archive

The Archive

Search the full wire by company, model, lab, or keyword. Every story we have ever aggregated.

Sub-JEPA: a simple fix to LeCun group's LeWorldModel that consistently improves performance [P]

**World models** learn compact latent representations for planning without pixel reconstruction. LeWorldModel (LeWM), from LeCun's group at NYU, achieves stable end-to-end JEPA training by enforcing an isotropic Gaussian prior over the full latent space. **The flaw:** real environment dynamics live on low-dimensional manifolds, so a global high-dimensional Gaussian is an overly rigid prior — mismatched to the task geometry. LeWM itself struggles most on low-intrinsic-dimension tasks like Two-Room. **Our fix (Sub-JEPA):** apply the Gaussian regularization inside multiple frozen random orthog...

··
13 matches