Joint Embedding Predictive Architecture (JEPA)
A Joint Embedding Predictive Architecture is a design proposed by Yann LeCun in 2022 for learning world models. Rather than predicting every pixel of a missing image patch or future video frame, it predicts an abstract summary of it, so the model can ignore details that cannot be predicted, like the exact motion of leaves. Meta released image and video versions (I-JEPA in 2023, V-JEPA later).
Why it comes up
JEPA is LeCun's proposed alternative to generative language models as the path to human-level AI.
Yann LeCun