JEPA A Path Towards Autonomous Machine Intelligence Paper Explained

>> YOUR LINK HERE: ___ http://youtube.com/watch?v=jSdHmImyUjk

#jepa #ai #machinelearning • Yann LeCun's position paper on a path towards machine intelligence combines Self-Supervised Learning, Energy-Based Models, and hierarchical predictive embedding models to arrive at a system that can teach itself to learn useful abstractions at multiple levels and use that as a world model to plan ahead in time. • OUTLINE: • 0:00 - Introduction • 2:00 - Main Contributions • 5:45 - Mode 1 and Mode 2 actors • 15:40 - Self-Supervised Learning and Energy-Based Models • 20:15 - Introducing latent variables • 25:00 - The problem of collapse • 29:50 - Contrastive vs regularized methods • 36:00 - The JEPA architecture • 47:00 - Hierarchical JEPA (H-JEPA) • 53:00 - Broader relevance • 56:00 - Summary Comments • Paper: https://openreview.net/forum?id=BZ5a1... • Abstract: How could machines learn as efficiently as humans and animals? How could machines learn to reason and plan? How could machines learn representations of percepts and action plans at multiple levels of abstraction, enabling them to reason, predict, and plan at multiple time horizons? This position paper proposes an architecture and training paradigms with which to construct autonomous intelligent agents. It combines concepts such as configurable predictive world model, behavior driven through intrinsic motivation, and hierarchical joint embedding architectures trained with self-supervised learning. • Author: Yann LeCun • Links: • Homepage: https://ykilcher.com • Merch: https://ykilcher.com/merch • YouTube: / yannickilcher • Twitter: / ykilcher • Discord: https://ykilcher.com/discord • LinkedIn: / ykilcher • If you want to support me, the best thing to do is to share out the content :) • If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this): • SubscribeStar: https://www.subscribestar.com/yannick... • Patreon: / yannickilcher • Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq • Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2 • Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m • Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n

#############################

New on site