Vanishing amp Exploding Gradient explained A problem resulting from backpropagation

>> YOUR LINK HERE: ___ http://youtube.com/watch?v=qO_NLVjD6zE

Let's discuss a problem that creeps up time-and-time during the training process of an artificial neural network. This is the problem of unstable gradients, and is most popularly referred to as the vanishing gradient problem. • We're first going to answer the question, what is the vanishing gradient problem, anyway? Here, we'll cover the idea conceptually. We'll then move our discussion to talking about how this problem occurs. Then, with the understanding that we'll have developed up to this point, we'll discuss the problem of exploding gradients, which we'll see is actually very similar to the vanishing gradient problem, and so we'll be able to take what we learned about that problem and apply it to this new one. • 🕒🦎 VIDEO SECTIONS 🦎🕒 • 00:00 Welcome to DEEPLIZARD - Go to deeplizard.com for learning resources • 00:28 Gradient review • 01:18 Agenda • 01:45 The vanishing gradient problem • 03:27 The cause of the vanishing gradients • 05:30 Exploding gradient • 07:13 Collective Intelligence and the DEEPLIZARD HIVEMIND • 💥🦎 DEEPLIZARD COMMUNITY RESOURCES 🦎💥 • 👋 Hey, we're Chris and Mandy, the creators of deeplizard! • 👉 Check out the website for more learning material: • 🔗 https://deeplizard.com • 💻 ENROLL TO GET DOWNLOAD ACCESS TO CODE FILES • 🔗 https://deeplizard.com/resources • 🧠 Support collective intelligence, join the deeplizard hivemind: • 🔗 https://deeplizard.com/hivemind • 🧠 Use code DEEPLIZARD at checkout to receive 15% off your first Neurohacker order • 👉 Use your receipt from Neurohacker to get a discount on deeplizard courses • 🔗 https://neurohacker.com/shop?rfsn=648... • 👀 CHECK OUT OUR VLOG: • 🔗 / deeplizardvlog • ❤️🦎 Special thanks to the following polymaths of the deeplizard hivemind: • Tammy • Mano Prime • Ling Li • 🚀 Boost collective intelligence by sharing this video on social media! • 👀 Follow deeplizard: • Our vlog: / deeplizardvlog • Facebook: / deeplizard • Instagram: / deeplizard • Twitter: / deeplizard • Patreon: / deeplizard • YouTube: / deeplizard • 🎓 Deep Learning with deeplizard: • Deep Learning Dictionary - https://deeplizard.com/course/ddcpailzrd • Deep Learning Fundamentals - https://deeplizard.com/course/dlcpailzrd • Learn TensorFlow - https://deeplizard.com/course/tfcpailzrd • Learn PyTorch - https://deeplizard.com/course/ptcpailzrd • Natural Language Processing - https://deeplizard.com/course/txtcpai... • Reinforcement Learning - https://deeplizard.com/course/rlcpailzrd • Generative Adversarial Networks - https://deeplizard.com/course/gacpailzrd • 🎓 Other Courses: • DL Fundamentals Classic - https://deeplizard.com/learn/video/gZ... • Deep Learning Deployment - https://deeplizard.com/learn/video/SI... • Data Science - https://deeplizard.com/learn/video/d1... • Trading - https://deeplizard.com/learn/video/Zp... • 🛒 Check out products deeplizard recommends on Amazon: • 🔗 https://amazon.com/shop/deeplizard • 🎵 deeplizard uses music by Kevin MacLeod • 🔗 / @incompetech_kmac • ❤️ Please use the knowledge gained from deeplizard content for good, not evil.

#############################

New on site