{"id":2436,"date":"2023-08-08T20:32:46","date_gmt":"2023-08-08T20:32:46","guid":{"rendered":"https:\/\/sites.uac.pt\/amendes\/?p=2436"},"modified":"2023-08-08T20:32:46","modified_gmt":"2023-08-08T20:32:46","slug":"why-momentum-really-works","status":"publish","type":"post","link":"https:\/\/sites.uac.pt\/amendes\/materiais-ensino\/why-momentum-really-works\/","title":{"rendered":"Why Momentum Really Works"},"content":{"rendered":"\n<div class=\"wp-block-cover is-light\" style=\"min-height:104px;aspect-ratio:unset;\"><span aria-hidden=\"true\" class=\"wp-block-cover__background has-background-dim\"><\/span><img loading=\"lazy\" decoding=\"async\" width=\"984\" height=\"300\" class=\"wp-block-cover__image-background wp-image-2437\" alt=\"\" src=\"https:\/\/sites.uac.pt\/amendes\/files\/2023\/08\/https__distill.pub_2017_momentum-Screenshot-2023-08-08-at-17-26-26-Why-Momentum-Really-Works.png\" data-object-fit=\"cover\" srcset=\"https:\/\/sites.uac.pt\/amendes\/files\/2023\/08\/https__distill.pub_2017_momentum-Screenshot-2023-08-08-at-17-26-26-Why-Momentum-Really-Works.png 984w, https:\/\/sites.uac.pt\/amendes\/files\/2023\/08\/https__distill.pub_2017_momentum-Screenshot-2023-08-08-at-17-26-26-Why-Momentum-Really-Works-300x91.png 300w, https:\/\/sites.uac.pt\/amendes\/files\/2023\/08\/https__distill.pub_2017_momentum-Screenshot-2023-08-08-at-17-26-26-Why-Momentum-Really-Works-768x234.png 768w\" sizes=\"auto, (max-width: 984px) 100vw, 984px\" \/><div class=\"wp-block-cover__inner-container is-layout-flow wp-block-cover-is-layout-flow\">\n<p class=\"has-text-align-center has-large-font-size\"><a href=\"https:\/\/distill.pub\/2017\/momentum\/\" data-type=\"URL\" data-id=\"https:\/\/distill.pub\/2017\/momentum\/\">clique aqui para o site<\/a><\/p>\n\n\n\n<p><\/p>\n<\/div><\/div>\n\n\n\n<p class=\"has-luminous-vivid-amber-color has-text-color\">Uma excelente explica\u00e7\u00e3o de como funciona o <em>momentum <\/em>em redes neuronais<\/p>\n\n\n\n<p>Here\u2019s a popular story about momentum [1, 2, 3]: gradient descent is a man walking down a hill. He follows the steepest path downwards; his progress is slow, but steady. Momentum is a heavy ball rolling down the same hill. The added inertia acts both as a smoother and an accelerator, dampening oscillations and causing us to barrel through narrow valleys, small humps and local minima.<\/p>\n\n\n\n<p>This standard story isn\u2019t wrong, but it fails to explain many important behaviors of momentum. In fact, momentum can be understood far more precisely if we study it on the right model.<\/p>\n\n\n\n<p>One nice model is the convex quadratic. This model is rich enough to reproduce momentum\u2019s local dynamics in real problems, and yet simple enough to be understood in closed form. This balance gives us powerful traction for understanding this algorithm.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Uma excelente explica\u00e7\u00e3o de como funciona o momentum em redes neuronais Here\u2019s a popular story about momentum [1, 2, 3]: gradient descent is a man walking down a hill. He follows the steepest path downwards; his progress is slow, but steady. Momentum is a heavy ball rolling down the same hill. The added inertia acts [&hellip;]<\/p>\n","protected":false},"author":159,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[4066,4102,105],"tags":[4235,4233,4070,4234],"class_list":["post-2436","post","type-post","status-publish","format-standard","hentry","category-data-science","category-infogramas-dashboards","category-materiais-ensino","tag-aprendizagem","tag-deep-learning","tag-ml","tag-rna"],"_links":{"self":[{"href":"https:\/\/sites.uac.pt\/amendes\/wp-json\/wp\/v2\/posts\/2436","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sites.uac.pt\/amendes\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sites.uac.pt\/amendes\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sites.uac.pt\/amendes\/wp-json\/wp\/v2\/users\/159"}],"replies":[{"embeddable":true,"href":"https:\/\/sites.uac.pt\/amendes\/wp-json\/wp\/v2\/comments?post=2436"}],"version-history":[{"count":1,"href":"https:\/\/sites.uac.pt\/amendes\/wp-json\/wp\/v2\/posts\/2436\/revisions"}],"predecessor-version":[{"id":2438,"href":"https:\/\/sites.uac.pt\/amendes\/wp-json\/wp\/v2\/posts\/2436\/revisions\/2438"}],"wp:attachment":[{"href":"https:\/\/sites.uac.pt\/amendes\/wp-json\/wp\/v2\/media?parent=2436"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sites.uac.pt\/amendes\/wp-json\/wp\/v2\/categories?post=2436"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sites.uac.pt\/amendes\/wp-json\/wp\/v2\/tags?post=2436"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}