There is a great new Distill post on understanding moment:

Goh, "Why Momentum Really Works", Distill, 2017. http://doi.org/10.23915/distill.00006
Advertisements
There is a great new Distill post on understanding moment:
Goh, "Why Momentum Really Works", Distill, 2017. http://doi.org/10.23915/distill.00006
Hi,
I was wondering if anyone had worked their way through the blog post?
I was looking at the section “First Steps: Gradient Descent” and for some reason I can’t seem to derive the same expression as in the blogspot for the equation:
x_i^{k+1}= x_i^{k} ….
Specifically the second term ” alpha…”. I tried to develop the whole thing but can’t seem to find the exact same thing as presented here.
Thanks!
LikeLike