smaller update
This commit is contained in:
@@ -3770,7 +3770,7 @@ derivative_fn = grad(sum_logistic)
|
||||
<h2 id="weekend-challenge">Weekend challenge </h2>
|
||||
|
||||
<ul>
|
||||
<p><li> Try to run the above codes and implement the stochastic gradient descent with RMSprop and ADAM.</li>
|
||||
<p><li> Try to run the above codes and implement the stochastic gradient descent with the ADAM. Here you can use as examples the Adagrad and the RMSprop algorithms.</li>
|
||||
<p><li> Add a more complicated function and study the rate of convergence for the derivatives as function of the different methods</li>
|
||||
<p><li> Extend from linear regression to logistic regression.</li>
|
||||
</ul>
|
||||
|
||||
@@ -3705,7 +3705,7 @@ derivative_fn = grad(sum_logistic)
|
||||
<h2 id="weekend-challenge">Weekend challenge </h2>
|
||||
|
||||
<ul>
|
||||
<li> Try to run the above codes and implement the stochastic gradient descent with RMSprop and ADAM.</li>
|
||||
<li> Try to run the above codes and implement the stochastic gradient descent with the ADAM. Here you can use as examples the Adagrad and the RMSprop algorithms.</li>
|
||||
<li> Add a more complicated function and study the rate of convergence for the derivatives as function of the different methods</li>
|
||||
<li> Extend from linear regression to logistic regression.</li>
|
||||
</ul>
|
||||
|
||||
@@ -3782,7 +3782,7 @@ derivative_fn <span style="color: #666666">=</span> grad(sum_logistic)
|
||||
<h2 id="weekend-challenge">Weekend challenge </h2>
|
||||
|
||||
<ul>
|
||||
<li> Try to run the above codes and implement the stochastic gradient descent with RMSprop and ADAM.</li>
|
||||
<li> Try to run the above codes and implement the stochastic gradient descent with the ADAM. Here you can use as examples the Adagrad and the RMSprop algorithms.</li>
|
||||
<li> Add a more complicated function and study the rate of convergence for the derivatives as function of the different methods</li>
|
||||
<li> Extend from linear regression to logistic regression.</li>
|
||||
</ul>
|
||||
|
||||
Binary file not shown.
+283
-283
File diff suppressed because it is too large
Load Diff
@@ -2633,6 +2633,6 @@ print(derivative_fn(x_small))
|
||||
!split
|
||||
===== Weekend challenge =====
|
||||
|
||||
* Try to run the above codes and implement the stochastic gradient descent with RMSprop and ADAM.
|
||||
* Try to run the above codes and implement the stochastic gradient descent with the ADAM. Here you can use as examples the Adagrad and the RMSprop algorithms.
|
||||
* Add a more complicated function and study the rate of convergence for the derivatives as function of the different methods
|
||||
* Extend from linear regression to logistic regression.
|
||||
|
||||
Reference in New Issue
Block a user