smaller update

This commit is contained in:
Morten Hjorth-Jensen
2022-10-04 15:20:22 +02:00
parent f0b8dd310f
commit af3d1a5993
6 changed files with 287 additions and 287 deletions
+1 -1
View File
@@ -3770,7 +3770,7 @@ derivative_fn = grad(sum_logistic)
<h2 id="weekend-challenge">Weekend challenge </h2>
<ul>
<p><li> Try to run the above codes and implement the stochastic gradient descent with RMSprop and ADAM.</li>
<p><li> Try to run the above codes and implement the stochastic gradient descent with the ADAM. Here you can use as examples the Adagrad and the RMSprop algorithms.</li>
<p><li> Add a more complicated function and study the rate of convergence for the derivatives as function of the different methods</li>
<p><li> Extend from linear regression to logistic regression.</li>
</ul>
+1 -1
View File
@@ -3705,7 +3705,7 @@ derivative_fn = grad(sum_logistic)
<h2 id="weekend-challenge">Weekend challenge </h2>
<ul>
<li> Try to run the above codes and implement the stochastic gradient descent with RMSprop and ADAM.</li>
<li> Try to run the above codes and implement the stochastic gradient descent with the ADAM. Here you can use as examples the Adagrad and the RMSprop algorithms.</li>
<li> Add a more complicated function and study the rate of convergence for the derivatives as function of the different methods</li>
<li> Extend from linear regression to logistic regression.</li>
</ul>
+1 -1
View File
@@ -3782,7 +3782,7 @@ derivative_fn <span style="color: #666666">=</span> grad(sum_logistic)
<h2 id="weekend-challenge">Weekend challenge </h2>
<ul>
<li> Try to run the above codes and implement the stochastic gradient descent with RMSprop and ADAM.</li>
<li> Try to run the above codes and implement the stochastic gradient descent with the ADAM. Here you can use as examples the Adagrad and the RMSprop algorithms.</li>
<li> Add a more complicated function and study the rate of convergence for the derivatives as function of the different methods</li>
<li> Extend from linear regression to logistic regression.</li>
</ul>
Binary file not shown.
File diff suppressed because it is too large Load Diff
+1 -1
View File
@@ -2633,6 +2633,6 @@ print(derivative_fn(x_small))
!split
===== Weekend challenge =====
* Try to run the above codes and implement the stochastic gradient descent with RMSprop and ADAM.
* Try to run the above codes and implement the stochastic gradient descent with the ADAM. Here you can use as examples the Adagrad and the RMSprop algorithms.
* Add a more complicated function and study the rate of convergence for the derivatives as function of the different methods
* Extend from linear regression to logistic regression.