This commit is contained in:
Morten Hjorth-Jensen
2023-10-05 16:32:17 +02:00
parent 4b847a0d95
commit ec511fb068
7 changed files with 760 additions and 673 deletions
+3 -1
View File
@@ -339,7 +339,9 @@ MathJax.Hub.Config({
<!-- subsequent paragraphs come in larger fonts, so start with a paragraph -->
<ul>
<li> Stochastic Gradient descent with examples and automatic differentiation</li>
<li> Neural Networks, setting up the basic steps, from the simple perceptron model to the multi-layer perceptron model.</li>
<li> Neural Networks, setting up the basic steps, from the simple perceptron model to the multi-layer perceptron model.</li>
<li> <a href="https://youtu.be/75pr3hKY20U" target="_self">Video of lecture</a></li>
<li> "Whiteboard notes at <a href="https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2023/NotesOct5.pdf" target="_self"><tt>https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2023/NotesOct5.pdf</tt></a></li>
<li> Readings and Videos:</li>
<ul>
<li> These lecture notes</li>
+4
View File
@@ -222,6 +222,10 @@ MathJax.Hub.Config({
<p><li> Neural Networks, setting up the basic steps, from the simple perceptron model to the multi-layer perceptron model.</li>
<p><li> <a href="https://youtu.be/75pr3hKY20U" target="_blank">Video of lecture</a></li>
<p><li> "Whiteboard notes at <a href="https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2023/NotesOct5.pdf" target="_blank"><tt>https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2023/NotesOct5.pdf</tt></a></li>
<p><li> Readings and Videos:</li>
<ul>
+3 -1
View File
@@ -295,7 +295,9 @@ MathJax.Hub.Config({
<p>
<ul>
<li> Stochastic Gradient descent with examples and automatic differentiation</li>
<li> Neural Networks, setting up the basic steps, from the simple perceptron model to the multi-layer perceptron model.</li>
<li> Neural Networks, setting up the basic steps, from the simple perceptron model to the multi-layer perceptron model.</li>
<li> <a href="https://youtu.be/75pr3hKY20U" target="_blank">Video of lecture</a></li>
<li> "Whiteboard notes at <a href="https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2023/NotesOct5.pdf" target="_blank"><tt>https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2023/NotesOct5.pdf</tt></a></li>
<li> Readings and Videos:</li>
<ul>
<li> These lecture notes</li>
+3 -1
View File
@@ -372,7 +372,9 @@ MathJax.Hub.Config({
<p>
<ul>
<li> Stochastic Gradient descent with examples and automatic differentiation</li>
<li> Neural Networks, setting up the basic steps, from the simple perceptron model to the multi-layer perceptron model.</li>
<li> Neural Networks, setting up the basic steps, from the simple perceptron model to the multi-layer perceptron model.</li>
<li> <a href="https://youtu.be/75pr3hKY20U" target="_blank">Video of lecture</a></li>
<li> "Whiteboard notes at <a href="https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2023/NotesOct5.pdf" target="_blank"><tt>https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2023/NotesOct5.pdf</tt></a></li>
<li> Readings and Videos:</li>
<ul>
<li> These lecture notes</li>
Binary file not shown.
File diff suppressed because one or more lines are too long
+3 -1
View File
@@ -18,7 +18,9 @@ DATE: October 2-6, 2023
!bblock Material for the lecture on Thursday October 5, 2023
* Stochastic Gradient descent with examples and automatic differentiation
* Neural Networks, setting up the basic steps, from the simple perceptron model to the multi-layer perceptron model.
* Neural Networks, setting up the basic steps, from the simple perceptron model to the multi-layer perceptron model.
* "Video of lecture":"https://youtu.be/75pr3hKY20U"
* "Whiteboard notes at URL:"https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2023/NotesOct5.pdf"
* Readings and Videos:
* These lecture notes
* For a good discussion on gradient methods, we would like to recommend Goodfellow et al section 4.3-4.5 and sections 8.3-8.6. We will come back to the latter chapter in our discussion of Neural networks as well.