update
This commit is contained in:
Morten Hjorth-Jensen
Binary file not shown.
Binary file not shown.
Binary file not shown.
File diff suppressed because it is too large
Load Diff
File diff suppressed because one or more lines are too long
@@ -452,9 +452,10 @@ doconce format html week38.do.txt --no_mako -->
|
||||
<li><p>Statistical interpretation of OLS and various expectation values</p></li>
|
||||
<li><p>Resampling techniques, Bootstrap and cross validation and bias-variance tradeoff</p></li>
|
||||
<li><p>The material we did not cover last week, that is on more advanced methods for updating the learning rate, are covered by its own video. We will briefly discuss these topics at the beginning of the lecture and during the lab sessions. See video on ADAgrad, RMSprop and ADAM (material from last week not covered during lecture) at <a class="reference external" href="https://youtu.be/J_41Hld6tTU">https://youtu.be/J_41Hld6tTU</a></p></li>
|
||||
<li><p><a class="reference external" href="https://youtu.be/4Fo7ITVA7V4">Video of Lecture</a></p></li>
|
||||
<li><p><a class="reference external" href="https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2025/FYSSTKweek38.pdf">Whiteboard notes</a></p></li>
|
||||
</ol>
|
||||
<!-- * [Video of Lecture](https://youtu.be/omLmp_kkie0) -->
|
||||
<!-- * [Whiteboard notes](https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2024/NotesSeptember9.pdf) --></section>
|
||||
</section>
|
||||
<section id="readings-and-videos">
|
||||
<h2>Readings and Videos<a class="headerlink" href="#readings-and-videos" title="Link to this heading">#</a></h2>
|
||||
<ol class="arabic simple">
|
||||
@@ -684,12 +685,12 @@ is equivalent to the maximization/minimization of the function itself.</p>
|
||||
<p>We could now define a new cost function to minimize, namely the negative logarithm of the above PDF</p>
|
||||
<div class="math notranslate nohighlight">
|
||||
\[
|
||||
C(\boldsymbol{\theta}=-\log{\prod_{i=0}^{n-1}p(y_i,\boldsymbol{X}\vert\boldsymbol{\theta})}=-\sum_{i=0}^{n-1}\log{p(y_i,\boldsymbol{X}\vert\boldsymbol{\theta})},
|
||||
C(\boldsymbol{\theta})=-\log{\prod_{i=0}^{n-1}p(y_i,\boldsymbol{X}\vert\boldsymbol{\theta})}=-\sum_{i=0}^{n-1}\log{p(y_i,\boldsymbol{X}\vert\boldsymbol{\theta})},
|
||||
\]</div>
|
||||
<p>which becomes</p>
|
||||
<div class="math notranslate nohighlight">
|
||||
\[
|
||||
C(\boldsymbol{\theta}=\frac{n}{2}\log{2\pi\sigma^2}+\frac{\vert\vert (\boldsymbol{y}-\boldsymbol{X}\boldsymbol{\theta})\vert\vert_2^2}{2\sigma^2}.
|
||||
C(\boldsymbol{\theta})=\frac{n}{2}\log{2\pi\sigma^2}+\frac{\vert\vert (\boldsymbol{y}-\boldsymbol{X}\boldsymbol{\theta})\vert\vert_2^2}{2\sigma^2}.
|
||||
\]</div>
|
||||
<p>Taking the derivative of the <em>new</em> cost function with respect to the parameters <span class="math notranslate nohighlight">\(\theta\)</span> we recognize our familiar OLS equation, namely</p>
|
||||
<div class="math notranslate nohighlight">
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
+129
-127
File diff suppressed because it is too large
Load Diff
@@ -259,9 +259,9 @@ MathJax.Hub.Config({
|
||||
<ol>
|
||||
<li> Statistical interpretation of OLS and various expectation values</li>
|
||||
<li> Resampling techniques, Bootstrap and cross validation and bias-variance tradeoff</li>
|
||||
<li> The material we did not cover last week, that is on more advanced methods for updating the learning rate, are covered by its own video. We will briefly discuss these topics at the beginning of the lecture and during the lab sessions. See video on ADAgrad, RMSprop and ADAM (material from last week not covered during lecture) at <a href="https://youtu.be/J_41Hld6tTU" target="_self"><tt>https://youtu.be/J_41Hld6tTU</tt></a>
|
||||
<!-- * <a href="https://youtu.be/omLmp_kkie0" target="_self">Video of Lecture</a> -->
|
||||
<!-- * <a href="https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2024/NotesSeptember9.pdf" target="_self">Whiteboard notes</a> --></li>
|
||||
<li> The material we did not cover last week, that is on more advanced methods for updating the learning rate, are covered by its own video. We will briefly discuss these topics at the beginning of the lecture and during the lab sessions. See video on ADAgrad, RMSprop and ADAM (material from last week not covered during lecture) at <a href="https://youtu.be/J_41Hld6tTU" target="_self"><tt>https://youtu.be/J_41Hld6tTU</tt></a></li>
|
||||
<li> <a href="https://youtu.be/4Fo7ITVA7V4" target="_self">Video of Lecture</a></li>
|
||||
<li> <a href="https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2025/FYSSTKweek38.pdf" target="_self">Whiteboard notes</a></li>
|
||||
</ol>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
@@ -200,9 +200,9 @@ MathJax.Hub.Config({
|
||||
<ol>
|
||||
<p><li> Statistical interpretation of OLS and various expectation values</li>
|
||||
<p><li> Resampling techniques, Bootstrap and cross validation and bias-variance tradeoff</li>
|
||||
<p><li> The material we did not cover last week, that is on more advanced methods for updating the learning rate, are covered by its own video. We will briefly discuss these topics at the beginning of the lecture and during the lab sessions. See video on ADAgrad, RMSprop and ADAM (material from last week not covered during lecture) at <a href="https://youtu.be/J_41Hld6tTU" target="_blank"><tt>https://youtu.be/J_41Hld6tTU</tt></a>
|
||||
<!-- * <a href="https://youtu.be/omLmp_kkie0" target="_blank">Video of Lecture</a> -->
|
||||
<!-- * <a href="https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2024/NotesSeptember9.pdf" target="_blank">Whiteboard notes</a> --></li>
|
||||
<p><li> The material we did not cover last week, that is on more advanced methods for updating the learning rate, are covered by its own video. We will briefly discuss these topics at the beginning of the lecture and during the lab sessions. See video on ADAgrad, RMSprop and ADAM (material from last week not covered during lecture) at <a href="https://youtu.be/J_41Hld6tTU" target="_blank"><tt>https://youtu.be/J_41Hld6tTU</tt></a></li>
|
||||
<p><li> <a href="https://youtu.be/4Fo7ITVA7V4" target="_blank">Video of Lecture</a></li>
|
||||
<p><li> <a href="https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2025/FYSSTKweek38.pdf" target="_blank">Whiteboard notes</a></li>
|
||||
</ol>
|
||||
</div>
|
||||
</section>
|
||||
|
||||
@@ -238,9 +238,9 @@ MathJax.Hub.Config({
|
||||
<ol>
|
||||
<li> Statistical interpretation of OLS and various expectation values</li>
|
||||
<li> Resampling techniques, Bootstrap and cross validation and bias-variance tradeoff</li>
|
||||
<li> The material we did not cover last week, that is on more advanced methods for updating the learning rate, are covered by its own video. We will briefly discuss these topics at the beginning of the lecture and during the lab sessions. See video on ADAgrad, RMSprop and ADAM (material from last week not covered during lecture) at <a href="https://youtu.be/J_41Hld6tTU" target="_blank"><tt>https://youtu.be/J_41Hld6tTU</tt></a>
|
||||
<!-- * <a href="https://youtu.be/omLmp_kkie0" target="_blank">Video of Lecture</a> -->
|
||||
<!-- * <a href="https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2024/NotesSeptember9.pdf" target="_blank">Whiteboard notes</a> --></li>
|
||||
<li> The material we did not cover last week, that is on more advanced methods for updating the learning rate, are covered by its own video. We will briefly discuss these topics at the beginning of the lecture and during the lab sessions. See video on ADAgrad, RMSprop and ADAM (material from last week not covered during lecture) at <a href="https://youtu.be/J_41Hld6tTU" target="_blank"><tt>https://youtu.be/J_41Hld6tTU</tt></a></li>
|
||||
<li> <a href="https://youtu.be/4Fo7ITVA7V4" target="_blank">Video of Lecture</a></li>
|
||||
<li> <a href="https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2025/FYSSTKweek38.pdf" target="_blank">Whiteboard notes</a></li>
|
||||
</ol>
|
||||
</div>
|
||||
|
||||
|
||||
@@ -315,9 +315,9 @@ MathJax.Hub.Config({
|
||||
<ol>
|
||||
<li> Statistical interpretation of OLS and various expectation values</li>
|
||||
<li> Resampling techniques, Bootstrap and cross validation and bias-variance tradeoff</li>
|
||||
<li> The material we did not cover last week, that is on more advanced methods for updating the learning rate, are covered by its own video. We will briefly discuss these topics at the beginning of the lecture and during the lab sessions. See video on ADAgrad, RMSprop and ADAM (material from last week not covered during lecture) at <a href="https://youtu.be/J_41Hld6tTU" target="_blank"><tt>https://youtu.be/J_41Hld6tTU</tt></a>
|
||||
<!-- * <a href="https://youtu.be/omLmp_kkie0" target="_blank">Video of Lecture</a> -->
|
||||
<!-- * <a href="https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2024/NotesSeptember9.pdf" target="_blank">Whiteboard notes</a> --></li>
|
||||
<li> The material we did not cover last week, that is on more advanced methods for updating the learning rate, are covered by its own video. We will briefly discuss these topics at the beginning of the lecture and during the lab sessions. See video on ADAgrad, RMSprop and ADAM (material from last week not covered during lecture) at <a href="https://youtu.be/J_41Hld6tTU" target="_blank"><tt>https://youtu.be/J_41Hld6tTU</tt></a></li>
|
||||
<li> <a href="https://youtu.be/4Fo7ITVA7V4" target="_blank">Video of Lecture</a></li>
|
||||
<li> <a href="https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2025/FYSSTKweek38.pdf" target="_blank">Whiteboard notes</a></li>
|
||||
</ol>
|
||||
</div>
|
||||
|
||||
|
||||
File diff suppressed because one or more lines are too long
Binary file not shown.
+127
-125
@@ -2,7 +2,7 @@
|
||||
"cells": [
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "799137cd",
|
||||
"id": "8f27372d",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -14,7 +14,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "f5b17715",
|
||||
"id": "fff8ca30",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -27,7 +27,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "cc859721",
|
||||
"id": "7ee7e714",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -41,13 +41,15 @@
|
||||
"2. Resampling techniques, Bootstrap and cross validation and bias-variance tradeoff\n",
|
||||
"\n",
|
||||
"3. The material we did not cover last week, that is on more advanced methods for updating the learning rate, are covered by its own video. We will briefly discuss these topics at the beginning of the lecture and during the lab sessions. See video on ADAgrad, RMSprop and ADAM (material from last week not covered during lecture) at <https://youtu.be/J_41Hld6tTU>\n",
|
||||
"<!-- * [Video of Lecture](https://youtu.be/omLmp_kkie0) -->\n",
|
||||
"<!-- * [Whiteboard notes](https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2024/NotesSeptember9.pdf) -->"
|
||||
"\n",
|
||||
"4. [Video of Lecture](https://youtu.be/4Fo7ITVA7V4)\n",
|
||||
"\n",
|
||||
"5. [Whiteboard notes](https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2025/FYSSTKweek38.pdf)"
|
||||
]
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "a3ecb019",
|
||||
"id": "3b5ac440",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -68,7 +70,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "f128464d",
|
||||
"id": "6d5dba52",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -96,7 +98,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "981db0b8",
|
||||
"id": "bfc2983a",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -112,7 +114,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "85cc8db5",
|
||||
"id": "2b5f5980",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -131,7 +133,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "96a431a6",
|
||||
"id": "3464c7e8",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -145,7 +147,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "b6bf35de",
|
||||
"id": "ed0fd2df",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -157,7 +159,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "a4133715",
|
||||
"id": "feb9d4c2",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -168,7 +170,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "9d8eea64",
|
||||
"id": "eb6d71f8",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -180,7 +182,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "0707109a",
|
||||
"id": "566399f6",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -192,7 +194,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "c84ee75e",
|
||||
"id": "6b33f497",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -208,7 +210,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "eceb2fb1",
|
||||
"id": "5f2f79f2",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -219,7 +221,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "571c857b",
|
||||
"id": "199121b0",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -242,7 +244,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "fa94afa6",
|
||||
"id": "9a1cc529",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -253,7 +255,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "ae5807fe",
|
||||
"id": "149e63be",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -265,7 +267,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "9b7dbfc6",
|
||||
"id": "6a6fb04a",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -277,7 +279,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "a469ecb5",
|
||||
"id": "79420d06",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -291,7 +293,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "a22a5899",
|
||||
"id": "0e3de992",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -322,7 +324,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "f7b64841",
|
||||
"id": "d3ea2897",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -344,7 +346,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "26d50d5c",
|
||||
"id": "da5e3927",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -356,7 +358,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "e2e18a10",
|
||||
"id": "7ab5488b",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -369,7 +371,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "9a97e0bb",
|
||||
"id": "f904a739",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -381,7 +383,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "53cef62d",
|
||||
"id": "10fd648b",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -393,7 +395,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "c8ec4ab0",
|
||||
"id": "4812c2a4",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -405,7 +407,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "1e5e5e07",
|
||||
"id": "199d8531",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -417,7 +419,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "b1ea4ea7",
|
||||
"id": "96c16676",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -440,7 +442,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "d9c8dd38",
|
||||
"id": "a2a1a004",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -452,7 +454,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "7abb690f",
|
||||
"id": "5aad445b",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -465,7 +467,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "417c8406",
|
||||
"id": "d197c8bb",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -477,7 +479,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "fb01419c",
|
||||
"id": "e2e7462f",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -489,7 +491,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "dbe14673",
|
||||
"id": "eb635d3d",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -501,7 +503,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "a19153fe",
|
||||
"id": "445ed13e",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -512,7 +514,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "017ca4ca",
|
||||
"id": "319bfc6c",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -524,7 +526,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "85c7bc4a",
|
||||
"id": "90abf35a",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -535,7 +537,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "ad6066d5",
|
||||
"id": "04b66fbd",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -547,7 +549,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "7d9872d8",
|
||||
"id": "4a27b5a7",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -557,7 +559,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "e3973752",
|
||||
"id": "8d12543f",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -588,7 +590,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "5adedf8a",
|
||||
"id": "2e5cd118",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -600,7 +602,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "23e01c9e",
|
||||
"id": "c71a5edf",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -612,7 +614,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "94cc3cc3",
|
||||
"id": "e663bf2e",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -622,7 +624,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "0e3f94c9",
|
||||
"id": "c4bc4873",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -634,7 +636,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "b8dcd25e",
|
||||
"id": "f5bc59b8",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -644,7 +646,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "9140542c",
|
||||
"id": "4f6ddf4a",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -656,7 +658,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "294a8ce0",
|
||||
"id": "afda0a6b",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -666,7 +668,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "a8c1b097",
|
||||
"id": "b5335dc0",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -678,7 +680,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "4180c17f",
|
||||
"id": "4f86a52d",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -688,7 +690,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "6a48bb05",
|
||||
"id": "5cdb1767",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -707,7 +709,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "d053a5c8",
|
||||
"id": "69435d77",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -735,7 +737,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "8cb550a1",
|
||||
"id": "cefbb559",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -761,7 +763,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "96be5396",
|
||||
"id": "2659401a",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -778,7 +780,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "f8a288b4",
|
||||
"id": "4d5d7748",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -798,7 +800,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "ee8bd2f9",
|
||||
"id": "54df92b3",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -827,7 +829,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "1037fcf3",
|
||||
"id": "5b1a1390",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -852,7 +854,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "2653d9e3",
|
||||
"id": "39f233e4",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -872,7 +874,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "33e4596e",
|
||||
"id": "361320d8",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -884,7 +886,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "137d3cd6",
|
||||
"id": "a363db1e",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -894,7 +896,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "4c9853b7",
|
||||
"id": "92967efc",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -909,7 +911,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "493028c4",
|
||||
"id": "1bffca97",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -922,7 +924,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "c819e616",
|
||||
"id": "0dacb6fc",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -935,7 +937,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "f0385e1a",
|
||||
"id": "baeedf81",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -947,7 +949,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "4310a9b4",
|
||||
"id": "20cc7770",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -960,7 +962,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "1e3932be",
|
||||
"id": "f67d3b94",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -971,7 +973,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "91e64919",
|
||||
"id": "17f59fb6",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -985,7 +987,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "c83a8ca5",
|
||||
"id": "5f899fbe",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -995,7 +997,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "16c94c48",
|
||||
"id": "19a1f5bb",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1009,7 +1011,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "63bc9d16",
|
||||
"id": "1db8fcf2",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1022,7 +1024,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "710fedd5",
|
||||
"id": "bfadf7e5",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1035,7 +1037,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "8c47e8f8",
|
||||
"id": "7c65ce24",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1045,7 +1047,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "c0e43db3",
|
||||
"id": "8cd5650a",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1058,7 +1060,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "e9a40705",
|
||||
"id": "11fdc936",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1068,7 +1070,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "de6040d9",
|
||||
"id": "ed88642e",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1081,7 +1083,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "f2907638",
|
||||
"id": "82c61b81",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1093,7 +1095,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "9e53d173",
|
||||
"id": "bc43db46",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1112,7 +1114,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "959c77be",
|
||||
"id": "25418113",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1125,7 +1127,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "6470ab77",
|
||||
"id": "e5d3c3eb",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1137,7 +1139,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "720c157a",
|
||||
"id": "c504cba4",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1150,7 +1152,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "62c153d3",
|
||||
"id": "079ded2a",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1170,7 +1172,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "cfd10bd9",
|
||||
"id": "e8534a50",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1193,7 +1195,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "40dc022d",
|
||||
"id": "2fc73431",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1208,7 +1210,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "242bfa08",
|
||||
"id": "0f8b0845",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1220,7 +1222,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "7dd4616b",
|
||||
"id": "25105753",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1240,7 +1242,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "00b509e4",
|
||||
"id": "89be6eea",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1260,7 +1262,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "941834ae",
|
||||
"id": "6c240b38",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1284,7 +1286,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "69ba3346",
|
||||
"id": "fbd95a5c",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1305,7 +1307,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "99f1499e",
|
||||
"id": "dc50d43a",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1335,7 +1337,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "c817851a",
|
||||
"id": "283068cc",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1359,7 +1361,7 @@
|
||||
{
|
||||
"cell_type": "code",
|
||||
"execution_count": 1,
|
||||
"id": "4b9647f3",
|
||||
"id": "ff4790ba",
|
||||
"metadata": {
|
||||
"collapsed": false,
|
||||
"editable": true
|
||||
@@ -1398,7 +1400,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "26cf7fd4",
|
||||
"id": "3e6adc2f",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1408,7 +1410,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "b2205188",
|
||||
"id": "6ec8223c",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1419,7 +1421,7 @@
|
||||
{
|
||||
"cell_type": "code",
|
||||
"execution_count": 2,
|
||||
"id": "be6f7ced",
|
||||
"id": "3cf4144d",
|
||||
"metadata": {
|
||||
"collapsed": false,
|
||||
"editable": true
|
||||
@@ -1439,7 +1441,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "69bcb406",
|
||||
"id": "db5a8f91",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1457,7 +1459,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "ce87dc4f",
|
||||
"id": "327bce6a",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1469,7 +1471,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "b8d1371c",
|
||||
"id": "1c671d4e",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1486,7 +1488,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "c95f3051",
|
||||
"id": "6e05fc43",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1498,7 +1500,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "107fab0a",
|
||||
"id": "c45e0752",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1508,7 +1510,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "d56b4bd7",
|
||||
"id": "bafa4ab6",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1520,7 +1522,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "4712d813",
|
||||
"id": "ea0bc471",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1537,7 +1539,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "43a58a59",
|
||||
"id": "08b603f3",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1549,7 +1551,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "6333f694",
|
||||
"id": "4114d10e",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1559,7 +1561,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "24e27c2b",
|
||||
"id": "8890c666",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1571,7 +1573,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "0462c197",
|
||||
"id": "7d5b7ce4",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1581,7 +1583,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "965cd453",
|
||||
"id": "3913c5b9",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1593,7 +1595,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "4426c74e",
|
||||
"id": "5e0067b1",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1603,7 +1605,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "d68ec470",
|
||||
"id": "326bc8f1",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1619,7 +1621,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "0198c371",
|
||||
"id": "d3713eca",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1630,7 +1632,7 @@
|
||||
{
|
||||
"cell_type": "code",
|
||||
"execution_count": 3,
|
||||
"id": "af517050",
|
||||
"id": "01c3b507",
|
||||
"metadata": {
|
||||
"collapsed": false,
|
||||
"editable": true
|
||||
@@ -1695,7 +1697,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "2b502d1d",
|
||||
"id": "949e3a5e",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1706,7 +1708,7 @@
|
||||
{
|
||||
"cell_type": "code",
|
||||
"execution_count": 4,
|
||||
"id": "9a5194fb",
|
||||
"id": "7e7f4926",
|
||||
"metadata": {
|
||||
"collapsed": false,
|
||||
"editable": true
|
||||
@@ -1763,7 +1765,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "727c7723",
|
||||
"id": "33c5cae5",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1801,7 +1803,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "7e90566c",
|
||||
"id": "f931f0f2",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1828,7 +1830,7 @@
|
||||
{
|
||||
"cell_type": "code",
|
||||
"execution_count": 5,
|
||||
"id": "7c760f15",
|
||||
"id": "58daa28d",
|
||||
"metadata": {
|
||||
"collapsed": false,
|
||||
"editable": true
|
||||
@@ -1890,7 +1892,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "2619ab70",
|
||||
"id": "3bbcf741",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1915,7 +1917,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "3e4d0bdb",
|
||||
"id": "4b0ffe06",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1943,7 +1945,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "65d5f3f5",
|
||||
"id": "b11baed6",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -1956,7 +1958,7 @@
|
||||
{
|
||||
"cell_type": "code",
|
||||
"execution_count": 6,
|
||||
"id": "66c55986",
|
||||
"id": "39e76d49",
|
||||
"metadata": {
|
||||
"collapsed": false,
|
||||
"editable": true
|
||||
@@ -2056,7 +2058,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "8bd8e7a8",
|
||||
"id": "e7d12ef0",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -2067,7 +2069,7 @@
|
||||
{
|
||||
"cell_type": "code",
|
||||
"execution_count": 7,
|
||||
"id": "2b363d73",
|
||||
"id": "47f6ae18",
|
||||
"metadata": {
|
||||
"collapsed": false,
|
||||
"editable": true
|
||||
@@ -2156,7 +2158,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "de30ce89",
|
||||
"id": "9c1d4754",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -2166,7 +2168,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "936b8f0f",
|
||||
"id": "b698ac66",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
@@ -2179,7 +2181,7 @@
|
||||
{
|
||||
"cell_type": "code",
|
||||
"execution_count": 8,
|
||||
"id": "399b09d4",
|
||||
"id": "0a2409b0",
|
||||
"metadata": {
|
||||
"collapsed": false,
|
||||
"editable": true
|
||||
@@ -2257,7 +2259,7 @@
|
||||
},
|
||||
{
|
||||
"cell_type": "markdown",
|
||||
"id": "ded3c9a0",
|
||||
"id": "56f130b5",
|
||||
"metadata": {
|
||||
"editable": true
|
||||
},
|
||||
|
||||
@@ -11,8 +11,8 @@ DATE: September 15-19, 2025
|
||||
o Statistical interpretation of OLS and various expectation values
|
||||
o Resampling techniques, Bootstrap and cross validation and bias-variance tradeoff
|
||||
o The material we did not cover last week, that is on more advanced methods for updating the learning rate, are covered by its own video. We will briefly discuss these topics at the beginning of the lecture and during the lab sessions. See video on ADAgrad, RMSprop and ADAM (material from last week not covered during lecture) at URL:"https://youtu.be/J_41Hld6tTU"
|
||||
# * "Video of Lecture":"https://youtu.be/omLmp_kkie0"
|
||||
# * "Whiteboard notes":"https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2024/NotesSeptember9.pdf"
|
||||
o "Video of Lecture":"https://youtu.be/4Fo7ITVA7V4"
|
||||
o "Whiteboard notes":"https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2025/FYSSTKweek38.pdf"
|
||||
!eblock
|
||||
|
||||
|
||||
|
||||
Reference in New Issue
Block a user