From 1aef956d0e8ed111b271fb233440d53715f68d50 Mon Sep 17 00:00:00 2001 From: Morten Hjorth-Jensen Date: Sun, 6 Oct 2024 12:29:55 +0200 Subject: [PATCH] update week 41 --- doc/pub/week41/html/._week41-bs002.html | 32 +- doc/pub/week41/html/week41-reveal.html | 35 +- doc/pub/week41/html/week41-solarized.html | 31 +- doc/pub/week41/html/week41.html | 31 +- doc/pub/week41/ipynb/ipynb-week41-src.tar.gz | Bin 34323 -> 34323 bytes doc/pub/week41/ipynb/week41.ipynb | 450 ++++++++++--------- doc/src/week41/week41.do.txt | 23 +- 7 files changed, 314 insertions(+), 288 deletions(-) diff --git a/doc/pub/week41/html/._week41-bs002.html b/doc/pub/week41/html/._week41-bs002.html index 56a81ba6d..e40d78038 100644 --- a/doc/pub/week41/html/._week41-bs002.html +++ b/doc/pub/week41/html/._week41-bs002.html @@ -342,22 +342,30 @@ MathJax.Hub.Config({

Material for the lecture on Monday October 7, 2024

- -

I also recommend Michael Nielsen's intuitive approach to the neural networks and the universal approximation theorem, see the slides at http://neuralnetworksanddeeplearning.com/chap4.html.

+ +
+
+ +
    +
  1. These lecture notes
    2. +
  2. Rashcka et al chapter 11
    3. +
  3. For neural networks we recommend Goodfellow et al chapter 6. +
      +
    1. Neural Networks demystified at https://www.youtube.com/watch?v=bxe2T-V8XRs&list=PLiaHhY2iBX9hdHaRr6b7XevZtgZRa1PoU&ab_channel=WelchLabs
      2. +
    +
  4. Building Neural Networks from scratch at https://www.youtube.com/watch?v=Wo5dMEP_BbI&list=PLQVvvaa0QuDcjD5BAw2DxE6OF2tius3V3&ab_channel=sentdex
    5. +
  5. Video on Neural Networks at https://www.youtube.com/watch?v=CqOfi41LfDw
    6. +
  6. Video on the back propagation algorithm at https://www.youtube.com/watch?v=Ilg3gGewQ5U
    7. +
+

We also recommend Michael Nielsen's intuitive approach to the neural networks and the universal approximation theorem, see the slides at http://neuralnetworksanddeeplearning.com/chap4.html.

+
+
+

diff --git a/doc/pub/week41/html/week41-reveal.html b/doc/pub/week41/html/week41-reveal.html index 5ab4c69ff..e390a2e4b 100644 --- a/doc/pub/week41/html/week41-reveal.html +++ b/doc/pub/week41/html/week41-reveal.html @@ -197,30 +197,31 @@ MathJax.Hub.Config({

Material for the lecture on Monday October 7, 2024

- +

  • Rashcka et al chapter 11
    • +

  • For neural networks we recommend Goodfellow et al chapter 6. +
      +

    1. Neural Networks demystified at https://www.youtube.com/watch?v=bxe2T-V8XRs&list=PLiaHhY2iBX9hdHaRr6b7XevZtgZRa1PoU&ab_channel=WelchLabs
      2. +

    - +

  • Building Neural Networks from scratch at https://www.youtube.com/watch?v=Wo5dMEP_BbI&list=PLQVvvaa0QuDcjD5BAw2DxE6OF2tius3V3&ab_channel=sentdex
    • +

  • Video on Neural Networks at https://www.youtube.com/watch?v=CqOfi41LfDw
    • +

  • Video on the back propagation algorithm at https://www.youtube.com/watch?v=Ilg3gGewQ5U
    • +

    -

    I also recommend Michael Nielsen's intuitive approach to the neural networks and the universal approximation theorem, see the slides at http://neuralnetworksanddeeplearning.com/chap4.html.

    +

    We also recommend Michael Nielsen's intuitive approach to the neural networks and the universal approximation theorem, see the slides at http://neuralnetworksanddeeplearning.com/chap4.html.

    +
    diff --git a/doc/pub/week41/html/week41-solarized.html b/doc/pub/week41/html/week41-solarized.html index 46fb7e9da..1d336f81a 100644 --- a/doc/pub/week41/html/week41-solarized.html +++ b/doc/pub/week41/html/week41-solarized.html @@ -298,22 +298,29 @@ MathJax.Hub.Config({









    Material for the lecture on Monday October 7, 2024

    - -

    I also recommend Michael Nielsen's intuitive approach to the neural networks and the universal approximation theorem, see the slides at http://neuralnetworksanddeeplearning.com/chap4.html.

    + +
    +Readings and Videos: +

    +

      +
    1. These lecture notes
      2. +
    2. Rashcka et al chapter 11
      3. +
    3. For neural networks we recommend Goodfellow et al chapter 6. +
        +
      1. Neural Networks demystified at https://www.youtube.com/watch?v=bxe2T-V8XRs&list=PLiaHhY2iBX9hdHaRr6b7XevZtgZRa1PoU&ab_channel=WelchLabs
        2. +
      +
    4. Building Neural Networks from scratch at https://www.youtube.com/watch?v=Wo5dMEP_BbI&list=PLQVvvaa0QuDcjD5BAw2DxE6OF2tius3V3&ab_channel=sentdex
      5. +
    5. Video on Neural Networks at https://www.youtube.com/watch?v=CqOfi41LfDw
      6. +
    6. Video on the back propagation algorithm at https://www.youtube.com/watch?v=Ilg3gGewQ5U
      7. +
    +

    We also recommend Michael Nielsen's intuitive approach to the neural networks and the universal approximation theorem, see the slides at http://neuralnetworksanddeeplearning.com/chap4.html.

    +
    +









    Material for the active learning sessions on Tuesday and Wednesday

    diff --git a/doc/pub/week41/html/week41.html b/doc/pub/week41/html/week41.html index c2478214d..3acd69a81 100644 --- a/doc/pub/week41/html/week41.html +++ b/doc/pub/week41/html/week41.html @@ -375,22 +375,29 @@ MathJax.Hub.Config({









    Material for the lecture on Monday October 7, 2024

    - -

    I also recommend Michael Nielsen's intuitive approach to the neural networks and the universal approximation theorem, see the slides at http://neuralnetworksanddeeplearning.com/chap4.html.

    + +
    +Readings and Videos: +

    +

      +
    1. These lecture notes
      2. +
    2. Rashcka et al chapter 11
      3. +
    3. For neural networks we recommend Goodfellow et al chapter 6. +
        +
      1. Neural Networks demystified at https://www.youtube.com/watch?v=bxe2T-V8XRs&list=PLiaHhY2iBX9hdHaRr6b7XevZtgZRa1PoU&ab_channel=WelchLabs
        2. +
      +
    4. Building Neural Networks from scratch at https://www.youtube.com/watch?v=Wo5dMEP_BbI&list=PLQVvvaa0QuDcjD5BAw2DxE6OF2tius3V3&ab_channel=sentdex
      5. +
    5. Video on Neural Networks at https://www.youtube.com/watch?v=CqOfi41LfDw
      6. +
    6. Video on the back propagation algorithm at https://www.youtube.com/watch?v=Ilg3gGewQ5U
      7. +
    +

    We also recommend Michael Nielsen's intuitive approach to the neural networks and the universal approximation theorem, see the slides at http://neuralnetworksanddeeplearning.com/chap4.html.

    +
    +









    Material for the active learning sessions on Tuesday and Wednesday

    diff --git a/doc/pub/week41/ipynb/ipynb-week41-src.tar.gz b/doc/pub/week41/ipynb/ipynb-week41-src.tar.gz index b41fbe87e7bbfabf9995c6c03315b2413f14b783..b7b3589779d7cdfb9256b65e328e9227a95ae273 100644 GIT binary patch delta 18 ZcmbQ-!!)^viCw;%gJDJ*(?)ilHUKrB1x5e> delta 18 ZcmbQ-!!)^viCw;%gW>&8hK=kzZ2&uH1}*>q diff --git a/doc/pub/week41/ipynb/week41.ipynb b/doc/pub/week41/ipynb/week41.ipynb index 7fa78c784..3def9b7f3 100644 --- a/doc/pub/week41/ipynb/week41.ipynb +++ b/doc/pub/week41/ipynb/week41.ipynb @@ -2,7 +2,7 @@ "cells": [ { "cell_type": "markdown", - "id": "cd0bfabc", + "id": "4fed6eef", "metadata": { "editable": true }, @@ -14,7 +14,7 @@ }, { "cell_type": "markdown", - "id": "f0f7f96b", + "id": "6a758aaa", "metadata": { "editable": true }, @@ -27,7 +27,7 @@ }, { "cell_type": "markdown", - "id": "bd960320", + "id": "7436d60f", "metadata": { "editable": true }, @@ -37,38 +37,40 @@ }, { "cell_type": "markdown", - "id": "0d1f535d", + "id": "4a06fa29", "metadata": { "editable": true }, "source": [ "## Material for the lecture on Monday October 7, 2024\n", - "* Neural Networks, setting up the basic steps, from the simple perceptron model to the multi-layer perceptron model.\n", + "1. Neural Networks, setting up the basic steps, from the simple perceptron model to the multi-layer perceptron model.\n", "\n", - "* Building our own Feed-forward Neural Network\n", + "2. Building our own Feed-forward Neural Network\n", "\n", "\n", "\n", - "* Readings and Videos:\n", + "**Readings and Videos:**\n", "\n", - " * These lecture notes\n", + "1. These lecture notes\n", "\n", - " * For neural networks we recommend Goodfellow et al chapter 6.\n", + "2. Rashcka et al chapter 11 \n", "\n", - " * [Neural Networks demystified](https://www.youtube.com/watch?v=bxe2T-V8XRs&list=PLiaHhY2iBX9hdHaRr6b7XevZtgZRa1PoU&ab_channel=WelchLabs)\n", + "3. For neural networks we recommend Goodfellow et al chapter 6.\n", "\n", - " * [Building Neural Networks from scratch](https://www.youtube.com/watch?v=Wo5dMEP_BbI&list=PLQVvvaa0QuDcjD5BAw2DxE6OF2tius3V3&ab_channel=sentdex)\n", + "a. Neural Networks demystified at \n", "\n", - " * [Video on Neural Networks](https://www.youtube.com/watch?v=CqOfi41LfDw)\n", + "2. Building Neural Networks from scratch at \n", "\n", - " * [Video on the back propagation algorithm](https://www.youtube.com/watch?v=Ilg3gGewQ5U)\n", + "3. Video on Neural Networks at \n", "\n", - "I also recommend Michael Nielsen's intuitive approach to the neural networks and the universal approximation theorem, see the slides at ." + "4. Video on the back propagation algorithm at \n", + "\n", + "We also recommend Michael Nielsen's intuitive approach to the neural networks and the universal approximation theorem, see the slides at ." ] }, { "cell_type": "markdown", - "id": "2d4f220f", + "id": "c77f547a", "metadata": { "editable": true }, @@ -85,7 +87,7 @@ }, { "cell_type": "markdown", - "id": "7214b9bd", + "id": "a1ba6a50", "metadata": { "editable": true }, @@ -95,7 +97,7 @@ }, { "cell_type": "markdown", - "id": "80595801", + "id": "9ef418c8", "metadata": { "editable": true }, @@ -113,7 +115,7 @@ }, { "cell_type": "markdown", - "id": "12ee45b0", + "id": "b58ec2e6", "metadata": { "editable": true }, @@ -137,7 +139,7 @@ }, { "cell_type": "markdown", - "id": "0e213000", + "id": "7d1b99e3", "metadata": { "editable": true }, @@ -155,7 +157,7 @@ }, { "cell_type": "markdown", - "id": "d7816da0", + "id": "367512fa", "metadata": { "editable": true }, @@ -195,7 +197,7 @@ }, { "cell_type": "markdown", - "id": "f6814f51", + "id": "3d79cfce", "metadata": { "editable": true }, @@ -224,7 +226,7 @@ }, { "cell_type": "markdown", - "id": "68cd207e", + "id": "cbcafcdc", "metadata": { "editable": true }, @@ -245,7 +247,7 @@ }, { "cell_type": "markdown", - "id": "33080b90", + "id": "1ab04b48", "metadata": { "editable": true }, @@ -274,7 +276,7 @@ }, { "cell_type": "markdown", - "id": "70e55f4d", + "id": "e4cf80b3", "metadata": { "editable": true }, @@ -295,7 +297,7 @@ }, { "cell_type": "markdown", - "id": "aefd09e1", + "id": "f27655c6", "metadata": { "editable": true }, @@ -316,7 +318,7 @@ }, { "cell_type": "markdown", - "id": "e91cd288", + "id": "fa00e7d8", "metadata": { "editable": true }, @@ -333,7 +335,7 @@ }, { "cell_type": "markdown", - "id": "4e177844", + "id": "7b05bd13", "metadata": { "editable": true }, @@ -354,7 +356,7 @@ }, { "cell_type": "markdown", - "id": "4931b6a4", + "id": "3600caa3", "metadata": { "editable": true }, @@ -370,7 +372,7 @@ }, { "cell_type": "markdown", - "id": "7e3e6f86", + "id": "99af52bb", "metadata": { "editable": true }, @@ -387,7 +389,7 @@ { "cell_type": "code", "execution_count": 1, - "id": "9f29bf66", + "id": "04ecfb00", "metadata": { "collapsed": false, "editable": true @@ -428,7 +430,7 @@ }, { "cell_type": "markdown", - "id": "21456d42", + "id": "0026adeb", "metadata": { "editable": true }, @@ -438,7 +440,7 @@ }, { "cell_type": "markdown", - "id": "8ebc44ca", + "id": "e23f3056", "metadata": { "editable": true }, @@ -449,7 +451,7 @@ { "cell_type": "code", "execution_count": 2, - "id": "ca464a78", + "id": "a30fe879", "metadata": { "collapsed": false, "editable": true @@ -511,7 +513,7 @@ }, { "cell_type": "markdown", - "id": "8a11dae8", + "id": "7773ba9d", "metadata": { "editable": true }, @@ -521,7 +523,7 @@ }, { "cell_type": "markdown", - "id": "983f7b58", + "id": "4a85ef26", "metadata": { "editable": true }, @@ -532,7 +534,7 @@ { "cell_type": "code", "execution_count": 3, - "id": "67ced134", + "id": "2f8dd9ef", "metadata": { "collapsed": false, "editable": true @@ -552,7 +554,7 @@ }, { "cell_type": "markdown", - "id": "766a2022", + "id": "5b0fb3ff", "metadata": { "editable": true }, @@ -564,7 +566,7 @@ }, { "cell_type": "markdown", - "id": "5f2a0748", + "id": "f5c984c2", "metadata": { "editable": true }, @@ -576,7 +578,7 @@ }, { "cell_type": "markdown", - "id": "ffc9a317", + "id": "9743f4cb", "metadata": { "editable": true }, @@ -591,7 +593,7 @@ }, { "cell_type": "markdown", - "id": "00218ad2", + "id": "e89c3e3f", "metadata": { "editable": true }, @@ -603,7 +605,7 @@ }, { "cell_type": "markdown", - "id": "6c0c7e27", + "id": "21c83fef", "metadata": { "editable": true }, @@ -620,7 +622,7 @@ }, { "cell_type": "markdown", - "id": "fa049e8f", + "id": "3267338f", "metadata": { "editable": true }, @@ -635,7 +637,7 @@ }, { "cell_type": "markdown", - "id": "d703bcf0", + "id": "04a1a613", "metadata": { "editable": true }, @@ -653,7 +655,7 @@ }, { "cell_type": "markdown", - "id": "6b6c02a0", + "id": "bc8b70e2", "metadata": { "editable": true }, @@ -665,7 +667,7 @@ }, { "cell_type": "markdown", - "id": "43e302c7", + "id": "10686541", "metadata": { "editable": true }, @@ -683,7 +685,7 @@ }, { "cell_type": "markdown", - "id": "50de39ca", + "id": "a92cdf36", "metadata": { "editable": true }, @@ -696,7 +698,7 @@ }, { "cell_type": "markdown", - "id": "e605d839", + "id": "74dcfa13", "metadata": { "editable": true }, @@ -708,7 +710,7 @@ }, { "cell_type": "markdown", - "id": "d9e3c72b", + "id": "0147afef", "metadata": { "editable": true }, @@ -726,7 +728,7 @@ }, { "cell_type": "markdown", - "id": "0670ca49", + "id": "4a4d5b2e", "metadata": { "editable": true }, @@ -744,7 +746,7 @@ }, { "cell_type": "markdown", - "id": "e8b54cc4", + "id": "31742756", "metadata": { "editable": true }, @@ -754,7 +756,7 @@ }, { "cell_type": "markdown", - "id": "c79790fe", + "id": "123af90c", "metadata": { "editable": true }, @@ -772,7 +774,7 @@ }, { "cell_type": "markdown", - "id": "132a7811", + "id": "aeb7cc95", "metadata": { "editable": true }, @@ -791,7 +793,7 @@ }, { "cell_type": "markdown", - "id": "b4b2cbce", + "id": "3ab7d88c", "metadata": { "editable": true }, @@ -804,7 +806,7 @@ }, { "cell_type": "markdown", - "id": "a77ce5e6", + "id": "9b07f5bb", "metadata": { "editable": true }, @@ -822,7 +824,7 @@ }, { "cell_type": "markdown", - "id": "d6f61a54", + "id": "e9b4beb5", "metadata": { "editable": true }, @@ -833,7 +835,7 @@ }, { "cell_type": "markdown", - "id": "5154a5d2", + "id": "57213d71", "metadata": { "editable": true }, @@ -852,7 +854,7 @@ }, { "cell_type": "markdown", - "id": "871d00a4", + "id": "85dc952c", "metadata": { "editable": true }, @@ -870,7 +872,7 @@ }, { "cell_type": "markdown", - "id": "acb3cfcf", + "id": "4a67580f", "metadata": { "editable": true }, @@ -883,7 +885,7 @@ }, { "cell_type": "markdown", - "id": "a1e3ddcf", + "id": "19f79e3c", "metadata": { "editable": true }, @@ -903,7 +905,7 @@ }, { "cell_type": "markdown", - "id": "5d8f7770", + "id": "e350b83c", "metadata": { "editable": true }, @@ -936,7 +938,7 @@ }, { "cell_type": "markdown", - "id": "c95ac1f1", + "id": "3b64eaf6", "metadata": { "editable": true }, @@ -948,7 +950,7 @@ }, { "cell_type": "markdown", - "id": "eef8190d", + "id": "dc8ca05e", "metadata": { "editable": true }, @@ -967,7 +969,7 @@ }, { "cell_type": "markdown", - "id": "c1ca6046", + "id": "079a6c4b", "metadata": { "editable": true }, @@ -981,7 +983,7 @@ }, { "cell_type": "markdown", - "id": "e956d05b", + "id": "3498dab8", "metadata": { "editable": true }, @@ -1004,7 +1006,7 @@ }, { "cell_type": "markdown", - "id": "d0c99061", + "id": "c0b93415", "metadata": { "editable": true }, @@ -1023,7 +1025,7 @@ }, { "cell_type": "markdown", - "id": "6815467d", + "id": "74a5d31d", "metadata": { "editable": true }, @@ -1035,7 +1037,7 @@ }, { "cell_type": "markdown", - "id": "fc187909", + "id": "539998aa", "metadata": { "editable": true }, @@ -1045,7 +1047,7 @@ }, { "cell_type": "markdown", - "id": "cbb43071", + "id": "e4b4b760", "metadata": { "editable": true }, @@ -1057,7 +1059,7 @@ }, { "cell_type": "markdown", - "id": "46c884c8", + "id": "b98e352b", "metadata": { "editable": true }, @@ -1074,7 +1076,7 @@ { "cell_type": "code", "execution_count": 4, - "id": "28cea7ab", + "id": "9f6ead02", "metadata": { "collapsed": false, "editable": true @@ -1156,7 +1158,7 @@ }, { "cell_type": "markdown", - "id": "61b52960", + "id": "95f54888", "metadata": { "editable": true }, @@ -1194,7 +1196,7 @@ }, { "cell_type": "markdown", - "id": "0dddbc91", + "id": "91bf2419", "metadata": { "editable": true }, @@ -1224,7 +1226,7 @@ }, { "cell_type": "markdown", - "id": "e95a6f3e", + "id": "6500ed58", "metadata": { "editable": true }, @@ -1245,7 +1247,7 @@ }, { "cell_type": "markdown", - "id": "8e4d580d", + "id": "703f7235", "metadata": { "editable": true }, @@ -1257,7 +1259,7 @@ }, { "cell_type": "markdown", - "id": "9b212a3a", + "id": "667ef874", "metadata": { "editable": true }, @@ -1272,7 +1274,7 @@ }, { "cell_type": "markdown", - "id": "ef29083a", + "id": "dd53c6c8", "metadata": { "editable": true }, @@ -1289,7 +1291,7 @@ }, { "cell_type": "markdown", - "id": "5c1e1166", + "id": "4f58ed9b", "metadata": { "editable": true }, @@ -1301,7 +1303,7 @@ }, { "cell_type": "markdown", - "id": "a243367c", + "id": "c60762cd", "metadata": { "editable": true }, @@ -1314,7 +1316,7 @@ }, { "cell_type": "markdown", - "id": "1239f466", + "id": "5c1c5162", "metadata": { "editable": true }, @@ -1326,7 +1328,7 @@ }, { "cell_type": "markdown", - "id": "da34ddfb", + "id": "080b6f9a", "metadata": { "editable": true }, @@ -1340,7 +1342,7 @@ }, { "cell_type": "markdown", - "id": "4931c9f9", + "id": "12e261bb", "metadata": { "editable": true }, @@ -1352,7 +1354,7 @@ }, { "cell_type": "markdown", - "id": "d8fc8d86", + "id": "49a48c09", "metadata": { "editable": true }, @@ -1364,7 +1366,7 @@ }, { "cell_type": "markdown", - "id": "3f5b98a0", + "id": "6dc08f48", "metadata": { "editable": true }, @@ -1376,7 +1378,7 @@ }, { "cell_type": "markdown", - "id": "009e2644", + "id": "b8211d41", "metadata": { "editable": true }, @@ -1386,7 +1388,7 @@ }, { "cell_type": "markdown", - "id": "163f6fd0", + "id": "96822eda", "metadata": { "editable": true }, @@ -1398,7 +1400,7 @@ }, { "cell_type": "markdown", - "id": "00c5a33c", + "id": "f0b1660f", "metadata": { "editable": true }, @@ -1408,7 +1410,7 @@ }, { "cell_type": "markdown", - "id": "dcb81383", + "id": "df85f033", "metadata": { "editable": true }, @@ -1420,7 +1422,7 @@ }, { "cell_type": "markdown", - "id": "bb30ab8e", + "id": "ea90d738", "metadata": { "editable": true }, @@ -1434,7 +1436,7 @@ }, { "cell_type": "markdown", - "id": "99a6059e", + "id": "fafb43b4", "metadata": { "editable": true }, @@ -1446,7 +1448,7 @@ }, { "cell_type": "markdown", - "id": "d33c12cc", + "id": "41afcc45", "metadata": { "editable": true }, @@ -1456,7 +1458,7 @@ }, { "cell_type": "markdown", - "id": "a02c173e", + "id": "aed16939", "metadata": { "editable": true }, @@ -1468,7 +1470,7 @@ }, { "cell_type": "markdown", - "id": "56bc3c91", + "id": "4ece624c", "metadata": { "editable": true }, @@ -1478,7 +1480,7 @@ }, { "cell_type": "markdown", - "id": "41c8098a", + "id": "7fbf4fe4", "metadata": { "editable": true }, @@ -1490,7 +1492,7 @@ }, { "cell_type": "markdown", - "id": "4bf3307b", + "id": "dba0e4a4", "metadata": { "editable": true }, @@ -1502,7 +1504,7 @@ }, { "cell_type": "markdown", - "id": "007b5c5f", + "id": "c32147af", "metadata": { "editable": true }, @@ -1514,7 +1516,7 @@ }, { "cell_type": "markdown", - "id": "121eb6a5", + "id": "4b6176c8", "metadata": { "editable": true }, @@ -1524,7 +1526,7 @@ }, { "cell_type": "markdown", - "id": "c34990f3", + "id": "b87747a4", "metadata": { "editable": true }, @@ -1536,7 +1538,7 @@ }, { "cell_type": "markdown", - "id": "2b79d7c9", + "id": "1547289e", "metadata": { "editable": true }, @@ -1546,7 +1548,7 @@ }, { "cell_type": "markdown", - "id": "e9823b90", + "id": "ef9854e4", "metadata": { "editable": true }, @@ -1558,7 +1560,7 @@ }, { "cell_type": "markdown", - "id": "60341a2e", + "id": "c9ce87bb", "metadata": { "editable": true }, @@ -1582,7 +1584,7 @@ }, { "cell_type": "markdown", - "id": "c9df01ae", + "id": "5b74b869", "metadata": { "editable": true }, @@ -1594,7 +1596,7 @@ }, { "cell_type": "markdown", - "id": "bb5b7b0e", + "id": "42b1eab9", "metadata": { "editable": true }, @@ -1604,7 +1606,7 @@ }, { "cell_type": "markdown", - "id": "ab815c87", + "id": "27331743", "metadata": { "editable": true }, @@ -1616,7 +1618,7 @@ }, { "cell_type": "markdown", - "id": "f4a75dc4", + "id": "8f1b672f", "metadata": { "editable": true }, @@ -1628,7 +1630,7 @@ }, { "cell_type": "markdown", - "id": "e7fb1341", + "id": "543a0ba2", "metadata": { "editable": true }, @@ -1640,7 +1642,7 @@ }, { "cell_type": "markdown", - "id": "f88b8251", + "id": "628ee133", "metadata": { "editable": true }, @@ -1650,7 +1652,7 @@ }, { "cell_type": "markdown", - "id": "5dbd33c7", + "id": "94f361e5", "metadata": { "editable": true }, @@ -1662,7 +1664,7 @@ }, { "cell_type": "markdown", - "id": "06980f0c", + "id": "13e5c5d5", "metadata": { "editable": true }, @@ -1672,7 +1674,7 @@ }, { "cell_type": "markdown", - "id": "2f1032fa", + "id": "4887a3d7", "metadata": { "editable": true }, @@ -1686,7 +1688,7 @@ }, { "cell_type": "markdown", - "id": "2387c247", + "id": "8f4d75dd", "metadata": { "editable": true }, @@ -1704,7 +1706,7 @@ }, { "cell_type": "markdown", - "id": "10b12fdf", + "id": "69864347", "metadata": { "editable": true }, @@ -1714,7 +1716,7 @@ }, { "cell_type": "markdown", - "id": "fd488646", + "id": "e654f179", "metadata": { "editable": true }, @@ -1732,7 +1734,7 @@ }, { "cell_type": "markdown", - "id": "33e87c9a", + "id": "f650a917", "metadata": { "editable": true }, @@ -1742,7 +1744,7 @@ }, { "cell_type": "markdown", - "id": "3896fa6f", + "id": "b8169c55", "metadata": { "editable": true }, @@ -1760,7 +1762,7 @@ }, { "cell_type": "markdown", - "id": "6c5f256e", + "id": "5567d66c", "metadata": { "editable": true }, @@ -1787,7 +1789,7 @@ }, { "cell_type": "markdown", - "id": "29eed044", + "id": "f5c09470", "metadata": { "editable": true }, @@ -1799,7 +1801,7 @@ }, { "cell_type": "markdown", - "id": "95bacfb5", + "id": "d66ef5ca", "metadata": { "editable": true }, @@ -1811,7 +1813,7 @@ }, { "cell_type": "markdown", - "id": "55fd0995", + "id": "e96004a2", "metadata": { "editable": true }, @@ -1821,7 +1823,7 @@ }, { "cell_type": "markdown", - "id": "9c5b8bec", + "id": "0ee94485", "metadata": { "editable": true }, @@ -1833,7 +1835,7 @@ }, { "cell_type": "markdown", - "id": "d25c4849", + "id": "1c2ac190", "metadata": { "editable": true }, @@ -1843,7 +1845,7 @@ }, { "cell_type": "markdown", - "id": "a2f304a9", + "id": "f89f9c76", "metadata": { "editable": true }, @@ -1855,7 +1857,7 @@ }, { "cell_type": "markdown", - "id": "0882ef89", + "id": "f8293787", "metadata": { "editable": true }, @@ -1865,7 +1867,7 @@ }, { "cell_type": "markdown", - "id": "0832397a", + "id": "a2914db3", "metadata": { "editable": true }, @@ -1877,7 +1879,7 @@ }, { "cell_type": "markdown", - "id": "87f4f78f", + "id": "297a2622", "metadata": { "editable": true }, @@ -1889,7 +1891,7 @@ }, { "cell_type": "markdown", - "id": "ea38b2c5", + "id": "c952f57b", "metadata": { "editable": true }, @@ -1912,7 +1914,7 @@ }, { "cell_type": "markdown", - "id": "df795f22", + "id": "37d4f242", "metadata": { "editable": true }, @@ -1924,7 +1926,7 @@ }, { "cell_type": "markdown", - "id": "a36288c9", + "id": "ff2e732a", "metadata": { "editable": true }, @@ -1934,7 +1936,7 @@ }, { "cell_type": "markdown", - "id": "b28747c8", + "id": "97a96714", "metadata": { "editable": true }, @@ -1946,7 +1948,7 @@ }, { "cell_type": "markdown", - "id": "9d3780d4", + "id": "3ee8ad1b", "metadata": { "editable": true }, @@ -1956,7 +1958,7 @@ }, { "cell_type": "markdown", - "id": "b4e7a6e4", + "id": "c4d2d1a1", "metadata": { "editable": true }, @@ -1968,7 +1970,7 @@ }, { "cell_type": "markdown", - "id": "64ec6017", + "id": "d412dae3", "metadata": { "editable": true }, @@ -1980,7 +1982,7 @@ }, { "cell_type": "markdown", - "id": "732ae342", + "id": "64129a91", "metadata": { "editable": true }, @@ -1991,7 +1993,7 @@ }, { "cell_type": "markdown", - "id": "8411f5a4", + "id": "681d8bd9", "metadata": { "editable": true }, @@ -2014,7 +2016,7 @@ }, { "cell_type": "markdown", - "id": "d20565e2", + "id": "62904d70", "metadata": { "editable": true }, @@ -2026,7 +2028,7 @@ }, { "cell_type": "markdown", - "id": "caa6405c", + "id": "bb5b2dde", "metadata": { "editable": true }, @@ -2036,7 +2038,7 @@ }, { "cell_type": "markdown", - "id": "d9b58d13", + "id": "51828c66", "metadata": { "editable": true }, @@ -2048,7 +2050,7 @@ }, { "cell_type": "markdown", - "id": "a8b70423", + "id": "c4124232", "metadata": { "editable": true }, @@ -2058,7 +2060,7 @@ }, { "cell_type": "markdown", - "id": "35548fe3", + "id": "80791bf2", "metadata": { "editable": true }, @@ -2070,7 +2072,7 @@ }, { "cell_type": "markdown", - "id": "f2fa2e1a", + "id": "107737c9", "metadata": { "editable": true }, @@ -2082,7 +2084,7 @@ }, { "cell_type": "markdown", - "id": "86cf20f9", + "id": "720ad834", "metadata": { "editable": true }, @@ -2093,7 +2095,7 @@ }, { "cell_type": "markdown", - "id": "18f9316b", + "id": "6854da89", "metadata": { "editable": true }, @@ -2116,7 +2118,7 @@ }, { "cell_type": "markdown", - "id": "fcd69e95", + "id": "b5c0c6c7", "metadata": { "editable": true }, @@ -2128,7 +2130,7 @@ }, { "cell_type": "markdown", - "id": "915a9ca7", + "id": "43403932", "metadata": { "editable": true }, @@ -2138,7 +2140,7 @@ }, { "cell_type": "markdown", - "id": "031bf60c", + "id": "08f3064e", "metadata": { "editable": true }, @@ -2150,7 +2152,7 @@ }, { "cell_type": "markdown", - "id": "3f430a8b", + "id": "f5d698a4", "metadata": { "editable": true }, @@ -2160,7 +2162,7 @@ }, { "cell_type": "markdown", - "id": "fd2ad2ed", + "id": "3ae56fb5", "metadata": { "editable": true }, @@ -2172,7 +2174,7 @@ }, { "cell_type": "markdown", - "id": "c313b9fd", + "id": "b822ca59", "metadata": { "editable": true }, @@ -2184,7 +2186,7 @@ }, { "cell_type": "markdown", - "id": "bfc31104", + "id": "e0593696", "metadata": { "editable": true }, @@ -2195,7 +2197,7 @@ }, { "cell_type": "markdown", - "id": "06c382a1", + "id": "c77a2a17", "metadata": { "editable": true }, @@ -2223,7 +2225,7 @@ }, { "cell_type": "markdown", - "id": "c1d4dbf3", + "id": "093f5d87", "metadata": { "editable": true }, @@ -2235,7 +2237,7 @@ }, { "cell_type": "markdown", - "id": "8d7bbee4", + "id": "7bd03f69", "metadata": { "editable": true }, @@ -2245,7 +2247,7 @@ }, { "cell_type": "markdown", - "id": "42969039", + "id": "fe5226a0", "metadata": { "editable": true }, @@ -2257,7 +2259,7 @@ }, { "cell_type": "markdown", - "id": "0656759f", + "id": "45f1532a", "metadata": { "editable": true }, @@ -2268,7 +2270,7 @@ }, { "cell_type": "markdown", - "id": "571bd5c2", + "id": "1b07418e", "metadata": { "editable": true }, @@ -2280,7 +2282,7 @@ }, { "cell_type": "markdown", - "id": "1aa1692d", + "id": "c7f5232f", "metadata": { "editable": true }, @@ -2293,7 +2295,7 @@ }, { "cell_type": "markdown", - "id": "ad5c5f5a", + "id": "e1af7b47", "metadata": { "editable": true }, @@ -2318,7 +2320,7 @@ }, { "cell_type": "markdown", - "id": "2bca9ba0", + "id": "db469d35", "metadata": { "editable": true }, @@ -2331,7 +2333,7 @@ }, { "cell_type": "markdown", - "id": "078f8c40", + "id": "deb48962", "metadata": { "editable": true }, @@ -2343,7 +2345,7 @@ }, { "cell_type": "markdown", - "id": "cc7f345a", + "id": "36443e39", "metadata": { "editable": true }, @@ -2355,7 +2357,7 @@ }, { "cell_type": "markdown", - "id": "b8ab0b35", + "id": "8076d9fa", "metadata": { "editable": true }, @@ -2365,7 +2367,7 @@ }, { "cell_type": "markdown", - "id": "5ba5bd24", + "id": "292dad0a", "metadata": { "editable": true }, @@ -2377,7 +2379,7 @@ }, { "cell_type": "markdown", - "id": "7b4711bd", + "id": "7803b746", "metadata": { "editable": true }, @@ -2389,7 +2391,7 @@ }, { "cell_type": "markdown", - "id": "a7805552", + "id": "a71f1366", "metadata": { "editable": true }, @@ -2401,7 +2403,7 @@ }, { "cell_type": "markdown", - "id": "34e38390", + "id": "25efb288", "metadata": { "editable": true }, @@ -2413,7 +2415,7 @@ }, { "cell_type": "markdown", - "id": "c45bbfea", + "id": "6192694f", "metadata": { "editable": true }, @@ -2423,7 +2425,7 @@ }, { "cell_type": "markdown", - "id": "0044549e", + "id": "f6786106", "metadata": { "editable": true }, @@ -2435,7 +2437,7 @@ }, { "cell_type": "markdown", - "id": "3f04f1e0", + "id": "be663cac", "metadata": { "editable": true }, @@ -2445,7 +2447,7 @@ }, { "cell_type": "markdown", - "id": "1f709d3a", + "id": "a6953973", "metadata": { "editable": true }, @@ -2457,7 +2459,7 @@ }, { "cell_type": "markdown", - "id": "ea67fd3c", + "id": "de08816b", "metadata": { "editable": true }, @@ -2470,7 +2472,7 @@ }, { "cell_type": "markdown", - "id": "ef34e350", + "id": "d9b14b33", "metadata": { "editable": true }, @@ -2482,7 +2484,7 @@ }, { "cell_type": "markdown", - "id": "6ee1c370", + "id": "8072c452", "metadata": { "editable": true }, @@ -2492,7 +2494,7 @@ }, { "cell_type": "markdown", - "id": "70256a66", + "id": "34a5cb25", "metadata": { "editable": true }, @@ -2504,7 +2506,7 @@ }, { "cell_type": "markdown", - "id": "c12d5e8c", + "id": "833dc972", "metadata": { "editable": true }, @@ -2515,7 +2517,7 @@ }, { "cell_type": "markdown", - "id": "1cecca24", + "id": "3c52b850", "metadata": { "editable": true }, @@ -2527,7 +2529,7 @@ }, { "cell_type": "markdown", - "id": "e67a0c5c", + "id": "01c24d99", "metadata": { "editable": true }, @@ -2537,7 +2539,7 @@ }, { "cell_type": "markdown", - "id": "4f99fcf2", + "id": "692fbd5a", "metadata": { "editable": true }, @@ -2549,7 +2551,7 @@ }, { "cell_type": "markdown", - "id": "01baf6b9", + "id": "cdd8c203", "metadata": { "editable": true }, @@ -2559,7 +2561,7 @@ }, { "cell_type": "markdown", - "id": "5f97ef72", + "id": "1e7eba9c", "metadata": { "editable": true }, @@ -2570,7 +2572,7 @@ }, { "cell_type": "markdown", - "id": "2449e89f", + "id": "8ca62ded", "metadata": { "editable": true }, @@ -2583,7 +2585,7 @@ }, { "cell_type": "markdown", - "id": "ffbe52a9", + "id": "479d6d33", "metadata": { "editable": true }, @@ -2593,7 +2595,7 @@ }, { "cell_type": "markdown", - "id": "fa5d8f6f", + "id": "3a63ba14", "metadata": { "editable": true }, @@ -2605,7 +2607,7 @@ }, { "cell_type": "markdown", - "id": "f3a84584", + "id": "bed10528", "metadata": { "editable": true }, @@ -2615,7 +2617,7 @@ }, { "cell_type": "markdown", - "id": "9181d14a", + "id": "6a77ac39", "metadata": { "editable": true }, @@ -2627,7 +2629,7 @@ }, { "cell_type": "markdown", - "id": "c1b5e9c6", + "id": "7fd16de8", "metadata": { "editable": true }, @@ -2637,7 +2639,7 @@ }, { "cell_type": "markdown", - "id": "518618df", + "id": "a598757e", "metadata": { "editable": true }, @@ -2661,7 +2663,7 @@ }, { "cell_type": "markdown", - "id": "dd9849be", + "id": "0dc69031", "metadata": { "editable": true }, @@ -2711,7 +2713,7 @@ { "cell_type": "code", "execution_count": 5, - "id": "6589864f", + "id": "d7c49d9c", "metadata": { "collapsed": false, "editable": true @@ -2764,7 +2766,7 @@ }, { "cell_type": "markdown", - "id": "4d774335", + "id": "672723bb", "metadata": { "editable": true }, @@ -2785,7 +2787,7 @@ { "cell_type": "code", "execution_count": 6, - "id": "f023f65a", + "id": "3b0db869", "metadata": { "collapsed": false, "editable": true @@ -2823,7 +2825,7 @@ }, { "cell_type": "markdown", - "id": "c08defda", + "id": "a52c7acf", "metadata": { "editable": true }, @@ -2867,7 +2869,7 @@ }, { "cell_type": "markdown", - "id": "fe343ab1", + "id": "f1ef08f4", "metadata": { "editable": true }, @@ -2907,7 +2909,7 @@ }, { "cell_type": "markdown", - "id": "3a09f23d", + "id": "867b3b89", "metadata": { "editable": true }, @@ -2928,7 +2930,7 @@ { "cell_type": "code", "execution_count": 7, - "id": "f79fcfb5", + "id": "8ec462da", "metadata": { "collapsed": false, "editable": true @@ -2954,7 +2956,7 @@ }, { "cell_type": "markdown", - "id": "d193fb0f", + "id": "cf228009", "metadata": { "editable": true }, @@ -2982,7 +2984,7 @@ }, { "cell_type": "markdown", - "id": "4839004d", + "id": "c57ea8b9", "metadata": { "editable": true }, @@ -3019,7 +3021,7 @@ { "cell_type": "code", "execution_count": 8, - "id": "a25e1447", + "id": "9c286c15", "metadata": { "collapsed": false, "editable": true @@ -3065,7 +3067,7 @@ }, { "cell_type": "markdown", - "id": "21a8a7ca", + "id": "a6cf75c3", "metadata": { "editable": true }, @@ -3096,7 +3098,7 @@ }, { "cell_type": "markdown", - "id": "4f61ae98", + "id": "e69ffdc8", "metadata": { "editable": true }, @@ -3134,7 +3136,7 @@ }, { "cell_type": "markdown", - "id": "16aea86f", + "id": "ef19d1e0", "metadata": { "editable": true }, @@ -3168,7 +3170,7 @@ }, { "cell_type": "markdown", - "id": "3813fe67", + "id": "d93c5dfb", "metadata": { "editable": true }, @@ -3209,7 +3211,7 @@ { "cell_type": "code", "execution_count": 9, - "id": "363b5c60", + "id": "0a62b82a", "metadata": { "collapsed": false, "editable": true @@ -3288,7 +3290,7 @@ }, { "cell_type": "markdown", - "id": "386b7ffa", + "id": "b666f091", "metadata": { "editable": true }, @@ -3309,7 +3311,7 @@ }, { "cell_type": "markdown", - "id": "b2a3c690", + "id": "79055893", "metadata": { "editable": true }, @@ -3323,7 +3325,7 @@ { "cell_type": "code", "execution_count": 10, - "id": "1a6415ed", + "id": "85af4a1c", "metadata": { "collapsed": false, "editable": true @@ -3433,7 +3435,7 @@ }, { "cell_type": "markdown", - "id": "88011cdc", + "id": "d0ef37e8", "metadata": { "editable": true }, @@ -3452,7 +3454,7 @@ { "cell_type": "code", "execution_count": 11, - "id": "e8222862", + "id": "d2891643", "metadata": { "collapsed": false, "editable": true @@ -3479,7 +3481,7 @@ }, { "cell_type": "markdown", - "id": "b1e2e538", + "id": "5c91c8fc", "metadata": { "editable": true }, @@ -3493,7 +3495,7 @@ { "cell_type": "code", "execution_count": 12, - "id": "80b01b3a", + "id": "c245d23d", "metadata": { "collapsed": false, "editable": true @@ -3524,7 +3526,7 @@ }, { "cell_type": "markdown", - "id": "b376cce8", + "id": "ea3be61a", "metadata": { "editable": true }, @@ -3535,7 +3537,7 @@ { "cell_type": "code", "execution_count": 13, - "id": "a8195066", + "id": "d26e1748", "metadata": { "collapsed": false, "editable": true @@ -3579,7 +3581,7 @@ }, { "cell_type": "markdown", - "id": "836934f9", + "id": "572f3f4b", "metadata": { "editable": true }, @@ -3602,7 +3604,7 @@ { "cell_type": "code", "execution_count": 14, - "id": "6d537674", + "id": "fdb38053", "metadata": { "collapsed": false, "editable": true @@ -3629,7 +3631,7 @@ }, { "cell_type": "markdown", - "id": "4e6fd391", + "id": "5fc3dd13", "metadata": { "editable": true }, @@ -3640,7 +3642,7 @@ { "cell_type": "code", "execution_count": 15, - "id": "8760d8af", + "id": "cd9e4505", "metadata": { "collapsed": false, "editable": true @@ -3685,7 +3687,7 @@ }, { "cell_type": "markdown", - "id": "36c08f07", + "id": "30d61094", "metadata": { "editable": true }, @@ -3712,7 +3714,7 @@ }, { "cell_type": "markdown", - "id": "8ed8a9d1", + "id": "9b4cd63f", "metadata": { "editable": true }, @@ -3750,7 +3752,7 @@ }, { "cell_type": "markdown", - "id": "58af02d9", + "id": "1a2bd6f1", "metadata": { "editable": true }, @@ -3762,7 +3764,7 @@ }, { "cell_type": "markdown", - "id": "669b626a", + "id": "a569e669", "metadata": { "editable": true }, @@ -3777,7 +3779,7 @@ }, { "cell_type": "markdown", - "id": "58f23d44", + "id": "51363b82", "metadata": { "editable": true }, @@ -3787,7 +3789,7 @@ }, { "cell_type": "markdown", - "id": "0e16989f", + "id": "e4172d21", "metadata": { "editable": true }, @@ -3800,7 +3802,7 @@ { "cell_type": "code", "execution_count": 16, - "id": "62970cc9", + "id": "b8640651", "metadata": { "collapsed": false, "editable": true @@ -3876,7 +3878,7 @@ }, { "cell_type": "markdown", - "id": "a187ce27", + "id": "f6b2c036", "metadata": { "editable": true }, @@ -3886,7 +3888,7 @@ }, { "cell_type": "markdown", - "id": "7e5cc157", + "id": "49fdf701", "metadata": { "editable": true }, @@ -3897,7 +3899,7 @@ { "cell_type": "code", "execution_count": 17, - "id": "2f28ce5f", + "id": "45dae979", "metadata": { "collapsed": false, "editable": true diff --git a/doc/src/week41/week41.do.txt b/doc/src/week41/week41.do.txt index 40591b038..1be02d626 100644 --- a/doc/src/week41/week41.do.txt +++ b/doc/src/week41/week41.do.txt @@ -8,19 +8,20 @@ DATE: Week 41 !split ===== Material for the lecture on Monday October 7, 2024 ===== -* Neural Networks, setting up the basic steps, from the simple perceptron model to the multi-layer perceptron model. -* Building our own Feed-forward Neural Network +o Neural Networks, setting up the basic steps, from the simple perceptron model to the multi-layer perceptron model. +o Building our own Feed-forward Neural Network # * "Video of lecture notes":"https://youtu.be/5-RRTO9uDvI" # * "Whiteboard notes":"https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2024/NotesOctober7.pdf" -* Readings and Videos: - * These lecture notes - * For neural networks we recommend Goodfellow et al chapter 6. - * "Neural Networks demystified":"https://www.youtube.com/watch?v=bxe2T-V8XRs&list=PLiaHhY2iBX9hdHaRr6b7XevZtgZRa1PoU&ab_channel=WelchLabs" - * "Building Neural Networks from scratch":"https://www.youtube.com/watch?v=Wo5dMEP_BbI&list=PLQVvvaa0QuDcjD5BAw2DxE6OF2tius3V3&ab_channel=sentdex" - * "Video on Neural Networks":"https://www.youtube.com/watch?v=CqOfi41LfDw" - * "Video on the back propagation algorithm":"https://www.youtube.com/watch?v=Ilg3gGewQ5U" -I also recommend Michael Nielsen's intuitive approach to the neural networks and the universal approximation theorem, see the slides at URL:"http://neuralnetworksanddeeplearning.com/chap4.html". - +!bblock Readings and Videos: + o These lecture notes + o Rashcka et al chapter 11 + o For neural networks we recommend Goodfellow et al chapter 6. + o Neural Networks demystified at URL:"https://www.youtube.com/watch?v=bxe2T-V8XRs&list=PLiaHhY2iBX9hdHaRr6b7XevZtgZRa1PoU&ab_channel=WelchLabs" + o Building Neural Networks from scratch at URL:"https://www.youtube.com/watch?v=Wo5dMEP_BbI&list=PLQVvvaa0QuDcjD5BAw2DxE6OF2tius3V3&ab_channel=sentdex" + o Video on Neural Networks at URL:"https://www.youtube.com/watch?v=CqOfi41LfDw" + o Video on the back propagation algorithm at URL:"https://www.youtube.com/watch?v=Ilg3gGewQ5U" +We also recommend Michael Nielsen's intuitive approach to the neural networks and the universal approximation theorem, see the slides at URL:"http://neuralnetworksanddeeplearning.com/chap4.html". +!eblock !split