diff --git a/doc/pub/week40/html/._week40-bs003.html b/doc/pub/week40/html/._week40-bs003.html index 1b6c408d7..c93b19017 100644 --- a/doc/pub/week40/html/._week40-bs003.html +++ b/doc/pub/week40/html/._week40-bs003.html @@ -369,7 +369,7 @@ MathJax.Hub.Config({
  1. The lecture notes for week 40 (these notes)
  2. For a good discussion on gradient methods, we would like to recommend Goodfellow et al section 4.3-4.5 and sections 8.3-8.6. We will come back to the latter chapter in our discussion of Neural networks as well.
    3. -
  3. For neural networks we recommend Goodfellow et al chapter 6 and Raschka et al pages 48-60
    4. +
  4. For neural networks we recommend Goodfellow et al chapter 6 and Raschka et al chapter 2 (contains also material about gradient descent) and chapter 11 (we will use this next week)
  5. Video on gradient descent at https://www.youtube.com/watch?v=sDv4f4s2SB8
  6. Video on stochastic gradient descent at https://www.youtube.com/watch?v=vMh0zPT0tLI
  7. Neural Networks demystified at https://www.youtube.com/watch?v=bxe2T-V8XRs&list=PLiaHhY2iBX9hdHaRr6b7XevZtgZRa1PoU&ab_channel=WelchLabs
    8. diff --git a/doc/pub/week40/html/week40-reveal.html b/doc/pub/week40/html/week40-reveal.html index 8f6b65a11..e071e82b3 100644 --- a/doc/pub/week40/html/week40-reveal.html +++ b/doc/pub/week40/html/week40-reveal.html @@ -223,7 +223,7 @@ MathJax.Hub.Config({

  8. For a good discussion on gradient methods, we would like to recommend Goodfellow et al section 4.3-4.5 and sections 8.3-8.6. We will come back to the latter chapter in our discussion of Neural networks as well.
    9. -

  9. For neural networks we recommend Goodfellow et al chapter 6 and Raschka et al pages 48-60
    10. +

  10. For neural networks we recommend Goodfellow et al chapter 6 and Raschka et al chapter 2 (contains also material about gradient descent) and chapter 11 (we will use this next week)

  11. Video on gradient descent at https://www.youtube.com/watch?v=sDv4f4s2SB8
    12. diff --git a/doc/pub/week40/html/week40-solarized.html b/doc/pub/week40/html/week40-solarized.html index c35a18465..df4127fb1 100644 --- a/doc/pub/week40/html/week40-solarized.html +++ b/doc/pub/week40/html/week40-solarized.html @@ -335,7 +335,7 @@ MathJax.Hub.Config({
    1. The lecture notes for week 40 (these notes)
    2. For a good discussion on gradient methods, we would like to recommend Goodfellow et al section 4.3-4.5 and sections 8.3-8.6. We will come back to the latter chapter in our discussion of Neural networks as well.
      3. -
    3. For neural networks we recommend Goodfellow et al chapter 6 and Raschka et al pages 48-60
      4. +
    4. For neural networks we recommend Goodfellow et al chapter 6 and Raschka et al chapter 2 (contains also material about gradient descent) and chapter 11 (we will use this next week)
    5. Video on gradient descent at https://www.youtube.com/watch?v=sDv4f4s2SB8
    6. Video on stochastic gradient descent at https://www.youtube.com/watch?v=vMh0zPT0tLI
    7. Neural Networks demystified at https://www.youtube.com/watch?v=bxe2T-V8XRs&list=PLiaHhY2iBX9hdHaRr6b7XevZtgZRa1PoU&ab_channel=WelchLabs
      8. diff --git a/doc/pub/week40/html/week40.html b/doc/pub/week40/html/week40.html index 198b8eb9f..e72c11ae0 100644 --- a/doc/pub/week40/html/week40.html +++ b/doc/pub/week40/html/week40.html @@ -412,7 +412,7 @@ MathJax.Hub.Config({
      1. The lecture notes for week 40 (these notes)
      2. For a good discussion on gradient methods, we would like to recommend Goodfellow et al section 4.3-4.5 and sections 8.3-8.6. We will come back to the latter chapter in our discussion of Neural networks as well.
        3. -
      3. For neural networks we recommend Goodfellow et al chapter 6 and Raschka et al pages 48-60
        4. +
      4. For neural networks we recommend Goodfellow et al chapter 6 and Raschka et al chapter 2 (contains also material about gradient descent) and chapter 11 (we will use this next week)
      5. Video on gradient descent at https://www.youtube.com/watch?v=sDv4f4s2SB8
      6. Video on stochastic gradient descent at https://www.youtube.com/watch?v=vMh0zPT0tLI
      7. Neural Networks demystified at https://www.youtube.com/watch?v=bxe2T-V8XRs&list=PLiaHhY2iBX9hdHaRr6b7XevZtgZRa1PoU&ab_channel=WelchLabs
        8. diff --git a/doc/pub/week40/ipynb/ipynb-week40-src.tar.gz b/doc/pub/week40/ipynb/ipynb-week40-src.tar.gz index b39745f03..648f68866 100644 Binary files a/doc/pub/week40/ipynb/ipynb-week40-src.tar.gz and b/doc/pub/week40/ipynb/ipynb-week40-src.tar.gz differ diff --git a/doc/pub/week40/ipynb/week40.ipynb b/doc/pub/week40/ipynb/week40.ipynb index 75131329b..cf0d66003 100644 --- a/doc/pub/week40/ipynb/week40.ipynb +++ b/doc/pub/week40/ipynb/week40.ipynb @@ -2,7 +2,7 @@ "cells": [ { "cell_type": "markdown", - "id": "40a3b8b1", + "id": "4687f345", "metadata": { "editable": true }, @@ -14,7 +14,7 @@ }, { "cell_type": "markdown", - "id": "4cd886cf", + "id": "3da2749d", "metadata": { "editable": true }, @@ -27,7 +27,7 @@ }, { "cell_type": "markdown", - "id": "6f2ab2a9", + "id": "55819acc", "metadata": { "editable": true }, @@ -37,7 +37,7 @@ }, { "cell_type": "markdown", - "id": "d049440d", + "id": "e1252272", "metadata": { "editable": true }, @@ -52,7 +52,7 @@ }, { "cell_type": "markdown", - "id": "af6c016b", + "id": "5684fcf4", "metadata": { "editable": true }, @@ -64,7 +64,7 @@ "\n", "2. For a good discussion on gradient methods, we would like to recommend Goodfellow et al section 4.3-4.5 and sections 8.3-8.6. We will come back to the latter chapter in our discussion of Neural networks as well.\n", "\n", - "3. For neural networks we recommend Goodfellow et al chapter 6 and Raschka et al pages 48-60\n", + "3. For neural networks we recommend Goodfellow et al chapter 6 and Raschka et al chapter 2 (contains also material about gradient descent) and chapter 11 (we will use this next week)\n", "\n", "4. Video on gradient descent at \n", "\n", @@ -77,7 +77,7 @@ }, { "cell_type": "markdown", - "id": "bd5dfaab", + "id": "db5aaeaa", "metadata": { "editable": true }, @@ -96,7 +96,7 @@ }, { "cell_type": "markdown", - "id": "c556c3f8", + "id": "358e1ba3", "metadata": { "editable": true }, @@ -118,7 +118,7 @@ }, { "cell_type": "markdown", - "id": "ca435671", + "id": "5f980026", "metadata": { "editable": true }, @@ -132,7 +132,7 @@ { "cell_type": "code", "execution_count": 1, - "id": "bd8a175e", + "id": "1e1a0f93", "metadata": { "collapsed": false, "editable": true @@ -186,7 +186,7 @@ }, { "cell_type": "markdown", - "id": "4aa33b8f", + "id": "fa35be2d", "metadata": { "editable": true }, @@ -199,7 +199,7 @@ { "cell_type": "code", "execution_count": 2, - "id": "1d26ef60", + "id": "a07b46f9", "metadata": { "collapsed": false, "editable": true @@ -243,7 +243,7 @@ }, { "cell_type": "markdown", - "id": "dfc92966", + "id": "ad8a1ec1", "metadata": { "editable": true }, @@ -258,7 +258,7 @@ { "cell_type": "code", "execution_count": 3, - "id": "39c8011b", + "id": "442155a9", "metadata": { "collapsed": false, "editable": true @@ -300,7 +300,7 @@ }, { "cell_type": "markdown", - "id": "4b5aea10", + "id": "6906a7b0", "metadata": { "editable": true }, @@ -319,7 +319,7 @@ }, { "cell_type": "markdown", - "id": "a102ff7a", + "id": "0d1b86f0", "metadata": { "editable": true }, @@ -340,7 +340,7 @@ }, { "cell_type": "markdown", - "id": "634be3be", + "id": "de264c3b", "metadata": { "editable": true }, @@ -372,7 +372,7 @@ }, { "cell_type": "markdown", - "id": "e87a0b66", + "id": "89be850a", "metadata": { "editable": true }, @@ -389,7 +389,7 @@ }, { "cell_type": "markdown", - "id": "5e979927", + "id": "97f3f2d2", "metadata": { "editable": true }, @@ -402,7 +402,7 @@ }, { "cell_type": "markdown", - "id": "7f087cfe", + "id": "c5756174", "metadata": { "editable": true }, @@ -415,7 +415,7 @@ }, { "cell_type": "markdown", - "id": "e739c280", + "id": "9491611c", "metadata": { "editable": true }, @@ -428,7 +428,7 @@ }, { "cell_type": "markdown", - "id": "6c1491c2", + "id": "c5aa3260", "metadata": { "editable": true }, @@ -442,7 +442,7 @@ }, { "cell_type": "markdown", - "id": "9fcf7b71", + "id": "14db2504", "metadata": { "editable": true }, @@ -464,7 +464,7 @@ }, { "cell_type": "markdown", - "id": "5c52ab78", + "id": "7246951f", "metadata": { "editable": true }, @@ -479,7 +479,7 @@ }, { "cell_type": "markdown", - "id": "dfaffffe", + "id": "1662a436", "metadata": { "editable": true }, @@ -491,7 +491,7 @@ }, { "cell_type": "markdown", - "id": "6ccdb1c1", + "id": "af377a66", "metadata": { "editable": true }, @@ -504,7 +504,7 @@ }, { "cell_type": "markdown", - "id": "118c2e10", + "id": "87fd2445", "metadata": { "editable": true }, @@ -518,7 +518,7 @@ }, { "cell_type": "markdown", - "id": "f64773bc", + "id": "e962547b", "metadata": { "editable": true }, @@ -529,7 +529,7 @@ { "cell_type": "code", "execution_count": 4, - "id": "e1fe59b7", + "id": "53e4501a", "metadata": { "collapsed": false, "editable": true @@ -554,7 +554,7 @@ }, { "cell_type": "markdown", - "id": "4f942e91", + "id": "46109bad", "metadata": { "editable": true }, @@ -570,7 +570,7 @@ }, { "cell_type": "markdown", - "id": "c637c3fe", + "id": "539812ca", "metadata": { "editable": true }, @@ -591,7 +591,7 @@ }, { "cell_type": "markdown", - "id": "8d49866f", + "id": "bdfb3ce0", "metadata": { "editable": true }, @@ -611,7 +611,7 @@ }, { "cell_type": "markdown", - "id": "45fef403", + "id": "93825012", "metadata": { "editable": true }, @@ -630,7 +630,7 @@ { "cell_type": "code", "execution_count": 5, - "id": "984b3833", + "id": "17635e19", "metadata": { "collapsed": false, "editable": true @@ -665,7 +665,7 @@ }, { "cell_type": "markdown", - "id": "7ce3c15a", + "id": "e9af4782", "metadata": { "editable": true }, @@ -678,7 +678,7 @@ { "cell_type": "code", "execution_count": 6, - "id": "5214d90b", + "id": "a21b3bf0", "metadata": { "collapsed": false, "editable": true @@ -757,7 +757,7 @@ }, { "cell_type": "markdown", - "id": "9b65386d", + "id": "5649ec2a", "metadata": { "editable": true }, @@ -772,7 +772,7 @@ }, { "cell_type": "markdown", - "id": "0421a331", + "id": "302f4f77", "metadata": { "editable": true }, @@ -787,7 +787,7 @@ }, { "cell_type": "markdown", - "id": "902cbf26", + "id": "0c094b0b", "metadata": { "editable": true }, @@ -799,7 +799,7 @@ }, { "cell_type": "markdown", - "id": "59b3aafa", + "id": "750579fd", "metadata": { "editable": true }, @@ -817,7 +817,7 @@ }, { "cell_type": "markdown", - "id": "d8f49a06", + "id": "1d55fdab", "metadata": { "editable": true }, @@ -836,7 +836,7 @@ }, { "cell_type": "markdown", - "id": "862fbb87", + "id": "c78ccbf6", "metadata": { "editable": true }, @@ -848,7 +848,7 @@ }, { "cell_type": "markdown", - "id": "0be675d8", + "id": "73bf75c1", "metadata": { "editable": true }, @@ -858,7 +858,7 @@ }, { "cell_type": "markdown", - "id": "9441cba2", + "id": "24406ec7", "metadata": { "editable": true }, @@ -874,7 +874,7 @@ }, { "cell_type": "markdown", - "id": "4d1e8de7", + "id": "ff0a7cdb", "metadata": { "editable": true }, @@ -886,7 +886,7 @@ }, { "cell_type": "markdown", - "id": "304dfeb4", + "id": "5881f048", "metadata": { "editable": true }, @@ -896,7 +896,7 @@ }, { "cell_type": "markdown", - "id": "622e15cb", + "id": "ceb5d976", "metadata": { "editable": true }, @@ -908,7 +908,7 @@ }, { "cell_type": "markdown", - "id": "51f4ab39", + "id": "4e997304", "metadata": { "editable": true }, @@ -918,7 +918,7 @@ }, { "cell_type": "markdown", - "id": "c0d6c4c5", + "id": "db031583", "metadata": { "editable": true }, @@ -930,7 +930,7 @@ }, { "cell_type": "markdown", - "id": "56ea0914", + "id": "cf54750e", "metadata": { "editable": true }, @@ -946,7 +946,7 @@ }, { "cell_type": "markdown", - "id": "9b490bda", + "id": "6424326d", "metadata": { "editable": true }, @@ -958,7 +958,7 @@ }, { "cell_type": "markdown", - "id": "7f030575", + "id": "4c52261d", "metadata": { "editable": true }, @@ -991,7 +991,7 @@ }, { "cell_type": "markdown", - "id": "e25e45e6", + "id": "e6351f61", "metadata": { "editable": true }, @@ -1003,7 +1003,7 @@ }, { "cell_type": "markdown", - "id": "e60ffae2", + "id": "c0feb3d3", "metadata": { "editable": true }, @@ -1021,7 +1021,7 @@ }, { "cell_type": "markdown", - "id": "4ebf6cfc", + "id": "932dfc89", "metadata": { "editable": true }, @@ -1031,7 +1031,7 @@ }, { "cell_type": "markdown", - "id": "1b54260c", + "id": "d403c5d0", "metadata": { "editable": true }, @@ -1062,7 +1062,7 @@ }, { "cell_type": "markdown", - "id": "96535e86", + "id": "3ecb97e6", "metadata": { "editable": true }, @@ -1077,7 +1077,7 @@ }, { "cell_type": "markdown", - "id": "332667fe", + "id": "fabedf61", "metadata": { "editable": true }, @@ -1095,7 +1095,7 @@ }, { "cell_type": "markdown", - "id": "4394115d", + "id": "e0a1b163", "metadata": { "editable": true }, @@ -1107,7 +1107,7 @@ }, { "cell_type": "markdown", - "id": "1f8dda26", + "id": "60639b97", "metadata": { "editable": true }, @@ -1119,7 +1119,7 @@ }, { "cell_type": "markdown", - "id": "28204ca7", + "id": "f3af4ae4", "metadata": { "editable": true }, @@ -1137,7 +1137,7 @@ }, { "cell_type": "markdown", - "id": "04c35c15", + "id": "936f4678", "metadata": { "editable": true }, @@ -1166,7 +1166,7 @@ }, { "cell_type": "markdown", - "id": "527eff80", + "id": "9614f73b", "metadata": { "editable": true }, @@ -1184,7 +1184,7 @@ }, { "cell_type": "markdown", - "id": "0f276c1c", + "id": "2440882c", "metadata": { "editable": true }, @@ -1196,7 +1196,7 @@ }, { "cell_type": "markdown", - "id": "e0727d8f", + "id": "a585a1e4", "metadata": { "editable": true }, @@ -1208,7 +1208,7 @@ }, { "cell_type": "markdown", - "id": "e1ce4ed6", + "id": "c6a8e863", "metadata": { "editable": true }, @@ -1220,7 +1220,7 @@ }, { "cell_type": "markdown", - "id": "b7feb436", + "id": "1978dbb2", "metadata": { "editable": true }, @@ -1232,7 +1232,7 @@ }, { "cell_type": "markdown", - "id": "898a5066", + "id": "0b153be5", "metadata": { "editable": true }, @@ -1244,7 +1244,7 @@ }, { "cell_type": "markdown", - "id": "709f0071", + "id": "2659e6e6", "metadata": { "editable": true }, @@ -1261,7 +1261,7 @@ }, { "cell_type": "markdown", - "id": "ea231cc8", + "id": "fe39f4bd", "metadata": { "editable": true }, @@ -1280,7 +1280,7 @@ }, { "cell_type": "markdown", - "id": "3f618548", + "id": "45c3b53e", "metadata": { "editable": true }, @@ -1292,7 +1292,7 @@ }, { "cell_type": "markdown", - "id": "7256c5b6", + "id": "0e1d1ab6", "metadata": { "editable": true }, @@ -1306,7 +1306,7 @@ }, { "cell_type": "markdown", - "id": "12802eb3", + "id": "650e1cd6", "metadata": { "editable": true }, @@ -1322,7 +1322,7 @@ }, { "cell_type": "markdown", - "id": "6d31f6ec", + "id": "36fcf928", "metadata": { "editable": true }, @@ -1338,7 +1338,7 @@ }, { "cell_type": "markdown", - "id": "50d1083c", + "id": "f68ae4d9", "metadata": { "editable": true }, @@ -1354,7 +1354,7 @@ }, { "cell_type": "markdown", - "id": "38299019", + "id": "8eb914ed", "metadata": { "editable": true }, @@ -1374,7 +1374,7 @@ }, { "cell_type": "markdown", - "id": "a8a8ea9c", + "id": "5e2981dc", "metadata": { "editable": true }, @@ -1412,7 +1412,7 @@ }, { "cell_type": "markdown", - "id": "ec3e3541", + "id": "b81eabd7", "metadata": { "editable": true }, @@ -1424,7 +1424,7 @@ }, { "cell_type": "markdown", - "id": "07ef031f", + "id": "664845f7", "metadata": { "editable": true }, @@ -1434,7 +1434,7 @@ }, { "cell_type": "markdown", - "id": "8d3836ea", + "id": "a2a77f69", "metadata": { "editable": true }, @@ -1446,7 +1446,7 @@ }, { "cell_type": "markdown", - "id": "4b2473d1", + "id": "34f3786a", "metadata": { "editable": true }, @@ -1457,7 +1457,7 @@ { "cell_type": "code", "execution_count": 7, - "id": "569f9232", + "id": "6f76195d", "metadata": { "collapsed": false, "editable": true @@ -1502,7 +1502,7 @@ }, { "cell_type": "markdown", - "id": "f7dd1a65", + "id": "d2d23a0d", "metadata": { "editable": true }, @@ -1519,7 +1519,7 @@ { "cell_type": "code", "execution_count": 8, - "id": "f7c641e3", + "id": "c51dc30f", "metadata": { "collapsed": false, "editable": true @@ -1547,7 +1547,7 @@ }, { "cell_type": "markdown", - "id": "3bab49cc", + "id": "c0b62f5e", "metadata": { "editable": true }, @@ -1562,7 +1562,7 @@ { "cell_type": "code", "execution_count": 9, - "id": "815a8c13", + "id": "52904dfe", "metadata": { "collapsed": false, "editable": true @@ -1606,7 +1606,7 @@ }, { "cell_type": "markdown", - "id": "15b683ec", + "id": "86e0ebe1", "metadata": { "editable": true }, @@ -1616,7 +1616,7 @@ }, { "cell_type": "markdown", - "id": "89eaabc0", + "id": "634ceac6", "metadata": { "editable": true }, @@ -1627,7 +1627,7 @@ { "cell_type": "code", "execution_count": 10, - "id": "1976e1dd", + "id": "2bea8a29", "metadata": { "collapsed": false, "editable": true @@ -1655,7 +1655,7 @@ }, { "cell_type": "markdown", - "id": "5aaaee25", + "id": "6275cbc4", "metadata": { "editable": true }, @@ -1670,7 +1670,7 @@ }, { "cell_type": "markdown", - "id": "ec765425", + "id": "0068cd3c", "metadata": { "editable": true }, @@ -1681,7 +1681,7 @@ { "cell_type": "code", "execution_count": 11, - "id": "efdbaffd", + "id": "efa2537a", "metadata": { "collapsed": false, "editable": true @@ -1709,7 +1709,7 @@ }, { "cell_type": "markdown", - "id": "4b8973ec", + "id": "0e26d1c9", "metadata": { "editable": true }, @@ -1720,7 +1720,7 @@ { "cell_type": "code", "execution_count": 12, - "id": "16f1f586", + "id": "a5630d31", "metadata": { "collapsed": false, "editable": true @@ -1745,7 +1745,7 @@ }, { "cell_type": "markdown", - "id": "e4b04c83", + "id": "b110f814", "metadata": { "editable": true }, @@ -1756,7 +1756,7 @@ { "cell_type": "code", "execution_count": 13, - "id": "2275cb9b", + "id": "a6ebc226", "metadata": { "collapsed": false, "editable": true @@ -1792,7 +1792,7 @@ { "cell_type": "code", "execution_count": 14, - "id": "65e89c7d", + "id": "c38d8cd5", "metadata": { "collapsed": false, "editable": true @@ -1812,7 +1812,7 @@ }, { "cell_type": "markdown", - "id": "70d7b3eb", + "id": "a85b9833", "metadata": { "editable": true }, @@ -1823,7 +1823,7 @@ { "cell_type": "code", "execution_count": 15, - "id": "d18f567e", + "id": "cc00d05b", "metadata": { "collapsed": false, "editable": true @@ -1861,7 +1861,7 @@ }, { "cell_type": "markdown", - "id": "37c337b5", + "id": "2b8de443", "metadata": { "editable": true }, @@ -1871,7 +1871,7 @@ }, { "cell_type": "markdown", - "id": "7af2ea16", + "id": "7cd545c2", "metadata": { "editable": true }, @@ -1886,7 +1886,7 @@ { "cell_type": "code", "execution_count": 16, - "id": "f0599e66", + "id": "4bd975ee", "metadata": { "collapsed": false, "editable": true @@ -1946,7 +1946,7 @@ }, { "cell_type": "markdown", - "id": "302b992d", + "id": "f442d7c8", "metadata": { "editable": true }, @@ -1957,7 +1957,7 @@ { "cell_type": "code", "execution_count": 17, - "id": "1ac42108", + "id": "26b37007", "metadata": { "collapsed": false, "editable": true @@ -2021,7 +2021,7 @@ }, { "cell_type": "markdown", - "id": "2b602738", + "id": "acb26c62", "metadata": { "editable": true }, @@ -2033,7 +2033,7 @@ { "cell_type": "code", "execution_count": 18, - "id": "438066e5", + "id": "9d6704a9", "metadata": { "collapsed": false, "editable": true @@ -2117,7 +2117,7 @@ }, { "cell_type": "markdown", - "id": "f45229be", + "id": "dd2d9f35", "metadata": { "editable": true }, @@ -2128,7 +2128,7 @@ { "cell_type": "code", "execution_count": 19, - "id": "93bd562f", + "id": "85731b81", "metadata": { "collapsed": false, "editable": true @@ -2206,7 +2206,7 @@ }, { "cell_type": "markdown", - "id": "80071a5b", + "id": "99fcedcf", "metadata": { "editable": true }, @@ -2217,7 +2217,7 @@ { "cell_type": "code", "execution_count": 20, - "id": "f4dead7b", + "id": "1bbef9b5", "metadata": { "collapsed": false, "editable": true @@ -2276,7 +2276,7 @@ }, { "cell_type": "markdown", - "id": "f96ec7cd", + "id": "6f14b9e9", "metadata": { "editable": true }, @@ -2286,7 +2286,7 @@ }, { "cell_type": "markdown", - "id": "c2d47430", + "id": "420764bb", "metadata": { "editable": true }, @@ -2297,7 +2297,7 @@ { "cell_type": "code", "execution_count": 21, - "id": "773d70a9", + "id": "1ea8deac", "metadata": { "collapsed": false, "editable": true @@ -2362,7 +2362,7 @@ }, { "cell_type": "markdown", - "id": "0742af6b", + "id": "7476e8fa", "metadata": { "editable": true }, @@ -2373,7 +2373,7 @@ { "cell_type": "code", "execution_count": 22, - "id": "4d069ff2", + "id": "dd54ee0d", "metadata": { "collapsed": false, "editable": true @@ -2443,7 +2443,7 @@ }, { "cell_type": "markdown", - "id": "3815a9b8", + "id": "8bff90bf", "metadata": { "editable": true }, @@ -2454,7 +2454,7 @@ { "cell_type": "code", "execution_count": 23, - "id": "5b4a4da2", + "id": "4d6f38aa", "metadata": { "collapsed": false, "editable": true @@ -2498,7 +2498,7 @@ }, { "cell_type": "markdown", - "id": "9f0583be", + "id": "be009d46", "metadata": { "editable": true }, @@ -2514,7 +2514,7 @@ }, { "cell_type": "markdown", - "id": "cd4d32ea", + "id": "8c42305d", "metadata": { "editable": true }, @@ -2525,7 +2525,7 @@ { "cell_type": "code", "execution_count": 24, - "id": "393153ff", + "id": "ee92fe44", "metadata": { "collapsed": false, "editable": true @@ -2542,7 +2542,7 @@ }, { "cell_type": "markdown", - "id": "b46c6cf5", + "id": "7b2c5c5d", "metadata": { "editable": true }, @@ -2553,7 +2553,7 @@ { "cell_type": "code", "execution_count": 25, - "id": "c6f213c8", + "id": "a9f25005", "metadata": { "collapsed": false, "editable": true @@ -2598,7 +2598,7 @@ }, { "cell_type": "markdown", - "id": "416133b6", + "id": "6734e909", "metadata": { "editable": true }, @@ -2609,7 +2609,7 @@ { "cell_type": "code", "execution_count": 26, - "id": "2d85c484", + "id": "cc5b54ed", "metadata": { "collapsed": false, "editable": true @@ -2640,7 +2640,7 @@ }, { "cell_type": "markdown", - "id": "7367f636", + "id": "d0ff0a0e", "metadata": { "editable": true }, @@ -2658,7 +2658,7 @@ }, { "cell_type": "markdown", - "id": "2ba97c52", + "id": "624b7343", "metadata": { "editable": true }, @@ -2682,7 +2682,7 @@ }, { "cell_type": "markdown", - "id": "40b16ffe", + "id": "b6ab860b", "metadata": { "editable": true }, @@ -2700,7 +2700,7 @@ }, { "cell_type": "markdown", - "id": "13f6c18a", + "id": "fdab69ac", "metadata": { "editable": true }, @@ -2740,7 +2740,7 @@ }, { "cell_type": "markdown", - "id": "9cd26ac7", + "id": "6466c987", "metadata": { "editable": true }, @@ -2769,7 +2769,7 @@ }, { "cell_type": "markdown", - "id": "91a3bb34", + "id": "8a9c8edb", "metadata": { "editable": true }, @@ -2790,7 +2790,7 @@ }, { "cell_type": "markdown", - "id": "78626151", + "id": "ca6a908c", "metadata": { "editable": true }, @@ -2819,7 +2819,7 @@ }, { "cell_type": "markdown", - "id": "01e37306", + "id": "7f1f4f38", "metadata": { "editable": true }, @@ -2840,7 +2840,7 @@ }, { "cell_type": "markdown", - "id": "b950fc32", + "id": "ced07fa5", "metadata": { "editable": true }, @@ -2861,7 +2861,7 @@ }, { "cell_type": "markdown", - "id": "1eaf849a", + "id": "5421341a", "metadata": { "editable": true }, @@ -2878,7 +2878,7 @@ }, { "cell_type": "markdown", - "id": "ac28d174", + "id": "e5ae78f7", "metadata": { "editable": true }, @@ -2899,7 +2899,7 @@ }, { "cell_type": "markdown", - "id": "6d60aa06", + "id": "40adefcc", "metadata": { "editable": true }, @@ -2915,7 +2915,7 @@ }, { "cell_type": "markdown", - "id": "9e221e59", + "id": "31608ee5", "metadata": { "editable": true }, @@ -2932,7 +2932,7 @@ { "cell_type": "code", "execution_count": 27, - "id": "66786383", + "id": "0529c3e9", "metadata": { "collapsed": false, "editable": true @@ -2973,7 +2973,7 @@ }, { "cell_type": "markdown", - "id": "04814f2f", + "id": "844f16f8", "metadata": { "editable": true }, @@ -2983,7 +2983,7 @@ }, { "cell_type": "markdown", - "id": "14fd1ad1", + "id": "750cf959", "metadata": { "editable": true }, @@ -2994,7 +2994,7 @@ { "cell_type": "code", "execution_count": 28, - "id": "c3104ec8", + "id": "68870b7b", "metadata": { "collapsed": false, "editable": true @@ -3054,7 +3054,7 @@ }, { "cell_type": "markdown", - "id": "b8d4e336", + "id": "78424809", "metadata": { "editable": true }, @@ -3064,7 +3064,7 @@ }, { "cell_type": "markdown", - "id": "68933530", + "id": "51a551b4", "metadata": { "editable": true }, @@ -3075,7 +3075,7 @@ { "cell_type": "code", "execution_count": 29, - "id": "f6b849de", + "id": "390527c4", "metadata": { "collapsed": false, "editable": true @@ -3095,7 +3095,7 @@ }, { "cell_type": "markdown", - "id": "0356fca3", + "id": "3fc8196f", "metadata": { "editable": true }, @@ -3107,7 +3107,7 @@ }, { "cell_type": "markdown", - "id": "56c1d634", + "id": "f75b24d9", "metadata": { "editable": true }, @@ -3119,7 +3119,7 @@ }, { "cell_type": "markdown", - "id": "3e361bd2", + "id": "3a468c58", "metadata": { "editable": true }, @@ -3134,7 +3134,7 @@ }, { "cell_type": "markdown", - "id": "ae88d477", + "id": "bf8973da", "metadata": { "editable": true }, @@ -3146,7 +3146,7 @@ }, { "cell_type": "markdown", - "id": "7e830e4c", + "id": "5e0da5ad", "metadata": { "editable": true }, @@ -3163,7 +3163,7 @@ }, { "cell_type": "markdown", - "id": "ef8f0370", + "id": "64d27300", "metadata": { "editable": true }, @@ -3178,7 +3178,7 @@ }, { "cell_type": "markdown", - "id": "8a47b26e", + "id": "9e29b76e", "metadata": { "editable": true }, @@ -3196,7 +3196,7 @@ }, { "cell_type": "markdown", - "id": "5f90a1db", + "id": "b1da5364", "metadata": { "editable": true }, @@ -3208,7 +3208,7 @@ }, { "cell_type": "markdown", - "id": "ce05af67", + "id": "6ed696f9", "metadata": { "editable": true }, @@ -3226,7 +3226,7 @@ }, { "cell_type": "markdown", - "id": "02406090", + "id": "a4148a64", "metadata": { "editable": true }, @@ -3239,7 +3239,7 @@ }, { "cell_type": "markdown", - "id": "7d50188d", + "id": "da587faa", "metadata": { "editable": true }, @@ -3251,7 +3251,7 @@ }, { "cell_type": "markdown", - "id": "d0ded1af", + "id": "73eefe7b", "metadata": { "editable": true }, @@ -3269,7 +3269,7 @@ }, { "cell_type": "markdown", - "id": "f033b7ce", + "id": "9c00114f", "metadata": { "editable": true }, @@ -3287,7 +3287,7 @@ }, { "cell_type": "markdown", - "id": "30300c41", + "id": "5e51f9a8", "metadata": { "editable": true }, @@ -3297,7 +3297,7 @@ }, { "cell_type": "markdown", - "id": "336784b2", + "id": "f0e1bc9b", "metadata": { "editable": true }, @@ -3315,7 +3315,7 @@ }, { "cell_type": "markdown", - "id": "35a7b487", + "id": "992a154d", "metadata": { "editable": true }, @@ -3334,7 +3334,7 @@ }, { "cell_type": "markdown", - "id": "b326e744", + "id": "1ce03e37", "metadata": { "editable": true }, @@ -3347,7 +3347,7 @@ }, { "cell_type": "markdown", - "id": "cd3f8b40", + "id": "1d14ed5f", "metadata": { "editable": true }, @@ -3365,7 +3365,7 @@ }, { "cell_type": "markdown", - "id": "6b7f22ce", + "id": "5d4af831", "metadata": { "editable": true }, @@ -3376,7 +3376,7 @@ }, { "cell_type": "markdown", - "id": "0c92dfbf", + "id": "833c2044", "metadata": { "editable": true }, @@ -3395,7 +3395,7 @@ }, { "cell_type": "markdown", - "id": "f9d12b53", + "id": "1919c37b", "metadata": { "editable": true }, @@ -3413,7 +3413,7 @@ }, { "cell_type": "markdown", - "id": "29f85c5e", + "id": "034185ce", "metadata": { "editable": true }, @@ -3426,7 +3426,7 @@ }, { "cell_type": "markdown", - "id": "9d83e2a1", + "id": "36e298b2", "metadata": { "editable": true }, @@ -3446,7 +3446,7 @@ }, { "cell_type": "markdown", - "id": "8bd93580", + "id": "b8f05873", "metadata": { "editable": true }, @@ -3479,7 +3479,7 @@ }, { "cell_type": "markdown", - "id": "99876c91", + "id": "e7a6e970", "metadata": { "editable": true }, @@ -3491,7 +3491,7 @@ }, { "cell_type": "markdown", - "id": "35718ca0", + "id": "543db865", "metadata": { "editable": true }, @@ -3510,7 +3510,7 @@ }, { "cell_type": "markdown", - "id": "b37d2e34", + "id": "59d15e0e", "metadata": { "editable": true }, @@ -3524,7 +3524,7 @@ }, { "cell_type": "markdown", - "id": "2ab0c728", + "id": "ccf5313b", "metadata": { "editable": true }, @@ -3547,7 +3547,7 @@ }, { "cell_type": "markdown", - "id": "7e188d78", + "id": "4123228a", "metadata": { "editable": true }, @@ -3566,7 +3566,7 @@ }, { "cell_type": "markdown", - "id": "0076ade3", + "id": "a388e95b", "metadata": { "editable": true }, @@ -3578,7 +3578,7 @@ }, { "cell_type": "markdown", - "id": "2831b6a4", + "id": "1b615cdb", "metadata": { "editable": true }, @@ -3588,7 +3588,7 @@ }, { "cell_type": "markdown", - "id": "d28f08c6", + "id": "89752e18", "metadata": { "editable": true }, @@ -3600,7 +3600,7 @@ }, { "cell_type": "markdown", - "id": "774f91b2", + "id": "b0006d32", "metadata": { "editable": true }, @@ -3617,7 +3617,7 @@ { "cell_type": "code", "execution_count": 30, - "id": "7a8f6fd8", + "id": "bcba3ef9", "metadata": { "collapsed": false, "editable": true diff --git a/doc/src/week40/week40.do.txt b/doc/src/week40/week40.do.txt index e9a2b377b..9a0fbaee2 100644 --- a/doc/src/week40/week40.do.txt +++ b/doc/src/week40/week40.do.txt @@ -22,7 +22,7 @@ DATE: September 30-October 4, 2024 !bblock Readings and Videos: o The lecture notes for week 40 (these notes) o For a good discussion on gradient methods, we would like to recommend Goodfellow et al section 4.3-4.5 and sections 8.3-8.6. We will come back to the latter chapter in our discussion of Neural networks as well. - o For neural networks we recommend Goodfellow et al chapter 6 and Raschka et al pages 48-60 + o For neural networks we recommend Goodfellow et al chapter 6 and Raschka et al chapter 2 (contains also material about gradient descent) and chapter 11 (we will use this next week) o Video on gradient descent at URL:"https://www.youtube.com/watch?v=sDv4f4s2SB8" o Video on stochastic gradient descent at URL:"https://www.youtube.com/watch?v=vMh0zPT0tLI" o Neural Networks demystified at URL:"https://www.youtube.com/watch?v=bxe2T-V8XRs&list=PLiaHhY2iBX9hdHaRr6b7XevZtgZRa1PoU&ab_channel=WelchLabs"