diff --git a/doc/pub/week39/html/week39-reveal.html b/doc/pub/week39/html/week39-reveal.html index a399dfa6a..3d840a792 100644 --- a/doc/pub/week39/html/week39-reveal.html +++ b/doc/pub/week39/html/week39-reveal.html @@ -197,20 +197,53 @@ MathJax.Hub.Config({

Plan for week 39

+
+Material for the active learning sessions on Tuesday and Wednesday +

-

See lecture notes for week 39. -For a good discussion on gradient methods, we would like to recommend Goodfellow et al section 4.3-4.5 and chapter 8. We will come back to the latter chapter in our discussion of Neural networks as well. -

- -

For Stochastic Gradient Descent, we recommend chapter 4 of Geron's text.

- -For more discussions of project 1, chapter 5 of Goodfellow et al is a good read, in particular sections 5.1-5.5 and 5.7-5.11.

These sections summarize neatly what we have done till now and point to what is coming with respect to deep learning.

+ +
+ + +
+Material for the lecture on Thursday September 28 +

+

+
diff --git a/doc/pub/week39/html/week39-solarized.html b/doc/pub/week39/html/week39-solarized.html index b33720b01..aae5219af 100644 --- a/doc/pub/week39/html/week39-solarized.html +++ b/doc/pub/week39/html/week39-solarized.html @@ -342,19 +342,39 @@ MathJax.Hub.Config({









Plan for week 39

+
+Material for the active learning sessions on Tuesday and Wednesday +

-

See lecture notes for week 39. -For a good discussion on gradient methods, we would like to recommend Goodfellow et al section 4.3-4.5 and chapter 8. We will come back to the latter chapter in our discussion of Neural networks as well. -

- -

For Stochastic Gradient Descent, we recommend chapter 4 of Geron's text.

- -For more discussions of project 1, chapter 5 of Goodfellow et al is a good read, in particular sections 5.1-5.5 and 5.7-5.11.

These sections summarize neatly what we have done till now and point to what is coming with respect to deep learning.

+ +
+ + +
+Material for the lecture on Thursday September 28 +

+

+
+









Optimization, the central part of any Machine Learning algortithm

diff --git a/doc/pub/week39/html/week39.html b/doc/pub/week39/html/week39.html index 74ad42395..3623de81a 100644 --- a/doc/pub/week39/html/week39.html +++ b/doc/pub/week39/html/week39.html @@ -419,19 +419,39 @@ MathJax.Hub.Config({









Plan for week 39

+
+Material for the active learning sessions on Tuesday and Wednesday +

-

See lecture notes for week 39. -For a good discussion on gradient methods, we would like to recommend Goodfellow et al section 4.3-4.5 and chapter 8. We will come back to the latter chapter in our discussion of Neural networks as well. -

- -

For Stochastic Gradient Descent, we recommend chapter 4 of Geron's text.

- -For more discussions of project 1, chapter 5 of Goodfellow et al is a good read, in particular sections 5.1-5.5 and 5.7-5.11.

These sections summarize neatly what we have done till now and point to what is coming with respect to deep learning.

+ +
+ + +
+Material for the lecture on Thursday September 28 +

+

+
+









Optimization, the central part of any Machine Learning algortithm

diff --git a/doc/pub/week39/ipynb/ipynb-week39-src.tar.gz b/doc/pub/week39/ipynb/ipynb-week39-src.tar.gz index e9ca1fcbc..0d317a1d8 100644 Binary files a/doc/pub/week39/ipynb/ipynb-week39-src.tar.gz and b/doc/pub/week39/ipynb/ipynb-week39-src.tar.gz differ diff --git a/doc/pub/week39/ipynb/week39.ipynb b/doc/pub/week39/ipynb/week39.ipynb index d44d765e0..f8ed9613e 100644 --- a/doc/pub/week39/ipynb/week39.ipynb +++ b/doc/pub/week39/ipynb/week39.ipynb @@ -2,7 +2,7 @@ "cells": [ { "cell_type": "markdown", - "id": "0b6ca636", + "id": "97c9bb6c", "metadata": { "editable": true }, @@ -14,7 +14,7 @@ }, { "cell_type": "markdown", - "id": "e8840c08", + "id": "ade8d870", "metadata": { "editable": true }, @@ -27,31 +27,50 @@ }, { "cell_type": "markdown", - "id": "a9f4d2cf", + "id": "87cd74c3", "metadata": { "editable": true }, "source": [ "## Plan for week 39\n", "\n", - "* Repetition of Logistic regression equations and classification problems and discussion of Gradient methods. Examples on how to implement Logistic Regression and discussion of stochastic gradient descent\n", + "**Material for the active learning sessions on Tuesday and Wednesday.**\n", "\n", - "* Stochastic Gradient descent with examples and automatic differentiation\n", + " * Discussions on how to structure your report for the first project\n", "\n", - "* Reading recommendations:\n", + " * Exercise for week 39 on how to write the abstract and the introduction of the report and how to include references. \n", "\n", - "See [lecture notes for week 39](https://compphysics.github.io/MachineLearning/doc/web/course.html).\n", - "For a good discussion on gradient methods, we would like to recommend Goodfellow et al section 4.3-4.5 and chapter 8. We will come back to the latter chapter in our discussion of Neural networks as well. \n", + " * Work on project 1, in particular resampling methods like cross-validation and bootstrap. **For more discussions of project 1, chapter 5 of Goodfellow et al is a good read, in particular sections 5.1-5.5 and 5.7-5.11**.\n", "\n", - "For Stochastic Gradient Descent, we recommend chapter 4 of Geron's text.\n", + "These sections summarize neatly what we have done till now and point to what is coming with respect to deep learning. \n", + " * A general guideline can be found at .\n", "\n", - "**For more discussions of project 1, chapter 5 of Goodfellow et al is a good read, in particular sections 5.1-5.5 and 5.7-5.11**.\n", - "These sections summarize neatly what we have done till now and point to what is coming with respect to deep learning." + " \n", + "\n", + "**Material for the lecture on Thursday September 28.**\n", + "\n", + " * Repetition of Logistic regression equations and classification problems and discussion of Gradient methods. Examples on how to implement Logistic Regression and discussion of stochastic gradient descent \n", + "\n", + " * Stochastic Gradient descent with examples and automatic differentiation\n", + "\n", + " * [Video of lecture](https://youtu.be/)\n", + "\n", + " * Whiteboard notes TBA at \n", + "\n", + " * Readings and Videos:\n", + "\n", + " * These lecture notes\n", + "\n", + " * For a good discussion on gradient methods, we would like to recommend Goodfellow et al section 4.3-4.5 and sections 8.3-8.6. We will come back to the latter chapter in our discussion of Neural networks as well. \n", + "\n", + " * [Video on gradient descent](https://www.youtube.com/watch?v=sDv4f4s2SB8)\n", + "\n", + " * [Video on stochastic gradient descent](https://www.youtube.com/watch?v=vMh0zPT0tLI)" ] }, { "cell_type": "markdown", - "id": "83479647", + "id": "529184e5", "metadata": { "editable": true }, @@ -72,7 +91,7 @@ }, { "cell_type": "markdown", - "id": "1e80db83", + "id": "1a65465a", "metadata": { "editable": true }, @@ -89,7 +108,7 @@ }, { "cell_type": "markdown", - "id": "44d7e4fa", + "id": "b67231b3", "metadata": { "editable": true }, @@ -104,7 +123,7 @@ }, { "cell_type": "markdown", - "id": "34d2a6f4", + "id": "3f5e03db", "metadata": { "editable": true }, @@ -114,7 +133,7 @@ }, { "cell_type": "markdown", - "id": "a6f15df5", + "id": "e83141ae", "metadata": { "editable": true }, @@ -130,7 +149,7 @@ }, { "cell_type": "markdown", - "id": "e7571bf9", + "id": "cef5864b", "metadata": { "editable": true }, @@ -142,7 +161,7 @@ }, { "cell_type": "markdown", - "id": "92063c06", + "id": "2f59bbb1", "metadata": { "editable": true }, @@ -153,7 +172,7 @@ }, { "cell_type": "markdown", - "id": "976c9856", + "id": "3869b3c6", "metadata": { "editable": true }, @@ -165,7 +184,7 @@ }, { "cell_type": "markdown", - "id": "03839482", + "id": "e4656e92", "metadata": { "editable": true }, @@ -175,7 +194,7 @@ }, { "cell_type": "markdown", - "id": "f9905a63", + "id": "b73ae554", "metadata": { "editable": true }, @@ -189,7 +208,7 @@ }, { "cell_type": "markdown", - "id": "88d19971", + "id": "70a2df05", "metadata": { "editable": true }, @@ -201,7 +220,7 @@ }, { "cell_type": "markdown", - "id": "301f3887", + "id": "2e36f976", "metadata": { "editable": true }, @@ -211,7 +230,7 @@ }, { "cell_type": "markdown", - "id": "83164036", + "id": "7c4959c9", "metadata": { "editable": true }, @@ -223,7 +242,7 @@ }, { "cell_type": "markdown", - "id": "d9c42fcc", + "id": "c553379e", "metadata": { "editable": true }, @@ -235,7 +254,7 @@ }, { "cell_type": "markdown", - "id": "06d6cf6d", + "id": "145f9699", "metadata": { "editable": true }, @@ -255,7 +274,7 @@ }, { "cell_type": "markdown", - "id": "c41df29b", + "id": "9a68f686", "metadata": { "editable": true }, @@ -271,7 +290,7 @@ }, { "cell_type": "markdown", - "id": "1e708b4d", + "id": "d523ab61", "metadata": { "editable": true }, @@ -287,7 +306,7 @@ }, { "cell_type": "markdown", - "id": "118c1956", + "id": "8205fd3a", "metadata": { "editable": true }, @@ -298,7 +317,7 @@ }, { "cell_type": "markdown", - "id": "c437a7bf", + "id": "98d52e46", "metadata": { "editable": true }, @@ -310,7 +329,7 @@ }, { "cell_type": "markdown", - "id": "4269c5d8", + "id": "203f65e8", "metadata": { "editable": true }, @@ -320,7 +339,7 @@ }, { "cell_type": "markdown", - "id": "000f8372", + "id": "dd40195b", "metadata": { "editable": true }, @@ -332,7 +351,7 @@ }, { "cell_type": "markdown", - "id": "b4a8ca90", + "id": "e13a7340", "metadata": { "editable": true }, @@ -342,7 +361,7 @@ }, { "cell_type": "markdown", - "id": "d1629115", + "id": "30c258c9", "metadata": { "editable": true }, @@ -354,7 +373,7 @@ }, { "cell_type": "markdown", - "id": "d9703d98", + "id": "84f880c9", "metadata": { "editable": true }, @@ -376,7 +395,7 @@ }, { "cell_type": "markdown", - "id": "956b1426", + "id": "b237f214", "metadata": { "editable": true }, @@ -389,7 +408,7 @@ }, { "cell_type": "markdown", - "id": "628ea4b6", + "id": "b4ea1db2", "metadata": { "editable": true }, @@ -402,7 +421,7 @@ }, { "cell_type": "markdown", - "id": "050fe89b", + "id": "8b2b6606", "metadata": { "editable": true }, @@ -412,7 +431,7 @@ }, { "cell_type": "markdown", - "id": "94ce5a1f", + "id": "e9d217a4", "metadata": { "editable": true }, @@ -430,7 +449,7 @@ }, { "cell_type": "markdown", - "id": "e0f9817b", + "id": "54f87f7c", "metadata": { "editable": true }, @@ -440,7 +459,7 @@ }, { "cell_type": "markdown", - "id": "ce3d9f6a", + "id": "c2711fc8", "metadata": { "editable": true }, @@ -455,7 +474,7 @@ }, { "cell_type": "markdown", - "id": "bd1b2b82", + "id": "e0409f1c", "metadata": { "editable": true }, @@ -465,7 +484,7 @@ }, { "cell_type": "markdown", - "id": "432f95ed", + "id": "53651890", "metadata": { "editable": true }, @@ -479,7 +498,7 @@ }, { "cell_type": "markdown", - "id": "b22896f3", + "id": "4e70e7ac", "metadata": { "editable": true }, @@ -489,7 +508,7 @@ }, { "cell_type": "markdown", - "id": "5c1900ef", + "id": "9336db1d", "metadata": { "editable": true }, @@ -503,7 +522,7 @@ }, { "cell_type": "markdown", - "id": "37826b5b", + "id": "2c2ae028", "metadata": { "editable": true }, @@ -518,7 +537,7 @@ }, { "cell_type": "markdown", - "id": "f05b71c9", + "id": "cdf99885", "metadata": { "editable": true }, @@ -535,7 +554,7 @@ }, { "cell_type": "markdown", - "id": "79497e3e", + "id": "11bb1b41", "metadata": { "editable": true }, @@ -547,7 +566,7 @@ }, { "cell_type": "markdown", - "id": "b5a5f588", + "id": "5d957768", "metadata": { "editable": true }, @@ -561,7 +580,7 @@ }, { "cell_type": "markdown", - "id": "cfe26d28", + "id": "455b420a", "metadata": { "editable": true }, @@ -576,7 +595,7 @@ }, { "cell_type": "markdown", - "id": "c2458cdf", + "id": "aacb8b05", "metadata": { "editable": true }, @@ -588,7 +607,7 @@ }, { "cell_type": "markdown", - "id": "62f640a6", + "id": "2bb3385b", "metadata": { "editable": true }, @@ -599,7 +618,7 @@ }, { "cell_type": "markdown", - "id": "a4074602", + "id": "21326ef0", "metadata": { "editable": true }, @@ -627,7 +646,7 @@ }, { "cell_type": "markdown", - "id": "ffd18e66", + "id": "a41b3cc6", "metadata": { "editable": true }, @@ -649,7 +668,7 @@ }, { "cell_type": "markdown", - "id": "2b9569e0", + "id": "a01f11a5", "metadata": { "editable": true }, @@ -671,7 +690,7 @@ }, { "cell_type": "markdown", - "id": "54fe0e8b", + "id": "076a32fa", "metadata": { "editable": true }, @@ -683,7 +702,7 @@ }, { "cell_type": "markdown", - "id": "196dbe68", + "id": "73adde3c", "metadata": { "editable": true }, @@ -720,7 +739,7 @@ }, { "cell_type": "markdown", - "id": "7f983eb2", + "id": "9f9ab5ff", "metadata": { "editable": true }, @@ -748,7 +767,7 @@ }, { "cell_type": "markdown", - "id": "054cb408", + "id": "0b2a482b", "metadata": { "editable": true }, @@ -778,7 +797,7 @@ }, { "cell_type": "markdown", - "id": "d96c42f0", + "id": "6566ee55", "metadata": { "editable": true }, @@ -798,7 +817,7 @@ }, { "cell_type": "markdown", - "id": "74f954b6", + "id": "c2e30cc1", "metadata": { "editable": true }, @@ -810,7 +829,7 @@ }, { "cell_type": "markdown", - "id": "bab38e22", + "id": "5012b398", "metadata": { "editable": true }, @@ -820,7 +839,7 @@ }, { "cell_type": "markdown", - "id": "d1b87d81", + "id": "ca65d9a9", "metadata": { "editable": true }, @@ -832,7 +851,7 @@ }, { "cell_type": "markdown", - "id": "2564119f", + "id": "ec9323dd", "metadata": { "editable": true }, @@ -844,7 +863,7 @@ }, { "cell_type": "markdown", - "id": "8aa8dc93", + "id": "5caf0f7f", "metadata": { "editable": true }, @@ -856,7 +875,7 @@ }, { "cell_type": "markdown", - "id": "ce621d40", + "id": "07734ce6", "metadata": { "editable": true }, @@ -868,7 +887,7 @@ }, { "cell_type": "markdown", - "id": "967e409a", + "id": "468dcb52", "metadata": { "editable": true }, @@ -879,7 +898,7 @@ }, { "cell_type": "markdown", - "id": "5d2ef69c", + "id": "b63a89ae", "metadata": { "editable": true }, @@ -892,7 +911,7 @@ }, { "cell_type": "markdown", - "id": "5c5e3bda", + "id": "56a122a3", "metadata": { "editable": true }, @@ -904,7 +923,7 @@ }, { "cell_type": "markdown", - "id": "6cecea3d", + "id": "3256eb29", "metadata": { "editable": true }, @@ -914,7 +933,7 @@ }, { "cell_type": "markdown", - "id": "096853a4", + "id": "b6bab858", "metadata": { "editable": true }, @@ -926,7 +945,7 @@ }, { "cell_type": "markdown", - "id": "edcf059a", + "id": "7ff39e96", "metadata": { "editable": true }, @@ -936,7 +955,7 @@ }, { "cell_type": "markdown", - "id": "73b9ef7c", + "id": "6678fce9", "metadata": { "editable": true }, @@ -947,7 +966,7 @@ }, { "cell_type": "markdown", - "id": "116c2823", + "id": "853eb11f", "metadata": { "editable": true }, @@ -959,7 +978,7 @@ }, { "cell_type": "markdown", - "id": "00b979dd", + "id": "7c229917", "metadata": { "editable": true }, @@ -971,7 +990,7 @@ }, { "cell_type": "markdown", - "id": "8bc10ec6", + "id": "5c8f310a", "metadata": { "editable": true }, @@ -983,7 +1002,7 @@ }, { "cell_type": "markdown", - "id": "4080fe97", + "id": "f8a8c317", "metadata": { "editable": true }, @@ -994,7 +1013,7 @@ }, { "cell_type": "markdown", - "id": "1f39d1bd", + "id": "49b64ed0", "metadata": { "editable": true }, @@ -1005,7 +1024,7 @@ }, { "cell_type": "markdown", - "id": "7cbf183e", + "id": "857ee939", "metadata": { "editable": true }, @@ -1017,7 +1036,7 @@ }, { "cell_type": "markdown", - "id": "3572dfc2", + "id": "7e5611fa", "metadata": { "editable": true }, @@ -1027,7 +1046,7 @@ }, { "cell_type": "markdown", - "id": "530255c0", + "id": "384d5aa2", "metadata": { "editable": true }, @@ -1039,7 +1058,7 @@ }, { "cell_type": "markdown", - "id": "92bb5f9f", + "id": "0ce677be", "metadata": { "editable": true }, @@ -1049,7 +1068,7 @@ }, { "cell_type": "markdown", - "id": "ee402373", + "id": "e97f9044", "metadata": { "editable": true }, @@ -1061,7 +1080,7 @@ }, { "cell_type": "markdown", - "id": "b7ecc434", + "id": "d7fbeb68", "metadata": { "editable": true }, @@ -1071,7 +1090,7 @@ }, { "cell_type": "markdown", - "id": "bcdd6a46", + "id": "293c09b1", "metadata": { "editable": true }, @@ -1083,7 +1102,7 @@ }, { "cell_type": "markdown", - "id": "26d2eb03", + "id": "af88e065", "metadata": { "editable": true }, @@ -1093,7 +1112,7 @@ }, { "cell_type": "markdown", - "id": "b081689d", + "id": "2757e302", "metadata": { "editable": true }, @@ -1105,7 +1124,7 @@ }, { "cell_type": "markdown", - "id": "5e4dd65b", + "id": "87aab66b", "metadata": { "editable": true }, @@ -1116,7 +1135,7 @@ { "cell_type": "code", "execution_count": 1, - "id": "b5e819e0", + "id": "a0e20ff7", "metadata": { "collapsed": false, "editable": true @@ -1149,7 +1168,7 @@ }, { "cell_type": "markdown", - "id": "bc51c841", + "id": "c01b471a", "metadata": { "editable": true }, @@ -1160,7 +1179,7 @@ { "cell_type": "code", "execution_count": 2, - "id": "079d6a5b", + "id": "5b835c85", "metadata": { "collapsed": false, "editable": true @@ -1174,7 +1193,7 @@ }, { "cell_type": "markdown", - "id": "280c077f", + "id": "d6a3c121", "metadata": { "editable": true }, @@ -1185,7 +1204,7 @@ { "cell_type": "code", "execution_count": 3, - "id": "9c0e8d49", + "id": "19e1d73c", "metadata": { "collapsed": false, "editable": true @@ -1198,7 +1217,7 @@ }, { "cell_type": "markdown", - "id": "6df39dc7", + "id": "9f7b2dfc", "metadata": { "editable": true }, @@ -1209,7 +1228,7 @@ { "cell_type": "code", "execution_count": 4, - "id": "036ff5ee", + "id": "7d8247e6", "metadata": { "collapsed": false, "editable": true @@ -1227,7 +1246,7 @@ }, { "cell_type": "markdown", - "id": "2670d5e5", + "id": "c44006da", "metadata": { "editable": true }, @@ -1238,7 +1257,7 @@ { "cell_type": "code", "execution_count": 5, - "id": "0e68a3cf", + "id": "bb8a0fd8", "metadata": { "collapsed": false, "editable": true @@ -1253,7 +1272,7 @@ }, { "cell_type": "markdown", - "id": "13118605", + "id": "3d3c98f0", "metadata": { "editable": true }, @@ -1263,7 +1282,7 @@ }, { "cell_type": "markdown", - "id": "a18cc623", + "id": "29e5e792", "metadata": { "editable": true }, @@ -1277,7 +1296,7 @@ }, { "cell_type": "markdown", - "id": "b97138f6", + "id": "2b0e0db3", "metadata": { "editable": true }, @@ -1289,7 +1308,7 @@ }, { "cell_type": "markdown", - "id": "8a7f0370", + "id": "401dd643", "metadata": { "editable": true }, @@ -1300,7 +1319,7 @@ }, { "cell_type": "markdown", - "id": "f588314c", + "id": "bc29d596", "metadata": { "editable": true }, @@ -1312,7 +1331,7 @@ }, { "cell_type": "markdown", - "id": "7956e6f8", + "id": "c1b7adb4", "metadata": { "editable": true }, @@ -1323,7 +1342,7 @@ }, { "cell_type": "markdown", - "id": "77230878", + "id": "18924232", "metadata": { "editable": true }, @@ -1334,7 +1353,7 @@ }, { "cell_type": "markdown", - "id": "ff8b02db", + "id": "1764ac31", "metadata": { "editable": true }, @@ -1346,7 +1365,7 @@ }, { "cell_type": "markdown", - "id": "93043c94", + "id": "379d5862", "metadata": { "editable": true }, @@ -1356,7 +1375,7 @@ }, { "cell_type": "markdown", - "id": "4879c307", + "id": "9587d8bf", "metadata": { "editable": true }, @@ -1368,7 +1387,7 @@ }, { "cell_type": "markdown", - "id": "dd55a064", + "id": "4c3d0bfb", "metadata": { "editable": true }, @@ -1380,7 +1399,7 @@ }, { "cell_type": "markdown", - "id": "6d698cb0", + "id": "4079ca1a", "metadata": { "editable": true }, @@ -1392,7 +1411,7 @@ }, { "cell_type": "markdown", - "id": "ff388fc5", + "id": "e5b487a5", "metadata": { "editable": true }, @@ -1404,7 +1423,7 @@ }, { "cell_type": "markdown", - "id": "1e9b1ec2", + "id": "b623d7f7", "metadata": { "editable": true }, @@ -1415,7 +1434,7 @@ }, { "cell_type": "markdown", - "id": "7c9d1ee3", + "id": "8520c560", "metadata": { "editable": true }, @@ -1427,7 +1446,7 @@ }, { "cell_type": "markdown", - "id": "8d547db3", + "id": "52575016", "metadata": { "editable": true }, @@ -1437,7 +1456,7 @@ }, { "cell_type": "markdown", - "id": "2f4a5adc", + "id": "1b8a85bd", "metadata": { "editable": true }, @@ -1449,7 +1468,7 @@ }, { "cell_type": "markdown", - "id": "b7fd0f39", + "id": "e53b0f45", "metadata": { "editable": true }, @@ -1459,7 +1478,7 @@ }, { "cell_type": "markdown", - "id": "e70cf1f1", + "id": "2238e15f", "metadata": { "editable": true }, @@ -1471,7 +1490,7 @@ }, { "cell_type": "markdown", - "id": "f9e42581", + "id": "f00e8864", "metadata": { "editable": true }, @@ -1491,7 +1510,7 @@ }, { "cell_type": "markdown", - "id": "cb104480", + "id": "7a17895d", "metadata": { "editable": true }, @@ -1503,7 +1522,7 @@ }, { "cell_type": "markdown", - "id": "1aa99016", + "id": "d4bafcb3", "metadata": { "editable": true }, @@ -1513,7 +1532,7 @@ }, { "cell_type": "markdown", - "id": "c6005530", + "id": "78a7d2c3", "metadata": { "editable": true }, @@ -1525,7 +1544,7 @@ }, { "cell_type": "markdown", - "id": "f09ba534", + "id": "e3192cbf", "metadata": { "editable": true }, @@ -1535,7 +1554,7 @@ }, { "cell_type": "markdown", - "id": "8ee4ad71", + "id": "0d99ed55", "metadata": { "editable": true }, @@ -1546,7 +1565,7 @@ }, { "cell_type": "markdown", - "id": "f1235226", + "id": "b9653ede", "metadata": { "editable": true }, @@ -1558,7 +1577,7 @@ }, { "cell_type": "markdown", - "id": "13ad7eb8", + "id": "78441105", "metadata": { "editable": true }, @@ -1570,7 +1589,7 @@ }, { "cell_type": "markdown", - "id": "c66691cb", + "id": "317355d2", "metadata": { "editable": true }, @@ -1582,7 +1601,7 @@ }, { "cell_type": "markdown", - "id": "b1dafe82", + "id": "9bb15157", "metadata": { "editable": true }, @@ -1595,7 +1614,7 @@ }, { "cell_type": "markdown", - "id": "4603d128", + "id": "ac584971", "metadata": { "editable": true }, @@ -1606,7 +1625,7 @@ }, { "cell_type": "markdown", - "id": "bfa292fd", + "id": "911f1dfa", "metadata": { "editable": true }, @@ -1618,7 +1637,7 @@ }, { "cell_type": "markdown", - "id": "636e79c4", + "id": "d1472568", "metadata": { "editable": true }, @@ -1634,7 +1653,7 @@ }, { "cell_type": "markdown", - "id": "6d3e71b9", + "id": "c79708e8", "metadata": { "editable": true }, @@ -1646,7 +1665,7 @@ }, { "cell_type": "markdown", - "id": "9f6b7605", + "id": "535d3e73", "metadata": { "editable": true }, @@ -1657,7 +1676,7 @@ }, { "cell_type": "markdown", - "id": "90c617b8", + "id": "ad718f62", "metadata": { "editable": true }, @@ -1669,7 +1688,7 @@ }, { "cell_type": "markdown", - "id": "690e77f7", + "id": "d0a90fa5", "metadata": { "editable": true }, @@ -1679,7 +1698,7 @@ }, { "cell_type": "markdown", - "id": "ebe87bbf", + "id": "860e9217", "metadata": { "editable": true }, @@ -1691,7 +1710,7 @@ }, { "cell_type": "markdown", - "id": "284ebebe", + "id": "6d8a72c8", "metadata": { "editable": true }, @@ -1701,7 +1720,7 @@ }, { "cell_type": "markdown", - "id": "4a67d86f", + "id": "746e6fc0", "metadata": { "editable": true }, @@ -1713,7 +1732,7 @@ }, { "cell_type": "markdown", - "id": "bfa0b7a4", + "id": "f76c0e69", "metadata": { "editable": true }, @@ -1723,7 +1742,7 @@ }, { "cell_type": "markdown", - "id": "11b5ff1d", + "id": "9aee35ca", "metadata": { "editable": true }, @@ -1735,7 +1754,7 @@ }, { "cell_type": "markdown", - "id": "1a68b320", + "id": "ce9ce258", "metadata": { "editable": true }, @@ -1759,7 +1778,7 @@ { "cell_type": "code", "execution_count": 6, - "id": "f6b45066", + "id": "f902a0f2", "metadata": { "collapsed": false, "editable": true @@ -1772,7 +1791,7 @@ }, { "cell_type": "markdown", - "id": "941ec30c", + "id": "36d883b2", "metadata": { "editable": true }, @@ -1783,7 +1802,7 @@ }, { "cell_type": "markdown", - "id": "b2c795b2", + "id": "cde21ef1", "metadata": { "editable": true }, @@ -1795,7 +1814,7 @@ }, { "cell_type": "markdown", - "id": "aaa16809", + "id": "f2a021d3", "metadata": { "editable": true }, @@ -1805,7 +1824,7 @@ }, { "cell_type": "markdown", - "id": "b9010811", + "id": "ea0a91e4", "metadata": { "editable": true }, @@ -1817,7 +1836,7 @@ }, { "cell_type": "markdown", - "id": "7a496ec5", + "id": "854f3ebb", "metadata": { "editable": true }, @@ -1831,7 +1850,7 @@ }, { "cell_type": "markdown", - "id": "b96688aa", + "id": "dd282d2d", "metadata": { "editable": true }, @@ -1847,7 +1866,7 @@ }, { "cell_type": "markdown", - "id": "b10f96e6", + "id": "fd562029", "metadata": { "editable": true }, @@ -1857,7 +1876,7 @@ }, { "cell_type": "markdown", - "id": "8ac0e224", + "id": "25369bc3", "metadata": { "editable": true }, @@ -1869,7 +1888,7 @@ }, { "cell_type": "markdown", - "id": "819d5d1c", + "id": "a222f3ea", "metadata": { "editable": true }, @@ -1879,7 +1898,7 @@ }, { "cell_type": "markdown", - "id": "ab659bad", + "id": "1d5fb6f1", "metadata": { "editable": true }, @@ -1891,7 +1910,7 @@ }, { "cell_type": "markdown", - "id": "8c35e5a2", + "id": "eab2df73", "metadata": { "editable": true }, @@ -1905,7 +1924,7 @@ }, { "cell_type": "markdown", - "id": "0e3d77e1", + "id": "daee1165", "metadata": { "editable": true }, @@ -1915,7 +1934,7 @@ }, { "cell_type": "markdown", - "id": "b0b9b496", + "id": "f2c6f5cc", "metadata": { "editable": true }, @@ -1926,7 +1945,7 @@ }, { "cell_type": "markdown", - "id": "c102ee11", + "id": "ecce0d08", "metadata": { "editable": true }, @@ -1941,7 +1960,7 @@ }, { "cell_type": "markdown", - "id": "32dfcdd7", + "id": "c4308e5f", "metadata": { "editable": true }, @@ -1951,7 +1970,7 @@ }, { "cell_type": "markdown", - "id": "1f905bde", + "id": "4ee64b17", "metadata": { "editable": true }, @@ -1963,7 +1982,7 @@ }, { "cell_type": "markdown", - "id": "300e8838", + "id": "57e8db33", "metadata": { "editable": true }, @@ -1975,7 +1994,7 @@ }, { "cell_type": "markdown", - "id": "d28d496c", + "id": "c42e4032", "metadata": { "editable": true }, @@ -1990,7 +2009,7 @@ }, { "cell_type": "markdown", - "id": "445d56e6", + "id": "4c430cd3", "metadata": { "editable": true }, @@ -2003,7 +2022,7 @@ { "cell_type": "code", "execution_count": 7, - "id": "5b013b95", + "id": "9ac6096f", "metadata": { "collapsed": false, "editable": true @@ -2060,7 +2079,7 @@ }, { "cell_type": "markdown", - "id": "85d33a34", + "id": "df783e1d", "metadata": { "editable": true }, @@ -2071,7 +2090,7 @@ { "cell_type": "code", "execution_count": 8, - "id": "ef815a7a", + "id": "98f08f24", "metadata": { "collapsed": false, "editable": true @@ -2098,7 +2117,7 @@ }, { "cell_type": "markdown", - "id": "b4bd8c37", + "id": "50a5ab0d", "metadata": { "editable": true }, @@ -2110,7 +2129,7 @@ }, { "cell_type": "markdown", - "id": "58ac27e8", + "id": "b35293d4", "metadata": { "editable": true }, @@ -2122,7 +2141,7 @@ }, { "cell_type": "markdown", - "id": "c146f500", + "id": "fed491ee", "metadata": { "editable": true }, @@ -2132,7 +2151,7 @@ }, { "cell_type": "markdown", - "id": "afdf568c", + "id": "a0b4c94e", "metadata": { "editable": true }, @@ -2146,7 +2165,7 @@ }, { "cell_type": "markdown", - "id": "0e03b0f2", + "id": "e4f02dce", "metadata": { "editable": true }, @@ -2156,7 +2175,7 @@ }, { "cell_type": "markdown", - "id": "f7d35405", + "id": "b9f297ff", "metadata": { "editable": true }, @@ -2168,7 +2187,7 @@ }, { "cell_type": "markdown", - "id": "eee985e8", + "id": "4e1caf44", "metadata": { "editable": true }, @@ -2179,7 +2198,7 @@ }, { "cell_type": "markdown", - "id": "ebbe199f", + "id": "a046daea", "metadata": { "editable": true }, @@ -2194,7 +2213,7 @@ }, { "cell_type": "markdown", - "id": "efa70eb1", + "id": "02f05574", "metadata": { "editable": true }, @@ -2208,7 +2227,7 @@ }, { "cell_type": "markdown", - "id": "2dc242be", + "id": "45484749", "metadata": { "editable": true }, @@ -2219,7 +2238,7 @@ { "cell_type": "code", "execution_count": 9, - "id": "d31b5b9a", + "id": "9973cd20", "metadata": { "collapsed": false, "editable": true @@ -2280,7 +2299,7 @@ }, { "cell_type": "markdown", - "id": "29a18c30", + "id": "1836d4ef", "metadata": { "editable": true }, @@ -2302,7 +2321,7 @@ }, { "cell_type": "markdown", - "id": "5ba5a047", + "id": "88975d3d", "metadata": { "editable": true }, @@ -2315,7 +2334,7 @@ { "cell_type": "code", "execution_count": 10, - "id": "946e5b06", + "id": "56f415e0", "metadata": { "collapsed": false, "editable": true @@ -2381,7 +2400,7 @@ }, { "cell_type": "markdown", - "id": "0100a73f", + "id": "d3343584", "metadata": { "editable": true }, @@ -2392,7 +2411,7 @@ { "cell_type": "code", "execution_count": 11, - "id": "6cbbf9f1", + "id": "ff1e3778", "metadata": { "collapsed": false, "editable": true @@ -2466,7 +2485,7 @@ }, { "cell_type": "markdown", - "id": "0e599f71", + "id": "c1d70995", "metadata": { "editable": true }, @@ -2478,7 +2497,7 @@ }, { "cell_type": "markdown", - "id": "5cde0b8b", + "id": "930a5be8", "metadata": { "editable": true }, @@ -2499,7 +2518,7 @@ }, { "cell_type": "markdown", - "id": "7b8e3b3f", + "id": "0a7fb7ef", "metadata": { "editable": true }, @@ -2531,7 +2550,7 @@ }, { "cell_type": "markdown", - "id": "c1786f4c", + "id": "dbff87b0", "metadata": { "editable": true }, @@ -2548,7 +2567,7 @@ }, { "cell_type": "markdown", - "id": "4462b6fa", + "id": "cd292df5", "metadata": { "editable": true }, @@ -2561,7 +2580,7 @@ }, { "cell_type": "markdown", - "id": "09b2f507", + "id": "1b2ffa4e", "metadata": { "editable": true }, @@ -2574,7 +2593,7 @@ }, { "cell_type": "markdown", - "id": "31510e29", + "id": "d0abe4b0", "metadata": { "editable": true }, @@ -2587,7 +2606,7 @@ }, { "cell_type": "markdown", - "id": "78f3f26d", + "id": "65c15c60", "metadata": { "editable": true }, @@ -2601,7 +2620,7 @@ }, { "cell_type": "markdown", - "id": "bb53530d", + "id": "460354c0", "metadata": { "editable": true }, @@ -2623,7 +2642,7 @@ }, { "cell_type": "markdown", - "id": "79d494c4", + "id": "c2a5dfcd", "metadata": { "editable": true }, @@ -2638,7 +2657,7 @@ }, { "cell_type": "markdown", - "id": "1a6f31f3", + "id": "eeeb0fe8", "metadata": { "editable": true }, @@ -2650,7 +2669,7 @@ }, { "cell_type": "markdown", - "id": "770c4a2b", + "id": "2b49c741", "metadata": { "editable": true }, @@ -2663,7 +2682,7 @@ }, { "cell_type": "markdown", - "id": "640f9b47", + "id": "8ba7b9be", "metadata": { "editable": true }, @@ -2677,7 +2696,7 @@ }, { "cell_type": "markdown", - "id": "772329af", + "id": "50da33c0", "metadata": { "editable": true }, @@ -2688,7 +2707,7 @@ { "cell_type": "code", "execution_count": 12, - "id": "cdb099f5", + "id": "31bd6a24", "metadata": { "collapsed": false, "editable": true @@ -2713,7 +2732,7 @@ }, { "cell_type": "markdown", - "id": "40e10ef6", + "id": "0deb8111", "metadata": { "editable": true }, @@ -2729,7 +2748,7 @@ }, { "cell_type": "markdown", - "id": "1d19e5a8", + "id": "16d54f02", "metadata": { "editable": true }, @@ -2750,7 +2769,7 @@ }, { "cell_type": "markdown", - "id": "7fab9fc2", + "id": "b300d06b", "metadata": { "editable": true }, @@ -2770,7 +2789,7 @@ }, { "cell_type": "markdown", - "id": "a4c22706", + "id": "6bc7778d", "metadata": { "editable": true }, @@ -2789,7 +2808,7 @@ { "cell_type": "code", "execution_count": 13, - "id": "d7a2b4d8", + "id": "a60fe5bd", "metadata": { "collapsed": false, "editable": true @@ -2824,7 +2843,7 @@ }, { "cell_type": "markdown", - "id": "09bb98a4", + "id": "2192721f", "metadata": { "editable": true }, @@ -2837,7 +2856,7 @@ { "cell_type": "code", "execution_count": 14, - "id": "a1900f25", + "id": "e404f2c5", "metadata": { "collapsed": false, "editable": true @@ -2914,7 +2933,7 @@ }, { "cell_type": "markdown", - "id": "c94f1d84", + "id": "fffdbb91", "metadata": { "editable": true }, @@ -2929,7 +2948,7 @@ }, { "cell_type": "markdown", - "id": "2483e9ce", + "id": "8cce7a0e", "metadata": { "editable": true }, @@ -2944,7 +2963,7 @@ }, { "cell_type": "markdown", - "id": "983d9d50", + "id": "3154c365", "metadata": { "editable": true }, @@ -2956,7 +2975,7 @@ }, { "cell_type": "markdown", - "id": "f3f609a3", + "id": "a2a9ceca", "metadata": { "editable": true }, @@ -2974,7 +2993,7 @@ }, { "cell_type": "markdown", - "id": "f411d2ea", + "id": "3374c700", "metadata": { "editable": true }, @@ -2993,7 +3012,7 @@ }, { "cell_type": "markdown", - "id": "4ab2c5a8", + "id": "893d86fe", "metadata": { "editable": true }, @@ -3005,7 +3024,7 @@ }, { "cell_type": "markdown", - "id": "3f7480b7", + "id": "ca2449e8", "metadata": { "editable": true }, @@ -3015,7 +3034,7 @@ }, { "cell_type": "markdown", - "id": "e600ba28", + "id": "3cbd4adb", "metadata": { "editable": true }, @@ -3031,7 +3050,7 @@ }, { "cell_type": "markdown", - "id": "a8e40454", + "id": "e3f07cbc", "metadata": { "editable": true }, @@ -3043,7 +3062,7 @@ }, { "cell_type": "markdown", - "id": "1a241786", + "id": "99f2ac0f", "metadata": { "editable": true }, @@ -3053,7 +3072,7 @@ }, { "cell_type": "markdown", - "id": "ae87e69e", + "id": "83336244", "metadata": { "editable": true }, @@ -3065,7 +3084,7 @@ }, { "cell_type": "markdown", - "id": "4ceecc15", + "id": "efd3e708", "metadata": { "editable": true }, @@ -3075,7 +3094,7 @@ }, { "cell_type": "markdown", - "id": "882ffbf4", + "id": "6c24d65c", "metadata": { "editable": true }, @@ -3087,7 +3106,7 @@ }, { "cell_type": "markdown", - "id": "2ae9ed9e", + "id": "853d885b", "metadata": { "editable": true }, @@ -3103,7 +3122,7 @@ }, { "cell_type": "markdown", - "id": "d5acf4bb", + "id": "5ab54645", "metadata": { "editable": true }, @@ -3115,7 +3134,7 @@ }, { "cell_type": "markdown", - "id": "d20d63ac", + "id": "90f1503b", "metadata": { "editable": true }, @@ -3148,7 +3167,7 @@ }, { "cell_type": "markdown", - "id": "a8405106", + "id": "d496d988", "metadata": { "editable": true }, @@ -3160,7 +3179,7 @@ }, { "cell_type": "markdown", - "id": "58509b9c", + "id": "258ca1e6", "metadata": { "editable": true }, @@ -3178,7 +3197,7 @@ }, { "cell_type": "markdown", - "id": "1f487a62", + "id": "84278058", "metadata": { "editable": true }, @@ -3188,7 +3207,7 @@ }, { "cell_type": "markdown", - "id": "85af90cc", + "id": "feaee2f4", "metadata": { "editable": true }, @@ -3219,7 +3238,7 @@ }, { "cell_type": "markdown", - "id": "6763d293", + "id": "218edcf1", "metadata": { "editable": true }, @@ -3234,7 +3253,7 @@ }, { "cell_type": "markdown", - "id": "6269a700", + "id": "18dbc91c", "metadata": { "editable": true }, @@ -3252,7 +3271,7 @@ }, { "cell_type": "markdown", - "id": "3b8071de", + "id": "0bfcf74a", "metadata": { "editable": true }, @@ -3264,7 +3283,7 @@ }, { "cell_type": "markdown", - "id": "6ea30bc4", + "id": "5fedd6f0", "metadata": { "editable": true }, @@ -3276,7 +3295,7 @@ }, { "cell_type": "markdown", - "id": "2022c06c", + "id": "b210b2a4", "metadata": { "editable": true }, @@ -3294,7 +3313,7 @@ }, { "cell_type": "markdown", - "id": "7a0404a9", + "id": "34ffacbb", "metadata": { "editable": true }, @@ -3323,7 +3342,7 @@ }, { "cell_type": "markdown", - "id": "5f8513bf", + "id": "cd03375d", "metadata": { "editable": true }, @@ -3341,7 +3360,7 @@ }, { "cell_type": "markdown", - "id": "144b23a8", + "id": "0db5d6e0", "metadata": { "editable": true }, @@ -3353,7 +3372,7 @@ }, { "cell_type": "markdown", - "id": "8cd279b7", + "id": "84c709d9", "metadata": { "editable": true }, @@ -3365,7 +3384,7 @@ }, { "cell_type": "markdown", - "id": "03206a26", + "id": "e4e47496", "metadata": { "editable": true }, @@ -3377,7 +3396,7 @@ }, { "cell_type": "markdown", - "id": "6e1d0345", + "id": "164f27df", "metadata": { "editable": true }, @@ -3389,7 +3408,7 @@ }, { "cell_type": "markdown", - "id": "f50703d3", + "id": "591f4833", "metadata": { "editable": true }, @@ -3401,7 +3420,7 @@ }, { "cell_type": "markdown", - "id": "4eb84630", + "id": "e2127e8a", "metadata": { "editable": true }, @@ -3418,7 +3437,7 @@ }, { "cell_type": "markdown", - "id": "a64d776b", + "id": "5cef8b84", "metadata": { "editable": true }, @@ -3437,7 +3456,7 @@ }, { "cell_type": "markdown", - "id": "cb3f4d29", + "id": "505c8905", "metadata": { "editable": true }, @@ -3449,7 +3468,7 @@ }, { "cell_type": "markdown", - "id": "4d5878ed", + "id": "ca96ddec", "metadata": { "editable": true }, @@ -3463,7 +3482,7 @@ }, { "cell_type": "markdown", - "id": "addbba75", + "id": "fa011176", "metadata": { "editable": true }, @@ -3483,7 +3502,7 @@ }, { "cell_type": "markdown", - "id": "2707828a", + "id": "b91c4543", "metadata": { "editable": true }, @@ -3521,7 +3540,7 @@ }, { "cell_type": "markdown", - "id": "c879d74d", + "id": "f13065e5", "metadata": { "editable": true }, @@ -3533,7 +3552,7 @@ }, { "cell_type": "markdown", - "id": "50c78afa", + "id": "22937f5e", "metadata": { "editable": true }, @@ -3543,7 +3562,7 @@ }, { "cell_type": "markdown", - "id": "2e31b945", + "id": "e1459fe1", "metadata": { "editable": true }, @@ -3555,7 +3574,7 @@ }, { "cell_type": "markdown", - "id": "fbc53258", + "id": "441a109a", "metadata": { "editable": true }, @@ -3566,7 +3585,7 @@ { "cell_type": "code", "execution_count": 15, - "id": "8559136e", + "id": "9043abae", "metadata": { "collapsed": false, "editable": true @@ -3611,7 +3630,7 @@ }, { "cell_type": "markdown", - "id": "7c2fb26b", + "id": "787d5d78", "metadata": { "editable": true }, @@ -3628,7 +3647,7 @@ { "cell_type": "code", "execution_count": 16, - "id": "658e24b9", + "id": "6a677479", "metadata": { "collapsed": false, "editable": true @@ -3656,7 +3675,7 @@ }, { "cell_type": "markdown", - "id": "5449cca9", + "id": "f94a1d32", "metadata": { "editable": true }, @@ -3671,7 +3690,7 @@ { "cell_type": "code", "execution_count": 17, - "id": "2c3b79a8", + "id": "c0eb89fd", "metadata": { "collapsed": false, "editable": true @@ -3715,7 +3734,7 @@ }, { "cell_type": "markdown", - "id": "5bd26ddb", + "id": "05d7497d", "metadata": { "editable": true }, @@ -3725,7 +3744,7 @@ }, { "cell_type": "markdown", - "id": "1eb6a361", + "id": "24e3ca02", "metadata": { "editable": true }, @@ -3736,7 +3755,7 @@ { "cell_type": "code", "execution_count": 18, - "id": "700b1e86", + "id": "a616e696", "metadata": { "collapsed": false, "editable": true @@ -3764,7 +3783,7 @@ }, { "cell_type": "markdown", - "id": "9f2fa4a1", + "id": "f695da56", "metadata": { "editable": true }, @@ -3779,7 +3798,7 @@ }, { "cell_type": "markdown", - "id": "c5b1f850", + "id": "5ac073ee", "metadata": { "editable": true }, @@ -3790,7 +3809,7 @@ { "cell_type": "code", "execution_count": 19, - "id": "c6302980", + "id": "efc8906e", "metadata": { "collapsed": false, "editable": true @@ -3818,7 +3837,7 @@ }, { "cell_type": "markdown", - "id": "e3e526c6", + "id": "7c587e8f", "metadata": { "editable": true }, @@ -3829,7 +3848,7 @@ { "cell_type": "code", "execution_count": 20, - "id": "744be574", + "id": "6428be1f", "metadata": { "collapsed": false, "editable": true @@ -3854,7 +3873,7 @@ }, { "cell_type": "markdown", - "id": "50c2ebd2", + "id": "8e1de777", "metadata": { "editable": true }, @@ -3865,7 +3884,7 @@ { "cell_type": "code", "execution_count": 21, - "id": "20475a58", + "id": "770ff6aa", "metadata": { "collapsed": false, "editable": true @@ -3901,7 +3920,7 @@ { "cell_type": "code", "execution_count": 22, - "id": "d6aec0be", + "id": "b924cc5d", "metadata": { "collapsed": false, "editable": true @@ -3921,7 +3940,7 @@ }, { "cell_type": "markdown", - "id": "16863bc8", + "id": "f0b0e1e9", "metadata": { "editable": true }, @@ -3932,7 +3951,7 @@ { "cell_type": "code", "execution_count": 23, - "id": "417f5fe0", + "id": "1585ab28", "metadata": { "collapsed": false, "editable": true @@ -3970,7 +3989,7 @@ }, { "cell_type": "markdown", - "id": "a971daec", + "id": "2718df1a", "metadata": { "editable": true }, @@ -3980,7 +3999,7 @@ }, { "cell_type": "markdown", - "id": "99d11189", + "id": "d8fa5235", "metadata": { "editable": true }, @@ -3994,7 +4013,7 @@ { "cell_type": "code", "execution_count": 24, - "id": "aa1fbaa1", + "id": "196a52d6", "metadata": { "collapsed": false, "editable": true @@ -4016,7 +4035,7 @@ }, { "cell_type": "markdown", - "id": "23ba2063", + "id": "9127a2c5", "metadata": { "editable": true }, @@ -4026,7 +4045,7 @@ }, { "cell_type": "markdown", - "id": "d0691879", + "id": "2b12ed61", "metadata": { "editable": true }, @@ -4037,7 +4056,7 @@ { "cell_type": "code", "execution_count": 25, - "id": "d9741db5", + "id": "8ced55c8", "metadata": { "collapsed": false, "editable": true @@ -4059,7 +4078,7 @@ }, { "cell_type": "markdown", - "id": "c765b721", + "id": "92ebdc2b", "metadata": { "editable": true }, @@ -4072,7 +4091,7 @@ { "cell_type": "code", "execution_count": 26, - "id": "c1837dcc", + "id": "276f763e", "metadata": { "collapsed": false, "editable": true @@ -4097,7 +4116,7 @@ }, { "cell_type": "markdown", - "id": "1decd6b6", + "id": "7841ad0b", "metadata": { "editable": true }, @@ -4109,7 +4128,7 @@ { "cell_type": "code", "execution_count": 27, - "id": "fb7fadd3", + "id": "10107989", "metadata": { "collapsed": false, "editable": true @@ -4124,7 +4143,7 @@ }, { "cell_type": "markdown", - "id": "d1556c09", + "id": "4c1139c0", "metadata": { "editable": true }, @@ -4139,7 +4158,7 @@ { "cell_type": "code", "execution_count": 28, - "id": "f500b737", + "id": "3022af88", "metadata": { "collapsed": false, "editable": true @@ -4199,7 +4218,7 @@ }, { "cell_type": "markdown", - "id": "753b1d28", + "id": "04d09021", "metadata": { "editable": true }, @@ -4210,7 +4229,7 @@ { "cell_type": "code", "execution_count": 29, - "id": "5a8981f6", + "id": "71bf4b6d", "metadata": { "collapsed": false, "editable": true @@ -4274,7 +4293,7 @@ }, { "cell_type": "markdown", - "id": "25128c2c", + "id": "ad417bba", "metadata": { "editable": true }, @@ -4285,7 +4304,7 @@ { "cell_type": "code", "execution_count": 30, - "id": "8a030f2d", + "id": "c394bcef", "metadata": { "collapsed": false, "editable": true @@ -4334,7 +4353,7 @@ }, { "cell_type": "markdown", - "id": "d726e84e", + "id": "2e4cf4b5", "metadata": { "editable": true }, @@ -4346,7 +4365,7 @@ { "cell_type": "code", "execution_count": 31, - "id": "1d1f12f8", + "id": "47411bcf", "metadata": { "collapsed": false, "editable": true @@ -4430,7 +4449,7 @@ }, { "cell_type": "markdown", - "id": "a4615a81", + "id": "f8e30af2", "metadata": { "editable": true }, @@ -4441,7 +4460,7 @@ { "cell_type": "code", "execution_count": 32, - "id": "4ea0f0d4", + "id": "dd594924", "metadata": { "collapsed": false, "editable": true @@ -4519,7 +4538,7 @@ }, { "cell_type": "markdown", - "id": "2e5b6320", + "id": "75c4c29d", "metadata": { "editable": true }, @@ -4530,7 +4549,7 @@ { "cell_type": "code", "execution_count": 33, - "id": "b6cd6b48", + "id": "4dd14fc5", "metadata": { "collapsed": false, "editable": true @@ -4589,7 +4608,7 @@ }, { "cell_type": "markdown", - "id": "e3bdc8ab", + "id": "be4ce0cd", "metadata": { "editable": true }, @@ -4599,7 +4618,7 @@ }, { "cell_type": "markdown", - "id": "6b81d426", + "id": "0b739495", "metadata": { "editable": true }, @@ -4610,7 +4629,7 @@ { "cell_type": "code", "execution_count": 34, - "id": "dd810f17", + "id": "ae87789c", "metadata": { "collapsed": false, "editable": true @@ -4675,7 +4694,7 @@ }, { "cell_type": "markdown", - "id": "1482fbca", + "id": "76c8872b", "metadata": { "editable": true }, @@ -4686,7 +4705,7 @@ { "cell_type": "code", "execution_count": 35, - "id": "510c96db", + "id": "e99dbaa4", "metadata": { "collapsed": false, "editable": true @@ -4756,7 +4775,7 @@ }, { "cell_type": "markdown", - "id": "64368447", + "id": "596df570", "metadata": { "editable": true }, @@ -4767,7 +4786,7 @@ { "cell_type": "code", "execution_count": 36, - "id": "a54f6964", + "id": "6693f042", "metadata": { "collapsed": false, "editable": true @@ -4811,7 +4830,7 @@ }, { "cell_type": "markdown", - "id": "df97ad5c", + "id": "a40ed853", "metadata": { "editable": true }, @@ -4830,7 +4849,7 @@ { "cell_type": "code", "execution_count": 37, - "id": "cf6f0fdc", + "id": "02f88360", "metadata": { "collapsed": false, "editable": true diff --git a/doc/src/week39/exercisesweek39.ipynb b/doc/src/week39/exercisesweek39.ipynb deleted file mode 100644 index d685e82d8..000000000 --- a/doc/src/week39/exercisesweek39.ipynb +++ /dev/null @@ -1,59 +0,0 @@ -{ - "cells": [ - { - "cell_type": "markdown", - "id": "f35930ac", - "metadata": { - "editable": true - }, - "source": [ - "\n", - "" - ] - }, - { - "cell_type": "markdown", - "id": "8cb567a0", - "metadata": { - "editable": true - }, - "source": [ - "# Exercises week 39\n", - "**September 25-29, 2023**\n", - "\n", - "Date: **Deadline is Sunday October 1 at midnight**" - ] - }, - { - "cell_type": "markdown", - "id": "934324b3", - "metadata": { - "editable": true - }, - "source": [ - "## Overarching aims of the exercises this week\n", - "\n", - "The aim of the exercises this week is to aid you in getting started\n", - "with writing the report. This will be discussed during the lab\n", - "sessions as well. One of the lab sessions will be recorded.\n", - "\n", - "A general guideline can be found at .\n", - "\n", - "Similarly, an example of an earlier project can be found at \n", - "\n", - "Your task this week is to\n", - "1. Write an abstract for your project\n", - "\n", - "2. Write an introduction\n", - "\n", - "3. Include references\n", - "\n", - "Ashort feedback to the this exercise will be available after the deadline. And you can reuse these elements in your final report." - ] - } - ], - "metadata": {}, - "nbformat": 4, - "nbformat_minor": 5 -} diff --git a/doc/src/week39/week39.do.txt b/doc/src/week39/week39.do.txt index fbb6a344f..c743121e9 100644 --- a/doc/src/week39/week39.do.txt +++ b/doc/src/week39/week39.do.txt @@ -5,18 +5,30 @@ DATE: Week 39 !split ===== Plan for week 39 ===== -* Repetition of Logistic regression equations and classification problems and discussion of Gradient methods. Examples on how to implement Logistic Regression and discussion of stochastic gradient descent -* Stochastic Gradient descent with examples and automatic differentiation -* Reading recommendations: - -See "lecture notes for week 39":"https://compphysics.github.io/MachineLearning/doc/web/course.html". -For a good discussion on gradient methods, we would like to recommend Goodfellow et al section 4.3-4.5 and chapter 8. We will come back to the latter chapter in our discussion of Neural networks as well. - -For Stochastic Gradient Descent, we recommend chapter 4 of Geron's text. - -_For more discussions of project 1, chapter 5 of Goodfellow et al is a good read, in particular sections 5.1-5.5 and 5.7-5.11_. +!bblock Material for the active learning sessions on Tuesday and Wednesday + * Discussions on how to structure your report for the first project + * Exercise for week 39 on how to write the abstract and the introduction of the report and how to include references. + * Work on project 1, in particular resampling methods like cross-validation and bootstrap. _For more discussions of project 1, chapter 5 of Goodfellow et al is a good read, in particular sections 5.1-5.5 and 5.7-5.11_. These sections summarize neatly what we have done till now and point to what is coming with respect to deep learning. + * A general guideline can be found at URL:"https://github.com/CompPhysics/MachineLearning/blob/master/doc/Projects/EvaluationGrading/EvaluationForm.md". +!eblock + + +!bblock Material for the lecture on Thursday September 28 + * Repetition of Logistic regression equations and classification problems and discussion of Gradient methods. Examples on how to implement Logistic Regression and discussion of stochastic gradient descent + * Stochastic Gradient descent with examples and automatic differentiation + * "Video of lecture":"https://youtu.be/" + * Whiteboard notes TBA at URL:"https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2023/NotesSep28.pdf" + * Readings and Videos: + * These lecture notes + * For a good discussion on gradient methods, we would like to recommend Goodfellow et al section 4.3-4.5 and sections 8.3-8.6. We will come back to the latter chapter in our discussion of Neural networks as well. + * "Video on gradient descent":"https://www.youtube.com/watch?v=sDv4f4s2SB8" + * "Video on stochastic gradient descent":"https://www.youtube.com/watch?v=vMh0zPT0tLI" +!eblock + + + @@ -2687,3 +2699,6 @@ print(derivative_fn(x_small)) !ec + + +