From ba5f9ea365d7e3c0bd3e695a5701a25e80ef2d3d Mon Sep 17 00:00:00 2001
From: Morten Hjorth-Jensen <morten.hjorth-jensen@fys.uio.no>
Date: Wed, 25 Oct 2023 09:38:02 +0200
Subject: [PATCH] update

---
 doc/LectureNotes/exercisesweek43.ipynb       | 438 +++++++++-----
 doc/pub/week43/html/week43-bs.html           |   7 +-
 doc/pub/week43/html/week43-reveal.html       |   7 +-
 doc/pub/week43/html/week43-solarized.html    |   7 +-
 doc/pub/week43/html/week43.html              |   7 +-
 doc/pub/week43/ipynb/ipynb-week43-src.tar.gz | Bin 191 -> 192 bytes
 doc/pub/week43/ipynb/week43.ipynb            | 581 ++++++++++---------
 doc/src/week43/exercisesweek43.do.txt        |   7 +-
 doc/src/week43/week43.do.txt                 |  10 +-
 9 files changed, 602 insertions(+), 462 deletions(-)

diff --git a/doc/LectureNotes/exercisesweek43.ipynb b/doc/LectureNotes/exercisesweek43.ipynb
index 63211a3f0..96c3390e4 100644
--- a/doc/LectureNotes/exercisesweek43.ipynb
+++ b/doc/LectureNotes/exercisesweek43.ipynb
@@ -2,8 +2,10 @@
  "cells": [
   {
    "cell_type": "markdown",
-   "id": "ae832182",
-   "metadata": {},
+   "id": "d5ebb4c0",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "<!-- HTML file automatically generated from DocOnce source (https://github.com/doconce/doconce/)\n",
     "doconce format html exercisesweek43.do.txt  -->\n",
@@ -12,8 +14,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "77f844d9",
-   "metadata": {},
+   "id": "812b4e46",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "# Exercises weeks 43 and 44 \n",
     "**October 23-27, 2023**\n",
@@ -25,8 +29,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "d5b983e3",
-   "metadata": {},
+   "id": "3230cd2f",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "# Overarching aims of the exercises weeks 43 and 44\n",
     "\n",
@@ -63,8 +69,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "7f6cc12f",
-   "metadata": {},
+   "id": "e3617d4e",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "## The AND and XOR Gates\n",
     "\n",
@@ -99,8 +107,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "c0b07e46",
-   "metadata": {},
+   "id": "54e1e7fc",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "## Representing the Data Sets\n",
     "\n",
@@ -109,8 +119,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "e0a9840a",
-   "metadata": {},
+   "id": "6b3c15cb",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "$$\n",
     "\\boldsymbol{X}=\\begin{bmatrix} 0 & 0 \\\\\n",
@@ -122,8 +134,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "ff95d379",
-   "metadata": {},
+   "id": "acc25271",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "while the vector of outputs is $\\boldsymbol{y}^T=[0,1,1,0]$ for the XOR gate, $\\boldsymbol{y}^T=[0,0,0,1]$ for the AND gate and $\\boldsymbol{y}^T=[0,1,1,1]$ for the OR gate.\n",
     "\n",
@@ -150,8 +164,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "36fa3466",
-   "metadata": {},
+   "id": "ffe0a840",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "## Setting up dimensionalities by hand\n",
     "\n",
@@ -160,8 +176,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "e2e5e808",
-   "metadata": {},
+   "id": "46abf545",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "$$\n",
     "\\boldsymbol{W_h}=\\begin{bmatrix} 1 & 1 \\\\\n",
@@ -171,16 +189,20 @@
   },
   {
    "cell_type": "markdown",
-   "id": "419e3904",
-   "metadata": {},
+   "id": "86e105cc",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "Multiplying $\\boldsymbol{X}$ and $\\boldsymbol{W}$ gives"
    ]
   },
   {
    "cell_type": "markdown",
-   "id": "88a9712a",
-   "metadata": {},
+   "id": "5e1d21f1",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "$$\n",
     "\\boldsymbol{X}{W}_h=\\begin{bmatrix} 0 & 0 \\\\\n",
@@ -192,16 +214,20 @@
   },
   {
    "cell_type": "markdown",
-   "id": "036eee14",
-   "metadata": {},
+   "id": "692c6cbf",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "Assume also that the bias vector for the hidden layer is"
    ]
   },
   {
    "cell_type": "markdown",
-   "id": "3c771918",
-   "metadata": {},
+   "id": "5d81e641",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "$$\n",
     "\\boldsymbol{b}_h=\\begin{bmatrix} 0 \\\\\n",
@@ -211,16 +237,20 @@
   },
   {
    "cell_type": "markdown",
-   "id": "f5a4150d",
-   "metadata": {},
+   "id": "a42bdee4",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "Adding it gives us the input to the activation function of the hidden layer"
    ]
   },
   {
    "cell_type": "markdown",
-   "id": "e4eb7753",
-   "metadata": {},
+   "id": "5116b854",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "$$\n",
     "\\boldsymbol{z}_h=\\boldsymbol{X}\\boldsymbol{W}_h+\\boldsymbol{b}_h=\\begin{bmatrix} 0 & -1 \\\\\n",
@@ -232,16 +262,20 @@
   },
   {
    "cell_type": "markdown",
-   "id": "b5442b32",
-   "metadata": {},
+   "id": "8dd26d09",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "Let us then assume that our activation function is the RELU function, which simply means that we take the max of $0$ and the elements of the input argument $\\boldsymbol{z}_h$, that is we have"
    ]
   },
   {
    "cell_type": "markdown",
-   "id": "64d99f85",
-   "metadata": {},
+   "id": "ebf97c03",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "$$\n",
     "\\boldsymbol{a}_h=\\mathrm{RELU}(\\boldsymbol{z}_h=\\boldsymbol{X}\\boldsymbol{W}_h+\\boldsymbol{b}_h)=\\begin{bmatrix} 0 & 0 \\\\\n",
@@ -253,16 +287,20 @@
   },
   {
    "cell_type": "markdown",
-   "id": "2aee4b6b",
-   "metadata": {},
+   "id": "262a4a3a",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "Assume also that the bias of the output layer is zero and that the weights of the output layer are"
    ]
   },
   {
    "cell_type": "markdown",
-   "id": "884541eb",
-   "metadata": {},
+   "id": "f03ad8e7",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "$$\n",
     "\\boldsymbol{w}_o=\\begin{bmatrix} 1 \\\\\n",
@@ -272,37 +310,46 @@
   },
   {
    "cell_type": "markdown",
-   "id": "3999a4d5",
-   "metadata": {},
+   "id": "36fe00c0",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "and multiplying with $\\boldsymbol{a}_h$ gives the output"
    ]
   },
   {
    "cell_type": "markdown",
-   "id": "a4896b4d",
-   "metadata": {},
+   "id": "80ab43ac",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "$$\n",
-    "\\boldsymbol{a}_o=\\boldsymbol{w}_h^T\\begin{bmatrix} 0 & 0 \\\\\n",
+    "\\boldsymbol{a}_o=\\begin{bmatrix} 0 & 0 \\\\\n",
     "                       1 & 0 \\\\\n",
     "\t\t       1 & 0 \\\\\n",
-    "\t\t       2 & 1 \\end{bmatrix}=\\begin{bmatrix} 0 \\\\ 1 \\\\ 1 \\\\0\\end{bmatrix},\n",
+    "\t\t       2 & 1 \\end{bmatrix}\\begin{bmatrix} 1 \\\\\n",
+    "                       -2\\end{bmatrix}=\\begin{bmatrix} 0 \\\\ 1 \\\\ 1 \\\\0\\end{bmatrix},\n",
     "$$"
    ]
   },
   {
    "cell_type": "markdown",
-   "id": "2c74e7c0",
-   "metadata": {},
+   "id": "86bcfe49",
+   "metadata": {
+    "editable": true
+   },
    "source": [
-    "the wanted result."
+    "the wanted result.  Pay attention to the dimensionalities as well."
    ]
   },
   {
    "cell_type": "markdown",
-   "id": "249b9804",
-   "metadata": {},
+   "id": "f19a899e",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "## Setting up the Neural Network\n",
     "\n",
@@ -312,8 +359,11 @@
   {
    "cell_type": "code",
    "execution_count": 1,
-   "id": "afdd3100",
-   "metadata": {},
+   "id": "901ddca7",
+   "metadata": {
+    "collapsed": false,
+    "editable": true
+   },
    "outputs": [],
    "source": [
     "%matplotlib inline\n",
@@ -379,16 +429,20 @@
   },
   {
    "cell_type": "markdown",
-   "id": "fb383164",
-   "metadata": {},
+   "id": "53f22266",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "Not an impressive result, but this was our first forward pass with randomly assigned weights. Let us now add the full network with the back-propagation algorithm discussed above."
    ]
   },
   {
    "cell_type": "markdown",
-   "id": "0d26394c",
-   "metadata": {},
+   "id": "5f665ac6",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "## The Code using Scikit-Learn"
    ]
@@ -396,8 +450,11 @@
   {
    "cell_type": "code",
    "execution_count": 2,
-   "id": "befc368c",
-   "metadata": {},
+   "id": "cb396cda",
+   "metadata": {
+    "collapsed": false,
+    "editable": true
+   },
    "outputs": [],
    "source": [
     "# import necessary packages\n",
@@ -458,8 +515,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "03895a9f",
-   "metadata": {},
+   "id": "c5978471",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "## Building a neural network code\n",
     "\n",
@@ -475,8 +534,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "6226915b",
-   "metadata": {},
+   "id": "7b82dc46",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "### Learning rate methods\n",
     "\n",
@@ -495,8 +556,11 @@
   {
    "cell_type": "code",
    "execution_count": 3,
-   "id": "b6d5ea73",
-   "metadata": {},
+   "id": "de4dedfb",
+   "metadata": {
+    "collapsed": false,
+    "editable": true
+   },
    "outputs": [],
    "source": [
     "import autograd.numpy as np\n",
@@ -633,8 +697,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "edb42bef",
-   "metadata": {},
+   "id": "bb621fce",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "### Usage of the above learning rate schedulers\n",
     "\n",
@@ -647,8 +713,11 @@
   {
    "cell_type": "code",
    "execution_count": 4,
-   "id": "108c1209",
-   "metadata": {},
+   "id": "34ddb829",
+   "metadata": {
+    "collapsed": false,
+    "editable": true
+   },
    "outputs": [],
    "source": [
     "momentum_scheduler = Momentum(eta=1e-3, momentum=0.9)\n",
@@ -657,8 +726,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "d1c423f0",
-   "metadata": {},
+   "id": "e43498d4",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "Here is a small example for how a segment of code using schedulers\n",
     "could look. Switching out the schedulers is simple."
@@ -667,8 +738,11 @@
   {
    "cell_type": "code",
    "execution_count": 5,
-   "id": "63c8c749",
-   "metadata": {},
+   "id": "f05b9625",
+   "metadata": {
+    "collapsed": false,
+    "editable": true
+   },
    "outputs": [],
    "source": [
     "weights = np.ones((3,3))\n",
@@ -686,8 +760,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "7cb80992",
-   "metadata": {},
+   "id": "19cf9841",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "### Cost functions\n",
     "\n",
@@ -700,8 +776,11 @@
   {
    "cell_type": "code",
    "execution_count": 6,
-   "id": "a181dacb",
-   "metadata": {},
+   "id": "993efa8d",
+   "metadata": {
+    "collapsed": false,
+    "editable": true
+   },
    "outputs": [],
    "source": [
     "import autograd.numpy as np\n",
@@ -735,8 +814,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "26a7fe37",
-   "metadata": {},
+   "id": "011c734c",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "Below we give a short example of how these cost function may be used\n",
     "to obtain results if you wish to test them out on your own using\n",
@@ -746,8 +827,11 @@
   {
    "cell_type": "code",
    "execution_count": 7,
-   "id": "5894bd31",
-   "metadata": {},
+   "id": "9e1b97f5",
+   "metadata": {
+    "collapsed": false,
+    "editable": true
+   },
    "outputs": [],
    "source": [
     "from autograd import grad\n",
@@ -764,8 +848,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "71141fab",
-   "metadata": {},
+   "id": "4acd87b2",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "### Activation functions\n",
     "\n",
@@ -778,8 +864,11 @@
   {
    "cell_type": "code",
    "execution_count": 8,
-   "id": "433e0886",
-   "metadata": {},
+   "id": "befa86ae",
+   "metadata": {
+    "collapsed": false,
+    "editable": true
+   },
    "outputs": [],
    "source": [
     "import autograd.numpy as np\n",
@@ -833,8 +922,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "14c9d538",
-   "metadata": {},
+   "id": "c20aa75e",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "Below follows a short demonstration of how to use an activation\n",
     "function. The derivative of the activation function will be important\n",
@@ -846,8 +937,11 @@
   {
    "cell_type": "code",
    "execution_count": 9,
-   "id": "4c3a44ef",
-   "metadata": {},
+   "id": "e209f9e5",
+   "metadata": {
+    "collapsed": false,
+    "editable": true
+   },
    "outputs": [],
    "source": [
     "z = np.array([[4, 5, 6]]).T\n",
@@ -864,8 +958,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "aa7f604e",
-   "metadata": {},
+   "id": "524b409b",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "### The Neural Network\n",
     "\n",
@@ -886,8 +982,11 @@
   {
    "cell_type": "code",
    "execution_count": 10,
-   "id": "585a227b",
-   "metadata": {},
+   "id": "083116d3",
+   "metadata": {
+    "collapsed": false,
+    "editable": true
+   },
    "outputs": [],
    "source": [
     "import math\n",
@@ -1355,8 +1454,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "7de704af",
-   "metadata": {},
+   "id": "e4ba55d0",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "Before we make a model, we will quickly generate a dataset we can use\n",
     "for our linear regression problem as shown below"
@@ -1365,8 +1466,11 @@
   {
    "cell_type": "code",
    "execution_count": 11,
-   "id": "212b0a35",
-   "metadata": {},
+   "id": "c72a22c6",
+   "metadata": {
+    "collapsed": false,
+    "editable": true
+   },
    "outputs": [],
    "source": [
     "import autograd.numpy as np\n",
@@ -1406,8 +1510,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "1ff4ec7b",
-   "metadata": {},
+   "id": "25b63b47",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "Now that we have our dataset ready for the regression, we can create\n",
     "our regressor. Note that with the seed parameter, we can make sure our\n",
@@ -1420,8 +1526,11 @@
   {
    "cell_type": "code",
    "execution_count": 12,
-   "id": "57d8eca3",
-   "metadata": {},
+   "id": "b6b4e461",
+   "metadata": {
+    "collapsed": false,
+    "editable": true
+   },
    "outputs": [],
    "source": [
     "input_nodes = X_train.shape[1]\n",
@@ -1432,8 +1541,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "f1977bae",
-   "metadata": {},
+   "id": "d7860b74",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "We then fit our model with our training data using the scheduler of our choice."
    ]
@@ -1441,8 +1552,11 @@
   {
    "cell_type": "code",
    "execution_count": 13,
-   "id": "31ae2a1e",
-   "metadata": {},
+   "id": "00522c73",
+   "metadata": {
+    "collapsed": false,
+    "editable": true
+   },
    "outputs": [],
    "source": [
     "linear_regression.reset_weights() # reset weights such that previous runs or reruns don't affect the weights\n",
@@ -1453,8 +1567,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "96a64da4",
-   "metadata": {},
+   "id": "a57bfb12",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "Due to the progress bar we can see the MSE (train_error) throughout\n",
     "the FFNN's training. Note that the fit() function has some optional\n",
@@ -1467,8 +1583,11 @@
   {
    "cell_type": "code",
    "execution_count": 14,
-   "id": "246499fc",
-   "metadata": {},
+   "id": "35259e41",
+   "metadata": {
+    "collapsed": false,
+    "editable": true
+   },
    "outputs": [],
    "source": [
     "linear_regression.reset_weights() # reset weights such that previous runs or reruns don't affect the weights\n",
@@ -1478,8 +1597,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "61d11e17",
-   "metadata": {},
+   "id": "4a403370",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "We see that given more epochs to train on, the regressor reaches a lower MSE.\n",
     "\n",
@@ -1491,8 +1612,11 @@
   {
    "cell_type": "code",
    "execution_count": 15,
-   "id": "b5b91899",
-   "metadata": {},
+   "id": "6c791130",
+   "metadata": {
+    "collapsed": false,
+    "editable": true
+   },
    "outputs": [],
    "source": [
     "from sklearn.datasets import load_breast_cancer\n",
@@ -1514,8 +1638,11 @@
   {
    "cell_type": "code",
    "execution_count": 16,
-   "id": "4bd01b3d",
-   "metadata": {},
+   "id": "0ac0258d",
+   "metadata": {
+    "collapsed": false,
+    "editable": true
+   },
    "outputs": [],
    "source": [
     "input_nodes = X_train.shape[1]\n",
@@ -1526,8 +1653,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "3a138d66",
-   "metadata": {},
+   "id": "a9c74baa",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "We will now make use of our validation data by passing it into our fit function as a keyword argument"
    ]
@@ -1535,8 +1664,11 @@
   {
    "cell_type": "code",
    "execution_count": 17,
-   "id": "faf1534e",
-   "metadata": {},
+   "id": "e5021bbf",
+   "metadata": {
+    "collapsed": false,
+    "editable": true
+   },
    "outputs": [],
    "source": [
     "logistic_regression.reset_weights() # reset weights such that previous runs or reruns don't affect the weights\n",
@@ -1547,8 +1679,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "33d2d346",
-   "metadata": {},
+   "id": "ae0148bb",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "Finally, we will create a neural network with 2 hidden layers with activation functions."
    ]
@@ -1556,8 +1690,11 @@
   {
    "cell_type": "code",
    "execution_count": 18,
-   "id": "a8f0a61c",
-   "metadata": {},
+   "id": "bb7e4340",
+   "metadata": {
+    "collapsed": false,
+    "editable": true
+   },
    "outputs": [],
    "source": [
     "input_nodes = X_train.shape[1]\n",
@@ -1573,8 +1710,11 @@
   {
    "cell_type": "code",
    "execution_count": 19,
-   "id": "d651702d",
-   "metadata": {},
+   "id": "d0655afb",
+   "metadata": {
+    "collapsed": false,
+    "editable": true
+   },
    "outputs": [],
    "source": [
     "neural_network.reset_weights() # reset weights such that previous runs or reruns don't affect the weights\n",
@@ -1585,8 +1725,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "200b64c0",
-   "metadata": {},
+   "id": "dc8a90af",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "### Multiclass classification\n",
     "\n",
@@ -1598,8 +1740,11 @@
   {
    "cell_type": "code",
    "execution_count": 20,
-   "id": "98b8d59b",
-   "metadata": {},
+   "id": "9305c08a",
+   "metadata": {
+    "collapsed": false,
+    "editable": true
+   },
    "outputs": [],
    "source": [
     "from sklearn.datasets import load_digits\n",
@@ -1632,8 +1777,10 @@
   },
   {
    "cell_type": "markdown",
-   "id": "cadd7e47",
-   "metadata": {},
+   "id": "8e208051",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "## Testing the XOR gate and other gates\n",
     "\n",
@@ -1643,8 +1790,11 @@
   {
    "cell_type": "code",
    "execution_count": 21,
-   "id": "a40e5cfe",
-   "metadata": {},
+   "id": "db016d41",
+   "metadata": {
+    "collapsed": false,
+    "editable": true
+   },
    "outputs": [],
    "source": [
     "X = np.array([ [0, 0], [0, 1], [1, 0],[1, 1]],dtype=np.float64)\n",
@@ -1663,32 +1813,16 @@
   },
   {
    "cell_type": "markdown",
-   "id": "b635db73",
-   "metadata": {},
+   "id": "d1384449",
+   "metadata": {
+    "editable": true
+   },
    "source": [
     "Not bad, but the results depend strongly on the learning reate. Try different learning rates."
    ]
   }
  ],
- "metadata": {
-  "kernelspec": {
-   "display_name": "Python 3 (ipykernel)",
-   "language": "python",
-   "name": "python3"
-  },
-  "language_info": {
-   "codemirror_mode": {
-    "name": "ipython",
-    "version": 3
-   },
-   "file_extension": ".py",
-   "mimetype": "text/x-python",
-   "name": "python",
-   "nbconvert_exporter": "python",
-   "pygments_lexer": "ipython3",
-   "version": "3.9.10"
-  }
- },
+ "metadata": {},
  "nbformat": 4,
  "nbformat_minor": 5
 }
diff --git a/doc/pub/week43/html/week43-bs.html b/doc/pub/week43/html/week43-bs.html
index 4383cb68a..b2de3d75a 100644
--- a/doc/pub/week43/html/week43-bs.html
+++ b/doc/pub/week43/html/week43-bs.html
@@ -698,13 +698,14 @@ $$
 
 <p>and multiplying with \( \boldsymbol{a}_h \) gives the output</p>
 $$
-\boldsymbol{a}_o=\boldsymbol{w}_h^T\begin{bmatrix} 0 & 0 \\
+\boldsymbol{a}_o=\begin{bmatrix} 0 & 0 \\
                        1 & 0 \\
 		       1 & 0 \\
-		       2 & 1 \end{bmatrix}=\begin{bmatrix} 0 \\ 1 \\ 1 \\0\end{bmatrix},
+		       2 & 1 \end{bmatrix}\begin{bmatrix} 1 \\
+                       -2\end{bmatrix}=\begin{bmatrix} 0 \\ 1 \\ 1 \\0\end{bmatrix},
 $$
 
-<p>the wanted result.</p>
+<p>the wanted result.  Pay attention to the dimensionalities as well.</p>
 
 <!-- !split -->
 <h2 id="setting-up-the-neural-network" class="anchor">Setting up the Neural Network </h2>
diff --git a/doc/pub/week43/html/week43-reveal.html b/doc/pub/week43/html/week43-reveal.html
index 0acd6b052..44e7b3b2b 100644
--- a/doc/pub/week43/html/week43-reveal.html
+++ b/doc/pub/week43/html/week43-reveal.html
@@ -426,14 +426,15 @@ $$
 <p>and multiplying with \( \boldsymbol{a}_h \) gives the output</p>
 <p>&nbsp;<br>
 $$
-\boldsymbol{a}_o=\boldsymbol{w}_h^T\begin{bmatrix} 0 & 0 \\
+\boldsymbol{a}_o=\begin{bmatrix} 0 & 0 \\
                        1 & 0 \\
 		       1 & 0 \\
-		       2 & 1 \end{bmatrix}=\begin{bmatrix} 0 \\ 1 \\ 1 \\0\end{bmatrix},
+		       2 & 1 \end{bmatrix}\begin{bmatrix} 1 \\
+                       -2\end{bmatrix}=\begin{bmatrix} 0 \\ 1 \\ 1 \\0\end{bmatrix},
 $$
 <p>&nbsp;<br>
 
-<p>the wanted result.</p>
+<p>the wanted result.  Pay attention to the dimensionalities as well.</p>
 </section>
 
 <section>
diff --git a/doc/pub/week43/html/week43-solarized.html b/doc/pub/week43/html/week43-solarized.html
index c7e2f3865..aed8ff56d 100644
--- a/doc/pub/week43/html/week43-solarized.html
+++ b/doc/pub/week43/html/week43-solarized.html
@@ -578,13 +578,14 @@ $$
 
 <p>and multiplying with \( \boldsymbol{a}_h \) gives the output</p>
 $$
-\boldsymbol{a}_o=\boldsymbol{w}_h^T\begin{bmatrix} 0 & 0 \\
+\boldsymbol{a}_o=\begin{bmatrix} 0 & 0 \\
                        1 & 0 \\
 		       1 & 0 \\
-		       2 & 1 \end{bmatrix}=\begin{bmatrix} 0 \\ 1 \\ 1 \\0\end{bmatrix},
+		       2 & 1 \end{bmatrix}\begin{bmatrix} 1 \\
+                       -2\end{bmatrix}=\begin{bmatrix} 0 \\ 1 \\ 1 \\0\end{bmatrix},
 $$
 
-<p>the wanted result.</p>
+<p>the wanted result.  Pay attention to the dimensionalities as well.</p>
 
 <!-- !split --><br><br><br><br><br><br><br><br><br><br>
 <h2 id="setting-up-the-neural-network">Setting up the Neural Network </h2>
diff --git a/doc/pub/week43/html/week43.html b/doc/pub/week43/html/week43.html
index 6b6ca1818..3df7f021a 100644
--- a/doc/pub/week43/html/week43.html
+++ b/doc/pub/week43/html/week43.html
@@ -655,13 +655,14 @@ $$
 
 <p>and multiplying with \( \boldsymbol{a}_h \) gives the output</p>
 $$
-\boldsymbol{a}_o=\boldsymbol{w}_h^T\begin{bmatrix} 0 & 0 \\
+\boldsymbol{a}_o=\begin{bmatrix} 0 & 0 \\
                        1 & 0 \\
 		       1 & 0 \\
-		       2 & 1 \end{bmatrix}=\begin{bmatrix} 0 \\ 1 \\ 1 \\0\end{bmatrix},
+		       2 & 1 \end{bmatrix}\begin{bmatrix} 1 \\
+                       -2\end{bmatrix}=\begin{bmatrix} 0 \\ 1 \\ 1 \\0\end{bmatrix},
 $$
 
-<p>the wanted result.</p>
+<p>the wanted result.  Pay attention to the dimensionalities as well.</p>
 
 <!-- !split --><br><br><br><br><br><br><br><br><br><br>
 <h2 id="setting-up-the-neural-network">Setting up the Neural Network </h2>
diff --git a/doc/pub/week43/ipynb/ipynb-week43-src.tar.gz b/doc/pub/week43/ipynb/ipynb-week43-src.tar.gz
index fe7dc31b6d827d2521bd87b0b5edf5b03aaff74e..f64f296e41763cea0671142cb2f49c768058f2eb 100644
GIT binary patch
literal 192
zcmV;x06+g9iwFSE#W-aE1MSbv3c@f92k@Qu6nTQt+HN}w?%+WX@dY}TxjNU*wnO*!
z?gR9sco`z}cli?%LUPE~n_U*Uy9*XW2uV1HG1DZTlC0)>LTL<?$26gQmC_UlWiev`
zkmXK#>8ulGIHjr1s4S{?bHi9!e%Ld=0?+&t$4Xk*?t52h1xh>2wXWfYSaTN1wpTe6
u8tvEugV#<P1fhBmMIoKkN?gL$=#vqRjly3)<9VLveeD5&-*+eg2mk>1j#-xg

literal 191
zcmV;w06_mAiwFRYn>b|v1MSaC3c@fD2H>uHia9|^Y!cUkE?fvAULd7Y8*7uAq-bw%
zAD}D6O%WmA=AV#Zm^o}#>)j^tcOT7$5F!|ZA(w)WNfy(4L@5W#I2C;%r~pD!p3(@&
zd@H@Q&P&^`QkQ4c4)wdfzO5)e%$ZJsXa0#}sT^$goiB|BZ9HbiRB%JASemG&(;4Ij
t-S7n#udT8OQg<NpTzO@*yu^()Co5~0#J@f!2!bH^+5?2?OvC^P001qIQ*QtO

diff --git a/doc/pub/week43/ipynb/week43.ipynb b/doc/pub/week43/ipynb/week43.ipynb
index 8de3714cd..4c84cfe33 100644
--- a/doc/pub/week43/ipynb/week43.ipynb
+++ b/doc/pub/week43/ipynb/week43.ipynb
@@ -2,7 +2,7 @@
  "cells": [
   {
    "cell_type": "markdown",
-   "id": "8d7cc066",
+   "id": "88f6e253",
    "metadata": {
     "editable": true
    },
@@ -14,7 +14,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "028dc8c6",
+   "id": "ebd16d73",
    "metadata": {
     "editable": true
    },
@@ -29,7 +29,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "15ef2310",
+   "id": "e9bc94b9",
    "metadata": {
     "editable": true
    },
@@ -73,7 +73,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "192aa783",
+   "id": "457d4421",
    "metadata": {
     "editable": true
    },
@@ -87,7 +87,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "22874f1a",
+   "id": "e86537af",
    "metadata": {
     "editable": true
    },
@@ -104,7 +104,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "29c53621",
+   "id": "14ffcfd0",
    "metadata": {
     "editable": true
    },
@@ -114,7 +114,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "c3ab8226",
+   "id": "5773ab41",
    "metadata": {
     "editable": true
    },
@@ -151,7 +151,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "d686af76",
+   "id": "fdcb6f1e",
    "metadata": {
     "editable": true
    },
@@ -189,7 +189,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "9e6ae224",
+   "id": "7bc3e18a",
    "metadata": {
     "editable": true
    },
@@ -201,7 +201,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "ee5e7e34",
+   "id": "b82f5167",
    "metadata": {
     "editable": true
    },
@@ -216,7 +216,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "da275174",
+   "id": "1ff6327f",
    "metadata": {
     "editable": true
    },
@@ -246,7 +246,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "78669a54",
+   "id": "fd88cb2a",
    "metadata": {
     "editable": true
    },
@@ -258,7 +258,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "453ff3ab",
+   "id": "277ccf21",
    "metadata": {
     "editable": true
    },
@@ -271,7 +271,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "9d82c2f1",
+   "id": "69024cd6",
    "metadata": {
     "editable": true
    },
@@ -281,7 +281,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "a22ab766",
+   "id": "3739f7f4",
    "metadata": {
     "editable": true
    },
@@ -296,7 +296,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "abfc4274",
+   "id": "891fbfbd",
    "metadata": {
     "editable": true
    },
@@ -306,7 +306,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "2b7b0970",
+   "id": "0befa9f2",
    "metadata": {
     "editable": true
    },
@@ -319,7 +319,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "d1e78b4a",
+   "id": "8b87520f",
    "metadata": {
     "editable": true
    },
@@ -329,7 +329,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "0ee46428",
+   "id": "0c36a6e9",
    "metadata": {
     "editable": true
    },
@@ -344,7 +344,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "bac66371",
+   "id": "6a5ebf2f",
    "metadata": {
     "editable": true
    },
@@ -354,7 +354,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "77606059",
+   "id": "5c2cce0f",
    "metadata": {
     "editable": true
    },
@@ -369,7 +369,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "b1a1f219",
+   "id": "6700bff0",
    "metadata": {
     "editable": true
    },
@@ -379,7 +379,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "a46fd0d7",
+   "id": "c9deb439",
    "metadata": {
     "editable": true
    },
@@ -392,7 +392,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "01e41f6f",
+   "id": "bca3d76a",
    "metadata": {
     "editable": true
    },
@@ -402,32 +402,33 @@
   },
   {
    "cell_type": "markdown",
-   "id": "371a2c47",
+   "id": "0fd2b2d0",
    "metadata": {
     "editable": true
    },
    "source": [
     "$$\n",
-    "\\boldsymbol{a}_o=\\boldsymbol{w}_h^T\\begin{bmatrix} 0 & 0 \\\\\n",
+    "\\boldsymbol{a}_o=\\begin{bmatrix} 0 & 0 \\\\\n",
     "                       1 & 0 \\\\\n",
     "\t\t       1 & 0 \\\\\n",
-    "\t\t       2 & 1 \\end{bmatrix}=\\begin{bmatrix} 0 \\\\ 1 \\\\ 1 \\\\0\\end{bmatrix},\n",
+    "\t\t       2 & 1 \\end{bmatrix}\\begin{bmatrix} 1 \\\\\n",
+    "                       -2\\end{bmatrix}=\\begin{bmatrix} 0 \\\\ 1 \\\\ 1 \\\\0\\end{bmatrix},\n",
     "$$"
    ]
   },
   {
    "cell_type": "markdown",
-   "id": "8ab62ed9",
+   "id": "aef5937c",
    "metadata": {
     "editable": true
    },
    "source": [
-    "the wanted result."
+    "the wanted result.  Pay attention to the dimensionalities as well."
    ]
   },
   {
    "cell_type": "markdown",
-   "id": "ee45366d",
+   "id": "784de267",
    "metadata": {
     "editable": true
    },
@@ -440,7 +441,7 @@
   {
    "cell_type": "code",
    "execution_count": 1,
-   "id": "43b32c8a",
+   "id": "1529f64e",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -510,7 +511,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "ce3f8d7b",
+   "id": "6c344985",
    "metadata": {
     "editable": true
    },
@@ -520,7 +521,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "0a60227f",
+   "id": "dda91d6e",
    "metadata": {
     "editable": true
    },
@@ -531,7 +532,7 @@
   {
    "cell_type": "code",
    "execution_count": 2,
-   "id": "0574c4c7",
+   "id": "dc12224d",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -596,7 +597,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "c3db2190",
+   "id": "7c9b27ed",
    "metadata": {
     "editable": true
    },
@@ -615,7 +616,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "3b6e8500",
+   "id": "e8e28114",
    "metadata": {
     "editable": true
    },
@@ -637,7 +638,7 @@
   {
    "cell_type": "code",
    "execution_count": 3,
-   "id": "ee32fb88",
+   "id": "37a2ec80",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -778,7 +779,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "6477d18f",
+   "id": "38ea41a5",
    "metadata": {
     "editable": true
    },
@@ -794,7 +795,7 @@
   {
    "cell_type": "code",
    "execution_count": 4,
-   "id": "5a396095",
+   "id": "869cf239",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -807,7 +808,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "28bd1ab9",
+   "id": "b9b25144",
    "metadata": {
     "editable": true
    },
@@ -819,7 +820,7 @@
   {
    "cell_type": "code",
    "execution_count": 5,
-   "id": "fb5d04e9",
+   "id": "7d2dc23b",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -841,7 +842,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "f1229684",
+   "id": "83b5e35f",
    "metadata": {
     "editable": true
    },
@@ -857,7 +858,7 @@
   {
    "cell_type": "code",
    "execution_count": 6,
-   "id": "f4a50c76",
+   "id": "4c217329",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -895,7 +896,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "3d646164",
+   "id": "a0515ac9",
    "metadata": {
     "editable": true
    },
@@ -908,7 +909,7 @@
   {
    "cell_type": "code",
    "execution_count": 7,
-   "id": "b0057b55",
+   "id": "5eb41a10",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -929,7 +930,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "37f67196",
+   "id": "0535d6fd",
    "metadata": {
     "editable": true
    },
@@ -945,7 +946,7 @@
   {
    "cell_type": "code",
    "execution_count": 8,
-   "id": "ae3c2dad",
+   "id": "c55d6d5f",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -1003,7 +1004,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "5be7f268",
+   "id": "b820a2a1",
    "metadata": {
     "editable": true
    },
@@ -1018,7 +1019,7 @@
   {
    "cell_type": "code",
    "execution_count": 9,
-   "id": "5296db7b",
+   "id": "43974d31",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -1039,7 +1040,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "fa62814a",
+   "id": "ec754834",
    "metadata": {
     "editable": true
    },
@@ -1063,7 +1064,7 @@
   {
    "cell_type": "code",
    "execution_count": 10,
-   "id": "08db6527",
+   "id": "505e52ab",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -1535,7 +1536,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "464f4548",
+   "id": "00aa7046",
    "metadata": {
     "editable": true
    },
@@ -1547,7 +1548,7 @@
   {
    "cell_type": "code",
    "execution_count": 11,
-   "id": "ea3d3c51",
+   "id": "b0b45dd4",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -1591,7 +1592,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "a6b49446",
+   "id": "cf9645c3",
    "metadata": {
     "editable": true
    },
@@ -1607,7 +1608,7 @@
   {
    "cell_type": "code",
    "execution_count": 12,
-   "id": "4f0f50b6",
+   "id": "a792c324",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -1622,7 +1623,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "8ae3f1e4",
+   "id": "e11ed70e",
    "metadata": {
     "editable": true
    },
@@ -1633,7 +1634,7 @@
   {
    "cell_type": "code",
    "execution_count": 13,
-   "id": "4d206fa2",
+   "id": "dfd03f3c",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -1648,7 +1649,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "27ffcb75",
+   "id": "99b1bd91",
    "metadata": {
     "editable": true
    },
@@ -1664,7 +1665,7 @@
   {
    "cell_type": "code",
    "execution_count": 14,
-   "id": "8cf19432",
+   "id": "864038bb",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -1678,7 +1679,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "97abfa15",
+   "id": "24d5f3cc",
    "metadata": {
     "editable": true
    },
@@ -1693,7 +1694,7 @@
   {
    "cell_type": "code",
    "execution_count": 15,
-   "id": "5aa3cb16",
+   "id": "14df9a52",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -1719,7 +1720,7 @@
   {
    "cell_type": "code",
    "execution_count": 16,
-   "id": "793cb2e9",
+   "id": "adb3edf2",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -1734,7 +1735,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "7b47a35a",
+   "id": "fa885022",
    "metadata": {
     "editable": true
    },
@@ -1745,7 +1746,7 @@
   {
    "cell_type": "code",
    "execution_count": 17,
-   "id": "e34123b4",
+   "id": "1b862f90",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -1760,7 +1761,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "413243c9",
+   "id": "e86e60dc",
    "metadata": {
     "editable": true
    },
@@ -1771,7 +1772,7 @@
   {
    "cell_type": "code",
    "execution_count": 18,
-   "id": "aa7b9e8f",
+   "id": "9e578191",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -1791,7 +1792,7 @@
   {
    "cell_type": "code",
    "execution_count": 19,
-   "id": "c66ee57f",
+   "id": "bbfc34f4",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -1806,7 +1807,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "aca7922f",
+   "id": "2ac7ad43",
    "metadata": {
     "editable": true
    },
@@ -1821,7 +1822,7 @@
   {
    "cell_type": "code",
    "execution_count": 20,
-   "id": "1503f15a",
+   "id": "f4a821cd",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -1858,7 +1859,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "838cf72d",
+   "id": "0fcf8bf2",
    "metadata": {
     "editable": true
    },
@@ -1871,7 +1872,7 @@
   {
    "cell_type": "code",
    "execution_count": 21,
-   "id": "a4444105",
+   "id": "d91608cf",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -1894,7 +1895,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "8bbdf09c",
+   "id": "494009be",
    "metadata": {
     "editable": true
    },
@@ -1904,7 +1905,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "c5cffe73",
+   "id": "db70a4fe",
    "metadata": {
     "editable": true
    },
@@ -1914,7 +1915,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "e88dc6ab",
+   "id": "e5fc9732",
    "metadata": {
     "editable": true
    },
@@ -1943,7 +1944,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "8ec227a0",
+   "id": "1f986c86",
    "metadata": {
     "editable": true
    },
@@ -1993,7 +1994,7 @@
   {
    "cell_type": "code",
    "execution_count": 22,
-   "id": "5336138a",
+   "id": "0f845fb5",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -2046,7 +2047,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "da4f9c76",
+   "id": "fbab1656",
    "metadata": {
     "editable": true
    },
@@ -2067,7 +2068,7 @@
   {
    "cell_type": "code",
    "execution_count": 23,
-   "id": "3d4a38d4",
+   "id": "3ecd3028",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -2105,7 +2106,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "bc7c43bb",
+   "id": "b45412df",
    "metadata": {
     "editable": true
    },
@@ -2149,7 +2150,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "60a15786",
+   "id": "e90b1e65",
    "metadata": {
     "editable": true
    },
@@ -2189,7 +2190,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "d9b2c952",
+   "id": "92bff738",
    "metadata": {
     "editable": true
    },
@@ -2210,7 +2211,7 @@
   {
    "cell_type": "code",
    "execution_count": 24,
-   "id": "a6dfcaaf",
+   "id": "8eb225e4",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -2236,7 +2237,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "623ec89c",
+   "id": "da1e7ad6",
    "metadata": {
     "editable": true
    },
@@ -2264,7 +2265,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "391b8f09",
+   "id": "52ea3780",
    "metadata": {
     "editable": true
    },
@@ -2301,7 +2302,7 @@
   {
    "cell_type": "code",
    "execution_count": 25,
-   "id": "a3a7a56e",
+   "id": "8ec12507",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -2347,7 +2348,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "6a467f9c",
+   "id": "518a6c33",
    "metadata": {
     "editable": true
    },
@@ -2378,7 +2379,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "824f2150",
+   "id": "9e4fe561",
    "metadata": {
     "editable": true
    },
@@ -2416,7 +2417,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "ad801a4f",
+   "id": "331db754",
    "metadata": {
     "editable": true
    },
@@ -2450,7 +2451,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "adbd5bf5",
+   "id": "94f8797f",
    "metadata": {
     "editable": true
    },
@@ -2491,7 +2492,7 @@
   {
    "cell_type": "code",
    "execution_count": 26,
-   "id": "03850373",
+   "id": "6cc0ad5a",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -2570,7 +2571,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "5c4ce702",
+   "id": "66341fe5",
    "metadata": {
     "editable": true
    },
@@ -2591,7 +2592,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "f54c055f",
+   "id": "4654bdd2",
    "metadata": {
     "editable": true
    },
@@ -2605,7 +2606,7 @@
   {
    "cell_type": "code",
    "execution_count": 27,
-   "id": "05fadefb",
+   "id": "84200c9e",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -2715,7 +2716,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "6d6bba32",
+   "id": "2fade818",
    "metadata": {
     "editable": true
    },
@@ -2734,7 +2735,7 @@
   {
    "cell_type": "code",
    "execution_count": 28,
-   "id": "5605c90f",
+   "id": "da2d74fa",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -2761,7 +2762,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "f22bb889",
+   "id": "45f911b8",
    "metadata": {
     "editable": true
    },
@@ -2775,7 +2776,7 @@
   {
    "cell_type": "code",
    "execution_count": 29,
-   "id": "a097c9e1",
+   "id": "b21a2c19",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -2806,7 +2807,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "bc02f298",
+   "id": "80801250",
    "metadata": {
     "editable": true
    },
@@ -2817,7 +2818,7 @@
   {
    "cell_type": "code",
    "execution_count": 30,
-   "id": "970ba03e",
+   "id": "303e085a",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -2861,7 +2862,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "e4ff0700",
+   "id": "9358790a",
    "metadata": {
     "editable": true
    },
@@ -2884,7 +2885,7 @@
   {
    "cell_type": "code",
    "execution_count": 31,
-   "id": "8bc77d1c",
+   "id": "a238def8",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -2911,7 +2912,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "76d38bcf",
+   "id": "2ef943ac",
    "metadata": {
     "editable": true
    },
@@ -2922,7 +2923,7 @@
   {
    "cell_type": "code",
    "execution_count": 32,
-   "id": "d22894cb",
+   "id": "afeabf8f",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -2967,7 +2968,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "d4efa31d",
+   "id": "3dd5dfb4",
    "metadata": {
     "editable": true
    },
@@ -2985,7 +2986,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "d6caddb7",
+   "id": "72754d13",
    "metadata": {
     "editable": true
    },
@@ -3020,7 +3021,7 @@
   {
    "cell_type": "code",
    "execution_count": 33,
-   "id": "96f112a6",
+   "id": "9fc42ba6",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -3032,7 +3033,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "2dee5b42",
+   "id": "35795551",
    "metadata": {
     "editable": true
    },
@@ -3044,7 +3045,7 @@
   {
    "cell_type": "code",
    "execution_count": 34,
-   "id": "29e13f69",
+   "id": "1dabca19",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -3057,7 +3058,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "4695192d",
+   "id": "be829505",
    "metadata": {
     "editable": true
    },
@@ -3068,7 +3069,7 @@
   {
    "cell_type": "code",
    "execution_count": 35,
-   "id": "573fade6",
+   "id": "7d92ce1c",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -3081,7 +3082,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "0d8ced47",
+   "id": "057049d7",
    "metadata": {
     "editable": true
    },
@@ -3096,7 +3097,7 @@
   {
    "cell_type": "code",
    "execution_count": 36,
-   "id": "28886e64",
+   "id": "0837641b",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -3108,7 +3109,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "298e5186",
+   "id": "19d5a72d",
    "metadata": {
     "editable": true
    },
@@ -3120,7 +3121,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "ea131902",
+   "id": "4ae0b49b",
    "metadata": {
     "editable": true
    },
@@ -3133,7 +3134,7 @@
   {
    "cell_type": "code",
    "execution_count": 37,
-   "id": "686215bb",
+   "id": "429afe53",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -3188,7 +3189,7 @@
   {
    "cell_type": "code",
    "execution_count": 38,
-   "id": "fa9efbca",
+   "id": "887c06b9",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -3217,7 +3218,7 @@
   {
    "cell_type": "code",
    "execution_count": 39,
-   "id": "5a6a0547",
+   "id": "a4d8f64e",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -3247,7 +3248,7 @@
   {
    "cell_type": "code",
    "execution_count": 40,
-   "id": "9df608ec",
+   "id": "b8fb8fa0",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -3274,7 +3275,7 @@
   {
    "cell_type": "code",
    "execution_count": 41,
-   "id": "8d20fdf7",
+   "id": "7777faa8",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -3316,7 +3317,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "bd641a2a",
+   "id": "bb6d1d3e",
    "metadata": {
     "editable": true
    },
@@ -3327,7 +3328,7 @@
   {
    "cell_type": "code",
    "execution_count": 42,
-   "id": "a6d8bf75",
+   "id": "d8c0caf4",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -3504,7 +3505,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "505033e6",
+   "id": "2631b51d",
    "metadata": {
     "editable": true
    },
@@ -3532,7 +3533,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "d138fcf8",
+   "id": "357644b3",
    "metadata": {
     "editable": true
    },
@@ -3555,7 +3556,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "df986885",
+   "id": "06854c7f",
    "metadata": {
     "editable": true
    },
@@ -3586,7 +3587,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "67ccb46b",
+   "id": "bb26a6da",
    "metadata": {
     "editable": true
    },
@@ -3618,7 +3619,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "a043bdea",
+   "id": "0277931e",
    "metadata": {
     "editable": true
    },
@@ -3656,7 +3657,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "ac370685",
+   "id": "93a45265",
    "metadata": {
     "editable": true
    },
@@ -3681,7 +3682,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "68411972",
+   "id": "7feb8c33",
    "metadata": {
     "editable": true
    },
@@ -3693,7 +3694,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "68d05dd2",
+   "id": "1f55cf23",
    "metadata": {
     "editable": true
    },
@@ -3716,7 +3717,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "55c89a89",
+   "id": "7cea0ca3",
    "metadata": {
     "editable": true
    },
@@ -3736,7 +3737,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "20f0b6de",
+   "id": "086014d5",
    "metadata": {
     "editable": true
    },
@@ -3758,7 +3759,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "8f0a4e60",
+   "id": "9bc419af",
    "metadata": {
     "editable": true
    },
@@ -3776,7 +3777,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "ee9f6778",
+   "id": "a9198ed4",
    "metadata": {
     "editable": true
    },
@@ -3795,7 +3796,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "8ec34edc",
+   "id": "75c023d8",
    "metadata": {
     "editable": true
    },
@@ -3807,7 +3808,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "4cb4f14f",
+   "id": "2d2e4666",
    "metadata": {
     "editable": true
    },
@@ -3852,7 +3853,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "3ceba030",
+   "id": "23dc45c2",
    "metadata": {
     "editable": true
    },
@@ -3882,7 +3883,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "fad4c7c0",
+   "id": "8d80aba5",
    "metadata": {
     "editable": true
    },
@@ -3909,7 +3910,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "92edec9a",
+   "id": "b8d6cf49",
    "metadata": {
     "editable": true
    },
@@ -3923,7 +3924,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "07153151",
+   "id": "ba566ae5",
    "metadata": {
     "editable": true
    },
@@ -3940,7 +3941,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "31a707ec",
+   "id": "fddca9d2",
    "metadata": {
     "editable": true
    },
@@ -3956,7 +3957,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "d0cbacbc",
+   "id": "11ed9eb7",
    "metadata": {
     "editable": true
    },
@@ -3968,7 +3969,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "88e6378a",
+   "id": "ab228680",
    "metadata": {
     "editable": true
    },
@@ -3986,7 +3987,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "a85abfe5",
+   "id": "a620d020",
    "metadata": {
     "editable": true
    },
@@ -4007,7 +4008,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "28e312e0",
+   "id": "4de72e77",
    "metadata": {
     "editable": true
    },
@@ -4024,7 +4025,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "7e562a52",
+   "id": "60ef63bb",
    "metadata": {
     "editable": true
    },
@@ -4036,7 +4037,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "ca872cb5",
+   "id": "6c719d5b",
    "metadata": {
     "editable": true
    },
@@ -4047,7 +4048,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "3f5aaf97",
+   "id": "3a6248cc",
    "metadata": {
     "editable": true
    },
@@ -4064,7 +4065,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "ea91ec87",
+   "id": "937fbb4d",
    "metadata": {
     "editable": true
    },
@@ -4075,7 +4076,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "23d4791e",
+   "id": "985098ad",
    "metadata": {
     "editable": true
    },
@@ -4091,7 +4092,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "645d3042",
+   "id": "7a2ade22",
    "metadata": {
     "editable": true
    },
@@ -4103,7 +4104,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "1957cac1",
+   "id": "4b50fe09",
    "metadata": {
     "editable": true
    },
@@ -4120,7 +4121,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "7ba994c2",
+   "id": "310ac762",
    "metadata": {
     "editable": true
    },
@@ -4132,7 +4133,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "0b4d1e86",
+   "id": "8ce2620f",
    "metadata": {
     "editable": true
    },
@@ -4150,7 +4151,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "7c000d4f",
+   "id": "78459d15",
    "metadata": {
     "editable": true
    },
@@ -4160,7 +4161,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "5c6e9896",
+   "id": "d40f94e2",
    "metadata": {
     "editable": true
    },
@@ -4172,7 +4173,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "c610b5a3",
+   "id": "c5f2c97d",
    "metadata": {
     "editable": true
    },
@@ -4189,7 +4190,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "7b156ba0",
+   "id": "bb30f7cc",
    "metadata": {
     "editable": true
    },
@@ -4201,7 +4202,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "6332b4fb",
+   "id": "a5d8512c",
    "metadata": {
     "editable": true
    },
@@ -4212,7 +4213,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "dadb48a5",
+   "id": "1c888249",
    "metadata": {
     "editable": true
    },
@@ -4224,7 +4225,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "14979de9",
+   "id": "477dada7",
    "metadata": {
     "editable": true
    },
@@ -4234,7 +4235,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "b15978ac",
+   "id": "8e5e2b68",
    "metadata": {
     "editable": true
    },
@@ -4254,7 +4255,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "ab70d7dc",
+   "id": "84150e8d",
    "metadata": {
     "editable": true
    },
@@ -4271,7 +4272,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "3158ad88",
+   "id": "3f25aabb",
    "metadata": {
     "editable": true
    },
@@ -4290,7 +4291,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "424ea4cd",
+   "id": "ce6c0a98",
    "metadata": {
     "editable": true
    },
@@ -4302,7 +4303,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "9875f210",
+   "id": "17805209",
    "metadata": {
     "editable": true
    },
@@ -4312,7 +4313,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "c317c081",
+   "id": "f9984101",
    "metadata": {
     "editable": true
    },
@@ -4329,7 +4330,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "850d7062",
+   "id": "4abcf7b3",
    "metadata": {
     "editable": true
    },
@@ -4339,7 +4340,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "05b6c21e",
+   "id": "3a4b99d7",
    "metadata": {
     "editable": true
    },
@@ -4355,7 +4356,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "52090d6f",
+   "id": "261d5f57",
    "metadata": {
     "editable": true
    },
@@ -4367,7 +4368,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "f4f56b6e",
+   "id": "0c7e0ed7",
    "metadata": {
     "editable": true
    },
@@ -4379,7 +4380,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "e76317e2",
+   "id": "410091f0",
    "metadata": {
     "editable": true
    },
@@ -4391,7 +4392,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "cf1ff27d",
+   "id": "17f0e1e7",
    "metadata": {
     "editable": true
    },
@@ -4401,7 +4402,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "c6558ca7",
+   "id": "acac4ddf",
    "metadata": {
     "editable": true
    },
@@ -4413,7 +4414,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "eb10b3cf",
+   "id": "0b3bdcec",
    "metadata": {
     "editable": true
    },
@@ -4430,7 +4431,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "95040138",
+   "id": "8b71f89e",
    "metadata": {
     "editable": true
    },
@@ -4440,7 +4441,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "efbb37df",
+   "id": "b1a4b8b2",
    "metadata": {
     "editable": true
    },
@@ -4452,7 +4453,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "ce339463",
+   "id": "bb3f35b1",
    "metadata": {
     "editable": true
    },
@@ -4466,7 +4467,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "51d1021d",
+   "id": "bb8eac7a",
    "metadata": {
     "editable": true
    },
@@ -4482,7 +4483,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "5471c13f",
+   "id": "23361eba",
    "metadata": {
     "editable": true
    },
@@ -4494,7 +4495,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "ca1015ba",
+   "id": "94bf3ada",
    "metadata": {
     "editable": true
    },
@@ -4516,7 +4517,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "325048d9",
+   "id": "ff0afe4b",
    "metadata": {
     "editable": true
    },
@@ -4528,7 +4529,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "5c6b185f",
+   "id": "393ee959",
    "metadata": {
     "editable": true
    },
@@ -4551,7 +4552,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "eddea0e3",
+   "id": "f2df5cfc",
    "metadata": {
     "editable": true
    },
@@ -4567,7 +4568,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "39eeb7a1",
+   "id": "f6358bb7",
    "metadata": {
     "editable": true
    },
@@ -4579,7 +4580,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "25477c00",
+   "id": "ef56bb84",
    "metadata": {
     "editable": true
    },
@@ -4603,7 +4604,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "dbdce765",
+   "id": "acd41944",
    "metadata": {
     "editable": true
    },
@@ -4615,7 +4616,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "3b833783",
+   "id": "1a2a7e92",
    "metadata": {
     "editable": true
    },
@@ -4636,7 +4637,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "98103cac",
+   "id": "a082637c",
    "metadata": {
     "editable": true
    },
@@ -4648,7 +4649,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "01de1e28",
+   "id": "dfc24dff",
    "metadata": {
     "editable": true
    },
@@ -4667,7 +4668,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "3d50cf6a",
+   "id": "90f81e55",
    "metadata": {
     "editable": true
    },
@@ -4677,7 +4678,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "221269b0",
+   "id": "3693fc3b",
    "metadata": {
     "editable": true
    },
@@ -4691,7 +4692,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "b736af88",
+   "id": "2bb540dd",
    "metadata": {
     "editable": true
    },
@@ -4703,7 +4704,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "ea505169",
+   "id": "5fad7cc5",
    "metadata": {
     "editable": true
    },
@@ -4715,7 +4716,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "515470a3",
+   "id": "c9a47e0a",
    "metadata": {
     "editable": true
    },
@@ -4732,7 +4733,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "f9eaeace",
+   "id": "f579f1d0",
    "metadata": {
     "editable": true
    },
@@ -4744,7 +4745,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "e6488f9b",
+   "id": "f980cb6a",
    "metadata": {
     "editable": true
    },
@@ -4766,7 +4767,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "f2bc476e",
+   "id": "de47a73d",
    "metadata": {
     "editable": true
    },
@@ -4781,7 +4782,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "2d7b7d19",
+   "id": "5eacb34e",
    "metadata": {
     "editable": true
    },
@@ -4792,7 +4793,7 @@
   {
    "cell_type": "code",
    "execution_count": 43,
-   "id": "4aad6e10",
+   "id": "77235f88",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -4947,7 +4948,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "f8c418c1",
+   "id": "0147790d",
    "metadata": {
     "editable": true
    },
@@ -4962,7 +4963,7 @@
   {
    "cell_type": "code",
    "execution_count": 44,
-   "id": "96758ada",
+   "id": "59eb96af",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -5131,7 +5132,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "c62fedb8",
+   "id": "dc02c291",
    "metadata": {
     "editable": true
    },
@@ -5144,7 +5145,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "1f962431",
+   "id": "c8fff51e",
    "metadata": {
     "editable": true
    },
@@ -5161,7 +5162,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "71b1d885",
+   "id": "3751edf7",
    "metadata": {
     "editable": true
    },
@@ -5177,7 +5178,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "0b96a028",
+   "id": "a502c731",
    "metadata": {
     "editable": true
    },
@@ -5190,7 +5191,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "311ae3d3",
+   "id": "eb73f07e",
    "metadata": {
     "editable": true
    },
@@ -5207,7 +5208,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "98cb3d44",
+   "id": "9ab9d930",
    "metadata": {
     "editable": true
    },
@@ -5219,7 +5220,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "3e8e134d",
+   "id": "9cb8689a",
    "metadata": {
     "editable": true
    },
@@ -5246,7 +5247,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "a1844ff9",
+   "id": "d21e3a14",
    "metadata": {
     "editable": true
    },
@@ -5259,7 +5260,7 @@
   {
    "cell_type": "code",
    "execution_count": 45,
-   "id": "4410b99e",
+   "id": "833da16b",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -5433,7 +5434,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "f0ab0e0f",
+   "id": "0fdcf8c5",
    "metadata": {
     "editable": true
    },
@@ -5453,7 +5454,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "333b0a8d",
+   "id": "0a057338",
    "metadata": {
     "editable": true
    },
@@ -5468,7 +5469,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "5b358fbf",
+   "id": "6721bcf2",
    "metadata": {
     "editable": true
    },
@@ -5482,7 +5483,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "c5d60864",
+   "id": "dc3db9fd",
    "metadata": {
     "editable": true
    },
@@ -5498,7 +5499,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "bcce6eb8",
+   "id": "9af3fd6a",
    "metadata": {
     "editable": true
    },
@@ -5508,7 +5509,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "e6497fd7",
+   "id": "4c2da445",
    "metadata": {
     "editable": true
    },
@@ -5530,7 +5531,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "31b650fc",
+   "id": "93b58380",
    "metadata": {
     "editable": true
    },
@@ -5544,7 +5545,7 @@
   {
    "cell_type": "code",
    "execution_count": 46,
-   "id": "6e267e72",
+   "id": "cb73915d",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -5620,7 +5621,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "8b054a85",
+   "id": "c9d250c7",
    "metadata": {
     "editable": true
    },
@@ -5632,7 +5633,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "f637dd9d",
+   "id": "0d67bc8c",
    "metadata": {
     "editable": true
    },
@@ -5649,7 +5650,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "ac088e86",
+   "id": "fe4ee5a8",
    "metadata": {
     "editable": true
    },
@@ -5661,7 +5662,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "14afd7fa",
+   "id": "62b400ca",
    "metadata": {
     "editable": true
    },
@@ -5676,7 +5677,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "0a2680eb",
+   "id": "7d4723f2",
    "metadata": {
     "editable": true
    },
@@ -5688,7 +5689,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "7e30575f",
+   "id": "97889b0e",
    "metadata": {
     "editable": true
    },
@@ -5700,7 +5701,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "3b30e08a",
+   "id": "236028bc",
    "metadata": {
     "editable": true
    },
@@ -5712,7 +5713,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "be7d958b",
+   "id": "a4334818",
    "metadata": {
     "editable": true
    },
@@ -5722,7 +5723,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "d6a52e39",
+   "id": "8330dd77",
    "metadata": {
     "editable": true
    },
@@ -5739,7 +5740,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "488d0a14",
+   "id": "78522018",
    "metadata": {
     "editable": true
    },
@@ -5751,7 +5752,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "59834674",
+   "id": "943956e4",
    "metadata": {
     "editable": true
    },
@@ -5763,7 +5764,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "af640638",
+   "id": "3c7b57e2",
    "metadata": {
     "editable": true
    },
@@ -5773,7 +5774,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "8d83ea23",
+   "id": "55173c99",
    "metadata": {
     "editable": true
    },
@@ -5785,7 +5786,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "4d4e4ea8",
+   "id": "a6d078e4",
    "metadata": {
     "editable": true
    },
@@ -5796,7 +5797,7 @@
   {
    "cell_type": "code",
    "execution_count": 47,
-   "id": "ad4cc32f",
+   "id": "452c599c",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -5957,7 +5958,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "ceb283ce",
+   "id": "8ca2348f",
    "metadata": {
     "editable": true
    },
@@ -5979,7 +5980,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "a68e0e56",
+   "id": "0ccc174e",
    "metadata": {
     "editable": true
    },
@@ -5996,7 +5997,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "8441e4e6",
+   "id": "d4601257",
    "metadata": {
     "editable": true
    },
@@ -6006,7 +6007,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "1d343e68",
+   "id": "9ec01889",
    "metadata": {
     "editable": true
    },
@@ -6021,7 +6022,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "1c566531",
+   "id": "71993d6c",
    "metadata": {
     "editable": true
    },
@@ -6031,7 +6032,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "7a06b755",
+   "id": "f6acfae4",
    "metadata": {
     "editable": true
    },
@@ -6046,7 +6047,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "2e88c504",
+   "id": "6540422f",
    "metadata": {
     "editable": true
    },
@@ -6057,7 +6058,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "7299b0d3",
+   "id": "fd8c2326",
    "metadata": {
     "editable": true
    },
@@ -6077,7 +6078,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "c849f0cc",
+   "id": "74eabad7",
    "metadata": {
     "editable": true
    },
@@ -6089,7 +6090,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "f19b2ed7",
+   "id": "f9d16e2f",
    "metadata": {
     "editable": true
    },
@@ -6126,7 +6127,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "96581350",
+   "id": "68c24098",
    "metadata": {
     "editable": true
    },
@@ -6136,7 +6137,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "2c5aa09d",
+   "id": "02c1e06d",
    "metadata": {
     "editable": true
    },
@@ -6149,7 +6150,7 @@
   {
    "cell_type": "code",
    "execution_count": 48,
-   "id": "9b979206",
+   "id": "972b8e94",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -6350,7 +6351,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "ec7cab35",
+   "id": "734d97bc",
    "metadata": {
     "editable": true
    },
@@ -6367,7 +6368,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "7366658f",
+   "id": "2c2d0e2c",
    "metadata": {
     "editable": true
    },
@@ -6384,7 +6385,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "b6557284",
+   "id": "9de00307",
    "metadata": {
     "editable": true
    },
@@ -6394,7 +6395,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "df2d7d07",
+   "id": "cb659253",
    "metadata": {
     "editable": true
    },
@@ -6409,7 +6410,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "aad0506a",
+   "id": "909d23ae",
    "metadata": {
     "editable": true
    },
@@ -6423,7 +6424,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "9e5776d1",
+   "id": "e3607f9e",
    "metadata": {
     "editable": true
    },
@@ -6436,7 +6437,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "7fad71c5",
+   "id": "e0254d92",
    "metadata": {
     "editable": true
    },
@@ -6456,7 +6457,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "d98bd52b",
+   "id": "7a787737",
    "metadata": {
     "editable": true
    },
@@ -6468,7 +6469,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "3f6cb731",
+   "id": "42cfda53",
    "metadata": {
     "editable": true
    },
@@ -6480,7 +6481,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "0efeb6a7",
+   "id": "41fdd74a",
    "metadata": {
     "editable": true
    },
@@ -6492,7 +6493,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "b3367fd8",
+   "id": "9a43a5c3",
    "metadata": {
     "editable": true
    },
@@ -6502,7 +6503,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "f5cdf037",
+   "id": "2deb98de",
    "metadata": {
     "editable": true
    },
@@ -6514,7 +6515,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "39090b0c",
+   "id": "367f7d4b",
    "metadata": {
     "editable": true
    },
@@ -6526,7 +6527,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "306f52ce",
+   "id": "4ace8d41",
    "metadata": {
     "editable": true
    },
@@ -6538,7 +6539,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "4dddd0e4",
+   "id": "014d9b72",
    "metadata": {
     "editable": true
    },
@@ -6548,7 +6549,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "19ba57a3",
+   "id": "91cb0d4f",
    "metadata": {
     "editable": true
    },
@@ -6564,7 +6565,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "3f4b369e",
+   "id": "7015c1df",
    "metadata": {
     "editable": true
    },
@@ -6574,7 +6575,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "01054c66",
+   "id": "a170f9bf",
    "metadata": {
     "editable": true
    },
@@ -6586,7 +6587,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "48250dfa",
+   "id": "f79c87b0",
    "metadata": {
     "editable": true
    },
@@ -6603,7 +6604,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "830538cd",
+   "id": "7b00c2c7",
    "metadata": {
     "editable": true
    },
@@ -6613,7 +6614,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "1e05f3d1",
+   "id": "1da2ec1f",
    "metadata": {
     "editable": true
    },
@@ -6629,7 +6630,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "278b7644",
+   "id": "d048b2b0",
    "metadata": {
     "editable": true
    },
@@ -6643,7 +6644,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "08bf068d",
+   "id": "2a5423c6",
    "metadata": {
     "editable": true
    },
@@ -6662,7 +6663,7 @@
   {
    "cell_type": "code",
    "execution_count": 49,
-   "id": "fb15b704",
+   "id": "39978a3f",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -6717,7 +6718,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "ca43eaaa",
+   "id": "d86acd9a",
    "metadata": {
     "editable": true
    },
@@ -6747,7 +6748,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "8cb99e50",
+   "id": "219af542",
    "metadata": {
     "editable": true
    },
@@ -6776,7 +6777,7 @@
   {
    "cell_type": "code",
    "execution_count": 50,
-   "id": "2c311458",
+   "id": "0300f83e",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -6823,7 +6824,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "6ce6fcdb",
+   "id": "63ff2d7d",
    "metadata": {
     "editable": true
    },
@@ -6849,7 +6850,7 @@
   {
    "cell_type": "code",
    "execution_count": 51,
-   "id": "975ad28f",
+   "id": "504a8a89",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -7083,7 +7084,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "a85b7bc6",
+   "id": "2154560c",
    "metadata": {
     "editable": true
    },
@@ -7095,7 +7096,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "913742fb",
+   "id": "36990efc",
    "metadata": {
     "editable": true
    },
@@ -7107,7 +7108,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "9b936d66",
+   "id": "d4e6e7d4",
    "metadata": {
     "editable": true
    },
@@ -7119,7 +7120,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "a0cd719f",
+   "id": "cca6cfed",
    "metadata": {
     "editable": true
    },
@@ -7136,7 +7137,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "8a8ddb73",
+   "id": "19f73071",
    "metadata": {
     "editable": true
    },
@@ -7146,7 +7147,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "460bb8e2",
+   "id": "3e637804",
    "metadata": {
     "editable": true
    },
@@ -7158,7 +7159,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "619814ea",
+   "id": "1a3ef69a",
    "metadata": {
     "editable": true
    },
@@ -7175,7 +7176,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "833fef22",
+   "id": "b9206a11",
    "metadata": {
     "editable": true
    },
@@ -7186,7 +7187,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "72df2582",
+   "id": "3050dcc1",
    "metadata": {
     "editable": true
    },
@@ -7206,7 +7207,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "efc2be56",
+   "id": "2adca788",
    "metadata": {
     "editable": true
    },
@@ -7216,7 +7217,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "8bee39ce",
+   "id": "9d36478f",
    "metadata": {
     "editable": true
    },
@@ -7242,7 +7243,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "e133bda5",
+   "id": "f5a39291",
    "metadata": {
     "editable": true
    },
@@ -7258,7 +7259,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "8cc804aa",
+   "id": "2090b5b8",
    "metadata": {
     "editable": true
    },
@@ -7269,7 +7270,7 @@
   {
    "cell_type": "code",
    "execution_count": 52,
-   "id": "8e3fb51d",
+   "id": "0598530e",
    "metadata": {
     "collapsed": false,
     "editable": true
@@ -7500,7 +7501,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "a77decf5",
+   "id": "518138c8",
    "metadata": {
     "editable": true
    },
diff --git a/doc/src/week43/exercisesweek43.do.txt b/doc/src/week43/exercisesweek43.do.txt
index a8f473796..105d59dd8 100644
--- a/doc/src/week43/exercisesweek43.do.txt
+++ b/doc/src/week43/exercisesweek43.do.txt
@@ -134,12 +134,13 @@ Assume also that the bias of the output layer is zero and that the weights of th
 !et
 and multiplying with $\bm{a}_h$ gives the output
 !bt
-\bm{a}_o=\bm{w}_h^T\begin{bmatrix} 0 & 0 \\
+\bm{a}_o=\begin{bmatrix} 0 & 0 \\
                        1 & 0 \\
 		       1 & 0 \\
-		       2 & 1 \end{bmatrix}=\begin{bmatrix} 0 \\ 1 \\ 1 \\0\end{bmatrix},
+		       2 & 1 \end{bmatrix}\begin{bmatrix} 1 \\
+                       -2\end{bmatrix}=\begin{bmatrix} 0 \\ 1 \\ 1 \\0\end{bmatrix},
 !et
-the wanted result.
+the wanted result.  Pay attention to the dimensionalities as well.
 
 
 !split
diff --git a/doc/src/week43/week43.do.txt b/doc/src/week43/week43.do.txt
index bb4a5f888..026731265 100644
--- a/doc/src/week43/week43.do.txt
+++ b/doc/src/week43/week43.do.txt
@@ -61,6 +61,7 @@ cost function.
 
 
 
+
 Their inputs and outputs can be
 summarized using the following tables, first for the OR gate with
 inputs $x_1$ and $x_2$ and outputs $y$:
@@ -173,12 +174,13 @@ Assume also that the bias of the output layer is zero and that the weights of th
 !et
 and multiplying with $\bm{a}_h$ gives the output
 !bt
-\bm{a}_o=\bm{w}_h^T\begin{bmatrix} 0 & 0 \\
+\bm{a}_o=\begin{bmatrix} 0 & 0 \\
                        1 & 0 \\
 		       1 & 0 \\
-		       2 & 1 \end{bmatrix}=\begin{bmatrix} 0 \\ 1 \\ 1 \\0\end{bmatrix},
+		       2 & 1 \end{bmatrix}\begin{bmatrix} 1 \\
+                       -2\end{bmatrix}=\begin{bmatrix} 0 \\ 1 \\ 1 \\0\end{bmatrix},
 !et
-the wanted result.
+the wanted result.  Pay attention to the dimensionalities as well.
 
 
 !split
@@ -1321,8 +1323,6 @@ scores = logistic_regression.fit(X, yXOR, scheduler, epochs=1000)
 !ec
 Not bad, but the results depend strongly on the learning reate. Try different learning rates.
 
-
-
 !split
 ===== Lecture Thursday October 26 =====