diff --git a/doc/LectureNotes/exercisesweek43.ipynb b/doc/LectureNotes/exercisesweek43.ipynb
index 63211a3f0..96c3390e4 100644
--- a/doc/LectureNotes/exercisesweek43.ipynb
+++ b/doc/LectureNotes/exercisesweek43.ipynb
@@ -2,8 +2,10 @@
"cells": [
{
"cell_type": "markdown",
- "id": "ae832182",
- "metadata": {},
+ "id": "d5ebb4c0",
+ "metadata": {
+ "editable": true
+ },
"source": [
"\n",
@@ -12,8 +14,10 @@
},
{
"cell_type": "markdown",
- "id": "77f844d9",
- "metadata": {},
+ "id": "812b4e46",
+ "metadata": {
+ "editable": true
+ },
"source": [
"# Exercises weeks 43 and 44 \n",
"**October 23-27, 2023**\n",
@@ -25,8 +29,10 @@
},
{
"cell_type": "markdown",
- "id": "d5b983e3",
- "metadata": {},
+ "id": "3230cd2f",
+ "metadata": {
+ "editable": true
+ },
"source": [
"# Overarching aims of the exercises weeks 43 and 44\n",
"\n",
@@ -63,8 +69,10 @@
},
{
"cell_type": "markdown",
- "id": "7f6cc12f",
- "metadata": {},
+ "id": "e3617d4e",
+ "metadata": {
+ "editable": true
+ },
"source": [
"## The AND and XOR Gates\n",
"\n",
@@ -99,8 +107,10 @@
},
{
"cell_type": "markdown",
- "id": "c0b07e46",
- "metadata": {},
+ "id": "54e1e7fc",
+ "metadata": {
+ "editable": true
+ },
"source": [
"## Representing the Data Sets\n",
"\n",
@@ -109,8 +119,10 @@
},
{
"cell_type": "markdown",
- "id": "e0a9840a",
- "metadata": {},
+ "id": "6b3c15cb",
+ "metadata": {
+ "editable": true
+ },
"source": [
"$$\n",
"\\boldsymbol{X}=\\begin{bmatrix} 0 & 0 \\\\\n",
@@ -122,8 +134,10 @@
},
{
"cell_type": "markdown",
- "id": "ff95d379",
- "metadata": {},
+ "id": "acc25271",
+ "metadata": {
+ "editable": true
+ },
"source": [
"while the vector of outputs is $\\boldsymbol{y}^T=[0,1,1,0]$ for the XOR gate, $\\boldsymbol{y}^T=[0,0,0,1]$ for the AND gate and $\\boldsymbol{y}^T=[0,1,1,1]$ for the OR gate.\n",
"\n",
@@ -150,8 +164,10 @@
},
{
"cell_type": "markdown",
- "id": "36fa3466",
- "metadata": {},
+ "id": "ffe0a840",
+ "metadata": {
+ "editable": true
+ },
"source": [
"## Setting up dimensionalities by hand\n",
"\n",
@@ -160,8 +176,10 @@
},
{
"cell_type": "markdown",
- "id": "e2e5e808",
- "metadata": {},
+ "id": "46abf545",
+ "metadata": {
+ "editable": true
+ },
"source": [
"$$\n",
"\\boldsymbol{W_h}=\\begin{bmatrix} 1 & 1 \\\\\n",
@@ -171,16 +189,20 @@
},
{
"cell_type": "markdown",
- "id": "419e3904",
- "metadata": {},
+ "id": "86e105cc",
+ "metadata": {
+ "editable": true
+ },
"source": [
"Multiplying $\\boldsymbol{X}$ and $\\boldsymbol{W}$ gives"
]
},
{
"cell_type": "markdown",
- "id": "88a9712a",
- "metadata": {},
+ "id": "5e1d21f1",
+ "metadata": {
+ "editable": true
+ },
"source": [
"$$\n",
"\\boldsymbol{X}{W}_h=\\begin{bmatrix} 0 & 0 \\\\\n",
@@ -192,16 +214,20 @@
},
{
"cell_type": "markdown",
- "id": "036eee14",
- "metadata": {},
+ "id": "692c6cbf",
+ "metadata": {
+ "editable": true
+ },
"source": [
"Assume also that the bias vector for the hidden layer is"
]
},
{
"cell_type": "markdown",
- "id": "3c771918",
- "metadata": {},
+ "id": "5d81e641",
+ "metadata": {
+ "editable": true
+ },
"source": [
"$$\n",
"\\boldsymbol{b}_h=\\begin{bmatrix} 0 \\\\\n",
@@ -211,16 +237,20 @@
},
{
"cell_type": "markdown",
- "id": "f5a4150d",
- "metadata": {},
+ "id": "a42bdee4",
+ "metadata": {
+ "editable": true
+ },
"source": [
"Adding it gives us the input to the activation function of the hidden layer"
]
},
{
"cell_type": "markdown",
- "id": "e4eb7753",
- "metadata": {},
+ "id": "5116b854",
+ "metadata": {
+ "editable": true
+ },
"source": [
"$$\n",
"\\boldsymbol{z}_h=\\boldsymbol{X}\\boldsymbol{W}_h+\\boldsymbol{b}_h=\\begin{bmatrix} 0 & -1 \\\\\n",
@@ -232,16 +262,20 @@
},
{
"cell_type": "markdown",
- "id": "b5442b32",
- "metadata": {},
+ "id": "8dd26d09",
+ "metadata": {
+ "editable": true
+ },
"source": [
"Let us then assume that our activation function is the RELU function, which simply means that we take the max of $0$ and the elements of the input argument $\\boldsymbol{z}_h$, that is we have"
]
},
{
"cell_type": "markdown",
- "id": "64d99f85",
- "metadata": {},
+ "id": "ebf97c03",
+ "metadata": {
+ "editable": true
+ },
"source": [
"$$\n",
"\\boldsymbol{a}_h=\\mathrm{RELU}(\\boldsymbol{z}_h=\\boldsymbol{X}\\boldsymbol{W}_h+\\boldsymbol{b}_h)=\\begin{bmatrix} 0 & 0 \\\\\n",
@@ -253,16 +287,20 @@
},
{
"cell_type": "markdown",
- "id": "2aee4b6b",
- "metadata": {},
+ "id": "262a4a3a",
+ "metadata": {
+ "editable": true
+ },
"source": [
"Assume also that the bias of the output layer is zero and that the weights of the output layer are"
]
},
{
"cell_type": "markdown",
- "id": "884541eb",
- "metadata": {},
+ "id": "f03ad8e7",
+ "metadata": {
+ "editable": true
+ },
"source": [
"$$\n",
"\\boldsymbol{w}_o=\\begin{bmatrix} 1 \\\\\n",
@@ -272,37 +310,46 @@
},
{
"cell_type": "markdown",
- "id": "3999a4d5",
- "metadata": {},
+ "id": "36fe00c0",
+ "metadata": {
+ "editable": true
+ },
"source": [
"and multiplying with $\\boldsymbol{a}_h$ gives the output"
]
},
{
"cell_type": "markdown",
- "id": "a4896b4d",
- "metadata": {},
+ "id": "80ab43ac",
+ "metadata": {
+ "editable": true
+ },
"source": [
"$$\n",
- "\\boldsymbol{a}_o=\\boldsymbol{w}_h^T\\begin{bmatrix} 0 & 0 \\\\\n",
+ "\\boldsymbol{a}_o=\\begin{bmatrix} 0 & 0 \\\\\n",
" 1 & 0 \\\\\n",
"\t\t 1 & 0 \\\\\n",
- "\t\t 2 & 1 \\end{bmatrix}=\\begin{bmatrix} 0 \\\\ 1 \\\\ 1 \\\\0\\end{bmatrix},\n",
+ "\t\t 2 & 1 \\end{bmatrix}\\begin{bmatrix} 1 \\\\\n",
+ " -2\\end{bmatrix}=\\begin{bmatrix} 0 \\\\ 1 \\\\ 1 \\\\0\\end{bmatrix},\n",
"$$"
]
},
{
"cell_type": "markdown",
- "id": "2c74e7c0",
- "metadata": {},
+ "id": "86bcfe49",
+ "metadata": {
+ "editable": true
+ },
"source": [
- "the wanted result."
+ "the wanted result. Pay attention to the dimensionalities as well."
]
},
{
"cell_type": "markdown",
- "id": "249b9804",
- "metadata": {},
+ "id": "f19a899e",
+ "metadata": {
+ "editable": true
+ },
"source": [
"## Setting up the Neural Network\n",
"\n",
@@ -312,8 +359,11 @@
{
"cell_type": "code",
"execution_count": 1,
- "id": "afdd3100",
- "metadata": {},
+ "id": "901ddca7",
+ "metadata": {
+ "collapsed": false,
+ "editable": true
+ },
"outputs": [],
"source": [
"%matplotlib inline\n",
@@ -379,16 +429,20 @@
},
{
"cell_type": "markdown",
- "id": "fb383164",
- "metadata": {},
+ "id": "53f22266",
+ "metadata": {
+ "editable": true
+ },
"source": [
"Not an impressive result, but this was our first forward pass with randomly assigned weights. Let us now add the full network with the back-propagation algorithm discussed above."
]
},
{
"cell_type": "markdown",
- "id": "0d26394c",
- "metadata": {},
+ "id": "5f665ac6",
+ "metadata": {
+ "editable": true
+ },
"source": [
"## The Code using Scikit-Learn"
]
@@ -396,8 +450,11 @@
{
"cell_type": "code",
"execution_count": 2,
- "id": "befc368c",
- "metadata": {},
+ "id": "cb396cda",
+ "metadata": {
+ "collapsed": false,
+ "editable": true
+ },
"outputs": [],
"source": [
"# import necessary packages\n",
@@ -458,8 +515,10 @@
},
{
"cell_type": "markdown",
- "id": "03895a9f",
- "metadata": {},
+ "id": "c5978471",
+ "metadata": {
+ "editable": true
+ },
"source": [
"## Building a neural network code\n",
"\n",
@@ -475,8 +534,10 @@
},
{
"cell_type": "markdown",
- "id": "6226915b",
- "metadata": {},
+ "id": "7b82dc46",
+ "metadata": {
+ "editable": true
+ },
"source": [
"### Learning rate methods\n",
"\n",
@@ -495,8 +556,11 @@
{
"cell_type": "code",
"execution_count": 3,
- "id": "b6d5ea73",
- "metadata": {},
+ "id": "de4dedfb",
+ "metadata": {
+ "collapsed": false,
+ "editable": true
+ },
"outputs": [],
"source": [
"import autograd.numpy as np\n",
@@ -633,8 +697,10 @@
},
{
"cell_type": "markdown",
- "id": "edb42bef",
- "metadata": {},
+ "id": "bb621fce",
+ "metadata": {
+ "editable": true
+ },
"source": [
"### Usage of the above learning rate schedulers\n",
"\n",
@@ -647,8 +713,11 @@
{
"cell_type": "code",
"execution_count": 4,
- "id": "108c1209",
- "metadata": {},
+ "id": "34ddb829",
+ "metadata": {
+ "collapsed": false,
+ "editable": true
+ },
"outputs": [],
"source": [
"momentum_scheduler = Momentum(eta=1e-3, momentum=0.9)\n",
@@ -657,8 +726,10 @@
},
{
"cell_type": "markdown",
- "id": "d1c423f0",
- "metadata": {},
+ "id": "e43498d4",
+ "metadata": {
+ "editable": true
+ },
"source": [
"Here is a small example for how a segment of code using schedulers\n",
"could look. Switching out the schedulers is simple."
@@ -667,8 +738,11 @@
{
"cell_type": "code",
"execution_count": 5,
- "id": "63c8c749",
- "metadata": {},
+ "id": "f05b9625",
+ "metadata": {
+ "collapsed": false,
+ "editable": true
+ },
"outputs": [],
"source": [
"weights = np.ones((3,3))\n",
@@ -686,8 +760,10 @@
},
{
"cell_type": "markdown",
- "id": "7cb80992",
- "metadata": {},
+ "id": "19cf9841",
+ "metadata": {
+ "editable": true
+ },
"source": [
"### Cost functions\n",
"\n",
@@ -700,8 +776,11 @@
{
"cell_type": "code",
"execution_count": 6,
- "id": "a181dacb",
- "metadata": {},
+ "id": "993efa8d",
+ "metadata": {
+ "collapsed": false,
+ "editable": true
+ },
"outputs": [],
"source": [
"import autograd.numpy as np\n",
@@ -735,8 +814,10 @@
},
{
"cell_type": "markdown",
- "id": "26a7fe37",
- "metadata": {},
+ "id": "011c734c",
+ "metadata": {
+ "editable": true
+ },
"source": [
"Below we give a short example of how these cost function may be used\n",
"to obtain results if you wish to test them out on your own using\n",
@@ -746,8 +827,11 @@
{
"cell_type": "code",
"execution_count": 7,
- "id": "5894bd31",
- "metadata": {},
+ "id": "9e1b97f5",
+ "metadata": {
+ "collapsed": false,
+ "editable": true
+ },
"outputs": [],
"source": [
"from autograd import grad\n",
@@ -764,8 +848,10 @@
},
{
"cell_type": "markdown",
- "id": "71141fab",
- "metadata": {},
+ "id": "4acd87b2",
+ "metadata": {
+ "editable": true
+ },
"source": [
"### Activation functions\n",
"\n",
@@ -778,8 +864,11 @@
{
"cell_type": "code",
"execution_count": 8,
- "id": "433e0886",
- "metadata": {},
+ "id": "befa86ae",
+ "metadata": {
+ "collapsed": false,
+ "editable": true
+ },
"outputs": [],
"source": [
"import autograd.numpy as np\n",
@@ -833,8 +922,10 @@
},
{
"cell_type": "markdown",
- "id": "14c9d538",
- "metadata": {},
+ "id": "c20aa75e",
+ "metadata": {
+ "editable": true
+ },
"source": [
"Below follows a short demonstration of how to use an activation\n",
"function. The derivative of the activation function will be important\n",
@@ -846,8 +937,11 @@
{
"cell_type": "code",
"execution_count": 9,
- "id": "4c3a44ef",
- "metadata": {},
+ "id": "e209f9e5",
+ "metadata": {
+ "collapsed": false,
+ "editable": true
+ },
"outputs": [],
"source": [
"z = np.array([[4, 5, 6]]).T\n",
@@ -864,8 +958,10 @@
},
{
"cell_type": "markdown",
- "id": "aa7f604e",
- "metadata": {},
+ "id": "524b409b",
+ "metadata": {
+ "editable": true
+ },
"source": [
"### The Neural Network\n",
"\n",
@@ -886,8 +982,11 @@
{
"cell_type": "code",
"execution_count": 10,
- "id": "585a227b",
- "metadata": {},
+ "id": "083116d3",
+ "metadata": {
+ "collapsed": false,
+ "editable": true
+ },
"outputs": [],
"source": [
"import math\n",
@@ -1355,8 +1454,10 @@
},
{
"cell_type": "markdown",
- "id": "7de704af",
- "metadata": {},
+ "id": "e4ba55d0",
+ "metadata": {
+ "editable": true
+ },
"source": [
"Before we make a model, we will quickly generate a dataset we can use\n",
"for our linear regression problem as shown below"
@@ -1365,8 +1466,11 @@
{
"cell_type": "code",
"execution_count": 11,
- "id": "212b0a35",
- "metadata": {},
+ "id": "c72a22c6",
+ "metadata": {
+ "collapsed": false,
+ "editable": true
+ },
"outputs": [],
"source": [
"import autograd.numpy as np\n",
@@ -1406,8 +1510,10 @@
},
{
"cell_type": "markdown",
- "id": "1ff4ec7b",
- "metadata": {},
+ "id": "25b63b47",
+ "metadata": {
+ "editable": true
+ },
"source": [
"Now that we have our dataset ready for the regression, we can create\n",
"our regressor. Note that with the seed parameter, we can make sure our\n",
@@ -1420,8 +1526,11 @@
{
"cell_type": "code",
"execution_count": 12,
- "id": "57d8eca3",
- "metadata": {},
+ "id": "b6b4e461",
+ "metadata": {
+ "collapsed": false,
+ "editable": true
+ },
"outputs": [],
"source": [
"input_nodes = X_train.shape[1]\n",
@@ -1432,8 +1541,10 @@
},
{
"cell_type": "markdown",
- "id": "f1977bae",
- "metadata": {},
+ "id": "d7860b74",
+ "metadata": {
+ "editable": true
+ },
"source": [
"We then fit our model with our training data using the scheduler of our choice."
]
@@ -1441,8 +1552,11 @@
{
"cell_type": "code",
"execution_count": 13,
- "id": "31ae2a1e",
- "metadata": {},
+ "id": "00522c73",
+ "metadata": {
+ "collapsed": false,
+ "editable": true
+ },
"outputs": [],
"source": [
"linear_regression.reset_weights() # reset weights such that previous runs or reruns don't affect the weights\n",
@@ -1453,8 +1567,10 @@
},
{
"cell_type": "markdown",
- "id": "96a64da4",
- "metadata": {},
+ "id": "a57bfb12",
+ "metadata": {
+ "editable": true
+ },
"source": [
"Due to the progress bar we can see the MSE (train_error) throughout\n",
"the FFNN's training. Note that the fit() function has some optional\n",
@@ -1467,8 +1583,11 @@
{
"cell_type": "code",
"execution_count": 14,
- "id": "246499fc",
- "metadata": {},
+ "id": "35259e41",
+ "metadata": {
+ "collapsed": false,
+ "editable": true
+ },
"outputs": [],
"source": [
"linear_regression.reset_weights() # reset weights such that previous runs or reruns don't affect the weights\n",
@@ -1478,8 +1597,10 @@
},
{
"cell_type": "markdown",
- "id": "61d11e17",
- "metadata": {},
+ "id": "4a403370",
+ "metadata": {
+ "editable": true
+ },
"source": [
"We see that given more epochs to train on, the regressor reaches a lower MSE.\n",
"\n",
@@ -1491,8 +1612,11 @@
{
"cell_type": "code",
"execution_count": 15,
- "id": "b5b91899",
- "metadata": {},
+ "id": "6c791130",
+ "metadata": {
+ "collapsed": false,
+ "editable": true
+ },
"outputs": [],
"source": [
"from sklearn.datasets import load_breast_cancer\n",
@@ -1514,8 +1638,11 @@
{
"cell_type": "code",
"execution_count": 16,
- "id": "4bd01b3d",
- "metadata": {},
+ "id": "0ac0258d",
+ "metadata": {
+ "collapsed": false,
+ "editable": true
+ },
"outputs": [],
"source": [
"input_nodes = X_train.shape[1]\n",
@@ -1526,8 +1653,10 @@
},
{
"cell_type": "markdown",
- "id": "3a138d66",
- "metadata": {},
+ "id": "a9c74baa",
+ "metadata": {
+ "editable": true
+ },
"source": [
"We will now make use of our validation data by passing it into our fit function as a keyword argument"
]
@@ -1535,8 +1664,11 @@
{
"cell_type": "code",
"execution_count": 17,
- "id": "faf1534e",
- "metadata": {},
+ "id": "e5021bbf",
+ "metadata": {
+ "collapsed": false,
+ "editable": true
+ },
"outputs": [],
"source": [
"logistic_regression.reset_weights() # reset weights such that previous runs or reruns don't affect the weights\n",
@@ -1547,8 +1679,10 @@
},
{
"cell_type": "markdown",
- "id": "33d2d346",
- "metadata": {},
+ "id": "ae0148bb",
+ "metadata": {
+ "editable": true
+ },
"source": [
"Finally, we will create a neural network with 2 hidden layers with activation functions."
]
@@ -1556,8 +1690,11 @@
{
"cell_type": "code",
"execution_count": 18,
- "id": "a8f0a61c",
- "metadata": {},
+ "id": "bb7e4340",
+ "metadata": {
+ "collapsed": false,
+ "editable": true
+ },
"outputs": [],
"source": [
"input_nodes = X_train.shape[1]\n",
@@ -1573,8 +1710,11 @@
{
"cell_type": "code",
"execution_count": 19,
- "id": "d651702d",
- "metadata": {},
+ "id": "d0655afb",
+ "metadata": {
+ "collapsed": false,
+ "editable": true
+ },
"outputs": [],
"source": [
"neural_network.reset_weights() # reset weights such that previous runs or reruns don't affect the weights\n",
@@ -1585,8 +1725,10 @@
},
{
"cell_type": "markdown",
- "id": "200b64c0",
- "metadata": {},
+ "id": "dc8a90af",
+ "metadata": {
+ "editable": true
+ },
"source": [
"### Multiclass classification\n",
"\n",
@@ -1598,8 +1740,11 @@
{
"cell_type": "code",
"execution_count": 20,
- "id": "98b8d59b",
- "metadata": {},
+ "id": "9305c08a",
+ "metadata": {
+ "collapsed": false,
+ "editable": true
+ },
"outputs": [],
"source": [
"from sklearn.datasets import load_digits\n",
@@ -1632,8 +1777,10 @@
},
{
"cell_type": "markdown",
- "id": "cadd7e47",
- "metadata": {},
+ "id": "8e208051",
+ "metadata": {
+ "editable": true
+ },
"source": [
"## Testing the XOR gate and other gates\n",
"\n",
@@ -1643,8 +1790,11 @@
{
"cell_type": "code",
"execution_count": 21,
- "id": "a40e5cfe",
- "metadata": {},
+ "id": "db016d41",
+ "metadata": {
+ "collapsed": false,
+ "editable": true
+ },
"outputs": [],
"source": [
"X = np.array([ [0, 0], [0, 1], [1, 0],[1, 1]],dtype=np.float64)\n",
@@ -1663,32 +1813,16 @@
},
{
"cell_type": "markdown",
- "id": "b635db73",
- "metadata": {},
+ "id": "d1384449",
+ "metadata": {
+ "editable": true
+ },
"source": [
"Not bad, but the results depend strongly on the learning reate. Try different learning rates."
]
}
],
- "metadata": {
- "kernelspec": {
- "display_name": "Python 3 (ipykernel)",
- "language": "python",
- "name": "python3"
- },
- "language_info": {
- "codemirror_mode": {
- "name": "ipython",
- "version": 3
- },
- "file_extension": ".py",
- "mimetype": "text/x-python",
- "name": "python",
- "nbconvert_exporter": "python",
- "pygments_lexer": "ipython3",
- "version": "3.9.10"
- }
- },
+ "metadata": {},
"nbformat": 4,
"nbformat_minor": 5
}
diff --git a/doc/pub/week43/html/week43-bs.html b/doc/pub/week43/html/week43-bs.html
index 4383cb68a..b2de3d75a 100644
--- a/doc/pub/week43/html/week43-bs.html
+++ b/doc/pub/week43/html/week43-bs.html
@@ -698,13 +698,14 @@ $$
and multiplying with \( \boldsymbol{a}_h \) gives the output
$$
-\boldsymbol{a}_o=\boldsymbol{w}_h^T\begin{bmatrix} 0 & 0 \\
+\boldsymbol{a}_o=\begin{bmatrix} 0 & 0 \\
1 & 0 \\
1 & 0 \\
- 2 & 1 \end{bmatrix}=\begin{bmatrix} 0 \\ 1 \\ 1 \\0\end{bmatrix},
+ 2 & 1 \end{bmatrix}\begin{bmatrix} 1 \\
+ -2\end{bmatrix}=\begin{bmatrix} 0 \\ 1 \\ 1 \\0\end{bmatrix},
$$
-the wanted result.
+the wanted result. Pay attention to the dimensionalities as well.
Setting up the Neural Network
diff --git a/doc/pub/week43/html/week43-reveal.html b/doc/pub/week43/html/week43-reveal.html
index 0acd6b052..44e7b3b2b 100644
--- a/doc/pub/week43/html/week43-reveal.html
+++ b/doc/pub/week43/html/week43-reveal.html
@@ -426,14 +426,15 @@ $$
and multiplying with \( \boldsymbol{a}_h \) gives the output
$$
-\boldsymbol{a}_o=\boldsymbol{w}_h^T\begin{bmatrix} 0 & 0 \\
+\boldsymbol{a}_o=\begin{bmatrix} 0 & 0 \\
1 & 0 \\
1 & 0 \\
- 2 & 1 \end{bmatrix}=\begin{bmatrix} 0 \\ 1 \\ 1 \\0\end{bmatrix},
+ 2 & 1 \end{bmatrix}\begin{bmatrix} 1 \\
+ -2\end{bmatrix}=\begin{bmatrix} 0 \\ 1 \\ 1 \\0\end{bmatrix},
$$
-
the wanted result.
+the wanted result. Pay attention to the dimensionalities as well.
diff --git a/doc/pub/week43/html/week43-solarized.html b/doc/pub/week43/html/week43-solarized.html
index c7e2f3865..aed8ff56d 100644
--- a/doc/pub/week43/html/week43-solarized.html
+++ b/doc/pub/week43/html/week43-solarized.html
@@ -578,13 +578,14 @@ $$
and multiplying with \( \boldsymbol{a}_h \) gives the output
$$
-\boldsymbol{a}_o=\boldsymbol{w}_h^T\begin{bmatrix} 0 & 0 \\
+\boldsymbol{a}_o=\begin{bmatrix} 0 & 0 \\
1 & 0 \\
1 & 0 \\
- 2 & 1 \end{bmatrix}=\begin{bmatrix} 0 \\ 1 \\ 1 \\0\end{bmatrix},
+ 2 & 1 \end{bmatrix}\begin{bmatrix} 1 \\
+ -2\end{bmatrix}=\begin{bmatrix} 0 \\ 1 \\ 1 \\0\end{bmatrix},
$$
-the wanted result.
+the wanted result. Pay attention to the dimensionalities as well.
Setting up the Neural Network
diff --git a/doc/pub/week43/html/week43.html b/doc/pub/week43/html/week43.html
index 6b6ca1818..3df7f021a 100644
--- a/doc/pub/week43/html/week43.html
+++ b/doc/pub/week43/html/week43.html
@@ -655,13 +655,14 @@ $$
and multiplying with \( \boldsymbol{a}_h \) gives the output
$$
-\boldsymbol{a}_o=\boldsymbol{w}_h^T\begin{bmatrix} 0 & 0 \\
+\boldsymbol{a}_o=\begin{bmatrix} 0 & 0 \\
1 & 0 \\
1 & 0 \\
- 2 & 1 \end{bmatrix}=\begin{bmatrix} 0 \\ 1 \\ 1 \\0\end{bmatrix},
+ 2 & 1 \end{bmatrix}\begin{bmatrix} 1 \\
+ -2\end{bmatrix}=\begin{bmatrix} 0 \\ 1 \\ 1 \\0\end{bmatrix},
$$
-the wanted result.
+the wanted result. Pay attention to the dimensionalities as well.
Setting up the Neural Network
diff --git a/doc/pub/week43/ipynb/ipynb-week43-src.tar.gz b/doc/pub/week43/ipynb/ipynb-week43-src.tar.gz
index fe7dc31b6..f64f296e4 100644
Binary files a/doc/pub/week43/ipynb/ipynb-week43-src.tar.gz and b/doc/pub/week43/ipynb/ipynb-week43-src.tar.gz differ
diff --git a/doc/pub/week43/ipynb/week43.ipynb b/doc/pub/week43/ipynb/week43.ipynb
index 8de3714cd..4c84cfe33 100644
--- a/doc/pub/week43/ipynb/week43.ipynb
+++ b/doc/pub/week43/ipynb/week43.ipynb
@@ -2,7 +2,7 @@
"cells": [
{
"cell_type": "markdown",
- "id": "8d7cc066",
+ "id": "88f6e253",
"metadata": {
"editable": true
},
@@ -14,7 +14,7 @@
},
{
"cell_type": "markdown",
- "id": "028dc8c6",
+ "id": "ebd16d73",
"metadata": {
"editable": true
},
@@ -29,7 +29,7 @@
},
{
"cell_type": "markdown",
- "id": "15ef2310",
+ "id": "e9bc94b9",
"metadata": {
"editable": true
},
@@ -73,7 +73,7 @@
},
{
"cell_type": "markdown",
- "id": "192aa783",
+ "id": "457d4421",
"metadata": {
"editable": true
},
@@ -87,7 +87,7 @@
},
{
"cell_type": "markdown",
- "id": "22874f1a",
+ "id": "e86537af",
"metadata": {
"editable": true
},
@@ -104,7 +104,7 @@
},
{
"cell_type": "markdown",
- "id": "29c53621",
+ "id": "14ffcfd0",
"metadata": {
"editable": true
},
@@ -114,7 +114,7 @@
},
{
"cell_type": "markdown",
- "id": "c3ab8226",
+ "id": "5773ab41",
"metadata": {
"editable": true
},
@@ -151,7 +151,7 @@
},
{
"cell_type": "markdown",
- "id": "d686af76",
+ "id": "fdcb6f1e",
"metadata": {
"editable": true
},
@@ -189,7 +189,7 @@
},
{
"cell_type": "markdown",
- "id": "9e6ae224",
+ "id": "7bc3e18a",
"metadata": {
"editable": true
},
@@ -201,7 +201,7 @@
},
{
"cell_type": "markdown",
- "id": "ee5e7e34",
+ "id": "b82f5167",
"metadata": {
"editable": true
},
@@ -216,7 +216,7 @@
},
{
"cell_type": "markdown",
- "id": "da275174",
+ "id": "1ff6327f",
"metadata": {
"editable": true
},
@@ -246,7 +246,7 @@
},
{
"cell_type": "markdown",
- "id": "78669a54",
+ "id": "fd88cb2a",
"metadata": {
"editable": true
},
@@ -258,7 +258,7 @@
},
{
"cell_type": "markdown",
- "id": "453ff3ab",
+ "id": "277ccf21",
"metadata": {
"editable": true
},
@@ -271,7 +271,7 @@
},
{
"cell_type": "markdown",
- "id": "9d82c2f1",
+ "id": "69024cd6",
"metadata": {
"editable": true
},
@@ -281,7 +281,7 @@
},
{
"cell_type": "markdown",
- "id": "a22ab766",
+ "id": "3739f7f4",
"metadata": {
"editable": true
},
@@ -296,7 +296,7 @@
},
{
"cell_type": "markdown",
- "id": "abfc4274",
+ "id": "891fbfbd",
"metadata": {
"editable": true
},
@@ -306,7 +306,7 @@
},
{
"cell_type": "markdown",
- "id": "2b7b0970",
+ "id": "0befa9f2",
"metadata": {
"editable": true
},
@@ -319,7 +319,7 @@
},
{
"cell_type": "markdown",
- "id": "d1e78b4a",
+ "id": "8b87520f",
"metadata": {
"editable": true
},
@@ -329,7 +329,7 @@
},
{
"cell_type": "markdown",
- "id": "0ee46428",
+ "id": "0c36a6e9",
"metadata": {
"editable": true
},
@@ -344,7 +344,7 @@
},
{
"cell_type": "markdown",
- "id": "bac66371",
+ "id": "6a5ebf2f",
"metadata": {
"editable": true
},
@@ -354,7 +354,7 @@
},
{
"cell_type": "markdown",
- "id": "77606059",
+ "id": "5c2cce0f",
"metadata": {
"editable": true
},
@@ -369,7 +369,7 @@
},
{
"cell_type": "markdown",
- "id": "b1a1f219",
+ "id": "6700bff0",
"metadata": {
"editable": true
},
@@ -379,7 +379,7 @@
},
{
"cell_type": "markdown",
- "id": "a46fd0d7",
+ "id": "c9deb439",
"metadata": {
"editable": true
},
@@ -392,7 +392,7 @@
},
{
"cell_type": "markdown",
- "id": "01e41f6f",
+ "id": "bca3d76a",
"metadata": {
"editable": true
},
@@ -402,32 +402,33 @@
},
{
"cell_type": "markdown",
- "id": "371a2c47",
+ "id": "0fd2b2d0",
"metadata": {
"editable": true
},
"source": [
"$$\n",
- "\\boldsymbol{a}_o=\\boldsymbol{w}_h^T\\begin{bmatrix} 0 & 0 \\\\\n",
+ "\\boldsymbol{a}_o=\\begin{bmatrix} 0 & 0 \\\\\n",
" 1 & 0 \\\\\n",
"\t\t 1 & 0 \\\\\n",
- "\t\t 2 & 1 \\end{bmatrix}=\\begin{bmatrix} 0 \\\\ 1 \\\\ 1 \\\\0\\end{bmatrix},\n",
+ "\t\t 2 & 1 \\end{bmatrix}\\begin{bmatrix} 1 \\\\\n",
+ " -2\\end{bmatrix}=\\begin{bmatrix} 0 \\\\ 1 \\\\ 1 \\\\0\\end{bmatrix},\n",
"$$"
]
},
{
"cell_type": "markdown",
- "id": "8ab62ed9",
+ "id": "aef5937c",
"metadata": {
"editable": true
},
"source": [
- "the wanted result."
+ "the wanted result. Pay attention to the dimensionalities as well."
]
},
{
"cell_type": "markdown",
- "id": "ee45366d",
+ "id": "784de267",
"metadata": {
"editable": true
},
@@ -440,7 +441,7 @@
{
"cell_type": "code",
"execution_count": 1,
- "id": "43b32c8a",
+ "id": "1529f64e",
"metadata": {
"collapsed": false,
"editable": true
@@ -510,7 +511,7 @@
},
{
"cell_type": "markdown",
- "id": "ce3f8d7b",
+ "id": "6c344985",
"metadata": {
"editable": true
},
@@ -520,7 +521,7 @@
},
{
"cell_type": "markdown",
- "id": "0a60227f",
+ "id": "dda91d6e",
"metadata": {
"editable": true
},
@@ -531,7 +532,7 @@
{
"cell_type": "code",
"execution_count": 2,
- "id": "0574c4c7",
+ "id": "dc12224d",
"metadata": {
"collapsed": false,
"editable": true
@@ -596,7 +597,7 @@
},
{
"cell_type": "markdown",
- "id": "c3db2190",
+ "id": "7c9b27ed",
"metadata": {
"editable": true
},
@@ -615,7 +616,7 @@
},
{
"cell_type": "markdown",
- "id": "3b6e8500",
+ "id": "e8e28114",
"metadata": {
"editable": true
},
@@ -637,7 +638,7 @@
{
"cell_type": "code",
"execution_count": 3,
- "id": "ee32fb88",
+ "id": "37a2ec80",
"metadata": {
"collapsed": false,
"editable": true
@@ -778,7 +779,7 @@
},
{
"cell_type": "markdown",
- "id": "6477d18f",
+ "id": "38ea41a5",
"metadata": {
"editable": true
},
@@ -794,7 +795,7 @@
{
"cell_type": "code",
"execution_count": 4,
- "id": "5a396095",
+ "id": "869cf239",
"metadata": {
"collapsed": false,
"editable": true
@@ -807,7 +808,7 @@
},
{
"cell_type": "markdown",
- "id": "28bd1ab9",
+ "id": "b9b25144",
"metadata": {
"editable": true
},
@@ -819,7 +820,7 @@
{
"cell_type": "code",
"execution_count": 5,
- "id": "fb5d04e9",
+ "id": "7d2dc23b",
"metadata": {
"collapsed": false,
"editable": true
@@ -841,7 +842,7 @@
},
{
"cell_type": "markdown",
- "id": "f1229684",
+ "id": "83b5e35f",
"metadata": {
"editable": true
},
@@ -857,7 +858,7 @@
{
"cell_type": "code",
"execution_count": 6,
- "id": "f4a50c76",
+ "id": "4c217329",
"metadata": {
"collapsed": false,
"editable": true
@@ -895,7 +896,7 @@
},
{
"cell_type": "markdown",
- "id": "3d646164",
+ "id": "a0515ac9",
"metadata": {
"editable": true
},
@@ -908,7 +909,7 @@
{
"cell_type": "code",
"execution_count": 7,
- "id": "b0057b55",
+ "id": "5eb41a10",
"metadata": {
"collapsed": false,
"editable": true
@@ -929,7 +930,7 @@
},
{
"cell_type": "markdown",
- "id": "37f67196",
+ "id": "0535d6fd",
"metadata": {
"editable": true
},
@@ -945,7 +946,7 @@
{
"cell_type": "code",
"execution_count": 8,
- "id": "ae3c2dad",
+ "id": "c55d6d5f",
"metadata": {
"collapsed": false,
"editable": true
@@ -1003,7 +1004,7 @@
},
{
"cell_type": "markdown",
- "id": "5be7f268",
+ "id": "b820a2a1",
"metadata": {
"editable": true
},
@@ -1018,7 +1019,7 @@
{
"cell_type": "code",
"execution_count": 9,
- "id": "5296db7b",
+ "id": "43974d31",
"metadata": {
"collapsed": false,
"editable": true
@@ -1039,7 +1040,7 @@
},
{
"cell_type": "markdown",
- "id": "fa62814a",
+ "id": "ec754834",
"metadata": {
"editable": true
},
@@ -1063,7 +1064,7 @@
{
"cell_type": "code",
"execution_count": 10,
- "id": "08db6527",
+ "id": "505e52ab",
"metadata": {
"collapsed": false,
"editable": true
@@ -1535,7 +1536,7 @@
},
{
"cell_type": "markdown",
- "id": "464f4548",
+ "id": "00aa7046",
"metadata": {
"editable": true
},
@@ -1547,7 +1548,7 @@
{
"cell_type": "code",
"execution_count": 11,
- "id": "ea3d3c51",
+ "id": "b0b45dd4",
"metadata": {
"collapsed": false,
"editable": true
@@ -1591,7 +1592,7 @@
},
{
"cell_type": "markdown",
- "id": "a6b49446",
+ "id": "cf9645c3",
"metadata": {
"editable": true
},
@@ -1607,7 +1608,7 @@
{
"cell_type": "code",
"execution_count": 12,
- "id": "4f0f50b6",
+ "id": "a792c324",
"metadata": {
"collapsed": false,
"editable": true
@@ -1622,7 +1623,7 @@
},
{
"cell_type": "markdown",
- "id": "8ae3f1e4",
+ "id": "e11ed70e",
"metadata": {
"editable": true
},
@@ -1633,7 +1634,7 @@
{
"cell_type": "code",
"execution_count": 13,
- "id": "4d206fa2",
+ "id": "dfd03f3c",
"metadata": {
"collapsed": false,
"editable": true
@@ -1648,7 +1649,7 @@
},
{
"cell_type": "markdown",
- "id": "27ffcb75",
+ "id": "99b1bd91",
"metadata": {
"editable": true
},
@@ -1664,7 +1665,7 @@
{
"cell_type": "code",
"execution_count": 14,
- "id": "8cf19432",
+ "id": "864038bb",
"metadata": {
"collapsed": false,
"editable": true
@@ -1678,7 +1679,7 @@
},
{
"cell_type": "markdown",
- "id": "97abfa15",
+ "id": "24d5f3cc",
"metadata": {
"editable": true
},
@@ -1693,7 +1694,7 @@
{
"cell_type": "code",
"execution_count": 15,
- "id": "5aa3cb16",
+ "id": "14df9a52",
"metadata": {
"collapsed": false,
"editable": true
@@ -1719,7 +1720,7 @@
{
"cell_type": "code",
"execution_count": 16,
- "id": "793cb2e9",
+ "id": "adb3edf2",
"metadata": {
"collapsed": false,
"editable": true
@@ -1734,7 +1735,7 @@
},
{
"cell_type": "markdown",
- "id": "7b47a35a",
+ "id": "fa885022",
"metadata": {
"editable": true
},
@@ -1745,7 +1746,7 @@
{
"cell_type": "code",
"execution_count": 17,
- "id": "e34123b4",
+ "id": "1b862f90",
"metadata": {
"collapsed": false,
"editable": true
@@ -1760,7 +1761,7 @@
},
{
"cell_type": "markdown",
- "id": "413243c9",
+ "id": "e86e60dc",
"metadata": {
"editable": true
},
@@ -1771,7 +1772,7 @@
{
"cell_type": "code",
"execution_count": 18,
- "id": "aa7b9e8f",
+ "id": "9e578191",
"metadata": {
"collapsed": false,
"editable": true
@@ -1791,7 +1792,7 @@
{
"cell_type": "code",
"execution_count": 19,
- "id": "c66ee57f",
+ "id": "bbfc34f4",
"metadata": {
"collapsed": false,
"editable": true
@@ -1806,7 +1807,7 @@
},
{
"cell_type": "markdown",
- "id": "aca7922f",
+ "id": "2ac7ad43",
"metadata": {
"editable": true
},
@@ -1821,7 +1822,7 @@
{
"cell_type": "code",
"execution_count": 20,
- "id": "1503f15a",
+ "id": "f4a821cd",
"metadata": {
"collapsed": false,
"editable": true
@@ -1858,7 +1859,7 @@
},
{
"cell_type": "markdown",
- "id": "838cf72d",
+ "id": "0fcf8bf2",
"metadata": {
"editable": true
},
@@ -1871,7 +1872,7 @@
{
"cell_type": "code",
"execution_count": 21,
- "id": "a4444105",
+ "id": "d91608cf",
"metadata": {
"collapsed": false,
"editable": true
@@ -1894,7 +1895,7 @@
},
{
"cell_type": "markdown",
- "id": "8bbdf09c",
+ "id": "494009be",
"metadata": {
"editable": true
},
@@ -1904,7 +1905,7 @@
},
{
"cell_type": "markdown",
- "id": "c5cffe73",
+ "id": "db70a4fe",
"metadata": {
"editable": true
},
@@ -1914,7 +1915,7 @@
},
{
"cell_type": "markdown",
- "id": "e88dc6ab",
+ "id": "e5fc9732",
"metadata": {
"editable": true
},
@@ -1943,7 +1944,7 @@
},
{
"cell_type": "markdown",
- "id": "8ec227a0",
+ "id": "1f986c86",
"metadata": {
"editable": true
},
@@ -1993,7 +1994,7 @@
{
"cell_type": "code",
"execution_count": 22,
- "id": "5336138a",
+ "id": "0f845fb5",
"metadata": {
"collapsed": false,
"editable": true
@@ -2046,7 +2047,7 @@
},
{
"cell_type": "markdown",
- "id": "da4f9c76",
+ "id": "fbab1656",
"metadata": {
"editable": true
},
@@ -2067,7 +2068,7 @@
{
"cell_type": "code",
"execution_count": 23,
- "id": "3d4a38d4",
+ "id": "3ecd3028",
"metadata": {
"collapsed": false,
"editable": true
@@ -2105,7 +2106,7 @@
},
{
"cell_type": "markdown",
- "id": "bc7c43bb",
+ "id": "b45412df",
"metadata": {
"editable": true
},
@@ -2149,7 +2150,7 @@
},
{
"cell_type": "markdown",
- "id": "60a15786",
+ "id": "e90b1e65",
"metadata": {
"editable": true
},
@@ -2189,7 +2190,7 @@
},
{
"cell_type": "markdown",
- "id": "d9b2c952",
+ "id": "92bff738",
"metadata": {
"editable": true
},
@@ -2210,7 +2211,7 @@
{
"cell_type": "code",
"execution_count": 24,
- "id": "a6dfcaaf",
+ "id": "8eb225e4",
"metadata": {
"collapsed": false,
"editable": true
@@ -2236,7 +2237,7 @@
},
{
"cell_type": "markdown",
- "id": "623ec89c",
+ "id": "da1e7ad6",
"metadata": {
"editable": true
},
@@ -2264,7 +2265,7 @@
},
{
"cell_type": "markdown",
- "id": "391b8f09",
+ "id": "52ea3780",
"metadata": {
"editable": true
},
@@ -2301,7 +2302,7 @@
{
"cell_type": "code",
"execution_count": 25,
- "id": "a3a7a56e",
+ "id": "8ec12507",
"metadata": {
"collapsed": false,
"editable": true
@@ -2347,7 +2348,7 @@
},
{
"cell_type": "markdown",
- "id": "6a467f9c",
+ "id": "518a6c33",
"metadata": {
"editable": true
},
@@ -2378,7 +2379,7 @@
},
{
"cell_type": "markdown",
- "id": "824f2150",
+ "id": "9e4fe561",
"metadata": {
"editable": true
},
@@ -2416,7 +2417,7 @@
},
{
"cell_type": "markdown",
- "id": "ad801a4f",
+ "id": "331db754",
"metadata": {
"editable": true
},
@@ -2450,7 +2451,7 @@
},
{
"cell_type": "markdown",
- "id": "adbd5bf5",
+ "id": "94f8797f",
"metadata": {
"editable": true
},
@@ -2491,7 +2492,7 @@
{
"cell_type": "code",
"execution_count": 26,
- "id": "03850373",
+ "id": "6cc0ad5a",
"metadata": {
"collapsed": false,
"editable": true
@@ -2570,7 +2571,7 @@
},
{
"cell_type": "markdown",
- "id": "5c4ce702",
+ "id": "66341fe5",
"metadata": {
"editable": true
},
@@ -2591,7 +2592,7 @@
},
{
"cell_type": "markdown",
- "id": "f54c055f",
+ "id": "4654bdd2",
"metadata": {
"editable": true
},
@@ -2605,7 +2606,7 @@
{
"cell_type": "code",
"execution_count": 27,
- "id": "05fadefb",
+ "id": "84200c9e",
"metadata": {
"collapsed": false,
"editable": true
@@ -2715,7 +2716,7 @@
},
{
"cell_type": "markdown",
- "id": "6d6bba32",
+ "id": "2fade818",
"metadata": {
"editable": true
},
@@ -2734,7 +2735,7 @@
{
"cell_type": "code",
"execution_count": 28,
- "id": "5605c90f",
+ "id": "da2d74fa",
"metadata": {
"collapsed": false,
"editable": true
@@ -2761,7 +2762,7 @@
},
{
"cell_type": "markdown",
- "id": "f22bb889",
+ "id": "45f911b8",
"metadata": {
"editable": true
},
@@ -2775,7 +2776,7 @@
{
"cell_type": "code",
"execution_count": 29,
- "id": "a097c9e1",
+ "id": "b21a2c19",
"metadata": {
"collapsed": false,
"editable": true
@@ -2806,7 +2807,7 @@
},
{
"cell_type": "markdown",
- "id": "bc02f298",
+ "id": "80801250",
"metadata": {
"editable": true
},
@@ -2817,7 +2818,7 @@
{
"cell_type": "code",
"execution_count": 30,
- "id": "970ba03e",
+ "id": "303e085a",
"metadata": {
"collapsed": false,
"editable": true
@@ -2861,7 +2862,7 @@
},
{
"cell_type": "markdown",
- "id": "e4ff0700",
+ "id": "9358790a",
"metadata": {
"editable": true
},
@@ -2884,7 +2885,7 @@
{
"cell_type": "code",
"execution_count": 31,
- "id": "8bc77d1c",
+ "id": "a238def8",
"metadata": {
"collapsed": false,
"editable": true
@@ -2911,7 +2912,7 @@
},
{
"cell_type": "markdown",
- "id": "76d38bcf",
+ "id": "2ef943ac",
"metadata": {
"editable": true
},
@@ -2922,7 +2923,7 @@
{
"cell_type": "code",
"execution_count": 32,
- "id": "d22894cb",
+ "id": "afeabf8f",
"metadata": {
"collapsed": false,
"editable": true
@@ -2967,7 +2968,7 @@
},
{
"cell_type": "markdown",
- "id": "d4efa31d",
+ "id": "3dd5dfb4",
"metadata": {
"editable": true
},
@@ -2985,7 +2986,7 @@
},
{
"cell_type": "markdown",
- "id": "d6caddb7",
+ "id": "72754d13",
"metadata": {
"editable": true
},
@@ -3020,7 +3021,7 @@
{
"cell_type": "code",
"execution_count": 33,
- "id": "96f112a6",
+ "id": "9fc42ba6",
"metadata": {
"collapsed": false,
"editable": true
@@ -3032,7 +3033,7 @@
},
{
"cell_type": "markdown",
- "id": "2dee5b42",
+ "id": "35795551",
"metadata": {
"editable": true
},
@@ -3044,7 +3045,7 @@
{
"cell_type": "code",
"execution_count": 34,
- "id": "29e13f69",
+ "id": "1dabca19",
"metadata": {
"collapsed": false,
"editable": true
@@ -3057,7 +3058,7 @@
},
{
"cell_type": "markdown",
- "id": "4695192d",
+ "id": "be829505",
"metadata": {
"editable": true
},
@@ -3068,7 +3069,7 @@
{
"cell_type": "code",
"execution_count": 35,
- "id": "573fade6",
+ "id": "7d92ce1c",
"metadata": {
"collapsed": false,
"editable": true
@@ -3081,7 +3082,7 @@
},
{
"cell_type": "markdown",
- "id": "0d8ced47",
+ "id": "057049d7",
"metadata": {
"editable": true
},
@@ -3096,7 +3097,7 @@
{
"cell_type": "code",
"execution_count": 36,
- "id": "28886e64",
+ "id": "0837641b",
"metadata": {
"collapsed": false,
"editable": true
@@ -3108,7 +3109,7 @@
},
{
"cell_type": "markdown",
- "id": "298e5186",
+ "id": "19d5a72d",
"metadata": {
"editable": true
},
@@ -3120,7 +3121,7 @@
},
{
"cell_type": "markdown",
- "id": "ea131902",
+ "id": "4ae0b49b",
"metadata": {
"editable": true
},
@@ -3133,7 +3134,7 @@
{
"cell_type": "code",
"execution_count": 37,
- "id": "686215bb",
+ "id": "429afe53",
"metadata": {
"collapsed": false,
"editable": true
@@ -3188,7 +3189,7 @@
{
"cell_type": "code",
"execution_count": 38,
- "id": "fa9efbca",
+ "id": "887c06b9",
"metadata": {
"collapsed": false,
"editable": true
@@ -3217,7 +3218,7 @@
{
"cell_type": "code",
"execution_count": 39,
- "id": "5a6a0547",
+ "id": "a4d8f64e",
"metadata": {
"collapsed": false,
"editable": true
@@ -3247,7 +3248,7 @@
{
"cell_type": "code",
"execution_count": 40,
- "id": "9df608ec",
+ "id": "b8fb8fa0",
"metadata": {
"collapsed": false,
"editable": true
@@ -3274,7 +3275,7 @@
{
"cell_type": "code",
"execution_count": 41,
- "id": "8d20fdf7",
+ "id": "7777faa8",
"metadata": {
"collapsed": false,
"editable": true
@@ -3316,7 +3317,7 @@
},
{
"cell_type": "markdown",
- "id": "bd641a2a",
+ "id": "bb6d1d3e",
"metadata": {
"editable": true
},
@@ -3327,7 +3328,7 @@
{
"cell_type": "code",
"execution_count": 42,
- "id": "a6d8bf75",
+ "id": "d8c0caf4",
"metadata": {
"collapsed": false,
"editable": true
@@ -3504,7 +3505,7 @@
},
{
"cell_type": "markdown",
- "id": "505033e6",
+ "id": "2631b51d",
"metadata": {
"editable": true
},
@@ -3532,7 +3533,7 @@
},
{
"cell_type": "markdown",
- "id": "d138fcf8",
+ "id": "357644b3",
"metadata": {
"editable": true
},
@@ -3555,7 +3556,7 @@
},
{
"cell_type": "markdown",
- "id": "df986885",
+ "id": "06854c7f",
"metadata": {
"editable": true
},
@@ -3586,7 +3587,7 @@
},
{
"cell_type": "markdown",
- "id": "67ccb46b",
+ "id": "bb26a6da",
"metadata": {
"editable": true
},
@@ -3618,7 +3619,7 @@
},
{
"cell_type": "markdown",
- "id": "a043bdea",
+ "id": "0277931e",
"metadata": {
"editable": true
},
@@ -3656,7 +3657,7 @@
},
{
"cell_type": "markdown",
- "id": "ac370685",
+ "id": "93a45265",
"metadata": {
"editable": true
},
@@ -3681,7 +3682,7 @@
},
{
"cell_type": "markdown",
- "id": "68411972",
+ "id": "7feb8c33",
"metadata": {
"editable": true
},
@@ -3693,7 +3694,7 @@
},
{
"cell_type": "markdown",
- "id": "68d05dd2",
+ "id": "1f55cf23",
"metadata": {
"editable": true
},
@@ -3716,7 +3717,7 @@
},
{
"cell_type": "markdown",
- "id": "55c89a89",
+ "id": "7cea0ca3",
"metadata": {
"editable": true
},
@@ -3736,7 +3737,7 @@
},
{
"cell_type": "markdown",
- "id": "20f0b6de",
+ "id": "086014d5",
"metadata": {
"editable": true
},
@@ -3758,7 +3759,7 @@
},
{
"cell_type": "markdown",
- "id": "8f0a4e60",
+ "id": "9bc419af",
"metadata": {
"editable": true
},
@@ -3776,7 +3777,7 @@
},
{
"cell_type": "markdown",
- "id": "ee9f6778",
+ "id": "a9198ed4",
"metadata": {
"editable": true
},
@@ -3795,7 +3796,7 @@
},
{
"cell_type": "markdown",
- "id": "8ec34edc",
+ "id": "75c023d8",
"metadata": {
"editable": true
},
@@ -3807,7 +3808,7 @@
},
{
"cell_type": "markdown",
- "id": "4cb4f14f",
+ "id": "2d2e4666",
"metadata": {
"editable": true
},
@@ -3852,7 +3853,7 @@
},
{
"cell_type": "markdown",
- "id": "3ceba030",
+ "id": "23dc45c2",
"metadata": {
"editable": true
},
@@ -3882,7 +3883,7 @@
},
{
"cell_type": "markdown",
- "id": "fad4c7c0",
+ "id": "8d80aba5",
"metadata": {
"editable": true
},
@@ -3909,7 +3910,7 @@
},
{
"cell_type": "markdown",
- "id": "92edec9a",
+ "id": "b8d6cf49",
"metadata": {
"editable": true
},
@@ -3923,7 +3924,7 @@
},
{
"cell_type": "markdown",
- "id": "07153151",
+ "id": "ba566ae5",
"metadata": {
"editable": true
},
@@ -3940,7 +3941,7 @@
},
{
"cell_type": "markdown",
- "id": "31a707ec",
+ "id": "fddca9d2",
"metadata": {
"editable": true
},
@@ -3956,7 +3957,7 @@
},
{
"cell_type": "markdown",
- "id": "d0cbacbc",
+ "id": "11ed9eb7",
"metadata": {
"editable": true
},
@@ -3968,7 +3969,7 @@
},
{
"cell_type": "markdown",
- "id": "88e6378a",
+ "id": "ab228680",
"metadata": {
"editable": true
},
@@ -3986,7 +3987,7 @@
},
{
"cell_type": "markdown",
- "id": "a85abfe5",
+ "id": "a620d020",
"metadata": {
"editable": true
},
@@ -4007,7 +4008,7 @@
},
{
"cell_type": "markdown",
- "id": "28e312e0",
+ "id": "4de72e77",
"metadata": {
"editable": true
},
@@ -4024,7 +4025,7 @@
},
{
"cell_type": "markdown",
- "id": "7e562a52",
+ "id": "60ef63bb",
"metadata": {
"editable": true
},
@@ -4036,7 +4037,7 @@
},
{
"cell_type": "markdown",
- "id": "ca872cb5",
+ "id": "6c719d5b",
"metadata": {
"editable": true
},
@@ -4047,7 +4048,7 @@
},
{
"cell_type": "markdown",
- "id": "3f5aaf97",
+ "id": "3a6248cc",
"metadata": {
"editable": true
},
@@ -4064,7 +4065,7 @@
},
{
"cell_type": "markdown",
- "id": "ea91ec87",
+ "id": "937fbb4d",
"metadata": {
"editable": true
},
@@ -4075,7 +4076,7 @@
},
{
"cell_type": "markdown",
- "id": "23d4791e",
+ "id": "985098ad",
"metadata": {
"editable": true
},
@@ -4091,7 +4092,7 @@
},
{
"cell_type": "markdown",
- "id": "645d3042",
+ "id": "7a2ade22",
"metadata": {
"editable": true
},
@@ -4103,7 +4104,7 @@
},
{
"cell_type": "markdown",
- "id": "1957cac1",
+ "id": "4b50fe09",
"metadata": {
"editable": true
},
@@ -4120,7 +4121,7 @@
},
{
"cell_type": "markdown",
- "id": "7ba994c2",
+ "id": "310ac762",
"metadata": {
"editable": true
},
@@ -4132,7 +4133,7 @@
},
{
"cell_type": "markdown",
- "id": "0b4d1e86",
+ "id": "8ce2620f",
"metadata": {
"editable": true
},
@@ -4150,7 +4151,7 @@
},
{
"cell_type": "markdown",
- "id": "7c000d4f",
+ "id": "78459d15",
"metadata": {
"editable": true
},
@@ -4160,7 +4161,7 @@
},
{
"cell_type": "markdown",
- "id": "5c6e9896",
+ "id": "d40f94e2",
"metadata": {
"editable": true
},
@@ -4172,7 +4173,7 @@
},
{
"cell_type": "markdown",
- "id": "c610b5a3",
+ "id": "c5f2c97d",
"metadata": {
"editable": true
},
@@ -4189,7 +4190,7 @@
},
{
"cell_type": "markdown",
- "id": "7b156ba0",
+ "id": "bb30f7cc",
"metadata": {
"editable": true
},
@@ -4201,7 +4202,7 @@
},
{
"cell_type": "markdown",
- "id": "6332b4fb",
+ "id": "a5d8512c",
"metadata": {
"editable": true
},
@@ -4212,7 +4213,7 @@
},
{
"cell_type": "markdown",
- "id": "dadb48a5",
+ "id": "1c888249",
"metadata": {
"editable": true
},
@@ -4224,7 +4225,7 @@
},
{
"cell_type": "markdown",
- "id": "14979de9",
+ "id": "477dada7",
"metadata": {
"editable": true
},
@@ -4234,7 +4235,7 @@
},
{
"cell_type": "markdown",
- "id": "b15978ac",
+ "id": "8e5e2b68",
"metadata": {
"editable": true
},
@@ -4254,7 +4255,7 @@
},
{
"cell_type": "markdown",
- "id": "ab70d7dc",
+ "id": "84150e8d",
"metadata": {
"editable": true
},
@@ -4271,7 +4272,7 @@
},
{
"cell_type": "markdown",
- "id": "3158ad88",
+ "id": "3f25aabb",
"metadata": {
"editable": true
},
@@ -4290,7 +4291,7 @@
},
{
"cell_type": "markdown",
- "id": "424ea4cd",
+ "id": "ce6c0a98",
"metadata": {
"editable": true
},
@@ -4302,7 +4303,7 @@
},
{
"cell_type": "markdown",
- "id": "9875f210",
+ "id": "17805209",
"metadata": {
"editable": true
},
@@ -4312,7 +4313,7 @@
},
{
"cell_type": "markdown",
- "id": "c317c081",
+ "id": "f9984101",
"metadata": {
"editable": true
},
@@ -4329,7 +4330,7 @@
},
{
"cell_type": "markdown",
- "id": "850d7062",
+ "id": "4abcf7b3",
"metadata": {
"editable": true
},
@@ -4339,7 +4340,7 @@
},
{
"cell_type": "markdown",
- "id": "05b6c21e",
+ "id": "3a4b99d7",
"metadata": {
"editable": true
},
@@ -4355,7 +4356,7 @@
},
{
"cell_type": "markdown",
- "id": "52090d6f",
+ "id": "261d5f57",
"metadata": {
"editable": true
},
@@ -4367,7 +4368,7 @@
},
{
"cell_type": "markdown",
- "id": "f4f56b6e",
+ "id": "0c7e0ed7",
"metadata": {
"editable": true
},
@@ -4379,7 +4380,7 @@
},
{
"cell_type": "markdown",
- "id": "e76317e2",
+ "id": "410091f0",
"metadata": {
"editable": true
},
@@ -4391,7 +4392,7 @@
},
{
"cell_type": "markdown",
- "id": "cf1ff27d",
+ "id": "17f0e1e7",
"metadata": {
"editable": true
},
@@ -4401,7 +4402,7 @@
},
{
"cell_type": "markdown",
- "id": "c6558ca7",
+ "id": "acac4ddf",
"metadata": {
"editable": true
},
@@ -4413,7 +4414,7 @@
},
{
"cell_type": "markdown",
- "id": "eb10b3cf",
+ "id": "0b3bdcec",
"metadata": {
"editable": true
},
@@ -4430,7 +4431,7 @@
},
{
"cell_type": "markdown",
- "id": "95040138",
+ "id": "8b71f89e",
"metadata": {
"editable": true
},
@@ -4440,7 +4441,7 @@
},
{
"cell_type": "markdown",
- "id": "efbb37df",
+ "id": "b1a4b8b2",
"metadata": {
"editable": true
},
@@ -4452,7 +4453,7 @@
},
{
"cell_type": "markdown",
- "id": "ce339463",
+ "id": "bb3f35b1",
"metadata": {
"editable": true
},
@@ -4466,7 +4467,7 @@
},
{
"cell_type": "markdown",
- "id": "51d1021d",
+ "id": "bb8eac7a",
"metadata": {
"editable": true
},
@@ -4482,7 +4483,7 @@
},
{
"cell_type": "markdown",
- "id": "5471c13f",
+ "id": "23361eba",
"metadata": {
"editable": true
},
@@ -4494,7 +4495,7 @@
},
{
"cell_type": "markdown",
- "id": "ca1015ba",
+ "id": "94bf3ada",
"metadata": {
"editable": true
},
@@ -4516,7 +4517,7 @@
},
{
"cell_type": "markdown",
- "id": "325048d9",
+ "id": "ff0afe4b",
"metadata": {
"editable": true
},
@@ -4528,7 +4529,7 @@
},
{
"cell_type": "markdown",
- "id": "5c6b185f",
+ "id": "393ee959",
"metadata": {
"editable": true
},
@@ -4551,7 +4552,7 @@
},
{
"cell_type": "markdown",
- "id": "eddea0e3",
+ "id": "f2df5cfc",
"metadata": {
"editable": true
},
@@ -4567,7 +4568,7 @@
},
{
"cell_type": "markdown",
- "id": "39eeb7a1",
+ "id": "f6358bb7",
"metadata": {
"editable": true
},
@@ -4579,7 +4580,7 @@
},
{
"cell_type": "markdown",
- "id": "25477c00",
+ "id": "ef56bb84",
"metadata": {
"editable": true
},
@@ -4603,7 +4604,7 @@
},
{
"cell_type": "markdown",
- "id": "dbdce765",
+ "id": "acd41944",
"metadata": {
"editable": true
},
@@ -4615,7 +4616,7 @@
},
{
"cell_type": "markdown",
- "id": "3b833783",
+ "id": "1a2a7e92",
"metadata": {
"editable": true
},
@@ -4636,7 +4637,7 @@
},
{
"cell_type": "markdown",
- "id": "98103cac",
+ "id": "a082637c",
"metadata": {
"editable": true
},
@@ -4648,7 +4649,7 @@
},
{
"cell_type": "markdown",
- "id": "01de1e28",
+ "id": "dfc24dff",
"metadata": {
"editable": true
},
@@ -4667,7 +4668,7 @@
},
{
"cell_type": "markdown",
- "id": "3d50cf6a",
+ "id": "90f81e55",
"metadata": {
"editable": true
},
@@ -4677,7 +4678,7 @@
},
{
"cell_type": "markdown",
- "id": "221269b0",
+ "id": "3693fc3b",
"metadata": {
"editable": true
},
@@ -4691,7 +4692,7 @@
},
{
"cell_type": "markdown",
- "id": "b736af88",
+ "id": "2bb540dd",
"metadata": {
"editable": true
},
@@ -4703,7 +4704,7 @@
},
{
"cell_type": "markdown",
- "id": "ea505169",
+ "id": "5fad7cc5",
"metadata": {
"editable": true
},
@@ -4715,7 +4716,7 @@
},
{
"cell_type": "markdown",
- "id": "515470a3",
+ "id": "c9a47e0a",
"metadata": {
"editable": true
},
@@ -4732,7 +4733,7 @@
},
{
"cell_type": "markdown",
- "id": "f9eaeace",
+ "id": "f579f1d0",
"metadata": {
"editable": true
},
@@ -4744,7 +4745,7 @@
},
{
"cell_type": "markdown",
- "id": "e6488f9b",
+ "id": "f980cb6a",
"metadata": {
"editable": true
},
@@ -4766,7 +4767,7 @@
},
{
"cell_type": "markdown",
- "id": "f2bc476e",
+ "id": "de47a73d",
"metadata": {
"editable": true
},
@@ -4781,7 +4782,7 @@
},
{
"cell_type": "markdown",
- "id": "2d7b7d19",
+ "id": "5eacb34e",
"metadata": {
"editable": true
},
@@ -4792,7 +4793,7 @@
{
"cell_type": "code",
"execution_count": 43,
- "id": "4aad6e10",
+ "id": "77235f88",
"metadata": {
"collapsed": false,
"editable": true
@@ -4947,7 +4948,7 @@
},
{
"cell_type": "markdown",
- "id": "f8c418c1",
+ "id": "0147790d",
"metadata": {
"editable": true
},
@@ -4962,7 +4963,7 @@
{
"cell_type": "code",
"execution_count": 44,
- "id": "96758ada",
+ "id": "59eb96af",
"metadata": {
"collapsed": false,
"editable": true
@@ -5131,7 +5132,7 @@
},
{
"cell_type": "markdown",
- "id": "c62fedb8",
+ "id": "dc02c291",
"metadata": {
"editable": true
},
@@ -5144,7 +5145,7 @@
},
{
"cell_type": "markdown",
- "id": "1f962431",
+ "id": "c8fff51e",
"metadata": {
"editable": true
},
@@ -5161,7 +5162,7 @@
},
{
"cell_type": "markdown",
- "id": "71b1d885",
+ "id": "3751edf7",
"metadata": {
"editable": true
},
@@ -5177,7 +5178,7 @@
},
{
"cell_type": "markdown",
- "id": "0b96a028",
+ "id": "a502c731",
"metadata": {
"editable": true
},
@@ -5190,7 +5191,7 @@
},
{
"cell_type": "markdown",
- "id": "311ae3d3",
+ "id": "eb73f07e",
"metadata": {
"editable": true
},
@@ -5207,7 +5208,7 @@
},
{
"cell_type": "markdown",
- "id": "98cb3d44",
+ "id": "9ab9d930",
"metadata": {
"editable": true
},
@@ -5219,7 +5220,7 @@
},
{
"cell_type": "markdown",
- "id": "3e8e134d",
+ "id": "9cb8689a",
"metadata": {
"editable": true
},
@@ -5246,7 +5247,7 @@
},
{
"cell_type": "markdown",
- "id": "a1844ff9",
+ "id": "d21e3a14",
"metadata": {
"editable": true
},
@@ -5259,7 +5260,7 @@
{
"cell_type": "code",
"execution_count": 45,
- "id": "4410b99e",
+ "id": "833da16b",
"metadata": {
"collapsed": false,
"editable": true
@@ -5433,7 +5434,7 @@
},
{
"cell_type": "markdown",
- "id": "f0ab0e0f",
+ "id": "0fdcf8c5",
"metadata": {
"editable": true
},
@@ -5453,7 +5454,7 @@
},
{
"cell_type": "markdown",
- "id": "333b0a8d",
+ "id": "0a057338",
"metadata": {
"editable": true
},
@@ -5468,7 +5469,7 @@
},
{
"cell_type": "markdown",
- "id": "5b358fbf",
+ "id": "6721bcf2",
"metadata": {
"editable": true
},
@@ -5482,7 +5483,7 @@
},
{
"cell_type": "markdown",
- "id": "c5d60864",
+ "id": "dc3db9fd",
"metadata": {
"editable": true
},
@@ -5498,7 +5499,7 @@
},
{
"cell_type": "markdown",
- "id": "bcce6eb8",
+ "id": "9af3fd6a",
"metadata": {
"editable": true
},
@@ -5508,7 +5509,7 @@
},
{
"cell_type": "markdown",
- "id": "e6497fd7",
+ "id": "4c2da445",
"metadata": {
"editable": true
},
@@ -5530,7 +5531,7 @@
},
{
"cell_type": "markdown",
- "id": "31b650fc",
+ "id": "93b58380",
"metadata": {
"editable": true
},
@@ -5544,7 +5545,7 @@
{
"cell_type": "code",
"execution_count": 46,
- "id": "6e267e72",
+ "id": "cb73915d",
"metadata": {
"collapsed": false,
"editable": true
@@ -5620,7 +5621,7 @@
},
{
"cell_type": "markdown",
- "id": "8b054a85",
+ "id": "c9d250c7",
"metadata": {
"editable": true
},
@@ -5632,7 +5633,7 @@
},
{
"cell_type": "markdown",
- "id": "f637dd9d",
+ "id": "0d67bc8c",
"metadata": {
"editable": true
},
@@ -5649,7 +5650,7 @@
},
{
"cell_type": "markdown",
- "id": "ac088e86",
+ "id": "fe4ee5a8",
"metadata": {
"editable": true
},
@@ -5661,7 +5662,7 @@
},
{
"cell_type": "markdown",
- "id": "14afd7fa",
+ "id": "62b400ca",
"metadata": {
"editable": true
},
@@ -5676,7 +5677,7 @@
},
{
"cell_type": "markdown",
- "id": "0a2680eb",
+ "id": "7d4723f2",
"metadata": {
"editable": true
},
@@ -5688,7 +5689,7 @@
},
{
"cell_type": "markdown",
- "id": "7e30575f",
+ "id": "97889b0e",
"metadata": {
"editable": true
},
@@ -5700,7 +5701,7 @@
},
{
"cell_type": "markdown",
- "id": "3b30e08a",
+ "id": "236028bc",
"metadata": {
"editable": true
},
@@ -5712,7 +5713,7 @@
},
{
"cell_type": "markdown",
- "id": "be7d958b",
+ "id": "a4334818",
"metadata": {
"editable": true
},
@@ -5722,7 +5723,7 @@
},
{
"cell_type": "markdown",
- "id": "d6a52e39",
+ "id": "8330dd77",
"metadata": {
"editable": true
},
@@ -5739,7 +5740,7 @@
},
{
"cell_type": "markdown",
- "id": "488d0a14",
+ "id": "78522018",
"metadata": {
"editable": true
},
@@ -5751,7 +5752,7 @@
},
{
"cell_type": "markdown",
- "id": "59834674",
+ "id": "943956e4",
"metadata": {
"editable": true
},
@@ -5763,7 +5764,7 @@
},
{
"cell_type": "markdown",
- "id": "af640638",
+ "id": "3c7b57e2",
"metadata": {
"editable": true
},
@@ -5773,7 +5774,7 @@
},
{
"cell_type": "markdown",
- "id": "8d83ea23",
+ "id": "55173c99",
"metadata": {
"editable": true
},
@@ -5785,7 +5786,7 @@
},
{
"cell_type": "markdown",
- "id": "4d4e4ea8",
+ "id": "a6d078e4",
"metadata": {
"editable": true
},
@@ -5796,7 +5797,7 @@
{
"cell_type": "code",
"execution_count": 47,
- "id": "ad4cc32f",
+ "id": "452c599c",
"metadata": {
"collapsed": false,
"editable": true
@@ -5957,7 +5958,7 @@
},
{
"cell_type": "markdown",
- "id": "ceb283ce",
+ "id": "8ca2348f",
"metadata": {
"editable": true
},
@@ -5979,7 +5980,7 @@
},
{
"cell_type": "markdown",
- "id": "a68e0e56",
+ "id": "0ccc174e",
"metadata": {
"editable": true
},
@@ -5996,7 +5997,7 @@
},
{
"cell_type": "markdown",
- "id": "8441e4e6",
+ "id": "d4601257",
"metadata": {
"editable": true
},
@@ -6006,7 +6007,7 @@
},
{
"cell_type": "markdown",
- "id": "1d343e68",
+ "id": "9ec01889",
"metadata": {
"editable": true
},
@@ -6021,7 +6022,7 @@
},
{
"cell_type": "markdown",
- "id": "1c566531",
+ "id": "71993d6c",
"metadata": {
"editable": true
},
@@ -6031,7 +6032,7 @@
},
{
"cell_type": "markdown",
- "id": "7a06b755",
+ "id": "f6acfae4",
"metadata": {
"editable": true
},
@@ -6046,7 +6047,7 @@
},
{
"cell_type": "markdown",
- "id": "2e88c504",
+ "id": "6540422f",
"metadata": {
"editable": true
},
@@ -6057,7 +6058,7 @@
},
{
"cell_type": "markdown",
- "id": "7299b0d3",
+ "id": "fd8c2326",
"metadata": {
"editable": true
},
@@ -6077,7 +6078,7 @@
},
{
"cell_type": "markdown",
- "id": "c849f0cc",
+ "id": "74eabad7",
"metadata": {
"editable": true
},
@@ -6089,7 +6090,7 @@
},
{
"cell_type": "markdown",
- "id": "f19b2ed7",
+ "id": "f9d16e2f",
"metadata": {
"editable": true
},
@@ -6126,7 +6127,7 @@
},
{
"cell_type": "markdown",
- "id": "96581350",
+ "id": "68c24098",
"metadata": {
"editable": true
},
@@ -6136,7 +6137,7 @@
},
{
"cell_type": "markdown",
- "id": "2c5aa09d",
+ "id": "02c1e06d",
"metadata": {
"editable": true
},
@@ -6149,7 +6150,7 @@
{
"cell_type": "code",
"execution_count": 48,
- "id": "9b979206",
+ "id": "972b8e94",
"metadata": {
"collapsed": false,
"editable": true
@@ -6350,7 +6351,7 @@
},
{
"cell_type": "markdown",
- "id": "ec7cab35",
+ "id": "734d97bc",
"metadata": {
"editable": true
},
@@ -6367,7 +6368,7 @@
},
{
"cell_type": "markdown",
- "id": "7366658f",
+ "id": "2c2d0e2c",
"metadata": {
"editable": true
},
@@ -6384,7 +6385,7 @@
},
{
"cell_type": "markdown",
- "id": "b6557284",
+ "id": "9de00307",
"metadata": {
"editable": true
},
@@ -6394,7 +6395,7 @@
},
{
"cell_type": "markdown",
- "id": "df2d7d07",
+ "id": "cb659253",
"metadata": {
"editable": true
},
@@ -6409,7 +6410,7 @@
},
{
"cell_type": "markdown",
- "id": "aad0506a",
+ "id": "909d23ae",
"metadata": {
"editable": true
},
@@ -6423,7 +6424,7 @@
},
{
"cell_type": "markdown",
- "id": "9e5776d1",
+ "id": "e3607f9e",
"metadata": {
"editable": true
},
@@ -6436,7 +6437,7 @@
},
{
"cell_type": "markdown",
- "id": "7fad71c5",
+ "id": "e0254d92",
"metadata": {
"editable": true
},
@@ -6456,7 +6457,7 @@
},
{
"cell_type": "markdown",
- "id": "d98bd52b",
+ "id": "7a787737",
"metadata": {
"editable": true
},
@@ -6468,7 +6469,7 @@
},
{
"cell_type": "markdown",
- "id": "3f6cb731",
+ "id": "42cfda53",
"metadata": {
"editable": true
},
@@ -6480,7 +6481,7 @@
},
{
"cell_type": "markdown",
- "id": "0efeb6a7",
+ "id": "41fdd74a",
"metadata": {
"editable": true
},
@@ -6492,7 +6493,7 @@
},
{
"cell_type": "markdown",
- "id": "b3367fd8",
+ "id": "9a43a5c3",
"metadata": {
"editable": true
},
@@ -6502,7 +6503,7 @@
},
{
"cell_type": "markdown",
- "id": "f5cdf037",
+ "id": "2deb98de",
"metadata": {
"editable": true
},
@@ -6514,7 +6515,7 @@
},
{
"cell_type": "markdown",
- "id": "39090b0c",
+ "id": "367f7d4b",
"metadata": {
"editable": true
},
@@ -6526,7 +6527,7 @@
},
{
"cell_type": "markdown",
- "id": "306f52ce",
+ "id": "4ace8d41",
"metadata": {
"editable": true
},
@@ -6538,7 +6539,7 @@
},
{
"cell_type": "markdown",
- "id": "4dddd0e4",
+ "id": "014d9b72",
"metadata": {
"editable": true
},
@@ -6548,7 +6549,7 @@
},
{
"cell_type": "markdown",
- "id": "19ba57a3",
+ "id": "91cb0d4f",
"metadata": {
"editable": true
},
@@ -6564,7 +6565,7 @@
},
{
"cell_type": "markdown",
- "id": "3f4b369e",
+ "id": "7015c1df",
"metadata": {
"editable": true
},
@@ -6574,7 +6575,7 @@
},
{
"cell_type": "markdown",
- "id": "01054c66",
+ "id": "a170f9bf",
"metadata": {
"editable": true
},
@@ -6586,7 +6587,7 @@
},
{
"cell_type": "markdown",
- "id": "48250dfa",
+ "id": "f79c87b0",
"metadata": {
"editable": true
},
@@ -6603,7 +6604,7 @@
},
{
"cell_type": "markdown",
- "id": "830538cd",
+ "id": "7b00c2c7",
"metadata": {
"editable": true
},
@@ -6613,7 +6614,7 @@
},
{
"cell_type": "markdown",
- "id": "1e05f3d1",
+ "id": "1da2ec1f",
"metadata": {
"editable": true
},
@@ -6629,7 +6630,7 @@
},
{
"cell_type": "markdown",
- "id": "278b7644",
+ "id": "d048b2b0",
"metadata": {
"editable": true
},
@@ -6643,7 +6644,7 @@
},
{
"cell_type": "markdown",
- "id": "08bf068d",
+ "id": "2a5423c6",
"metadata": {
"editable": true
},
@@ -6662,7 +6663,7 @@
{
"cell_type": "code",
"execution_count": 49,
- "id": "fb15b704",
+ "id": "39978a3f",
"metadata": {
"collapsed": false,
"editable": true
@@ -6717,7 +6718,7 @@
},
{
"cell_type": "markdown",
- "id": "ca43eaaa",
+ "id": "d86acd9a",
"metadata": {
"editable": true
},
@@ -6747,7 +6748,7 @@
},
{
"cell_type": "markdown",
- "id": "8cb99e50",
+ "id": "219af542",
"metadata": {
"editable": true
},
@@ -6776,7 +6777,7 @@
{
"cell_type": "code",
"execution_count": 50,
- "id": "2c311458",
+ "id": "0300f83e",
"metadata": {
"collapsed": false,
"editable": true
@@ -6823,7 +6824,7 @@
},
{
"cell_type": "markdown",
- "id": "6ce6fcdb",
+ "id": "63ff2d7d",
"metadata": {
"editable": true
},
@@ -6849,7 +6850,7 @@
{
"cell_type": "code",
"execution_count": 51,
- "id": "975ad28f",
+ "id": "504a8a89",
"metadata": {
"collapsed": false,
"editable": true
@@ -7083,7 +7084,7 @@
},
{
"cell_type": "markdown",
- "id": "a85b7bc6",
+ "id": "2154560c",
"metadata": {
"editable": true
},
@@ -7095,7 +7096,7 @@
},
{
"cell_type": "markdown",
- "id": "913742fb",
+ "id": "36990efc",
"metadata": {
"editable": true
},
@@ -7107,7 +7108,7 @@
},
{
"cell_type": "markdown",
- "id": "9b936d66",
+ "id": "d4e6e7d4",
"metadata": {
"editable": true
},
@@ -7119,7 +7120,7 @@
},
{
"cell_type": "markdown",
- "id": "a0cd719f",
+ "id": "cca6cfed",
"metadata": {
"editable": true
},
@@ -7136,7 +7137,7 @@
},
{
"cell_type": "markdown",
- "id": "8a8ddb73",
+ "id": "19f73071",
"metadata": {
"editable": true
},
@@ -7146,7 +7147,7 @@
},
{
"cell_type": "markdown",
- "id": "460bb8e2",
+ "id": "3e637804",
"metadata": {
"editable": true
},
@@ -7158,7 +7159,7 @@
},
{
"cell_type": "markdown",
- "id": "619814ea",
+ "id": "1a3ef69a",
"metadata": {
"editable": true
},
@@ -7175,7 +7176,7 @@
},
{
"cell_type": "markdown",
- "id": "833fef22",
+ "id": "b9206a11",
"metadata": {
"editable": true
},
@@ -7186,7 +7187,7 @@
},
{
"cell_type": "markdown",
- "id": "72df2582",
+ "id": "3050dcc1",
"metadata": {
"editable": true
},
@@ -7206,7 +7207,7 @@
},
{
"cell_type": "markdown",
- "id": "efc2be56",
+ "id": "2adca788",
"metadata": {
"editable": true
},
@@ -7216,7 +7217,7 @@
},
{
"cell_type": "markdown",
- "id": "8bee39ce",
+ "id": "9d36478f",
"metadata": {
"editable": true
},
@@ -7242,7 +7243,7 @@
},
{
"cell_type": "markdown",
- "id": "e133bda5",
+ "id": "f5a39291",
"metadata": {
"editable": true
},
@@ -7258,7 +7259,7 @@
},
{
"cell_type": "markdown",
- "id": "8cc804aa",
+ "id": "2090b5b8",
"metadata": {
"editable": true
},
@@ -7269,7 +7270,7 @@
{
"cell_type": "code",
"execution_count": 52,
- "id": "8e3fb51d",
+ "id": "0598530e",
"metadata": {
"collapsed": false,
"editable": true
@@ -7500,7 +7501,7 @@
},
{
"cell_type": "markdown",
- "id": "a77decf5",
+ "id": "518138c8",
"metadata": {
"editable": true
},
diff --git a/doc/src/week43/exercisesweek43.do.txt b/doc/src/week43/exercisesweek43.do.txt
index a8f473796..105d59dd8 100644
--- a/doc/src/week43/exercisesweek43.do.txt
+++ b/doc/src/week43/exercisesweek43.do.txt
@@ -134,12 +134,13 @@ Assume also that the bias of the output layer is zero and that the weights of th
!et
and multiplying with $\bm{a}_h$ gives the output
!bt
-\bm{a}_o=\bm{w}_h^T\begin{bmatrix} 0 & 0 \\
+\bm{a}_o=\begin{bmatrix} 0 & 0 \\
1 & 0 \\
1 & 0 \\
- 2 & 1 \end{bmatrix}=\begin{bmatrix} 0 \\ 1 \\ 1 \\0\end{bmatrix},
+ 2 & 1 \end{bmatrix}\begin{bmatrix} 1 \\
+ -2\end{bmatrix}=\begin{bmatrix} 0 \\ 1 \\ 1 \\0\end{bmatrix},
!et
-the wanted result.
+the wanted result. Pay attention to the dimensionalities as well.
!split
diff --git a/doc/src/week43/week43.do.txt b/doc/src/week43/week43.do.txt
index bb4a5f888..026731265 100644
--- a/doc/src/week43/week43.do.txt
+++ b/doc/src/week43/week43.do.txt
@@ -61,6 +61,7 @@ cost function.
+
Their inputs and outputs can be
summarized using the following tables, first for the OR gate with
inputs $x_1$ and $x_2$ and outputs $y$:
@@ -173,12 +174,13 @@ Assume also that the bias of the output layer is zero and that the weights of th
!et
and multiplying with $\bm{a}_h$ gives the output
!bt
-\bm{a}_o=\bm{w}_h^T\begin{bmatrix} 0 & 0 \\
+\bm{a}_o=\begin{bmatrix} 0 & 0 \\
1 & 0 \\
1 & 0 \\
- 2 & 1 \end{bmatrix}=\begin{bmatrix} 0 \\ 1 \\ 1 \\0\end{bmatrix},
+ 2 & 1 \end{bmatrix}\begin{bmatrix} 1 \\
+ -2\end{bmatrix}=\begin{bmatrix} 0 \\ 1 \\ 1 \\0\end{bmatrix},
!et
-the wanted result.
+the wanted result. Pay attention to the dimensionalities as well.
!split
@@ -1321,8 +1323,6 @@ scores = logistic_regression.fit(X, yXOR, scheduler, epochs=1000)
!ec
Not bad, but the results depend strongly on the learning reate. Try different learning rates.
-
-
!split
===== Lecture Thursday October 26 =====