update notes

This commit is contained in:
Morten Hjorth-Jensen
2023-11-07 06:18:24 +01:00
parent 83073af9aa
commit 2e2f61f8de
14 changed files with 412 additions and 392 deletions
Binary file not shown.
Binary file not shown.
Binary file not shown.

Before

Width:  |  Height:  |  Size: 44 KiB

After

Width:  |  Height:  |  Size: 17 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 38 KiB

After

Width:  |  Height:  |  Size: 44 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 38 KiB

@@ -2,7 +2,7 @@
"cells": [
{
"cell_type": "markdown",
"id": "38177bc8",
"id": "ddffe3be",
"metadata": {
"editable": true
},
@@ -14,7 +14,7 @@
},
{
"cell_type": "markdown",
"id": "a816084f",
"id": "cde0bbff",
"metadata": {
"editable": true
},
@@ -27,7 +27,7 @@
},
{
"cell_type": "markdown",
"id": "f62a8799",
"id": "f48c6388",
"metadata": {
"editable": true
},
@@ -67,7 +67,7 @@
},
{
"cell_type": "markdown",
"id": "2a50d9d2",
"id": "ba6964ff",
"metadata": {
"editable": true
},
@@ -77,7 +77,7 @@
},
{
"cell_type": "markdown",
"id": "30ed4f8b",
"id": "4d810bbf",
"metadata": {
"editable": true
},
@@ -96,7 +96,7 @@
{
"cell_type": "code",
"execution_count": 1,
"id": "b6060ea0",
"id": "39f540b5",
"metadata": {
"collapsed": false,
"editable": true
@@ -153,7 +153,7 @@
},
{
"cell_type": "markdown",
"id": "02a16352",
"id": "09d24c34",
"metadata": {
"editable": true
},
@@ -165,7 +165,7 @@
},
{
"cell_type": "markdown",
"id": "d15635eb",
"id": "7c84429f",
"metadata": {
"editable": true
},
@@ -180,7 +180,7 @@
{
"cell_type": "code",
"execution_count": 2,
"id": "3587f6a6",
"id": "ac8fda39",
"metadata": {
"collapsed": false,
"editable": true
@@ -233,7 +233,7 @@
},
{
"cell_type": "markdown",
"id": "e5c4df1d",
"id": "b9da31b6",
"metadata": {
"editable": true
},
@@ -248,7 +248,7 @@
},
{
"cell_type": "markdown",
"id": "334af746",
"id": "afe2e276",
"metadata": {
"editable": true
},
@@ -268,7 +268,7 @@
{
"cell_type": "code",
"execution_count": 3,
"id": "04ba2582",
"id": "5707b319",
"metadata": {
"collapsed": false,
"editable": true
@@ -322,7 +322,7 @@
},
{
"cell_type": "markdown",
"id": "e713b0d3",
"id": "8f067ea7",
"metadata": {
"editable": true
},
@@ -337,7 +337,7 @@
{
"cell_type": "code",
"execution_count": 4,
"id": "a0304d86",
"id": "cfe2ed78",
"metadata": {
"collapsed": false,
"editable": true
@@ -364,7 +364,7 @@
},
{
"cell_type": "markdown",
"id": "a67cf20f",
"id": "97a315dc",
"metadata": {
"editable": true
},
@@ -378,7 +378,7 @@
{
"cell_type": "code",
"execution_count": 5,
"id": "78a673cf",
"id": "9363662a",
"metadata": {
"collapsed": false,
"editable": true
@@ -423,7 +423,7 @@
},
{
"cell_type": "markdown",
"id": "e533f0d8",
"id": "298800d9",
"metadata": {
"editable": true
},
@@ -448,7 +448,7 @@
{
"cell_type": "code",
"execution_count": 6,
"id": "88a99e3b",
"id": "9db77f36",
"metadata": {
"collapsed": false,
"editable": true
@@ -460,7 +460,7 @@
},
{
"cell_type": "markdown",
"id": "e1095373",
"id": "2872089d",
"metadata": {
"editable": true
},
@@ -471,7 +471,7 @@
{
"cell_type": "code",
"execution_count": 7,
"id": "580dfa45",
"id": "926cdfd7",
"metadata": {
"collapsed": false,
"editable": true
@@ -483,7 +483,7 @@
},
{
"cell_type": "markdown",
"id": "1f67b639",
"id": "6bd13984",
"metadata": {
"editable": true
},
@@ -496,7 +496,7 @@
},
{
"cell_type": "markdown",
"id": "a42f0ef1",
"id": "55242d6d",
"metadata": {
"editable": true
},
@@ -507,7 +507,7 @@
{
"cell_type": "code",
"execution_count": 8,
"id": "286c60f7",
"id": "00c15782",
"metadata": {
"collapsed": false,
"editable": true
@@ -550,7 +550,40 @@
},
{
"cell_type": "markdown",
"id": "5f126f5b",
"id": "b7a8eeb7",
"metadata": {
"editable": true
},
"source": [
"## ROC curve\n",
"\n",
"A receiver operating characteristic curve, or ROC curve, is a\n",
"graphical plot that illustrates the performance of a binary classifier\n",
"model at varying threshold values.\n",
"\n",
"The ROC curve is the plot of the true positive rate (TPR) against the false positive rate (FPR) at each threshold setting.\n",
"See <https://en.wikipedia.org/wiki/Receiver_operating_characteristic> for more discussions."
]
},
{
"cell_type": "markdown",
"id": "6414e652",
"metadata": {
"editable": true
},
"source": [
"## Cumulative gain curve\n",
"\n",
"The cumulative gain curve is a performance evaluation used typically for binary classification problems.\n",
"It plots the $TPR$ True Positive Rate or Sensitivity (which represents the \n",
"fraction of examples correctly classified\n",
"against Predictive Positive Rate, which represents \n",
"the fraction of positively predicted examples."
]
},
{
"cell_type": "markdown",
"id": "7646c025",
"metadata": {
"editable": true
},
@@ -560,7 +593,7 @@
},
{
"cell_type": "markdown",
"id": "bf47aea8",
"id": "f7b4b23b",
"metadata": {
"editable": true
},
@@ -587,7 +620,7 @@
},
{
"cell_type": "markdown",
"id": "43911e80",
"id": "741bf972",
"metadata": {
"editable": true
},
@@ -598,7 +631,7 @@
{
"cell_type": "code",
"execution_count": 9,
"id": "93a5e85c",
"id": "f9060416",
"metadata": {
"collapsed": false,
"editable": true
@@ -671,7 +704,7 @@
},
{
"cell_type": "markdown",
"id": "15c0abdc",
"id": "e0342b0b",
"metadata": {
"editable": true
},
@@ -691,7 +724,7 @@
},
{
"cell_type": "markdown",
"id": "e2c9969b",
"id": "58fdc710",
"metadata": {
"editable": true
},
@@ -707,7 +740,7 @@
},
{
"cell_type": "markdown",
"id": "bc82b4e6",
"id": "f793c129",
"metadata": {
"editable": true
},
@@ -729,7 +762,7 @@
},
{
"cell_type": "markdown",
"id": "c1dfa318",
"id": "b7446349",
"metadata": {
"editable": true
},
@@ -747,7 +780,7 @@
},
{
"cell_type": "markdown",
"id": "bce88bd1",
"id": "fac85e06",
"metadata": {
"editable": true
},
@@ -793,7 +826,7 @@
},
{
"cell_type": "markdown",
"id": "630c5765",
"id": "7e3fbdb7",
"metadata": {
"editable": true
},
@@ -814,7 +847,7 @@
},
{
"cell_type": "markdown",
"id": "74a05e7a",
"id": "f29008fb",
"metadata": {
"editable": true
},
@@ -875,7 +908,7 @@
},
{
"cell_type": "markdown",
"id": "ba29a00f",
"id": "dedfb5dd",
"metadata": {
"editable": true
},
@@ -900,7 +933,7 @@
},
{
"cell_type": "markdown",
"id": "4fb99b23",
"id": "2abfa20e",
"metadata": {
"editable": true
},
@@ -919,7 +952,7 @@
},
{
"cell_type": "markdown",
"id": "640d0ffd",
"id": "abc4dabb",
"metadata": {
"editable": true
},
@@ -943,7 +976,7 @@
},
{
"cell_type": "markdown",
"id": "0aa61a82",
"id": "67e1ca86",
"metadata": {
"editable": true
},
@@ -1025,7 +1058,7 @@
},
{
"cell_type": "markdown",
"id": "05d59f36",
"id": "bc04ebe9",
"metadata": {
"editable": true
},
@@ -1041,7 +1074,7 @@
{
"cell_type": "code",
"execution_count": 10,
"id": "b1bf0cab",
"id": "a5882cbb",
"metadata": {
"collapsed": false,
"editable": true
@@ -1080,7 +1113,7 @@
},
{
"cell_type": "markdown",
"id": "c6095262",
"id": "18221ec4",
"metadata": {
"editable": true
},
@@ -1124,7 +1157,7 @@
{
"cell_type": "code",
"execution_count": 11,
"id": "9eebf739",
"id": "d4982f3a",
"metadata": {
"collapsed": false,
"editable": true
@@ -1207,7 +1240,7 @@
},
{
"cell_type": "markdown",
"id": "b1f61819",
"id": "a146c2c5",
"metadata": {
"editable": true
},
@@ -1218,7 +1251,7 @@
{
"cell_type": "code",
"execution_count": 12,
"id": "eed2466a",
"id": "2f7691d6",
"metadata": {
"collapsed": false,
"editable": true
@@ -1320,7 +1353,7 @@
},
{
"cell_type": "markdown",
"id": "71855b2c",
"id": "618a775c",
"metadata": {
"editable": true
},
@@ -1342,7 +1375,7 @@
{
"cell_type": "code",
"execution_count": 13,
"id": "d1650ea8",
"id": "5f955304",
"metadata": {
"collapsed": false,
"editable": true
@@ -1439,7 +1472,7 @@
},
{
"cell_type": "markdown",
"id": "32c4c59c",
"id": "ae8bb1a0",
"metadata": {
"editable": true
},
@@ -1465,7 +1498,7 @@
{
"cell_type": "code",
"execution_count": 14,
"id": "bbb48a15",
"id": "701451d4",
"metadata": {
"collapsed": false,
"editable": true
File diff suppressed because one or more lines are too long
+90 -94
View File
@@ -489,6 +489,16 @@ const thebe_selector_output = ".output, .cell_output"
Other measures in classification studies: Cancer Data again
</a>
</li>
<li class="toc-h2 nav-item toc-entry">
<a class="reference internal nav-link" href="#roc-curve">
ROC curve
</a>
</li>
<li class="toc-h2 nav-item toc-entry">
<a class="reference internal nav-link" href="#cumulative-gain-curve">
Cumulative gain curve
</a>
</li>
<li class="toc-h2 nav-item toc-entry">
<a class="reference internal nav-link" href="#material-for-lecture-thursday-november-9">
Material for Lecture Thursday November 9
@@ -658,6 +668,16 @@ const thebe_selector_output = ".output, .cell_output"
Other measures in classification studies: Cancer Data again
</a>
</li>
<li class="toc-h2 nav-item toc-entry">
<a class="reference internal nav-link" href="#roc-curve">
ROC curve
</a>
</li>
<li class="toc-h2 nav-item toc-entry">
<a class="reference internal nav-link" href="#cumulative-gain-curve">
Cumulative gain curve
</a>
</li>
<li class="toc-h2 nav-item toc-entry">
<a class="reference internal nav-link" href="#material-for-lecture-thursday-november-9">
Material for Lecture Thursday November 9
@@ -999,7 +1019,7 @@ case under study.</p>
</div>
<div class="cell_output docutils container">
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>RandomizedSearchCV(estimator=Ridge(), n_iter=100,
param_distributions={&#39;alpha&#39;: &lt;scipy.stats._distn_infrastructure.rv_frozen object at 0x168f3fca0&gt;})
param_distributions={&#39;alpha&#39;: &lt;scipy.stats._distn_infrastructure.rv_frozen object at 0x105b84cd0&gt;})
Best estimated lambda-value: 0.9849967686928113
MSE score: 1.0853136633465326
R2 score: -0.0002382102844775691
@@ -1177,9 +1197,6 @@ applications. This will be discussed later this semester (<a class="reference ex
<div class="cell_output docutils container">
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>(426, 30)
(143, 30)
[1. 0.86666667 1. 0.92857143 1. 0.85714286
1. 0.92857143 0.92857143 1. ]
Test set accuracy with Logistic Regression: 0.94
</pre></div>
</div>
<div class="output stderr highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>/Users/mhjensen/miniforge3/envs/myenv/lib/python3.9/site-packages/sklearn/linear_model/_logistic.py:814: ConvergenceWarning: lbfgs failed to converge (status=1):
@@ -1272,12 +1289,33 @@ Please also refer to the documentation for alternative solver options:
n_iter_i = _check_optimize_result(
</pre></div>
</div>
<img alt="_images/week45_22_2.png" src="_images/week45_22_2.png" />
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>[1. 0.86666667 1. 0.92857143 1. 0.85714286
1. 0.92857143 0.92857143 1. ]
Test set accuracy with Logistic Regression: 0.94
</pre></div>
</div>
<img alt="_images/week45_22_3.png" src="_images/week45_22_3.png" />
<img alt="_images/week45_22_4.png" src="_images/week45_22_4.png" />
<img alt="_images/week45_22_5.png" src="_images/week45_22_5.png" />
</div>
</div>
</div>
<div class="section" id="roc-curve">
<h2>ROC curve<a class="headerlink" href="#roc-curve" title="Permalink to this headline"></a></h2>
<p>A receiver operating characteristic curve, or ROC curve, is a
graphical plot that illustrates the performance of a binary classifier
model at varying threshold values.</p>
<p>The ROC curve is the plot of the true positive rate (TPR) against the false positive rate (FPR) at each threshold setting.
See <a class="reference external" href="https://en.wikipedia.org/wiki/Receiver_operating_characteristic">https://en.wikipedia.org/wiki/Receiver_operating_characteristic</a> for more discussions.</p>
</div>
<div class="section" id="cumulative-gain-curve">
<h2>Cumulative gain curve<a class="headerlink" href="#cumulative-gain-curve" title="Permalink to this headline"></a></h2>
<p>The cumulative gain curve is a performance evaluation used typically for binary classification problems.
It plots the <span class="math notranslate nohighlight">\(TPR\)</span> True Positive Rate or Sensitivity (which represents the
fraction of examples correctly classified
against Predictive Positive Rate, which represents
the fraction of positively predicted examples.</p>
</div>
<div class="section" id="material-for-lecture-thursday-november-9">
<h2>Material for Lecture Thursday November 9<a class="headerlink" href="#material-for-lecture-thursday-november-9" title="Permalink to this headline"></a></h2>
</div>
@@ -1419,327 +1457,285 @@ systems such as automatic translation and speech-to-text.</p>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 1/100
</pre></div>
</div>
<div class="output stderr highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>2023-11-06 06:26:15.664586: W tensorflow/core/platform/profile_utils/cpu_utils.cc:128] Failed to get CPU frequency: 0 Hz
<div class="output stderr highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>2023-11-07 06:16:59.648382: W tensorflow/core/platform/profile_utils/cpu_utils.cc:128] Failed to get CPU frequency: 0 Hz
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 3s - loss: 0.4727 - 3s/epoch - 66ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 3s - loss: 0.9885 - 3s/epoch - 66ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 2/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3966 - 471ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.4316 - 465ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 3/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3929 - 470ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.4150 - 494ms/epoch - 10ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 4/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3901 - 468ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.4066 - 466ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 5/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3920 - 467ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.4037 - 497ms/epoch - 10ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 6/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3910 - 469ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.4013 - 469ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 7/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3911 - 470ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3980 - 467ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 8/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3896 - 469ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3981 - 468ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 9/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3913 - 467ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3944 - 467ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 10/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3858 - 467ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3951 - 468ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 11/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3884 - 465ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3929 - 467ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 12/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3899 - 468ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3929 - 467ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 13/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3868 - 467ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3915 - 469ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 14/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3853 - 467ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3923 - 472ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 15/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3889 - 465ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3901 - 467ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 16/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3858 - 468ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3893 - 471ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 17/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3873 - 465ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3893 - 468ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 18/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3879 - 466ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3893 - 490ms/epoch - 10ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 19/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3870 - 468ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3888 - 475ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 20/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3842 - 467ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3866 - 468ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 21/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3847 - 468ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3875 - 469ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 22/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3846 - 469ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3864 - 472ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 23/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3837 - 470ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3883 - 467ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 24/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3855 - 466ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3877 - 469ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 25/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3846 - 467ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3884 - 491ms/epoch - 10ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 26/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3842 - 468ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3862 - 472ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 27/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3835 - 463ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3844 - 466ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 28/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3839 - 461ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3869 - 468ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 29/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3827 - 462ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3859 - 470ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 30/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3827 - 463ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3849 - 466ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 31/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3810 - 462ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3861 - 463ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 32/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3812 - 457ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3837 - 462ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 33/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3814 - 460ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3844 - 477ms/epoch - 10ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 34/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3828 - 466ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3842 - 479ms/epoch - 10ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 35/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3816 - 461ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3825 - 476ms/epoch - 10ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 36/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3822 - 463ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3849 - 477ms/epoch - 10ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 37/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3813 - 462ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3826 - 463ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 38/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3803 - 465ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3816 - 466ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 39/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3801 - 466ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 1s - loss: 0.3843 - 1s/epoch - 25ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 40/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3815 - 467ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 1s - loss: 0.3821 - 522ms/epoch - 10ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 41/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3806 - 464ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3825 - 486ms/epoch - 10ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 42/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3801 - 464ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3822 - 480ms/epoch - 10ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 43/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3791 - 469ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 1s - loss: 0.3836 - 521ms/epoch - 10ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 44/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3803 - 468ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 1s - loss: 0.3827 - 566ms/epoch - 11ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 45/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3779 - 468ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 1s - loss: 0.3815 - 504ms/epoch - 10ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 46/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3776 - 466ms/epoch - 9ms/step
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 1s - loss: 0.3832 - 511ms/epoch - 10ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 47/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3778 - 472ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 48/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3790 - 465ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 49/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3750 - 466ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 50/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3782 - 468ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 51/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3773 - 469ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 52/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3768 - 466ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 53/100
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>50/50 - 0s - loss: 0.3760 - 467ms/epoch - 9ms/step
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Epoch 54/100
</pre></div>
</div>
<div class="output traceback highlight-ipythontb notranslate"><div class="highlight"><pre><span></span><span class="gt">---------------------------------------------------------------------------</span>
<span class="ne">KeyboardInterrupt</span><span class="g g-Whitespace"> </span>Traceback (most recent call last)
<span class="nn">Input In [9],</span> in <span class="ni">&lt;cell line: 53&gt;</span><span class="nt">()</span>
File diff suppressed because one or more lines are too long
@@ -373,6 +373,23 @@ skplt.metrics.plot_cumulative_gain(y_test, y_probas)
plt.show()
# ## ROC curve
#
# A receiver operating characteristic curve, or ROC curve, is a
# graphical plot that illustrates the performance of a binary classifier
# model at varying threshold values.
#
# The ROC curve is the plot of the true positive rate (TPR) against the false positive rate (FPR) at each threshold setting.
# See <https://en.wikipedia.org/wiki/Receiver_operating_characteristic> for more discussions.
# ## Cumulative gain curve
#
# The cumulative gain curve is a performance evaluation used typically for binary classification problems.
# It plots the $TPR$ True Positive Rate or Sensitivity (which represents the
# fraction of examples correctly classified
# against Predictive Positive Rate, which represents
# the fraction of positively predicted examples.
# ## Material for Lecture Thursday November 9
# ## Recurrent neural networks (RNNs): Overarching view
Binary file not shown.

Before

Width:  |  Height:  |  Size: 44 KiB

After

Width:  |  Height:  |  Size: 17 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 38 KiB

After

Width:  |  Height:  |  Size: 44 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 38 KiB

+81 -48
View File
@@ -2,7 +2,7 @@
"cells": [
{
"cell_type": "markdown",
"id": "38177bc8",
"id": "ddffe3be",
"metadata": {
"editable": true
},
@@ -14,7 +14,7 @@
},
{
"cell_type": "markdown",
"id": "a816084f",
"id": "cde0bbff",
"metadata": {
"editable": true
},
@@ -27,7 +27,7 @@
},
{
"cell_type": "markdown",
"id": "f62a8799",
"id": "f48c6388",
"metadata": {
"editable": true
},
@@ -67,7 +67,7 @@
},
{
"cell_type": "markdown",
"id": "2a50d9d2",
"id": "ba6964ff",
"metadata": {
"editable": true
},
@@ -77,7 +77,7 @@
},
{
"cell_type": "markdown",
"id": "30ed4f8b",
"id": "4d810bbf",
"metadata": {
"editable": true
},
@@ -96,7 +96,7 @@
{
"cell_type": "code",
"execution_count": 1,
"id": "b6060ea0",
"id": "39f540b5",
"metadata": {
"collapsed": false,
"editable": true
@@ -153,7 +153,7 @@
},
{
"cell_type": "markdown",
"id": "02a16352",
"id": "09d24c34",
"metadata": {
"editable": true
},
@@ -165,7 +165,7 @@
},
{
"cell_type": "markdown",
"id": "d15635eb",
"id": "7c84429f",
"metadata": {
"editable": true
},
@@ -180,7 +180,7 @@
{
"cell_type": "code",
"execution_count": 2,
"id": "3587f6a6",
"id": "ac8fda39",
"metadata": {
"collapsed": false,
"editable": true
@@ -233,7 +233,7 @@
},
{
"cell_type": "markdown",
"id": "e5c4df1d",
"id": "b9da31b6",
"metadata": {
"editable": true
},
@@ -248,7 +248,7 @@
},
{
"cell_type": "markdown",
"id": "334af746",
"id": "afe2e276",
"metadata": {
"editable": true
},
@@ -268,7 +268,7 @@
{
"cell_type": "code",
"execution_count": 3,
"id": "04ba2582",
"id": "5707b319",
"metadata": {
"collapsed": false,
"editable": true
@@ -322,7 +322,7 @@
},
{
"cell_type": "markdown",
"id": "e713b0d3",
"id": "8f067ea7",
"metadata": {
"editable": true
},
@@ -337,7 +337,7 @@
{
"cell_type": "code",
"execution_count": 4,
"id": "a0304d86",
"id": "cfe2ed78",
"metadata": {
"collapsed": false,
"editable": true
@@ -364,7 +364,7 @@
},
{
"cell_type": "markdown",
"id": "a67cf20f",
"id": "97a315dc",
"metadata": {
"editable": true
},
@@ -378,7 +378,7 @@
{
"cell_type": "code",
"execution_count": 5,
"id": "78a673cf",
"id": "9363662a",
"metadata": {
"collapsed": false,
"editable": true
@@ -423,7 +423,7 @@
},
{
"cell_type": "markdown",
"id": "e533f0d8",
"id": "298800d9",
"metadata": {
"editable": true
},
@@ -448,7 +448,7 @@
{
"cell_type": "code",
"execution_count": 6,
"id": "88a99e3b",
"id": "9db77f36",
"metadata": {
"collapsed": false,
"editable": true
@@ -460,7 +460,7 @@
},
{
"cell_type": "markdown",
"id": "e1095373",
"id": "2872089d",
"metadata": {
"editable": true
},
@@ -471,7 +471,7 @@
{
"cell_type": "code",
"execution_count": 7,
"id": "580dfa45",
"id": "926cdfd7",
"metadata": {
"collapsed": false,
"editable": true
@@ -483,7 +483,7 @@
},
{
"cell_type": "markdown",
"id": "1f67b639",
"id": "6bd13984",
"metadata": {
"editable": true
},
@@ -496,7 +496,7 @@
},
{
"cell_type": "markdown",
"id": "a42f0ef1",
"id": "55242d6d",
"metadata": {
"editable": true
},
@@ -507,7 +507,7 @@
{
"cell_type": "code",
"execution_count": 8,
"id": "286c60f7",
"id": "00c15782",
"metadata": {
"collapsed": false,
"editable": true
@@ -550,7 +550,40 @@
},
{
"cell_type": "markdown",
"id": "5f126f5b",
"id": "b7a8eeb7",
"metadata": {
"editable": true
},
"source": [
"## ROC curve\n",
"\n",
"A receiver operating characteristic curve, or ROC curve, is a\n",
"graphical plot that illustrates the performance of a binary classifier\n",
"model at varying threshold values.\n",
"\n",
"The ROC curve is the plot of the true positive rate (TPR) against the false positive rate (FPR) at each threshold setting.\n",
"See <https://en.wikipedia.org/wiki/Receiver_operating_characteristic> for more discussions."
]
},
{
"cell_type": "markdown",
"id": "6414e652",
"metadata": {
"editable": true
},
"source": [
"## Cumulative gain curve\n",
"\n",
"The cumulative gain curve is a performance evaluation used typically for binary classification problems.\n",
"It plots the $TPR$ True Positive Rate or Sensitivity (which represents the \n",
"fraction of examples correctly classified\n",
"against Predictive Positive Rate, which represents \n",
"the fraction of positively predicted examples."
]
},
{
"cell_type": "markdown",
"id": "7646c025",
"metadata": {
"editable": true
},
@@ -560,7 +593,7 @@
},
{
"cell_type": "markdown",
"id": "bf47aea8",
"id": "f7b4b23b",
"metadata": {
"editable": true
},
@@ -587,7 +620,7 @@
},
{
"cell_type": "markdown",
"id": "43911e80",
"id": "741bf972",
"metadata": {
"editable": true
},
@@ -598,7 +631,7 @@
{
"cell_type": "code",
"execution_count": 9,
"id": "93a5e85c",
"id": "f9060416",
"metadata": {
"collapsed": false,
"editable": true
@@ -671,7 +704,7 @@
},
{
"cell_type": "markdown",
"id": "15c0abdc",
"id": "e0342b0b",
"metadata": {
"editable": true
},
@@ -691,7 +724,7 @@
},
{
"cell_type": "markdown",
"id": "e2c9969b",
"id": "58fdc710",
"metadata": {
"editable": true
},
@@ -707,7 +740,7 @@
},
{
"cell_type": "markdown",
"id": "bc82b4e6",
"id": "f793c129",
"metadata": {
"editable": true
},
@@ -729,7 +762,7 @@
},
{
"cell_type": "markdown",
"id": "c1dfa318",
"id": "b7446349",
"metadata": {
"editable": true
},
@@ -747,7 +780,7 @@
},
{
"cell_type": "markdown",
"id": "bce88bd1",
"id": "fac85e06",
"metadata": {
"editable": true
},
@@ -793,7 +826,7 @@
},
{
"cell_type": "markdown",
"id": "630c5765",
"id": "7e3fbdb7",
"metadata": {
"editable": true
},
@@ -814,7 +847,7 @@
},
{
"cell_type": "markdown",
"id": "74a05e7a",
"id": "f29008fb",
"metadata": {
"editable": true
},
@@ -875,7 +908,7 @@
},
{
"cell_type": "markdown",
"id": "ba29a00f",
"id": "dedfb5dd",
"metadata": {
"editable": true
},
@@ -900,7 +933,7 @@
},
{
"cell_type": "markdown",
"id": "4fb99b23",
"id": "2abfa20e",
"metadata": {
"editable": true
},
@@ -919,7 +952,7 @@
},
{
"cell_type": "markdown",
"id": "640d0ffd",
"id": "abc4dabb",
"metadata": {
"editable": true
},
@@ -943,7 +976,7 @@
},
{
"cell_type": "markdown",
"id": "0aa61a82",
"id": "67e1ca86",
"metadata": {
"editable": true
},
@@ -1025,7 +1058,7 @@
},
{
"cell_type": "markdown",
"id": "05d59f36",
"id": "bc04ebe9",
"metadata": {
"editable": true
},
@@ -1041,7 +1074,7 @@
{
"cell_type": "code",
"execution_count": 10,
"id": "b1bf0cab",
"id": "a5882cbb",
"metadata": {
"collapsed": false,
"editable": true
@@ -1080,7 +1113,7 @@
},
{
"cell_type": "markdown",
"id": "c6095262",
"id": "18221ec4",
"metadata": {
"editable": true
},
@@ -1124,7 +1157,7 @@
{
"cell_type": "code",
"execution_count": 11,
"id": "9eebf739",
"id": "d4982f3a",
"metadata": {
"collapsed": false,
"editable": true
@@ -1207,7 +1240,7 @@
},
{
"cell_type": "markdown",
"id": "b1f61819",
"id": "a146c2c5",
"metadata": {
"editable": true
},
@@ -1218,7 +1251,7 @@
{
"cell_type": "code",
"execution_count": 12,
"id": "eed2466a",
"id": "2f7691d6",
"metadata": {
"collapsed": false,
"editable": true
@@ -1320,7 +1353,7 @@
},
{
"cell_type": "markdown",
"id": "71855b2c",
"id": "618a775c",
"metadata": {
"editable": true
},
@@ -1342,7 +1375,7 @@
{
"cell_type": "code",
"execution_count": 13,
"id": "d1650ea8",
"id": "5f955304",
"metadata": {
"collapsed": false,
"editable": true
@@ -1439,7 +1472,7 @@
},
{
"cell_type": "markdown",
"id": "32c4c59c",
"id": "ae8bb1a0",
"metadata": {
"editable": true
},
@@ -1465,7 +1498,7 @@
{
"cell_type": "code",
"execution_count": 14,
"id": "bbb48a15",
"id": "701451d4",
"metadata": {
"collapsed": false,
"editable": true