diff --git a/doc/LectureNotes/_build/.doctrees/environment.pickle b/doc/LectureNotes/_build/.doctrees/environment.pickle
index b3ba51187..068afdef0 100644
Binary files a/doc/LectureNotes/_build/.doctrees/environment.pickle and b/doc/LectureNotes/_build/.doctrees/environment.pickle differ
diff --git a/doc/LectureNotes/_build/.doctrees/exercisesweek34.doctree b/doc/LectureNotes/_build/.doctrees/exercisesweek34.doctree
index 3ec0c40c4..f16d259f7 100644
Binary files a/doc/LectureNotes/_build/.doctrees/exercisesweek34.doctree and b/doc/LectureNotes/_build/.doctrees/exercisesweek34.doctree differ
diff --git a/doc/LectureNotes/_build/.doctrees/week35.doctree b/doc/LectureNotes/_build/.doctrees/week35.doctree
index 431695baa..3078e6ae5 100644
Binary files a/doc/LectureNotes/_build/.doctrees/week35.doctree and b/doc/LectureNotes/_build/.doctrees/week35.doctree differ
diff --git a/doc/LectureNotes/_build/html/_sources/exercisesweek34.ipynb b/doc/LectureNotes/_build/html/_sources/exercisesweek34.ipynb
index a17ecafef..6a84a1d30 100644
--- a/doc/LectureNotes/_build/html/_sources/exercisesweek34.ipynb
+++ b/doc/LectureNotes/_build/html/_sources/exercisesweek34.ipynb
@@ -2,7 +2,7 @@
"cells": [
{
"cell_type": "markdown",
- "id": "72dc0997",
+ "id": "a50ea987",
"metadata": {
"editable": true
},
@@ -14,7 +14,7 @@
},
{
"cell_type": "markdown",
- "id": "8c591125",
+ "id": "291e6015",
"metadata": {
"editable": true
},
@@ -27,7 +27,7 @@
},
{
"cell_type": "markdown",
- "id": "1ad21876",
+ "id": "141ff111",
"metadata": {
"editable": true
},
@@ -39,7 +39,7 @@
},
{
"cell_type": "markdown",
- "id": "4eaa91e2",
+ "id": "32a1fc9e",
"metadata": {
"editable": true
},
@@ -108,7 +108,7 @@
},
{
"cell_type": "markdown",
- "id": "360adb56",
+ "id": "f103f4c1",
"metadata": {
"editable": true
},
@@ -122,20 +122,21 @@
{
"cell_type": "code",
"execution_count": 1,
- "id": "278aa34f",
+ "id": "81c11edc",
"metadata": {
"collapsed": false,
"editable": true
},
"outputs": [],
"source": [
+ "import numpy as np\n",
"x = np.random.rand(100,1)\n",
"y = 2.0+5*x*x+0.1*np.random.randn(100,1)"
]
},
{
"cell_type": "markdown",
- "id": "1ff20e45",
+ "id": "970bd604",
"metadata": {
"editable": true
},
@@ -149,7 +150,7 @@
},
{
"cell_type": "markdown",
- "id": "e8809de1",
+ "id": "bda3ed04",
"metadata": {
"editable": true
},
@@ -162,7 +163,7 @@
},
{
"cell_type": "markdown",
- "id": "8c9e5277",
+ "id": "ca995691",
"metadata": {
"editable": true
},
@@ -173,7 +174,7 @@
},
{
"cell_type": "markdown",
- "id": "85a5881c",
+ "id": "27cbfeed",
"metadata": {
"editable": true
},
@@ -185,7 +186,7 @@
},
{
"cell_type": "markdown",
- "id": "4fb35d0d",
+ "id": "9e063f6d",
"metadata": {
"editable": true
},
@@ -195,7 +196,7 @@
},
{
"cell_type": "markdown",
- "id": "608f9780",
+ "id": "e582c2bb",
"metadata": {
"editable": true
},
@@ -207,7 +208,7 @@
},
{
"cell_type": "markdown",
- "id": "014bbc09",
+ "id": "59e0ed7a",
"metadata": {
"editable": true
},
@@ -218,7 +219,7 @@
},
{
"cell_type": "markdown",
- "id": "f28863ad",
+ "id": "051e71aa",
"metadata": {
"editable": true
},
@@ -237,7 +238,7 @@
{
"cell_type": "code",
"execution_count": 2,
- "id": "85f75a99",
+ "id": "c82d8b64",
"metadata": {
"collapsed": false,
"editable": true
@@ -253,7 +254,7 @@
},
{
"cell_type": "markdown",
- "id": "bee8d814",
+ "id": "3e810bba",
"metadata": {
"editable": true
},
@@ -263,7 +264,7 @@
},
{
"cell_type": "markdown",
- "id": "7c94f8bd",
+ "id": "c1198fce",
"metadata": {
"editable": true
},
@@ -274,7 +275,7 @@
},
{
"cell_type": "markdown",
- "id": "c0e789dd",
+ "id": "1b0cea0a",
"metadata": {
"editable": true
},
@@ -286,7 +287,7 @@
},
{
"cell_type": "markdown",
- "id": "5ee1d70e",
+ "id": "5194ba08",
"metadata": {
"editable": true
},
diff --git a/doc/LectureNotes/_build/html/_sources/week35.ipynb b/doc/LectureNotes/_build/html/_sources/week35.ipynb
index 40b6c66a9..ce308ef85 100644
--- a/doc/LectureNotes/_build/html/_sources/week35.ipynb
+++ b/doc/LectureNotes/_build/html/_sources/week35.ipynb
@@ -2,7 +2,7 @@
"cells": [
{
"cell_type": "markdown",
- "id": "ea977b24",
+ "id": "0e8171d8",
"metadata": {
"editable": true
},
@@ -14,20 +14,20 @@
},
{
"cell_type": "markdown",
- "id": "a247218b",
+ "id": "d54fb4b6",
"metadata": {
"editable": true
},
"source": [
"# Week 35: From Ordinary Linear Regression to Ridge and Lasso Regression\n",
- "**Morten Hjorth-Jensen**, Department of Physics, University of Oslo and Department of Physics and Astronomy and National Superconducting Cyclotron Laboratory, Michigan State University\n",
+ "**Morten Hjorth-Jensen**, Department of Physics, University of Oslo\n",
"\n",
- "Date: **August 26-30**"
+ "Date: **August 26-30, 2024**"
]
},
{
"cell_type": "markdown",
- "id": "f234b76d",
+ "id": "359ef523",
"metadata": {
"editable": true
},
@@ -38,7 +38,7 @@
"\n",
"1. Brief repetition from last week\n",
"\n",
- "2. Derivation of the equations for ordinary least squares\n",
+ "2. Discussions of the equations for ordinary least squares\n",
"\n",
"3. Discussion on how to prepare data and examples of applications of linear regression\n",
"\n",
@@ -49,26 +49,30 @@
},
{
"cell_type": "markdown",
- "id": "86d0671f",
+ "id": "76ab9350",
"metadata": {
"editable": true
},
"source": [
"### Reading recommendations:\n",
"\n",
- "1. See lecture notes for week 35 at \n",
+ "1. These lecture notes\n",
"\n",
- "2. Goodfellow, Bengio and Courville, Deep Learning, chapter 2 on linear algebra and sections 3.1-3.10 on elements of statistics (background)"
+ "2. Goodfellow, Bengio and Courville, Deep Learning, chapter 2 on linear algebra and sections 3.1-3.10 on elements of statistics (background)\n",
+ "\n",
+ "3. Raschka et al on preprocessing of data, relevant for exercise 3 this week, see chapter 4.\n",
+ "\n",
+ "4. For exercise 1 of week 35, the book by A. Aldo Faisal, Cheng Soon Ong, and Marc Peter Deisenroth on the Mathematics of Machine Learning, may be very relevant. In particular chapter 5 at URL\"https://mml-book.github.io/\" (section 5.5 on derivatives) is very useful for exercise 1 this coming week."
]
},
{
"cell_type": "markdown",
- "id": "0b0bc0ec",
+ "id": "231f16d6",
"metadata": {
"editable": true
},
"source": [
- "## Why Linear Regression (aka Ordinary Least Squares and family), repeat from last week\n",
+ "## For exercise sessions: Why Linear Regression (aka Ordinary Least Squares and family), repeat from last week\n",
"\n",
"We need first a reminder from last week about linear regression. \n",
"\n",
@@ -97,7 +101,7 @@
},
{
"cell_type": "markdown",
- "id": "c30cfd06",
+ "id": "a163dea4",
"metadata": {
"editable": true
},
@@ -113,7 +117,7 @@
},
{
"cell_type": "markdown",
- "id": "59d6452b",
+ "id": "e30d7141",
"metadata": {
"editable": true
},
@@ -125,7 +129,7 @@
},
{
"cell_type": "markdown",
- "id": "8649d84d",
+ "id": "1e391e10",
"metadata": {
"editable": true
},
@@ -135,7 +139,7 @@
},
{
"cell_type": "markdown",
- "id": "aaa65f06",
+ "id": "440e1f2a",
"metadata": {
"editable": true
},
@@ -147,7 +151,7 @@
},
{
"cell_type": "markdown",
- "id": "cc43802e",
+ "id": "4f920c69",
"metadata": {
"editable": true
},
@@ -168,7 +172,7 @@
},
{
"cell_type": "markdown",
- "id": "53877600",
+ "id": "179c4cba",
"metadata": {
"editable": true
},
@@ -180,7 +184,7 @@
},
{
"cell_type": "markdown",
- "id": "bc4478fc",
+ "id": "82d6dd48",
"metadata": {
"editable": true
},
@@ -193,7 +197,7 @@
},
{
"cell_type": "markdown",
- "id": "64bc2ac2",
+ "id": "fb67db20",
"metadata": {
"editable": true
},
@@ -205,7 +209,7 @@
},
{
"cell_type": "markdown",
- "id": "d7b7d1d1",
+ "id": "406fe296",
"metadata": {
"editable": true
},
@@ -217,7 +221,7 @@
},
{
"cell_type": "markdown",
- "id": "f34563f6",
+ "id": "7ca59383",
"metadata": {
"editable": true
},
@@ -227,7 +231,7 @@
},
{
"cell_type": "markdown",
- "id": "1dbad69a",
+ "id": "59b8cb83",
"metadata": {
"editable": true
},
@@ -239,7 +243,7 @@
},
{
"cell_type": "markdown",
- "id": "2a16de00",
+ "id": "5e10e269",
"metadata": {
"editable": true
},
@@ -252,7 +256,7 @@
},
{
"cell_type": "markdown",
- "id": "07115e56",
+ "id": "c8f4a461",
"metadata": {
"editable": true
},
@@ -264,7 +268,7 @@
},
{
"cell_type": "markdown",
- "id": "b90655a4",
+ "id": "8299a747",
"metadata": {
"editable": true
},
@@ -274,7 +278,7 @@
},
{
"cell_type": "markdown",
- "id": "2ac208f1",
+ "id": "e3adcb3e",
"metadata": {
"editable": true
},
@@ -286,7 +290,7 @@
},
{
"cell_type": "markdown",
- "id": "a8197640",
+ "id": "a48bfab5",
"metadata": {
"editable": true
},
@@ -298,7 +302,7 @@
},
{
"cell_type": "markdown",
- "id": "7c72baae",
+ "id": "87754669",
"metadata": {
"editable": true
},
@@ -309,7 +313,7 @@
},
{
"cell_type": "markdown",
- "id": "3c595093",
+ "id": "c4980f00",
"metadata": {
"editable": true
},
@@ -321,7 +325,7 @@
},
{
"cell_type": "markdown",
- "id": "4dab1f87",
+ "id": "1a1adcd3",
"metadata": {
"editable": true
},
@@ -340,7 +344,7 @@
},
{
"cell_type": "markdown",
- "id": "2a85bd46",
+ "id": "8d4dd262",
"metadata": {
"editable": true
},
@@ -353,7 +357,7 @@
},
{
"cell_type": "markdown",
- "id": "5500dd61",
+ "id": "2215a906",
"metadata": {
"editable": true
},
@@ -363,7 +367,7 @@
},
{
"cell_type": "markdown",
- "id": "0072db82",
+ "id": "d293ee98",
"metadata": {
"editable": true
},
@@ -375,7 +379,7 @@
},
{
"cell_type": "markdown",
- "id": "078ec23d",
+ "id": "cc42ead9",
"metadata": {
"editable": true
},
@@ -385,7 +389,7 @@
},
{
"cell_type": "markdown",
- "id": "cc1760bc",
+ "id": "fb13cd8b",
"metadata": {
"editable": true
},
@@ -397,7 +401,7 @@
},
{
"cell_type": "markdown",
- "id": "73d00905",
+ "id": "fc02a912",
"metadata": {
"editable": true
},
@@ -407,7 +411,7 @@
},
{
"cell_type": "markdown",
- "id": "50dff40b",
+ "id": "82afab7b",
"metadata": {
"editable": true
},
@@ -419,7 +423,7 @@
},
{
"cell_type": "markdown",
- "id": "622bf5f5",
+ "id": "843ade9a",
"metadata": {
"editable": true
},
@@ -430,7 +434,7 @@
},
{
"cell_type": "markdown",
- "id": "48bfcf85",
+ "id": "e955afa1",
"metadata": {
"editable": true
},
@@ -442,7 +446,7 @@
},
{
"cell_type": "markdown",
- "id": "07c395fe",
+ "id": "61e860cd",
"metadata": {
"editable": true
},
@@ -452,7 +456,7 @@
},
{
"cell_type": "markdown",
- "id": "d3ccdcb0",
+ "id": "93d2b6e6",
"metadata": {
"editable": true
},
@@ -464,7 +468,7 @@
},
{
"cell_type": "markdown",
- "id": "c1ef9741",
+ "id": "adfd7e62",
"metadata": {
"editable": true
},
@@ -474,7 +478,7 @@
},
{
"cell_type": "markdown",
- "id": "1646a521",
+ "id": "1663846c",
"metadata": {
"editable": true
},
@@ -486,7 +490,7 @@
},
{
"cell_type": "markdown",
- "id": "daa11d84",
+ "id": "12dd4571",
"metadata": {
"editable": true
},
@@ -506,7 +510,7 @@
},
{
"cell_type": "markdown",
- "id": "78b271ce",
+ "id": "57f81768",
"metadata": {
"editable": true
},
@@ -533,7 +537,7 @@
},
{
"cell_type": "markdown",
- "id": "9482d4e6",
+ "id": "7f129030",
"metadata": {
"editable": true
},
@@ -545,7 +549,7 @@
},
{
"cell_type": "markdown",
- "id": "c7787334",
+ "id": "6c35b0ba",
"metadata": {
"editable": true
},
@@ -557,7 +561,7 @@
},
{
"cell_type": "markdown",
- "id": "a7c6c6e4",
+ "id": "162c4ffd",
"metadata": {
"editable": true
},
@@ -573,7 +577,7 @@
},
{
"cell_type": "markdown",
- "id": "dc9f4b6f",
+ "id": "84eee206",
"metadata": {
"editable": true
},
@@ -591,7 +595,7 @@
},
{
"cell_type": "markdown",
- "id": "dbb092e9",
+ "id": "832f9fc3",
"metadata": {
"editable": true
},
@@ -603,7 +607,7 @@
},
{
"cell_type": "markdown",
- "id": "47f695d0",
+ "id": "43a78640",
"metadata": {
"editable": true
},
@@ -615,7 +619,7 @@
},
{
"cell_type": "markdown",
- "id": "6ff6f849",
+ "id": "7fbfd556",
"metadata": {
"editable": true
},
@@ -626,7 +630,7 @@
},
{
"cell_type": "markdown",
- "id": "3fab9d8e",
+ "id": "f0b01c52",
"metadata": {
"editable": true
},
@@ -638,7 +642,7 @@
},
{
"cell_type": "markdown",
- "id": "230d417b",
+ "id": "fb5c1bd7",
"metadata": {
"editable": true
},
@@ -648,7 +652,7 @@
},
{
"cell_type": "markdown",
- "id": "ae3eea03",
+ "id": "9a0a695d",
"metadata": {
"editable": true
},
@@ -660,7 +664,7 @@
},
{
"cell_type": "markdown",
- "id": "97d7d08a",
+ "id": "87e15057",
"metadata": {
"editable": true
},
@@ -674,7 +678,7 @@
},
{
"cell_type": "markdown",
- "id": "dbcabc11",
+ "id": "fca1498a",
"metadata": {
"editable": true
},
@@ -686,7 +690,7 @@
},
{
"cell_type": "markdown",
- "id": "7278dcbd",
+ "id": "b8c63be2",
"metadata": {
"editable": true
},
@@ -698,7 +702,7 @@
},
{
"cell_type": "markdown",
- "id": "c16d222a",
+ "id": "2ddd0ffc",
"metadata": {
"editable": true
},
@@ -710,7 +714,7 @@
},
{
"cell_type": "markdown",
- "id": "0d85444e",
+ "id": "509d2ab6",
"metadata": {
"editable": true
},
@@ -720,7 +724,7 @@
},
{
"cell_type": "markdown",
- "id": "4d26bab6",
+ "id": "bb492979",
"metadata": {
"editable": true
},
@@ -732,7 +736,7 @@
},
{
"cell_type": "markdown",
- "id": "b6d57fdf",
+ "id": "ca02a149",
"metadata": {
"editable": true
},
@@ -744,7 +748,7 @@
},
{
"cell_type": "markdown",
- "id": "7a78e5dc",
+ "id": "782c5c3d",
"metadata": {
"editable": true
},
@@ -756,7 +760,7 @@
},
{
"cell_type": "markdown",
- "id": "6231367b",
+ "id": "749d69a8",
"metadata": {
"editable": true
},
@@ -770,7 +774,7 @@
},
{
"cell_type": "markdown",
- "id": "ab068594",
+ "id": "e2910da5",
"metadata": {
"editable": true
},
@@ -782,7 +786,7 @@
},
{
"cell_type": "markdown",
- "id": "07d2f06b",
+ "id": "effa9035",
"metadata": {
"editable": true
},
@@ -794,7 +798,7 @@
},
{
"cell_type": "markdown",
- "id": "d2382139",
+ "id": "89e33e6e",
"metadata": {
"editable": true
},
@@ -806,7 +810,7 @@
},
{
"cell_type": "markdown",
- "id": "7d063f00",
+ "id": "5a0e8a3b",
"metadata": {
"editable": true
},
@@ -816,7 +820,7 @@
},
{
"cell_type": "markdown",
- "id": "5e119075",
+ "id": "12119d38",
"metadata": {
"editable": true
},
@@ -828,7 +832,7 @@
},
{
"cell_type": "markdown",
- "id": "700eaedb",
+ "id": "b8e2462f",
"metadata": {
"editable": true
},
@@ -838,7 +842,7 @@
},
{
"cell_type": "markdown",
- "id": "51e05fca",
+ "id": "ba9fdb35",
"metadata": {
"editable": true
},
@@ -850,7 +854,7 @@
},
{
"cell_type": "markdown",
- "id": "bba7f463",
+ "id": "ac7406a7",
"metadata": {
"editable": true
},
@@ -860,7 +864,7 @@
},
{
"cell_type": "markdown",
- "id": "601577cc",
+ "id": "01329146",
"metadata": {
"editable": true
},
@@ -872,7 +876,7 @@
},
{
"cell_type": "markdown",
- "id": "ea31952c",
+ "id": "3575ca3b",
"metadata": {
"editable": true
},
@@ -884,7 +888,7 @@
},
{
"cell_type": "markdown",
- "id": "fc6c86a7",
+ "id": "bda9dbe5",
"metadata": {
"editable": true
},
@@ -896,7 +900,7 @@
},
{
"cell_type": "markdown",
- "id": "ffe09390",
+ "id": "a50cda13",
"metadata": {
"editable": true
},
@@ -911,7 +915,7 @@
},
{
"cell_type": "markdown",
- "id": "22f4970c",
+ "id": "98a5bfd3",
"metadata": {
"editable": true
},
@@ -923,7 +927,7 @@
},
{
"cell_type": "markdown",
- "id": "4ba751cb",
+ "id": "29825b92",
"metadata": {
"editable": true
},
@@ -933,7 +937,7 @@
},
{
"cell_type": "markdown",
- "id": "87052e13",
+ "id": "98cd166a",
"metadata": {
"editable": true
},
@@ -945,7 +949,7 @@
},
{
"cell_type": "markdown",
- "id": "e24dea19",
+ "id": "ac113691",
"metadata": {
"editable": true
},
@@ -955,7 +959,7 @@
},
{
"cell_type": "markdown",
- "id": "6b52c737",
+ "id": "4885434d",
"metadata": {
"editable": true
},
@@ -967,7 +971,7 @@
},
{
"cell_type": "markdown",
- "id": "904b93aa",
+ "id": "0be054ab",
"metadata": {
"editable": true
},
@@ -977,7 +981,7 @@
},
{
"cell_type": "markdown",
- "id": "439e197d",
+ "id": "56bd4473",
"metadata": {
"editable": true
},
@@ -989,7 +993,7 @@
},
{
"cell_type": "markdown",
- "id": "f5658ed9",
+ "id": "f7696e03",
"metadata": {
"editable": true
},
@@ -1001,7 +1005,7 @@
},
{
"cell_type": "markdown",
- "id": "6f99984d",
+ "id": "52b3aee8",
"metadata": {
"editable": true
},
@@ -1013,7 +1017,7 @@
},
{
"cell_type": "markdown",
- "id": "eeb1373c",
+ "id": "5ae5b749",
"metadata": {
"editable": true
},
@@ -1023,7 +1027,7 @@
},
{
"cell_type": "markdown",
- "id": "f3c557ba",
+ "id": "ad4d9e92",
"metadata": {
"editable": true
},
@@ -1035,7 +1039,7 @@
},
{
"cell_type": "markdown",
- "id": "412789d5",
+ "id": "593fb36f",
"metadata": {
"editable": true
},
@@ -1048,7 +1052,7 @@
},
{
"cell_type": "markdown",
- "id": "65fbbb29",
+ "id": "49bdf172",
"metadata": {
"editable": true
},
@@ -1060,7 +1064,7 @@
},
{
"cell_type": "markdown",
- "id": "f4cd65e4",
+ "id": "2fb6ff7e",
"metadata": {
"editable": true
},
@@ -1070,7 +1074,7 @@
},
{
"cell_type": "markdown",
- "id": "9ee329c3",
+ "id": "5dbcf369",
"metadata": {
"editable": true
},
@@ -1082,7 +1086,7 @@
},
{
"cell_type": "markdown",
- "id": "47023d81",
+ "id": "317f4f66",
"metadata": {
"editable": true
},
@@ -1092,7 +1096,7 @@
},
{
"cell_type": "markdown",
- "id": "40d4cc36",
+ "id": "2b3b5bf8",
"metadata": {
"editable": true
},
@@ -1104,7 +1108,7 @@
},
{
"cell_type": "markdown",
- "id": "e266851f",
+ "id": "482872ec",
"metadata": {
"editable": true
},
@@ -1114,7 +1118,7 @@
},
{
"cell_type": "markdown",
- "id": "f4d0941c",
+ "id": "cbfa31c1",
"metadata": {
"editable": true
},
@@ -1126,7 +1130,7 @@
},
{
"cell_type": "markdown",
- "id": "6f4b2a9d",
+ "id": "29d719aa",
"metadata": {
"editable": true
},
@@ -1136,7 +1140,7 @@
},
{
"cell_type": "markdown",
- "id": "62cab30b",
+ "id": "d09f28c9",
"metadata": {
"editable": true
},
@@ -1148,7 +1152,7 @@
},
{
"cell_type": "markdown",
- "id": "4c8c6398",
+ "id": "b563a46a",
"metadata": {
"editable": true
},
@@ -1158,7 +1162,7 @@
},
{
"cell_type": "markdown",
- "id": "f9c6ab8a",
+ "id": "cfb14c2e",
"metadata": {
"editable": true
},
@@ -1170,7 +1174,7 @@
},
{
"cell_type": "markdown",
- "id": "b7945d33",
+ "id": "55d73d59",
"metadata": {
"editable": true
},
@@ -1182,7 +1186,7 @@
},
{
"cell_type": "markdown",
- "id": "80421efe",
+ "id": "0d302953",
"metadata": {
"editable": true
},
@@ -1194,7 +1198,7 @@
},
{
"cell_type": "markdown",
- "id": "cc1fb4bf",
+ "id": "3134df8b",
"metadata": {
"editable": true
},
@@ -1206,7 +1210,7 @@
},
{
"cell_type": "markdown",
- "id": "c149bd15",
+ "id": "f7a379d8",
"metadata": {
"editable": true
},
@@ -1218,7 +1222,7 @@
},
{
"cell_type": "markdown",
- "id": "4aeb6fad",
+ "id": "625b988b",
"metadata": {
"editable": true
},
@@ -1234,7 +1238,7 @@
},
{
"cell_type": "markdown",
- "id": "fecdf631",
+ "id": "9ad87f84",
"metadata": {
"editable": true
},
@@ -1246,7 +1250,7 @@
},
{
"cell_type": "markdown",
- "id": "7ffbaccd",
+ "id": "c09b142d",
"metadata": {
"editable": true
},
@@ -1256,7 +1260,7 @@
},
{
"cell_type": "markdown",
- "id": "ba12c9f2",
+ "id": "87e150ea",
"metadata": {
"editable": true
},
@@ -1268,7 +1272,7 @@
},
{
"cell_type": "markdown",
- "id": "871cfd8e",
+ "id": "df00240d",
"metadata": {
"editable": true
},
@@ -1286,7 +1290,7 @@
},
{
"cell_type": "markdown",
- "id": "0ad332cd",
+ "id": "8fdbd7f8",
"metadata": {
"editable": true
},
@@ -1298,7 +1302,7 @@
},
{
"cell_type": "markdown",
- "id": "5e7042e9",
+ "id": "238c7bd8",
"metadata": {
"editable": true
},
@@ -1310,7 +1314,7 @@
},
{
"cell_type": "markdown",
- "id": "43b825ce",
+ "id": "18a876fb",
"metadata": {
"editable": true
},
@@ -1320,7 +1324,7 @@
},
{
"cell_type": "markdown",
- "id": "58a4ed44",
+ "id": "ef14c409",
"metadata": {
"editable": true
},
@@ -1332,7 +1336,7 @@
},
{
"cell_type": "markdown",
- "id": "202c5775",
+ "id": "13723af9",
"metadata": {
"editable": true
},
@@ -1342,7 +1346,7 @@
},
{
"cell_type": "markdown",
- "id": "0eab64e4",
+ "id": "4d4ffe70",
"metadata": {
"editable": true
},
@@ -1354,7 +1358,7 @@
},
{
"cell_type": "markdown",
- "id": "d17063fa",
+ "id": "6d044514",
"metadata": {
"editable": true
},
@@ -1364,7 +1368,7 @@
},
{
"cell_type": "markdown",
- "id": "02cca57e",
+ "id": "63c7644a",
"metadata": {
"editable": true
},
@@ -1378,7 +1382,7 @@
},
{
"cell_type": "markdown",
- "id": "d5a0e65b",
+ "id": "c2dbbf59",
"metadata": {
"editable": true
},
@@ -1390,7 +1394,7 @@
},
{
"cell_type": "markdown",
- "id": "03f47788",
+ "id": "c972290a",
"metadata": {
"editable": true
},
@@ -1401,7 +1405,7 @@
},
{
"cell_type": "markdown",
- "id": "ab07b7cf",
+ "id": "141194f9",
"metadata": {
"editable": true
},
@@ -1414,7 +1418,7 @@
{
"cell_type": "code",
"execution_count": 1,
- "id": "f51e672d",
+ "id": "015492ec",
"metadata": {
"collapsed": false,
"editable": true
@@ -1441,7 +1445,7 @@
},
{
"cell_type": "markdown",
- "id": "e44be45e",
+ "id": "1d13253b",
"metadata": {
"editable": true
},
@@ -1452,7 +1456,7 @@
{
"cell_type": "code",
"execution_count": 2,
- "id": "b4786589",
+ "id": "a85b890a",
"metadata": {
"collapsed": false,
"editable": true
@@ -1465,7 +1469,7 @@
},
{
"cell_type": "markdown",
- "id": "af2dcc52",
+ "id": "08eee60c",
"metadata": {
"editable": true
},
@@ -1479,7 +1483,7 @@
{
"cell_type": "code",
"execution_count": 3,
- "id": "2bc65bc5",
+ "id": "06c7d473",
"metadata": {
"collapsed": false,
"editable": true
@@ -1492,7 +1496,7 @@
},
{
"cell_type": "markdown",
- "id": "46bda600",
+ "id": "8a9eb7fd",
"metadata": {
"editable": true
},
@@ -1503,7 +1507,7 @@
{
"cell_type": "code",
"execution_count": 4,
- "id": "9bdae7bf",
+ "id": "44804614",
"metadata": {
"collapsed": false,
"editable": true
@@ -1515,7 +1519,7 @@
},
{
"cell_type": "markdown",
- "id": "64eeaaef",
+ "id": "3c36f7b4",
"metadata": {
"editable": true
},
@@ -1526,7 +1530,7 @@
{
"cell_type": "code",
"execution_count": 5,
- "id": "cafbda91",
+ "id": "128cc3f9",
"metadata": {
"collapsed": false,
"editable": true
@@ -1542,7 +1546,7 @@
},
{
"cell_type": "markdown",
- "id": "831a5888",
+ "id": "f0555b78",
"metadata": {
"editable": true
},
@@ -1553,7 +1557,7 @@
{
"cell_type": "code",
"execution_count": 6,
- "id": "90f6a538",
+ "id": "f482d41d",
"metadata": {
"collapsed": false,
"editable": true
@@ -1567,7 +1571,7 @@
},
{
"cell_type": "markdown",
- "id": "dc364c27",
+ "id": "292cb89c",
"metadata": {
"editable": true
},
@@ -1588,7 +1592,7 @@
},
{
"cell_type": "markdown",
- "id": "1598259c",
+ "id": "59a7edef",
"metadata": {
"editable": true
},
@@ -1599,7 +1603,7 @@
{
"cell_type": "code",
"execution_count": 7,
- "id": "ca994e68",
+ "id": "847478f5",
"metadata": {
"collapsed": false,
"editable": true
@@ -1652,7 +1656,7 @@
},
{
"cell_type": "markdown",
- "id": "7353f2e7",
+ "id": "4a92abc5",
"metadata": {
"editable": true
},
@@ -1663,7 +1667,7 @@
{
"cell_type": "code",
"execution_count": 8,
- "id": "05a066db",
+ "id": "71d29d58",
"metadata": {
"collapsed": false,
"editable": true
@@ -1688,7 +1692,7 @@
},
{
"cell_type": "markdown",
- "id": "1f30de64",
+ "id": "71ffb936",
"metadata": {
"editable": true
},
@@ -1700,7 +1704,7 @@
},
{
"cell_type": "markdown",
- "id": "80fa8b7d",
+ "id": "ed47d431",
"metadata": {
"editable": true
},
@@ -1729,7 +1733,7 @@
},
{
"cell_type": "markdown",
- "id": "7e92be20",
+ "id": "4a01c695",
"metadata": {
"editable": true
},
@@ -1754,7 +1758,7 @@
},
{
"cell_type": "markdown",
- "id": "052e8c0c",
+ "id": "d8b9ee62",
"metadata": {
"editable": true
},
@@ -1774,7 +1778,7 @@
},
{
"cell_type": "markdown",
- "id": "d752c7f4",
+ "id": "a5f362af",
"metadata": {
"editable": true
},
@@ -1801,7 +1805,7 @@
},
{
"cell_type": "markdown",
- "id": "4b40d092",
+ "id": "1bdf7ea5",
"metadata": {
"editable": true
},
@@ -1814,7 +1818,7 @@
},
{
"cell_type": "markdown",
- "id": "f8526e57",
+ "id": "142f891c",
"metadata": {
"editable": true
},
@@ -1826,7 +1830,7 @@
},
{
"cell_type": "markdown",
- "id": "5cfb3455",
+ "id": "aee9f94b",
"metadata": {
"editable": true
},
@@ -1837,7 +1841,7 @@
},
{
"cell_type": "markdown",
- "id": "363e0117",
+ "id": "4ce309d1",
"metadata": {
"editable": true
},
@@ -1853,7 +1857,7 @@
{
"cell_type": "code",
"execution_count": 9,
- "id": "4c7ecfc5",
+ "id": "0a704745",
"metadata": {
"collapsed": false,
"editable": true
@@ -1887,7 +1891,7 @@
},
{
"cell_type": "markdown",
- "id": "981f65fb",
+ "id": "84eabf2a",
"metadata": {
"editable": true
},
@@ -1897,7 +1901,7 @@
},
{
"cell_type": "markdown",
- "id": "9ddcca79",
+ "id": "d43e8012",
"metadata": {
"editable": true
},
@@ -1912,7 +1916,7 @@
},
{
"cell_type": "markdown",
- "id": "02bed8b3",
+ "id": "7e9736ec",
"metadata": {
"editable": true
},
@@ -1924,7 +1928,7 @@
},
{
"cell_type": "markdown",
- "id": "64033f1d",
+ "id": "b10b3475",
"metadata": {
"editable": true
},
@@ -1934,7 +1938,7 @@
},
{
"cell_type": "markdown",
- "id": "1cfc52cc",
+ "id": "d84b36f4",
"metadata": {
"editable": true
},
@@ -1950,7 +1954,7 @@
{
"cell_type": "code",
"execution_count": 10,
- "id": "06b67f41",
+ "id": "f7106c42",
"metadata": {
"collapsed": false,
"editable": true
@@ -1967,7 +1971,7 @@
},
{
"cell_type": "markdown",
- "id": "773210a0",
+ "id": "3c69f9f8",
"metadata": {
"editable": true
},
@@ -1980,7 +1984,7 @@
{
"cell_type": "code",
"execution_count": 11,
- "id": "34cb4217",
+ "id": "11c487ef",
"metadata": {
"collapsed": false,
"editable": true
@@ -2027,7 +2031,7 @@
},
{
"cell_type": "markdown",
- "id": "4ae9cee9",
+ "id": "7c801b72",
"metadata": {
"editable": true
},
@@ -2038,7 +2042,7 @@
{
"cell_type": "code",
"execution_count": 12,
- "id": "9be1964e",
+ "id": "d3aeb46a",
"metadata": {
"collapsed": false,
"editable": true
@@ -2141,7 +2145,7 @@
},
{
"cell_type": "markdown",
- "id": "f0fe5870",
+ "id": "40492c3d",
"metadata": {
"editable": true
},
@@ -2169,7 +2173,7 @@
},
{
"cell_type": "markdown",
- "id": "9b60a7bd",
+ "id": "8522203f",
"metadata": {
"editable": true
},
@@ -2204,7 +2208,7 @@
},
{
"cell_type": "markdown",
- "id": "a31dcc5d",
+ "id": "be983c3c",
"metadata": {
"editable": true
},
@@ -2219,7 +2223,7 @@
{
"cell_type": "code",
"execution_count": 13,
- "id": "225671c5",
+ "id": "1efd2e47",
"metadata": {
"collapsed": false,
"editable": true
@@ -2244,7 +2248,7 @@
},
{
"cell_type": "markdown",
- "id": "ac1448c8",
+ "id": "f19c62cb",
"metadata": {
"editable": true
},
@@ -2260,7 +2264,7 @@
},
{
"cell_type": "markdown",
- "id": "c6e308a3",
+ "id": "a584c9cd",
"metadata": {
"editable": true
},
@@ -2272,7 +2276,7 @@
},
{
"cell_type": "markdown",
- "id": "a2f2dab5",
+ "id": "0be698a6",
"metadata": {
"editable": true
},
@@ -2287,7 +2291,7 @@
},
{
"cell_type": "markdown",
- "id": "8a7df606",
+ "id": "5d75610e",
"metadata": {
"editable": true
},
@@ -2299,7 +2303,7 @@
},
{
"cell_type": "markdown",
- "id": "31e595c9",
+ "id": "ff7ee954",
"metadata": {
"editable": true
},
@@ -2309,7 +2313,7 @@
},
{
"cell_type": "markdown",
- "id": "f5f389db",
+ "id": "5e6bb341",
"metadata": {
"editable": true
},
@@ -2321,7 +2325,7 @@
},
{
"cell_type": "markdown",
- "id": "1dd4b34d",
+ "id": "e963c568",
"metadata": {
"editable": true
},
@@ -2331,7 +2335,7 @@
},
{
"cell_type": "markdown",
- "id": "f931e286",
+ "id": "55885a4a",
"metadata": {
"editable": true
},
@@ -2343,7 +2347,7 @@
},
{
"cell_type": "markdown",
- "id": "4cbda41b",
+ "id": "45b41040",
"metadata": {
"editable": true
},
@@ -2356,7 +2360,7 @@
},
{
"cell_type": "markdown",
- "id": "6657a435",
+ "id": "09f46805",
"metadata": {
"editable": true
},
@@ -2368,7 +2372,7 @@
},
{
"cell_type": "markdown",
- "id": "91f7475b",
+ "id": "d1568bca",
"metadata": {
"editable": true
},
@@ -2378,7 +2382,7 @@
},
{
"cell_type": "markdown",
- "id": "98482060",
+ "id": "5596da7b",
"metadata": {
"editable": true
},
@@ -2390,7 +2394,7 @@
},
{
"cell_type": "markdown",
- "id": "01e12c29",
+ "id": "1a811520",
"metadata": {
"editable": true
},
@@ -2400,7 +2404,7 @@
},
{
"cell_type": "markdown",
- "id": "38fa32e4",
+ "id": "97432a8f",
"metadata": {
"editable": true
},
@@ -2412,7 +2416,7 @@
},
{
"cell_type": "markdown",
- "id": "ea483f66",
+ "id": "f0771458",
"metadata": {
"editable": true
},
@@ -2422,7 +2426,7 @@
},
{
"cell_type": "markdown",
- "id": "d5862089",
+ "id": "7c19d9c3",
"metadata": {
"editable": true
},
@@ -2434,7 +2438,7 @@
},
{
"cell_type": "markdown",
- "id": "0456f62e",
+ "id": "f095d30a",
"metadata": {
"editable": true
},
@@ -2444,7 +2448,7 @@
},
{
"cell_type": "markdown",
- "id": "1ed14941",
+ "id": "40723219",
"metadata": {
"editable": true
},
@@ -2456,7 +2460,7 @@
},
{
"cell_type": "markdown",
- "id": "43387b69",
+ "id": "46ed821b",
"metadata": {
"editable": true
},
@@ -2466,7 +2470,7 @@
},
{
"cell_type": "markdown",
- "id": "06bd01bf",
+ "id": "5a319080",
"metadata": {
"editable": true
},
@@ -2478,7 +2482,7 @@
},
{
"cell_type": "markdown",
- "id": "9cad411e",
+ "id": "1113a828",
"metadata": {
"editable": true
},
@@ -2488,7 +2492,7 @@
},
{
"cell_type": "markdown",
- "id": "c37f7792",
+ "id": "283f8fe8",
"metadata": {
"editable": true
},
@@ -2500,7 +2504,7 @@
},
{
"cell_type": "markdown",
- "id": "8a7f23f8",
+ "id": "d2e5d910",
"metadata": {
"editable": true
},
@@ -2512,7 +2516,7 @@
},
{
"cell_type": "markdown",
- "id": "a7fdf6e8",
+ "id": "2de4cd2c",
"metadata": {
"editable": true
},
@@ -2524,7 +2528,7 @@
},
{
"cell_type": "markdown",
- "id": "3ac73282",
+ "id": "ef87b933",
"metadata": {
"editable": true
},
@@ -2537,7 +2541,7 @@
},
{
"cell_type": "markdown",
- "id": "e55db5a0",
+ "id": "36ae94a8",
"metadata": {
"editable": true
},
@@ -2549,7 +2553,7 @@
},
{
"cell_type": "markdown",
- "id": "966cd383",
+ "id": "0e940b73",
"metadata": {
"editable": true
},
@@ -2559,7 +2563,7 @@
},
{
"cell_type": "markdown",
- "id": "360cb45f",
+ "id": "6d215e00",
"metadata": {
"editable": true
},
@@ -2573,7 +2577,7 @@
{
"cell_type": "code",
"execution_count": 14,
- "id": "2099267d",
+ "id": "8e8abb2e",
"metadata": {
"collapsed": false,
"editable": true
@@ -2670,7 +2674,7 @@
},
{
"cell_type": "markdown",
- "id": "9ba9afe9",
+ "id": "2d3510cf",
"metadata": {
"editable": true
},
@@ -2691,7 +2695,7 @@
},
{
"cell_type": "markdown",
- "id": "ea4bf6fe",
+ "id": "6bbe3c03",
"metadata": {
"editable": true
},
@@ -2703,7 +2707,7 @@
},
{
"cell_type": "markdown",
- "id": "98ca9b28",
+ "id": "9402a7f6",
"metadata": {
"editable": true
},
@@ -2713,7 +2717,7 @@
},
{
"cell_type": "markdown",
- "id": "996fc4f6",
+ "id": "2854105e",
"metadata": {
"editable": true
},
@@ -2725,7 +2729,7 @@
},
{
"cell_type": "markdown",
- "id": "b5db8128",
+ "id": "8a104c4a",
"metadata": {
"editable": true
},
@@ -2735,7 +2739,7 @@
},
{
"cell_type": "markdown",
- "id": "745d6bff",
+ "id": "903e7426",
"metadata": {
"editable": true
},
@@ -2747,7 +2751,7 @@
},
{
"cell_type": "markdown",
- "id": "2ecb048e",
+ "id": "08a6f7fc",
"metadata": {
"editable": true
},
@@ -2763,381 +2767,17 @@
},
{
"cell_type": "markdown",
- "id": "73eb2f08",
+ "id": "f08f1d7b",
"metadata": {
"editable": true
},
"source": [
- "## The Boston housing data example\n",
- "\n",
- "The Boston housing \n",
- "data set was originally a part of UCI Machine Learning Repository\n",
- "and has been removed now. The data set is now included in **Scikit-Learn**'s \n",
- "library. There are 506 samples and 13 feature (predictor) variables\n",
- "in this data set. The objective is to predict the value of prices of\n",
- "the house using the features (predictors) listed here.\n",
- "\n",
- "The features/predictors are\n",
- "1. CRIM: Per capita crime rate by town\n",
- "\n",
- "2. ZN: Proportion of residential land zoned for lots over 25000 square feet\n",
- "\n",
- "3. INDUS: Proportion of non-retail business acres per town\n",
- "\n",
- "4. CHAS: Charles River dummy variable (= 1 if tract bounds river; 0 otherwise)\n",
- "\n",
- "5. NOX: Nitric oxide concentration (parts per 10 million)\n",
- "\n",
- "6. RM: Average number of rooms per dwelling\n",
- "\n",
- "7. AGE: Proportion of owner-occupied units built prior to 1940\n",
- "\n",
- "8. DIS: Weighted distances to five Boston employment centers\n",
- "\n",
- "9. RAD: Index of accessibility to radial highways\n",
- "\n",
- "10. TAX: Full-value property tax rate per USD10000\n",
- "\n",
- "11. B: $1000(Bk - 0.63)^2$, where $Bk$ is the proportion of [people of African American descent] by town\n",
- "\n",
- "12. LSTAT: Percentage of lower status of the population\n",
- "\n",
- "13. MEDV: Median value of owner-occupied homes in USD 1000s"
+ "## Material for lecture Monday, August 26"
]
},
{
"cell_type": "markdown",
- "id": "41d9c008",
- "metadata": {
- "editable": true
- },
- "source": [
- "## Housing data, the code\n",
- "We start by importing the libraries"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 15,
- "id": "0af3b38a",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "import numpy as np\n",
- "import matplotlib.pyplot as plt \n",
- "\n",
- "import pandas as pd \n",
- "import seaborn as sns"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "41771944",
- "metadata": {
- "editable": true
- },
- "source": [
- "and load the Boston Housing DataSet from **Scikit-Learn**"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 16,
- "id": "c0ad90ff",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "from sklearn.datasets import load_boston\n",
- "\n",
- "boston_dataset = load_boston()\n",
- "\n",
- "# boston_dataset is a dictionary\n",
- "# let's check what it contains\n",
- "boston_dataset.keys()"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "ef2f9bce",
- "metadata": {
- "editable": true
- },
- "source": [
- "Then we invoke Pandas"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 17,
- "id": "150d1433",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "boston = pd.DataFrame(boston_dataset.data, columns=boston_dataset.feature_names)\n",
- "boston.head()\n",
- "boston['MEDV'] = boston_dataset.target"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "1be017ef",
- "metadata": {
- "editable": true
- },
- "source": [
- "and preprocess the data"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 18,
- "id": "01ef8953",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "# check for missing values in all the columns\n",
- "boston.isnull().sum()"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "adc486b5",
- "metadata": {
- "editable": true
- },
- "source": [
- "We can then visualize the data"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 19,
- "id": "2471fc63",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "# set the size of the figure\n",
- "sns.set(rc={'figure.figsize':(11.7,8.27)})\n",
- "\n",
- "# plot a histogram showing the distribution of the target values\n",
- "sns.distplot(boston['MEDV'], bins=30)\n",
- "plt.show()"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "e26d39f7",
- "metadata": {
- "editable": true
- },
- "source": [
- "It is now useful to look at the correlation matrix"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 20,
- "id": "6bb60001",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "# compute the pair wise correlation for all columns \n",
- "correlation_matrix = boston.corr().round(2)\n",
- "# use the heatmap function from seaborn to plot the correlation matrix\n",
- "# annot = True to print the values inside the square\n",
- "sns.heatmap(data=correlation_matrix, annot=True)"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "90f47dc1",
- "metadata": {
- "editable": true
- },
- "source": [
- "From the above coorelation plot we can see that **MEDV** is strongly correlated to **LSTAT** and **RM**. We see also that **RAD** and **TAX** are stronly correlated, but we don't include this in our features together to avoid multi-colinearity"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 21,
- "id": "a1f980e4",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "plt.figure(figsize=(20, 5))\n",
- "\n",
- "features = ['LSTAT', 'RM']\n",
- "target = boston['MEDV']\n",
- "\n",
- "for i, col in enumerate(features):\n",
- " plt.subplot(1, len(features) , i+1)\n",
- " x = boston[col]\n",
- " y = target\n",
- " plt.scatter(x, y, marker='o')\n",
- " plt.title(col)\n",
- " plt.xlabel(col)\n",
- " plt.ylabel('MEDV')"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "9efdaaaa",
- "metadata": {
- "editable": true
- },
- "source": [
- "Now we start training our model"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 22,
- "id": "01e9afe5",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "X = pd.DataFrame(np.c_[boston['LSTAT'], boston['RM']], columns = ['LSTAT','RM'])\n",
- "Y = boston['MEDV']"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "73335565",
- "metadata": {
- "editable": true
- },
- "source": [
- "We split the data into training and test sets"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 23,
- "id": "f865febb",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "from sklearn.model_selection import train_test_split\n",
- "\n",
- "# splits the training and test data set in 80% : 20%\n",
- "# assign random_state to any value.This ensures consistency.\n",
- "X_train, X_test, Y_train, Y_test = train_test_split(X, Y, test_size = 0.2, random_state=5)\n",
- "print(X_train.shape)\n",
- "print(X_test.shape)\n",
- "print(Y_train.shape)\n",
- "print(Y_test.shape)"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "88f5a339",
- "metadata": {
- "editable": true
- },
- "source": [
- "Then we use the linear regression functionality from **Scikit-Learn**"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 24,
- "id": "bacdbf9b",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "from sklearn.linear_model import LinearRegression\n",
- "from sklearn.metrics import mean_squared_error, r2_score\n",
- "\n",
- "lin_model = LinearRegression()\n",
- "lin_model.fit(X_train, Y_train)\n",
- "\n",
- "# model evaluation for training set\n",
- "\n",
- "y_train_predict = lin_model.predict(X_train)\n",
- "rmse = (np.sqrt(mean_squared_error(Y_train, y_train_predict)))\n",
- "r2 = r2_score(Y_train, y_train_predict)\n",
- "\n",
- "print(\"The model performance for training set\")\n",
- "print(\"--------------------------------------\")\n",
- "print('RMSE is {}'.format(rmse))\n",
- "print('R2 score is {}'.format(r2))\n",
- "print(\"\\n\")\n",
- "\n",
- "# model evaluation for testing set\n",
- "\n",
- "y_test_predict = lin_model.predict(X_test)\n",
- "# root mean square error of the model\n",
- "rmse = (np.sqrt(mean_squared_error(Y_test, y_test_predict)))\n",
- "\n",
- "# r-squared score of the model\n",
- "r2 = r2_score(Y_test, y_test_predict)\n",
- "\n",
- "print(\"The model performance for testing set\")\n",
- "print(\"--------------------------------------\")\n",
- "print('RMSE is {}'.format(rmse))\n",
- "print('R2 score is {}'.format(r2))"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 25,
- "id": "09aa7ac9",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "# plotting the y_test vs y_pred\n",
- "# ideally should have been a straight line\n",
- "plt.scatter(Y_test, y_test_predict)\n",
- "plt.show()"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "cb088f7a",
- "metadata": {
- "editable": true
- },
- "source": [
- "## Material for lecture Thursday, August 31"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "a452bf26",
+ "id": "5d936c7e",
"metadata": {
"editable": true
},
@@ -3151,7 +2791,7 @@
},
{
"cell_type": "markdown",
- "id": "603ea987",
+ "id": "ef7769a7",
"metadata": {
"editable": true
},
@@ -3163,7 +2803,7 @@
},
{
"cell_type": "markdown",
- "id": "61b65c66",
+ "id": "7771ff2c",
"metadata": {
"editable": true
},
@@ -3175,7 +2815,7 @@
},
{
"cell_type": "markdown",
- "id": "d08fd064",
+ "id": "10fc7ed2",
"metadata": {
"editable": true
},
@@ -3187,7 +2827,7 @@
},
{
"cell_type": "markdown",
- "id": "e8f62983",
+ "id": "39b5e3bd",
"metadata": {
"editable": true
},
@@ -3197,7 +2837,7 @@
},
{
"cell_type": "markdown",
- "id": "d68a9415",
+ "id": "52b3d0bb",
"metadata": {
"editable": true
},
@@ -3209,7 +2849,7 @@
},
{
"cell_type": "markdown",
- "id": "3307fed7",
+ "id": "4c3bc56d",
"metadata": {
"editable": true
},
@@ -3219,7 +2859,7 @@
},
{
"cell_type": "markdown",
- "id": "8a910e57",
+ "id": "1763f73c",
"metadata": {
"editable": true
},
@@ -3231,7 +2871,7 @@
},
{
"cell_type": "markdown",
- "id": "218a6b48",
+ "id": "10ca64dc",
"metadata": {
"editable": true
},
@@ -3242,7 +2882,7 @@
},
{
"cell_type": "markdown",
- "id": "8f3748ba",
+ "id": "59d74409",
"metadata": {
"editable": true
},
@@ -3254,7 +2894,7 @@
},
{
"cell_type": "markdown",
- "id": "d0385420",
+ "id": "e096a0c8",
"metadata": {
"editable": true
},
@@ -3266,7 +2906,7 @@
},
{
"cell_type": "markdown",
- "id": "4644a05e",
+ "id": "9e7b9f26",
"metadata": {
"editable": true
},
@@ -3276,7 +2916,7 @@
},
{
"cell_type": "markdown",
- "id": "bfb350df",
+ "id": "5f8e828c",
"metadata": {
"editable": true
},
@@ -3288,7 +2928,7 @@
},
{
"cell_type": "markdown",
- "id": "508acac7",
+ "id": "b649f8ce",
"metadata": {
"editable": true
},
@@ -3300,7 +2940,7 @@
},
{
"cell_type": "markdown",
- "id": "1cde0c41",
+ "id": "57c7d832",
"metadata": {
"editable": true
},
@@ -3310,7 +2950,7 @@
},
{
"cell_type": "markdown",
- "id": "683baaea",
+ "id": "c9c6af68",
"metadata": {
"editable": true
},
@@ -3322,7 +2962,7 @@
},
{
"cell_type": "markdown",
- "id": "ec9c67ea",
+ "id": "fa1128b4",
"metadata": {
"editable": true
},
@@ -3332,7 +2972,7 @@
},
{
"cell_type": "markdown",
- "id": "cdc9c6fc",
+ "id": "85c79bbd",
"metadata": {
"editable": true
},
@@ -3344,7 +2984,7 @@
},
{
"cell_type": "markdown",
- "id": "c7590b65",
+ "id": "a771f3ba",
"metadata": {
"editable": true
},
@@ -3354,7 +2994,7 @@
},
{
"cell_type": "markdown",
- "id": "f2d7afb2",
+ "id": "a537e28f",
"metadata": {
"editable": true
},
@@ -3394,7 +3034,7 @@
},
{
"cell_type": "markdown",
- "id": "69fd907d",
+ "id": "22a92910",
"metadata": {
"editable": true
},
@@ -3411,7 +3051,7 @@
},
{
"cell_type": "markdown",
- "id": "33b93521",
+ "id": "93aec13e",
"metadata": {
"editable": true
},
@@ -3434,7 +3074,7 @@
},
{
"cell_type": "markdown",
- "id": "600d8db6",
+ "id": "3e8fc4af",
"metadata": {
"editable": true
},
@@ -3451,7 +3091,7 @@
},
{
"cell_type": "markdown",
- "id": "22fc0a80",
+ "id": "3f2d73ed",
"metadata": {
"editable": true
},
@@ -3470,7 +3110,7 @@
},
{
"cell_type": "markdown",
- "id": "bd71990f",
+ "id": "cebec7f9",
"metadata": {
"editable": true
},
@@ -3481,7 +3121,7 @@
},
{
"cell_type": "markdown",
- "id": "587d44ae",
+ "id": "da556bd6",
"metadata": {
"editable": true
},
@@ -3493,7 +3133,7 @@
},
{
"cell_type": "markdown",
- "id": "2158156f",
+ "id": "4d23351d",
"metadata": {
"editable": true
},
@@ -3511,7 +3151,7 @@
},
{
"cell_type": "markdown",
- "id": "10eb0b7c",
+ "id": "162bcba6",
"metadata": {
"editable": true
},
@@ -3527,7 +3167,7 @@
},
{
"cell_type": "markdown",
- "id": "2aceb644",
+ "id": "778461b7",
"metadata": {
"editable": true
},
@@ -3539,7 +3179,7 @@
},
{
"cell_type": "markdown",
- "id": "1465b8be",
+ "id": "c691b8b0",
"metadata": {
"editable": true
},
@@ -3549,7 +3189,7 @@
},
{
"cell_type": "markdown",
- "id": "b3afc822",
+ "id": "b6b7e4a0",
"metadata": {
"editable": true
},
@@ -3564,7 +3204,7 @@
},
{
"cell_type": "markdown",
- "id": "4357f67d",
+ "id": "9a612971",
"metadata": {
"editable": true
},
@@ -3576,7 +3216,7 @@
},
{
"cell_type": "markdown",
- "id": "b2ed8199",
+ "id": "706132dc",
"metadata": {
"editable": true
},
@@ -3586,7 +3226,7 @@
},
{
"cell_type": "markdown",
- "id": "a28f5e2a",
+ "id": "206c55a7",
"metadata": {
"editable": true
},
@@ -3598,7 +3238,7 @@
},
{
"cell_type": "markdown",
- "id": "dda00171",
+ "id": "6b74284d",
"metadata": {
"editable": true
},
@@ -3608,7 +3248,7 @@
},
{
"cell_type": "markdown",
- "id": "99e49156",
+ "id": "0234a46a",
"metadata": {
"editable": true
},
@@ -3620,7 +3260,7 @@
},
{
"cell_type": "markdown",
- "id": "3de354b0",
+ "id": "abb8474f",
"metadata": {
"editable": true
},
@@ -3632,7 +3272,7 @@
},
{
"cell_type": "markdown",
- "id": "9b719377",
+ "id": "9467e419",
"metadata": {
"editable": true
},
@@ -3647,7 +3287,7 @@
},
{
"cell_type": "markdown",
- "id": "f46453c7",
+ "id": "abfadb01",
"metadata": {
"editable": true
},
@@ -3658,7 +3298,7 @@
},
{
"cell_type": "markdown",
- "id": "0255efb1",
+ "id": "b4d7950d",
"metadata": {
"editable": true
},
@@ -3678,7 +3318,7 @@
},
{
"cell_type": "markdown",
- "id": "61df6aad",
+ "id": "c6e946ea",
"metadata": {
"editable": true
},
@@ -3690,7 +3330,7 @@
},
{
"cell_type": "markdown",
- "id": "ac44e8fa",
+ "id": "485e3f93",
"metadata": {
"editable": true
},
@@ -3700,7 +3340,7 @@
},
{
"cell_type": "markdown",
- "id": "a73ed285",
+ "id": "8dd085df",
"metadata": {
"editable": true
},
@@ -3712,7 +3352,7 @@
},
{
"cell_type": "markdown",
- "id": "4809c104",
+ "id": "5e745921",
"metadata": {
"editable": true
},
@@ -3741,7 +3381,7 @@
},
{
"cell_type": "markdown",
- "id": "9ff4078a",
+ "id": "e123b112",
"metadata": {
"editable": true
},
@@ -3768,7 +3408,7 @@
},
{
"cell_type": "markdown",
- "id": "78a8b113",
+ "id": "8716fc03",
"metadata": {
"editable": true
},
@@ -3778,8 +3418,8 @@
},
{
"cell_type": "code",
- "execution_count": 26,
- "id": "47f6d805",
+ "execution_count": 15,
+ "id": "3b53ef76",
"metadata": {
"collapsed": false,
"editable": true
@@ -3819,7 +3459,7 @@
},
{
"cell_type": "markdown",
- "id": "5d841c14",
+ "id": "577ae352",
"metadata": {
"editable": true
},
@@ -3836,7 +3476,7 @@
},
{
"cell_type": "markdown",
- "id": "579b46a4",
+ "id": "052f1ae4",
"metadata": {
"editable": true
},
@@ -3859,7 +3499,7 @@
},
{
"cell_type": "markdown",
- "id": "1bb48e3c",
+ "id": "245d15c0",
"metadata": {
"editable": true
},
@@ -3873,7 +3513,7 @@
},
{
"cell_type": "markdown",
- "id": "a872fcf9",
+ "id": "b1b84021",
"metadata": {
"editable": true
},
@@ -3892,7 +3532,7 @@
},
{
"cell_type": "markdown",
- "id": "f0565ccd",
+ "id": "59677057",
"metadata": {
"editable": true
},
@@ -3902,7 +3542,7 @@
},
{
"cell_type": "markdown",
- "id": "a659e96f",
+ "id": "579a9b4c",
"metadata": {
"editable": true
},
@@ -3914,7 +3554,7 @@
},
{
"cell_type": "markdown",
- "id": "fcfcf6b0",
+ "id": "49fd275c",
"metadata": {
"editable": true
},
@@ -3928,7 +3568,7 @@
},
{
"cell_type": "markdown",
- "id": "ea39064c",
+ "id": "094a53e2",
"metadata": {
"editable": true
},
@@ -3940,7 +3580,7 @@
},
{
"cell_type": "markdown",
- "id": "0096e499",
+ "id": "c1fec661",
"metadata": {
"editable": true
},
@@ -3950,7 +3590,7 @@
},
{
"cell_type": "markdown",
- "id": "bf32dfa9",
+ "id": "a897fce4",
"metadata": {
"editable": true
},
@@ -3962,7 +3602,7 @@
},
{
"cell_type": "markdown",
- "id": "e0d6fee2",
+ "id": "cf091974",
"metadata": {
"editable": true
},
@@ -3979,7 +3619,7 @@
},
{
"cell_type": "markdown",
- "id": "0cb15d9d",
+ "id": "43eeed44",
"metadata": {
"editable": true
},
@@ -3989,7 +3629,7 @@
},
{
"cell_type": "markdown",
- "id": "754f4312",
+ "id": "6c94161a",
"metadata": {
"editable": true
},
@@ -4005,7 +3645,7 @@
},
{
"cell_type": "markdown",
- "id": "5bd1e9b0",
+ "id": "f2d6cec5",
"metadata": {
"editable": true
},
@@ -4015,7 +3655,7 @@
},
{
"cell_type": "markdown",
- "id": "2a839ac1",
+ "id": "3439cf2f",
"metadata": {
"editable": true
},
@@ -4031,7 +3671,7 @@
},
{
"cell_type": "markdown",
- "id": "69e34c64",
+ "id": "0c3d6910",
"metadata": {
"editable": true
},
@@ -4041,7 +3681,7 @@
},
{
"cell_type": "markdown",
- "id": "b32ae1de",
+ "id": "b3fe6cae",
"metadata": {
"editable": true
},
@@ -4057,7 +3697,7 @@
},
{
"cell_type": "markdown",
- "id": "00c3ff66",
+ "id": "52b64666",
"metadata": {
"editable": true
},
@@ -4067,7 +3707,7 @@
},
{
"cell_type": "markdown",
- "id": "92f1238d",
+ "id": "c016890a",
"metadata": {
"editable": true
},
@@ -4084,7 +3724,7 @@
},
{
"cell_type": "markdown",
- "id": "71f43637",
+ "id": "2589545c",
"metadata": {
"editable": true
},
@@ -4096,7 +3736,7 @@
},
{
"cell_type": "markdown",
- "id": "4bac0a15",
+ "id": "d74b662f",
"metadata": {
"editable": true
},
@@ -4108,7 +3748,7 @@
},
{
"cell_type": "markdown",
- "id": "b523b964",
+ "id": "79f18748",
"metadata": {
"editable": true
},
@@ -4120,7 +3760,7 @@
},
{
"cell_type": "markdown",
- "id": "3d7f8195",
+ "id": "c97ef564",
"metadata": {
"editable": true
},
@@ -4130,7 +3770,7 @@
},
{
"cell_type": "markdown",
- "id": "f308dd0a",
+ "id": "f2b64e40",
"metadata": {
"editable": true
},
@@ -4142,7 +3782,7 @@
},
{
"cell_type": "markdown",
- "id": "929784cf",
+ "id": "2780c653",
"metadata": {
"editable": true
},
@@ -4154,7 +3794,7 @@
},
{
"cell_type": "markdown",
- "id": "09dccee1",
+ "id": "42a104ce",
"metadata": {
"editable": true
},
@@ -4166,7 +3806,7 @@
},
{
"cell_type": "markdown",
- "id": "165b3f17",
+ "id": "665eee0d",
"metadata": {
"editable": true
},
@@ -4176,7 +3816,7 @@
},
{
"cell_type": "markdown",
- "id": "24a8dd50",
+ "id": "152a833c",
"metadata": {
"editable": true
},
@@ -4188,7 +3828,7 @@
},
{
"cell_type": "markdown",
- "id": "2597dc03",
+ "id": "af006756",
"metadata": {
"editable": true
},
@@ -4198,7 +3838,7 @@
},
{
"cell_type": "markdown",
- "id": "4d40ddce",
+ "id": "aa8a26d4",
"metadata": {
"editable": true
},
@@ -4210,7 +3850,7 @@
},
{
"cell_type": "markdown",
- "id": "41d0e0cb",
+ "id": "21f907f2",
"metadata": {
"editable": true
},
@@ -4226,7 +3866,7 @@
},
{
"cell_type": "markdown",
- "id": "e4bafe51",
+ "id": "39b264f4",
"metadata": {
"editable": true
},
@@ -4238,7 +3878,7 @@
},
{
"cell_type": "markdown",
- "id": "aab4d56f",
+ "id": "b77259ea",
"metadata": {
"editable": true
},
@@ -4250,7 +3890,7 @@
},
{
"cell_type": "markdown",
- "id": "861395ef",
+ "id": "dba49a93",
"metadata": {
"editable": true
},
@@ -4260,7 +3900,7 @@
},
{
"cell_type": "markdown",
- "id": "299b8198",
+ "id": "b51fa501",
"metadata": {
"editable": true
},
@@ -4272,7 +3912,7 @@
},
{
"cell_type": "markdown",
- "id": "2096c2e7",
+ "id": "8edb1494",
"metadata": {
"editable": true
},
@@ -4283,7 +3923,7 @@
},
{
"cell_type": "markdown",
- "id": "4ad3b043",
+ "id": "e9d9d5d3",
"metadata": {
"editable": true
},
@@ -4295,7 +3935,7 @@
},
{
"cell_type": "markdown",
- "id": "66bf91e3",
+ "id": "7c49927e",
"metadata": {
"editable": true
},
@@ -4305,7 +3945,7 @@
},
{
"cell_type": "markdown",
- "id": "95afc99c",
+ "id": "77eb9e2f",
"metadata": {
"editable": true
},
@@ -4317,7 +3957,7 @@
},
{
"cell_type": "markdown",
- "id": "73334115",
+ "id": "9a20a065",
"metadata": {
"editable": true
},
@@ -4327,7 +3967,7 @@
},
{
"cell_type": "markdown",
- "id": "fb6f936e",
+ "id": "f5ccfe0e",
"metadata": {
"editable": true
},
@@ -4339,7 +3979,7 @@
},
{
"cell_type": "markdown",
- "id": "f9093b47",
+ "id": "40447dce",
"metadata": {
"editable": true
},
@@ -4350,7 +3990,7 @@
},
{
"cell_type": "markdown",
- "id": "fe539ee1",
+ "id": "859c86b6",
"metadata": {
"editable": true
},
@@ -4362,7 +4002,7 @@
},
{
"cell_type": "markdown",
- "id": "d130c8c1",
+ "id": "72d9fdde",
"metadata": {
"editable": true
},
@@ -4380,7 +4020,7 @@
},
{
"cell_type": "markdown",
- "id": "6787b5c2",
+ "id": "4c69a499",
"metadata": {
"editable": true
},
@@ -4396,7 +4036,7 @@
},
{
"cell_type": "markdown",
- "id": "b2e599e5",
+ "id": "00f97350",
"metadata": {
"editable": true
},
@@ -4408,7 +4048,7 @@
},
{
"cell_type": "markdown",
- "id": "854ff040",
+ "id": "c71f00ef",
"metadata": {
"editable": true
},
@@ -4420,7 +4060,7 @@
},
{
"cell_type": "markdown",
- "id": "aaf5e54e",
+ "id": "35b4c0ce",
"metadata": {
"editable": true
},
@@ -4432,7 +4072,7 @@
},
{
"cell_type": "markdown",
- "id": "444a68be",
+ "id": "16757c16",
"metadata": {
"editable": true
},
@@ -4445,7 +4085,7 @@
},
{
"cell_type": "markdown",
- "id": "56e0f274",
+ "id": "ea15a5d1",
"metadata": {
"editable": true
},
@@ -4461,7 +4101,7 @@
},
{
"cell_type": "markdown",
- "id": "a55a54c3",
+ "id": "b658712b",
"metadata": {
"editable": true
},
@@ -4475,7 +4115,7 @@
},
{
"cell_type": "markdown",
- "id": "b614c964",
+ "id": "9e2de3bd",
"metadata": {
"editable": true
},
@@ -4485,7 +4125,7 @@
},
{
"cell_type": "markdown",
- "id": "624b1c18",
+ "id": "ac8eda2d",
"metadata": {
"editable": true
},
@@ -4497,7 +4137,7 @@
},
{
"cell_type": "markdown",
- "id": "63dc085a",
+ "id": "4dede760",
"metadata": {
"editable": true
},
@@ -4507,7 +4147,7 @@
},
{
"cell_type": "markdown",
- "id": "28db2f6a",
+ "id": "2fd5acb5",
"metadata": {
"editable": true
},
@@ -4519,7 +4159,7 @@
},
{
"cell_type": "markdown",
- "id": "a9f1ebdd",
+ "id": "e14ee8e6",
"metadata": {
"editable": true
},
@@ -4529,7 +4169,7 @@
},
{
"cell_type": "markdown",
- "id": "0b8bf07b",
+ "id": "8e51c303",
"metadata": {
"editable": true
},
@@ -4543,7 +4183,7 @@
},
{
"cell_type": "markdown",
- "id": "5f237448",
+ "id": "5399fb0c",
"metadata": {
"editable": true
},
@@ -4560,7 +4200,7 @@
},
{
"cell_type": "markdown",
- "id": "75b7044c",
+ "id": "a252f1ea",
"metadata": {
"editable": true
},
@@ -4576,7 +4216,7 @@
},
{
"cell_type": "markdown",
- "id": "51268862",
+ "id": "36f5c9dd",
"metadata": {
"editable": true
},
@@ -4588,7 +4228,7 @@
},
{
"cell_type": "markdown",
- "id": "608b9dff",
+ "id": "f2c3a15d",
"metadata": {
"editable": true
},
@@ -4601,7 +4241,7 @@
},
{
"cell_type": "markdown",
- "id": "b06c316f",
+ "id": "e1dc5ae3",
"metadata": {
"editable": true
},
@@ -4615,7 +4255,7 @@
},
{
"cell_type": "markdown",
- "id": "e82ba709",
+ "id": "18cba5ba",
"metadata": {
"editable": true
},
@@ -4625,7 +4265,7 @@
},
{
"cell_type": "markdown",
- "id": "92d739a1",
+ "id": "0611a8e9",
"metadata": {
"editable": true
},
@@ -4638,7 +4278,7 @@
},
{
"cell_type": "markdown",
- "id": "14ce5cea",
+ "id": "a4cc4815",
"metadata": {
"editable": true
},
@@ -4657,7 +4297,7 @@
},
{
"cell_type": "markdown",
- "id": "f7e1f2b1",
+ "id": "e9921c65",
"metadata": {
"editable": true
},
@@ -4669,7 +4309,7 @@
},
{
"cell_type": "markdown",
- "id": "71910404",
+ "id": "9d1540c2",
"metadata": {
"editable": true
},
@@ -4681,7 +4321,7 @@
},
{
"cell_type": "markdown",
- "id": "cbd60268",
+ "id": "277e8be4",
"metadata": {
"editable": true
},
@@ -4691,7 +4331,7 @@
},
{
"cell_type": "markdown",
- "id": "e6c94e3d",
+ "id": "c00cef73",
"metadata": {
"editable": true
},
@@ -4703,7 +4343,7 @@
},
{
"cell_type": "markdown",
- "id": "20cf812e",
+ "id": "3a7619df",
"metadata": {
"editable": true
},
@@ -4716,7 +4356,7 @@
},
{
"cell_type": "markdown",
- "id": "dd1cb8be",
+ "id": "357c8a98",
"metadata": {
"editable": true
},
@@ -4735,7 +4375,7 @@
},
{
"cell_type": "markdown",
- "id": "98a4e944",
+ "id": "ef8c1445",
"metadata": {
"editable": true
},
@@ -4745,7 +4385,7 @@
},
{
"cell_type": "markdown",
- "id": "8c6e3845",
+ "id": "3d542210",
"metadata": {
"editable": true
},
@@ -4764,7 +4404,7 @@
},
{
"cell_type": "markdown",
- "id": "bc13a77d",
+ "id": "93a12764",
"metadata": {
"editable": true
},
@@ -4782,7 +4422,7 @@
},
{
"cell_type": "markdown",
- "id": "19d6cd9e",
+ "id": "ab31ef4e",
"metadata": {
"editable": true
},
@@ -4796,7 +4436,7 @@
},
{
"cell_type": "markdown",
- "id": "c5c7eee1",
+ "id": "48d5864c",
"metadata": {
"editable": true
},
@@ -4810,8 +4450,8 @@
},
{
"cell_type": "code",
- "execution_count": 27,
- "id": "6ab6bcc3",
+ "execution_count": 16,
+ "id": "de29006a",
"metadata": {
"collapsed": false,
"editable": true
@@ -4832,7 +4472,7 @@
},
{
"cell_type": "markdown",
- "id": "839a512c",
+ "id": "b81e82a1",
"metadata": {
"editable": true
},
@@ -4848,8 +4488,8 @@
},
{
"cell_type": "code",
- "execution_count": 28,
- "id": "bad7396d",
+ "execution_count": 17,
+ "id": "59d716dc",
"metadata": {
"collapsed": false,
"editable": true
@@ -4881,7 +4521,7 @@
},
{
"cell_type": "markdown",
- "id": "365c6ef8",
+ "id": "7f3a4e9a",
"metadata": {
"editable": true
},
@@ -4895,7 +4535,7 @@
},
{
"cell_type": "markdown",
- "id": "6fd82fe9",
+ "id": "0be6217d",
"metadata": {
"editable": true
},
@@ -4907,8 +4547,8 @@
},
{
"cell_type": "code",
- "execution_count": 29,
- "id": "80ba738c",
+ "execution_count": 18,
+ "id": "c90c9bbd",
"metadata": {
"collapsed": false,
"editable": true
@@ -4933,7 +4573,7 @@
},
{
"cell_type": "markdown",
- "id": "4f390c8f",
+ "id": "23861648",
"metadata": {
"editable": true
},
@@ -4943,7 +4583,7 @@
},
{
"cell_type": "markdown",
- "id": "4bceabcb",
+ "id": "47a35083",
"metadata": {
"editable": true
},
@@ -4953,8 +4593,8 @@
},
{
"cell_type": "code",
- "execution_count": 30,
- "id": "0146e7c8",
+ "execution_count": 19,
+ "id": "7ac06d35",
"metadata": {
"collapsed": false,
"editable": true
@@ -5008,7 +4648,7 @@
},
{
"cell_type": "markdown",
- "id": "6e15d041",
+ "id": "1b096c22",
"metadata": {
"editable": true
},
@@ -5025,7 +4665,7 @@
},
{
"cell_type": "markdown",
- "id": "107d5b46",
+ "id": "df200389",
"metadata": {
"editable": true
},
@@ -5037,7 +4677,7 @@
},
{
"cell_type": "markdown",
- "id": "e47d0e76",
+ "id": "1d05f20f",
"metadata": {
"editable": true
},
@@ -5049,7 +4689,7 @@
},
{
"cell_type": "markdown",
- "id": "86b8daf6",
+ "id": "686f4de4",
"metadata": {
"editable": true
},
@@ -5059,7 +4699,7 @@
},
{
"cell_type": "markdown",
- "id": "934cc6c5",
+ "id": "5f1d2cf2",
"metadata": {
"editable": true
},
@@ -5076,7 +4716,7 @@
},
{
"cell_type": "markdown",
- "id": "2a384ee9",
+ "id": "c3af1edc",
"metadata": {
"editable": true
},
@@ -5086,7 +4726,7 @@
},
{
"cell_type": "markdown",
- "id": "e9a632a7",
+ "id": "16e4f2e4",
"metadata": {
"editable": true
},
@@ -5101,7 +4741,7 @@
},
{
"cell_type": "markdown",
- "id": "8cbf4cb8",
+ "id": "cfebd376",
"metadata": {
"editable": true
},
@@ -5111,7 +4751,7 @@
},
{
"cell_type": "markdown",
- "id": "b29a7909",
+ "id": "4e9bf897",
"metadata": {
"editable": true
},
@@ -5125,7 +4765,7 @@
},
{
"cell_type": "markdown",
- "id": "31b9c6a9",
+ "id": "a72e01ca",
"metadata": {
"editable": true
},
@@ -5137,7 +4777,7 @@
},
{
"cell_type": "markdown",
- "id": "cdc2f810",
+ "id": "8551cc9e",
"metadata": {
"editable": true
},
@@ -5149,7 +4789,7 @@
},
{
"cell_type": "markdown",
- "id": "0b7d368d",
+ "id": "2dc67193",
"metadata": {
"editable": true
},
@@ -5161,7 +4801,7 @@
},
{
"cell_type": "markdown",
- "id": "6d5ddd28",
+ "id": "7f9b2782",
"metadata": {
"editable": true
},
@@ -5171,7 +4811,7 @@
},
{
"cell_type": "markdown",
- "id": "a18622fc",
+ "id": "e7e4222d",
"metadata": {
"editable": true
},
@@ -5183,7 +4823,7 @@
},
{
"cell_type": "markdown",
- "id": "b5a8893c",
+ "id": "98a151ba",
"metadata": {
"editable": true
},
@@ -5193,7 +4833,7 @@
},
{
"cell_type": "markdown",
- "id": "50a0a62a",
+ "id": "30667b0e",
"metadata": {
"editable": true
},
@@ -5210,7 +4850,7 @@
},
{
"cell_type": "markdown",
- "id": "20380d89",
+ "id": "f72ff51e",
"metadata": {
"editable": true
},
@@ -5220,7 +4860,7 @@
},
{
"cell_type": "markdown",
- "id": "10805b50",
+ "id": "80b9b440",
"metadata": {
"editable": true
},
@@ -5232,7 +4872,7 @@
},
{
"cell_type": "markdown",
- "id": "b9c31a46",
+ "id": "0f19edd6",
"metadata": {
"editable": true
},
@@ -5242,7 +4882,7 @@
},
{
"cell_type": "markdown",
- "id": "1f48b48e",
+ "id": "e0f2758b",
"metadata": {
"editable": true
},
@@ -5254,7 +4894,7 @@
},
{
"cell_type": "markdown",
- "id": "ad8f7a8c",
+ "id": "3ba08a96",
"metadata": {
"editable": true
},
@@ -5268,7 +4908,7 @@
},
{
"cell_type": "markdown",
- "id": "9e0dec01",
+ "id": "b7271b81",
"metadata": {
"editable": true
},
@@ -5280,7 +4920,7 @@
},
{
"cell_type": "markdown",
- "id": "46fd0b6d",
+ "id": "56ad87f1",
"metadata": {
"editable": true
},
@@ -5302,7 +4942,7 @@
},
{
"cell_type": "markdown",
- "id": "3d2047ca",
+ "id": "d7c4dc29",
"metadata": {
"editable": true
},
@@ -5314,7 +4954,7 @@
},
{
"cell_type": "markdown",
- "id": "4a5f5016",
+ "id": "3209959e",
"metadata": {
"editable": true
},
@@ -5329,7 +4969,7 @@
},
{
"cell_type": "markdown",
- "id": "52651fc6",
+ "id": "8466bcf7",
"metadata": {
"editable": true
},
@@ -5341,7 +4981,7 @@
},
{
"cell_type": "markdown",
- "id": "fea09344",
+ "id": "a44c56d3",
"metadata": {
"editable": true
},
@@ -5353,7 +4993,7 @@
},
{
"cell_type": "markdown",
- "id": "bcfd303f",
+ "id": "0dc26201",
"metadata": {
"editable": true
},
@@ -5363,7 +5003,7 @@
},
{
"cell_type": "markdown",
- "id": "f684d942",
+ "id": "ed78f0e3",
"metadata": {
"editable": true
},
@@ -5375,7 +5015,7 @@
},
{
"cell_type": "markdown",
- "id": "1e54bd36",
+ "id": "3a072221",
"metadata": {
"editable": true
},
@@ -5385,7 +5025,7 @@
},
{
"cell_type": "markdown",
- "id": "4cdcdef2",
+ "id": "60baf463",
"metadata": {
"editable": true
},
@@ -5397,7 +5037,7 @@
},
{
"cell_type": "markdown",
- "id": "a6d5bd03",
+ "id": "60ff042d",
"metadata": {
"editable": true
},
@@ -5407,7 +5047,7 @@
},
{
"cell_type": "markdown",
- "id": "a4d9fc21",
+ "id": "1c31b285",
"metadata": {
"editable": true
},
@@ -5419,7 +5059,7 @@
},
{
"cell_type": "markdown",
- "id": "119bc56e",
+ "id": "4587edf9",
"metadata": {
"editable": true
},
@@ -5436,7 +5076,7 @@
},
{
"cell_type": "markdown",
- "id": "d15cad60",
+ "id": "3a423c6a",
"metadata": {
"editable": true
},
@@ -5449,7 +5089,7 @@
},
{
"cell_type": "markdown",
- "id": "f725d905",
+ "id": "d53b24a7",
"metadata": {
"editable": true
},
@@ -5461,7 +5101,7 @@
},
{
"cell_type": "markdown",
- "id": "a2a5b25f",
+ "id": "9d589cad",
"metadata": {
"editable": true
},
@@ -5471,7 +5111,7 @@
},
{
"cell_type": "markdown",
- "id": "a9f43162",
+ "id": "f6e8bb3f",
"metadata": {
"editable": true
},
@@ -5484,7 +5124,7 @@
},
{
"cell_type": "markdown",
- "id": "debb0a19",
+ "id": "c01d5a5e",
"metadata": {
"editable": true
},
@@ -5494,7 +5134,7 @@
},
{
"cell_type": "markdown",
- "id": "2764c014",
+ "id": "46e5562b",
"metadata": {
"editable": true
},
@@ -5506,7 +5146,7 @@
},
{
"cell_type": "markdown",
- "id": "ad141726",
+ "id": "44d5398b",
"metadata": {
"editable": true
},
@@ -5519,7 +5159,7 @@
},
{
"cell_type": "markdown",
- "id": "d194482f",
+ "id": "addf0d49",
"metadata": {
"editable": true
},
@@ -5532,7 +5172,7 @@
},
{
"cell_type": "markdown",
- "id": "7ccf56c7",
+ "id": "fdb87f8d",
"metadata": {
"editable": true
},
@@ -5544,7 +5184,7 @@
},
{
"cell_type": "markdown",
- "id": "41939010",
+ "id": "69d507e7",
"metadata": {
"editable": true
},
@@ -5556,7 +5196,7 @@
},
{
"cell_type": "markdown",
- "id": "93d38078",
+ "id": "a4b61630",
"metadata": {
"editable": true
},
@@ -5566,7 +5206,7 @@
},
{
"cell_type": "markdown",
- "id": "9c6d063a",
+ "id": "c82b13a0",
"metadata": {
"editable": true
},
@@ -5579,7 +5219,7 @@
},
{
"cell_type": "markdown",
- "id": "90d9a525",
+ "id": "9d225ea8",
"metadata": {
"editable": true
},
@@ -5591,7 +5231,7 @@
},
{
"cell_type": "markdown",
- "id": "d1c9d3ea",
+ "id": "293d144e",
"metadata": {
"editable": true
},
@@ -5603,7 +5243,7 @@
},
{
"cell_type": "markdown",
- "id": "6a03fd03",
+ "id": "2ba90687",
"metadata": {
"editable": true
},
@@ -5615,7 +5255,7 @@
},
{
"cell_type": "markdown",
- "id": "12f9e2f4",
+ "id": "71b67ece",
"metadata": {
"editable": true
},
@@ -5627,7 +5267,7 @@
},
{
"cell_type": "markdown",
- "id": "0bd449c0",
+ "id": "848de99f",
"metadata": {
"editable": true
},
@@ -5641,7 +5281,7 @@
},
{
"cell_type": "markdown",
- "id": "528f4c54",
+ "id": "229ab3bb",
"metadata": {
"editable": true
},
@@ -5653,7 +5293,7 @@
},
{
"cell_type": "markdown",
- "id": "a4e89b45",
+ "id": "fafe6f12",
"metadata": {
"editable": true
},
@@ -5663,7 +5303,7 @@
},
{
"cell_type": "markdown",
- "id": "af51b23c",
+ "id": "075b9702",
"metadata": {
"editable": true
},
@@ -5675,7 +5315,7 @@
},
{
"cell_type": "markdown",
- "id": "26945717",
+ "id": "4e8ad796",
"metadata": {
"editable": true
},
@@ -5687,7 +5327,7 @@
},
{
"cell_type": "markdown",
- "id": "70a85186",
+ "id": "070bea88",
"metadata": {
"editable": true
},
@@ -5699,7 +5339,7 @@
},
{
"cell_type": "markdown",
- "id": "86de1af1",
+ "id": "cbb1a6d0",
"metadata": {
"editable": true
},
@@ -5711,7 +5351,7 @@
},
{
"cell_type": "markdown",
- "id": "a7eaaac6",
+ "id": "62ea95e8",
"metadata": {
"editable": true
},
@@ -5723,7 +5363,7 @@
},
{
"cell_type": "markdown",
- "id": "732d4020",
+ "id": "1d0a0c3f",
"metadata": {
"editable": true
},
@@ -5742,7 +5382,7 @@
},
{
"cell_type": "markdown",
- "id": "06f71f9c",
+ "id": "502bf9b1",
"metadata": {
"editable": true
},
@@ -5754,7 +5394,7 @@
},
{
"cell_type": "markdown",
- "id": "04266404",
+ "id": "b98b3e29",
"metadata": {
"editable": true
},
@@ -5764,7 +5404,7 @@
},
{
"cell_type": "markdown",
- "id": "753d4bf0",
+ "id": "9afa64c1",
"metadata": {
"editable": true
},
@@ -5776,7 +5416,7 @@
},
{
"cell_type": "markdown",
- "id": "ea8b1f8f",
+ "id": "756fc3c6",
"metadata": {
"editable": true
},
@@ -5786,7 +5426,7 @@
},
{
"cell_type": "markdown",
- "id": "12703a7e",
+ "id": "9faf05fa",
"metadata": {
"editable": true
},
@@ -5798,7 +5438,7 @@
},
{
"cell_type": "markdown",
- "id": "90522189",
+ "id": "36e62812",
"metadata": {
"editable": true
},
@@ -5810,7 +5450,7 @@
},
{
"cell_type": "markdown",
- "id": "b81abc7b",
+ "id": "dee00fc3",
"metadata": {
"editable": true
},
@@ -5826,7 +5466,7 @@
},
{
"cell_type": "markdown",
- "id": "115018b1",
+ "id": "1287f83a",
"metadata": {
"editable": true
},
@@ -5838,7 +5478,7 @@
},
{
"cell_type": "markdown",
- "id": "8741b7a9",
+ "id": "b4240a7b",
"metadata": {
"editable": true
},
@@ -5850,7 +5490,7 @@
},
{
"cell_type": "markdown",
- "id": "5fe75d98",
+ "id": "fd444925",
"metadata": {
"editable": true
},
@@ -5860,7 +5500,7 @@
},
{
"cell_type": "markdown",
- "id": "522e6278",
+ "id": "5b055ab3",
"metadata": {
"editable": true
},
@@ -5872,7 +5512,7 @@
},
{
"cell_type": "markdown",
- "id": "eaa39cca",
+ "id": "bc539215",
"metadata": {
"editable": true
},
@@ -5882,7 +5522,7 @@
},
{
"cell_type": "markdown",
- "id": "230a8059",
+ "id": "5a4af335",
"metadata": {
"editable": true
},
@@ -5894,7 +5534,7 @@
},
{
"cell_type": "markdown",
- "id": "698a93f7",
+ "id": "94a4c6dc",
"metadata": {
"editable": true
},
@@ -5911,7 +5551,7 @@
},
{
"cell_type": "markdown",
- "id": "96e49fbc",
+ "id": "6cef8bfb",
"metadata": {
"editable": true
},
@@ -5923,7 +5563,7 @@
},
{
"cell_type": "markdown",
- "id": "f2043d81",
+ "id": "5f04ae7d",
"metadata": {
"editable": true
},
@@ -5935,7 +5575,7 @@
},
{
"cell_type": "markdown",
- "id": "f2dd8e44",
+ "id": "35418e34",
"metadata": {
"editable": true
},
@@ -5945,7 +5585,7 @@
},
{
"cell_type": "markdown",
- "id": "0ab90bb2",
+ "id": "df4a83ee",
"metadata": {
"editable": true
},
@@ -5957,7 +5597,7 @@
},
{
"cell_type": "markdown",
- "id": "1090467c",
+ "id": "43751ced",
"metadata": {
"editable": true
},
@@ -5967,7 +5607,7 @@
},
{
"cell_type": "markdown",
- "id": "8bc71963",
+ "id": "4a030f43",
"metadata": {
"editable": true
},
@@ -5979,7 +5619,7 @@
},
{
"cell_type": "markdown",
- "id": "918da4ad",
+ "id": "9e27747e",
"metadata": {
"editable": true
},
@@ -5989,7 +5629,7 @@
},
{
"cell_type": "markdown",
- "id": "ee673e3d",
+ "id": "be4c8f46",
"metadata": {
"editable": true
},
@@ -6001,7 +5641,7 @@
},
{
"cell_type": "markdown",
- "id": "03352030",
+ "id": "7da22e7f",
"metadata": {
"editable": true
},
@@ -6011,7 +5651,7 @@
},
{
"cell_type": "markdown",
- "id": "1b29a63e",
+ "id": "9c059120",
"metadata": {
"editable": true
},
@@ -6023,7 +5663,7 @@
},
{
"cell_type": "markdown",
- "id": "206bcec2",
+ "id": "aa7c7a38",
"metadata": {
"editable": true
},
diff --git a/doc/LectureNotes/_build/html/exercisesweek34.html b/doc/LectureNotes/_build/html/exercisesweek34.html
index d574ae7a5..122458e60 100644
--- a/doc/LectureNotes/_build/html/exercisesweek34.html
+++ b/doc/LectureNotes/_build/html/exercisesweek34.html
@@ -480,22 +480,12 @@ license.
The following simple Python instructions define our \(x\) and \(y\) values (with 100 data points).
+
+
0.10790125813226321
+4.340071371496255
+[[ 1.04193203 3.08165104]
+ [ 3.08165104 10.18383522]]
+
+
+
@@ -3658,6 +3413,14 @@ a more brute force way. Here we scale the mean values for each column of the des
+
+
0.08881497884574564
+1.7086067479626619
+[[1. 0.66080313]
+ [0.66080313 1. ]]
+
+
+
We see that the matrix elements along the diagonal are one as they
should be and that the matrix is symmetric. Furthermore, diagonalizing
@@ -3686,6 +3449,34 @@ this matrix we easily see that it is a positive definite matrix.
+
+
[[-0.40620066 -2.01265755]
+ [ 0.01458611 0.37737221]
+ [-1.0895387 -3.65442354]
+ [ 0.2338675 1.12044974]
+ [ 0.4676059 1.54393936]
+ [-0.65891389 -3.16304863]
+ [-0.1715252 0.39197698]
+ [ 0.71142161 2.95511792]
+ [ 0.39214397 0.13069442]
+ [ 0.50655336 2.3105791 ]]
+ 0 1
+0 -0.406201 -2.012658
+1 0.014586 0.377372
+2 -1.089539 -3.654424
+3 0.233868 1.120450
+4 0.467606 1.543939
+5 -0.658914 -3.163049
+6 -0.171525 0.391977
+7 0.711422 2.955118
+8 0.392144 0.130694
+9 0.506553 2.310579
+ 0 1
+0 1.000000 0.952387
+1 0.952387 1.000000
+
+
+
We expand this model to the Franke function discussed above.
@@ -3739,6 +3530,43 @@ this matrix we easily see that it is a positive definite matrix.
+
+
0 1 2 3 4 5 6 7 \
+0 0.0 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000
+1 0.0 0.078974 0.081276 0.075889 0.077168 0.078540 0.065410 0.066474
+2 0.0 0.081276 0.084076 0.078336 0.079946 0.081655 0.067707 0.069028
+3 0.0 0.075889 0.078336 0.077460 0.078986 0.080616 0.069452 0.070737
+4 0.0 0.077168 0.079946 0.078986 0.080764 0.082653 0.070986 0.072476
+5 0.0 0.078540 0.081655 0.080616 0.082653 0.084809 0.072621 0.074323
+6 0.0 0.065410 0.067707 0.069452 0.070986 0.072621 0.064074 0.065378
+7 0.0 0.066474 0.069028 0.070737 0.072476 0.074323 0.065378 0.066854
+8 0.0 0.067637 0.070457 0.072132 0.074084 0.076150 0.066787 0.068441
+9 0.0 0.068906 0.072000 0.073644 0.075816 0.078110 0.068307 0.070146
+10 0.0 0.055734 0.057835 0.060872 0.062337 0.063894 0.057393 0.058645
+11 0.0 0.056683 0.058996 0.062016 0.063653 0.065390 0.058552 0.059951
+12 0.0 0.057722 0.060254 0.063260 0.065077 0.066999 0.059807 0.061359
+13 0.0 0.058854 0.061614 0.064609 0.066612 0.068727 0.061163 0.062874
+14 0.0 0.060083 0.063080 0.066066 0.068264 0.070582 0.062624 0.064501
+
+ 8 9 10 11 12 13 14
+0 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000
+1 0.067637 0.068906 0.055734 0.056683 0.057722 0.058854 0.060083
+2 0.070457 0.072000 0.057835 0.058996 0.060254 0.061614 0.063080
+3 0.072132 0.073644 0.060872 0.062016 0.063260 0.064609 0.066066
+4 0.074084 0.075816 0.062337 0.063653 0.065077 0.066612 0.068264
+5 0.076150 0.078110 0.063894 0.065390 0.066999 0.068727 0.070582
+6 0.066787 0.068307 0.057393 0.058552 0.059807 0.061163 0.062624
+7 0.068441 0.070146 0.058645 0.059951 0.061359 0.062874 0.064501
+8 0.070213 0.072111 0.059993 0.061452 0.063019 0.064699 0.066500
+9 0.072111 0.074210 0.061443 0.063061 0.064793 0.066647 0.068629
+10 0.059993 0.061443 0.052305 0.053417 0.054617 0.055910 0.057300
+11 0.061452 0.063061 0.053417 0.054655 0.055987 0.057418 0.058952
+12 0.063019 0.064793 0.054617 0.055987 0.057457 0.059031 0.060716
+13 0.064699 0.066647 0.055910 0.057418 0.059031 0.060756 0.062599
+14 0.066500 0.068629 0.057300 0.058952 0.060716 0.062599 0.064606
+
+
+
We note here that the covariance is zero for the first rows and
columns since all matrix elements in the design matrix were set to one
diff --git a/doc/LectureNotes/_build/jupyter_execute/exercisesweek34.ipynb b/doc/LectureNotes/_build/jupyter_execute/exercisesweek34.ipynb
index a70430253..cdf78568e 100644
--- a/doc/LectureNotes/_build/jupyter_execute/exercisesweek34.ipynb
+++ b/doc/LectureNotes/_build/jupyter_execute/exercisesweek34.ipynb
@@ -2,7 +2,7 @@
"cells": [
{
"cell_type": "markdown",
- "id": "72dc0997",
+ "id": "a50ea987",
"metadata": {
"editable": true
},
@@ -14,7 +14,7 @@
},
{
"cell_type": "markdown",
- "id": "8c591125",
+ "id": "291e6015",
"metadata": {
"editable": true
},
@@ -27,7 +27,7 @@
},
{
"cell_type": "markdown",
- "id": "1ad21876",
+ "id": "141ff111",
"metadata": {
"editable": true
},
@@ -39,7 +39,7 @@
},
{
"cell_type": "markdown",
- "id": "4eaa91e2",
+ "id": "32a1fc9e",
"metadata": {
"editable": true
},
@@ -108,7 +108,7 @@
},
{
"cell_type": "markdown",
- "id": "360adb56",
+ "id": "f103f4c1",
"metadata": {
"editable": true
},
@@ -122,32 +122,21 @@
{
"cell_type": "code",
"execution_count": 1,
- "id": "278aa34f",
+ "id": "81c11edc",
"metadata": {
"collapsed": false,
"editable": true
},
- "outputs": [
- {
- "ename": "NameError",
- "evalue": "name 'np' is not defined",
- "output_type": "error",
- "traceback": [
- "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
- "\u001b[0;31mNameError\u001b[0m Traceback (most recent call last)",
- "Cell \u001b[0;32mIn[1], line 1\u001b[0m\n\u001b[0;32m----> 1\u001b[0m x \u001b[38;5;241m=\u001b[39m \u001b[43mnp\u001b[49m\u001b[38;5;241m.\u001b[39mrandom\u001b[38;5;241m.\u001b[39mrand(\u001b[38;5;241m100\u001b[39m,\u001b[38;5;241m1\u001b[39m)\n\u001b[1;32m 2\u001b[0m y \u001b[38;5;241m=\u001b[39m \u001b[38;5;241m2.0\u001b[39m\u001b[38;5;241m+\u001b[39m\u001b[38;5;241m5\u001b[39m\u001b[38;5;241m*\u001b[39mx\u001b[38;5;241m*\u001b[39mx\u001b[38;5;241m+\u001b[39m\u001b[38;5;241m0.1\u001b[39m\u001b[38;5;241m*\u001b[39mnp\u001b[38;5;241m.\u001b[39mrandom\u001b[38;5;241m.\u001b[39mrandn(\u001b[38;5;241m100\u001b[39m,\u001b[38;5;241m1\u001b[39m)\n",
- "\u001b[0;31mNameError\u001b[0m: name 'np' is not defined"
- ]
- }
- ],
+ "outputs": [],
"source": [
+ "import numpy as np\n",
"x = np.random.rand(100,1)\n",
"y = 2.0+5*x*x+0.1*np.random.randn(100,1)"
]
},
{
"cell_type": "markdown",
- "id": "1ff20e45",
+ "id": "970bd604",
"metadata": {
"editable": true
},
@@ -161,7 +150,7 @@
},
{
"cell_type": "markdown",
- "id": "e8809de1",
+ "id": "bda3ed04",
"metadata": {
"editable": true
},
@@ -174,7 +163,7 @@
},
{
"cell_type": "markdown",
- "id": "8c9e5277",
+ "id": "ca995691",
"metadata": {
"editable": true
},
@@ -185,7 +174,7 @@
},
{
"cell_type": "markdown",
- "id": "85a5881c",
+ "id": "27cbfeed",
"metadata": {
"editable": true
},
@@ -197,7 +186,7 @@
},
{
"cell_type": "markdown",
- "id": "4fb35d0d",
+ "id": "9e063f6d",
"metadata": {
"editable": true
},
@@ -207,7 +196,7 @@
},
{
"cell_type": "markdown",
- "id": "608f9780",
+ "id": "e582c2bb",
"metadata": {
"editable": true
},
@@ -219,7 +208,7 @@
},
{
"cell_type": "markdown",
- "id": "014bbc09",
+ "id": "59e0ed7a",
"metadata": {
"editable": true
},
@@ -230,7 +219,7 @@
},
{
"cell_type": "markdown",
- "id": "f28863ad",
+ "id": "051e71aa",
"metadata": {
"editable": true
},
@@ -249,7 +238,7 @@
{
"cell_type": "code",
"execution_count": 2,
- "id": "85f75a99",
+ "id": "c82d8b64",
"metadata": {
"collapsed": false,
"editable": true
@@ -265,7 +254,7 @@
},
{
"cell_type": "markdown",
- "id": "bee8d814",
+ "id": "3e810bba",
"metadata": {
"editable": true
},
@@ -275,7 +264,7 @@
},
{
"cell_type": "markdown",
- "id": "7c94f8bd",
+ "id": "c1198fce",
"metadata": {
"editable": true
},
@@ -286,7 +275,7 @@
},
{
"cell_type": "markdown",
- "id": "c0e789dd",
+ "id": "1b0cea0a",
"metadata": {
"editable": true
},
@@ -298,7 +287,7 @@
},
{
"cell_type": "markdown",
- "id": "5ee1d70e",
+ "id": "5194ba08",
"metadata": {
"editable": true
},
diff --git a/doc/LectureNotes/_build/jupyter_execute/exercisesweek34.py b/doc/LectureNotes/_build/jupyter_execute/exercisesweek34.py
index 088a52f36..6b944b9d6 100644
--- a/doc/LectureNotes/_build/jupyter_execute/exercisesweek34.py
+++ b/doc/LectureNotes/_build/jupyter_execute/exercisesweek34.py
@@ -83,6 +83,7 @@
# In[1]:
+import numpy as np
x = np.random.rand(100,1)
y = 2.0+5*x*x+0.1*np.random.randn(100,1)
diff --git a/doc/LectureNotes/_build/jupyter_execute/week35.ipynb b/doc/LectureNotes/_build/jupyter_execute/week35.ipynb
index 9a9f8529f..22fc6c63c 100644
--- a/doc/LectureNotes/_build/jupyter_execute/week35.ipynb
+++ b/doc/LectureNotes/_build/jupyter_execute/week35.ipynb
@@ -2,7 +2,7 @@
"cells": [
{
"cell_type": "markdown",
- "id": "ea977b24",
+ "id": "0e8171d8",
"metadata": {
"editable": true
},
@@ -14,20 +14,20 @@
},
{
"cell_type": "markdown",
- "id": "a247218b",
+ "id": "d54fb4b6",
"metadata": {
"editable": true
},
"source": [
"# Week 35: From Ordinary Linear Regression to Ridge and Lasso Regression\n",
- "**Morten Hjorth-Jensen**, Department of Physics, University of Oslo and Department of Physics and Astronomy and National Superconducting Cyclotron Laboratory, Michigan State University\n",
+ "**Morten Hjorth-Jensen**, Department of Physics, University of Oslo\n",
"\n",
- "Date: **August 26-30**"
+ "Date: **August 26-30, 2024**"
]
},
{
"cell_type": "markdown",
- "id": "f234b76d",
+ "id": "359ef523",
"metadata": {
"editable": true
},
@@ -38,7 +38,7 @@
"\n",
"1. Brief repetition from last week\n",
"\n",
- "2. Derivation of the equations for ordinary least squares\n",
+ "2. Discussions of the equations for ordinary least squares\n",
"\n",
"3. Discussion on how to prepare data and examples of applications of linear regression\n",
"\n",
@@ -49,26 +49,30 @@
},
{
"cell_type": "markdown",
- "id": "86d0671f",
+ "id": "76ab9350",
"metadata": {
"editable": true
},
"source": [
"### Reading recommendations:\n",
"\n",
- "1. See lecture notes for week 35 at \n",
+ "1. These lecture notes\n",
"\n",
- "2. Goodfellow, Bengio and Courville, Deep Learning, chapter 2 on linear algebra and sections 3.1-3.10 on elements of statistics (background)"
+ "2. Goodfellow, Bengio and Courville, Deep Learning, chapter 2 on linear algebra and sections 3.1-3.10 on elements of statistics (background)\n",
+ "\n",
+ "3. Raschka et al on preprocessing of data, relevant for exercise 3 this week, see chapter 4.\n",
+ "\n",
+ "4. For exercise 1 of week 35, the book by A. Aldo Faisal, Cheng Soon Ong, and Marc Peter Deisenroth on the Mathematics of Machine Learning, may be very relevant. In particular chapter 5 at URL\"https://mml-book.github.io/\" (section 5.5 on derivatives) is very useful for exercise 1 this coming week."
]
},
{
"cell_type": "markdown",
- "id": "0b0bc0ec",
+ "id": "231f16d6",
"metadata": {
"editable": true
},
"source": [
- "## Why Linear Regression (aka Ordinary Least Squares and family), repeat from last week\n",
+ "## For exercise sessions: Why Linear Regression (aka Ordinary Least Squares and family), repeat from last week\n",
"\n",
"We need first a reminder from last week about linear regression. \n",
"\n",
@@ -97,7 +101,7 @@
},
{
"cell_type": "markdown",
- "id": "c30cfd06",
+ "id": "a163dea4",
"metadata": {
"editable": true
},
@@ -113,7 +117,7 @@
},
{
"cell_type": "markdown",
- "id": "59d6452b",
+ "id": "e30d7141",
"metadata": {
"editable": true
},
@@ -125,7 +129,7 @@
},
{
"cell_type": "markdown",
- "id": "8649d84d",
+ "id": "1e391e10",
"metadata": {
"editable": true
},
@@ -135,7 +139,7 @@
},
{
"cell_type": "markdown",
- "id": "aaa65f06",
+ "id": "440e1f2a",
"metadata": {
"editable": true
},
@@ -147,7 +151,7 @@
},
{
"cell_type": "markdown",
- "id": "cc43802e",
+ "id": "4f920c69",
"metadata": {
"editable": true
},
@@ -168,7 +172,7 @@
},
{
"cell_type": "markdown",
- "id": "53877600",
+ "id": "179c4cba",
"metadata": {
"editable": true
},
@@ -180,7 +184,7 @@
},
{
"cell_type": "markdown",
- "id": "bc4478fc",
+ "id": "82d6dd48",
"metadata": {
"editable": true
},
@@ -193,7 +197,7 @@
},
{
"cell_type": "markdown",
- "id": "64bc2ac2",
+ "id": "fb67db20",
"metadata": {
"editable": true
},
@@ -205,7 +209,7 @@
},
{
"cell_type": "markdown",
- "id": "d7b7d1d1",
+ "id": "406fe296",
"metadata": {
"editable": true
},
@@ -217,7 +221,7 @@
},
{
"cell_type": "markdown",
- "id": "f34563f6",
+ "id": "7ca59383",
"metadata": {
"editable": true
},
@@ -227,7 +231,7 @@
},
{
"cell_type": "markdown",
- "id": "1dbad69a",
+ "id": "59b8cb83",
"metadata": {
"editable": true
},
@@ -239,7 +243,7 @@
},
{
"cell_type": "markdown",
- "id": "2a16de00",
+ "id": "5e10e269",
"metadata": {
"editable": true
},
@@ -252,7 +256,7 @@
},
{
"cell_type": "markdown",
- "id": "07115e56",
+ "id": "c8f4a461",
"metadata": {
"editable": true
},
@@ -264,7 +268,7 @@
},
{
"cell_type": "markdown",
- "id": "b90655a4",
+ "id": "8299a747",
"metadata": {
"editable": true
},
@@ -274,7 +278,7 @@
},
{
"cell_type": "markdown",
- "id": "2ac208f1",
+ "id": "e3adcb3e",
"metadata": {
"editable": true
},
@@ -286,7 +290,7 @@
},
{
"cell_type": "markdown",
- "id": "a8197640",
+ "id": "a48bfab5",
"metadata": {
"editable": true
},
@@ -298,7 +302,7 @@
},
{
"cell_type": "markdown",
- "id": "7c72baae",
+ "id": "87754669",
"metadata": {
"editable": true
},
@@ -309,7 +313,7 @@
},
{
"cell_type": "markdown",
- "id": "3c595093",
+ "id": "c4980f00",
"metadata": {
"editable": true
},
@@ -321,7 +325,7 @@
},
{
"cell_type": "markdown",
- "id": "4dab1f87",
+ "id": "1a1adcd3",
"metadata": {
"editable": true
},
@@ -340,7 +344,7 @@
},
{
"cell_type": "markdown",
- "id": "2a85bd46",
+ "id": "8d4dd262",
"metadata": {
"editable": true
},
@@ -353,7 +357,7 @@
},
{
"cell_type": "markdown",
- "id": "5500dd61",
+ "id": "2215a906",
"metadata": {
"editable": true
},
@@ -363,7 +367,7 @@
},
{
"cell_type": "markdown",
- "id": "0072db82",
+ "id": "d293ee98",
"metadata": {
"editable": true
},
@@ -375,7 +379,7 @@
},
{
"cell_type": "markdown",
- "id": "078ec23d",
+ "id": "cc42ead9",
"metadata": {
"editable": true
},
@@ -385,7 +389,7 @@
},
{
"cell_type": "markdown",
- "id": "cc1760bc",
+ "id": "fb13cd8b",
"metadata": {
"editable": true
},
@@ -397,7 +401,7 @@
},
{
"cell_type": "markdown",
- "id": "73d00905",
+ "id": "fc02a912",
"metadata": {
"editable": true
},
@@ -407,7 +411,7 @@
},
{
"cell_type": "markdown",
- "id": "50dff40b",
+ "id": "82afab7b",
"metadata": {
"editable": true
},
@@ -419,7 +423,7 @@
},
{
"cell_type": "markdown",
- "id": "622bf5f5",
+ "id": "843ade9a",
"metadata": {
"editable": true
},
@@ -430,7 +434,7 @@
},
{
"cell_type": "markdown",
- "id": "48bfcf85",
+ "id": "e955afa1",
"metadata": {
"editable": true
},
@@ -442,7 +446,7 @@
},
{
"cell_type": "markdown",
- "id": "07c395fe",
+ "id": "61e860cd",
"metadata": {
"editable": true
},
@@ -452,7 +456,7 @@
},
{
"cell_type": "markdown",
- "id": "d3ccdcb0",
+ "id": "93d2b6e6",
"metadata": {
"editable": true
},
@@ -464,7 +468,7 @@
},
{
"cell_type": "markdown",
- "id": "c1ef9741",
+ "id": "adfd7e62",
"metadata": {
"editable": true
},
@@ -474,7 +478,7 @@
},
{
"cell_type": "markdown",
- "id": "1646a521",
+ "id": "1663846c",
"metadata": {
"editable": true
},
@@ -486,7 +490,7 @@
},
{
"cell_type": "markdown",
- "id": "daa11d84",
+ "id": "12dd4571",
"metadata": {
"editable": true
},
@@ -506,7 +510,7 @@
},
{
"cell_type": "markdown",
- "id": "78b271ce",
+ "id": "57f81768",
"metadata": {
"editable": true
},
@@ -533,7 +537,7 @@
},
{
"cell_type": "markdown",
- "id": "9482d4e6",
+ "id": "7f129030",
"metadata": {
"editable": true
},
@@ -545,7 +549,7 @@
},
{
"cell_type": "markdown",
- "id": "c7787334",
+ "id": "6c35b0ba",
"metadata": {
"editable": true
},
@@ -557,7 +561,7 @@
},
{
"cell_type": "markdown",
- "id": "a7c6c6e4",
+ "id": "162c4ffd",
"metadata": {
"editable": true
},
@@ -573,7 +577,7 @@
},
{
"cell_type": "markdown",
- "id": "dc9f4b6f",
+ "id": "84eee206",
"metadata": {
"editable": true
},
@@ -591,7 +595,7 @@
},
{
"cell_type": "markdown",
- "id": "dbb092e9",
+ "id": "832f9fc3",
"metadata": {
"editable": true
},
@@ -603,7 +607,7 @@
},
{
"cell_type": "markdown",
- "id": "47f695d0",
+ "id": "43a78640",
"metadata": {
"editable": true
},
@@ -615,7 +619,7 @@
},
{
"cell_type": "markdown",
- "id": "6ff6f849",
+ "id": "7fbfd556",
"metadata": {
"editable": true
},
@@ -626,7 +630,7 @@
},
{
"cell_type": "markdown",
- "id": "3fab9d8e",
+ "id": "f0b01c52",
"metadata": {
"editable": true
},
@@ -638,7 +642,7 @@
},
{
"cell_type": "markdown",
- "id": "230d417b",
+ "id": "fb5c1bd7",
"metadata": {
"editable": true
},
@@ -648,7 +652,7 @@
},
{
"cell_type": "markdown",
- "id": "ae3eea03",
+ "id": "9a0a695d",
"metadata": {
"editable": true
},
@@ -660,7 +664,7 @@
},
{
"cell_type": "markdown",
- "id": "97d7d08a",
+ "id": "87e15057",
"metadata": {
"editable": true
},
@@ -674,7 +678,7 @@
},
{
"cell_type": "markdown",
- "id": "dbcabc11",
+ "id": "fca1498a",
"metadata": {
"editable": true
},
@@ -686,7 +690,7 @@
},
{
"cell_type": "markdown",
- "id": "7278dcbd",
+ "id": "b8c63be2",
"metadata": {
"editable": true
},
@@ -698,7 +702,7 @@
},
{
"cell_type": "markdown",
- "id": "c16d222a",
+ "id": "2ddd0ffc",
"metadata": {
"editable": true
},
@@ -710,7 +714,7 @@
},
{
"cell_type": "markdown",
- "id": "0d85444e",
+ "id": "509d2ab6",
"metadata": {
"editable": true
},
@@ -720,7 +724,7 @@
},
{
"cell_type": "markdown",
- "id": "4d26bab6",
+ "id": "bb492979",
"metadata": {
"editable": true
},
@@ -732,7 +736,7 @@
},
{
"cell_type": "markdown",
- "id": "b6d57fdf",
+ "id": "ca02a149",
"metadata": {
"editable": true
},
@@ -744,7 +748,7 @@
},
{
"cell_type": "markdown",
- "id": "7a78e5dc",
+ "id": "782c5c3d",
"metadata": {
"editable": true
},
@@ -756,7 +760,7 @@
},
{
"cell_type": "markdown",
- "id": "6231367b",
+ "id": "749d69a8",
"metadata": {
"editable": true
},
@@ -770,7 +774,7 @@
},
{
"cell_type": "markdown",
- "id": "ab068594",
+ "id": "e2910da5",
"metadata": {
"editable": true
},
@@ -782,7 +786,7 @@
},
{
"cell_type": "markdown",
- "id": "07d2f06b",
+ "id": "effa9035",
"metadata": {
"editable": true
},
@@ -794,7 +798,7 @@
},
{
"cell_type": "markdown",
- "id": "d2382139",
+ "id": "89e33e6e",
"metadata": {
"editable": true
},
@@ -806,7 +810,7 @@
},
{
"cell_type": "markdown",
- "id": "7d063f00",
+ "id": "5a0e8a3b",
"metadata": {
"editable": true
},
@@ -816,7 +820,7 @@
},
{
"cell_type": "markdown",
- "id": "5e119075",
+ "id": "12119d38",
"metadata": {
"editable": true
},
@@ -828,7 +832,7 @@
},
{
"cell_type": "markdown",
- "id": "700eaedb",
+ "id": "b8e2462f",
"metadata": {
"editable": true
},
@@ -838,7 +842,7 @@
},
{
"cell_type": "markdown",
- "id": "51e05fca",
+ "id": "ba9fdb35",
"metadata": {
"editable": true
},
@@ -850,7 +854,7 @@
},
{
"cell_type": "markdown",
- "id": "bba7f463",
+ "id": "ac7406a7",
"metadata": {
"editable": true
},
@@ -860,7 +864,7 @@
},
{
"cell_type": "markdown",
- "id": "601577cc",
+ "id": "01329146",
"metadata": {
"editable": true
},
@@ -872,7 +876,7 @@
},
{
"cell_type": "markdown",
- "id": "ea31952c",
+ "id": "3575ca3b",
"metadata": {
"editable": true
},
@@ -884,7 +888,7 @@
},
{
"cell_type": "markdown",
- "id": "fc6c86a7",
+ "id": "bda9dbe5",
"metadata": {
"editable": true
},
@@ -896,7 +900,7 @@
},
{
"cell_type": "markdown",
- "id": "ffe09390",
+ "id": "a50cda13",
"metadata": {
"editable": true
},
@@ -911,7 +915,7 @@
},
{
"cell_type": "markdown",
- "id": "22f4970c",
+ "id": "98a5bfd3",
"metadata": {
"editable": true
},
@@ -923,7 +927,7 @@
},
{
"cell_type": "markdown",
- "id": "4ba751cb",
+ "id": "29825b92",
"metadata": {
"editable": true
},
@@ -933,7 +937,7 @@
},
{
"cell_type": "markdown",
- "id": "87052e13",
+ "id": "98cd166a",
"metadata": {
"editable": true
},
@@ -945,7 +949,7 @@
},
{
"cell_type": "markdown",
- "id": "e24dea19",
+ "id": "ac113691",
"metadata": {
"editable": true
},
@@ -955,7 +959,7 @@
},
{
"cell_type": "markdown",
- "id": "6b52c737",
+ "id": "4885434d",
"metadata": {
"editable": true
},
@@ -967,7 +971,7 @@
},
{
"cell_type": "markdown",
- "id": "904b93aa",
+ "id": "0be054ab",
"metadata": {
"editable": true
},
@@ -977,7 +981,7 @@
},
{
"cell_type": "markdown",
- "id": "439e197d",
+ "id": "56bd4473",
"metadata": {
"editable": true
},
@@ -989,7 +993,7 @@
},
{
"cell_type": "markdown",
- "id": "f5658ed9",
+ "id": "f7696e03",
"metadata": {
"editable": true
},
@@ -1001,7 +1005,7 @@
},
{
"cell_type": "markdown",
- "id": "6f99984d",
+ "id": "52b3aee8",
"metadata": {
"editable": true
},
@@ -1013,7 +1017,7 @@
},
{
"cell_type": "markdown",
- "id": "eeb1373c",
+ "id": "5ae5b749",
"metadata": {
"editable": true
},
@@ -1023,7 +1027,7 @@
},
{
"cell_type": "markdown",
- "id": "f3c557ba",
+ "id": "ad4d9e92",
"metadata": {
"editable": true
},
@@ -1035,7 +1039,7 @@
},
{
"cell_type": "markdown",
- "id": "412789d5",
+ "id": "593fb36f",
"metadata": {
"editable": true
},
@@ -1048,7 +1052,7 @@
},
{
"cell_type": "markdown",
- "id": "65fbbb29",
+ "id": "49bdf172",
"metadata": {
"editable": true
},
@@ -1060,7 +1064,7 @@
},
{
"cell_type": "markdown",
- "id": "f4cd65e4",
+ "id": "2fb6ff7e",
"metadata": {
"editable": true
},
@@ -1070,7 +1074,7 @@
},
{
"cell_type": "markdown",
- "id": "9ee329c3",
+ "id": "5dbcf369",
"metadata": {
"editable": true
},
@@ -1082,7 +1086,7 @@
},
{
"cell_type": "markdown",
- "id": "47023d81",
+ "id": "317f4f66",
"metadata": {
"editable": true
},
@@ -1092,7 +1096,7 @@
},
{
"cell_type": "markdown",
- "id": "40d4cc36",
+ "id": "2b3b5bf8",
"metadata": {
"editable": true
},
@@ -1104,7 +1108,7 @@
},
{
"cell_type": "markdown",
- "id": "e266851f",
+ "id": "482872ec",
"metadata": {
"editable": true
},
@@ -1114,7 +1118,7 @@
},
{
"cell_type": "markdown",
- "id": "f4d0941c",
+ "id": "cbfa31c1",
"metadata": {
"editable": true
},
@@ -1126,7 +1130,7 @@
},
{
"cell_type": "markdown",
- "id": "6f4b2a9d",
+ "id": "29d719aa",
"metadata": {
"editable": true
},
@@ -1136,7 +1140,7 @@
},
{
"cell_type": "markdown",
- "id": "62cab30b",
+ "id": "d09f28c9",
"metadata": {
"editable": true
},
@@ -1148,7 +1152,7 @@
},
{
"cell_type": "markdown",
- "id": "4c8c6398",
+ "id": "b563a46a",
"metadata": {
"editable": true
},
@@ -1158,7 +1162,7 @@
},
{
"cell_type": "markdown",
- "id": "f9c6ab8a",
+ "id": "cfb14c2e",
"metadata": {
"editable": true
},
@@ -1170,7 +1174,7 @@
},
{
"cell_type": "markdown",
- "id": "b7945d33",
+ "id": "55d73d59",
"metadata": {
"editable": true
},
@@ -1182,7 +1186,7 @@
},
{
"cell_type": "markdown",
- "id": "80421efe",
+ "id": "0d302953",
"metadata": {
"editable": true
},
@@ -1194,7 +1198,7 @@
},
{
"cell_type": "markdown",
- "id": "cc1fb4bf",
+ "id": "3134df8b",
"metadata": {
"editable": true
},
@@ -1206,7 +1210,7 @@
},
{
"cell_type": "markdown",
- "id": "c149bd15",
+ "id": "f7a379d8",
"metadata": {
"editable": true
},
@@ -1218,7 +1222,7 @@
},
{
"cell_type": "markdown",
- "id": "4aeb6fad",
+ "id": "625b988b",
"metadata": {
"editable": true
},
@@ -1234,7 +1238,7 @@
},
{
"cell_type": "markdown",
- "id": "fecdf631",
+ "id": "9ad87f84",
"metadata": {
"editable": true
},
@@ -1246,7 +1250,7 @@
},
{
"cell_type": "markdown",
- "id": "7ffbaccd",
+ "id": "c09b142d",
"metadata": {
"editable": true
},
@@ -1256,7 +1260,7 @@
},
{
"cell_type": "markdown",
- "id": "ba12c9f2",
+ "id": "87e150ea",
"metadata": {
"editable": true
},
@@ -1268,7 +1272,7 @@
},
{
"cell_type": "markdown",
- "id": "871cfd8e",
+ "id": "df00240d",
"metadata": {
"editable": true
},
@@ -1286,7 +1290,7 @@
},
{
"cell_type": "markdown",
- "id": "0ad332cd",
+ "id": "8fdbd7f8",
"metadata": {
"editable": true
},
@@ -1298,7 +1302,7 @@
},
{
"cell_type": "markdown",
- "id": "5e7042e9",
+ "id": "238c7bd8",
"metadata": {
"editable": true
},
@@ -1310,7 +1314,7 @@
},
{
"cell_type": "markdown",
- "id": "43b825ce",
+ "id": "18a876fb",
"metadata": {
"editable": true
},
@@ -1320,7 +1324,7 @@
},
{
"cell_type": "markdown",
- "id": "58a4ed44",
+ "id": "ef14c409",
"metadata": {
"editable": true
},
@@ -1332,7 +1336,7 @@
},
{
"cell_type": "markdown",
- "id": "202c5775",
+ "id": "13723af9",
"metadata": {
"editable": true
},
@@ -1342,7 +1346,7 @@
},
{
"cell_type": "markdown",
- "id": "0eab64e4",
+ "id": "4d4ffe70",
"metadata": {
"editable": true
},
@@ -1354,7 +1358,7 @@
},
{
"cell_type": "markdown",
- "id": "d17063fa",
+ "id": "6d044514",
"metadata": {
"editable": true
},
@@ -1364,7 +1368,7 @@
},
{
"cell_type": "markdown",
- "id": "02cca57e",
+ "id": "63c7644a",
"metadata": {
"editable": true
},
@@ -1378,7 +1382,7 @@
},
{
"cell_type": "markdown",
- "id": "d5a0e65b",
+ "id": "c2dbbf59",
"metadata": {
"editable": true
},
@@ -1390,7 +1394,7 @@
},
{
"cell_type": "markdown",
- "id": "03f47788",
+ "id": "c972290a",
"metadata": {
"editable": true
},
@@ -1401,7 +1405,7 @@
},
{
"cell_type": "markdown",
- "id": "ab07b7cf",
+ "id": "141194f9",
"metadata": {
"editable": true
},
@@ -1414,7 +1418,7 @@
{
"cell_type": "code",
"execution_count": 1,
- "id": "f51e672d",
+ "id": "015492ec",
"metadata": {
"collapsed": false,
"editable": true
@@ -1441,7 +1445,7 @@
},
{
"cell_type": "markdown",
- "id": "e44be45e",
+ "id": "1d13253b",
"metadata": {
"editable": true
},
@@ -1452,7 +1456,7 @@
{
"cell_type": "code",
"execution_count": 2,
- "id": "b4786589",
+ "id": "a85b890a",
"metadata": {
"collapsed": false,
"editable": true
@@ -1465,7 +1469,7 @@
},
{
"cell_type": "markdown",
- "id": "af2dcc52",
+ "id": "08eee60c",
"metadata": {
"editable": true
},
@@ -1479,7 +1483,7 @@
{
"cell_type": "code",
"execution_count": 3,
- "id": "2bc65bc5",
+ "id": "06c7d473",
"metadata": {
"collapsed": false,
"editable": true
@@ -1492,7 +1496,7 @@
},
{
"cell_type": "markdown",
- "id": "46bda600",
+ "id": "8a9eb7fd",
"metadata": {
"editable": true
},
@@ -1503,7 +1507,7 @@
{
"cell_type": "code",
"execution_count": 4,
- "id": "9bdae7bf",
+ "id": "44804614",
"metadata": {
"collapsed": false,
"editable": true
@@ -1513,7 +1517,7 @@
"name": "stdout",
"output_type": "stream",
"text": [
- "0.9952638231265687\n"
+ "0.9966579875073338\n"
]
}
],
@@ -1523,7 +1527,7 @@
},
{
"cell_type": "markdown",
- "id": "64eeaaef",
+ "id": "3c36f7b4",
"metadata": {
"editable": true
},
@@ -1534,7 +1538,7 @@
{
"cell_type": "code",
"execution_count": 5,
- "id": "cafbda91",
+ "id": "128cc3f9",
"metadata": {
"collapsed": false,
"editable": true
@@ -1544,7 +1548,7 @@
"name": "stdout",
"output_type": "stream",
"text": [
- "0.011761161707539526\n"
+ "0.007652435292578527\n"
]
}
],
@@ -1558,7 +1562,7 @@
},
{
"cell_type": "markdown",
- "id": "831a5888",
+ "id": "f0555b78",
"metadata": {
"editable": true
},
@@ -1569,7 +1573,7 @@
{
"cell_type": "code",
"execution_count": 6,
- "id": "90f6a538",
+ "id": "f482d41d",
"metadata": {
"collapsed": false,
"editable": true
@@ -1579,23 +1583,31 @@
"name": "stdout",
"output_type": "stream",
"text": [
- "[0.00035753 0.04937621 0.02268114 0.03112297 0.01856502 0.05322899\n",
- " 0.01397927 0.03999935 0.02508836 0.01834042 0.0652633 0.00887114\n",
- " 0.01956921 0.01987248 0.06294313 0.01152476 0.00328431 0.03564082\n",
- " 0.02337045 0.01743586 0.01278035 0.02400968 0.08388138 0.03270341\n",
- " 0.00335956 0.01031903 0.09575469 0.00956774 0.00900879 0.01867985\n",
- " 0.01191227 0.02090296 0.04045671 0.03582958 0.06692165 0.06615863\n",
- " 0.06594872 0.03756493 0.00488992 0.01405237 0.00117071 0.0017567\n",
- " 0.05006306 0.02545639 0.03456485 0.00373984 0.02576476 0.03530741\n",
- " 0.00092902 0.0275742 0.05948007 0.01321652 0.18500705 0.00382166\n",
- " 0.00327313 0.01853877 0.01771317 0.05293662 0.07199977 0.00836148\n",
- " 0.01541649 0.00343257 0.00626797 0.05350297 0.01548272 0.05235058\n",
- " 0.04310698 0.00225189 0.02356396 0.01690512 0.03467756 0.00064364\n",
- " 0.02593596 0.00019607 0.0029508 0.0180194 0.06825695 0.01659559\n",
- " 0.01971341 0.02012338 0.02241311 0.00135736 0.0095653 0.05695438\n",
- " 0.00395659 0.07068033 0.02699873 0.00919237 0.02493299 0.00803115\n",
- " 0.0293055 0.02178063 0.00594353 0.04081883 0.01325225 0.0386443\n",
- " 0.01889695 0.02810253 0.0181166 0.01135924]\n"
+ "[3.25042813e-02 2.38298328e-02 2.64093905e-02 1.31145723e-02\n",
+ " 7.85640706e-02 2.08298871e-02 2.08187418e-02 6.69029803e-04\n",
+ " 2.18905573e-02 2.14957387e-02 2.32863661e-02 4.66181587e-03\n",
+ " 8.93710544e-03 2.89564974e-03 2.51647799e-03 3.61336683e-02\n",
+ " 1.11766707e-02 6.39623570e-02 7.54190070e-03 2.85193598e-03\n",
+ " 4.90018622e-02 1.46957262e-02 4.86592590e-02 9.69161166e-05\n",
+ " 1.11309850e-02 1.47605918e-02 1.80419748e-03 3.18023984e-02\n",
+ " 2.92063704e-02 3.53149684e-02 1.18573920e-02 3.32775737e-03\n",
+ " 1.71196799e-02 1.96079426e-02 1.69232893e-02 1.89273223e-02\n",
+ " 3.13021533e-02 2.96574402e-03 4.06270382e-02 4.92293994e-02\n",
+ " 1.07282462e-02 1.29064873e-02 8.37618253e-03 4.02472584e-02\n",
+ " 2.44637348e-02 1.00149403e-02 2.21129518e-02 2.30674822e-03\n",
+ " 4.87391702e-02 2.53371547e-02 8.26280707e-03 1.80203363e-02\n",
+ " 2.38115471e-02 7.62038116e-02 4.34816464e-02 3.92213792e-02\n",
+ " 6.68818255e-03 8.88623007e-03 8.28473779e-02 4.53859920e-02\n",
+ " 8.26121775e-02 4.67869899e-03 1.62034461e-02 2.78672237e-02\n",
+ " 8.98401894e-03 3.17303133e-02 3.51729923e-02 2.90612093e-03\n",
+ " 5.70221196e-03 3.49065324e-02 3.22091393e-02 2.15706394e-02\n",
+ " 1.40920261e-02 3.82602592e-03 4.59101492e-02 3.65313891e-02\n",
+ " 1.52725477e-02 3.05989176e-02 1.28347954e-03 3.00674454e-02\n",
+ " 8.92998014e-02 1.63727258e-02 3.77117804e-02 1.17886788e-02\n",
+ " 8.76071777e-02 4.11958697e-02 4.99322932e-03 7.57875488e-02\n",
+ " 1.16954396e-04 1.90884438e-02 1.41441328e-02 5.38923192e-02\n",
+ " 9.21237677e-03 1.36654107e-02 9.03904224e-04 9.90027459e-03\n",
+ " 3.01828101e-02 4.71038982e-02 3.87200322e-02 1.62397973e-02]\n"
]
}
],
@@ -1607,7 +1619,7 @@
},
{
"cell_type": "markdown",
- "id": "dc364c27",
+ "id": "292cb89c",
"metadata": {
"editable": true
},
@@ -1628,7 +1640,7 @@
},
{
"cell_type": "markdown",
- "id": "1598259c",
+ "id": "59a7edef",
"metadata": {
"editable": true
},
@@ -1639,7 +1651,7 @@
{
"cell_type": "code",
"execution_count": 7,
- "id": "ca994e68",
+ "id": "847478f5",
"metadata": {
"collapsed": false,
"editable": true
@@ -1649,15 +1661,15 @@
"name": "stdout",
"output_type": "stream",
"text": [
- "[ 2.00507876 0.39026883 3.20764972 2.73806921 -1.39609089]\n",
+ "[ 1.86544433 1.28573357 0.76075617 5.54611024 -2.45878472]\n",
"Training R2\n",
- "0.9972493421341901\n",
+ "0.9958543328528107\n",
"Training MSE\n",
- "0.007021475481484069\n",
+ "0.011031108072207247\n",
"Test R2\n",
- "0.9976639055733267\n",
+ "0.9958824304846606\n",
"Test MSE\n",
- "0.00575158411598985\n"
+ "0.006546368424400406\n"
]
}
],
@@ -1708,7 +1720,7 @@
},
{
"cell_type": "markdown",
- "id": "7353f2e7",
+ "id": "4a92abc5",
"metadata": {
"editable": true
},
@@ -1719,7 +1731,7 @@
{
"cell_type": "code",
"execution_count": 8,
- "id": "05a066db",
+ "id": "71d29d58",
"metadata": {
"collapsed": false,
"editable": true
@@ -1744,7 +1756,7 @@
},
{
"cell_type": "markdown",
- "id": "1f30de64",
+ "id": "71ffb936",
"metadata": {
"editable": true
},
@@ -1756,7 +1768,7 @@
},
{
"cell_type": "markdown",
- "id": "80fa8b7d",
+ "id": "ed47d431",
"metadata": {
"editable": true
},
@@ -1785,7 +1797,7 @@
},
{
"cell_type": "markdown",
- "id": "7e92be20",
+ "id": "4a01c695",
"metadata": {
"editable": true
},
@@ -1810,7 +1822,7 @@
},
{
"cell_type": "markdown",
- "id": "052e8c0c",
+ "id": "d8b9ee62",
"metadata": {
"editable": true
},
@@ -1830,7 +1842,7 @@
},
{
"cell_type": "markdown",
- "id": "d752c7f4",
+ "id": "a5f362af",
"metadata": {
"editable": true
},
@@ -1857,7 +1869,7 @@
},
{
"cell_type": "markdown",
- "id": "4b40d092",
+ "id": "1bdf7ea5",
"metadata": {
"editable": true
},
@@ -1870,7 +1882,7 @@
},
{
"cell_type": "markdown",
- "id": "f8526e57",
+ "id": "142f891c",
"metadata": {
"editable": true
},
@@ -1882,7 +1894,7 @@
},
{
"cell_type": "markdown",
- "id": "5cfb3455",
+ "id": "aee9f94b",
"metadata": {
"editable": true
},
@@ -1893,7 +1905,7 @@
},
{
"cell_type": "markdown",
- "id": "363e0117",
+ "id": "4ce309d1",
"metadata": {
"editable": true
},
@@ -1909,7 +1921,7 @@
{
"cell_type": "code",
"execution_count": 9,
- "id": "4c7ecfc5",
+ "id": "0a704745",
"metadata": {
"collapsed": false,
"editable": true
@@ -2352,7 +2364,7 @@
},
{
"cell_type": "markdown",
- "id": "981f65fb",
+ "id": "84eabf2a",
"metadata": {
"editable": true
},
@@ -2362,7 +2374,7 @@
},
{
"cell_type": "markdown",
- "id": "9ddcca79",
+ "id": "d43e8012",
"metadata": {
"editable": true
},
@@ -2377,7 +2389,7 @@
},
{
"cell_type": "markdown",
- "id": "02bed8b3",
+ "id": "7e9736ec",
"metadata": {
"editable": true
},
@@ -2389,7 +2401,7 @@
},
{
"cell_type": "markdown",
- "id": "64033f1d",
+ "id": "b10b3475",
"metadata": {
"editable": true
},
@@ -2399,7 +2411,7 @@
},
{
"cell_type": "markdown",
- "id": "1cfc52cc",
+ "id": "d84b36f4",
"metadata": {
"editable": true
},
@@ -2415,7 +2427,7 @@
{
"cell_type": "code",
"execution_count": 10,
- "id": "06b67f41",
+ "id": "f7106c42",
"metadata": {
"collapsed": false,
"editable": true
@@ -2432,7 +2444,7 @@
},
{
"cell_type": "markdown",
- "id": "773210a0",
+ "id": "3c69f9f8",
"metadata": {
"editable": true
},
@@ -2445,7 +2457,7 @@
{
"cell_type": "code",
"execution_count": 11,
- "id": "34cb4217",
+ "id": "11c487ef",
"metadata": {
"collapsed": false,
"editable": true
@@ -2507,7 +2519,7 @@
},
{
"cell_type": "markdown",
- "id": "4ae9cee9",
+ "id": "7c801b72",
"metadata": {
"editable": true
},
@@ -2518,7 +2530,7 @@
{
"cell_type": "code",
"execution_count": 12,
- "id": "9be1964e",
+ "id": "d3aeb46a",
"metadata": {
"collapsed": false,
"editable": true
@@ -2654,7 +2666,7 @@
},
{
"cell_type": "markdown",
- "id": "f0fe5870",
+ "id": "40492c3d",
"metadata": {
"editable": true
},
@@ -2682,7 +2694,7 @@
},
{
"cell_type": "markdown",
- "id": "9b60a7bd",
+ "id": "8522203f",
"metadata": {
"editable": true
},
@@ -2717,7 +2729,7 @@
},
{
"cell_type": "markdown",
- "id": "a31dcc5d",
+ "id": "be983c3c",
"metadata": {
"editable": true
},
@@ -2732,7 +2744,7 @@
{
"cell_type": "code",
"execution_count": 13,
- "id": "225671c5",
+ "id": "1efd2e47",
"metadata": {
"collapsed": false,
"editable": true
@@ -2757,7 +2769,7 @@
},
{
"cell_type": "markdown",
- "id": "ac1448c8",
+ "id": "f19c62cb",
"metadata": {
"editable": true
},
@@ -2773,7 +2785,7 @@
},
{
"cell_type": "markdown",
- "id": "c6e308a3",
+ "id": "a584c9cd",
"metadata": {
"editable": true
},
@@ -2785,7 +2797,7 @@
},
{
"cell_type": "markdown",
- "id": "a2f2dab5",
+ "id": "0be698a6",
"metadata": {
"editable": true
},
@@ -2800,7 +2812,7 @@
},
{
"cell_type": "markdown",
- "id": "8a7df606",
+ "id": "5d75610e",
"metadata": {
"editable": true
},
@@ -2812,7 +2824,7 @@
},
{
"cell_type": "markdown",
- "id": "31e595c9",
+ "id": "ff7ee954",
"metadata": {
"editable": true
},
@@ -2822,7 +2834,7 @@
},
{
"cell_type": "markdown",
- "id": "f5f389db",
+ "id": "5e6bb341",
"metadata": {
"editable": true
},
@@ -2834,7 +2846,7 @@
},
{
"cell_type": "markdown",
- "id": "1dd4b34d",
+ "id": "e963c568",
"metadata": {
"editable": true
},
@@ -2844,7 +2856,7 @@
},
{
"cell_type": "markdown",
- "id": "f931e286",
+ "id": "55885a4a",
"metadata": {
"editable": true
},
@@ -2856,7 +2868,7 @@
},
{
"cell_type": "markdown",
- "id": "4cbda41b",
+ "id": "45b41040",
"metadata": {
"editable": true
},
@@ -2869,7 +2881,7 @@
},
{
"cell_type": "markdown",
- "id": "6657a435",
+ "id": "09f46805",
"metadata": {
"editable": true
},
@@ -2881,7 +2893,7 @@
},
{
"cell_type": "markdown",
- "id": "91f7475b",
+ "id": "d1568bca",
"metadata": {
"editable": true
},
@@ -2891,7 +2903,7 @@
},
{
"cell_type": "markdown",
- "id": "98482060",
+ "id": "5596da7b",
"metadata": {
"editable": true
},
@@ -2903,7 +2915,7 @@
},
{
"cell_type": "markdown",
- "id": "01e12c29",
+ "id": "1a811520",
"metadata": {
"editable": true
},
@@ -2913,7 +2925,7 @@
},
{
"cell_type": "markdown",
- "id": "38fa32e4",
+ "id": "97432a8f",
"metadata": {
"editable": true
},
@@ -2925,7 +2937,7 @@
},
{
"cell_type": "markdown",
- "id": "ea483f66",
+ "id": "f0771458",
"metadata": {
"editable": true
},
@@ -2935,7 +2947,7 @@
},
{
"cell_type": "markdown",
- "id": "d5862089",
+ "id": "7c19d9c3",
"metadata": {
"editable": true
},
@@ -2947,7 +2959,7 @@
},
{
"cell_type": "markdown",
- "id": "0456f62e",
+ "id": "f095d30a",
"metadata": {
"editable": true
},
@@ -2957,7 +2969,7 @@
},
{
"cell_type": "markdown",
- "id": "1ed14941",
+ "id": "40723219",
"metadata": {
"editable": true
},
@@ -2969,7 +2981,7 @@
},
{
"cell_type": "markdown",
- "id": "43387b69",
+ "id": "46ed821b",
"metadata": {
"editable": true
},
@@ -2979,7 +2991,7 @@
},
{
"cell_type": "markdown",
- "id": "06bd01bf",
+ "id": "5a319080",
"metadata": {
"editable": true
},
@@ -2991,7 +3003,7 @@
},
{
"cell_type": "markdown",
- "id": "9cad411e",
+ "id": "1113a828",
"metadata": {
"editable": true
},
@@ -3001,7 +3013,7 @@
},
{
"cell_type": "markdown",
- "id": "c37f7792",
+ "id": "283f8fe8",
"metadata": {
"editable": true
},
@@ -3013,7 +3025,7 @@
},
{
"cell_type": "markdown",
- "id": "8a7f23f8",
+ "id": "d2e5d910",
"metadata": {
"editable": true
},
@@ -3025,7 +3037,7 @@
},
{
"cell_type": "markdown",
- "id": "a7fdf6e8",
+ "id": "2de4cd2c",
"metadata": {
"editable": true
},
@@ -3037,7 +3049,7 @@
},
{
"cell_type": "markdown",
- "id": "3ac73282",
+ "id": "ef87b933",
"metadata": {
"editable": true
},
@@ -3050,7 +3062,7 @@
},
{
"cell_type": "markdown",
- "id": "e55db5a0",
+ "id": "36ae94a8",
"metadata": {
"editable": true
},
@@ -3062,7 +3074,7 @@
},
{
"cell_type": "markdown",
- "id": "966cd383",
+ "id": "0e940b73",
"metadata": {
"editable": true
},
@@ -3072,7 +3084,7 @@
},
{
"cell_type": "markdown",
- "id": "360cb45f",
+ "id": "6d215e00",
"metadata": {
"editable": true
},
@@ -3086,7 +3098,7 @@
{
"cell_type": "code",
"execution_count": 14,
- "id": "2099267d",
+ "id": "8e8abb2e",
"metadata": {
"collapsed": false,
"editable": true
@@ -3219,7 +3231,7 @@
},
{
"cell_type": "markdown",
- "id": "9ba9afe9",
+ "id": "2d3510cf",
"metadata": {
"editable": true
},
@@ -3240,7 +3252,7 @@
},
{
"cell_type": "markdown",
- "id": "ea4bf6fe",
+ "id": "6bbe3c03",
"metadata": {
"editable": true
},
@@ -3252,7 +3264,7 @@
},
{
"cell_type": "markdown",
- "id": "98ca9b28",
+ "id": "9402a7f6",
"metadata": {
"editable": true
},
@@ -3262,7 +3274,7 @@
},
{
"cell_type": "markdown",
- "id": "996fc4f6",
+ "id": "2854105e",
"metadata": {
"editable": true
},
@@ -3274,7 +3286,7 @@
},
{
"cell_type": "markdown",
- "id": "b5db8128",
+ "id": "8a104c4a",
"metadata": {
"editable": true
},
@@ -3284,7 +3296,7 @@
},
{
"cell_type": "markdown",
- "id": "745d6bff",
+ "id": "903e7426",
"metadata": {
"editable": true
},
@@ -3296,7 +3308,7 @@
},
{
"cell_type": "markdown",
- "id": "2ecb048e",
+ "id": "08a6f7fc",
"metadata": {
"editable": true
},
@@ -3312,394 +3324,17 @@
},
{
"cell_type": "markdown",
- "id": "73eb2f08",
+ "id": "f08f1d7b",
"metadata": {
"editable": true
},
"source": [
- "## The Boston housing data example\n",
- "\n",
- "The Boston housing \n",
- "data set was originally a part of UCI Machine Learning Repository\n",
- "and has been removed now. The data set is now included in **Scikit-Learn**'s \n",
- "library. There are 506 samples and 13 feature (predictor) variables\n",
- "in this data set. The objective is to predict the value of prices of\n",
- "the house using the features (predictors) listed here.\n",
- "\n",
- "The features/predictors are\n",
- "1. CRIM: Per capita crime rate by town\n",
- "\n",
- "2. ZN: Proportion of residential land zoned for lots over 25000 square feet\n",
- "\n",
- "3. INDUS: Proportion of non-retail business acres per town\n",
- "\n",
- "4. CHAS: Charles River dummy variable (= 1 if tract bounds river; 0 otherwise)\n",
- "\n",
- "5. NOX: Nitric oxide concentration (parts per 10 million)\n",
- "\n",
- "6. RM: Average number of rooms per dwelling\n",
- "\n",
- "7. AGE: Proportion of owner-occupied units built prior to 1940\n",
- "\n",
- "8. DIS: Weighted distances to five Boston employment centers\n",
- "\n",
- "9. RAD: Index of accessibility to radial highways\n",
- "\n",
- "10. TAX: Full-value property tax rate per USD10000\n",
- "\n",
- "11. B: $1000(Bk - 0.63)^2$, where $Bk$ is the proportion of [people of African American descent] by town\n",
- "\n",
- "12. LSTAT: Percentage of lower status of the population\n",
- "\n",
- "13. MEDV: Median value of owner-occupied homes in USD 1000s"
+ "## Material for lecture Monday, August 26"
]
},
{
"cell_type": "markdown",
- "id": "41d9c008",
- "metadata": {
- "editable": true
- },
- "source": [
- "## Housing data, the code\n",
- "We start by importing the libraries"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 15,
- "id": "0af3b38a",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "import numpy as np\n",
- "import matplotlib.pyplot as plt \n",
- "\n",
- "import pandas as pd \n",
- "import seaborn as sns"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "41771944",
- "metadata": {
- "editable": true
- },
- "source": [
- "and load the Boston Housing DataSet from **Scikit-Learn**"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 16,
- "id": "c0ad90ff",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [
- {
- "ename": "ImportError",
- "evalue": "\n`load_boston` has been removed from scikit-learn since version 1.2.\n\nThe Boston housing prices dataset has an ethical problem: as\ninvestigated in [1], the authors of this dataset engineered a\nnon-invertible variable \"B\" assuming that racial self-segregation had a\npositive impact on house prices [2]. Furthermore the goal of the\nresearch that led to the creation of this dataset was to study the\nimpact of air quality but it did not give adequate demonstration of the\nvalidity of this assumption.\n\nThe scikit-learn maintainers therefore strongly discourage the use of\nthis dataset unless the purpose of the code is to study and educate\nabout ethical issues in data science and machine learning.\n\nIn this special case, you can fetch the dataset from the original\nsource::\n\n import pandas as pd\n import numpy as np\n\n data_url = \"http://lib.stat.cmu.edu/datasets/boston\"\n raw_df = pd.read_csv(data_url, sep=\"\\s+\", skiprows=22, header=None)\n data = np.hstack([raw_df.values[::2, :], raw_df.values[1::2, :2]])\n target = raw_df.values[1::2, 2]\n\nAlternative datasets include the California housing dataset and the\nAmes housing dataset. You can load the datasets as follows::\n\n from sklearn.datasets import fetch_california_housing\n housing = fetch_california_housing()\n\nfor the California housing dataset and::\n\n from sklearn.datasets import fetch_openml\n housing = fetch_openml(name=\"house_prices\", as_frame=True)\n\nfor the Ames housing dataset.\n\n[1] M Carlisle.\n\"Racist data destruction?\"\n\n\n[2] Harrison Jr, David, and Daniel L. Rubinfeld.\n\"Hedonic housing prices and the demand for clean air.\"\nJournal of environmental economics and management 5.1 (1978): 81-102.\n\n",
- "output_type": "error",
- "traceback": [
- "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
- "\u001b[0;31mImportError\u001b[0m Traceback (most recent call last)",
- "Cell \u001b[0;32mIn[16], line 1\u001b[0m\n\u001b[0;32m----> 1\u001b[0m \u001b[38;5;28;01mfrom\u001b[39;00m \u001b[38;5;21;01msklearn\u001b[39;00m\u001b[38;5;21;01m.\u001b[39;00m\u001b[38;5;21;01mdatasets\u001b[39;00m \u001b[38;5;28;01mimport\u001b[39;00m load_boston\n\u001b[1;32m 3\u001b[0m boston_dataset \u001b[38;5;241m=\u001b[39m load_boston()\n\u001b[1;32m 5\u001b[0m \u001b[38;5;66;03m# boston_dataset is a dictionary\u001b[39;00m\n\u001b[1;32m 6\u001b[0m \u001b[38;5;66;03m# let's check what it contains\u001b[39;00m\n",
- "File \u001b[0;32m~/miniforge3/envs/myenv/lib/python3.9/site-packages/sklearn/datasets/__init__.py:157\u001b[0m, in \u001b[0;36m__getattr__\u001b[0;34m(name)\u001b[0m\n\u001b[1;32m 108\u001b[0m \u001b[38;5;28;01mif\u001b[39;00m name \u001b[38;5;241m==\u001b[39m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mload_boston\u001b[39m\u001b[38;5;124m\"\u001b[39m:\n\u001b[1;32m 109\u001b[0m msg \u001b[38;5;241m=\u001b[39m textwrap\u001b[38;5;241m.\u001b[39mdedent(\u001b[38;5;124m\"\"\"\u001b[39m\n\u001b[1;32m 110\u001b[0m \u001b[38;5;124m `load_boston` has been removed from scikit-learn since version 1.2.\u001b[39m\n\u001b[1;32m 111\u001b[0m \n\u001b[0;32m (...)\u001b[0m\n\u001b[1;32m 155\u001b[0m \u001b[38;5;124m \u001b[39m\n\u001b[1;32m 156\u001b[0m \u001b[38;5;124m \u001b[39m\u001b[38;5;124m\"\"\"\u001b[39m)\n\u001b[0;32m--> 157\u001b[0m \u001b[38;5;28;01mraise\u001b[39;00m \u001b[38;5;167;01mImportError\u001b[39;00m(msg)\n\u001b[1;32m 158\u001b[0m \u001b[38;5;28;01mtry\u001b[39;00m:\n\u001b[1;32m 159\u001b[0m \u001b[38;5;28;01mreturn\u001b[39;00m \u001b[38;5;28mglobals\u001b[39m()[name]\n",
- "\u001b[0;31mImportError\u001b[0m: \n`load_boston` has been removed from scikit-learn since version 1.2.\n\nThe Boston housing prices dataset has an ethical problem: as\ninvestigated in [1], the authors of this dataset engineered a\nnon-invertible variable \"B\" assuming that racial self-segregation had a\npositive impact on house prices [2]. Furthermore the goal of the\nresearch that led to the creation of this dataset was to study the\nimpact of air quality but it did not give adequate demonstration of the\nvalidity of this assumption.\n\nThe scikit-learn maintainers therefore strongly discourage the use of\nthis dataset unless the purpose of the code is to study and educate\nabout ethical issues in data science and machine learning.\n\nIn this special case, you can fetch the dataset from the original\nsource::\n\n import pandas as pd\n import numpy as np\n\n data_url = \"http://lib.stat.cmu.edu/datasets/boston\"\n raw_df = pd.read_csv(data_url, sep=\"\\s+\", skiprows=22, header=None)\n data = np.hstack([raw_df.values[::2, :], raw_df.values[1::2, :2]])\n target = raw_df.values[1::2, 2]\n\nAlternative datasets include the California housing dataset and the\nAmes housing dataset. You can load the datasets as follows::\n\n from sklearn.datasets import fetch_california_housing\n housing = fetch_california_housing()\n\nfor the California housing dataset and::\n\n from sklearn.datasets import fetch_openml\n housing = fetch_openml(name=\"house_prices\", as_frame=True)\n\nfor the Ames housing dataset.\n\n[1] M Carlisle.\n\"Racist data destruction?\"\n\n\n[2] Harrison Jr, David, and Daniel L. Rubinfeld.\n\"Hedonic housing prices and the demand for clean air.\"\nJournal of environmental economics and management 5.1 (1978): 81-102.\n\n"
- ]
- }
- ],
- "source": [
- "from sklearn.datasets import load_boston\n",
- "\n",
- "boston_dataset = load_boston()\n",
- "\n",
- "# boston_dataset is a dictionary\n",
- "# let's check what it contains\n",
- "boston_dataset.keys()"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "ef2f9bce",
- "metadata": {
- "editable": true
- },
- "source": [
- "Then we invoke Pandas"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 17,
- "id": "150d1433",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "boston = pd.DataFrame(boston_dataset.data, columns=boston_dataset.feature_names)\n",
- "boston.head()\n",
- "boston['MEDV'] = boston_dataset.target"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "1be017ef",
- "metadata": {
- "editable": true
- },
- "source": [
- "and preprocess the data"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 18,
- "id": "01ef8953",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "# check for missing values in all the columns\n",
- "boston.isnull().sum()"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "adc486b5",
- "metadata": {
- "editable": true
- },
- "source": [
- "We can then visualize the data"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 19,
- "id": "2471fc63",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "# set the size of the figure\n",
- "sns.set(rc={'figure.figsize':(11.7,8.27)})\n",
- "\n",
- "# plot a histogram showing the distribution of the target values\n",
- "sns.distplot(boston['MEDV'], bins=30)\n",
- "plt.show()"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "e26d39f7",
- "metadata": {
- "editable": true
- },
- "source": [
- "It is now useful to look at the correlation matrix"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 20,
- "id": "6bb60001",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "# compute the pair wise correlation for all columns \n",
- "correlation_matrix = boston.corr().round(2)\n",
- "# use the heatmap function from seaborn to plot the correlation matrix\n",
- "# annot = True to print the values inside the square\n",
- "sns.heatmap(data=correlation_matrix, annot=True)"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "90f47dc1",
- "metadata": {
- "editable": true
- },
- "source": [
- "From the above coorelation plot we can see that **MEDV** is strongly correlated to **LSTAT** and **RM**. We see also that **RAD** and **TAX** are stronly correlated, but we don't include this in our features together to avoid multi-colinearity"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 21,
- "id": "a1f980e4",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "plt.figure(figsize=(20, 5))\n",
- "\n",
- "features = ['LSTAT', 'RM']\n",
- "target = boston['MEDV']\n",
- "\n",
- "for i, col in enumerate(features):\n",
- " plt.subplot(1, len(features) , i+1)\n",
- " x = boston[col]\n",
- " y = target\n",
- " plt.scatter(x, y, marker='o')\n",
- " plt.title(col)\n",
- " plt.xlabel(col)\n",
- " plt.ylabel('MEDV')"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "9efdaaaa",
- "metadata": {
- "editable": true
- },
- "source": [
- "Now we start training our model"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 22,
- "id": "01e9afe5",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "X = pd.DataFrame(np.c_[boston['LSTAT'], boston['RM']], columns = ['LSTAT','RM'])\n",
- "Y = boston['MEDV']"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "73335565",
- "metadata": {
- "editable": true
- },
- "source": [
- "We split the data into training and test sets"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 23,
- "id": "f865febb",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "from sklearn.model_selection import train_test_split\n",
- "\n",
- "# splits the training and test data set in 80% : 20%\n",
- "# assign random_state to any value.This ensures consistency.\n",
- "X_train, X_test, Y_train, Y_test = train_test_split(X, Y, test_size = 0.2, random_state=5)\n",
- "print(X_train.shape)\n",
- "print(X_test.shape)\n",
- "print(Y_train.shape)\n",
- "print(Y_test.shape)"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "88f5a339",
- "metadata": {
- "editable": true
- },
- "source": [
- "Then we use the linear regression functionality from **Scikit-Learn**"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 24,
- "id": "bacdbf9b",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "from sklearn.linear_model import LinearRegression\n",
- "from sklearn.metrics import mean_squared_error, r2_score\n",
- "\n",
- "lin_model = LinearRegression()\n",
- "lin_model.fit(X_train, Y_train)\n",
- "\n",
- "# model evaluation for training set\n",
- "\n",
- "y_train_predict = lin_model.predict(X_train)\n",
- "rmse = (np.sqrt(mean_squared_error(Y_train, y_train_predict)))\n",
- "r2 = r2_score(Y_train, y_train_predict)\n",
- "\n",
- "print(\"The model performance for training set\")\n",
- "print(\"--------------------------------------\")\n",
- "print('RMSE is {}'.format(rmse))\n",
- "print('R2 score is {}'.format(r2))\n",
- "print(\"\\n\")\n",
- "\n",
- "# model evaluation for testing set\n",
- "\n",
- "y_test_predict = lin_model.predict(X_test)\n",
- "# root mean square error of the model\n",
- "rmse = (np.sqrt(mean_squared_error(Y_test, y_test_predict)))\n",
- "\n",
- "# r-squared score of the model\n",
- "r2 = r2_score(Y_test, y_test_predict)\n",
- "\n",
- "print(\"The model performance for testing set\")\n",
- "print(\"--------------------------------------\")\n",
- "print('RMSE is {}'.format(rmse))\n",
- "print('R2 score is {}'.format(r2))"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 25,
- "id": "09aa7ac9",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "# plotting the y_test vs y_pred\n",
- "# ideally should have been a straight line\n",
- "plt.scatter(Y_test, y_test_predict)\n",
- "plt.show()"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "cb088f7a",
- "metadata": {
- "editable": true
- },
- "source": [
- "## Material for lecture Thursday, August 31"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "a452bf26",
+ "id": "5d936c7e",
"metadata": {
"editable": true
},
@@ -3713,7 +3348,7 @@
},
{
"cell_type": "markdown",
- "id": "603ea987",
+ "id": "ef7769a7",
"metadata": {
"editable": true
},
@@ -3725,7 +3360,7 @@
},
{
"cell_type": "markdown",
- "id": "61b65c66",
+ "id": "7771ff2c",
"metadata": {
"editable": true
},
@@ -3737,7 +3372,7 @@
},
{
"cell_type": "markdown",
- "id": "d08fd064",
+ "id": "10fc7ed2",
"metadata": {
"editable": true
},
@@ -3749,7 +3384,7 @@
},
{
"cell_type": "markdown",
- "id": "e8f62983",
+ "id": "39b5e3bd",
"metadata": {
"editable": true
},
@@ -3759,7 +3394,7 @@
},
{
"cell_type": "markdown",
- "id": "d68a9415",
+ "id": "52b3d0bb",
"metadata": {
"editable": true
},
@@ -3771,7 +3406,7 @@
},
{
"cell_type": "markdown",
- "id": "3307fed7",
+ "id": "4c3bc56d",
"metadata": {
"editable": true
},
@@ -3781,7 +3416,7 @@
},
{
"cell_type": "markdown",
- "id": "8a910e57",
+ "id": "1763f73c",
"metadata": {
"editable": true
},
@@ -3793,7 +3428,7 @@
},
{
"cell_type": "markdown",
- "id": "218a6b48",
+ "id": "10ca64dc",
"metadata": {
"editable": true
},
@@ -3804,7 +3439,7 @@
},
{
"cell_type": "markdown",
- "id": "8f3748ba",
+ "id": "59d74409",
"metadata": {
"editable": true
},
@@ -3816,7 +3451,7 @@
},
{
"cell_type": "markdown",
- "id": "d0385420",
+ "id": "e096a0c8",
"metadata": {
"editable": true
},
@@ -3828,7 +3463,7 @@
},
{
"cell_type": "markdown",
- "id": "4644a05e",
+ "id": "9e7b9f26",
"metadata": {
"editable": true
},
@@ -3838,7 +3473,7 @@
},
{
"cell_type": "markdown",
- "id": "bfb350df",
+ "id": "5f8e828c",
"metadata": {
"editable": true
},
@@ -3850,7 +3485,7 @@
},
{
"cell_type": "markdown",
- "id": "508acac7",
+ "id": "b649f8ce",
"metadata": {
"editable": true
},
@@ -3862,7 +3497,7 @@
},
{
"cell_type": "markdown",
- "id": "1cde0c41",
+ "id": "57c7d832",
"metadata": {
"editable": true
},
@@ -3872,7 +3507,7 @@
},
{
"cell_type": "markdown",
- "id": "683baaea",
+ "id": "c9c6af68",
"metadata": {
"editable": true
},
@@ -3884,7 +3519,7 @@
},
{
"cell_type": "markdown",
- "id": "ec9c67ea",
+ "id": "fa1128b4",
"metadata": {
"editable": true
},
@@ -3894,7 +3529,7 @@
},
{
"cell_type": "markdown",
- "id": "cdc9c6fc",
+ "id": "85c79bbd",
"metadata": {
"editable": true
},
@@ -3906,7 +3541,7 @@
},
{
"cell_type": "markdown",
- "id": "c7590b65",
+ "id": "a771f3ba",
"metadata": {
"editable": true
},
@@ -3916,7 +3551,7 @@
},
{
"cell_type": "markdown",
- "id": "f2d7afb2",
+ "id": "a537e28f",
"metadata": {
"editable": true
},
@@ -3956,7 +3591,7 @@
},
{
"cell_type": "markdown",
- "id": "69fd907d",
+ "id": "22a92910",
"metadata": {
"editable": true
},
@@ -3973,7 +3608,7 @@
},
{
"cell_type": "markdown",
- "id": "33b93521",
+ "id": "93aec13e",
"metadata": {
"editable": true
},
@@ -3996,7 +3631,7 @@
},
{
"cell_type": "markdown",
- "id": "600d8db6",
+ "id": "3e8fc4af",
"metadata": {
"editable": true
},
@@ -4013,7 +3648,7 @@
},
{
"cell_type": "markdown",
- "id": "22fc0a80",
+ "id": "3f2d73ed",
"metadata": {
"editable": true
},
@@ -4032,7 +3667,7 @@
},
{
"cell_type": "markdown",
- "id": "bd71990f",
+ "id": "cebec7f9",
"metadata": {
"editable": true
},
@@ -4043,7 +3678,7 @@
},
{
"cell_type": "markdown",
- "id": "587d44ae",
+ "id": "da556bd6",
"metadata": {
"editable": true
},
@@ -4055,7 +3690,7 @@
},
{
"cell_type": "markdown",
- "id": "2158156f",
+ "id": "4d23351d",
"metadata": {
"editable": true
},
@@ -4073,7 +3708,7 @@
},
{
"cell_type": "markdown",
- "id": "10eb0b7c",
+ "id": "162bcba6",
"metadata": {
"editable": true
},
@@ -4089,7 +3724,7 @@
},
{
"cell_type": "markdown",
- "id": "2aceb644",
+ "id": "778461b7",
"metadata": {
"editable": true
},
@@ -4101,7 +3736,7 @@
},
{
"cell_type": "markdown",
- "id": "1465b8be",
+ "id": "c691b8b0",
"metadata": {
"editable": true
},
@@ -4111,7 +3746,7 @@
},
{
"cell_type": "markdown",
- "id": "b3afc822",
+ "id": "b6b7e4a0",
"metadata": {
"editable": true
},
@@ -4126,7 +3761,7 @@
},
{
"cell_type": "markdown",
- "id": "4357f67d",
+ "id": "9a612971",
"metadata": {
"editable": true
},
@@ -4138,7 +3773,7 @@
},
{
"cell_type": "markdown",
- "id": "b2ed8199",
+ "id": "706132dc",
"metadata": {
"editable": true
},
@@ -4148,7 +3783,7 @@
},
{
"cell_type": "markdown",
- "id": "a28f5e2a",
+ "id": "206c55a7",
"metadata": {
"editable": true
},
@@ -4160,7 +3795,7 @@
},
{
"cell_type": "markdown",
- "id": "dda00171",
+ "id": "6b74284d",
"metadata": {
"editable": true
},
@@ -4170,7 +3805,7 @@
},
{
"cell_type": "markdown",
- "id": "99e49156",
+ "id": "0234a46a",
"metadata": {
"editable": true
},
@@ -4182,7 +3817,7 @@
},
{
"cell_type": "markdown",
- "id": "3de354b0",
+ "id": "abb8474f",
"metadata": {
"editable": true
},
@@ -4194,7 +3829,7 @@
},
{
"cell_type": "markdown",
- "id": "9b719377",
+ "id": "9467e419",
"metadata": {
"editable": true
},
@@ -4209,7 +3844,7 @@
},
{
"cell_type": "markdown",
- "id": "f46453c7",
+ "id": "abfadb01",
"metadata": {
"editable": true
},
@@ -4220,7 +3855,7 @@
},
{
"cell_type": "markdown",
- "id": "0255efb1",
+ "id": "b4d7950d",
"metadata": {
"editable": true
},
@@ -4240,7 +3875,7 @@
},
{
"cell_type": "markdown",
- "id": "61df6aad",
+ "id": "c6e946ea",
"metadata": {
"editable": true
},
@@ -4252,7 +3887,7 @@
},
{
"cell_type": "markdown",
- "id": "ac44e8fa",
+ "id": "485e3f93",
"metadata": {
"editable": true
},
@@ -4262,7 +3897,7 @@
},
{
"cell_type": "markdown",
- "id": "a73ed285",
+ "id": "8dd085df",
"metadata": {
"editable": true
},
@@ -4274,7 +3909,7 @@
},
{
"cell_type": "markdown",
- "id": "4809c104",
+ "id": "5e745921",
"metadata": {
"editable": true
},
@@ -4303,7 +3938,7 @@
},
{
"cell_type": "markdown",
- "id": "9ff4078a",
+ "id": "e123b112",
"metadata": {
"editable": true
},
@@ -4330,7 +3965,7 @@
},
{
"cell_type": "markdown",
- "id": "78a8b113",
+ "id": "8716fc03",
"metadata": {
"editable": true
},
@@ -4340,13 +3975,35 @@
},
{
"cell_type": "code",
- "execution_count": 26,
- "id": "47f6d805",
+ "execution_count": 15,
+ "id": "3b53ef76",
"metadata": {
"collapsed": false,
"editable": true
},
- "outputs": [],
+ "outputs": [
+ {
+ "name": "stdout",
+ "output_type": "stream",
+ "text": [
+ "[[ 1. -1.]\n",
+ " [ 1. -1.]]\n",
+ "test U\n",
+ "[[0. 0.]\n",
+ " [0. 0.]]\n",
+ "test VT\n",
+ "[[0. 0.]\n",
+ " [0. 0.]]\n",
+ "[[-0.70710678 -0.70710678]\n",
+ " [-0.70710678 0.70710678]]\n",
+ "[2.00000000e+00 3.35470445e-17]\n",
+ "[[-0.70710678 0.70710678]\n",
+ " [ 0.70710678 0.70710678]]\n",
+ "[[-3.33066907e-16 4.44089210e-16]\n",
+ " [ 0.00000000e+00 2.22044605e-16]]\n"
+ ]
+ }
+ ],
"source": [
"import numpy as np\n",
"# SVD inversion\n",
@@ -4381,7 +4038,7 @@
},
{
"cell_type": "markdown",
- "id": "5d841c14",
+ "id": "577ae352",
"metadata": {
"editable": true
},
@@ -4398,7 +4055,7 @@
},
{
"cell_type": "markdown",
- "id": "579b46a4",
+ "id": "052f1ae4",
"metadata": {
"editable": true
},
@@ -4421,7 +4078,7 @@
},
{
"cell_type": "markdown",
- "id": "1bb48e3c",
+ "id": "245d15c0",
"metadata": {
"editable": true
},
@@ -4435,7 +4092,7 @@
},
{
"cell_type": "markdown",
- "id": "a872fcf9",
+ "id": "b1b84021",
"metadata": {
"editable": true
},
@@ -4454,7 +4111,7 @@
},
{
"cell_type": "markdown",
- "id": "f0565ccd",
+ "id": "59677057",
"metadata": {
"editable": true
},
@@ -4464,7 +4121,7 @@
},
{
"cell_type": "markdown",
- "id": "a659e96f",
+ "id": "579a9b4c",
"metadata": {
"editable": true
},
@@ -4476,7 +4133,7 @@
},
{
"cell_type": "markdown",
- "id": "fcfcf6b0",
+ "id": "49fd275c",
"metadata": {
"editable": true
},
@@ -4490,7 +4147,7 @@
},
{
"cell_type": "markdown",
- "id": "ea39064c",
+ "id": "094a53e2",
"metadata": {
"editable": true
},
@@ -4502,7 +4159,7 @@
},
{
"cell_type": "markdown",
- "id": "0096e499",
+ "id": "c1fec661",
"metadata": {
"editable": true
},
@@ -4512,7 +4169,7 @@
},
{
"cell_type": "markdown",
- "id": "bf32dfa9",
+ "id": "a897fce4",
"metadata": {
"editable": true
},
@@ -4524,7 +4181,7 @@
},
{
"cell_type": "markdown",
- "id": "e0d6fee2",
+ "id": "cf091974",
"metadata": {
"editable": true
},
@@ -4541,7 +4198,7 @@
},
{
"cell_type": "markdown",
- "id": "0cb15d9d",
+ "id": "43eeed44",
"metadata": {
"editable": true
},
@@ -4551,7 +4208,7 @@
},
{
"cell_type": "markdown",
- "id": "754f4312",
+ "id": "6c94161a",
"metadata": {
"editable": true
},
@@ -4567,7 +4224,7 @@
},
{
"cell_type": "markdown",
- "id": "5bd1e9b0",
+ "id": "f2d6cec5",
"metadata": {
"editable": true
},
@@ -4577,7 +4234,7 @@
},
{
"cell_type": "markdown",
- "id": "2a839ac1",
+ "id": "3439cf2f",
"metadata": {
"editable": true
},
@@ -4593,7 +4250,7 @@
},
{
"cell_type": "markdown",
- "id": "69e34c64",
+ "id": "0c3d6910",
"metadata": {
"editable": true
},
@@ -4603,7 +4260,7 @@
},
{
"cell_type": "markdown",
- "id": "b32ae1de",
+ "id": "b3fe6cae",
"metadata": {
"editable": true
},
@@ -4619,7 +4276,7 @@
},
{
"cell_type": "markdown",
- "id": "00c3ff66",
+ "id": "52b64666",
"metadata": {
"editable": true
},
@@ -4629,7 +4286,7 @@
},
{
"cell_type": "markdown",
- "id": "92f1238d",
+ "id": "c016890a",
"metadata": {
"editable": true
},
@@ -4646,7 +4303,7 @@
},
{
"cell_type": "markdown",
- "id": "71f43637",
+ "id": "2589545c",
"metadata": {
"editable": true
},
@@ -4658,7 +4315,7 @@
},
{
"cell_type": "markdown",
- "id": "4bac0a15",
+ "id": "d74b662f",
"metadata": {
"editable": true
},
@@ -4670,7 +4327,7 @@
},
{
"cell_type": "markdown",
- "id": "b523b964",
+ "id": "79f18748",
"metadata": {
"editable": true
},
@@ -4682,7 +4339,7 @@
},
{
"cell_type": "markdown",
- "id": "3d7f8195",
+ "id": "c97ef564",
"metadata": {
"editable": true
},
@@ -4692,7 +4349,7 @@
},
{
"cell_type": "markdown",
- "id": "f308dd0a",
+ "id": "f2b64e40",
"metadata": {
"editable": true
},
@@ -4704,7 +4361,7 @@
},
{
"cell_type": "markdown",
- "id": "929784cf",
+ "id": "2780c653",
"metadata": {
"editable": true
},
@@ -4716,7 +4373,7 @@
},
{
"cell_type": "markdown",
- "id": "09dccee1",
+ "id": "42a104ce",
"metadata": {
"editable": true
},
@@ -4728,7 +4385,7 @@
},
{
"cell_type": "markdown",
- "id": "165b3f17",
+ "id": "665eee0d",
"metadata": {
"editable": true
},
@@ -4738,7 +4395,7 @@
},
{
"cell_type": "markdown",
- "id": "24a8dd50",
+ "id": "152a833c",
"metadata": {
"editable": true
},
@@ -4750,7 +4407,7 @@
},
{
"cell_type": "markdown",
- "id": "2597dc03",
+ "id": "af006756",
"metadata": {
"editable": true
},
@@ -4760,7 +4417,7 @@
},
{
"cell_type": "markdown",
- "id": "4d40ddce",
+ "id": "aa8a26d4",
"metadata": {
"editable": true
},
@@ -4772,7 +4429,7 @@
},
{
"cell_type": "markdown",
- "id": "41d0e0cb",
+ "id": "21f907f2",
"metadata": {
"editable": true
},
@@ -4788,7 +4445,7 @@
},
{
"cell_type": "markdown",
- "id": "e4bafe51",
+ "id": "39b264f4",
"metadata": {
"editable": true
},
@@ -4800,7 +4457,7 @@
},
{
"cell_type": "markdown",
- "id": "aab4d56f",
+ "id": "b77259ea",
"metadata": {
"editable": true
},
@@ -4812,7 +4469,7 @@
},
{
"cell_type": "markdown",
- "id": "861395ef",
+ "id": "dba49a93",
"metadata": {
"editable": true
},
@@ -4822,7 +4479,7 @@
},
{
"cell_type": "markdown",
- "id": "299b8198",
+ "id": "b51fa501",
"metadata": {
"editable": true
},
@@ -4834,7 +4491,7 @@
},
{
"cell_type": "markdown",
- "id": "2096c2e7",
+ "id": "8edb1494",
"metadata": {
"editable": true
},
@@ -4845,7 +4502,7 @@
},
{
"cell_type": "markdown",
- "id": "4ad3b043",
+ "id": "e9d9d5d3",
"metadata": {
"editable": true
},
@@ -4857,7 +4514,7 @@
},
{
"cell_type": "markdown",
- "id": "66bf91e3",
+ "id": "7c49927e",
"metadata": {
"editable": true
},
@@ -4867,7 +4524,7 @@
},
{
"cell_type": "markdown",
- "id": "95afc99c",
+ "id": "77eb9e2f",
"metadata": {
"editable": true
},
@@ -4879,7 +4536,7 @@
},
{
"cell_type": "markdown",
- "id": "73334115",
+ "id": "9a20a065",
"metadata": {
"editable": true
},
@@ -4889,7 +4546,7 @@
},
{
"cell_type": "markdown",
- "id": "fb6f936e",
+ "id": "f5ccfe0e",
"metadata": {
"editable": true
},
@@ -4901,7 +4558,7 @@
},
{
"cell_type": "markdown",
- "id": "f9093b47",
+ "id": "40447dce",
"metadata": {
"editable": true
},
@@ -4912,7 +4569,7 @@
},
{
"cell_type": "markdown",
- "id": "fe539ee1",
+ "id": "859c86b6",
"metadata": {
"editable": true
},
@@ -4924,7 +4581,7 @@
},
{
"cell_type": "markdown",
- "id": "d130c8c1",
+ "id": "72d9fdde",
"metadata": {
"editable": true
},
@@ -4942,7 +4599,7 @@
},
{
"cell_type": "markdown",
- "id": "6787b5c2",
+ "id": "4c69a499",
"metadata": {
"editable": true
},
@@ -4958,7 +4615,7 @@
},
{
"cell_type": "markdown",
- "id": "b2e599e5",
+ "id": "00f97350",
"metadata": {
"editable": true
},
@@ -4970,7 +4627,7 @@
},
{
"cell_type": "markdown",
- "id": "854ff040",
+ "id": "c71f00ef",
"metadata": {
"editable": true
},
@@ -4982,7 +4639,7 @@
},
{
"cell_type": "markdown",
- "id": "aaf5e54e",
+ "id": "35b4c0ce",
"metadata": {
"editable": true
},
@@ -4994,7 +4651,7 @@
},
{
"cell_type": "markdown",
- "id": "444a68be",
+ "id": "16757c16",
"metadata": {
"editable": true
},
@@ -5007,7 +4664,7 @@
},
{
"cell_type": "markdown",
- "id": "56e0f274",
+ "id": "ea15a5d1",
"metadata": {
"editable": true
},
@@ -5023,7 +4680,7 @@
},
{
"cell_type": "markdown",
- "id": "a55a54c3",
+ "id": "b658712b",
"metadata": {
"editable": true
},
@@ -5037,7 +4694,7 @@
},
{
"cell_type": "markdown",
- "id": "b614c964",
+ "id": "9e2de3bd",
"metadata": {
"editable": true
},
@@ -5047,7 +4704,7 @@
},
{
"cell_type": "markdown",
- "id": "624b1c18",
+ "id": "ac8eda2d",
"metadata": {
"editable": true
},
@@ -5059,7 +4716,7 @@
},
{
"cell_type": "markdown",
- "id": "63dc085a",
+ "id": "4dede760",
"metadata": {
"editable": true
},
@@ -5069,7 +4726,7 @@
},
{
"cell_type": "markdown",
- "id": "28db2f6a",
+ "id": "2fd5acb5",
"metadata": {
"editable": true
},
@@ -5081,7 +4738,7 @@
},
{
"cell_type": "markdown",
- "id": "a9f1ebdd",
+ "id": "e14ee8e6",
"metadata": {
"editable": true
},
@@ -5091,7 +4748,7 @@
},
{
"cell_type": "markdown",
- "id": "0b8bf07b",
+ "id": "8e51c303",
"metadata": {
"editable": true
},
@@ -5105,7 +4762,7 @@
},
{
"cell_type": "markdown",
- "id": "5f237448",
+ "id": "5399fb0c",
"metadata": {
"editable": true
},
@@ -5122,7 +4779,7 @@
},
{
"cell_type": "markdown",
- "id": "75b7044c",
+ "id": "a252f1ea",
"metadata": {
"editable": true
},
@@ -5138,7 +4795,7 @@
},
{
"cell_type": "markdown",
- "id": "51268862",
+ "id": "36f5c9dd",
"metadata": {
"editable": true
},
@@ -5150,7 +4807,7 @@
},
{
"cell_type": "markdown",
- "id": "608b9dff",
+ "id": "f2c3a15d",
"metadata": {
"editable": true
},
@@ -5163,7 +4820,7 @@
},
{
"cell_type": "markdown",
- "id": "b06c316f",
+ "id": "e1dc5ae3",
"metadata": {
"editable": true
},
@@ -5177,7 +4834,7 @@
},
{
"cell_type": "markdown",
- "id": "e82ba709",
+ "id": "18cba5ba",
"metadata": {
"editable": true
},
@@ -5187,7 +4844,7 @@
},
{
"cell_type": "markdown",
- "id": "92d739a1",
+ "id": "0611a8e9",
"metadata": {
"editable": true
},
@@ -5200,7 +4857,7 @@
},
{
"cell_type": "markdown",
- "id": "14ce5cea",
+ "id": "a4cc4815",
"metadata": {
"editable": true
},
@@ -5219,7 +4876,7 @@
},
{
"cell_type": "markdown",
- "id": "f7e1f2b1",
+ "id": "e9921c65",
"metadata": {
"editable": true
},
@@ -5231,7 +4888,7 @@
},
{
"cell_type": "markdown",
- "id": "71910404",
+ "id": "9d1540c2",
"metadata": {
"editable": true
},
@@ -5243,7 +4900,7 @@
},
{
"cell_type": "markdown",
- "id": "cbd60268",
+ "id": "277e8be4",
"metadata": {
"editable": true
},
@@ -5253,7 +4910,7 @@
},
{
"cell_type": "markdown",
- "id": "e6c94e3d",
+ "id": "c00cef73",
"metadata": {
"editable": true
},
@@ -5265,7 +4922,7 @@
},
{
"cell_type": "markdown",
- "id": "20cf812e",
+ "id": "3a7619df",
"metadata": {
"editable": true
},
@@ -5278,7 +4935,7 @@
},
{
"cell_type": "markdown",
- "id": "dd1cb8be",
+ "id": "357c8a98",
"metadata": {
"editable": true
},
@@ -5297,7 +4954,7 @@
},
{
"cell_type": "markdown",
- "id": "98a4e944",
+ "id": "ef8c1445",
"metadata": {
"editable": true
},
@@ -5307,7 +4964,7 @@
},
{
"cell_type": "markdown",
- "id": "8c6e3845",
+ "id": "3d542210",
"metadata": {
"editable": true
},
@@ -5326,7 +4983,7 @@
},
{
"cell_type": "markdown",
- "id": "bc13a77d",
+ "id": "93a12764",
"metadata": {
"editable": true
},
@@ -5344,7 +5001,7 @@
},
{
"cell_type": "markdown",
- "id": "19d6cd9e",
+ "id": "ab31ef4e",
"metadata": {
"editable": true
},
@@ -5358,7 +5015,7 @@
},
{
"cell_type": "markdown",
- "id": "c5c7eee1",
+ "id": "48d5864c",
"metadata": {
"editable": true
},
@@ -5372,13 +5029,24 @@
},
{
"cell_type": "code",
- "execution_count": 27,
- "id": "6ab6bcc3",
+ "execution_count": 16,
+ "id": "de29006a",
"metadata": {
"collapsed": false,
"editable": true
},
- "outputs": [],
+ "outputs": [
+ {
+ "name": "stdout",
+ "output_type": "stream",
+ "text": [
+ "0.10790125813226321\n",
+ "4.340071371496255\n",
+ "[[ 1.04193203 3.08165104]\n",
+ " [ 3.08165104 10.18383522]]\n"
+ ]
+ }
+ ],
"source": [
"# Importing various packages\n",
"import numpy as np\n",
@@ -5394,7 +5062,7 @@
},
{
"cell_type": "markdown",
- "id": "839a512c",
+ "id": "b81e82a1",
"metadata": {
"editable": true
},
@@ -5410,13 +5078,24 @@
},
{
"cell_type": "code",
- "execution_count": 28,
- "id": "bad7396d",
+ "execution_count": 17,
+ "id": "59d716dc",
"metadata": {
"collapsed": false,
"editable": true
},
- "outputs": [],
+ "outputs": [
+ {
+ "name": "stdout",
+ "output_type": "stream",
+ "text": [
+ "0.08881497884574564\n",
+ "1.7086067479626619\n",
+ "[[1. 0.66080313]\n",
+ " [0.66080313 1. ]]\n"
+ ]
+ }
+ ],
"source": [
"import numpy as np\n",
"n = 100\n",
@@ -5443,7 +5122,7 @@
},
{
"cell_type": "markdown",
- "id": "365c6ef8",
+ "id": "7f3a4e9a",
"metadata": {
"editable": true
},
@@ -5457,7 +5136,7 @@
},
{
"cell_type": "markdown",
- "id": "6fd82fe9",
+ "id": "0be6217d",
"metadata": {
"editable": true
},
@@ -5469,13 +5148,44 @@
},
{
"cell_type": "code",
- "execution_count": 29,
- "id": "80ba738c",
+ "execution_count": 18,
+ "id": "c90c9bbd",
"metadata": {
"collapsed": false,
"editable": true
},
- "outputs": [],
+ "outputs": [
+ {
+ "name": "stdout",
+ "output_type": "stream",
+ "text": [
+ "[[-0.40620066 -2.01265755]\n",
+ " [ 0.01458611 0.37737221]\n",
+ " [-1.0895387 -3.65442354]\n",
+ " [ 0.2338675 1.12044974]\n",
+ " [ 0.4676059 1.54393936]\n",
+ " [-0.65891389 -3.16304863]\n",
+ " [-0.1715252 0.39197698]\n",
+ " [ 0.71142161 2.95511792]\n",
+ " [ 0.39214397 0.13069442]\n",
+ " [ 0.50655336 2.3105791 ]]\n",
+ " 0 1\n",
+ "0 -0.406201 -2.012658\n",
+ "1 0.014586 0.377372\n",
+ "2 -1.089539 -3.654424\n",
+ "3 0.233868 1.120450\n",
+ "4 0.467606 1.543939\n",
+ "5 -0.658914 -3.163049\n",
+ "6 -0.171525 0.391977\n",
+ "7 0.711422 2.955118\n",
+ "8 0.392144 0.130694\n",
+ "9 0.506553 2.310579\n",
+ " 0 1\n",
+ "0 1.000000 0.952387\n",
+ "1 0.952387 1.000000\n"
+ ]
+ }
+ ],
"source": [
"import numpy as np\n",
"import pandas as pd\n",
@@ -5495,7 +5205,7 @@
},
{
"cell_type": "markdown",
- "id": "4f390c8f",
+ "id": "23861648",
"metadata": {
"editable": true
},
@@ -5505,7 +5215,7 @@
},
{
"cell_type": "markdown",
- "id": "4bceabcb",
+ "id": "47a35083",
"metadata": {
"editable": true
},
@@ -5515,13 +5225,53 @@
},
{
"cell_type": "code",
- "execution_count": 30,
- "id": "0146e7c8",
+ "execution_count": 19,
+ "id": "7ac06d35",
"metadata": {
"collapsed": false,
"editable": true
},
- "outputs": [],
+ "outputs": [
+ {
+ "name": "stdout",
+ "output_type": "stream",
+ "text": [
+ " 0 1 2 3 4 5 6 7 \\\n",
+ "0 0.0 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 \n",
+ "1 0.0 0.078974 0.081276 0.075889 0.077168 0.078540 0.065410 0.066474 \n",
+ "2 0.0 0.081276 0.084076 0.078336 0.079946 0.081655 0.067707 0.069028 \n",
+ "3 0.0 0.075889 0.078336 0.077460 0.078986 0.080616 0.069452 0.070737 \n",
+ "4 0.0 0.077168 0.079946 0.078986 0.080764 0.082653 0.070986 0.072476 \n",
+ "5 0.0 0.078540 0.081655 0.080616 0.082653 0.084809 0.072621 0.074323 \n",
+ "6 0.0 0.065410 0.067707 0.069452 0.070986 0.072621 0.064074 0.065378 \n",
+ "7 0.0 0.066474 0.069028 0.070737 0.072476 0.074323 0.065378 0.066854 \n",
+ "8 0.0 0.067637 0.070457 0.072132 0.074084 0.076150 0.066787 0.068441 \n",
+ "9 0.0 0.068906 0.072000 0.073644 0.075816 0.078110 0.068307 0.070146 \n",
+ "10 0.0 0.055734 0.057835 0.060872 0.062337 0.063894 0.057393 0.058645 \n",
+ "11 0.0 0.056683 0.058996 0.062016 0.063653 0.065390 0.058552 0.059951 \n",
+ "12 0.0 0.057722 0.060254 0.063260 0.065077 0.066999 0.059807 0.061359 \n",
+ "13 0.0 0.058854 0.061614 0.064609 0.066612 0.068727 0.061163 0.062874 \n",
+ "14 0.0 0.060083 0.063080 0.066066 0.068264 0.070582 0.062624 0.064501 \n",
+ "\n",
+ " 8 9 10 11 12 13 14 \n",
+ "0 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 \n",
+ "1 0.067637 0.068906 0.055734 0.056683 0.057722 0.058854 0.060083 \n",
+ "2 0.070457 0.072000 0.057835 0.058996 0.060254 0.061614 0.063080 \n",
+ "3 0.072132 0.073644 0.060872 0.062016 0.063260 0.064609 0.066066 \n",
+ "4 0.074084 0.075816 0.062337 0.063653 0.065077 0.066612 0.068264 \n",
+ "5 0.076150 0.078110 0.063894 0.065390 0.066999 0.068727 0.070582 \n",
+ "6 0.066787 0.068307 0.057393 0.058552 0.059807 0.061163 0.062624 \n",
+ "7 0.068441 0.070146 0.058645 0.059951 0.061359 0.062874 0.064501 \n",
+ "8 0.070213 0.072111 0.059993 0.061452 0.063019 0.064699 0.066500 \n",
+ "9 0.072111 0.074210 0.061443 0.063061 0.064793 0.066647 0.068629 \n",
+ "10 0.059993 0.061443 0.052305 0.053417 0.054617 0.055910 0.057300 \n",
+ "11 0.061452 0.063061 0.053417 0.054655 0.055987 0.057418 0.058952 \n",
+ "12 0.063019 0.064793 0.054617 0.055987 0.057457 0.059031 0.060716 \n",
+ "13 0.064699 0.066647 0.055910 0.057418 0.059031 0.060756 0.062599 \n",
+ "14 0.066500 0.068629 0.057300 0.058952 0.060716 0.062599 0.064606 \n"
+ ]
+ }
+ ],
"source": [
"# Common imports\n",
"import numpy as np\n",
@@ -5570,7 +5320,7 @@
},
{
"cell_type": "markdown",
- "id": "6e15d041",
+ "id": "1b096c22",
"metadata": {
"editable": true
},
@@ -5587,7 +5337,7 @@
},
{
"cell_type": "markdown",
- "id": "107d5b46",
+ "id": "df200389",
"metadata": {
"editable": true
},
@@ -5599,7 +5349,7 @@
},
{
"cell_type": "markdown",
- "id": "e47d0e76",
+ "id": "1d05f20f",
"metadata": {
"editable": true
},
@@ -5611,7 +5361,7 @@
},
{
"cell_type": "markdown",
- "id": "86b8daf6",
+ "id": "686f4de4",
"metadata": {
"editable": true
},
@@ -5621,7 +5371,7 @@
},
{
"cell_type": "markdown",
- "id": "934cc6c5",
+ "id": "5f1d2cf2",
"metadata": {
"editable": true
},
@@ -5638,7 +5388,7 @@
},
{
"cell_type": "markdown",
- "id": "2a384ee9",
+ "id": "c3af1edc",
"metadata": {
"editable": true
},
@@ -5648,7 +5398,7 @@
},
{
"cell_type": "markdown",
- "id": "e9a632a7",
+ "id": "16e4f2e4",
"metadata": {
"editable": true
},
@@ -5663,7 +5413,7 @@
},
{
"cell_type": "markdown",
- "id": "8cbf4cb8",
+ "id": "cfebd376",
"metadata": {
"editable": true
},
@@ -5673,7 +5423,7 @@
},
{
"cell_type": "markdown",
- "id": "b29a7909",
+ "id": "4e9bf897",
"metadata": {
"editable": true
},
@@ -5687,7 +5437,7 @@
},
{
"cell_type": "markdown",
- "id": "31b9c6a9",
+ "id": "a72e01ca",
"metadata": {
"editable": true
},
@@ -5699,7 +5449,7 @@
},
{
"cell_type": "markdown",
- "id": "cdc2f810",
+ "id": "8551cc9e",
"metadata": {
"editable": true
},
@@ -5711,7 +5461,7 @@
},
{
"cell_type": "markdown",
- "id": "0b7d368d",
+ "id": "2dc67193",
"metadata": {
"editable": true
},
@@ -5723,7 +5473,7 @@
},
{
"cell_type": "markdown",
- "id": "6d5ddd28",
+ "id": "7f9b2782",
"metadata": {
"editable": true
},
@@ -5733,7 +5483,7 @@
},
{
"cell_type": "markdown",
- "id": "a18622fc",
+ "id": "e7e4222d",
"metadata": {
"editable": true
},
@@ -5745,7 +5495,7 @@
},
{
"cell_type": "markdown",
- "id": "b5a8893c",
+ "id": "98a151ba",
"metadata": {
"editable": true
},
@@ -5755,7 +5505,7 @@
},
{
"cell_type": "markdown",
- "id": "50a0a62a",
+ "id": "30667b0e",
"metadata": {
"editable": true
},
@@ -5772,7 +5522,7 @@
},
{
"cell_type": "markdown",
- "id": "20380d89",
+ "id": "f72ff51e",
"metadata": {
"editable": true
},
@@ -5782,7 +5532,7 @@
},
{
"cell_type": "markdown",
- "id": "10805b50",
+ "id": "80b9b440",
"metadata": {
"editable": true
},
@@ -5794,7 +5544,7 @@
},
{
"cell_type": "markdown",
- "id": "b9c31a46",
+ "id": "0f19edd6",
"metadata": {
"editable": true
},
@@ -5804,7 +5554,7 @@
},
{
"cell_type": "markdown",
- "id": "1f48b48e",
+ "id": "e0f2758b",
"metadata": {
"editable": true
},
@@ -5816,7 +5566,7 @@
},
{
"cell_type": "markdown",
- "id": "ad8f7a8c",
+ "id": "3ba08a96",
"metadata": {
"editable": true
},
@@ -5830,7 +5580,7 @@
},
{
"cell_type": "markdown",
- "id": "9e0dec01",
+ "id": "b7271b81",
"metadata": {
"editable": true
},
@@ -5842,7 +5592,7 @@
},
{
"cell_type": "markdown",
- "id": "46fd0b6d",
+ "id": "56ad87f1",
"metadata": {
"editable": true
},
@@ -5864,7 +5614,7 @@
},
{
"cell_type": "markdown",
- "id": "3d2047ca",
+ "id": "d7c4dc29",
"metadata": {
"editable": true
},
@@ -5876,7 +5626,7 @@
},
{
"cell_type": "markdown",
- "id": "4a5f5016",
+ "id": "3209959e",
"metadata": {
"editable": true
},
@@ -5891,7 +5641,7 @@
},
{
"cell_type": "markdown",
- "id": "52651fc6",
+ "id": "8466bcf7",
"metadata": {
"editable": true
},
@@ -5903,7 +5653,7 @@
},
{
"cell_type": "markdown",
- "id": "fea09344",
+ "id": "a44c56d3",
"metadata": {
"editable": true
},
@@ -5915,7 +5665,7 @@
},
{
"cell_type": "markdown",
- "id": "bcfd303f",
+ "id": "0dc26201",
"metadata": {
"editable": true
},
@@ -5925,7 +5675,7 @@
},
{
"cell_type": "markdown",
- "id": "f684d942",
+ "id": "ed78f0e3",
"metadata": {
"editable": true
},
@@ -5937,7 +5687,7 @@
},
{
"cell_type": "markdown",
- "id": "1e54bd36",
+ "id": "3a072221",
"metadata": {
"editable": true
},
@@ -5947,7 +5697,7 @@
},
{
"cell_type": "markdown",
- "id": "4cdcdef2",
+ "id": "60baf463",
"metadata": {
"editable": true
},
@@ -5959,7 +5709,7 @@
},
{
"cell_type": "markdown",
- "id": "a6d5bd03",
+ "id": "60ff042d",
"metadata": {
"editable": true
},
@@ -5969,7 +5719,7 @@
},
{
"cell_type": "markdown",
- "id": "a4d9fc21",
+ "id": "1c31b285",
"metadata": {
"editable": true
},
@@ -5981,7 +5731,7 @@
},
{
"cell_type": "markdown",
- "id": "119bc56e",
+ "id": "4587edf9",
"metadata": {
"editable": true
},
@@ -5998,7 +5748,7 @@
},
{
"cell_type": "markdown",
- "id": "d15cad60",
+ "id": "3a423c6a",
"metadata": {
"editable": true
},
@@ -6011,7 +5761,7 @@
},
{
"cell_type": "markdown",
- "id": "f725d905",
+ "id": "d53b24a7",
"metadata": {
"editable": true
},
@@ -6023,7 +5773,7 @@
},
{
"cell_type": "markdown",
- "id": "a2a5b25f",
+ "id": "9d589cad",
"metadata": {
"editable": true
},
@@ -6033,7 +5783,7 @@
},
{
"cell_type": "markdown",
- "id": "a9f43162",
+ "id": "f6e8bb3f",
"metadata": {
"editable": true
},
@@ -6046,7 +5796,7 @@
},
{
"cell_type": "markdown",
- "id": "debb0a19",
+ "id": "c01d5a5e",
"metadata": {
"editable": true
},
@@ -6056,7 +5806,7 @@
},
{
"cell_type": "markdown",
- "id": "2764c014",
+ "id": "46e5562b",
"metadata": {
"editable": true
},
@@ -6068,7 +5818,7 @@
},
{
"cell_type": "markdown",
- "id": "ad141726",
+ "id": "44d5398b",
"metadata": {
"editable": true
},
@@ -6081,7 +5831,7 @@
},
{
"cell_type": "markdown",
- "id": "d194482f",
+ "id": "addf0d49",
"metadata": {
"editable": true
},
@@ -6094,7 +5844,7 @@
},
{
"cell_type": "markdown",
- "id": "7ccf56c7",
+ "id": "fdb87f8d",
"metadata": {
"editable": true
},
@@ -6106,7 +5856,7 @@
},
{
"cell_type": "markdown",
- "id": "41939010",
+ "id": "69d507e7",
"metadata": {
"editable": true
},
@@ -6118,7 +5868,7 @@
},
{
"cell_type": "markdown",
- "id": "93d38078",
+ "id": "a4b61630",
"metadata": {
"editable": true
},
@@ -6128,7 +5878,7 @@
},
{
"cell_type": "markdown",
- "id": "9c6d063a",
+ "id": "c82b13a0",
"metadata": {
"editable": true
},
@@ -6141,7 +5891,7 @@
},
{
"cell_type": "markdown",
- "id": "90d9a525",
+ "id": "9d225ea8",
"metadata": {
"editable": true
},
@@ -6153,7 +5903,7 @@
},
{
"cell_type": "markdown",
- "id": "d1c9d3ea",
+ "id": "293d144e",
"metadata": {
"editable": true
},
@@ -6165,7 +5915,7 @@
},
{
"cell_type": "markdown",
- "id": "6a03fd03",
+ "id": "2ba90687",
"metadata": {
"editable": true
},
@@ -6177,7 +5927,7 @@
},
{
"cell_type": "markdown",
- "id": "12f9e2f4",
+ "id": "71b67ece",
"metadata": {
"editable": true
},
@@ -6189,7 +5939,7 @@
},
{
"cell_type": "markdown",
- "id": "0bd449c0",
+ "id": "848de99f",
"metadata": {
"editable": true
},
@@ -6203,7 +5953,7 @@
},
{
"cell_type": "markdown",
- "id": "528f4c54",
+ "id": "229ab3bb",
"metadata": {
"editable": true
},
@@ -6215,7 +5965,7 @@
},
{
"cell_type": "markdown",
- "id": "a4e89b45",
+ "id": "fafe6f12",
"metadata": {
"editable": true
},
@@ -6225,7 +5975,7 @@
},
{
"cell_type": "markdown",
- "id": "af51b23c",
+ "id": "075b9702",
"metadata": {
"editable": true
},
@@ -6237,7 +5987,7 @@
},
{
"cell_type": "markdown",
- "id": "26945717",
+ "id": "4e8ad796",
"metadata": {
"editable": true
},
@@ -6249,7 +5999,7 @@
},
{
"cell_type": "markdown",
- "id": "70a85186",
+ "id": "070bea88",
"metadata": {
"editable": true
},
@@ -6261,7 +6011,7 @@
},
{
"cell_type": "markdown",
- "id": "86de1af1",
+ "id": "cbb1a6d0",
"metadata": {
"editable": true
},
@@ -6273,7 +6023,7 @@
},
{
"cell_type": "markdown",
- "id": "a7eaaac6",
+ "id": "62ea95e8",
"metadata": {
"editable": true
},
@@ -6285,7 +6035,7 @@
},
{
"cell_type": "markdown",
- "id": "732d4020",
+ "id": "1d0a0c3f",
"metadata": {
"editable": true
},
@@ -6304,7 +6054,7 @@
},
{
"cell_type": "markdown",
- "id": "06f71f9c",
+ "id": "502bf9b1",
"metadata": {
"editable": true
},
@@ -6316,7 +6066,7 @@
},
{
"cell_type": "markdown",
- "id": "04266404",
+ "id": "b98b3e29",
"metadata": {
"editable": true
},
@@ -6326,7 +6076,7 @@
},
{
"cell_type": "markdown",
- "id": "753d4bf0",
+ "id": "9afa64c1",
"metadata": {
"editable": true
},
@@ -6338,7 +6088,7 @@
},
{
"cell_type": "markdown",
- "id": "ea8b1f8f",
+ "id": "756fc3c6",
"metadata": {
"editable": true
},
@@ -6348,7 +6098,7 @@
},
{
"cell_type": "markdown",
- "id": "12703a7e",
+ "id": "9faf05fa",
"metadata": {
"editable": true
},
@@ -6360,7 +6110,7 @@
},
{
"cell_type": "markdown",
- "id": "90522189",
+ "id": "36e62812",
"metadata": {
"editable": true
},
@@ -6372,7 +6122,7 @@
},
{
"cell_type": "markdown",
- "id": "b81abc7b",
+ "id": "dee00fc3",
"metadata": {
"editable": true
},
@@ -6388,7 +6138,7 @@
},
{
"cell_type": "markdown",
- "id": "115018b1",
+ "id": "1287f83a",
"metadata": {
"editable": true
},
@@ -6400,7 +6150,7 @@
},
{
"cell_type": "markdown",
- "id": "8741b7a9",
+ "id": "b4240a7b",
"metadata": {
"editable": true
},
@@ -6412,7 +6162,7 @@
},
{
"cell_type": "markdown",
- "id": "5fe75d98",
+ "id": "fd444925",
"metadata": {
"editable": true
},
@@ -6422,7 +6172,7 @@
},
{
"cell_type": "markdown",
- "id": "522e6278",
+ "id": "5b055ab3",
"metadata": {
"editable": true
},
@@ -6434,7 +6184,7 @@
},
{
"cell_type": "markdown",
- "id": "eaa39cca",
+ "id": "bc539215",
"metadata": {
"editable": true
},
@@ -6444,7 +6194,7 @@
},
{
"cell_type": "markdown",
- "id": "230a8059",
+ "id": "5a4af335",
"metadata": {
"editable": true
},
@@ -6456,7 +6206,7 @@
},
{
"cell_type": "markdown",
- "id": "698a93f7",
+ "id": "94a4c6dc",
"metadata": {
"editable": true
},
@@ -6473,7 +6223,7 @@
},
{
"cell_type": "markdown",
- "id": "96e49fbc",
+ "id": "6cef8bfb",
"metadata": {
"editable": true
},
@@ -6485,7 +6235,7 @@
},
{
"cell_type": "markdown",
- "id": "f2043d81",
+ "id": "5f04ae7d",
"metadata": {
"editable": true
},
@@ -6497,7 +6247,7 @@
},
{
"cell_type": "markdown",
- "id": "f2dd8e44",
+ "id": "35418e34",
"metadata": {
"editable": true
},
@@ -6507,7 +6257,7 @@
},
{
"cell_type": "markdown",
- "id": "0ab90bb2",
+ "id": "df4a83ee",
"metadata": {
"editable": true
},
@@ -6519,7 +6269,7 @@
},
{
"cell_type": "markdown",
- "id": "1090467c",
+ "id": "43751ced",
"metadata": {
"editable": true
},
@@ -6529,7 +6279,7 @@
},
{
"cell_type": "markdown",
- "id": "8bc71963",
+ "id": "4a030f43",
"metadata": {
"editable": true
},
@@ -6541,7 +6291,7 @@
},
{
"cell_type": "markdown",
- "id": "918da4ad",
+ "id": "9e27747e",
"metadata": {
"editable": true
},
@@ -6551,7 +6301,7 @@
},
{
"cell_type": "markdown",
- "id": "ee673e3d",
+ "id": "be4c8f46",
"metadata": {
"editable": true
},
@@ -6563,7 +6313,7 @@
},
{
"cell_type": "markdown",
- "id": "03352030",
+ "id": "7da22e7f",
"metadata": {
"editable": true
},
@@ -6573,7 +6323,7 @@
},
{
"cell_type": "markdown",
- "id": "1b29a63e",
+ "id": "9c059120",
"metadata": {
"editable": true
},
@@ -6585,7 +6335,7 @@
},
{
"cell_type": "markdown",
- "id": "206bcec2",
+ "id": "aa7c7a38",
"metadata": {
"editable": true
},
diff --git a/doc/LectureNotes/_build/jupyter_execute/week35.py b/doc/LectureNotes/_build/jupyter_execute/week35.py
index b962e32d6..a585aeda5 100644
--- a/doc/LectureNotes/_build/jupyter_execute/week35.py
+++ b/doc/LectureNotes/_build/jupyter_execute/week35.py
@@ -6,9 +6,9 @@
#
# # Week 35: From Ordinary Linear Regression to Ridge and Lasso Regression
-# **Morten Hjorth-Jensen**, Department of Physics, University of Oslo and Department of Physics and Astronomy and National Superconducting Cyclotron Laboratory, Michigan State University
+# **Morten Hjorth-Jensen**, Department of Physics, University of Oslo
#
-# Date: **August 26-30**
+# Date: **August 26-30, 2024**
# ## Plans for week 35
#
@@ -16,7 +16,7 @@
#
# 1. Brief repetition from last week
#
-# 2. Derivation of the equations for ordinary least squares
+# 2. Discussions of the equations for ordinary least squares
#
# 3. Discussion on how to prepare data and examples of applications of linear regression
#
@@ -26,11 +26,15 @@
# ### Reading recommendations:
#
-# 1. See lecture notes for week 35 at
+# 1. These lecture notes
#
# 2. Goodfellow, Bengio and Courville, Deep Learning, chapter 2 on linear algebra and sections 3.1-3.10 on elements of statistics (background)
+#
+# 3. Raschka et al on preprocessing of data, relevant for exercise 3 this week, see chapter 4.
+#
+# 4. For exercise 1 of week 35, the book by A. Aldo Faisal, Cheng Soon Ong, and Marc Peter Deisenroth on the Mathematics of Machine Learning, may be very relevant. In particular chapter 5 at URL"https://mml-book.github.io/" (section 5.5 on derivatives) is very useful for exercise 1 this coming week.
-# ## Why Linear Regression (aka Ordinary Least Squares and family), repeat from last week
+# ## For exercise sessions: Why Linear Regression (aka Ordinary Least Squares and family), repeat from last week
#
# We need first a reminder from last week about linear regression.
#
@@ -1264,206 +1268,7 @@ plt.show()
# intercept. This becomes more important when we discuss Ridge and Lasso
# regression next week.
-# ## The Boston housing data example
-#
-# The Boston housing
-# data set was originally a part of UCI Machine Learning Repository
-# and has been removed now. The data set is now included in **Scikit-Learn**'s
-# library. There are 506 samples and 13 feature (predictor) variables
-# in this data set. The objective is to predict the value of prices of
-# the house using the features (predictors) listed here.
-#
-# The features/predictors are
-# 1. CRIM: Per capita crime rate by town
-#
-# 2. ZN: Proportion of residential land zoned for lots over 25000 square feet
-#
-# 3. INDUS: Proportion of non-retail business acres per town
-#
-# 4. CHAS: Charles River dummy variable (= 1 if tract bounds river; 0 otherwise)
-#
-# 5. NOX: Nitric oxide concentration (parts per 10 million)
-#
-# 6. RM: Average number of rooms per dwelling
-#
-# 7. AGE: Proportion of owner-occupied units built prior to 1940
-#
-# 8. DIS: Weighted distances to five Boston employment centers
-#
-# 9. RAD: Index of accessibility to radial highways
-#
-# 10. TAX: Full-value property tax rate per USD10000
-#
-# 11. B: $1000(Bk - 0.63)^2$, where $Bk$ is the proportion of [people of African American descent] by town
-#
-# 12. LSTAT: Percentage of lower status of the population
-#
-# 13. MEDV: Median value of owner-occupied homes in USD 1000s
-
-# ## Housing data, the code
-# We start by importing the libraries
-
-# In[15]:
-
-
-import numpy as np
-import matplotlib.pyplot as plt
-
-import pandas as pd
-import seaborn as sns
-
-
-# and load the Boston Housing DataSet from **Scikit-Learn**
-
-# In[16]:
-
-
-from sklearn.datasets import load_boston
-
-boston_dataset = load_boston()
-
-# boston_dataset is a dictionary
-# let's check what it contains
-boston_dataset.keys()
-
-
-# Then we invoke Pandas
-
-# In[17]:
-
-
-boston = pd.DataFrame(boston_dataset.data, columns=boston_dataset.feature_names)
-boston.head()
-boston['MEDV'] = boston_dataset.target
-
-
-# and preprocess the data
-
-# In[18]:
-
-
-# check for missing values in all the columns
-boston.isnull().sum()
-
-
-# We can then visualize the data
-
-# In[19]:
-
-
-# set the size of the figure
-sns.set(rc={'figure.figsize':(11.7,8.27)})
-
-# plot a histogram showing the distribution of the target values
-sns.distplot(boston['MEDV'], bins=30)
-plt.show()
-
-
-# It is now useful to look at the correlation matrix
-
-# In[20]:
-
-
-# compute the pair wise correlation for all columns
-correlation_matrix = boston.corr().round(2)
-# use the heatmap function from seaborn to plot the correlation matrix
-# annot = True to print the values inside the square
-sns.heatmap(data=correlation_matrix, annot=True)
-
-
-# From the above coorelation plot we can see that **MEDV** is strongly correlated to **LSTAT** and **RM**. We see also that **RAD** and **TAX** are stronly correlated, but we don't include this in our features together to avoid multi-colinearity
-
-# In[21]:
-
-
-plt.figure(figsize=(20, 5))
-
-features = ['LSTAT', 'RM']
-target = boston['MEDV']
-
-for i, col in enumerate(features):
- plt.subplot(1, len(features) , i+1)
- x = boston[col]
- y = target
- plt.scatter(x, y, marker='o')
- plt.title(col)
- plt.xlabel(col)
- plt.ylabel('MEDV')
-
-
-# Now we start training our model
-
-# In[22]:
-
-
-X = pd.DataFrame(np.c_[boston['LSTAT'], boston['RM']], columns = ['LSTAT','RM'])
-Y = boston['MEDV']
-
-
-# We split the data into training and test sets
-
-# In[23]:
-
-
-from sklearn.model_selection import train_test_split
-
-# splits the training and test data set in 80% : 20%
-# assign random_state to any value.This ensures consistency.
-X_train, X_test, Y_train, Y_test = train_test_split(X, Y, test_size = 0.2, random_state=5)
-print(X_train.shape)
-print(X_test.shape)
-print(Y_train.shape)
-print(Y_test.shape)
-
-
-# Then we use the linear regression functionality from **Scikit-Learn**
-
-# In[24]:
-
-
-from sklearn.linear_model import LinearRegression
-from sklearn.metrics import mean_squared_error, r2_score
-
-lin_model = LinearRegression()
-lin_model.fit(X_train, Y_train)
-
-# model evaluation for training set
-
-y_train_predict = lin_model.predict(X_train)
-rmse = (np.sqrt(mean_squared_error(Y_train, y_train_predict)))
-r2 = r2_score(Y_train, y_train_predict)
-
-print("The model performance for training set")
-print("--------------------------------------")
-print('RMSE is {}'.format(rmse))
-print('R2 score is {}'.format(r2))
-print("\n")
-
-# model evaluation for testing set
-
-y_test_predict = lin_model.predict(X_test)
-# root mean square error of the model
-rmse = (np.sqrt(mean_squared_error(Y_test, y_test_predict)))
-
-# r-squared score of the model
-r2 = r2_score(Y_test, y_test_predict)
-
-print("The model performance for testing set")
-print("--------------------------------------")
-print('RMSE is {}'.format(rmse))
-print('R2 score is {}'.format(r2))
-
-
-# In[25]:
-
-
-# plotting the y_test vs y_pred
-# ideally should have been a straight line
-plt.scatter(Y_test, y_test_predict)
-plt.show()
-
-
-# ## Material for lecture Thursday, August 31
+# ## Material for lecture Monday, August 26
# ## Mathematical Interpretation of Ordinary Least Squares
#
@@ -1738,7 +1543,7 @@ plt.show()
# ## Codes for the SVD
-# In[26]:
+# In[15]:
import numpy as np
@@ -2155,7 +1960,7 @@ print(C-X)
# function **np.mean(x)**. We can also extract the eigenvalues of the
# covariance matrix through the **np.linalg.eig()** function.
-# In[27]:
+# In[16]:
# Importing various packages
@@ -2178,7 +1983,7 @@ print(C)
# code which sets up the correlations matrix for the previous example in
# a more brute force way. Here we scale the mean values for each column of the design matrix, calculate the relevant mean values and variances and then finally set up the $2\times 2$ correlation matrix (since we have only two vectors).
-# In[28]:
+# In[17]:
import numpy as np
@@ -2214,7 +2019,7 @@ print(C)
#
# We whow here how we can set up the correlation matrix using **pandas**, as done in this simple code
-# In[29]:
+# In[18]:
import numpy as np
@@ -2237,7 +2042,7 @@ print(correlation_matrix)
# ## Correlation Matrix with Pandas and the Franke function
-# In[30]:
+# In[19]:
# Common imports
diff --git a/doc/LectureNotes/exercisesweek34.ipynb b/doc/LectureNotes/exercisesweek34.ipynb
index a17ecafef..6a84a1d30 100644
--- a/doc/LectureNotes/exercisesweek34.ipynb
+++ b/doc/LectureNotes/exercisesweek34.ipynb
@@ -2,7 +2,7 @@
"cells": [
{
"cell_type": "markdown",
- "id": "72dc0997",
+ "id": "a50ea987",
"metadata": {
"editable": true
},
@@ -14,7 +14,7 @@
},
{
"cell_type": "markdown",
- "id": "8c591125",
+ "id": "291e6015",
"metadata": {
"editable": true
},
@@ -27,7 +27,7 @@
},
{
"cell_type": "markdown",
- "id": "1ad21876",
+ "id": "141ff111",
"metadata": {
"editable": true
},
@@ -39,7 +39,7 @@
},
{
"cell_type": "markdown",
- "id": "4eaa91e2",
+ "id": "32a1fc9e",
"metadata": {
"editable": true
},
@@ -108,7 +108,7 @@
},
{
"cell_type": "markdown",
- "id": "360adb56",
+ "id": "f103f4c1",
"metadata": {
"editable": true
},
@@ -122,20 +122,21 @@
{
"cell_type": "code",
"execution_count": 1,
- "id": "278aa34f",
+ "id": "81c11edc",
"metadata": {
"collapsed": false,
"editable": true
},
"outputs": [],
"source": [
+ "import numpy as np\n",
"x = np.random.rand(100,1)\n",
"y = 2.0+5*x*x+0.1*np.random.randn(100,1)"
]
},
{
"cell_type": "markdown",
- "id": "1ff20e45",
+ "id": "970bd604",
"metadata": {
"editable": true
},
@@ -149,7 +150,7 @@
},
{
"cell_type": "markdown",
- "id": "e8809de1",
+ "id": "bda3ed04",
"metadata": {
"editable": true
},
@@ -162,7 +163,7 @@
},
{
"cell_type": "markdown",
- "id": "8c9e5277",
+ "id": "ca995691",
"metadata": {
"editable": true
},
@@ -173,7 +174,7 @@
},
{
"cell_type": "markdown",
- "id": "85a5881c",
+ "id": "27cbfeed",
"metadata": {
"editable": true
},
@@ -185,7 +186,7 @@
},
{
"cell_type": "markdown",
- "id": "4fb35d0d",
+ "id": "9e063f6d",
"metadata": {
"editable": true
},
@@ -195,7 +196,7 @@
},
{
"cell_type": "markdown",
- "id": "608f9780",
+ "id": "e582c2bb",
"metadata": {
"editable": true
},
@@ -207,7 +208,7 @@
},
{
"cell_type": "markdown",
- "id": "014bbc09",
+ "id": "59e0ed7a",
"metadata": {
"editable": true
},
@@ -218,7 +219,7 @@
},
{
"cell_type": "markdown",
- "id": "f28863ad",
+ "id": "051e71aa",
"metadata": {
"editable": true
},
@@ -237,7 +238,7 @@
{
"cell_type": "code",
"execution_count": 2,
- "id": "85f75a99",
+ "id": "c82d8b64",
"metadata": {
"collapsed": false,
"editable": true
@@ -253,7 +254,7 @@
},
{
"cell_type": "markdown",
- "id": "bee8d814",
+ "id": "3e810bba",
"metadata": {
"editable": true
},
@@ -263,7 +264,7 @@
},
{
"cell_type": "markdown",
- "id": "7c94f8bd",
+ "id": "c1198fce",
"metadata": {
"editable": true
},
@@ -274,7 +275,7 @@
},
{
"cell_type": "markdown",
- "id": "c0e789dd",
+ "id": "1b0cea0a",
"metadata": {
"editable": true
},
@@ -286,7 +287,7 @@
},
{
"cell_type": "markdown",
- "id": "5ee1d70e",
+ "id": "5194ba08",
"metadata": {
"editable": true
},
diff --git a/doc/LectureNotes/week35.ipynb b/doc/LectureNotes/week35.ipynb
index 40b6c66a9..ce308ef85 100644
--- a/doc/LectureNotes/week35.ipynb
+++ b/doc/LectureNotes/week35.ipynb
@@ -2,7 +2,7 @@
"cells": [
{
"cell_type": "markdown",
- "id": "ea977b24",
+ "id": "0e8171d8",
"metadata": {
"editable": true
},
@@ -14,20 +14,20 @@
},
{
"cell_type": "markdown",
- "id": "a247218b",
+ "id": "d54fb4b6",
"metadata": {
"editable": true
},
"source": [
"# Week 35: From Ordinary Linear Regression to Ridge and Lasso Regression\n",
- "**Morten Hjorth-Jensen**, Department of Physics, University of Oslo and Department of Physics and Astronomy and National Superconducting Cyclotron Laboratory, Michigan State University\n",
+ "**Morten Hjorth-Jensen**, Department of Physics, University of Oslo\n",
"\n",
- "Date: **August 26-30**"
+ "Date: **August 26-30, 2024**"
]
},
{
"cell_type": "markdown",
- "id": "f234b76d",
+ "id": "359ef523",
"metadata": {
"editable": true
},
@@ -38,7 +38,7 @@
"\n",
"1. Brief repetition from last week\n",
"\n",
- "2. Derivation of the equations for ordinary least squares\n",
+ "2. Discussions of the equations for ordinary least squares\n",
"\n",
"3. Discussion on how to prepare data and examples of applications of linear regression\n",
"\n",
@@ -49,26 +49,30 @@
},
{
"cell_type": "markdown",
- "id": "86d0671f",
+ "id": "76ab9350",
"metadata": {
"editable": true
},
"source": [
"### Reading recommendations:\n",
"\n",
- "1. See lecture notes for week 35 at \n",
+ "1. These lecture notes\n",
"\n",
- "2. Goodfellow, Bengio and Courville, Deep Learning, chapter 2 on linear algebra and sections 3.1-3.10 on elements of statistics (background)"
+ "2. Goodfellow, Bengio and Courville, Deep Learning, chapter 2 on linear algebra and sections 3.1-3.10 on elements of statistics (background)\n",
+ "\n",
+ "3. Raschka et al on preprocessing of data, relevant for exercise 3 this week, see chapter 4.\n",
+ "\n",
+ "4. For exercise 1 of week 35, the book by A. Aldo Faisal, Cheng Soon Ong, and Marc Peter Deisenroth on the Mathematics of Machine Learning, may be very relevant. In particular chapter 5 at URL\"https://mml-book.github.io/\" (section 5.5 on derivatives) is very useful for exercise 1 this coming week."
]
},
{
"cell_type": "markdown",
- "id": "0b0bc0ec",
+ "id": "231f16d6",
"metadata": {
"editable": true
},
"source": [
- "## Why Linear Regression (aka Ordinary Least Squares and family), repeat from last week\n",
+ "## For exercise sessions: Why Linear Regression (aka Ordinary Least Squares and family), repeat from last week\n",
"\n",
"We need first a reminder from last week about linear regression. \n",
"\n",
@@ -97,7 +101,7 @@
},
{
"cell_type": "markdown",
- "id": "c30cfd06",
+ "id": "a163dea4",
"metadata": {
"editable": true
},
@@ -113,7 +117,7 @@
},
{
"cell_type": "markdown",
- "id": "59d6452b",
+ "id": "e30d7141",
"metadata": {
"editable": true
},
@@ -125,7 +129,7 @@
},
{
"cell_type": "markdown",
- "id": "8649d84d",
+ "id": "1e391e10",
"metadata": {
"editable": true
},
@@ -135,7 +139,7 @@
},
{
"cell_type": "markdown",
- "id": "aaa65f06",
+ "id": "440e1f2a",
"metadata": {
"editable": true
},
@@ -147,7 +151,7 @@
},
{
"cell_type": "markdown",
- "id": "cc43802e",
+ "id": "4f920c69",
"metadata": {
"editable": true
},
@@ -168,7 +172,7 @@
},
{
"cell_type": "markdown",
- "id": "53877600",
+ "id": "179c4cba",
"metadata": {
"editable": true
},
@@ -180,7 +184,7 @@
},
{
"cell_type": "markdown",
- "id": "bc4478fc",
+ "id": "82d6dd48",
"metadata": {
"editable": true
},
@@ -193,7 +197,7 @@
},
{
"cell_type": "markdown",
- "id": "64bc2ac2",
+ "id": "fb67db20",
"metadata": {
"editable": true
},
@@ -205,7 +209,7 @@
},
{
"cell_type": "markdown",
- "id": "d7b7d1d1",
+ "id": "406fe296",
"metadata": {
"editable": true
},
@@ -217,7 +221,7 @@
},
{
"cell_type": "markdown",
- "id": "f34563f6",
+ "id": "7ca59383",
"metadata": {
"editable": true
},
@@ -227,7 +231,7 @@
},
{
"cell_type": "markdown",
- "id": "1dbad69a",
+ "id": "59b8cb83",
"metadata": {
"editable": true
},
@@ -239,7 +243,7 @@
},
{
"cell_type": "markdown",
- "id": "2a16de00",
+ "id": "5e10e269",
"metadata": {
"editable": true
},
@@ -252,7 +256,7 @@
},
{
"cell_type": "markdown",
- "id": "07115e56",
+ "id": "c8f4a461",
"metadata": {
"editable": true
},
@@ -264,7 +268,7 @@
},
{
"cell_type": "markdown",
- "id": "b90655a4",
+ "id": "8299a747",
"metadata": {
"editable": true
},
@@ -274,7 +278,7 @@
},
{
"cell_type": "markdown",
- "id": "2ac208f1",
+ "id": "e3adcb3e",
"metadata": {
"editable": true
},
@@ -286,7 +290,7 @@
},
{
"cell_type": "markdown",
- "id": "a8197640",
+ "id": "a48bfab5",
"metadata": {
"editable": true
},
@@ -298,7 +302,7 @@
},
{
"cell_type": "markdown",
- "id": "7c72baae",
+ "id": "87754669",
"metadata": {
"editable": true
},
@@ -309,7 +313,7 @@
},
{
"cell_type": "markdown",
- "id": "3c595093",
+ "id": "c4980f00",
"metadata": {
"editable": true
},
@@ -321,7 +325,7 @@
},
{
"cell_type": "markdown",
- "id": "4dab1f87",
+ "id": "1a1adcd3",
"metadata": {
"editable": true
},
@@ -340,7 +344,7 @@
},
{
"cell_type": "markdown",
- "id": "2a85bd46",
+ "id": "8d4dd262",
"metadata": {
"editable": true
},
@@ -353,7 +357,7 @@
},
{
"cell_type": "markdown",
- "id": "5500dd61",
+ "id": "2215a906",
"metadata": {
"editable": true
},
@@ -363,7 +367,7 @@
},
{
"cell_type": "markdown",
- "id": "0072db82",
+ "id": "d293ee98",
"metadata": {
"editable": true
},
@@ -375,7 +379,7 @@
},
{
"cell_type": "markdown",
- "id": "078ec23d",
+ "id": "cc42ead9",
"metadata": {
"editable": true
},
@@ -385,7 +389,7 @@
},
{
"cell_type": "markdown",
- "id": "cc1760bc",
+ "id": "fb13cd8b",
"metadata": {
"editable": true
},
@@ -397,7 +401,7 @@
},
{
"cell_type": "markdown",
- "id": "73d00905",
+ "id": "fc02a912",
"metadata": {
"editable": true
},
@@ -407,7 +411,7 @@
},
{
"cell_type": "markdown",
- "id": "50dff40b",
+ "id": "82afab7b",
"metadata": {
"editable": true
},
@@ -419,7 +423,7 @@
},
{
"cell_type": "markdown",
- "id": "622bf5f5",
+ "id": "843ade9a",
"metadata": {
"editable": true
},
@@ -430,7 +434,7 @@
},
{
"cell_type": "markdown",
- "id": "48bfcf85",
+ "id": "e955afa1",
"metadata": {
"editable": true
},
@@ -442,7 +446,7 @@
},
{
"cell_type": "markdown",
- "id": "07c395fe",
+ "id": "61e860cd",
"metadata": {
"editable": true
},
@@ -452,7 +456,7 @@
},
{
"cell_type": "markdown",
- "id": "d3ccdcb0",
+ "id": "93d2b6e6",
"metadata": {
"editable": true
},
@@ -464,7 +468,7 @@
},
{
"cell_type": "markdown",
- "id": "c1ef9741",
+ "id": "adfd7e62",
"metadata": {
"editable": true
},
@@ -474,7 +478,7 @@
},
{
"cell_type": "markdown",
- "id": "1646a521",
+ "id": "1663846c",
"metadata": {
"editable": true
},
@@ -486,7 +490,7 @@
},
{
"cell_type": "markdown",
- "id": "daa11d84",
+ "id": "12dd4571",
"metadata": {
"editable": true
},
@@ -506,7 +510,7 @@
},
{
"cell_type": "markdown",
- "id": "78b271ce",
+ "id": "57f81768",
"metadata": {
"editable": true
},
@@ -533,7 +537,7 @@
},
{
"cell_type": "markdown",
- "id": "9482d4e6",
+ "id": "7f129030",
"metadata": {
"editable": true
},
@@ -545,7 +549,7 @@
},
{
"cell_type": "markdown",
- "id": "c7787334",
+ "id": "6c35b0ba",
"metadata": {
"editable": true
},
@@ -557,7 +561,7 @@
},
{
"cell_type": "markdown",
- "id": "a7c6c6e4",
+ "id": "162c4ffd",
"metadata": {
"editable": true
},
@@ -573,7 +577,7 @@
},
{
"cell_type": "markdown",
- "id": "dc9f4b6f",
+ "id": "84eee206",
"metadata": {
"editable": true
},
@@ -591,7 +595,7 @@
},
{
"cell_type": "markdown",
- "id": "dbb092e9",
+ "id": "832f9fc3",
"metadata": {
"editable": true
},
@@ -603,7 +607,7 @@
},
{
"cell_type": "markdown",
- "id": "47f695d0",
+ "id": "43a78640",
"metadata": {
"editable": true
},
@@ -615,7 +619,7 @@
},
{
"cell_type": "markdown",
- "id": "6ff6f849",
+ "id": "7fbfd556",
"metadata": {
"editable": true
},
@@ -626,7 +630,7 @@
},
{
"cell_type": "markdown",
- "id": "3fab9d8e",
+ "id": "f0b01c52",
"metadata": {
"editable": true
},
@@ -638,7 +642,7 @@
},
{
"cell_type": "markdown",
- "id": "230d417b",
+ "id": "fb5c1bd7",
"metadata": {
"editable": true
},
@@ -648,7 +652,7 @@
},
{
"cell_type": "markdown",
- "id": "ae3eea03",
+ "id": "9a0a695d",
"metadata": {
"editable": true
},
@@ -660,7 +664,7 @@
},
{
"cell_type": "markdown",
- "id": "97d7d08a",
+ "id": "87e15057",
"metadata": {
"editable": true
},
@@ -674,7 +678,7 @@
},
{
"cell_type": "markdown",
- "id": "dbcabc11",
+ "id": "fca1498a",
"metadata": {
"editable": true
},
@@ -686,7 +690,7 @@
},
{
"cell_type": "markdown",
- "id": "7278dcbd",
+ "id": "b8c63be2",
"metadata": {
"editable": true
},
@@ -698,7 +702,7 @@
},
{
"cell_type": "markdown",
- "id": "c16d222a",
+ "id": "2ddd0ffc",
"metadata": {
"editable": true
},
@@ -710,7 +714,7 @@
},
{
"cell_type": "markdown",
- "id": "0d85444e",
+ "id": "509d2ab6",
"metadata": {
"editable": true
},
@@ -720,7 +724,7 @@
},
{
"cell_type": "markdown",
- "id": "4d26bab6",
+ "id": "bb492979",
"metadata": {
"editable": true
},
@@ -732,7 +736,7 @@
},
{
"cell_type": "markdown",
- "id": "b6d57fdf",
+ "id": "ca02a149",
"metadata": {
"editable": true
},
@@ -744,7 +748,7 @@
},
{
"cell_type": "markdown",
- "id": "7a78e5dc",
+ "id": "782c5c3d",
"metadata": {
"editable": true
},
@@ -756,7 +760,7 @@
},
{
"cell_type": "markdown",
- "id": "6231367b",
+ "id": "749d69a8",
"metadata": {
"editable": true
},
@@ -770,7 +774,7 @@
},
{
"cell_type": "markdown",
- "id": "ab068594",
+ "id": "e2910da5",
"metadata": {
"editable": true
},
@@ -782,7 +786,7 @@
},
{
"cell_type": "markdown",
- "id": "07d2f06b",
+ "id": "effa9035",
"metadata": {
"editable": true
},
@@ -794,7 +798,7 @@
},
{
"cell_type": "markdown",
- "id": "d2382139",
+ "id": "89e33e6e",
"metadata": {
"editable": true
},
@@ -806,7 +810,7 @@
},
{
"cell_type": "markdown",
- "id": "7d063f00",
+ "id": "5a0e8a3b",
"metadata": {
"editable": true
},
@@ -816,7 +820,7 @@
},
{
"cell_type": "markdown",
- "id": "5e119075",
+ "id": "12119d38",
"metadata": {
"editable": true
},
@@ -828,7 +832,7 @@
},
{
"cell_type": "markdown",
- "id": "700eaedb",
+ "id": "b8e2462f",
"metadata": {
"editable": true
},
@@ -838,7 +842,7 @@
},
{
"cell_type": "markdown",
- "id": "51e05fca",
+ "id": "ba9fdb35",
"metadata": {
"editable": true
},
@@ -850,7 +854,7 @@
},
{
"cell_type": "markdown",
- "id": "bba7f463",
+ "id": "ac7406a7",
"metadata": {
"editable": true
},
@@ -860,7 +864,7 @@
},
{
"cell_type": "markdown",
- "id": "601577cc",
+ "id": "01329146",
"metadata": {
"editable": true
},
@@ -872,7 +876,7 @@
},
{
"cell_type": "markdown",
- "id": "ea31952c",
+ "id": "3575ca3b",
"metadata": {
"editable": true
},
@@ -884,7 +888,7 @@
},
{
"cell_type": "markdown",
- "id": "fc6c86a7",
+ "id": "bda9dbe5",
"metadata": {
"editable": true
},
@@ -896,7 +900,7 @@
},
{
"cell_type": "markdown",
- "id": "ffe09390",
+ "id": "a50cda13",
"metadata": {
"editable": true
},
@@ -911,7 +915,7 @@
},
{
"cell_type": "markdown",
- "id": "22f4970c",
+ "id": "98a5bfd3",
"metadata": {
"editable": true
},
@@ -923,7 +927,7 @@
},
{
"cell_type": "markdown",
- "id": "4ba751cb",
+ "id": "29825b92",
"metadata": {
"editable": true
},
@@ -933,7 +937,7 @@
},
{
"cell_type": "markdown",
- "id": "87052e13",
+ "id": "98cd166a",
"metadata": {
"editable": true
},
@@ -945,7 +949,7 @@
},
{
"cell_type": "markdown",
- "id": "e24dea19",
+ "id": "ac113691",
"metadata": {
"editable": true
},
@@ -955,7 +959,7 @@
},
{
"cell_type": "markdown",
- "id": "6b52c737",
+ "id": "4885434d",
"metadata": {
"editable": true
},
@@ -967,7 +971,7 @@
},
{
"cell_type": "markdown",
- "id": "904b93aa",
+ "id": "0be054ab",
"metadata": {
"editable": true
},
@@ -977,7 +981,7 @@
},
{
"cell_type": "markdown",
- "id": "439e197d",
+ "id": "56bd4473",
"metadata": {
"editable": true
},
@@ -989,7 +993,7 @@
},
{
"cell_type": "markdown",
- "id": "f5658ed9",
+ "id": "f7696e03",
"metadata": {
"editable": true
},
@@ -1001,7 +1005,7 @@
},
{
"cell_type": "markdown",
- "id": "6f99984d",
+ "id": "52b3aee8",
"metadata": {
"editable": true
},
@@ -1013,7 +1017,7 @@
},
{
"cell_type": "markdown",
- "id": "eeb1373c",
+ "id": "5ae5b749",
"metadata": {
"editable": true
},
@@ -1023,7 +1027,7 @@
},
{
"cell_type": "markdown",
- "id": "f3c557ba",
+ "id": "ad4d9e92",
"metadata": {
"editable": true
},
@@ -1035,7 +1039,7 @@
},
{
"cell_type": "markdown",
- "id": "412789d5",
+ "id": "593fb36f",
"metadata": {
"editable": true
},
@@ -1048,7 +1052,7 @@
},
{
"cell_type": "markdown",
- "id": "65fbbb29",
+ "id": "49bdf172",
"metadata": {
"editable": true
},
@@ -1060,7 +1064,7 @@
},
{
"cell_type": "markdown",
- "id": "f4cd65e4",
+ "id": "2fb6ff7e",
"metadata": {
"editable": true
},
@@ -1070,7 +1074,7 @@
},
{
"cell_type": "markdown",
- "id": "9ee329c3",
+ "id": "5dbcf369",
"metadata": {
"editable": true
},
@@ -1082,7 +1086,7 @@
},
{
"cell_type": "markdown",
- "id": "47023d81",
+ "id": "317f4f66",
"metadata": {
"editable": true
},
@@ -1092,7 +1096,7 @@
},
{
"cell_type": "markdown",
- "id": "40d4cc36",
+ "id": "2b3b5bf8",
"metadata": {
"editable": true
},
@@ -1104,7 +1108,7 @@
},
{
"cell_type": "markdown",
- "id": "e266851f",
+ "id": "482872ec",
"metadata": {
"editable": true
},
@@ -1114,7 +1118,7 @@
},
{
"cell_type": "markdown",
- "id": "f4d0941c",
+ "id": "cbfa31c1",
"metadata": {
"editable": true
},
@@ -1126,7 +1130,7 @@
},
{
"cell_type": "markdown",
- "id": "6f4b2a9d",
+ "id": "29d719aa",
"metadata": {
"editable": true
},
@@ -1136,7 +1140,7 @@
},
{
"cell_type": "markdown",
- "id": "62cab30b",
+ "id": "d09f28c9",
"metadata": {
"editable": true
},
@@ -1148,7 +1152,7 @@
},
{
"cell_type": "markdown",
- "id": "4c8c6398",
+ "id": "b563a46a",
"metadata": {
"editable": true
},
@@ -1158,7 +1162,7 @@
},
{
"cell_type": "markdown",
- "id": "f9c6ab8a",
+ "id": "cfb14c2e",
"metadata": {
"editable": true
},
@@ -1170,7 +1174,7 @@
},
{
"cell_type": "markdown",
- "id": "b7945d33",
+ "id": "55d73d59",
"metadata": {
"editable": true
},
@@ -1182,7 +1186,7 @@
},
{
"cell_type": "markdown",
- "id": "80421efe",
+ "id": "0d302953",
"metadata": {
"editable": true
},
@@ -1194,7 +1198,7 @@
},
{
"cell_type": "markdown",
- "id": "cc1fb4bf",
+ "id": "3134df8b",
"metadata": {
"editable": true
},
@@ -1206,7 +1210,7 @@
},
{
"cell_type": "markdown",
- "id": "c149bd15",
+ "id": "f7a379d8",
"metadata": {
"editable": true
},
@@ -1218,7 +1222,7 @@
},
{
"cell_type": "markdown",
- "id": "4aeb6fad",
+ "id": "625b988b",
"metadata": {
"editable": true
},
@@ -1234,7 +1238,7 @@
},
{
"cell_type": "markdown",
- "id": "fecdf631",
+ "id": "9ad87f84",
"metadata": {
"editable": true
},
@@ -1246,7 +1250,7 @@
},
{
"cell_type": "markdown",
- "id": "7ffbaccd",
+ "id": "c09b142d",
"metadata": {
"editable": true
},
@@ -1256,7 +1260,7 @@
},
{
"cell_type": "markdown",
- "id": "ba12c9f2",
+ "id": "87e150ea",
"metadata": {
"editable": true
},
@@ -1268,7 +1272,7 @@
},
{
"cell_type": "markdown",
- "id": "871cfd8e",
+ "id": "df00240d",
"metadata": {
"editable": true
},
@@ -1286,7 +1290,7 @@
},
{
"cell_type": "markdown",
- "id": "0ad332cd",
+ "id": "8fdbd7f8",
"metadata": {
"editable": true
},
@@ -1298,7 +1302,7 @@
},
{
"cell_type": "markdown",
- "id": "5e7042e9",
+ "id": "238c7bd8",
"metadata": {
"editable": true
},
@@ -1310,7 +1314,7 @@
},
{
"cell_type": "markdown",
- "id": "43b825ce",
+ "id": "18a876fb",
"metadata": {
"editable": true
},
@@ -1320,7 +1324,7 @@
},
{
"cell_type": "markdown",
- "id": "58a4ed44",
+ "id": "ef14c409",
"metadata": {
"editable": true
},
@@ -1332,7 +1336,7 @@
},
{
"cell_type": "markdown",
- "id": "202c5775",
+ "id": "13723af9",
"metadata": {
"editable": true
},
@@ -1342,7 +1346,7 @@
},
{
"cell_type": "markdown",
- "id": "0eab64e4",
+ "id": "4d4ffe70",
"metadata": {
"editable": true
},
@@ -1354,7 +1358,7 @@
},
{
"cell_type": "markdown",
- "id": "d17063fa",
+ "id": "6d044514",
"metadata": {
"editable": true
},
@@ -1364,7 +1368,7 @@
},
{
"cell_type": "markdown",
- "id": "02cca57e",
+ "id": "63c7644a",
"metadata": {
"editable": true
},
@@ -1378,7 +1382,7 @@
},
{
"cell_type": "markdown",
- "id": "d5a0e65b",
+ "id": "c2dbbf59",
"metadata": {
"editable": true
},
@@ -1390,7 +1394,7 @@
},
{
"cell_type": "markdown",
- "id": "03f47788",
+ "id": "c972290a",
"metadata": {
"editable": true
},
@@ -1401,7 +1405,7 @@
},
{
"cell_type": "markdown",
- "id": "ab07b7cf",
+ "id": "141194f9",
"metadata": {
"editable": true
},
@@ -1414,7 +1418,7 @@
{
"cell_type": "code",
"execution_count": 1,
- "id": "f51e672d",
+ "id": "015492ec",
"metadata": {
"collapsed": false,
"editable": true
@@ -1441,7 +1445,7 @@
},
{
"cell_type": "markdown",
- "id": "e44be45e",
+ "id": "1d13253b",
"metadata": {
"editable": true
},
@@ -1452,7 +1456,7 @@
{
"cell_type": "code",
"execution_count": 2,
- "id": "b4786589",
+ "id": "a85b890a",
"metadata": {
"collapsed": false,
"editable": true
@@ -1465,7 +1469,7 @@
},
{
"cell_type": "markdown",
- "id": "af2dcc52",
+ "id": "08eee60c",
"metadata": {
"editable": true
},
@@ -1479,7 +1483,7 @@
{
"cell_type": "code",
"execution_count": 3,
- "id": "2bc65bc5",
+ "id": "06c7d473",
"metadata": {
"collapsed": false,
"editable": true
@@ -1492,7 +1496,7 @@
},
{
"cell_type": "markdown",
- "id": "46bda600",
+ "id": "8a9eb7fd",
"metadata": {
"editable": true
},
@@ -1503,7 +1507,7 @@
{
"cell_type": "code",
"execution_count": 4,
- "id": "9bdae7bf",
+ "id": "44804614",
"metadata": {
"collapsed": false,
"editable": true
@@ -1515,7 +1519,7 @@
},
{
"cell_type": "markdown",
- "id": "64eeaaef",
+ "id": "3c36f7b4",
"metadata": {
"editable": true
},
@@ -1526,7 +1530,7 @@
{
"cell_type": "code",
"execution_count": 5,
- "id": "cafbda91",
+ "id": "128cc3f9",
"metadata": {
"collapsed": false,
"editable": true
@@ -1542,7 +1546,7 @@
},
{
"cell_type": "markdown",
- "id": "831a5888",
+ "id": "f0555b78",
"metadata": {
"editable": true
},
@@ -1553,7 +1557,7 @@
{
"cell_type": "code",
"execution_count": 6,
- "id": "90f6a538",
+ "id": "f482d41d",
"metadata": {
"collapsed": false,
"editable": true
@@ -1567,7 +1571,7 @@
},
{
"cell_type": "markdown",
- "id": "dc364c27",
+ "id": "292cb89c",
"metadata": {
"editable": true
},
@@ -1588,7 +1592,7 @@
},
{
"cell_type": "markdown",
- "id": "1598259c",
+ "id": "59a7edef",
"metadata": {
"editable": true
},
@@ -1599,7 +1603,7 @@
{
"cell_type": "code",
"execution_count": 7,
- "id": "ca994e68",
+ "id": "847478f5",
"metadata": {
"collapsed": false,
"editable": true
@@ -1652,7 +1656,7 @@
},
{
"cell_type": "markdown",
- "id": "7353f2e7",
+ "id": "4a92abc5",
"metadata": {
"editable": true
},
@@ -1663,7 +1667,7 @@
{
"cell_type": "code",
"execution_count": 8,
- "id": "05a066db",
+ "id": "71d29d58",
"metadata": {
"collapsed": false,
"editable": true
@@ -1688,7 +1692,7 @@
},
{
"cell_type": "markdown",
- "id": "1f30de64",
+ "id": "71ffb936",
"metadata": {
"editable": true
},
@@ -1700,7 +1704,7 @@
},
{
"cell_type": "markdown",
- "id": "80fa8b7d",
+ "id": "ed47d431",
"metadata": {
"editable": true
},
@@ -1729,7 +1733,7 @@
},
{
"cell_type": "markdown",
- "id": "7e92be20",
+ "id": "4a01c695",
"metadata": {
"editable": true
},
@@ -1754,7 +1758,7 @@
},
{
"cell_type": "markdown",
- "id": "052e8c0c",
+ "id": "d8b9ee62",
"metadata": {
"editable": true
},
@@ -1774,7 +1778,7 @@
},
{
"cell_type": "markdown",
- "id": "d752c7f4",
+ "id": "a5f362af",
"metadata": {
"editable": true
},
@@ -1801,7 +1805,7 @@
},
{
"cell_type": "markdown",
- "id": "4b40d092",
+ "id": "1bdf7ea5",
"metadata": {
"editable": true
},
@@ -1814,7 +1818,7 @@
},
{
"cell_type": "markdown",
- "id": "f8526e57",
+ "id": "142f891c",
"metadata": {
"editable": true
},
@@ -1826,7 +1830,7 @@
},
{
"cell_type": "markdown",
- "id": "5cfb3455",
+ "id": "aee9f94b",
"metadata": {
"editable": true
},
@@ -1837,7 +1841,7 @@
},
{
"cell_type": "markdown",
- "id": "363e0117",
+ "id": "4ce309d1",
"metadata": {
"editable": true
},
@@ -1853,7 +1857,7 @@
{
"cell_type": "code",
"execution_count": 9,
- "id": "4c7ecfc5",
+ "id": "0a704745",
"metadata": {
"collapsed": false,
"editable": true
@@ -1887,7 +1891,7 @@
},
{
"cell_type": "markdown",
- "id": "981f65fb",
+ "id": "84eabf2a",
"metadata": {
"editable": true
},
@@ -1897,7 +1901,7 @@
},
{
"cell_type": "markdown",
- "id": "9ddcca79",
+ "id": "d43e8012",
"metadata": {
"editable": true
},
@@ -1912,7 +1916,7 @@
},
{
"cell_type": "markdown",
- "id": "02bed8b3",
+ "id": "7e9736ec",
"metadata": {
"editable": true
},
@@ -1924,7 +1928,7 @@
},
{
"cell_type": "markdown",
- "id": "64033f1d",
+ "id": "b10b3475",
"metadata": {
"editable": true
},
@@ -1934,7 +1938,7 @@
},
{
"cell_type": "markdown",
- "id": "1cfc52cc",
+ "id": "d84b36f4",
"metadata": {
"editable": true
},
@@ -1950,7 +1954,7 @@
{
"cell_type": "code",
"execution_count": 10,
- "id": "06b67f41",
+ "id": "f7106c42",
"metadata": {
"collapsed": false,
"editable": true
@@ -1967,7 +1971,7 @@
},
{
"cell_type": "markdown",
- "id": "773210a0",
+ "id": "3c69f9f8",
"metadata": {
"editable": true
},
@@ -1980,7 +1984,7 @@
{
"cell_type": "code",
"execution_count": 11,
- "id": "34cb4217",
+ "id": "11c487ef",
"metadata": {
"collapsed": false,
"editable": true
@@ -2027,7 +2031,7 @@
},
{
"cell_type": "markdown",
- "id": "4ae9cee9",
+ "id": "7c801b72",
"metadata": {
"editable": true
},
@@ -2038,7 +2042,7 @@
{
"cell_type": "code",
"execution_count": 12,
- "id": "9be1964e",
+ "id": "d3aeb46a",
"metadata": {
"collapsed": false,
"editable": true
@@ -2141,7 +2145,7 @@
},
{
"cell_type": "markdown",
- "id": "f0fe5870",
+ "id": "40492c3d",
"metadata": {
"editable": true
},
@@ -2169,7 +2173,7 @@
},
{
"cell_type": "markdown",
- "id": "9b60a7bd",
+ "id": "8522203f",
"metadata": {
"editable": true
},
@@ -2204,7 +2208,7 @@
},
{
"cell_type": "markdown",
- "id": "a31dcc5d",
+ "id": "be983c3c",
"metadata": {
"editable": true
},
@@ -2219,7 +2223,7 @@
{
"cell_type": "code",
"execution_count": 13,
- "id": "225671c5",
+ "id": "1efd2e47",
"metadata": {
"collapsed": false,
"editable": true
@@ -2244,7 +2248,7 @@
},
{
"cell_type": "markdown",
- "id": "ac1448c8",
+ "id": "f19c62cb",
"metadata": {
"editable": true
},
@@ -2260,7 +2264,7 @@
},
{
"cell_type": "markdown",
- "id": "c6e308a3",
+ "id": "a584c9cd",
"metadata": {
"editable": true
},
@@ -2272,7 +2276,7 @@
},
{
"cell_type": "markdown",
- "id": "a2f2dab5",
+ "id": "0be698a6",
"metadata": {
"editable": true
},
@@ -2287,7 +2291,7 @@
},
{
"cell_type": "markdown",
- "id": "8a7df606",
+ "id": "5d75610e",
"metadata": {
"editable": true
},
@@ -2299,7 +2303,7 @@
},
{
"cell_type": "markdown",
- "id": "31e595c9",
+ "id": "ff7ee954",
"metadata": {
"editable": true
},
@@ -2309,7 +2313,7 @@
},
{
"cell_type": "markdown",
- "id": "f5f389db",
+ "id": "5e6bb341",
"metadata": {
"editable": true
},
@@ -2321,7 +2325,7 @@
},
{
"cell_type": "markdown",
- "id": "1dd4b34d",
+ "id": "e963c568",
"metadata": {
"editable": true
},
@@ -2331,7 +2335,7 @@
},
{
"cell_type": "markdown",
- "id": "f931e286",
+ "id": "55885a4a",
"metadata": {
"editable": true
},
@@ -2343,7 +2347,7 @@
},
{
"cell_type": "markdown",
- "id": "4cbda41b",
+ "id": "45b41040",
"metadata": {
"editable": true
},
@@ -2356,7 +2360,7 @@
},
{
"cell_type": "markdown",
- "id": "6657a435",
+ "id": "09f46805",
"metadata": {
"editable": true
},
@@ -2368,7 +2372,7 @@
},
{
"cell_type": "markdown",
- "id": "91f7475b",
+ "id": "d1568bca",
"metadata": {
"editable": true
},
@@ -2378,7 +2382,7 @@
},
{
"cell_type": "markdown",
- "id": "98482060",
+ "id": "5596da7b",
"metadata": {
"editable": true
},
@@ -2390,7 +2394,7 @@
},
{
"cell_type": "markdown",
- "id": "01e12c29",
+ "id": "1a811520",
"metadata": {
"editable": true
},
@@ -2400,7 +2404,7 @@
},
{
"cell_type": "markdown",
- "id": "38fa32e4",
+ "id": "97432a8f",
"metadata": {
"editable": true
},
@@ -2412,7 +2416,7 @@
},
{
"cell_type": "markdown",
- "id": "ea483f66",
+ "id": "f0771458",
"metadata": {
"editable": true
},
@@ -2422,7 +2426,7 @@
},
{
"cell_type": "markdown",
- "id": "d5862089",
+ "id": "7c19d9c3",
"metadata": {
"editable": true
},
@@ -2434,7 +2438,7 @@
},
{
"cell_type": "markdown",
- "id": "0456f62e",
+ "id": "f095d30a",
"metadata": {
"editable": true
},
@@ -2444,7 +2448,7 @@
},
{
"cell_type": "markdown",
- "id": "1ed14941",
+ "id": "40723219",
"metadata": {
"editable": true
},
@@ -2456,7 +2460,7 @@
},
{
"cell_type": "markdown",
- "id": "43387b69",
+ "id": "46ed821b",
"metadata": {
"editable": true
},
@@ -2466,7 +2470,7 @@
},
{
"cell_type": "markdown",
- "id": "06bd01bf",
+ "id": "5a319080",
"metadata": {
"editable": true
},
@@ -2478,7 +2482,7 @@
},
{
"cell_type": "markdown",
- "id": "9cad411e",
+ "id": "1113a828",
"metadata": {
"editable": true
},
@@ -2488,7 +2492,7 @@
},
{
"cell_type": "markdown",
- "id": "c37f7792",
+ "id": "283f8fe8",
"metadata": {
"editable": true
},
@@ -2500,7 +2504,7 @@
},
{
"cell_type": "markdown",
- "id": "8a7f23f8",
+ "id": "d2e5d910",
"metadata": {
"editable": true
},
@@ -2512,7 +2516,7 @@
},
{
"cell_type": "markdown",
- "id": "a7fdf6e8",
+ "id": "2de4cd2c",
"metadata": {
"editable": true
},
@@ -2524,7 +2528,7 @@
},
{
"cell_type": "markdown",
- "id": "3ac73282",
+ "id": "ef87b933",
"metadata": {
"editable": true
},
@@ -2537,7 +2541,7 @@
},
{
"cell_type": "markdown",
- "id": "e55db5a0",
+ "id": "36ae94a8",
"metadata": {
"editable": true
},
@@ -2549,7 +2553,7 @@
},
{
"cell_type": "markdown",
- "id": "966cd383",
+ "id": "0e940b73",
"metadata": {
"editable": true
},
@@ -2559,7 +2563,7 @@
},
{
"cell_type": "markdown",
- "id": "360cb45f",
+ "id": "6d215e00",
"metadata": {
"editable": true
},
@@ -2573,7 +2577,7 @@
{
"cell_type": "code",
"execution_count": 14,
- "id": "2099267d",
+ "id": "8e8abb2e",
"metadata": {
"collapsed": false,
"editable": true
@@ -2670,7 +2674,7 @@
},
{
"cell_type": "markdown",
- "id": "9ba9afe9",
+ "id": "2d3510cf",
"metadata": {
"editable": true
},
@@ -2691,7 +2695,7 @@
},
{
"cell_type": "markdown",
- "id": "ea4bf6fe",
+ "id": "6bbe3c03",
"metadata": {
"editable": true
},
@@ -2703,7 +2707,7 @@
},
{
"cell_type": "markdown",
- "id": "98ca9b28",
+ "id": "9402a7f6",
"metadata": {
"editable": true
},
@@ -2713,7 +2717,7 @@
},
{
"cell_type": "markdown",
- "id": "996fc4f6",
+ "id": "2854105e",
"metadata": {
"editable": true
},
@@ -2725,7 +2729,7 @@
},
{
"cell_type": "markdown",
- "id": "b5db8128",
+ "id": "8a104c4a",
"metadata": {
"editable": true
},
@@ -2735,7 +2739,7 @@
},
{
"cell_type": "markdown",
- "id": "745d6bff",
+ "id": "903e7426",
"metadata": {
"editable": true
},
@@ -2747,7 +2751,7 @@
},
{
"cell_type": "markdown",
- "id": "2ecb048e",
+ "id": "08a6f7fc",
"metadata": {
"editable": true
},
@@ -2763,381 +2767,17 @@
},
{
"cell_type": "markdown",
- "id": "73eb2f08",
+ "id": "f08f1d7b",
"metadata": {
"editable": true
},
"source": [
- "## The Boston housing data example\n",
- "\n",
- "The Boston housing \n",
- "data set was originally a part of UCI Machine Learning Repository\n",
- "and has been removed now. The data set is now included in **Scikit-Learn**'s \n",
- "library. There are 506 samples and 13 feature (predictor) variables\n",
- "in this data set. The objective is to predict the value of prices of\n",
- "the house using the features (predictors) listed here.\n",
- "\n",
- "The features/predictors are\n",
- "1. CRIM: Per capita crime rate by town\n",
- "\n",
- "2. ZN: Proportion of residential land zoned for lots over 25000 square feet\n",
- "\n",
- "3. INDUS: Proportion of non-retail business acres per town\n",
- "\n",
- "4. CHAS: Charles River dummy variable (= 1 if tract bounds river; 0 otherwise)\n",
- "\n",
- "5. NOX: Nitric oxide concentration (parts per 10 million)\n",
- "\n",
- "6. RM: Average number of rooms per dwelling\n",
- "\n",
- "7. AGE: Proportion of owner-occupied units built prior to 1940\n",
- "\n",
- "8. DIS: Weighted distances to five Boston employment centers\n",
- "\n",
- "9. RAD: Index of accessibility to radial highways\n",
- "\n",
- "10. TAX: Full-value property tax rate per USD10000\n",
- "\n",
- "11. B: $1000(Bk - 0.63)^2$, where $Bk$ is the proportion of [people of African American descent] by town\n",
- "\n",
- "12. LSTAT: Percentage of lower status of the population\n",
- "\n",
- "13. MEDV: Median value of owner-occupied homes in USD 1000s"
+ "## Material for lecture Monday, August 26"
]
},
{
"cell_type": "markdown",
- "id": "41d9c008",
- "metadata": {
- "editable": true
- },
- "source": [
- "## Housing data, the code\n",
- "We start by importing the libraries"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 15,
- "id": "0af3b38a",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "import numpy as np\n",
- "import matplotlib.pyplot as plt \n",
- "\n",
- "import pandas as pd \n",
- "import seaborn as sns"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "41771944",
- "metadata": {
- "editable": true
- },
- "source": [
- "and load the Boston Housing DataSet from **Scikit-Learn**"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 16,
- "id": "c0ad90ff",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "from sklearn.datasets import load_boston\n",
- "\n",
- "boston_dataset = load_boston()\n",
- "\n",
- "# boston_dataset is a dictionary\n",
- "# let's check what it contains\n",
- "boston_dataset.keys()"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "ef2f9bce",
- "metadata": {
- "editable": true
- },
- "source": [
- "Then we invoke Pandas"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 17,
- "id": "150d1433",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "boston = pd.DataFrame(boston_dataset.data, columns=boston_dataset.feature_names)\n",
- "boston.head()\n",
- "boston['MEDV'] = boston_dataset.target"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "1be017ef",
- "metadata": {
- "editable": true
- },
- "source": [
- "and preprocess the data"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 18,
- "id": "01ef8953",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "# check for missing values in all the columns\n",
- "boston.isnull().sum()"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "adc486b5",
- "metadata": {
- "editable": true
- },
- "source": [
- "We can then visualize the data"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 19,
- "id": "2471fc63",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "# set the size of the figure\n",
- "sns.set(rc={'figure.figsize':(11.7,8.27)})\n",
- "\n",
- "# plot a histogram showing the distribution of the target values\n",
- "sns.distplot(boston['MEDV'], bins=30)\n",
- "plt.show()"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "e26d39f7",
- "metadata": {
- "editable": true
- },
- "source": [
- "It is now useful to look at the correlation matrix"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 20,
- "id": "6bb60001",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "# compute the pair wise correlation for all columns \n",
- "correlation_matrix = boston.corr().round(2)\n",
- "# use the heatmap function from seaborn to plot the correlation matrix\n",
- "# annot = True to print the values inside the square\n",
- "sns.heatmap(data=correlation_matrix, annot=True)"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "90f47dc1",
- "metadata": {
- "editable": true
- },
- "source": [
- "From the above coorelation plot we can see that **MEDV** is strongly correlated to **LSTAT** and **RM**. We see also that **RAD** and **TAX** are stronly correlated, but we don't include this in our features together to avoid multi-colinearity"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 21,
- "id": "a1f980e4",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "plt.figure(figsize=(20, 5))\n",
- "\n",
- "features = ['LSTAT', 'RM']\n",
- "target = boston['MEDV']\n",
- "\n",
- "for i, col in enumerate(features):\n",
- " plt.subplot(1, len(features) , i+1)\n",
- " x = boston[col]\n",
- " y = target\n",
- " plt.scatter(x, y, marker='o')\n",
- " plt.title(col)\n",
- " plt.xlabel(col)\n",
- " plt.ylabel('MEDV')"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "9efdaaaa",
- "metadata": {
- "editable": true
- },
- "source": [
- "Now we start training our model"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 22,
- "id": "01e9afe5",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "X = pd.DataFrame(np.c_[boston['LSTAT'], boston['RM']], columns = ['LSTAT','RM'])\n",
- "Y = boston['MEDV']"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "73335565",
- "metadata": {
- "editable": true
- },
- "source": [
- "We split the data into training and test sets"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 23,
- "id": "f865febb",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "from sklearn.model_selection import train_test_split\n",
- "\n",
- "# splits the training and test data set in 80% : 20%\n",
- "# assign random_state to any value.This ensures consistency.\n",
- "X_train, X_test, Y_train, Y_test = train_test_split(X, Y, test_size = 0.2, random_state=5)\n",
- "print(X_train.shape)\n",
- "print(X_test.shape)\n",
- "print(Y_train.shape)\n",
- "print(Y_test.shape)"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "88f5a339",
- "metadata": {
- "editable": true
- },
- "source": [
- "Then we use the linear regression functionality from **Scikit-Learn**"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 24,
- "id": "bacdbf9b",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "from sklearn.linear_model import LinearRegression\n",
- "from sklearn.metrics import mean_squared_error, r2_score\n",
- "\n",
- "lin_model = LinearRegression()\n",
- "lin_model.fit(X_train, Y_train)\n",
- "\n",
- "# model evaluation for training set\n",
- "\n",
- "y_train_predict = lin_model.predict(X_train)\n",
- "rmse = (np.sqrt(mean_squared_error(Y_train, y_train_predict)))\n",
- "r2 = r2_score(Y_train, y_train_predict)\n",
- "\n",
- "print(\"The model performance for training set\")\n",
- "print(\"--------------------------------------\")\n",
- "print('RMSE is {}'.format(rmse))\n",
- "print('R2 score is {}'.format(r2))\n",
- "print(\"\\n\")\n",
- "\n",
- "# model evaluation for testing set\n",
- "\n",
- "y_test_predict = lin_model.predict(X_test)\n",
- "# root mean square error of the model\n",
- "rmse = (np.sqrt(mean_squared_error(Y_test, y_test_predict)))\n",
- "\n",
- "# r-squared score of the model\n",
- "r2 = r2_score(Y_test, y_test_predict)\n",
- "\n",
- "print(\"The model performance for testing set\")\n",
- "print(\"--------------------------------------\")\n",
- "print('RMSE is {}'.format(rmse))\n",
- "print('R2 score is {}'.format(r2))"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 25,
- "id": "09aa7ac9",
- "metadata": {
- "collapsed": false,
- "editable": true
- },
- "outputs": [],
- "source": [
- "# plotting the y_test vs y_pred\n",
- "# ideally should have been a straight line\n",
- "plt.scatter(Y_test, y_test_predict)\n",
- "plt.show()"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "cb088f7a",
- "metadata": {
- "editable": true
- },
- "source": [
- "## Material for lecture Thursday, August 31"
- ]
- },
- {
- "cell_type": "markdown",
- "id": "a452bf26",
+ "id": "5d936c7e",
"metadata": {
"editable": true
},
@@ -3151,7 +2791,7 @@
},
{
"cell_type": "markdown",
- "id": "603ea987",
+ "id": "ef7769a7",
"metadata": {
"editable": true
},
@@ -3163,7 +2803,7 @@
},
{
"cell_type": "markdown",
- "id": "61b65c66",
+ "id": "7771ff2c",
"metadata": {
"editable": true
},
@@ -3175,7 +2815,7 @@
},
{
"cell_type": "markdown",
- "id": "d08fd064",
+ "id": "10fc7ed2",
"metadata": {
"editable": true
},
@@ -3187,7 +2827,7 @@
},
{
"cell_type": "markdown",
- "id": "e8f62983",
+ "id": "39b5e3bd",
"metadata": {
"editable": true
},
@@ -3197,7 +2837,7 @@
},
{
"cell_type": "markdown",
- "id": "d68a9415",
+ "id": "52b3d0bb",
"metadata": {
"editable": true
},
@@ -3209,7 +2849,7 @@
},
{
"cell_type": "markdown",
- "id": "3307fed7",
+ "id": "4c3bc56d",
"metadata": {
"editable": true
},
@@ -3219,7 +2859,7 @@
},
{
"cell_type": "markdown",
- "id": "8a910e57",
+ "id": "1763f73c",
"metadata": {
"editable": true
},
@@ -3231,7 +2871,7 @@
},
{
"cell_type": "markdown",
- "id": "218a6b48",
+ "id": "10ca64dc",
"metadata": {
"editable": true
},
@@ -3242,7 +2882,7 @@
},
{
"cell_type": "markdown",
- "id": "8f3748ba",
+ "id": "59d74409",
"metadata": {
"editable": true
},
@@ -3254,7 +2894,7 @@
},
{
"cell_type": "markdown",
- "id": "d0385420",
+ "id": "e096a0c8",
"metadata": {
"editable": true
},
@@ -3266,7 +2906,7 @@
},
{
"cell_type": "markdown",
- "id": "4644a05e",
+ "id": "9e7b9f26",
"metadata": {
"editable": true
},
@@ -3276,7 +2916,7 @@
},
{
"cell_type": "markdown",
- "id": "bfb350df",
+ "id": "5f8e828c",
"metadata": {
"editable": true
},
@@ -3288,7 +2928,7 @@
},
{
"cell_type": "markdown",
- "id": "508acac7",
+ "id": "b649f8ce",
"metadata": {
"editable": true
},
@@ -3300,7 +2940,7 @@
},
{
"cell_type": "markdown",
- "id": "1cde0c41",
+ "id": "57c7d832",
"metadata": {
"editable": true
},
@@ -3310,7 +2950,7 @@
},
{
"cell_type": "markdown",
- "id": "683baaea",
+ "id": "c9c6af68",
"metadata": {
"editable": true
},
@@ -3322,7 +2962,7 @@
},
{
"cell_type": "markdown",
- "id": "ec9c67ea",
+ "id": "fa1128b4",
"metadata": {
"editable": true
},
@@ -3332,7 +2972,7 @@
},
{
"cell_type": "markdown",
- "id": "cdc9c6fc",
+ "id": "85c79bbd",
"metadata": {
"editable": true
},
@@ -3344,7 +2984,7 @@
},
{
"cell_type": "markdown",
- "id": "c7590b65",
+ "id": "a771f3ba",
"metadata": {
"editable": true
},
@@ -3354,7 +2994,7 @@
},
{
"cell_type": "markdown",
- "id": "f2d7afb2",
+ "id": "a537e28f",
"metadata": {
"editable": true
},
@@ -3394,7 +3034,7 @@
},
{
"cell_type": "markdown",
- "id": "69fd907d",
+ "id": "22a92910",
"metadata": {
"editable": true
},
@@ -3411,7 +3051,7 @@
},
{
"cell_type": "markdown",
- "id": "33b93521",
+ "id": "93aec13e",
"metadata": {
"editable": true
},
@@ -3434,7 +3074,7 @@
},
{
"cell_type": "markdown",
- "id": "600d8db6",
+ "id": "3e8fc4af",
"metadata": {
"editable": true
},
@@ -3451,7 +3091,7 @@
},
{
"cell_type": "markdown",
- "id": "22fc0a80",
+ "id": "3f2d73ed",
"metadata": {
"editable": true
},
@@ -3470,7 +3110,7 @@
},
{
"cell_type": "markdown",
- "id": "bd71990f",
+ "id": "cebec7f9",
"metadata": {
"editable": true
},
@@ -3481,7 +3121,7 @@
},
{
"cell_type": "markdown",
- "id": "587d44ae",
+ "id": "da556bd6",
"metadata": {
"editable": true
},
@@ -3493,7 +3133,7 @@
},
{
"cell_type": "markdown",
- "id": "2158156f",
+ "id": "4d23351d",
"metadata": {
"editable": true
},
@@ -3511,7 +3151,7 @@
},
{
"cell_type": "markdown",
- "id": "10eb0b7c",
+ "id": "162bcba6",
"metadata": {
"editable": true
},
@@ -3527,7 +3167,7 @@
},
{
"cell_type": "markdown",
- "id": "2aceb644",
+ "id": "778461b7",
"metadata": {
"editable": true
},
@@ -3539,7 +3179,7 @@
},
{
"cell_type": "markdown",
- "id": "1465b8be",
+ "id": "c691b8b0",
"metadata": {
"editable": true
},
@@ -3549,7 +3189,7 @@
},
{
"cell_type": "markdown",
- "id": "b3afc822",
+ "id": "b6b7e4a0",
"metadata": {
"editable": true
},
@@ -3564,7 +3204,7 @@
},
{
"cell_type": "markdown",
- "id": "4357f67d",
+ "id": "9a612971",
"metadata": {
"editable": true
},
@@ -3576,7 +3216,7 @@
},
{
"cell_type": "markdown",
- "id": "b2ed8199",
+ "id": "706132dc",
"metadata": {
"editable": true
},
@@ -3586,7 +3226,7 @@
},
{
"cell_type": "markdown",
- "id": "a28f5e2a",
+ "id": "206c55a7",
"metadata": {
"editable": true
},
@@ -3598,7 +3238,7 @@
},
{
"cell_type": "markdown",
- "id": "dda00171",
+ "id": "6b74284d",
"metadata": {
"editable": true
},
@@ -3608,7 +3248,7 @@
},
{
"cell_type": "markdown",
- "id": "99e49156",
+ "id": "0234a46a",
"metadata": {
"editable": true
},
@@ -3620,7 +3260,7 @@
},
{
"cell_type": "markdown",
- "id": "3de354b0",
+ "id": "abb8474f",
"metadata": {
"editable": true
},
@@ -3632,7 +3272,7 @@
},
{
"cell_type": "markdown",
- "id": "9b719377",
+ "id": "9467e419",
"metadata": {
"editable": true
},
@@ -3647,7 +3287,7 @@
},
{
"cell_type": "markdown",
- "id": "f46453c7",
+ "id": "abfadb01",
"metadata": {
"editable": true
},
@@ -3658,7 +3298,7 @@
},
{
"cell_type": "markdown",
- "id": "0255efb1",
+ "id": "b4d7950d",
"metadata": {
"editable": true
},
@@ -3678,7 +3318,7 @@
},
{
"cell_type": "markdown",
- "id": "61df6aad",
+ "id": "c6e946ea",
"metadata": {
"editable": true
},
@@ -3690,7 +3330,7 @@
},
{
"cell_type": "markdown",
- "id": "ac44e8fa",
+ "id": "485e3f93",
"metadata": {
"editable": true
},
@@ -3700,7 +3340,7 @@
},
{
"cell_type": "markdown",
- "id": "a73ed285",
+ "id": "8dd085df",
"metadata": {
"editable": true
},
@@ -3712,7 +3352,7 @@
},
{
"cell_type": "markdown",
- "id": "4809c104",
+ "id": "5e745921",
"metadata": {
"editable": true
},
@@ -3741,7 +3381,7 @@
},
{
"cell_type": "markdown",
- "id": "9ff4078a",
+ "id": "e123b112",
"metadata": {
"editable": true
},
@@ -3768,7 +3408,7 @@
},
{
"cell_type": "markdown",
- "id": "78a8b113",
+ "id": "8716fc03",
"metadata": {
"editable": true
},
@@ -3778,8 +3418,8 @@
},
{
"cell_type": "code",
- "execution_count": 26,
- "id": "47f6d805",
+ "execution_count": 15,
+ "id": "3b53ef76",
"metadata": {
"collapsed": false,
"editable": true
@@ -3819,7 +3459,7 @@
},
{
"cell_type": "markdown",
- "id": "5d841c14",
+ "id": "577ae352",
"metadata": {
"editable": true
},
@@ -3836,7 +3476,7 @@
},
{
"cell_type": "markdown",
- "id": "579b46a4",
+ "id": "052f1ae4",
"metadata": {
"editable": true
},
@@ -3859,7 +3499,7 @@
},
{
"cell_type": "markdown",
- "id": "1bb48e3c",
+ "id": "245d15c0",
"metadata": {
"editable": true
},
@@ -3873,7 +3513,7 @@
},
{
"cell_type": "markdown",
- "id": "a872fcf9",
+ "id": "b1b84021",
"metadata": {
"editable": true
},
@@ -3892,7 +3532,7 @@
},
{
"cell_type": "markdown",
- "id": "f0565ccd",
+ "id": "59677057",
"metadata": {
"editable": true
},
@@ -3902,7 +3542,7 @@
},
{
"cell_type": "markdown",
- "id": "a659e96f",
+ "id": "579a9b4c",
"metadata": {
"editable": true
},
@@ -3914,7 +3554,7 @@
},
{
"cell_type": "markdown",
- "id": "fcfcf6b0",
+ "id": "49fd275c",
"metadata": {
"editable": true
},
@@ -3928,7 +3568,7 @@
},
{
"cell_type": "markdown",
- "id": "ea39064c",
+ "id": "094a53e2",
"metadata": {
"editable": true
},
@@ -3940,7 +3580,7 @@
},
{
"cell_type": "markdown",
- "id": "0096e499",
+ "id": "c1fec661",
"metadata": {
"editable": true
},
@@ -3950,7 +3590,7 @@
},
{
"cell_type": "markdown",
- "id": "bf32dfa9",
+ "id": "a897fce4",
"metadata": {
"editable": true
},
@@ -3962,7 +3602,7 @@
},
{
"cell_type": "markdown",
- "id": "e0d6fee2",
+ "id": "cf091974",
"metadata": {
"editable": true
},
@@ -3979,7 +3619,7 @@
},
{
"cell_type": "markdown",
- "id": "0cb15d9d",
+ "id": "43eeed44",
"metadata": {
"editable": true
},
@@ -3989,7 +3629,7 @@
},
{
"cell_type": "markdown",
- "id": "754f4312",
+ "id": "6c94161a",
"metadata": {
"editable": true
},
@@ -4005,7 +3645,7 @@
},
{
"cell_type": "markdown",
- "id": "5bd1e9b0",
+ "id": "f2d6cec5",
"metadata": {
"editable": true
},
@@ -4015,7 +3655,7 @@
},
{
"cell_type": "markdown",
- "id": "2a839ac1",
+ "id": "3439cf2f",
"metadata": {
"editable": true
},
@@ -4031,7 +3671,7 @@
},
{
"cell_type": "markdown",
- "id": "69e34c64",
+ "id": "0c3d6910",
"metadata": {
"editable": true
},
@@ -4041,7 +3681,7 @@
},
{
"cell_type": "markdown",
- "id": "b32ae1de",
+ "id": "b3fe6cae",
"metadata": {
"editable": true
},
@@ -4057,7 +3697,7 @@
},
{
"cell_type": "markdown",
- "id": "00c3ff66",
+ "id": "52b64666",
"metadata": {
"editable": true
},
@@ -4067,7 +3707,7 @@
},
{
"cell_type": "markdown",
- "id": "92f1238d",
+ "id": "c016890a",
"metadata": {
"editable": true
},
@@ -4084,7 +3724,7 @@
},
{
"cell_type": "markdown",
- "id": "71f43637",
+ "id": "2589545c",
"metadata": {
"editable": true
},
@@ -4096,7 +3736,7 @@
},
{
"cell_type": "markdown",
- "id": "4bac0a15",
+ "id": "d74b662f",
"metadata": {
"editable": true
},
@@ -4108,7 +3748,7 @@
},
{
"cell_type": "markdown",
- "id": "b523b964",
+ "id": "79f18748",
"metadata": {
"editable": true
},
@@ -4120,7 +3760,7 @@
},
{
"cell_type": "markdown",
- "id": "3d7f8195",
+ "id": "c97ef564",
"metadata": {
"editable": true
},
@@ -4130,7 +3770,7 @@
},
{
"cell_type": "markdown",
- "id": "f308dd0a",
+ "id": "f2b64e40",
"metadata": {
"editable": true
},
@@ -4142,7 +3782,7 @@
},
{
"cell_type": "markdown",
- "id": "929784cf",
+ "id": "2780c653",
"metadata": {
"editable": true
},
@@ -4154,7 +3794,7 @@
},
{
"cell_type": "markdown",
- "id": "09dccee1",
+ "id": "42a104ce",
"metadata": {
"editable": true
},
@@ -4166,7 +3806,7 @@
},
{
"cell_type": "markdown",
- "id": "165b3f17",
+ "id": "665eee0d",
"metadata": {
"editable": true
},
@@ -4176,7 +3816,7 @@
},
{
"cell_type": "markdown",
- "id": "24a8dd50",
+ "id": "152a833c",
"metadata": {
"editable": true
},
@@ -4188,7 +3828,7 @@
},
{
"cell_type": "markdown",
- "id": "2597dc03",
+ "id": "af006756",
"metadata": {
"editable": true
},
@@ -4198,7 +3838,7 @@
},
{
"cell_type": "markdown",
- "id": "4d40ddce",
+ "id": "aa8a26d4",
"metadata": {
"editable": true
},
@@ -4210,7 +3850,7 @@
},
{
"cell_type": "markdown",
- "id": "41d0e0cb",
+ "id": "21f907f2",
"metadata": {
"editable": true
},
@@ -4226,7 +3866,7 @@
},
{
"cell_type": "markdown",
- "id": "e4bafe51",
+ "id": "39b264f4",
"metadata": {
"editable": true
},
@@ -4238,7 +3878,7 @@
},
{
"cell_type": "markdown",
- "id": "aab4d56f",
+ "id": "b77259ea",
"metadata": {
"editable": true
},
@@ -4250,7 +3890,7 @@
},
{
"cell_type": "markdown",
- "id": "861395ef",
+ "id": "dba49a93",
"metadata": {
"editable": true
},
@@ -4260,7 +3900,7 @@
},
{
"cell_type": "markdown",
- "id": "299b8198",
+ "id": "b51fa501",
"metadata": {
"editable": true
},
@@ -4272,7 +3912,7 @@
},
{
"cell_type": "markdown",
- "id": "2096c2e7",
+ "id": "8edb1494",
"metadata": {
"editable": true
},
@@ -4283,7 +3923,7 @@
},
{
"cell_type": "markdown",
- "id": "4ad3b043",
+ "id": "e9d9d5d3",
"metadata": {
"editable": true
},
@@ -4295,7 +3935,7 @@
},
{
"cell_type": "markdown",
- "id": "66bf91e3",
+ "id": "7c49927e",
"metadata": {
"editable": true
},
@@ -4305,7 +3945,7 @@
},
{
"cell_type": "markdown",
- "id": "95afc99c",
+ "id": "77eb9e2f",
"metadata": {
"editable": true
},
@@ -4317,7 +3957,7 @@
},
{
"cell_type": "markdown",
- "id": "73334115",
+ "id": "9a20a065",
"metadata": {
"editable": true
},
@@ -4327,7 +3967,7 @@
},
{
"cell_type": "markdown",
- "id": "fb6f936e",
+ "id": "f5ccfe0e",
"metadata": {
"editable": true
},
@@ -4339,7 +3979,7 @@
},
{
"cell_type": "markdown",
- "id": "f9093b47",
+ "id": "40447dce",
"metadata": {
"editable": true
},
@@ -4350,7 +3990,7 @@
},
{
"cell_type": "markdown",
- "id": "fe539ee1",
+ "id": "859c86b6",
"metadata": {
"editable": true
},
@@ -4362,7 +4002,7 @@
},
{
"cell_type": "markdown",
- "id": "d130c8c1",
+ "id": "72d9fdde",
"metadata": {
"editable": true
},
@@ -4380,7 +4020,7 @@
},
{
"cell_type": "markdown",
- "id": "6787b5c2",
+ "id": "4c69a499",
"metadata": {
"editable": true
},
@@ -4396,7 +4036,7 @@
},
{
"cell_type": "markdown",
- "id": "b2e599e5",
+ "id": "00f97350",
"metadata": {
"editable": true
},
@@ -4408,7 +4048,7 @@
},
{
"cell_type": "markdown",
- "id": "854ff040",
+ "id": "c71f00ef",
"metadata": {
"editable": true
},
@@ -4420,7 +4060,7 @@
},
{
"cell_type": "markdown",
- "id": "aaf5e54e",
+ "id": "35b4c0ce",
"metadata": {
"editable": true
},
@@ -4432,7 +4072,7 @@
},
{
"cell_type": "markdown",
- "id": "444a68be",
+ "id": "16757c16",
"metadata": {
"editable": true
},
@@ -4445,7 +4085,7 @@
},
{
"cell_type": "markdown",
- "id": "56e0f274",
+ "id": "ea15a5d1",
"metadata": {
"editable": true
},
@@ -4461,7 +4101,7 @@
},
{
"cell_type": "markdown",
- "id": "a55a54c3",
+ "id": "b658712b",
"metadata": {
"editable": true
},
@@ -4475,7 +4115,7 @@
},
{
"cell_type": "markdown",
- "id": "b614c964",
+ "id": "9e2de3bd",
"metadata": {
"editable": true
},
@@ -4485,7 +4125,7 @@
},
{
"cell_type": "markdown",
- "id": "624b1c18",
+ "id": "ac8eda2d",
"metadata": {
"editable": true
},
@@ -4497,7 +4137,7 @@
},
{
"cell_type": "markdown",
- "id": "63dc085a",
+ "id": "4dede760",
"metadata": {
"editable": true
},
@@ -4507,7 +4147,7 @@
},
{
"cell_type": "markdown",
- "id": "28db2f6a",
+ "id": "2fd5acb5",
"metadata": {
"editable": true
},
@@ -4519,7 +4159,7 @@
},
{
"cell_type": "markdown",
- "id": "a9f1ebdd",
+ "id": "e14ee8e6",
"metadata": {
"editable": true
},
@@ -4529,7 +4169,7 @@
},
{
"cell_type": "markdown",
- "id": "0b8bf07b",
+ "id": "8e51c303",
"metadata": {
"editable": true
},
@@ -4543,7 +4183,7 @@
},
{
"cell_type": "markdown",
- "id": "5f237448",
+ "id": "5399fb0c",
"metadata": {
"editable": true
},
@@ -4560,7 +4200,7 @@
},
{
"cell_type": "markdown",
- "id": "75b7044c",
+ "id": "a252f1ea",
"metadata": {
"editable": true
},
@@ -4576,7 +4216,7 @@
},
{
"cell_type": "markdown",
- "id": "51268862",
+ "id": "36f5c9dd",
"metadata": {
"editable": true
},
@@ -4588,7 +4228,7 @@
},
{
"cell_type": "markdown",
- "id": "608b9dff",
+ "id": "f2c3a15d",
"metadata": {
"editable": true
},
@@ -4601,7 +4241,7 @@
},
{
"cell_type": "markdown",
- "id": "b06c316f",
+ "id": "e1dc5ae3",
"metadata": {
"editable": true
},
@@ -4615,7 +4255,7 @@
},
{
"cell_type": "markdown",
- "id": "e82ba709",
+ "id": "18cba5ba",
"metadata": {
"editable": true
},
@@ -4625,7 +4265,7 @@
},
{
"cell_type": "markdown",
- "id": "92d739a1",
+ "id": "0611a8e9",
"metadata": {
"editable": true
},
@@ -4638,7 +4278,7 @@
},
{
"cell_type": "markdown",
- "id": "14ce5cea",
+ "id": "a4cc4815",
"metadata": {
"editable": true
},
@@ -4657,7 +4297,7 @@
},
{
"cell_type": "markdown",
- "id": "f7e1f2b1",
+ "id": "e9921c65",
"metadata": {
"editable": true
},
@@ -4669,7 +4309,7 @@
},
{
"cell_type": "markdown",
- "id": "71910404",
+ "id": "9d1540c2",
"metadata": {
"editable": true
},
@@ -4681,7 +4321,7 @@
},
{
"cell_type": "markdown",
- "id": "cbd60268",
+ "id": "277e8be4",
"metadata": {
"editable": true
},
@@ -4691,7 +4331,7 @@
},
{
"cell_type": "markdown",
- "id": "e6c94e3d",
+ "id": "c00cef73",
"metadata": {
"editable": true
},
@@ -4703,7 +4343,7 @@
},
{
"cell_type": "markdown",
- "id": "20cf812e",
+ "id": "3a7619df",
"metadata": {
"editable": true
},
@@ -4716,7 +4356,7 @@
},
{
"cell_type": "markdown",
- "id": "dd1cb8be",
+ "id": "357c8a98",
"metadata": {
"editable": true
},
@@ -4735,7 +4375,7 @@
},
{
"cell_type": "markdown",
- "id": "98a4e944",
+ "id": "ef8c1445",
"metadata": {
"editable": true
},
@@ -4745,7 +4385,7 @@
},
{
"cell_type": "markdown",
- "id": "8c6e3845",
+ "id": "3d542210",
"metadata": {
"editable": true
},
@@ -4764,7 +4404,7 @@
},
{
"cell_type": "markdown",
- "id": "bc13a77d",
+ "id": "93a12764",
"metadata": {
"editable": true
},
@@ -4782,7 +4422,7 @@
},
{
"cell_type": "markdown",
- "id": "19d6cd9e",
+ "id": "ab31ef4e",
"metadata": {
"editable": true
},
@@ -4796,7 +4436,7 @@
},
{
"cell_type": "markdown",
- "id": "c5c7eee1",
+ "id": "48d5864c",
"metadata": {
"editable": true
},
@@ -4810,8 +4450,8 @@
},
{
"cell_type": "code",
- "execution_count": 27,
- "id": "6ab6bcc3",
+ "execution_count": 16,
+ "id": "de29006a",
"metadata": {
"collapsed": false,
"editable": true
@@ -4832,7 +4472,7 @@
},
{
"cell_type": "markdown",
- "id": "839a512c",
+ "id": "b81e82a1",
"metadata": {
"editable": true
},
@@ -4848,8 +4488,8 @@
},
{
"cell_type": "code",
- "execution_count": 28,
- "id": "bad7396d",
+ "execution_count": 17,
+ "id": "59d716dc",
"metadata": {
"collapsed": false,
"editable": true
@@ -4881,7 +4521,7 @@
},
{
"cell_type": "markdown",
- "id": "365c6ef8",
+ "id": "7f3a4e9a",
"metadata": {
"editable": true
},
@@ -4895,7 +4535,7 @@
},
{
"cell_type": "markdown",
- "id": "6fd82fe9",
+ "id": "0be6217d",
"metadata": {
"editable": true
},
@@ -4907,8 +4547,8 @@
},
{
"cell_type": "code",
- "execution_count": 29,
- "id": "80ba738c",
+ "execution_count": 18,
+ "id": "c90c9bbd",
"metadata": {
"collapsed": false,
"editable": true
@@ -4933,7 +4573,7 @@
},
{
"cell_type": "markdown",
- "id": "4f390c8f",
+ "id": "23861648",
"metadata": {
"editable": true
},
@@ -4943,7 +4583,7 @@
},
{
"cell_type": "markdown",
- "id": "4bceabcb",
+ "id": "47a35083",
"metadata": {
"editable": true
},
@@ -4953,8 +4593,8 @@
},
{
"cell_type": "code",
- "execution_count": 30,
- "id": "0146e7c8",
+ "execution_count": 19,
+ "id": "7ac06d35",
"metadata": {
"collapsed": false,
"editable": true
@@ -5008,7 +4648,7 @@
},
{
"cell_type": "markdown",
- "id": "6e15d041",
+ "id": "1b096c22",
"metadata": {
"editable": true
},
@@ -5025,7 +4665,7 @@
},
{
"cell_type": "markdown",
- "id": "107d5b46",
+ "id": "df200389",
"metadata": {
"editable": true
},
@@ -5037,7 +4677,7 @@
},
{
"cell_type": "markdown",
- "id": "e47d0e76",
+ "id": "1d05f20f",
"metadata": {
"editable": true
},
@@ -5049,7 +4689,7 @@
},
{
"cell_type": "markdown",
- "id": "86b8daf6",
+ "id": "686f4de4",
"metadata": {
"editable": true
},
@@ -5059,7 +4699,7 @@
},
{
"cell_type": "markdown",
- "id": "934cc6c5",
+ "id": "5f1d2cf2",
"metadata": {
"editable": true
},
@@ -5076,7 +4716,7 @@
},
{
"cell_type": "markdown",
- "id": "2a384ee9",
+ "id": "c3af1edc",
"metadata": {
"editable": true
},
@@ -5086,7 +4726,7 @@
},
{
"cell_type": "markdown",
- "id": "e9a632a7",
+ "id": "16e4f2e4",
"metadata": {
"editable": true
},
@@ -5101,7 +4741,7 @@
},
{
"cell_type": "markdown",
- "id": "8cbf4cb8",
+ "id": "cfebd376",
"metadata": {
"editable": true
},
@@ -5111,7 +4751,7 @@
},
{
"cell_type": "markdown",
- "id": "b29a7909",
+ "id": "4e9bf897",
"metadata": {
"editable": true
},
@@ -5125,7 +4765,7 @@
},
{
"cell_type": "markdown",
- "id": "31b9c6a9",
+ "id": "a72e01ca",
"metadata": {
"editable": true
},
@@ -5137,7 +4777,7 @@
},
{
"cell_type": "markdown",
- "id": "cdc2f810",
+ "id": "8551cc9e",
"metadata": {
"editable": true
},
@@ -5149,7 +4789,7 @@
},
{
"cell_type": "markdown",
- "id": "0b7d368d",
+ "id": "2dc67193",
"metadata": {
"editable": true
},
@@ -5161,7 +4801,7 @@
},
{
"cell_type": "markdown",
- "id": "6d5ddd28",
+ "id": "7f9b2782",
"metadata": {
"editable": true
},
@@ -5171,7 +4811,7 @@
},
{
"cell_type": "markdown",
- "id": "a18622fc",
+ "id": "e7e4222d",
"metadata": {
"editable": true
},
@@ -5183,7 +4823,7 @@
},
{
"cell_type": "markdown",
- "id": "b5a8893c",
+ "id": "98a151ba",
"metadata": {
"editable": true
},
@@ -5193,7 +4833,7 @@
},
{
"cell_type": "markdown",
- "id": "50a0a62a",
+ "id": "30667b0e",
"metadata": {
"editable": true
},
@@ -5210,7 +4850,7 @@
},
{
"cell_type": "markdown",
- "id": "20380d89",
+ "id": "f72ff51e",
"metadata": {
"editable": true
},
@@ -5220,7 +4860,7 @@
},
{
"cell_type": "markdown",
- "id": "10805b50",
+ "id": "80b9b440",
"metadata": {
"editable": true
},
@@ -5232,7 +4872,7 @@
},
{
"cell_type": "markdown",
- "id": "b9c31a46",
+ "id": "0f19edd6",
"metadata": {
"editable": true
},
@@ -5242,7 +4882,7 @@
},
{
"cell_type": "markdown",
- "id": "1f48b48e",
+ "id": "e0f2758b",
"metadata": {
"editable": true
},
@@ -5254,7 +4894,7 @@
},
{
"cell_type": "markdown",
- "id": "ad8f7a8c",
+ "id": "3ba08a96",
"metadata": {
"editable": true
},
@@ -5268,7 +4908,7 @@
},
{
"cell_type": "markdown",
- "id": "9e0dec01",
+ "id": "b7271b81",
"metadata": {
"editable": true
},
@@ -5280,7 +4920,7 @@
},
{
"cell_type": "markdown",
- "id": "46fd0b6d",
+ "id": "56ad87f1",
"metadata": {
"editable": true
},
@@ -5302,7 +4942,7 @@
},
{
"cell_type": "markdown",
- "id": "3d2047ca",
+ "id": "d7c4dc29",
"metadata": {
"editable": true
},
@@ -5314,7 +4954,7 @@
},
{
"cell_type": "markdown",
- "id": "4a5f5016",
+ "id": "3209959e",
"metadata": {
"editable": true
},
@@ -5329,7 +4969,7 @@
},
{
"cell_type": "markdown",
- "id": "52651fc6",
+ "id": "8466bcf7",
"metadata": {
"editable": true
},
@@ -5341,7 +4981,7 @@
},
{
"cell_type": "markdown",
- "id": "fea09344",
+ "id": "a44c56d3",
"metadata": {
"editable": true
},
@@ -5353,7 +4993,7 @@
},
{
"cell_type": "markdown",
- "id": "bcfd303f",
+ "id": "0dc26201",
"metadata": {
"editable": true
},
@@ -5363,7 +5003,7 @@
},
{
"cell_type": "markdown",
- "id": "f684d942",
+ "id": "ed78f0e3",
"metadata": {
"editable": true
},
@@ -5375,7 +5015,7 @@
},
{
"cell_type": "markdown",
- "id": "1e54bd36",
+ "id": "3a072221",
"metadata": {
"editable": true
},
@@ -5385,7 +5025,7 @@
},
{
"cell_type": "markdown",
- "id": "4cdcdef2",
+ "id": "60baf463",
"metadata": {
"editable": true
},
@@ -5397,7 +5037,7 @@
},
{
"cell_type": "markdown",
- "id": "a6d5bd03",
+ "id": "60ff042d",
"metadata": {
"editable": true
},
@@ -5407,7 +5047,7 @@
},
{
"cell_type": "markdown",
- "id": "a4d9fc21",
+ "id": "1c31b285",
"metadata": {
"editable": true
},
@@ -5419,7 +5059,7 @@
},
{
"cell_type": "markdown",
- "id": "119bc56e",
+ "id": "4587edf9",
"metadata": {
"editable": true
},
@@ -5436,7 +5076,7 @@
},
{
"cell_type": "markdown",
- "id": "d15cad60",
+ "id": "3a423c6a",
"metadata": {
"editable": true
},
@@ -5449,7 +5089,7 @@
},
{
"cell_type": "markdown",
- "id": "f725d905",
+ "id": "d53b24a7",
"metadata": {
"editable": true
},
@@ -5461,7 +5101,7 @@
},
{
"cell_type": "markdown",
- "id": "a2a5b25f",
+ "id": "9d589cad",
"metadata": {
"editable": true
},
@@ -5471,7 +5111,7 @@
},
{
"cell_type": "markdown",
- "id": "a9f43162",
+ "id": "f6e8bb3f",
"metadata": {
"editable": true
},
@@ -5484,7 +5124,7 @@
},
{
"cell_type": "markdown",
- "id": "debb0a19",
+ "id": "c01d5a5e",
"metadata": {
"editable": true
},
@@ -5494,7 +5134,7 @@
},
{
"cell_type": "markdown",
- "id": "2764c014",
+ "id": "46e5562b",
"metadata": {
"editable": true
},
@@ -5506,7 +5146,7 @@
},
{
"cell_type": "markdown",
- "id": "ad141726",
+ "id": "44d5398b",
"metadata": {
"editable": true
},
@@ -5519,7 +5159,7 @@
},
{
"cell_type": "markdown",
- "id": "d194482f",
+ "id": "addf0d49",
"metadata": {
"editable": true
},
@@ -5532,7 +5172,7 @@
},
{
"cell_type": "markdown",
- "id": "7ccf56c7",
+ "id": "fdb87f8d",
"metadata": {
"editable": true
},
@@ -5544,7 +5184,7 @@
},
{
"cell_type": "markdown",
- "id": "41939010",
+ "id": "69d507e7",
"metadata": {
"editable": true
},
@@ -5556,7 +5196,7 @@
},
{
"cell_type": "markdown",
- "id": "93d38078",
+ "id": "a4b61630",
"metadata": {
"editable": true
},
@@ -5566,7 +5206,7 @@
},
{
"cell_type": "markdown",
- "id": "9c6d063a",
+ "id": "c82b13a0",
"metadata": {
"editable": true
},
@@ -5579,7 +5219,7 @@
},
{
"cell_type": "markdown",
- "id": "90d9a525",
+ "id": "9d225ea8",
"metadata": {
"editable": true
},
@@ -5591,7 +5231,7 @@
},
{
"cell_type": "markdown",
- "id": "d1c9d3ea",
+ "id": "293d144e",
"metadata": {
"editable": true
},
@@ -5603,7 +5243,7 @@
},
{
"cell_type": "markdown",
- "id": "6a03fd03",
+ "id": "2ba90687",
"metadata": {
"editable": true
},
@@ -5615,7 +5255,7 @@
},
{
"cell_type": "markdown",
- "id": "12f9e2f4",
+ "id": "71b67ece",
"metadata": {
"editable": true
},
@@ -5627,7 +5267,7 @@
},
{
"cell_type": "markdown",
- "id": "0bd449c0",
+ "id": "848de99f",
"metadata": {
"editable": true
},
@@ -5641,7 +5281,7 @@
},
{
"cell_type": "markdown",
- "id": "528f4c54",
+ "id": "229ab3bb",
"metadata": {
"editable": true
},
@@ -5653,7 +5293,7 @@
},
{
"cell_type": "markdown",
- "id": "a4e89b45",
+ "id": "fafe6f12",
"metadata": {
"editable": true
},
@@ -5663,7 +5303,7 @@
},
{
"cell_type": "markdown",
- "id": "af51b23c",
+ "id": "075b9702",
"metadata": {
"editable": true
},
@@ -5675,7 +5315,7 @@
},
{
"cell_type": "markdown",
- "id": "26945717",
+ "id": "4e8ad796",
"metadata": {
"editable": true
},
@@ -5687,7 +5327,7 @@
},
{
"cell_type": "markdown",
- "id": "70a85186",
+ "id": "070bea88",
"metadata": {
"editable": true
},
@@ -5699,7 +5339,7 @@
},
{
"cell_type": "markdown",
- "id": "86de1af1",
+ "id": "cbb1a6d0",
"metadata": {
"editable": true
},
@@ -5711,7 +5351,7 @@
},
{
"cell_type": "markdown",
- "id": "a7eaaac6",
+ "id": "62ea95e8",
"metadata": {
"editable": true
},
@@ -5723,7 +5363,7 @@
},
{
"cell_type": "markdown",
- "id": "732d4020",
+ "id": "1d0a0c3f",
"metadata": {
"editable": true
},
@@ -5742,7 +5382,7 @@
},
{
"cell_type": "markdown",
- "id": "06f71f9c",
+ "id": "502bf9b1",
"metadata": {
"editable": true
},
@@ -5754,7 +5394,7 @@
},
{
"cell_type": "markdown",
- "id": "04266404",
+ "id": "b98b3e29",
"metadata": {
"editable": true
},
@@ -5764,7 +5404,7 @@
},
{
"cell_type": "markdown",
- "id": "753d4bf0",
+ "id": "9afa64c1",
"metadata": {
"editable": true
},
@@ -5776,7 +5416,7 @@
},
{
"cell_type": "markdown",
- "id": "ea8b1f8f",
+ "id": "756fc3c6",
"metadata": {
"editable": true
},
@@ -5786,7 +5426,7 @@
},
{
"cell_type": "markdown",
- "id": "12703a7e",
+ "id": "9faf05fa",
"metadata": {
"editable": true
},
@@ -5798,7 +5438,7 @@
},
{
"cell_type": "markdown",
- "id": "90522189",
+ "id": "36e62812",
"metadata": {
"editable": true
},
@@ -5810,7 +5450,7 @@
},
{
"cell_type": "markdown",
- "id": "b81abc7b",
+ "id": "dee00fc3",
"metadata": {
"editable": true
},
@@ -5826,7 +5466,7 @@
},
{
"cell_type": "markdown",
- "id": "115018b1",
+ "id": "1287f83a",
"metadata": {
"editable": true
},
@@ -5838,7 +5478,7 @@
},
{
"cell_type": "markdown",
- "id": "8741b7a9",
+ "id": "b4240a7b",
"metadata": {
"editable": true
},
@@ -5850,7 +5490,7 @@
},
{
"cell_type": "markdown",
- "id": "5fe75d98",
+ "id": "fd444925",
"metadata": {
"editable": true
},
@@ -5860,7 +5500,7 @@
},
{
"cell_type": "markdown",
- "id": "522e6278",
+ "id": "5b055ab3",
"metadata": {
"editable": true
},
@@ -5872,7 +5512,7 @@
},
{
"cell_type": "markdown",
- "id": "eaa39cca",
+ "id": "bc539215",
"metadata": {
"editable": true
},
@@ -5882,7 +5522,7 @@
},
{
"cell_type": "markdown",
- "id": "230a8059",
+ "id": "5a4af335",
"metadata": {
"editable": true
},
@@ -5894,7 +5534,7 @@
},
{
"cell_type": "markdown",
- "id": "698a93f7",
+ "id": "94a4c6dc",
"metadata": {
"editable": true
},
@@ -5911,7 +5551,7 @@
},
{
"cell_type": "markdown",
- "id": "96e49fbc",
+ "id": "6cef8bfb",
"metadata": {
"editable": true
},
@@ -5923,7 +5563,7 @@
},
{
"cell_type": "markdown",
- "id": "f2043d81",
+ "id": "5f04ae7d",
"metadata": {
"editable": true
},
@@ -5935,7 +5575,7 @@
},
{
"cell_type": "markdown",
- "id": "f2dd8e44",
+ "id": "35418e34",
"metadata": {
"editable": true
},
@@ -5945,7 +5585,7 @@
},
{
"cell_type": "markdown",
- "id": "0ab90bb2",
+ "id": "df4a83ee",
"metadata": {
"editable": true
},
@@ -5957,7 +5597,7 @@
},
{
"cell_type": "markdown",
- "id": "1090467c",
+ "id": "43751ced",
"metadata": {
"editable": true
},
@@ -5967,7 +5607,7 @@
},
{
"cell_type": "markdown",
- "id": "8bc71963",
+ "id": "4a030f43",
"metadata": {
"editable": true
},
@@ -5979,7 +5619,7 @@
},
{
"cell_type": "markdown",
- "id": "918da4ad",
+ "id": "9e27747e",
"metadata": {
"editable": true
},
@@ -5989,7 +5629,7 @@
},
{
"cell_type": "markdown",
- "id": "ee673e3d",
+ "id": "be4c8f46",
"metadata": {
"editable": true
},
@@ -6001,7 +5641,7 @@
},
{
"cell_type": "markdown",
- "id": "03352030",
+ "id": "7da22e7f",
"metadata": {
"editable": true
},
@@ -6011,7 +5651,7 @@
},
{
"cell_type": "markdown",
- "id": "1b29a63e",
+ "id": "9c059120",
"metadata": {
"editable": true
},
@@ -6023,7 +5663,7 @@
},
{
"cell_type": "markdown",
- "id": "206bcec2",
+ "id": "aa7c7a38",
"metadata": {
"editable": true
},
diff --git a/doc/src/week34/exercisesweek34.do.txt b/doc/src/week34/exercisesweek34.do.txt
index 20bcf493a..542d00eda 100644
--- a/doc/src/week34/exercisesweek34.do.txt
+++ b/doc/src/week34/exercisesweek34.do.txt
@@ -78,6 +78,7 @@ We recommend using _Anaconda_ if you are not too familiar with setting paths in
We will generate our own dataset for a function $y(x)$ where $x \in [0,1]$ and defined by random numbers computed with the uniform distribution. The function $y$ is a quadratic polynomial in $x$ with added stochastic noise according to the normal distribution $\cal {N}(0,1)$.
The following simple Python instructions define our $x$ and $y$ values (with 100 data points).
!bc pycod
+import numpy as np
x = np.random.rand(100,1)
y = 2.0+5*x*x+0.1*np.random.randn(100,1)
!ec
diff --git a/doc/src/week34/exercisesweek34.ipynb b/doc/src/week34/exercisesweek34.ipynb
new file mode 100644
index 000000000..6a84a1d30
--- /dev/null
+++ b/doc/src/week34/exercisesweek34.ipynb
@@ -0,0 +1,303 @@
+{
+ "cells": [
+ {
+ "cell_type": "markdown",
+ "id": "a50ea987",
+ "metadata": {
+ "editable": true
+ },
+ "source": [
+ "\n",
+ ""
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "291e6015",
+ "metadata": {
+ "editable": true
+ },
+ "source": [
+ "# Exercises week 34\n",
+ "**FYS-STK3155/4155**\n",
+ "\n",
+ "Date: **August 19-23, 2024**"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "141ff111",
+ "metadata": {
+ "editable": true
+ },
+ "source": [
+ "## Exercises\n",
+ "\n",
+ "Here are three possible exercises for week 34"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "32a1fc9e",
+ "metadata": {
+ "editable": true
+ },
+ "source": [
+ "## Exercise 1: Setting up various Python environments\n",
+ "\n",
+ "The first exercise here is of a mere technical art. We want you to have \n",
+ "* git as a version control software and to establish a user account on a provider like GitHub. Other providers like GitLab etc are equally fine. You can also use the University of Oslo [GitHub facilities](https://www.uio.no/tjenester/it/maskin/filer/versjonskontroll/github.html). \n",
+ "\n",
+ "* Install various Python packages\n",
+ "\n",
+ "We will make extensive use of Python as programming language and its\n",
+ "myriad of available libraries. You will find\n",
+ "IPython/Jupyter notebooks invaluable in your work. You can run **R**\n",
+ "codes in the Jupyter/IPython notebooks, with the immediate benefit of\n",
+ "visualizing your data. You can also use compiled languages like C++,\n",
+ "Rust, Fortran etc if you prefer. The focus in these lectures will be\n",
+ "on Python.\n",
+ "\n",
+ "If you have Python installed (we recommend Python3) and you feel\n",
+ "pretty familiar with installing different packages, we recommend that\n",
+ "you install the following Python packages via **pip** as \n",
+ "\n",
+ "1. pip install numpy scipy matplotlib ipython scikit-learn sympy pandas pillow \n",
+ "\n",
+ "For **Tensorflow**, we recommend following the instructions in the text of \n",
+ "[Aurelien Geron, Hands‑On Machine Learning with Scikit‑Learn and TensorFlow, O'Reilly](http://shop.oreilly.com/product/0636920052289.do)\n",
+ "\n",
+ "We will come back to **tensorflow** later. \n",
+ "\n",
+ "For Python3, replace **pip** with **pip3**.\n",
+ "\n",
+ "For OSX users we recommend, after having installed Xcode, to\n",
+ "install **brew**. Brew allows for a seamless installation of additional\n",
+ "software via for example \n",
+ "\n",
+ "1. brew install python3\n",
+ "\n",
+ "For Linux users, with its variety of distributions like for example the widely popular Ubuntu distribution,\n",
+ "you can use **pip** as well and simply install Python as \n",
+ "\n",
+ "1. sudo apt-get install python3 (or python for Python2.7)\n",
+ "\n",
+ "If you don't want to perform these operations separately and venture\n",
+ "into the hassle of exploring how to set up dependencies and paths, we\n",
+ "recommend two widely used distrubutions which set up all relevant\n",
+ "dependencies for Python, namely \n",
+ "\n",
+ "* [Anaconda](https://docs.anaconda.com/), \n",
+ "\n",
+ "which is an open source\n",
+ "distribution of the Python and R programming languages for large-scale\n",
+ "data processing, predictive analytics, and scientific computing, that\n",
+ "aims to simplify package management and deployment. Package versions\n",
+ "are managed by the package management system **conda**. \n",
+ "\n",
+ "* [Enthought canopy](https://www.enthought.com/product/canopy/) \n",
+ "\n",
+ "is a Python\n",
+ "distribution for scientific and analytic computing distribution and\n",
+ "analysis environment, available for free and under a commercial\n",
+ "license.\n",
+ "\n",
+ "We recommend using **Anaconda** if you are not too familiar with setting paths in a terminal environment."
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "f103f4c1",
+ "metadata": {
+ "editable": true
+ },
+ "source": [
+ "## Exercise 2: making your own data and exploring scikit-learn\n",
+ "\n",
+ "We will generate our own dataset for a function $y(x)$ where $x \\in [0,1]$ and defined by random numbers computed with the uniform distribution. The function $y$ is a quadratic polynomial in $x$ with added stochastic noise according to the normal distribution $\\cal {N}(0,1)$.\n",
+ "The following simple Python instructions define our $x$ and $y$ values (with 100 data points)."
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 1,
+ "id": "81c11edc",
+ "metadata": {
+ "collapsed": false,
+ "editable": true
+ },
+ "outputs": [],
+ "source": [
+ "import numpy as np\n",
+ "x = np.random.rand(100,1)\n",
+ "y = 2.0+5*x*x+0.1*np.random.randn(100,1)"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "970bd604",
+ "metadata": {
+ "editable": true
+ },
+ "source": [
+ "1. Write your own code (following the examples under the [regression notes](https://compphysics.github.io/MachineLearning/doc/LectureNotes/_build/html/chapter1.html)) for computing the parametrization of the data set fitting a second-order polynomial. \n",
+ "\n",
+ "2. Use thereafter **scikit-learn** (see again the examples in the regression slides) and compare with your own code. \n",
+ "\n",
+ "3. Using scikit-learn, compute also the mean square error, a risk metric corresponding to the expected value of the squared (quadratic) error defined as"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "bda3ed04",
+ "metadata": {
+ "editable": true
+ },
+ "source": [
+ "$$\n",
+ "MSE(\\boldsymbol{y},\\boldsymbol{\\tilde{y}}) = \\frac{1}{n}\n",
+ "\\sum_{i=0}^{n-1}(y_i-\\tilde{y}_i)^2,\n",
+ "$$"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "ca995691",
+ "metadata": {
+ "editable": true
+ },
+ "source": [
+ "and the $R^2$ score function.\n",
+ "If $\\tilde{\\boldsymbol{y}}_i$ is the predicted value of the $i-th$ sample and $y_i$ is the corresponding true value, then the score $R^2$ is defined as"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "27cbfeed",
+ "metadata": {
+ "editable": true
+ },
+ "source": [
+ "$$\n",
+ "R^2(\\boldsymbol{y}, \\tilde{\\boldsymbol{y}}) = 1 - \\frac{\\sum_{i=0}^{n - 1} (y_i - \\tilde{y}_i)^2}{\\sum_{i=0}^{n - 1} (y_i - \\bar{y})^2},\n",
+ "$$"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "9e063f6d",
+ "metadata": {
+ "editable": true
+ },
+ "source": [
+ "where we have defined the mean value of $\\boldsymbol{y}$ as"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "e582c2bb",
+ "metadata": {
+ "editable": true
+ },
+ "source": [
+ "$$\n",
+ "\\bar{y} = \\frac{1}{n} \\sum_{i=0}^{n - 1} y_i.\n",
+ "$$"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "59e0ed7a",
+ "metadata": {
+ "editable": true
+ },
+ "source": [
+ "You can use the functionality included in scikit-learn. If you feel for it, you can use your own program and define functions which compute the above two functions. \n",
+ "Discuss the meaning of these results. Try also to vary the coefficient in front of the added stochastic noise term and discuss the quality of the fits."
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "051e71aa",
+ "metadata": {
+ "editable": true
+ },
+ "source": [
+ "## Exercise 3: Split data in test and training data\n",
+ "\n",
+ "In this exercise we want you to to compute the MSE for the training\n",
+ "data and the test data as function of the complexity of a polynomial,\n",
+ "that is the degree of a given polynomial.\n",
+ "\n",
+ "The aim is to reproduce Figure 2.11 of [Hastie et al](https://github.com/CompPhysics/MLErasmus/blob/master/doc/Textbooks/elementsstat.pdf).\n",
+ "\n",
+ "Our data is defined by $x\\in [-3,3]$ with a total of for example $n=100$ data points. You should try to vary the number of data points $n$ in your analysis."
+ ]
+ },
+ {
+ "cell_type": "code",
+ "execution_count": 2,
+ "id": "c82d8b64",
+ "metadata": {
+ "collapsed": false,
+ "editable": true
+ },
+ "outputs": [],
+ "source": [
+ "np.random.seed()\n",
+ "n = 100\n",
+ "# Make data set.\n",
+ "x = np.linspace(-3, 3, n).reshape(-1, 1)\n",
+ "y = np.exp(-x**2) + 1.5 * np.exp(-(x-2)**2)+ np.random.normal(0, 0.1, x.shape)"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "3e810bba",
+ "metadata": {
+ "editable": true
+ },
+ "source": [
+ "where $y$ is the function we want to fit with a given polynomial."
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "c1198fce",
+ "metadata": {
+ "editable": true
+ },
+ "source": [
+ "**a)**\n",
+ "Write a first code which sets up a design matrix $X$ defined by a fifth-order polynomial and split your data set in training and test data."
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "1b0cea0a",
+ "metadata": {
+ "editable": true
+ },
+ "source": [
+ "**b)**\n",
+ "Write thereafter (using either **scikit-learn** or your matrix inversion code using for example **numpy**)\n",
+ "and perform an ordinary least squares fitting and compute the mean squared error for the training data and the test data. These calculations should apply to a model given by a fifth-order polynomial."
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "id": "5194ba08",
+ "metadata": {
+ "editable": true
+ },
+ "source": [
+ "**c)**\n",
+ "Add now a model which allows you to make polynomials up to degree $15$. Perform a standard OLS fitting of the training data and compute the MSE for the training and test data and plot both test and training data MSE as functions of the polynomial degree. Compare what you see with Figure 2.11 of Hastie et al. Comment your results. For which polynomial degree do you find an optimal MSE (smallest value)?"
+ ]
+ }
+ ],
+ "metadata": {},
+ "nbformat": 4,
+ "nbformat_minor": 5
+}