This commit is contained in:
Morten Hjorth-Jensen
2023-09-11 07:03:15 +02:00
parent 125231ac1a
commit 006b2407fe
8 changed files with 69 additions and 74 deletions
Binary file not shown.
@@ -2,7 +2,7 @@
"cells": [
{
"cell_type": "markdown",
"id": "28222517",
"id": "ebfc874e",
"metadata": {
"editable": true
},
@@ -14,7 +14,7 @@
},
{
"cell_type": "markdown",
"id": "c7ffd7b0",
"id": "8ecf95b0",
"metadata": {
"editable": true
},
@@ -27,7 +27,7 @@
},
{
"cell_type": "markdown",
"id": "f687d0b0",
"id": "7940e437",
"metadata": {
"editable": true
},
@@ -45,7 +45,7 @@
},
{
"cell_type": "markdown",
"id": "b0b5ae03",
"id": "964cf4c4",
"metadata": {
"editable": true
},
@@ -57,7 +57,7 @@
},
{
"cell_type": "markdown",
"id": "a5442d69",
"id": "bc8b093a",
"metadata": {
"editable": true
},
@@ -68,7 +68,7 @@
},
{
"cell_type": "markdown",
"id": "d9ac69f5",
"id": "bc1907b5",
"metadata": {
"editable": true
},
@@ -80,7 +80,7 @@
},
{
"cell_type": "markdown",
"id": "6f42da1d",
"id": "c7d29897",
"metadata": {
"editable": true
},
@@ -90,7 +90,7 @@
},
{
"cell_type": "markdown",
"id": "5690cef0",
"id": "e45dbe57",
"metadata": {
"editable": true
},
@@ -102,7 +102,7 @@
},
{
"cell_type": "markdown",
"id": "3834fc47",
"id": "0331d3dd",
"metadata": {
"editable": true
},
@@ -114,7 +114,7 @@
},
{
"cell_type": "markdown",
"id": "bcfd68b4",
"id": "51159839",
"metadata": {
"editable": true
},
@@ -125,7 +125,7 @@
},
{
"cell_type": "markdown",
"id": "9551e381",
"id": "6df6ca33",
"metadata": {
"editable": true
},
@@ -137,7 +137,7 @@
},
{
"cell_type": "markdown",
"id": "e470afef",
"id": "6bf812e3",
"metadata": {
"editable": true
},
@@ -150,7 +150,7 @@
},
{
"cell_type": "markdown",
"id": "6ece00ae",
"id": "1e04714b",
"metadata": {
"editable": true
},
@@ -162,7 +162,7 @@
},
{
"cell_type": "markdown",
"id": "98bad716",
"id": "621afaa2",
"metadata": {
"editable": true
},
@@ -172,7 +172,7 @@
},
{
"cell_type": "markdown",
"id": "a8dad13c",
"id": "b7aa535d",
"metadata": {
"editable": true
},
@@ -184,7 +184,7 @@
},
{
"cell_type": "markdown",
"id": "94cddcc3",
"id": "45ea3a92",
"metadata": {
"editable": true
},
@@ -195,7 +195,7 @@
},
{
"cell_type": "markdown",
"id": "8e5c2d66",
"id": "3851ded2",
"metadata": {
"editable": true
},
@@ -207,7 +207,7 @@
},
{
"cell_type": "markdown",
"id": "5d7e493e",
"id": "c759e617",
"metadata": {
"editable": true
},
@@ -220,7 +220,7 @@
},
{
"cell_type": "markdown",
"id": "44050008",
"id": "c16482df",
"metadata": {
"editable": true
},
@@ -233,20 +233,19 @@
},
{
"cell_type": "markdown",
"id": "c0bf3608",
"id": "2e2cda9b",
"metadata": {
"editable": true
},
"source": [
"$$\n",
"\\mbox{Var}[\\boldsymbol{\\beta}^{\\mathrm{Ridge}}]=\\sigma^2[ \\mathbf{X}^{T} \\mathbf{X} + \\lambda \\mathbf{I} ]^{-1} \\mathbf{X}^{T} \\mathbf{X} \\{ [ \\m\\\n",
"athbf{X}^{\\top} \\mathbf{X} + \\lambda \\mathbf{I} ]^{-1}\\}^{T},\n",
"\\mbox{Var}[\\boldsymbol{\\beta}^{\\mathrm{Ridge}}]=\\sigma^2[ \\mathbf{X}^{T} \\mathbf{X} + \\lambda \\mathbf{I} ]^{-1} \\mathbf{X}^{T}\\mathbf{X} \\{ [ \\mathbf{X}^{\\top} \\mathbf{X} + \\lambda \\mathbf{I} ]^{-1}\\}^{T},\n",
"$$"
]
},
{
"cell_type": "markdown",
"id": "371484f8",
"id": "d69a45ab",
"metadata": {
"editable": true
},
@@ -496,8 +496,7 @@ A given parameter <span class="math notranslate nohighlight">\(\beta_j\)</span>
<p>Show also that the variance is</p>
<div class="math notranslate nohighlight">
\[
\mbox{Var}[\boldsymbol{\beta}^{\mathrm{Ridge}}]=\sigma^2[ \mathbf{X}^{T} \mathbf{X} + \lambda \mathbf{I} ]^{-1} \mathbf{X}^{T} \mathbf{X} \{ [ \m\
athbf{X}^{\top} \mathbf{X} + \lambda \mathbf{I} ]^{-1}\}^{T},
\mbox{Var}[\boldsymbol{\beta}^{\mathrm{Ridge}}]=\sigma^2[ \mathbf{X}^{T} \mathbf{X} + \lambda \mathbf{I} ]^{-1} \mathbf{X}^{T}\mathbf{X} \{ [ \mathbf{X}^{\top} \mathbf{X} + \lambda \mathbf{I} ]^{-1}\}^{T},
\]</div>
<p>and it is easy to see that if the parameter <span class="math notranslate nohighlight">\(\lambda\)</span> goes to infinity then the variance of Ridge parameters <span class="math notranslate nohighlight">\(\boldsymbol{\beta}\)</span> goes to zero.</p>
</div>
File diff suppressed because one or more lines are too long
@@ -2,7 +2,7 @@
"cells": [
{
"cell_type": "markdown",
"id": "28222517",
"id": "ebfc874e",
"metadata": {
"editable": true
},
@@ -14,7 +14,7 @@
},
{
"cell_type": "markdown",
"id": "c7ffd7b0",
"id": "8ecf95b0",
"metadata": {
"editable": true
},
@@ -27,7 +27,7 @@
},
{
"cell_type": "markdown",
"id": "f687d0b0",
"id": "7940e437",
"metadata": {
"editable": true
},
@@ -45,7 +45,7 @@
},
{
"cell_type": "markdown",
"id": "b0b5ae03",
"id": "964cf4c4",
"metadata": {
"editable": true
},
@@ -57,7 +57,7 @@
},
{
"cell_type": "markdown",
"id": "a5442d69",
"id": "bc8b093a",
"metadata": {
"editable": true
},
@@ -68,7 +68,7 @@
},
{
"cell_type": "markdown",
"id": "d9ac69f5",
"id": "bc1907b5",
"metadata": {
"editable": true
},
@@ -80,7 +80,7 @@
},
{
"cell_type": "markdown",
"id": "6f42da1d",
"id": "c7d29897",
"metadata": {
"editable": true
},
@@ -90,7 +90,7 @@
},
{
"cell_type": "markdown",
"id": "5690cef0",
"id": "e45dbe57",
"metadata": {
"editable": true
},
@@ -102,7 +102,7 @@
},
{
"cell_type": "markdown",
"id": "3834fc47",
"id": "0331d3dd",
"metadata": {
"editable": true
},
@@ -114,7 +114,7 @@
},
{
"cell_type": "markdown",
"id": "bcfd68b4",
"id": "51159839",
"metadata": {
"editable": true
},
@@ -125,7 +125,7 @@
},
{
"cell_type": "markdown",
"id": "9551e381",
"id": "6df6ca33",
"metadata": {
"editable": true
},
@@ -137,7 +137,7 @@
},
{
"cell_type": "markdown",
"id": "e470afef",
"id": "6bf812e3",
"metadata": {
"editable": true
},
@@ -150,7 +150,7 @@
},
{
"cell_type": "markdown",
"id": "6ece00ae",
"id": "1e04714b",
"metadata": {
"editable": true
},
@@ -162,7 +162,7 @@
},
{
"cell_type": "markdown",
"id": "98bad716",
"id": "621afaa2",
"metadata": {
"editable": true
},
@@ -172,7 +172,7 @@
},
{
"cell_type": "markdown",
"id": "a8dad13c",
"id": "b7aa535d",
"metadata": {
"editable": true
},
@@ -184,7 +184,7 @@
},
{
"cell_type": "markdown",
"id": "94cddcc3",
"id": "45ea3a92",
"metadata": {
"editable": true
},
@@ -195,7 +195,7 @@
},
{
"cell_type": "markdown",
"id": "8e5c2d66",
"id": "3851ded2",
"metadata": {
"editable": true
},
@@ -207,7 +207,7 @@
},
{
"cell_type": "markdown",
"id": "5d7e493e",
"id": "c759e617",
"metadata": {
"editable": true
},
@@ -220,7 +220,7 @@
},
{
"cell_type": "markdown",
"id": "44050008",
"id": "c16482df",
"metadata": {
"editable": true
},
@@ -233,20 +233,19 @@
},
{
"cell_type": "markdown",
"id": "c0bf3608",
"id": "2e2cda9b",
"metadata": {
"editable": true
},
"source": [
"$$\n",
"\\mbox{Var}[\\boldsymbol{\\beta}^{\\mathrm{Ridge}}]=\\sigma^2[ \\mathbf{X}^{T} \\mathbf{X} + \\lambda \\mathbf{I} ]^{-1} \\mathbf{X}^{T} \\mathbf{X} \\{ [ \\m\\\n",
"athbf{X}^{\\top} \\mathbf{X} + \\lambda \\mathbf{I} ]^{-1}\\}^{T},\n",
"\\mbox{Var}[\\boldsymbol{\\beta}^{\\mathrm{Ridge}}]=\\sigma^2[ \\mathbf{X}^{T} \\mathbf{X} + \\lambda \\mathbf{I} ]^{-1} \\mathbf{X}^{T}\\mathbf{X} \\{ [ \\mathbf{X}^{\\top} \\mathbf{X} + \\lambda \\mathbf{I} ]^{-1}\\}^{T},\n",
"$$"
]
},
{
"cell_type": "markdown",
"id": "371484f8",
"id": "d69a45ab",
"metadata": {
"editable": true
},