update

doc/src/How2ReadData/How2ReadData.do.txt

@@ -2,11 +2,6 @@ TITLE: Data Analysis and Machine Learning: Getting started, our first data and M
 AUTHOR: Morten Hjorth-Jensen {copyright, 1999-present|CC BY-NC} at Department of Physics, University of Oslo & Department of Physics and Astronomy and National Superconducting Cyclotron Laboratory, Michigan State University
 DATE: today
 
-!split
-===== To do =====
-
-* rewrite totally, shuffle statistics material to stat part
-* lin algebra part to be removed
 
 
 ===== Introduction =====

doc/src/How2ReadData/make.sh

@@ -47,7 +47,7 @@ system doconce format html $name --html_style=bootstrap --pygments_html_style=de
 #system doconce split_html $html.html --method=split --pagination --nav_button=bottom
 
 # IPython notebook
-system doconce format ipynb $name $opt
+#system doconce format ipynb $name $opt
 
 
 

doc/src/How2ReadData/todo.list

@@ -0,0 +1,7 @@
+
+===== To do =====
+
+* rewrite totally, shuffle statistics material to stat part
+* lin algebra part to be removed
+
+

doc/src/Introduction/make.sh

@@ -47,7 +47,7 @@ system doconce format html $name --html_style=bootstrap --pygments_html_style=de
 #system doconce split_html $html.html --method=split --pagination --nav_button=bottom
 
 # IPython notebook
-system doconce format ipynb $name $opt
+#system doconce format ipynb $name $opt
 
 
 # Ordinary plain LaTeX document

doc/src/Regression/make.sh

@@ -47,7 +47,7 @@ system doconce format html $name --html_style=bootstrap --pygments_html_style=de
 system doconce split_html $html.html --method=split --pagination --nav_button=bottom
 
 # IPython notebook
-system doconce format ipynb $name $opt
+#system doconce format ipynb $name $opt
 
 
 # Ordinary plain LaTeX document

doc/src/Regression/todo.list

@@ -0,0 +1,12 @@
+
+* Clean up Boston Housing data with correlations, add perhaps another more science related example. Add more info about correlation matrix, how to set it up and what it means
+* show how the data is set up and show the design matrix for this data set
+* Bring up covid data, say eg recent UK data on race etc
+* Same for the Ising model
+* Clean up part on statistics and resampling methods
+* add material on ridge and lasso and link to SVD, show proofs, use doughnut example
+* clean up math formalism, hats to boldface
+* add material about kernel regression and splines
+* rewrite Cross validation part and add discussion of train, validate and test, think of placing in statistics part or merge statistics into the reg material. add more formal stat on bootstrapping
+* add discussion of training, validation and testing using ridge and lasso regression. demonstrate usage of gridsearch in validation case. 
+