394 lines
18 KiB
Plaintext
394 lines
18 KiB
Plaintext
TITLE: Overview of course material: Data Analysis and Machine Learning
|
|
AUTHOR: "Morten Hjorth-Jensen":"http://mhjgit.github.io/info/doc/web/" at Department of Physics and Astronomy and Facility for Rare ion Beams and National Superconducting Cyclotron Laboratory, Michigan State University, USA & Department of Physics (office FV308), University of Oslo, Norway
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
The teaching material is produced in various formats for printing and on-screen reading.
|
|
|
|
!split
|
|
!bwarning
|
|
The PDF files are based on LaTeX and have seldom technical
|
|
failures that cannot be easily corrected.
|
|
The HTML-based files, called ``HTML'' and ``ipynb'' below, apply MathJax
|
|
for rendering LaTeX formulas and sometimes this technology gives rise
|
|
to unexpected failures (e.g.,
|
|
incorrect rendering in a web page despite correct LaTeX syntax in the
|
|
formula). Consult the corresponding PDF
|
|
files if you find missing or incorrectly rendered
|
|
formulas in HTML or ipython notebook files.
|
|
!ewarning
|
|
|
|
|
|
|
|
|
|
===== Basic introduction to the course with schedule etc =====
|
|
|
|
|
|
|
|
* LaTeX PDF:
|
|
* For printing:
|
|
* "Standard one-page format": "https://compphysics.github.io/MachineLearning/doc/pub/Intro2Course/pdf/Intro2Course-minted.pdf"
|
|
* HTML:
|
|
* "Plain html": "https://compphysics.github.io/MachineLearning/doc/pub/Intro2Course/html/Intro2Course.html"
|
|
* "reveal.js beige slide style": "https://compphysics.github.io/MachineLearning/doc/pub/Intro2Course/html/Intro2Course-reveal.html"
|
|
* "Bootstrap slide style, easy for reading on mobile devices": "https://compphysics.github.io/MachineLearning/doc/pub/Intro2Course/html/Intro2Course-bs.html"
|
|
* Jupyter notebook:
|
|
* "ipynb file": "https://compphysics.github.io/MachineLearning/doc/pub/Intro2Course/ipynb/Intro2Course.ipynb"
|
|
|
|
|
|
===== Introduction to Data Analysis and Machine Learning =====
|
|
|
|
|
|
|
|
* LaTeX PDF:
|
|
* For printing:
|
|
* "Standard one-page format": "https://compphysics.github.io/MachineLearning/doc/pub/Introduction/pdf/Introduction-minted.pdf"
|
|
* HTML:
|
|
* "Plain html": "https://compphysics.github.io/MachineLearning/doc/pub/Introduction/html/Introduction.html"
|
|
* "reveal.js beige slide style": "https://compphysics.github.io/MachineLearning/doc/pub/Introduction/html/Introduction-reveal.html"
|
|
* "Bootstrap slide style, easy for reading on mobile devices": "https://compphysics.github.io/MachineLearning/doc/pub/Introduction/html/Introduction-bs.html"
|
|
* Jupyter notebook:
|
|
* "ipynb file": "https://compphysics.github.io/MachineLearning/doc/pub/Introduction/ipynb/Introduction.ipynb"
|
|
|
|
|
|
===== Getting started with Machine Learning with simple Examples =====
|
|
|
|
|
|
|
|
* LaTeX PDF:
|
|
* For printing:
|
|
* "Standard one-page format": "https://compphysics.github.io/MachineLearning/doc/pub/How2ReadData/pdf/How2ReadData-minted.pdf"
|
|
* HTML:
|
|
* "Plain html": "https://compphysics.github.io/MachineLearning/doc/pub/How2ReadData/html/How2ReadData.html"
|
|
* "reveal.js beige slide style": "https://compphysics.github.io/MachineLearning/doc/pub/How2ReadData/html/How2ReadData-reveal.html"
|
|
* "Bootstrap slide style, easy for reading on mobile devices": "https://compphysics.github.io/MachineLearning/doc/pub/How2ReadData/html/How2ReadData-bs.html"
|
|
* Jupyter notebook:
|
|
* "ipynb file": "https://compphysics.github.io/MachineLearning/doc/pub/How2ReadData/ipynb/How2ReadData.ipynb"
|
|
|
|
|
|
===== Review of central linear algebra elements =====
|
|
|
|
|
|
|
|
* LaTeX PDF:
|
|
* For printing:
|
|
* "Standard one-page format": "https://compphysics.github.io/MachineLearning/doc/pub/Linalg/pdf/Linalg-minted.pdf"
|
|
* HTML:
|
|
* "Plain html": "https://compphysics.github.io/MachineLearning/doc/pub/Linalg/html/Linalg.html"
|
|
* "reveal.js beige slide style": "https://compphysics.github.io/MachineLearning/doc/pub/Linalg/html/Linalg-reveal.html"
|
|
* "Bootstrap slide style, easy for reading on mobile devices": "https://compphysics.github.io/MachineLearning/doc/pub/Linalg/html/Linalg-bs.html"
|
|
* Jupyter notebook:
|
|
* "ipynb file": "https://compphysics.github.io/MachineLearning/doc/pub/Linalg/ipynb/Linalg.ipynb"
|
|
|
|
|
|
===== Monte Carlo methods and elements of probability theory =====
|
|
|
|
|
|
|
|
* LaTeX PDF:
|
|
* For printing:
|
|
* "Standard one-page format": "https://compphysics.github.io/MachineLearning/doc/pub/Statistics/pdf/Statistics-minted.pdf"
|
|
* HTML:
|
|
* "Plain html": "https://compphysics.github.io/MachineLearning/doc/pub/Statistics/html/Statistics.html"
|
|
* "reveal.js beige slide style": "https://compphysics.github.io/MachineLearning/doc/pub/Statistics/html/Statistics-reveal.html"
|
|
* "Bootstrap slide style, easy for reading on mobile devices": "https://compphysics.github.io/MachineLearning/doc/pub/Statistics/html/Statistics-bs.html"
|
|
* Jupyter notebook:
|
|
* "ipynb file": "https://compphysics.github.io/MachineLearning/doc/pub/Statistics/ipynb/Statistics.ipynb"
|
|
|
|
|
|
===== Regression Methods =====
|
|
|
|
|
|
|
|
* LaTeX PDF:
|
|
* For printing:
|
|
* "Standard one-page format": "https://compphysics.github.io/MachineLearning/doc/pub/Regression/pdf/Regression-minted.pdf"
|
|
* HTML:
|
|
* "Plain html": "https://compphysics.github.io/MachineLearning/doc/pub/Regression/html/Regression.html"
|
|
* "reveal.js beige slide style": "https://compphysics.github.io/MachineLearning/doc/pub/Regression/html/Regression-reveal.html"
|
|
* "Bootstrap slide style, easy for reading on mobile devices": "https://compphysics.github.io/MachineLearning/doc/pub/Regression/html/Regression-bs.html"
|
|
* Jupyter notebook:
|
|
* "ipynb file": "https://compphysics.github.io/MachineLearning/doc/pub/Regression/ipynb/Regression.ipynb"
|
|
|
|
|
|
===== Gradient methods and Minimization Algorithms =====
|
|
|
|
|
|
|
|
* LaTeX PDF:
|
|
* For printing:
|
|
* "Standard one-page format": "https://compphysics.github.io/MachineLearning/doc/pub/Splines/pdf/Splines-minted.pdf"
|
|
* HTML:
|
|
* "Plain html": "https://compphysics.github.io/MachineLearning/doc/pub/Splines/html/Splines.html"
|
|
* "reveal.js beige slide style": "https://compphysics.github.io/MachineLearning/doc/pub/Splines/html/Splines-reveal.html"
|
|
* "Bootstrap slide style, easy for reading on mobile devices": "https://compphysics.github.io/MachineLearning/doc/pub/Splines/html/Splines-bs.html"
|
|
* Jupyter notebook:
|
|
* "ipynb file": "https://compphysics.github.io/MachineLearning/doc/pub/Splines/ipynb/Splines.ipynb"
|
|
|
|
|
|
===== Logistic Regression =====
|
|
|
|
|
|
|
|
* LaTeX PDF:
|
|
* For printing:
|
|
* "Standard one-page format": "https://compphysics.github.io/MachineLearning/doc/pub/LogReg/pdf/LogReg-minted.pdf"
|
|
* HTML:
|
|
* "Plain html": "https://compphysics.github.io/MachineLearning/doc/pub/LogReg/html/LogReg.html"
|
|
* "reveal.js beige slide style": "https://compphysics.github.io/MachineLearning/doc/pub/LogReg/html/LogReg-reveal.html"
|
|
* "Bootstrap slide style, easy for reading on mobile devices": "https://compphysics.github.io/MachineLearning/doc/pub/LogReg/html/LogReg-bs.html"
|
|
* Jupyter notebook:
|
|
* "ipynb file": "https://compphysics.github.io/MachineLearning/doc/pub/LogReg/ipynb/LogReg.ipynb"
|
|
|
|
|
|
===== Neural Networks =====
|
|
|
|
|
|
|
|
* LaTeX PDF:
|
|
* For printing:
|
|
* "Standard one-page format": "https://compphysics.github.io/MachineLearning/doc/pub/NeuralNet/pdf/NeuralNet-minted.pdf"
|
|
* HTML:
|
|
* "Plain html": "https://compphysics.github.io/MachineLearning/doc/pub/NeuralNet/html/NeuralNet.html"
|
|
* "reveal.js beige slide style": "https://compphysics.github.io/MachineLearning/doc/pub/NeuralNet/html/NeuralNet-reveal.html"
|
|
* "Bootstrap slide style, easy for reading on mobile devices": "https://compphysics.github.io/MachineLearning/doc/pub/NeuralNet/html/NeuralNet-bs.html"
|
|
* Jupyter notebook:
|
|
* "ipynb file": "https://compphysics.github.io/MachineLearning/doc/pub/NeuralNet/ipynb/NeuralNet.ipynb"
|
|
|
|
|
|
===== Convolutional Neural Networks =====
|
|
|
|
|
|
|
|
* LaTeX PDF:
|
|
* For printing:
|
|
* "Standard one-page format": "https://compphysics.github.io/MachineLearning/doc/pub/cnn/pdf/cnn-minted.pdf"
|
|
* HTML:
|
|
* "Plain html": "https://compphysics.github.io/MachineLearning/doc/pub/cnn/html/cnn.html"
|
|
* "reveal.js beige slide style": "https://compphysics.github.io/MachineLearning/doc/pub/cnn/html/cnn-reveal.html"
|
|
* "Bootstrap slide style, easy for reading on mobile devices": "https://compphysics.github.io/MachineLearning/doc/pub/cnn/html/cnn-bs.html"
|
|
* Jupyter notebook:
|
|
* "ipynb file": "https://compphysics.github.io/MachineLearning/doc/pub/cnn/ipynb/cnn.ipynb"
|
|
|
|
|
|
===== Reduction of dimensionality =====
|
|
|
|
|
|
|
|
* LaTeX PDF:
|
|
* For printing:
|
|
* "Standard one-page format": "https://compphysics.github.io/MachineLearning/doc/pub/DimRed/pdf/DimRed-minted.pdf"
|
|
* HTML:
|
|
* "Plain html": "https://compphysics.github.io/MachineLearning/doc/pub/DimRed/html/DimRed.html"
|
|
* "reveal.js beige slide style": "https://compphysics.github.io/MachineLearning/doc/pub/DimRed/html/DimRed-reveal.html"
|
|
* "Bootstrap slide style, easy for reading on mobile devices": "https://compphysics.github.io/MachineLearning/doc/pub/DimRed/html/DimRed-bs.html"
|
|
* Jupyter notebook:
|
|
* "ipynb file": "https://compphysics.github.io/MachineLearning/doc/pub/DimRed/ipynb/DimRed.ipynb"
|
|
|
|
|
|
===== Decision Trees and Random Forests =====
|
|
|
|
|
|
|
|
* LaTeX PDF:
|
|
* For printing:
|
|
* "Standard one-page format": "https://compphysics.github.io/MachineLearning/doc/pub/DecisionTrees/pdf/DecisionTrees-minted.pdf"
|
|
* HTML:
|
|
* "Plain html": "https://compphysics.github.io/MachineLearning/doc/pub/DecisionTrees/html/DecisionTrees.html"
|
|
* "reveal.js beige slide style": "https://compphysics.github.io/MachineLearning/doc/pub/DecisionTrees/html/DecisionTrees-reveal.html"
|
|
* "Bootstrap slide style, easy for reading on mobile devices": "https://compphysics.github.io/MachineLearning/doc/pub/DecisionTrees/html/DecisionTrees-bs.html"
|
|
* Jupyter notebook:
|
|
* "ipynb file": "https://compphysics.github.io/MachineLearning/doc/pub/DecisionTrees/ipynb/DecisionTrees.ipynb"
|
|
|
|
|
|
===== Support Vector Machines =====
|
|
|
|
|
|
|
|
* LaTeX PDF:
|
|
* For printing:
|
|
* "Standard one-page format": "https://compphysics.github.io/MachineLearning/doc/pub/svm/pdf/svm-minted.pdf"
|
|
* HTML:
|
|
* "Plain html": "https://compphysics.github.io/MachineLearning/doc/pub/svm/html/svm.html"
|
|
* "reveal.js beige slide style": "https://compphysics.github.io/MachineLearning/doc/pub/svm/html/svm-reveal.html"
|
|
* "Bootstrap slide style, easy for reading on mobile devices": "https://compphysics.github.io/MachineLearning/doc/pub/svm/html/svm-bs.html"
|
|
* Jupyter notebook:
|
|
* "ipynb file": "https://compphysics.github.io/MachineLearning/doc/pub/svm/ipynb/svm.ipynb"
|
|
|
|
|
|
===== Unsupervised Learning, Boltzmann Machines =====
|
|
|
|
|
|
|
|
* LaTeX PDF:
|
|
* For printing:
|
|
* "Standard one-page format": "https://compphysics.github.io/MachineLearning/doc/pub/BM/pdf/BM-minted.pdf"
|
|
* HTML:
|
|
* "Plain html": "https://compphysics.github.io/MachineLearning/doc/pub/BM/html/BM.html"
|
|
* "reveal.js beige slide style": "https://compphysics.github.io/MachineLearning/doc/pub/BM/html/BM-reveal.html"
|
|
* "Bootstrap slide style, easy for reading on mobile devices": "https://compphysics.github.io/MachineLearning/doc/pub/BM/html/BM-bs.html"
|
|
* Jupyter notebook:
|
|
* "ipynb file": "https://compphysics.github.io/MachineLearning/doc/pub/BM/ipynb/BM.ipynb"
|
|
|
|
|
|
===== Recurrent Neural Networks =====
|
|
|
|
|
|
|
|
* LaTeX PDF:
|
|
* For printing:
|
|
* "Standard one-page format": "https://compphysics.github.io/MachineLearning/doc/pub/Recurrent/pdf/Recurrent-minted.pdf"
|
|
* HTML:
|
|
* "Plain html": "https://compphysics.github.io/MachineLearning/doc/pub/Recurrent/html/Recurrent.html"
|
|
* "reveal.js beige slide style": "https://compphysics.github.io/MachineLearning/doc/pub/Recurrent/html/Recurrent-reveal.html"
|
|
* "Bootstrap slide style, easy for reading on mobile devices": "https://compphysics.github.io/MachineLearning/doc/pub/Recurrent/html/Recurrent-bs.html"
|
|
* Jupyter notebook:
|
|
* "ipynb file": "https://compphysics.github.io/MachineLearning/doc/pub/Recurrent/ipynb/Recurrent.ipynb"
|
|
|
|
|
|
===== Autoencoders =====
|
|
|
|
|
|
|
|
* LaTeX PDF:
|
|
* For printing:
|
|
* "Standard one-page format": "https://compphysics.github.io/MachineLearning/doc/pub/Autoencoders/pdf/Autoencoders-minted.pdf"
|
|
* HTML:
|
|
* "Plain html": "https://compphysics.github.io/MachineLearning/doc/pub/Autoencoders/html/Autoencoders.html"
|
|
* "reveal.js beige slide style": "https://compphysics.github.io/MachineLearning/doc/pub/Autoencoders/html/Autoencoders-reveal.html"
|
|
* "Bootstrap slide style, easy for reading on mobile devices": "https://compphysics.github.io/MachineLearning/doc/pub/Autoencoders/html/Autoencoders-bs.html"
|
|
* Jupyter notebook:
|
|
* "ipynb file": "https://compphysics.github.io/MachineLearning/doc/pub/Autoencoders/ipynb/Autoencoders.ipynb"
|
|
|
|
|
|
===== Reinforcement Learning =====
|
|
|
|
|
|
|
|
* LaTeX PDF:
|
|
* For printing:
|
|
* "Standard one-page format": "https://compphysics.github.io/MachineLearning/doc/pub/Reinforce/pdf/Reinforce-minted.pdf"
|
|
* HTML:
|
|
* "Plain html": "https://compphysics.github.io/MachineLearning/doc/pub/Reinforce/html/Reinforce.html"
|
|
* "reveal.js beige slide style": "https://compphysics.github.io/MachineLearning/doc/pub/Reinforce/html/Reinforce-reveal.html"
|
|
* "Bootstrap slide style, easy for reading on mobile devices": "https://compphysics.github.io/MachineLearning/doc/pub/Reinforce/html/Reinforce-bs.html"
|
|
* Jupyter notebook:
|
|
* "ipynb file": "https://compphysics.github.io/MachineLearning/doc/pub/Reinforce/ipynb/Reinforce.ipynb"
|
|
|
|
|
|
===== Solving ordinary and Partial Differential Equations and Eigenvalue Problems with Neural Networks =====
|
|
|
|
|
|
|
|
* LaTeX PDF:
|
|
* For printing:
|
|
* "Standard one-page format": "https://compphysics.github.io/MachineLearning/doc/pub/odenn/pdf/odenn-minted.pdf"
|
|
* HTML:
|
|
* "Plain html": "https://compphysics.github.io/MachineLearning/doc/pub/odenn/html/odenn.html"
|
|
* "reveal.js beige slide style": "https://compphysics.github.io/MachineLearning/doc/pub/odenn/html/odenn-reveal.html"
|
|
* "Bootstrap slide style, easy for reading on mobile devices": "https://compphysics.github.io/MachineLearning/doc/pub/odenn/html/odenn-bs.html"
|
|
* Jupyter notebook:
|
|
* "ipynb file": "https://compphysics.github.io/MachineLearning/doc/pub/odenn/ipynb/odenn.ipynb"
|
|
|
|
|
|
===== Elements of Bayesian theory and Bayesian Neural Networks =====
|
|
|
|
|
|
|
|
* LaTeX PDF:
|
|
* For printing:
|
|
* "Standard one-page format": "https://compphysics.github.io/MachineLearning/doc/pub/Bayesian/pdf/Bayesian-minted.pdf"
|
|
* HTML:
|
|
* "Plain html": "https://compphysics.github.io/MachineLearning/doc/pub/Bayesian/html/Bayesian.html"
|
|
* "reveal.js beige slide style": "https://compphysics.github.io/MachineLearning/doc/pub/Bayesian/html/Bayesian-reveal.html"
|
|
* "Bootstrap slide style, easy for reading on mobile devices": "https://compphysics.github.io/MachineLearning/doc/pub/Bayesian/html/Bayesian-bs.html"
|
|
* Jupyter notebook:
|
|
* "ipynb file": "https://compphysics.github.io/MachineLearning/doc/pub/Bayesian/ipynb/Bayesian.ipynb"
|
|
|
|
|
|
===== Summary =====
|
|
|
|
|
|
|
|
* LaTeX PDF:
|
|
* For printing:
|
|
* "Standard one-page format": "https://compphysics.github.io/MachineLearning/doc/pub/summary/pdf/summary-minted.pdf"
|
|
* HTML:
|
|
* "Plain html": "https://compphysics.github.io/MachineLearning/doc/pub/summary/html/summary.html"
|
|
* "reveal.js beige slide style": "https://compphysics.github.io/MachineLearning/doc/pub/summary/html/summary-reveal.html"
|
|
* "Bootstrap slide style, easy for reading on mobile devices": "https://compphysics.github.io/MachineLearning/doc/pub/summary/html/summary-bs.html"
|
|
* Jupyter notebook:
|
|
* "ipynb file": "https://compphysics.github.io/MachineLearning/doc/pub/summary/ipynb/summary.ipynb"
|
|
|
|
|
|
|
|
|
|
|
|
|
|
!split
|
|
===== Projects and Exercises Fall 2020 =====
|
|
|
|
=== First homework set, week 35 ===
|
|
* LaTeX and PDF:
|
|
* "LaTex file":"http://compphysics.github.io/MachineLearning/doc/Projects/2020/hw1/pdf/hw1.tex"
|
|
* "PDF file":"http://compphysics.github.io/MachineLearning/doc/Projects/2020/hw1/pdf/hw1.pdf"
|
|
* HTML:
|
|
* "Plain html":"http://compphysics.github.io/MachineLearning/doc/Projects/2020/hw1/html/hw1.html"
|
|
* "Bootstrap slide style, easy for reading on mobile devices": "http://compphysics.github.io/MachineLearning/doc/Projects/2020/hw1/html/hw1-bs.html"
|
|
|
|
=== Second homework set, week 36 ===
|
|
* LaTeX and PDF:
|
|
* "LaTex file":"http://compphysics.github.io/MachineLearning/doc/Projects/2020/hw2/pdf/hw2.tex"
|
|
* "PDF file":"http://compphysics.github.io/MachineLearning/doc/Projects/2020/hw2/pdf/hw2.pdf"
|
|
* HTML:
|
|
* "Plain html":"http://compphysics.github.io/MachineLearning/doc/Projects/2020/hw2/html/hw2.html"
|
|
* "Bootstrap slide style, easy for reading on mobile devices": "http://compphysics.github.io/MachineLearning/doc/Projects/2020/hw2/html/hw2-bs.html"
|
|
|
|
|
|
|
|
=== Project 1, Deadline October 5 (available September 1) ===
|
|
* LaTeX and PDF:
|
|
* "LaTex file":"http://compphysics.github.io/MachineLearning/doc/Projects/2020/Project1/pdf/Project1.tex"
|
|
* "PDF file":"http://compphysics.github.io/MachineLearning/doc/Projects/2020/Project1/pdf/Project1.pdf"
|
|
* HTML:
|
|
* "Plain html":"http://compphysics.github.io/MachineLearning/doc/Projects/2020/Project1/html/Project1.html"
|
|
* "Bootstrap slide style, easy for reading on mobile devices": "http://compphysics.github.io/MachineLearning/doc/Projects/2020/Project1/html/Project1-bs.html"
|
|
* Jupyter notebook:
|
|
* "ipynb file": "http://compphysics.github.io/MachineLearning/doc/Projects/2020/Project1/ipynb/Project1.ipynb"
|
|
|
|
=== Project 2, Deadline November 2 (available September 28) ===
|
|
* LaTeX and PDF:
|
|
* "Latex file":"http://compphysics.github.io/MachineLearning/doc/Projects/2020/Project2/pdf/Project2.tex"
|
|
* "PDF file":"http://compphysics.github.io/MachineLearning/doc/Projects/2020/Project2/pdf/Project2.pdf"
|
|
* HTML:
|
|
* "Plain html":"http://compphysics.github.io/MachineLearning/doc/Projects/2020/Project2/html/Project2.html"
|
|
* "Bootstrap slide style, easy for reading on mobile devices": "http://compphysics.github.io/MachineLearning/doc/Projects/2020/Project2/html/Project2-bs.html"
|
|
* Jupyter notebook:
|
|
* "ipynb file": "http://compphysics.github.io/MachineLearning/doc/Projects/2020/Project2/ipynb/Project2.ipynb"
|
|
|
|
|
|
=== Project 3, Deadline December 7 (available November 2) ===
|
|
* LaTeX and PDF:
|
|
* "LaTex file":"http://compphysics.github.io/MachineLearning/doc/Projects/2020/Project3/pdf/Project3.tex"
|
|
* "PDF file":"http://compphysics.github.io/MachineLearning/doc/Projects/2020/Project3/pdf/Project3.pdf"
|
|
* HTML:
|
|
* "Plain html":"http://compphysics.github.io/MachineLearning/doc/Projects/2020/Project3/html/Project3.html"
|
|
* "Bootstrap slide style, easy for reading on mobile devices": "http://compphysics.github.io/MachineLearning/doc/Projects/2020/Project3/html/Project3-bs.html"
|
|
* Jupyter notebook:
|
|
* "ipynb file": "http://compphysics.github.io/MachineLearning/doc/Projects/2020/Project3/ipynb/Project3.ipynb"
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|