237 lines
11 KiB
Plaintext
237 lines
11 KiB
Plaintext
{
|
|
"cells": [
|
|
{
|
|
"cell_type": "markdown",
|
|
"metadata": {},
|
|
"source": [
|
|
"<!-- dom:TITLE: Applied Data Analysis and Machine Learning: Introduction to the course, Logistics and Practicalities -->\n",
|
|
"# Applied Data Analysis and Machine Learning: Introduction to the course, Logistics and Practicalities\n",
|
|
"<!-- dom:AUTHOR: Morten Hjorth-Jensen at Department of Physics, University of Oslo & Department of Physics and Astronomy and National Superconducting Cyclotron Laboratory, Michigan State University -->\n",
|
|
"<!-- Author: --> \n",
|
|
"**Morten Hjorth-Jensen**, Department of Physics, University of Oslo and Department of Physics and Astronomy and National Superconducting Cyclotron Laboratory, Michigan State University\n",
|
|
"\n",
|
|
"Date: **Nov 12, 2019**\n",
|
|
"\n",
|
|
"Copyright 1999-2019, Morten Hjorth-Jensen. Released under CC Attribution-NonCommercial 4.0 license\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"## Overview of first week\n",
|
|
"\n",
|
|
" * Thursday August 22: First lecture: Presentation of the course, aims and content\n",
|
|
"\n",
|
|
" * Thursday: Second Lecture: Start with simple linear regression and repetition of linear algebra\n",
|
|
"\n",
|
|
" * Friday August 23: Linear regression \n",
|
|
"\n",
|
|
" * Computer lab: Tuesday. First time: Tuesday August 27.\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"## Lectures and ComputerLab\n",
|
|
"\n",
|
|
" * Lectures: Thursday (2.15pm-4pm, this may change) and Friday (12.15pm-2pm).\n",
|
|
"\n",
|
|
" * Weekly reading assignments needed to solve projects and exercises.\n",
|
|
"\n",
|
|
" * Weekly exercises when not working on projects. You can hand in exercises if you want.\n",
|
|
"\n",
|
|
" * First hour of each lab session may be used to discuss technicalities, address questions etc linked with projects and exercises.\n",
|
|
"\n",
|
|
" * Detailed lecture notes, exercises, all programs presented, projects etc can be found at the homepage of the course.\n",
|
|
"\n",
|
|
" * Computerlab: Tuesday (8am-4pm), VB IT-auditorium 3. Depending on how many enlist we may extend the lab sessions\n",
|
|
"\n",
|
|
" * Weekly plans and all other information are on the official webpage.\n",
|
|
"\n",
|
|
" * No final exam, three projects that are graded and have to be approved.\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"## Course Format\n",
|
|
"\n",
|
|
" * Three compulsory projects. Electronic reports only using [devilry](https://devilry.ifi.uio.no/) to hand in projects and [Git](https://github.com/) for repository and all your material.\n",
|
|
"\n",
|
|
" * Evaluation and grading: The three projects are graded and each counts 1/3 of the final mark. No final written or oral exam.\n",
|
|
"\n",
|
|
"a. For the last project Each group/participant submits a proposal or works with suggested (by us) proposals for the project.\n",
|
|
"\n",
|
|
"b. If possible, we would like to organize the last project as a workshop where each group makes a poster and presents this to all other participants of the course\n",
|
|
"\n",
|
|
"c. Poster session where all participants can study and discuss the other proposals.\n",
|
|
"\n",
|
|
"d. Based on feedback etc, each group finalizes the report and submits for grading. \n",
|
|
"\n",
|
|
"\n",
|
|
" * Python is the default programming language, but feel free to use C/C++ and/or Fortran or other programmin languages. All source codes discussed during the lectures can be found at the webpage and [github address](https://github.com/CompPhysics/MachineLearning/tree/master/doc/Programs) of the course.\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"## Teachers and ComputerLab\n",
|
|
"\n",
|
|
"\n",
|
|
"**Teachers :**\n",
|
|
"\n",
|
|
"1. [Hanna Svennevik](https://www.researchgate.net/profile/Hanna_Svennevik)\n",
|
|
"\n",
|
|
"2. [Morten Hjorth-Jensen](http://mhjgit.github.io/info/doc/web/)\n",
|
|
"\n",
|
|
"3. [Lucas Charpentier](https://no.linkedin.com/in/lucas-charpentier-176206171)\n",
|
|
"\n",
|
|
"4. [Stian Bilek](https://www.researchgate.net/profile/Stian_Bilek)\n",
|
|
"\n",
|
|
"5. [Øyvind Sigmundson Schøyen](https://github.com/Schoyen)\n",
|
|
"\n",
|
|
"<table border=\"1\">\n",
|
|
"<thead>\n",
|
|
"<tr><th align=\"center\"> day </th> <th align=\"center\"> Time </th> </tr>\n",
|
|
"</thead>\n",
|
|
"<tbody>\n",
|
|
"<tr><td align=\"center\"> Group 1: Tuesday </td> <td align=\"center\"> 8am-10am </td> </tr>\n",
|
|
"<tr><td align=\"center\"> Group 2: Tuesday </td> <td align=\"center\"> 10am-12pm </td> </tr>\n",
|
|
"<tr><td align=\"center\"> Group 3: Tuesday </td> <td align=\"center\"> 12pm-2pm </td> </tr>\n",
|
|
"<tr><td align=\"center\"> Group 4: Tuesday </td> <td align=\"center\"> 2pm-4pm </td> </tr>\n",
|
|
"</tbody>\n",
|
|
"</table>\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"## Deadlines for projects (tentative)\n",
|
|
"\n",
|
|
"\n",
|
|
"1. Project 1: September 30 (graded with feedback)\n",
|
|
"\n",
|
|
"2. Project 2: November 13 (graded with feedback)\n",
|
|
"\n",
|
|
"3. Project 3: December 15 (graded with feedback)\n",
|
|
"\n",
|
|
"Projects are handed in using devilry.ifi.uio.no. We use Github as repository for codes, benchmark calculations etc. Comments and feedback on projects only via devilry.\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"## Learning outcomes\n",
|
|
"\n",
|
|
"\n",
|
|
"* Learn about basic data analysis, statistical analysis, Bayesian statistics, Monte Carlo sampling, data optimization and machine learning\n",
|
|
"\n",
|
|
"* Be capable of extending the acquired knowledge to other systems and cases\n",
|
|
"\n",
|
|
"* Have an understanding of central algorithms used in data analysis and machine learning\n",
|
|
"\n",
|
|
"* Gain knowledge of central aspects of Monte Carlo methods, Markov chains, Gibbs samplers and their possible applications\n",
|
|
"\n",
|
|
"* Understand linear methods for regression and classification, from ordinary least squares, via Lasso and Ridge to Logistic regression\n",
|
|
"\n",
|
|
"* Learn about various neural networks and deep learning methods for supervised and unsupervised learning\n",
|
|
"\n",
|
|
"* Learn about about decision trees and random forests\n",
|
|
"\n",
|
|
"* Learn about support vector machines and kernel transformations\n",
|
|
"\n",
|
|
"* Reduction of data sets, from PCA to clustering, supervised and unsupervided methods\n",
|
|
"\n",
|
|
"* Work on numerical projects to illustrate the theory. The projects play a central role and you are expected to know modern programming languages like Python or C++\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"## Topics covered in this course: Statistical analysis and optimization of data\n",
|
|
"\n",
|
|
"* Basic concepts, expectation values, variance, covariance, correlation functions and errors\n",
|
|
"\n",
|
|
"* Simpler models, binomial distribution, the Poisson distribution, simple and multivariate normal distributions\n",
|
|
"\n",
|
|
"* Central elements of Bayesian statistics and modeling\n",
|
|
"\n",
|
|
"* Gradient methods for data optimization\n",
|
|
"\n",
|
|
"* Monte Carlo methods, Markov chains, Metropolis-Hastings algorithm\n",
|
|
"\n",
|
|
"* Linear methods for regression and classification\n",
|
|
"\n",
|
|
"* Estimation of errors using cross-validation, blocking, bootstrapping and jackknife methods\n",
|
|
"\n",
|
|
"* Practical optimization using Singular-value decomposition and least squares for parameterizing data\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"## Topics covered in this course: Machine Learning\n",
|
|
"\n",
|
|
"The following topics will be covered\n",
|
|
"* Linear Regression and Logistic Regression\n",
|
|
"\n",
|
|
"* Neural networks and deep learning\n",
|
|
"\n",
|
|
"* Decisions trees and nearest neighbor algorithms\n",
|
|
"\n",
|
|
"* Support vector machines\n",
|
|
"\n",
|
|
"* Bayesian Neural Networks\n",
|
|
"\n",
|
|
"* Boltzmann Machines\n",
|
|
"\n",
|
|
"* Dimensionality reduction, from PCA to cluster models\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"## Extremely useful tools, strongly recommended\n",
|
|
"\n",
|
|
"**and discussed at the lab sessions.**\n",
|
|
"\n",
|
|
" * GIT for version control, highly recommended\n",
|
|
"\n",
|
|
" * Devilry for handing in projects, next week\n",
|
|
"\n",
|
|
" * Anaconda and other Python environments, see intro slides\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"\n",
|
|
"## Other courses on Data science and Machine Learning at UiO\n",
|
|
"\n",
|
|
"The link here <https://www.mn.uio.no/english/research/about/centre-focus/innovation/data-science/studies/> gives an excellent overview of courses on Machine learning at UiO.\n",
|
|
"\n",
|
|
"1. [STK2100 Machine learning and statistical methods for prediction and classification](http://www.uio.no/studier/emner/matnat/math/STK2100/index-eng.html). \n",
|
|
"\n",
|
|
"2. [IN3050 Introduction to Artificial Intelligence and Machine Learning](https://www.uio.no/studier/emner/matnat/ifi/IN3050/index-eng.html). Introductory course in machine learning and AI with an algorithmic approach. \n",
|
|
"\n",
|
|
"3. [STK-INF3000/4000 Selected Topics in Data Science](http://www.uio.no/studier/emner/matnat/math/STK-INF3000/index-eng.html). The course provides insight into selected contemporary relevant topics within Data Science. \n",
|
|
"\n",
|
|
"4. [IN4080 Natural Language Processing](https://www.uio.no/studier/emner/matnat/ifi/IN4080/index.html). Probabilistic and machine learning techniques applied to natural language processing. \n",
|
|
"\n",
|
|
"5. [STK-IN4300 Statistical learning methods in Data Science](https://www.uio.no/studier/emner/matnat/math/STK-IN4300/index-eng.html). An advanced introduction to statistical and machine learning. For students with a good mathematics and statistics background.\n",
|
|
"\n",
|
|
"6. [INF4490 Biologically Inspired Computing](http://www.uio.no/studier/emner/matnat/ifi/INF4490/). An introduction to self-adapting methods also called artificial intelligence or machine learning. \n",
|
|
"\n",
|
|
"7. [IN-STK5000 Adaptive Methods for Data-Based Decision Making](https://www.uio.no/studier/emner/matnat/ifi/IN-STK5000/index-eng.html). Methods for adaptive collection and processing of data based on machine learning techniques. \n",
|
|
"\n",
|
|
"8. [IN5400/INF5860 Machine Learning for Image Analysis](https://www.uio.no/studier/emner/matnat/ifi/IN5400/). An introduction to deep learning with particular emphasis on applications within Image analysis, but useful for other application areas too.\n",
|
|
"\n",
|
|
"9. [TEK5040 Deep learning for autonomous systems](https://www.uio.no/studier/emner/matnat/its/TEK5040/). The course addresses advanced algorithms and architectures for deep learning with neural networks. The course provides an introduction to how deep-learning techniques can be used in the construction of key parts of advanced autonomous systems that exist in physical environments and cyber environments.\n",
|
|
"\n",
|
|
"10. [STK4051 Computational Statistics](https://www.uio.no/studier/emner/matnat/math/STK4051/index-eng.html)\n",
|
|
"\n",
|
|
"11. [STK4021 Applied Bayesian Analysis and Numerical Methods](https://www.uio.no/studier/emner/matnat/math/STK4021/index-eng.html)"
|
|
]
|
|
}
|
|
],
|
|
"metadata": {},
|
|
"nbformat": 4,
|
|
"nbformat_minor": 2
|
|
}
|