lars/FYS-STK4155
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

corrected problems with intro file

Browse Source
This commit is contained in:
mhjensen
2019-07-23 22:55:13 +02:00
parent c0a5aad0b1
commit 72ec953a06
46 changed files with 1881 additions and 3704 deletions
Download Patch File Download Diff File Expand all files Collapse all files
doc/pub/Intro2Course/html/Intro2Course.html
+105 -101
View File
@@ -6,9 +6,10 @@ Automatically generated HTML file from DocOnce source
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<meta name="generator" content="DocOnce: https://github.com/hplgit/doconce/" />
<meta name="description" content="Applied Data Analysis and Machine Learning: Introduction to the course">
<meta name="viewport" content="width=device-width, initial-scale=1.0" />
<meta name="description" content="Applied Data Analysis and Machine Learning: Introduction to the course, Logistics and Practicalities">
<title>Applied Data Analysis and Machine Learning: Introduction to the course</title>
<title>Applied Data Analysis and Machine Learning: Introduction to the course, Logistics and Practicalities</title>
<style type="text/css">
@@ -66,22 +67,25 @@ div { text-align: justify; text-justify: inter-word; }
<!-- tocinfo
{'highest level': 2,
'sections': [('Overview of first week', 2, None, '___sec0'),
('Reading suggestions and exercises', 2, None, '___sec1'),
('Lectures and ComputerLab', 2, None, '___sec2'),
('Course Format', 2, None, '___sec3'),
('Teachers and ComputerLab', 2, None, '___sec4'),
('Deadlines for projects (end of day)', 2, None, '___sec5'),
('Learning outcomes', 2, None, '___sec6'),
('Lectures and ComputerLab', 2, None, '___sec1'),
('Course Format', 2, None, '___sec2'),
('Teachers and ComputerLab', 2, None, '___sec3'),
('Deadlines for projects (tentative)', 2, None, '___sec4'),
('Learning outcomes', 2, None, '___sec5'),
('Topics covered in this course: Statistical analysis and '
'optimization of data',
2,
None,
'___sec7'),
'___sec6'),
('Topics covered in this course: Machine Learning',
2,
None,
'___sec8'),
'___sec7'),
('Extremely useful tools, strongly recommended',
2,
None,
'___sec8'),
('Other courses on Data science and Machine Learning at UiO',
2,
None,
'___sec9')]}
@@ -94,7 +98,7 @@ end of tocinfo -->
<center><h1>Applied Data Analysis and Machine Learning: Introduction to the course</h1></center> <!-- document title -->
<center><h1>Applied Data Analysis and Machine Learning: Introduction to the course, Logistics and Practicalities</h1></center> <!-- document title -->
<p>
<!-- author(s): Morten Hjorth-Jensen -->
@@ -110,7 +114,7 @@ end of tocinfo -->
<center>[2] <b>Department of Physics and Astronomy and National Superconducting Cyclotron Laboratory, Michigan State University</b></center>
<br>
<p>
<center><h4>Aug 23, 2018</h4></center> <!-- date -->
<center><h4>Jul 23, 2019</h4></center> <!-- date -->
<br>
<p>
<!-- !split --><br><br><br><br><br><br><br><br><br><br>
@@ -126,7 +130,7 @@ end of tocinfo -->
<li> Thursday: First lecture: Presentation of the course, aims and content</li>
<li> Thursday: Second Lecture: Start with simple linear regression and repetition of linear algebra</li>
<li> Friday: Linear regression</li>
<li> Computer lab: Wednesday. First time: Wednesday August 29.</li>
<li> Computer lab: Tuesday. First time: Tuesday August 27.</li>
</ul>
</div>
@@ -134,31 +138,7 @@ end of tocinfo -->
<p>
<!-- !split --><br><br><br><br><br><br><br><br><br><br>
<h2 id="___sec1">Reading suggestions and exercises </h2>
<p>
The recommended textbooks
<ul>
<li> HTF: <a href="https://www.springer.com/gp/book/9780387848570" target="_blank">Trevor Hastie, Robert Tibshirani, Jerome H. Friedman, The Elements of Statistical Learning, Springer</a></li>
<li> AG: <a href="http://shop.oreilly.com/product/0636920052289.do" target="_blank">Aurelien Geron, Hands&#8209;On Machine Learning with Scikit&#8209;Learn and TensorFlow, O'Reilly</a></li>
</ul>
<div class="alert alert-block alert-block alert-text-normal">
<b></b>
<p>
<ul>
<li> HTF chapters 1-3 and <a href="https://compphysics.github.io/MachineLearning/doc/pub/Regression/html/Regression-bs.html" target="_blank">lecture notes</a></li>
<li> AG chapters 1 and 2</li>
</ul>
</div>
<p>
<!-- !split --><br><br><br><br><br><br><br><br><br><br>
<h2 id="___sec2">Lectures and ComputerLab </h2>
<h2 id="___sec1">Lectures and ComputerLab </h2>
<p>
<div class="alert alert-block alert-block alert-text-normal">
@@ -171,7 +151,7 @@ The recommended textbooks
<li> Weekly exercises when not working on projects. You can hand in exercises if you want.</li>
<li> First hour of each lab session may be used to discuss technicalities, address questions etc linked with projects and exercises.</li>
<li> Detailed lecture notes, exercises, all programs presented, projects etc can be found at the homepage of the course.</li>
<li> Computerlab: Wednesday (10am-6pm), room FV329, four groups (10am-12pm, 12pm-2pm, 2pm-4pm, 4pm-6pm).</li>
<li> Computerlab: Tuesday (8am-6pm), VB IT-auditorium 3</li>
<li> Weekly plans and all other information are on the official webpage.</li>
<li> No final exam, three projects that are graded and have to be approved.</li>
</ul>
@@ -181,7 +161,7 @@ The recommended textbooks
<p>
<!-- !split --><br><br><br><br><br><br><br><br><br><br>
<h2 id="___sec3">Course Format </h2>
<h2 id="___sec2">Course Format </h2>
<p>
<div class="alert alert-block alert-block alert-text-normal">
@@ -190,17 +170,16 @@ The recommended textbooks
<ul>
<li> Three compulsory projects. Electronic reports only using <a href="https://devilry.ifi.uio.no/" target="_blank">devilry</a> to hand in projects and <a href="https://github.com/" target="_blank">Git</a> for repository and all your material.</li>
<li> Evaluation and grading: The three projects are graded and each counts 1/3 of the final mark. No final written or oral exam.</li>
<li> The last project is organized as a workshop (duration approx 5-6 hours toward the end of the semester) where each group submits a proposal for a data sets to be analyzed with the different methods discussed during the course.
<li> Evaluation and grading: The three projects are graded and each counts 1/3 of the final mark. No final written or oral exam.
<ol type="a"></li>
<li> Each group submits a proposal or works with suggested (by us) proposals for the project.</li>
<li> Each group makes a poster and presents this to all other participants of the course</li>
<li> Poster session where all participants can study and discuss the other proposals (the three best posters get additional score)</li>
<li> For the last project Each group/participant submits a proposal or works with suggested (by us) proposals for the project.</li>
<li> If possible, we would like to organize the last project as a workshop where each group makes a poster and presents this to all other participants of the course</li>
<li> Poster session where all participants can study and discuss the other proposals.</li>
<li> Based on feedback etc, each group finalizes the report and submits for grading.</li>
</ol>
<li> The computer lab (room FV329)consists of 16 Linux PCs, but many prefer own laptops. Python is the default programming language, but feel free to use C/C++ and/or Fortran. All source codes discussed during the lectures can be found at the webpage and <a href="https://github.com/CompPhysics/MachineLearning/tree/master/doc/Programs" target="_blank">github address</a> of the course.</li>
<li> Python is the default programming language, but feel free to use C/C++ and/or Fortran or other programmin languages. All source codes discussed during the lectures can be found at the webpage and <a href="https://github.com/CompPhysics/MachineLearning/tree/master/doc/Programs" target="_blank">github address</a> of the course.</li>
</ul>
</div>
@@ -208,7 +187,7 @@ The recommended textbooks
<p>
<!-- !split --><br><br><br><br><br><br><br><br><br><br>
<h2 id="___sec4">Teachers and ComputerLab </h2>
<h2 id="___sec3">Teachers and ComputerLab </h2>
<p>
<div class="alert alert-block alert-block alert-text-normal">
@@ -219,21 +198,21 @@ The recommended textbooks
<b>Teachers :</b>
<ol>
<li> <a href="https://www.mn.uio.no/ifi/english/?vrtx=person-view&uid=krisbhei" target="_blank">Kristine B. Heine</a></li>
<li> <a href="https://www.researchgate.net/profile/Hanna_Svennevik" target="_blank">Hanna Svennevik</a></li>
<li> <a href="http://mhjgit.github.io/info/doc/web/" target="_blank">Morten Hjorth-Jensen</a></li>
<li> <a href="https://www.mn.uio.no/fysikk/english/?vrtx=person-view&uid=bendiksa" target="_blank">Bendik Samseth</a></li>
<li> <a href="https://www.mn.uio.no/fysikk/english/?vrtx=person-view&uid=oyvinssc" target="_blank">&#216;yvind Sigmundson Sch&#248;yen</a></li>
<li> <a href="https://no.linkedin.com/in/lucas-charpentier-176206171" target="_blank">Lucas Charpentier</a></li>
<li> <a href="https://www.researchgate.net/profile/Stian_Bilek" target="_blank">Stian Bilek</a></li>
</ol>
<table border="1">
<thead>
<tr><th align="center"> day </th> <th align="center"> Time </th> </tr>
<tr><th align="center"> day </th> <th align="center"> Time </th> </tr>
</thead>
<tbody>
<tr><td align="center"> Group 1: Wednesday </td> <td align="center"> 10am-12pm </td> </tr>
<tr><td align="center"> Group 2: Wednesday </td> <td align="center"> 12pm-2pm </td> </tr>
<tr><td align="center"> Group 3: Wednesday </td> <td align="center"> 2pm-4pm </td> </tr>
<tr><td align="center"> Group 4: Wednesday </td> <td align="center"> 4pm-6pm </td> </tr>
<tr><td align="center"> Group 1: Tuesday </td> <td align="center"> 8am-10am </td> </tr>
<tr><td align="center"> Group 2: Tuesday </td> <td align="center"> 10am-12pm </td> </tr>
<tr><td align="center"> Group 3: Tuesday </td> <td align="center"> 12pm-2pm </td> </tr>
<tr><td align="center"> Group 4: Tuesday </td> <td align="center"> 2pm-4pm </td> </tr>
</tbody>
</table>
@@ -243,7 +222,7 @@ The recommended textbooks
<p>
<!-- !split --><br><br><br><br><br><br><br><br><br><br>
<h2 id="___sec5">Deadlines for projects (end of day) </h2>
<h2 id="___sec4">Deadlines for projects (tentative) </h2>
<p>
<div class="alert alert-block alert-block alert-text-normal">
@@ -251,9 +230,9 @@ The recommended textbooks
<p>
<ol>
<li> Project 1: October 1 (graded with feedback)</li>
<li> Project 2: November 5 (graded with feedback)</li>
<li> Project 3: November 30, tentative (graded with feedback)</li>
<li> Project 1: September 30 (graded with feedback)</li>
<li> Project 2: November 4 (graded with feedback)</li>
<li> Project 3: December 2 (graded with feedback)</li>
</ol>
Projects are handed in using devilry.ifi.uio.no. We use Github as repository for codes, benchmark calculations etc. Comments and feedback on projects only via devilry.
@@ -265,22 +244,24 @@ Projects are handed in using devilry.ifi.uio.no. We use Github as repository for
<p>
<!-- !split --><br><br><br><br><br><br><br><br><br><br>
<h2 id="___sec6">Learning outcomes </h2>
<h2 id="___sec5">Learning outcomes </h2>
<p>
<div class="alert alert-block alert-block alert-text-normal">
<b></b>
<p>
The course introduces a variety of central algorithms and methods essential for studies of data analysis and machine learning. The course is project based and through the various projects, normally three, you will be exposed to fundamental research problems in these fields, with the aim to reproduce state of the art scientific results. You will learn to develop and structure large codes for studying these systems, get acquainted with computing facilities and learn to handle large scientific projects. A good scientific and ethical conduct is emphasized throughout the course. More specifically, after this course you will
<ul>
<li> Learn about basic data analysis, Bayesian statistics, Monte Carlo methods, data optimization and machine learning;</li>
<li> Be capable of extending the acquired knowledge to other systems and cases;</li>
<li> Have an understanding of central algorithms used in data analysis and machine learning;</li>
<li> Gain knowledge of central aspects of Monte Carlo methods, Markov chains, Gibbs samplers and their possible applications, from numerical integration to simulation of stock markets;</li>
<li> Understand linear methods for regression and classification;</li>
<li> Learn about neural network, genetic algorithms and Boltzmann machines;</li>
<li> Work on numerical projects to illustrate the theory. The projects play a central role and you are expected to know modern programming languages like Python or C++.</li>
<li> Learn about basic data analysis, statistical analysis, Bayesian statistics, Monte Carlo sampling, data optimization and machine learning</li>
<li> Be capable of extending the acquired knowledge to other systems and cases</li>
<li> Have an understanding of central algorithms used in data analysis and machine learning</li>
<li> Gain knowledge of central aspects of Monte Carlo methods, Markov chains, Gibbs samplers and their possible applications</li>
<li> Understand linear methods for regression and classification, from ordinary least squares, via Lasso and Ridge to Logistic regression</li>
<li> Learn about various neural networks and deep learning methods for supervised and unsupervised learning</li>
<li> Learn about about decision trees and random forests</li>
<li> Learn about support vector machines and kernel transformations</li>
<li> Reduction of data sets, from PCA to clustering, supervised and unsupervided methods</li>
<li> Work on numerical projects to illustrate the theory. The projects play a central role and you are expected to know modern programming languages like Python or C++</li>
</ul>
</div>
@@ -288,7 +269,30 @@ The course introduces a variety of central algorithms and methods essential for
<p>
<!-- !split --><br><br><br><br><br><br><br><br><br><br>
<h2 id="___sec7">Topics covered in this course: Statistical analysis and optimization of data </h2>
<h2 id="___sec6">Topics covered in this course: Statistical analysis and optimization of data </h2>
<p>
<div class="alert alert-block alert-block alert-text-normal">
<b></b>
<p>
<ul>
<li> Basic concepts, expectation values, variance, covariance, correlation functions and errors</li>
<li> Simpler models, binomial distribution, the Poisson distribution, simple and multivariate normal distributions</li>
<li> Central elements of Bayesian statistics and modeling</li>
<li> Gradient methods for data optimization</li>
<li> Monte Carlo methods, Markov chains, Metropolis-Hastings algorithm</li>
<li> Linear methods for regression and classification</li>
<li> Estimation of errors using cross-validation, blocking, bootstrapping and jackknife methods</li>
<li> Practical optimization using Singular-value decomposition and least squares for parameterizing data</li>
</ul>
</div>
<p>
<!-- !split --><br><br><br><br><br><br><br><br><br><br>
<h2 id="___sec7">Topics covered in this course: Machine Learning </h2>
<p>
<div class="alert alert-block alert-block alert-text-normal">
@@ -297,35 +301,13 @@ The course introduces a variety of central algorithms and methods essential for
The following topics will be covered
<ul>
<li> Basic concepts, expectation values, variance, covariance, correlation functions and errors;</li>
<li> Simpler models, binomial distribution, the Poisson distribution, simple and multivariate normal distributions;</li>
<li> Central elements of Bayesian statistics and modeling;</li>
<li> Central elements from linear algebra</li>
<li> Cubic splines and gradient methods for data optimization</li>
<li> Monte Carlo methods, Markov chains, Metropolis-Hastings algorithm, ergodicity;</li>
<li> Linear methods for regression and classification;</li>
<li> Estimation of errors using blocking, bootstrapping and jackknife methods;</li>
</ul>
</div>
<p>
<!-- !split --><br><br><br><br><br><br><br><br><br><br>
<h2 id="___sec8">Topics covered in this course: Machine Learning </h2>
<p>
<div class="alert alert-block alert-block alert-text-normal">
<b></b>
<p>
<ul>
<li> Linear and non-linear regression</li>
<li> Gaussian and Dirichlet processes;</li>
<li> Boltzmann machines;</li>
<li> Neural networks;</li>
<li> Linear Regression and Logistic Regression</li>
<li> Neural networks and deep learning</li>
<li> Decisions trees and nearest neighbor algorithms</li>
<li> Support vector machines</li>
<li> Bayesian Neural Networks</li>
<li> Boltzmann Machines</li>
<li> Dimensionality reduction, from PCA to cluster models</li>
</ul>
</div>
@@ -333,7 +315,7 @@ The following topics will be covered
<p>
<!-- !split --><br><br><br><br><br><br><br><br><br><br>
<h2 id="___sec9">Extremely useful tools, strongly recommended </h2>
<h2 id="___sec8">Extremely useful tools, strongly recommended </h2>
<p>
<div class="alert alert-block alert-block alert-text-normal">
@@ -341,19 +323,41 @@ The following topics will be covered
<p>
<ul>
<li> GIT for version control (see webpage)</li>
<li> ipython/jupyter notebook</li>
<li> GIT for version control, highly recommended</li>
<li> Devilry for handing in projects, next week</li>
<li> Anaconda and other Python environments</li>
<li> Anaconda and other Python environments, see intro slides</li>
</ul>
</div>
<p>
<!-- !split --><br><br><br><br><br><br><br><br><br><br>
<h2 id="___sec9">Other courses on Data science and Machine Learning at UiO </h2>
<p>
The link here <a href="https://www.mn.uio.no/english/research/about/centre-focus/innovation/data-science/studies/" target="_blank"><tt>https://www.mn.uio.no/english/research/about/centre-focus/innovation/data-science/studies/</tt></a> gives an excellent overview of courses on Machine learning at UiO.
<ol>
<li> <a href="http://www.uio.no/studier/emner/matnat/math/STK2100/index-eng.html" target="_blank">STK2100 Machine learning and statistical methods for prediction and classification</a>.</li>
<li> <a href="https://www.uio.no/studier/emner/matnat/ifi/IN3050/index-eng.html" target="_blank">IN3050 Introduction to Artificial Intelligence and Machine Learning</a>. Introductory course in machine learning and AI with an algorithmic approach.</li>
<li> <a href="http://www.uio.no/studier/emner/matnat/math/STK-INF3000/index-eng.html" target="_blank">STK-INF3000/4000 Selected Topics in Data Science</a>. The course provides insight into selected contemporary relevant topics within Data Science.</li>
<li> <a href="https://www.uio.no/studier/emner/matnat/ifi/IN4080/index.html" target="_blank">IN4080 Natural Language Processing</a>. Probabilistic and machine learning techniques applied to natural language processing.</li>
<li> <a href="https://www.uio.no/studier/emner/matnat/math/STK-IN4300/index-eng.html" target="_blank">STK-IN4300 Statistical learning methods in Data Science</a>. An advanced introduction to statistical and machine learning. For students with a good mathematics and statistics background.</li>
<li> <a href="http://www.uio.no/studier/emner/matnat/ifi/INF4490/" target="_blank">INF4490 Biologically Inspired Computing</a>. An introduction to self-adapting methods also called artificial intelligence or machine learning.</li>
<li> <a href="https://www.uio.no/studier/emner/matnat/ifi/IN-STK5000/index-eng.html" target="_blank">IN-STK5000 Adaptive Methods for Data-Based Decision Making</a>. Methods for adaptive collection and processing of data based on machine learning techniques.</li>
<li> <a href="https://www.uio.no/studier/emner/matnat/ifi/IN5400/" target="_blank">IN5400/INF5860 Machine Learning for Image Analysis</a>. An introduction to deep learning with particular emphasis on applications within Image analysis, but useful for other application areas too.</li>
<li> <a href="https://www.uio.no/studier/emner/matnat/its/TEK5040/" target="_blank">TEK5040 Deep learning for autonomous systems</a>. The course addresses advanced algorithms and architectures for deep learning with neural networks. The course provides an introduction to how deep-learning techniques can be used in the construction of key parts of advanced autonomous systems that exist in physical environments and cyber environments.</li>
<li> <a href="https://www.uio.no/studier/emner/matnat/math/STK4051/index-eng.html" target="_blank">STK4051 Computational Statistics</a></li>
<li> <a href="https://www.uio.no/studier/emner/matnat/math/STK4021/index-eng.html" target="_blank">STK4021 Applied Bayesian Analysis and Numerical Methods</a></li>
</ol>
<!-- ------------------- end of main content --------------- -->
<center style="font-size:80%">
<!-- copyright --> &copy; 1999-2018, Morten Hjorth-Jensen. Released under CC Attribution-NonCommercial 4.0 license
<!-- copyright --> &copy; 1999-2019, Morten Hjorth-Jensen. Released under CC Attribution-NonCommercial 4.0 license
</center>