Files
FYS-STK4155/doc/LectureNotes/_build/html/textbooks.html
T
Morten Hjorth-Jensen be71a16b8b updated book
2021-08-22 23:25:18 +02:00

402 lines
19 KiB
HTML
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
<!DOCTYPE html>
<html>
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1.0" />
<title>Textbooks &#8212; Applied Data Analysis and Machine Learning</title>
<link href="_static/css/theme.css" rel="stylesheet" />
<link href="_static/css/index.c5995385ac14fb8791e8eb36b4908be2.css" rel="stylesheet" />
<link rel="stylesheet"
href="_static/vendor/fontawesome/5.13.0/css/all.min.css">
<link rel="preload" as="font" type="font/woff2" crossorigin
href="_static/vendor/fontawesome/5.13.0/webfonts/fa-solid-900.woff2">
<link rel="preload" as="font" type="font/woff2" crossorigin
href="_static/vendor/fontawesome/5.13.0/webfonts/fa-brands-400.woff2">
<link rel="stylesheet" href="_static/pygments.css" type="text/css" />
<link rel="stylesheet" href="_static/sphinx-book-theme.5f77b4aec8189eecf79907ce328c390d.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="_static/togglebutton.css" />
<link rel="stylesheet" type="text/css" href="_static/copybutton.css" />
<link rel="stylesheet" type="text/css" href="_static/mystnb.css" />
<link rel="stylesheet" type="text/css" href="_static/sphinx-thebe.css" />
<link rel="stylesheet" type="text/css" href="_static/panels-main.c949a650a448cc0ae9fd3441c0e17fb0.css" />
<link rel="stylesheet" type="text/css" href="_static/panels-variables.06eb56fa6e07937060861dad626602ad.css" />
<link rel="preload" as="script" href="_static/js/index.1c5a1a01449ed65a7b51.js">
<script id="documentation_options" data-url_root="./" src="_static/documentation_options.js"></script>
<script src="_static/jquery.js"></script>
<script src="_static/underscore.js"></script>
<script src="_static/doctools.js"></script>
<script src="_static/language_data.js"></script>
<script src="_static/togglebutton.js"></script>
<script src="_static/clipboard.min.js"></script>
<script src="_static/copybutton.js"></script>
<script >var togglebuttonSelector = '.toggle, .admonition.dropdown, .tag_hide_input div.cell_input, .tag_hide-input div.cell_input, .tag_hide_output div.cell_output, .tag_hide-output div.cell_output, .tag_hide_cell.cell, .tag_hide-cell.cell';</script>
<script src="_static/sphinx-book-theme.12a9622fbb08dcb3a2a40b2c02b83a57.js"></script>
<script async="async" src="https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.7/latest.js?config=TeX-AMS-MML_HTMLorMML"></script>
<script type="text/x-mathjax-config">MathJax.Hub.Config({"tex2jax": {"inlineMath": [["\\(", "\\)"]], "displayMath": [["\\[", "\\]"]], "processRefs": false, "processEnvironments": false}})</script>
<script async="async" src="https://unpkg.com/thebelab@latest/lib/index.js"></script>
<script >
const thebe_selector = ".thebe"
const thebe_selector_input = "pre"
const thebe_selector_output = ".output"
</script>
<script async="async" src="_static/sphinx-thebe.js"></script>
<link rel="index" title="Index" href="genindex.html" />
<link rel="search" title="Search" href="search.html" />
<link rel="next" title="1. Elements of Probability Theory and Statistical Data Analysis" href="statistics.html" />
<link rel="prev" title="Teachers and Grading" href="teachers.html" />
<meta name="viewport" content="width=device-width, initial-scale=1" />
<meta name="docsearch:language" content="en" />
</head>
<body data-spy="scroll" data-target="#bd-toc-nav" data-offset="80">
<div class="container-fluid" id="banner"></div>
<div class="container-xl">
<div class="row">
<div class="col-12 col-md-3 bd-sidebar site-navigation show" id="site-navigation">
<div class="navbar-brand-box">
<a class="navbar-brand text-wrap" href="index.html">
<img src="_static/logo.png" class="logo" alt="logo">
<h1 class="site-logo" id="site-title">Applied Data Analysis and Machine Learning</h1>
</a>
</div><form class="bd-search d-flex align-items-center" action="search.html" method="get">
<i class="icon fas fa-search"></i>
<input type="search" class="form-control" name="q" id="search-input" placeholder="Search this book..." aria-label="Search this book..." autocomplete="off" >
</form><nav class="bd-links" id="bd-docs-nav" aria-label="Main navigation">
<div class="bd-toc-item active">
<ul class="nav bd-sidenav">
<li class="toctree-l1">
<a class="reference internal" href="intro.html">
Applied Data Analysis and Machine Learning, FYS-STK3155/4155 at the University of Oslo, Norway
</a>
</li>
</ul>
<p class="caption">
<span class="caption-text">
About the course
</span>
</p>
<ul class="current nav bd-sidenav">
<li class="toctree-l1">
<a class="reference internal" href="schedule.html">
Teaching schedule with links to material
</a>
</li>
<li class="toctree-l1">
<a class="reference internal" href="teachers.html">
Teachers and Grading
</a>
</li>
<li class="toctree-l1 current active">
<a class="current reference internal" href="#">
Textbooks
</a>
</li>
</ul>
<p class="caption">
<span class="caption-text">
Review of Statistics with Resampling Techniques and Linear Algebra
</span>
</p>
<ul class="nav bd-sidenav">
<li class="toctree-l1">
<a class="reference internal" href="statistics.html">
1. Elements of Probability Theory and Statistical Data Analysis
</a>
</li>
<li class="toctree-l1">
<a class="reference internal" href="linalg.html">
2. Linear Algebra, Handling of Arrays and more Python Features
</a>
</li>
</ul>
<p class="caption">
<span class="caption-text">
From Regression to Support Vector Machines
</span>
</p>
<ul class="nav bd-sidenav">
<li class="toctree-l1">
<a class="reference internal" href="chapter1.html">
3. Linear Regression, basic Elements
</a>
</li>
<li class="toctree-l1">
<a class="reference internal" href="chapter2.html">
4. Resampling Methods
</a>
</li>
<li class="toctree-l1">
<a class="reference internal" href="chapter3.html">
5. Ridge and Lasso Regression
</a>
</li>
<li class="toctree-l1">
<a class="reference internal" href="chapter4.html">
6. Logistic Regression
</a>
</li>
<li class="toctree-l1">
<a class="reference internal" href="chapter5.html">
7. Support Vector Machines, overarching aims
</a>
</li>
</ul>
<p class="caption">
<span class="caption-text">
Decision Trees, Ensemble Methods and Boosting
</span>
</p>
<ul class="nav bd-sidenav">
<li class="toctree-l1">
<a class="reference internal" href="chapter6.html">
8. Decision trees, overarching aims
</a>
</li>
<li class="toctree-l1">
<a class="reference internal" href="chapter7.html">
9. Ensemble Methods: From a Single Tree to Many Trees and Extreme Boosting, Meet the Jungle of Methods
</a>
</li>
</ul>
<p class="caption">
<span class="caption-text">
Dimensionality Reduction
</span>
</p>
<ul class="nav bd-sidenav">
<li class="toctree-l1">
<a class="reference internal" href="chapter8.html">
10. Basic ideas of the Principal Component Analysis (PCA)
</a>
</li>
<li class="toctree-l1">
<a class="reference internal" href="Clustering.html">
11. Clustering Analysis
</a>
</li>
</ul>
<p class="caption">
<span class="caption-text">
Deep Learning Methods
</span>
</p>
<ul class="nav bd-sidenav">
<li class="toctree-l1">
<a class="reference internal" href="chapter9.html">
12. Neural networks
</a>
</li>
<li class="toctree-l1">
<a class="reference internal" href="chapter10.html">
13. Building a Feed Forward Neural Network
</a>
</li>
</ul>
</div>
</nav> <!-- To handle the deprecated key -->
<div class="navbar_extra_footer">
Powered by <a href="https://jupyterbook.org">Jupyter Book</a>
</div>
</div>
<main class="col py-md-3 pl-md-4 bd-content overflow-auto" role="main">
<div class="topbar container-xl fixed-top">
<div class="topbar-contents row">
<div class="col-12 col-md-3 bd-topbar-whitespace site-navigation show"></div>
<div class="col pl-md-4 topbar-main">
<button id="navbar-toggler" class="navbar-toggler ml-0" type="button" data-toggle="collapse"
data-toggle="tooltip" data-placement="bottom" data-target=".site-navigation" aria-controls="navbar-menu"
aria-expanded="true" aria-label="Toggle navigation" aria-controls="site-navigation"
title="Toggle navigation" data-toggle="tooltip" data-placement="left">
<i class="fas fa-bars"></i>
<i class="fas fa-arrow-left"></i>
<i class="fas fa-arrow-up"></i>
</button>
<div class="dropdown-buttons-trigger">
<button id="dropdown-buttons-trigger" class="btn btn-secondary topbarbtn" aria-label="Download this page"><i
class="fas fa-download"></i></button>
<div class="dropdown-buttons">
<!-- ipynb file if we had a myst markdown file -->
<!-- Download raw file -->
<a class="dropdown-buttons" href="_sources/textbooks.md"><button type="button"
class="btn btn-secondary topbarbtn" title="Download source file" data-toggle="tooltip"
data-placement="left">.md</button></a>
<!-- Download PDF via print -->
<button type="button" id="download-print" class="btn btn-secondary topbarbtn" title="Print to PDF"
onClick="window.print()" data-toggle="tooltip" data-placement="left">.pdf</button>
</div>
</div>
<!-- Source interaction buttons -->
<!-- Full screen (wrap in <a> to have style consistency -->
<a class="full-screen-button"><button type="button" class="btn btn-secondary topbarbtn" data-toggle="tooltip"
data-placement="bottom" onclick="toggleFullScreen()" aria-label="Fullscreen mode"
title="Fullscreen mode"><i
class="fas fa-expand"></i></button></a>
<!-- Launch buttons -->
</div>
<!-- Table of contents -->
<div class="d-none d-md-block col-md-2 bd-toc show">
<div class="tocsection onthispage pt-5 pb-3">
<i class="fas fa-list"></i> Contents
</div>
<nav id="bd-toc-nav">
<ul class="visible nav section-nav flex-column">
<li class="toc-h1 nav-item toc-entry">
<a class="reference internal nav-link" href="#">
Textbooks
</a>
</li>
<li class="toc-h1 nav-item toc-entry">
<a class="reference internal nav-link" href="#links-to-relevant-courses-at-the-university-of-oslo">
Links to relevant courses at the University of Oslo
</a>
</li>
</ul>
</nav>
</div>
</div>
</div>
<div id="main-content" class="row">
<div class="col-12 col-md-9 pl-md-3 pr-md-0">
<div>
<div class="section" id="textbooks">
<h1>Textbooks<a class="headerlink" href="#textbooks" title="Permalink to this headline"></a></h1>
<p><em>Recommended textbooks</em>:
The lecture notes are collected as a jupyter-book at <a class="reference external" href="https://compphysics.github.io/MachineLearning/doc/LectureNotes/_build/html/intro.html">https://compphysics.github.io/MachineLearning/doc/LectureNotes/_build/html/intro.html</a>. In addition to the electure notes, we recommend the books of Bishop and Goodfellow et al. We will follow these texts closely and the weekly reading assignments refer to these two texts.</p>
<ul class="simple">
<li><p>Christopher M. Bishop, Pattern Recognition and Machine Learning, Springer, <a class="reference external" href="https://www.springer.com/gp/book/9780387310732">https://www.springer.com/gp/book/9780387310732</a>. This is the main textbook and this course covers chapters 1-7, 11 and 12. You can download for free the textbook in PDF format at <a class="reference external" href="https://www.microsoft.com/en-us/research/uploads/prod/2006/01/Bishop-Pattern-Recognition-and-Machine-Learning-2006.pdf">https://www.microsoft.com/en-us/research/uploads/prod/2006/01/Bishop-Pattern-Recognition-and-Machine-Learning-2006.pdf</a></p></li>
<li><p>Ian Goodfellow, Yoshua Bengio, and Aaron Courville. The different chapters are available for free at <a class="reference external" href="https://www.deeplearningbook.org/">https://www.deeplearningbook.org/</a>. Chapters 2-14 are highly recommended. The lectures follow to a larg extent this text.
The weekly plans will include reading suggestions from these two textbooks.
<em>Additional textbooks</em>:</p></li>
<li><p>Trevor Hastie, Robert Tibshirani, Jerome H. Friedman, The Elements of Statistical Learning, Springer, <a class="reference external" href="https://www.springer.com/gp/book/9780387848570">https://www.springer.com/gp/book/9780387848570</a>. This is a well-known text and serves as additional literature.</p></li>
<li><p>Aurelien Geron, HandsOn Machine Learning with ScikitLearn and TensorFlow, OReilly, <a class="reference external" href="https://www.oreilly.com/library/view/hands-on-machine-learning/9781492032632/">https://www.oreilly.com/library/view/hands-on-machine-learning/9781492032632/</a>. This text is very useful since it contains many code examples and hands-on applications of all algorithms discussed in this course.</p></li>
</ul>
<p><em>General learning book on statistical analysis</em>:</p>
<ul class="simple">
<li><p>Christian Robert and George Casella, Monte Carlo Statistical Methods, Springer</p></li>
<li><p>Peter Hoff, A first course in Bayesian statistical models, Springer</p></li>
</ul>
<p><em>General Machine Learning Books</em>:</p>
<ul class="simple">
<li><p>Kevin Murphy, Machine Learning: A Probabilistic Perspective, MIT Press</p></li>
<li><p>David J.C. MacKay, Information Theory, Inference, and Learning Algorithms, Cambridge University Press</p></li>
<li><p>David Barber, Bayesian Reasoning and Machine Learning, Cambridge University Press</p></li>
</ul>
</div>
<div class="section" id="links-to-relevant-courses-at-the-university-of-oslo">
<h1>Links to relevant courses at the University of Oslo<a class="headerlink" href="#links-to-relevant-courses-at-the-university-of-oslo" title="Permalink to this headline"></a></h1>
<p>The link here <a class="reference external" href="https://www.mn.uio.no/english/research/about/centre-focus/innovation/data-science/studies/">https://www.mn.uio.no/english/research/about/centre-focus/innovation/data-science/studies/</a> gives an excellent overview of courses on Machine learning at UiO.</p>
<ul class="simple">
<li><p><em>STK2100 Machine learning and statistical methods for prediction and classification</em> <a class="reference external" href="http://www.uio.no/studier/emner/matnat/math/STK2100/index-eng.html">http://www.uio.no/studier/emner/matnat/math/STK2100/index-eng.html</a>.</p></li>
<li><p><em>IN3050 Introduction to Artificial Intelligence and Machine Learning</em> <a class="reference external" href="https://www.uio.no/studier/emner/matnat/ifi/IN3050/index-eng.html">https://www.uio.no/studier/emner/matnat/ifi/IN3050/index-eng.html</a>. Introductory course in machine learning and AI with an algorithmic approach.</p></li>
<li><p><em>STK-INF3000/4000 Selected Topics in Data Science</em> <a class="reference external" href="http://www.uio.no/studier/emner/matnat/math/STK-INF3000/index-eng.html">http://www.uio.no/studier/emner/matnat/math/STK-INF3000/index-eng.html</a>. The course provides insight into selected contemporary relevant topics within Data Science.</p></li>
<li><p><em>IN4080 Natural Language Processing</em> <a class="reference external" href="https://www.uio.no/studier/emner/matnat/ifi/IN4080/index.html">https://www.uio.no/studier/emner/matnat/ifi/IN4080/index.html</a>. Probabilistic and machine learning techniques applied to natural language processing.</p></li>
<li><p><em>STK-IN4300 Statistical learning methods in Data Science</em> <a class="reference external" href="https://www.uio.no/studier/emner/matnat/math/STK-IN4300/index-eng.html">https://www.uio.no/studier/emner/matnat/math/STK-IN4300/index-eng.html</a>. An advanced introduction to statistical and machine learning. For students with a good mathematics and statistics background.</p></li>
<li><p><em>INF4490 Biologically Inspired Computing</em> <a class="reference external" href="http://www.uio.no/studier/emner/matnat/ifi/INF4490/">http://www.uio.no/studier/emner/matnat/ifi/INF4490/</a>. An introduction to self-adapting methods also called artificial intelligence or machine learning.</p></li>
<li><p><em>IN-STK5000 Adaptive Methods for Data-Based Decision Making</em> <a class="reference external" href="https://www.uio.no/studier/emner/matnat/ifi/IN-STK5000/index-eng.html">https://www.uio.no/studier/emner/matnat/ifi/IN-STK5000/index-eng.html</a>. Methods for adaptive collection and processing of data based on machine learning techniques.</p></li>
<li><p><em>IN5400/INF5860 Machine Learning for Image Analysis</em> <a class="reference external" href="https://www.uio.no/studier/emner/matnat/ifi/IN5400/">https://www.uio.no/studier/emner/matnat/ifi/IN5400/</a>. An introduction to deep learning with particular emphasis on applications within Image analysis, but useful for other application areas too.</p></li>
<li><p><em>TEK5040 Deep learning for autonomous systems</em> <a class="reference external" href="https://www.uio.no/studier/emner/matnat/its/TEK5040/">https://www.uio.no/studier/emner/matnat/its/TEK5040/</a>. The course addresses advanced algorithms and architectures for deep learning with neural networks. The course provides an introduction to how deep-learning techniques can be used in the construction of key parts of advanced autonomous systems that exist in physical environments and cyber environments.</p></li>
<li><p><em>STK4051 Computational Statistics</em> <a class="reference external" href="https://www.uio.no/studier/emner/matnat/math/STK4051/index-eng.html">https://www.uio.no/studier/emner/matnat/math/STK4051/index-eng.html</a></p></li>
<li><p><em>STK4021 Applied Bayesian Analysis and Numerical Methods</em> <a class="reference external" href="https://www.uio.no/studier/emner/matnat/math/STK4021/">https://www.uio.no/studier/emner/matnat/math/STK4021/</a></p></li>
</ul>
</div>
<script type="text/x-thebe-config">
{
requestKernel: true,
binderOptions: {
repo: "binder-examples/jupyter-stacks-datascience",
ref: "master",
},
codeMirrorConfig: {
theme: "abcdef",
mode: "python"
},
kernelOptions: {
kernelName: "python3",
path: "./."
},
predefinedOutput: true
}
</script>
<script>kernelName = 'python3'</script>
</div>
<div class='prev-next-bottom'>
<a class='left-prev' id="prev-link" href="teachers.html" title="previous page">Teachers and Grading</a>
<a class='right-next' id="next-link" href="statistics.html" title="next page"><span class="section-number">1. </span>Elements of Probability Theory and Statistical Data Analysis</a>
</div>
</div>
</div>
<footer class="footer mt-5 mt-md-0">
<div class="container">
<p>
By Morten Hjorth-Jensen<br/>
&copy; Copyright 2021.<br/>
</p>
</div>
</footer>
</main>
</div>
</div>
<script src="_static/js/index.1c5a1a01449ed65a7b51.js"></script>
</body>
</html>