test

2020-09-24 06:05:58 +02:00
parent eb509b1666 b1013585fe
commit 485478da7a
347 changed files with 85349 additions and 16044 deletions
@@ -10,9 +10,9 @@
    "<!-- Author: -->  \n",
    "**Morten Hjorth-Jensen**, Department of Physics, University of Oslo and Department of Physics and Astronomy and National Superconducting Cyclotron Laboratory, Michigan State University\n",
    "\n",
-    "Date: **Nov 19, 2019**\n",
+    "Date: **Sep 19, 2020**\n",
    "\n",
-    "Copyright 1999-2019, Morten Hjorth-Jensen. Released under CC Attribution-NonCommercial 4.0 license\n",
+    "Copyright 1999-2020, Morten Hjorth-Jensen. Released under CC Attribution-NonCommercial 4.0 license\n",
    "\n",
    "\n",
    "\n",
@@ -94,7 +94,7 @@
    "of algorithms and methods we will discuss.\n",
    "\n",
    "\n",
-    "<!-- !split  -->\n",
+    "\n",
    "## Learning outcomes\n",
    "\n",
    "These sets of lectures aim at giving you an overview of central aspects of\n",
@@ -153,6 +153,51 @@
    "\n",
    "\n",
    "\n",
+    "## Machine Learning, a small (and probably biased) introduction\n",
+    "\n",
+    "\n",
+    "Ideally, machine learning represents the science of giving computers\n",
+    "the ability to learn without being explicitly programmed.  The idea is\n",
+    "that there exist generic algorithms which can be used to find patterns\n",
+    "in a broad class of data sets without having to write code\n",
+    "specifically for each problem. The algorithm will build its own logic\n",
+    "based on the data.  You should however always keep in mind that\n",
+    "machines and algorithms are to a large extent developed by humans. The\n",
+    "insights and knowledge we have about a specific system, play a central\n",
+    "role when we develop a specific machine learning algorithm. \n",
+    "\n",
+    "\n",
+    "## Machine Learning, an extremely rich field\n",
+    "\n",
+    "Machine learning is an extremely rich field, in spite of its young\n",
+    "age. The increases we have seen during the last  decades in\n",
+    "computational capabilities have been followed by developments of\n",
+    "methods and techniques for analyzing and handling large date sets,\n",
+    "relying heavily on statistics, computer science and mathematics.  The\n",
+    "field is rather new and developing rapidly. Popular software libraries\n",
+    "written in Python for machine learning like\n",
+    "[Scikit-learn](http://scikit-learn.org/stable/),\n",
+    "[Tensorflow](https://www.tensorflow.org/),\n",
+    "[PyTorch](http://pytorch.org/) and [Keras](https://keras.io/), all\n",
+    "freely available at their respective GitHub sites, encompass\n",
+    "communities of developers in the thousands or more. And the number of\n",
+    "code developers and contributors keeps increasing.\n",
+    "\n",
+    "\n",
+    "## A multidisciplinary approach\n",
+    "\n",
+    "Not all the\n",
+    "algorithms and methods can be given a rigorous mathematical\n",
+    "justification (for example decision trees and random forests), opening up thereby large rooms for experimenting and\n",
+    "trial and error and thereby exciting new developments.  However, a\n",
+    "solid command of linear algebra, multivariate theory, probability\n",
+    "theory, statistical data analysis, understanding errors and Monte\n",
+    "Carlo methods are central elements in a proper understanding of many\n",
+    "of the algorithms and methods we will discuss.\n",
+    "\n",
+    "\n",
+    "\n",
+    "\n",
    "\n",
    "## Types of Machine Learning\n",
    "\n",
@@ -170,44 +215,117 @@
    "Another way to categorize machine learning tasks is to consider the\n",
    "desired output of a system.  Some of the most common tasks are:\n",
    "\n",
-    "  * Classification: Outputs are divided into two or more classes. The goal is to   produce a model that assigns inputs into one of these classes. An example is to identify  digits based on pictures of hand-written ones. Classification is typically supervised learning.\n",
+    "* Classification: Outputs are divided into two or more classes. The goal is to   produce a model that assigns inputs into one of these classes. An example is to identify  digits based on pictures of hand-written ones. Classification is often supervised learning.\n",
    "\n",
-    "  * Regression: Finding a functional relationship between an input data set and a reference data set.   The goal is to construct a function that maps input data to continuous output values.\n",
+    "* Regression: Finding a functional relationship between an input data set and a reference data set.   The goal is to construct a function that maps input data to continuous output values.\n",
    "\n",
-    "  * Clustering: Data are divided into groups with certain common traits, without knowing the different groups beforehand.  It is thus a form of unsupervised learning.\n",
+    "* Clustering: Data are divided into groups with certain common traits, without knowing the different groups beforehand.  It is thus a form of unsupervised learning.\n",
+    "\n",
+    "\n",
+    "\n",
+    "\n",
+    "\n",
+    "## Essential elements of ML\n",
    "\n",
    "The methods we cover have three main topics in common, irrespective of\n",
-    "whether we deal with supervised or unsupervised learning. The first\n",
-    "ingredient is normally our data set (which can be subdivided into\n",
-    "training and test data), the second item is a model which is normally\n",
-    "a function of some parameters.  The model reflects our knowledge of\n",
-    "the system (or lack thereof). As an example, if we know that our data\n",
-    "show a behavior similar to what would be predicted by a polynomial,\n",
-    "fitting our data to a polynomial of some degree would then determin\n",
-    "our model.\n",
+    "whether we deal with supervised or unsupervised learning.\n",
+    "* The first ingredient is normally our data set (which can be subdivided into training, validation  and test data). Many find the most difficult part of using Machine Learning to be the set up of your data in a meaningful way. \n",
    "\n",
-    "The last ingredient is a so-called **cost**\n",
-    "function which allows us to present an estimate on how good our model\n",
-    "is in reproducing the data it is supposed to train.  \n",
+    "* The second item is a model which is normally a function of some parameters.  The model reflects our knowledge of the system (or lack thereof). As an example, if we know that our data show a behavior similar to what would be predicted by a polynomial, fitting our data to a polynomial of some degree would then determin our model. \n",
    "\n",
-    "Here we will build our machine learning approach on elements of the\n",
-    "statistical foundation discussed above, with elements from data\n",
-    "analysis, stochastic processes etc. We will discuss the following\n",
-    "machine learning algorithms\n",
+    "* The last ingredient is a so-called **cost/loss** function (or error function) which allows us to present an estimate on how good our model is in reproducing the data it is supposed to train.  \n",
    "\n",
-    "1. Linear regression and its variants\n",
    "\n",
-    "2. Decision tree algorithms, from single trees to random forests\n",
    "\n",
-    "3. Bayesian statistics and regression\n",
    "\n",
-    "4. Support vector machines and finally various variants of\n",
    "\n",
-    "5. Artifical neural networks and deep learning, including convolutional neural networks and Bayesian neural networks\n",
    "\n",
-    "6. Networks for unsupervised learning using for example reduced Boltzmann machines.\n",
+    "## An optimization/minimization problem\n",
    "\n",
-    "## Choice of programming language\n",
+    "At the heart of basically all Machine Learning algorithms we will encounter so-called minimization or optimization algorithms. A large family of such methods are so-called **gradient methods**.\n",
+    "\n",
+    "\n",
+    "## A Frequentist approach to data analysis\n",
+    "\n",
+    "When you hear phrases like **predictions and estimations** and\n",
+    "**correlations and causations**, what do you think of?  May be you think\n",
+    "of the difference between classifying new data points and generating\n",
+    "new data points.\n",
+    "Or perhaps you consider that correlations represent some kind of symmetric statements like\n",
+    "if $A$ is correlated with $B$, then $B$ is correlated with\n",
+    "$A$. Causation on the other hand is directional, that is if $A$ causes $B$, $B$ does not\n",
+    "necessarily cause $A$.\n",
+    "\n",
+    "These concepts are in some sense the difference between machine\n",
+    "learning and statistics. In machine learning and prediction based\n",
+    "tasks, we are often interested in developing algorithms that are\n",
+    "capable of learning patterns from given data in an automated fashion,\n",
+    "and then using these learned patterns to make predictions or\n",
+    "assessments of newly given data. In many cases, our primary concern\n",
+    "is the quality of the predictions or assessments, and we are less\n",
+    "concerned about the underlying patterns that were learned in order\n",
+    "to make these predictions.\n",
+    "\n",
+    "In machine learning we normally use [a so-called frequentist approach](https://en.wikipedia.org/wiki/Frequentist_inference),\n",
+    "where the aim is to make predictions and find correlations. We focus\n",
+    "less on for example extracting a probability distribution function (PDF). The PDF can be\n",
+    "used in turn to make estimations and find causations such as given $A$\n",
+    "what is the likelihood of finding $B$.\n",
+    "\n",
+    "\n",
+    "\n",
+    "## What is a good model?\n",
+    "\n",
+    "In science and engineering we often end up in situations where we want to infer (or learn) a\n",
+    "quantitative model $M$ for a given set of sample points $\\boldsymbol{X} \\in [x_1, x_2,\\dots x_N]$.\n",
+    "\n",
+    "As we will see repeatedely in these lectures, we could try to fit these data points to a model given by a\n",
+    "straight line, or if we wish to be more sophisticated to a more complex\n",
+    "function.\n",
+    "\n",
+    "The reason for inferring such a model is that it\n",
+    "serves many useful purposes. On the one hand, the model can reveal information\n",
+    "encoded in the data or underlying mechanisms from which the data were generated. For instance, we could discover important\n",
+    "corelations that relate interesting physics interpretations.\n",
+    "\n",
+    "In addition, it can simplify the representation of the given data set and help\n",
+    "us in making predictions about  future data samples.\n",
+    "\n",
+    "A first important consideration to keep in mind is that inferring the *correct* model\n",
+    "for a given data set is an elusive, if not impossible, task. The fundamental difficulty\n",
+    "is that if we are not specific about what we mean by a *correct* model, there\n",
+    "could easily be many different models that fit the given data set *equally well*.\n",
+    "\n",
+    "\n",
+    "\n",
+    "## What is a good model? Can we define it?\n",
+    "\n",
+    "\n",
+    "The central question is this: what leads us to say that a model is correct or\n",
+    "optimal for a given data set? To make the model inference problem well posed, i.e.,\n",
+    "to guarantee that there is a unique optimal model for the given data, we need to\n",
+    "impose additional assumptions or restrictions on the class of models considered. To\n",
+    "this end, we should not be looking for just any model that can describe the data.\n",
+    "Instead, we should look for a **model** $M$ that is the best among a restricted class\n",
+    "of models. In addition, to make the model inference problem computationally\n",
+    "tractable, we need to specify how restricted the class of models needs to be. A\n",
+    "common strategy is to start \n",
+    "with the simplest possible class of models that is just necessary to describe the data\n",
+    "or solve the problem at hand. More precisely, the model class should be rich enough\n",
+    "to contain at least one model that can fit the data to a desired accuracy and yet be\n",
+    "restricted enough that it is relatively simple to find the best model for the given data.\n",
+    "\n",
+    "Thus, the most popular strategy is to start from the\n",
+    "simplest class of models and increase the complexity of the models only when the\n",
+    "simpler models become inadequate. For instance, if we work with a regression problem to fit a set of sample points, one\n",
+    "may first try the simplest class of models, namely linear models, followed obviously by more complex models.\n",
+    "\n",
+    "How to evaluate which model fits best the data is something we will come back to over and over again in these set of lectures.\n",
+    "\n",
+    "\n",
+    "\n",
+    "\n",
+    "## Choice of Programming Language\n",
    "\n",
    "Python plays nowadays a central role in the development of machine\n",
    "learning techniques and tools for data analysis. In particular, seen\n",
@@ -218,38 +336,12 @@
    "compiled programs written in C++, and much more made our choice of\n",
    "programming language for this series of lectures easy. However,\n",
    "since the focus here is not only on using existing Python libraries such\n",
-    "as **Scikit-Learn** or **Tensorflow**, but also on developing your own\n",
+    "as **Scikit-Learn**, **Tensorflow** and **Pytorch**, but also on developing your own\n",
    "algorithms and codes, we will as far as possible present many of these\n",
    "algorithms either as a Python codes or C++ or Fortran (or other languages) codes. \n",
    "\n",
-    "The reason we also  focus on compiled languages like C++ (or\n",
-    "Fortran), is that Python is still notoriously slow when we do not\n",
-    "utilize highly streamlined computational libraries like\n",
-    "[Lapack](http://www.netlib.org/lapack/) or other numerical libraries\n",
-    "written in compiled languages (many of these libraries are written in\n",
-    "Fortran).  Although a project like [Numba](https://numba.pydata.org/)\n",
-    "holds great promise for speeding up the unrolling of lengthy loops, C++\n",
-    "and Fortran are presently still the performance winners. Numba gives\n",
-    "you potentially the power to speed up your applications with high\n",
-    "performance functions written directly in Python. In particular,\n",
-    "array-oriented and math-heavy Python code can achieve similar\n",
-    "performance to C, C++ and Fortran. However, even with these speed-ups,\n",
-    "for codes involving heavy Markov Chain Monte Carlo analyses and\n",
-    "optimizations of cost functions, C++/C or Fortran codes tend to\n",
-    "outperform Python codes.  \n",
    "\n",
-    "Presently thus, the community tends to let\n",
-    "code written in C++/C or Fortran do the heavy duty numerical\n",
-    "number crunching and leave the post-analysis of the data to the above\n",
-    "mentioned Python modules or software packages.  However, with the developments taking place in for example the Python community, and seen\n",
-    "the changes during the last decade, the above situation may change swiftly in the not too distant future. \n",
    "\n",
-    "Many of the examples we discuss in this series of lectures come with\n",
-    "existing data files or provide code examples which produce the data to\n",
-    "be analyzed.  Most of the  applications we will discuss deal with\n",
-    "small data sets (less than a terabyte of information) and can easily\n",
-    "be analyzed and tested  on standard off the shelf laptops you find in general \n",
-    "stores.\n",
    "\n",
    "## Data handling, machine learning  and ethical aspects\n",
    "\n",
@@ -355,14 +447,15 @@
    ":titlesonly:\n",
    "\n",
    "\n",
-    "gettingstarted.ipynb\n",
-    "regression.ipynb\n",
-    "logistic.ipynb\n",
+    "chapter2\n",
+    "chapter3\n",
+    "chapter4\n",
+    "chapter5\n",
    "```\n"
   ]
  }
 ],
 "metadata": {},
 "nbformat": 4,
- "nbformat_minor": 2
+ "nbformat_minor": 4
 }
@@ -4,9 +4,9 @@
 <!-- Author: -->  
 **Morten Hjorth-Jensen**, Department of Physics, University of Oslo and Department of Physics and Astronomy and National Superconducting Cyclotron Laboratory, Michigan State University

-Date: **Nov 19, 2019**
+Date: **Sep 19, 2020**

-Copyright 1999-2019, Morten Hjorth-Jensen. Released under CC Attribution-NonCommercial 4.0 license
+Copyright 1999-2020, Morten Hjorth-Jensen. Released under CC Attribution-NonCommercial 4.0 license



@@ -88,7 +88,7 @@ Carlo methods are central elements in a proper understanding of many
 of algorithms and methods we will discuss.


-<!-- !split  -->
+
 ## Learning outcomes

 These sets of lectures aim at giving you an overview of central aspects of
@@ -147,6 +147,51 @@ machine learning.



+## Machine Learning, a small (and probably biased) introduction
+
+
+Ideally, machine learning represents the science of giving computers
+the ability to learn without being explicitly programmed.  The idea is
+that there exist generic algorithms which can be used to find patterns
+in a broad class of data sets without having to write code
+specifically for each problem. The algorithm will build its own logic
+based on the data.  You should however always keep in mind that
+machines and algorithms are to a large extent developed by humans. The
+insights and knowledge we have about a specific system, play a central
+role when we develop a specific machine learning algorithm. 
+
+
+## Machine Learning, an extremely rich field
+
+Machine learning is an extremely rich field, in spite of its young
+age. The increases we have seen during the last  decades in
+computational capabilities have been followed by developments of
+methods and techniques for analyzing and handling large date sets,
+relying heavily on statistics, computer science and mathematics.  The
+field is rather new and developing rapidly. Popular software libraries
+written in Python for machine learning like
+[Scikit-learn](http://scikit-learn.org/stable/),
+[Tensorflow](https://www.tensorflow.org/),
+[PyTorch](http://pytorch.org/) and [Keras](https://keras.io/), all
+freely available at their respective GitHub sites, encompass
+communities of developers in the thousands or more. And the number of
+code developers and contributors keeps increasing.
+
+
+## A multidisciplinary approach
+
+Not all the
+algorithms and methods can be given a rigorous mathematical
+justification (for example decision trees and random forests), opening up thereby large rooms for experimenting and
+trial and error and thereby exciting new developments.  However, a
+solid command of linear algebra, multivariate theory, probability
+theory, statistical data analysis, understanding errors and Monte
+Carlo methods are central elements in a proper understanding of many
+of the algorithms and methods we will discuss.
+
+
+
+

 ## Types of Machine Learning

@@ -164,44 +209,117 @@ solely from rewards and punishment.
 Another way to categorize machine learning tasks is to consider the
 desired output of a system.  Some of the most common tasks are:

-  * Classification: Outputs are divided into two or more classes. The goal is to   produce a model that assigns inputs into one of these classes. An example is to identify  digits based on pictures of hand-written ones. Classification is typically supervised learning.
+* Classification: Outputs are divided into two or more classes. The goal is to   produce a model that assigns inputs into one of these classes. An example is to identify  digits based on pictures of hand-written ones. Classification is often supervised learning.

-  * Regression: Finding a functional relationship between an input data set and a reference data set.   The goal is to construct a function that maps input data to continuous output values.
+* Regression: Finding a functional relationship between an input data set and a reference data set.   The goal is to construct a function that maps input data to continuous output values.

-  * Clustering: Data are divided into groups with certain common traits, without knowing the different groups beforehand.  It is thus a form of unsupervised learning.
+* Clustering: Data are divided into groups with certain common traits, without knowing the different groups beforehand.  It is thus a form of unsupervised learning.
+
+
+
+
+
+## Essential elements of ML

 The methods we cover have three main topics in common, irrespective of
-whether we deal with supervised or unsupervised learning. The first
-ingredient is normally our data set (which can be subdivided into
-training and test data), the second item is a model which is normally
-a function of some parameters.  The model reflects our knowledge of
-the system (or lack thereof). As an example, if we know that our data
-show a behavior similar to what would be predicted by a polynomial,
-fitting our data to a polynomial of some degree would then determin
-our model.
+whether we deal with supervised or unsupervised learning.
+* The first ingredient is normally our data set (which can be subdivided into training, validation  and test data). Many find the most difficult part of using Machine Learning to be the set up of your data in a meaningful way. 

-The last ingredient is a so-called **cost**
-function which allows us to present an estimate on how good our model
-is in reproducing the data it is supposed to train.  
+* The second item is a model which is normally a function of some parameters.  The model reflects our knowledge of the system (or lack thereof). As an example, if we know that our data show a behavior similar to what would be predicted by a polynomial, fitting our data to a polynomial of some degree would then determin our model. 

-Here we will build our machine learning approach on elements of the
-statistical foundation discussed above, with elements from data
-analysis, stochastic processes etc. We will discuss the following
-machine learning algorithms
+* The last ingredient is a so-called **cost/loss** function (or error function) which allows us to present an estimate on how good our model is in reproducing the data it is supposed to train.  

-1. Linear regression and its variants

-2. Decision tree algorithms, from single trees to random forests

-3. Bayesian statistics and regression

-4. Support vector machines and finally various variants of

-5. Artifical neural networks and deep learning, including convolutional neural networks and Bayesian neural networks

-6. Networks for unsupervised learning using for example reduced Boltzmann machines.
+## An optimization/minimization problem

-## Choice of programming language
+At the heart of basically all Machine Learning algorithms we will encounter so-called minimization or optimization algorithms. A large family of such methods are so-called **gradient methods**.
+
+
+## A Frequentist approach to data analysis
+
+When you hear phrases like **predictions and estimations** and
+**correlations and causations**, what do you think of?  May be you think
+of the difference between classifying new data points and generating
+new data points.
+Or perhaps you consider that correlations represent some kind of symmetric statements like
+if $A$ is correlated with $B$, then $B$ is correlated with
+$A$. Causation on the other hand is directional, that is if $A$ causes $B$, $B$ does not
+necessarily cause $A$.
+
+These concepts are in some sense the difference between machine
+learning and statistics. In machine learning and prediction based
+tasks, we are often interested in developing algorithms that are
+capable of learning patterns from given data in an automated fashion,
+and then using these learned patterns to make predictions or
+assessments of newly given data. In many cases, our primary concern
+is the quality of the predictions or assessments, and we are less
+concerned about the underlying patterns that were learned in order
+to make these predictions.
+
+In machine learning we normally use [a so-called frequentist approach](https://en.wikipedia.org/wiki/Frequentist_inference),
+where the aim is to make predictions and find correlations. We focus
+less on for example extracting a probability distribution function (PDF). The PDF can be
+used in turn to make estimations and find causations such as given $A$
+what is the likelihood of finding $B$.
+
+
+
+## What is a good model?
+
+In science and engineering we often end up in situations where we want to infer (or learn) a
+quantitative model $M$ for a given set of sample points $\boldsymbol{X} \in [x_1, x_2,\dots x_N]$.
+
+As we will see repeatedely in these lectures, we could try to fit these data points to a model given by a
+straight line, or if we wish to be more sophisticated to a more complex
+function.
+
+The reason for inferring such a model is that it
+serves many useful purposes. On the one hand, the model can reveal information
+encoded in the data or underlying mechanisms from which the data were generated. For instance, we could discover important
+corelations that relate interesting physics interpretations.
+
+In addition, it can simplify the representation of the given data set and help
+us in making predictions about  future data samples.
+
+A first important consideration to keep in mind is that inferring the *correct* model
+for a given data set is an elusive, if not impossible, task. The fundamental difficulty
+is that if we are not specific about what we mean by a *correct* model, there
+could easily be many different models that fit the given data set *equally well*.
+
+
+
+## What is a good model? Can we define it?
+
+
+The central question is this: what leads us to say that a model is correct or
+optimal for a given data set? To make the model inference problem well posed, i.e.,
+to guarantee that there is a unique optimal model for the given data, we need to
+impose additional assumptions or restrictions on the class of models considered. To
+this end, we should not be looking for just any model that can describe the data.
+Instead, we should look for a **model** $M$ that is the best among a restricted class
+of models. In addition, to make the model inference problem computationally
+tractable, we need to specify how restricted the class of models needs to be. A
+common strategy is to start 
+with the simplest possible class of models that is just necessary to describe the data
+or solve the problem at hand. More precisely, the model class should be rich enough
+to contain at least one model that can fit the data to a desired accuracy and yet be
+restricted enough that it is relatively simple to find the best model for the given data.
+
+Thus, the most popular strategy is to start from the
+simplest class of models and increase the complexity of the models only when the
+simpler models become inadequate. For instance, if we work with a regression problem to fit a set of sample points, one
+may first try the simplest class of models, namely linear models, followed obviously by more complex models.
+
+How to evaluate which model fits best the data is something we will come back to over and over again in these set of lectures.
+
+
+
+
+## Choice of Programming Language

 Python plays nowadays a central role in the development of machine
 learning techniques and tools for data analysis. In particular, seen
@@ -212,38 +330,12 @@ Jupyter notebook framework with the possibility to run **R** codes or
 compiled programs written in C++, and much more made our choice of
 programming language for this series of lectures easy. However,
 since the focus here is not only on using existing Python libraries such
-as **Scikit-Learn** or **Tensorflow**, but also on developing your own
+as **Scikit-Learn**, **Tensorflow** and **Pytorch**, but also on developing your own
 algorithms and codes, we will as far as possible present many of these
 algorithms either as a Python codes or C++ or Fortran (or other languages) codes. 

-The reason we also  focus on compiled languages like C++ (or
-Fortran), is that Python is still notoriously slow when we do not
-utilize highly streamlined computational libraries like
-[Lapack](http://www.netlib.org/lapack/) or other numerical libraries
-written in compiled languages (many of these libraries are written in
-Fortran).  Although a project like [Numba](https://numba.pydata.org/)
-holds great promise for speeding up the unrolling of lengthy loops, C++
-and Fortran are presently still the performance winners. Numba gives
-you potentially the power to speed up your applications with high
-performance functions written directly in Python. In particular,
-array-oriented and math-heavy Python code can achieve similar
-performance to C, C++ and Fortran. However, even with these speed-ups,
-for codes involving heavy Markov Chain Monte Carlo analyses and
-optimizations of cost functions, C++/C or Fortran codes tend to
-outperform Python codes.  

-Presently thus, the community tends to let
-code written in C++/C or Fortran do the heavy duty numerical
-number crunching and leave the post-analysis of the data to the above
-mentioned Python modules or software packages.  However, with the developments taking place in for example the Python community, and seen
-the changes during the last decade, the above situation may change swiftly in the not too distant future. 

-Many of the examples we discuss in this series of lectures come with
-existing data files or provide code examples which produce the data to
-be analyzed.  Most of the  applications we will discuss deal with
-small data sets (less than a terabyte of information) and can easily
-be analyzed and tested  on standard off the shelf laptops you find in general 
-stores.

 ## Data handling, machine learning  and ethical aspects

@@ -344,7 +436,8 @@ society.
 :titlesonly:


-gettingstarted.ipynb
-regression.ipynb
-logistic.ipynb
+chapter2
+chapter3
+chapter4
+chapter5
 ```
@@ -0,0 +1,544 @@
+<!-- dom:TITLE: Data Analysis and Machine Learning: Logistic Regression -->
+# Data Analysis and Machine Learning: Logistic Regression
+<!-- dom:AUTHOR: Morten Hjorth-Jensen at Department of Physics, University of Oslo & Department of Physics and Astronomy and National Superconducting Cyclotron Laboratory, Michigan State University -->
+<!-- Author: -->  
+**Morten Hjorth-Jensen**, Department of Physics, University of Oslo and Department of Physics and Astronomy and National Superconducting Cyclotron Laboratory, Michigan State University
+
+Date: **Oct 17, 2019**
+
+Copyright 1999-2019, Morten Hjorth-Jensen. Released under CC Attribution-NonCommercial 4.0 license
+
+
+
+
+<!-- !split  -->
+## Logistic Regression
+
+In linear regression our main interest was centered on learning the
+coefficients of a functional fit (say a polynomial) in order to be
+able to predict the response of a continuous variable on some unseen
+data. The fit to the continuous variable $y_i$ is based on some
+independent variables $\hat{x}_i$. Linear regression resulted in
+analytical expressions for standard ordinary Least Squares or Ridge
+regression (in terms of matrices to invert) for several quantities,
+ranging from the variance and thereby the confidence intervals of the
+parameters $\hat{\beta}$ to the mean squared error. If we can invert
+the product of the design matrices, linear regression gives then a
+simple recipe for fitting our data.
+
+
+Classification problems, however, are concerned with outcomes taking
+the form of discrete variables (i.e. categories). We may for example,
+on the basis of DNA sequencing for a number of patients, like to find
+out which mutations are important for a certain disease; or based on
+scans of various patients' brains, figure out if there is a tumor or
+not; or given a specific physical system, we'd like to identify its
+state, say whether it is an ordered or disordered system (typical
+situation in solid state physics); or classify the status of a
+patient, whether she/he has a stroke or not and many other similar
+situations.
+
+The most common situation we encounter when we apply logistic
+regression is that of two possible outcomes, normally denoted as a
+binary outcome, true or false, positive or negative, success or
+failure etc.
+
+## Optimization and Deep learning
+
+Logistic regression will also serve as our stepping stone towards
+neural network algorithms and supervised deep learning. For logistic
+learning, the minimization of the cost function leads to a non-linear
+equation in the parameters $\hat{\beta}$. The optimization of the
+problem calls therefore for minimization algorithms. This forms the
+bottle neck of all machine learning algorithms, namely how to find
+reliable minima of a multi-variable function. This leads us to the
+family of gradient descent methods. The latter are the working horses
+of basically all modern machine learning algorithms.
+
+We note also that many of the topics discussed here on logistic 
+regression are also commonly used in modern supervised Deep Learning
+models, as we will see later.
+
+
+<!-- !split  -->
+## Basics
+
+We consider the case where the dependent variables, also called the
+responses or the outcomes, $y_i$ are discrete and only take values
+from $k=0,\dots,K-1$ (i.e. $K$ classes).
+
+The goal is to predict the
+output classes from the design matrix $\hat{X}\in\mathbb{R}^{n\times p}$
+made of $n$ samples, each of which carries $p$ features or predictors. The
+primary goal is to identify the classes to which new unseen samples
+belong.
+
+Let us specialize to the case of two classes only, with outputs
+$y_i=0$ and $y_i=1$. Our outcomes could represent the status of a
+credit card user that could default or not on her/his credit card
+debt. That is
+
+$$
+y_i = \begin{bmatrix} 0 & \mathrm{no}\\  1 & \mathrm{yes} \end{bmatrix}.
+$$
+
+## Linear classifier
+
+Before moving to the logistic model, let us try to use our linear
+regression model to classify these two outcomes. We could for example
+fit a linear model to the default case if $y_i > 0.5$ and the no
+default case $y_i \leq 0.5$.
+
+We would then have our 
+weighted linear combination, namely
+
+<!-- Equation labels as ordinary links -->
+<div id="_auto1"></div>
+
+$$
+\begin{equation}
+\hat{y} = \hat{X}^T\hat{\beta} +  \hat{\epsilon},
+\label{_auto1} \tag{1}
+\end{equation}
+$$
+
+where $\hat{y}$ is a vector representing the possible outcomes, $\hat{X}$ is our
+$n\times p$ design matrix and $\hat{\beta}$ represents our estimators/predictors.
+
+## Some selected properties
+
+The main problem with our function is that it takes values on the
+entire real axis. In the case of logistic regression, however, the
+labels $y_i$ are discrete variables. A typical example is the credit
+card data discussed below here, where we can set the state of
+defaulting the debt to $y_i=1$ and not to $y_i=0$ for one the persons
+in the data set (see the full example below).
+
+One simple way to get a discrete output is to have sign
+functions that map the output of a linear regressor to values $\{0,1\}$,
+$f(s_i)=sign(s_i)=1$ if $s_i\ge 0$ and 0 if otherwise. 
+We will encounter this model in our first demonstration of neural networks. Historically it is called the "perceptron" model in the machine learning
+literature. This model is extremely simple. However, in many cases it is more
+favorable to use a ``soft" classifier that outputs
+the probability of a given category. This leads us to the logistic function.
+
+
+## The logistic function
+
+The perceptron is an example of a ``hard classification" model. We
+will encounter this model when we discuss neural networks as
+well. Each datapoint is deterministically assigned to a category (i.e
+$y_i=0$ or $y_i=1$). In many cases, it is favorable to have a "soft"
+classifier that outputs the probability of a given category rather
+than a single value. For example, given $x_i$, the classifier
+outputs the probability of being in a category $k$.  Logistic regression
+is the most common example of a so-called soft classifier. In logistic
+regression, the probability that a data point $x_i$
+belongs to a category $y_i=\{0,1\}$ is given by the so-called logit function (or Sigmoid) which is meant to represent the likelihood for a given event,
+
+$$
+p(t) = \frac{1}{1+\mathrm \exp{-t}}=\frac{\exp{t}}{1+\mathrm \exp{t}}.
+$$
+
+Note that $1-p(t)= p(-t)$.
+
+## Examples of likelihood functions used in logistic regression and nueral networks
+
+
+The following code plots the logistic function, the step function and other functions we will encounter from here and on.
+
+%matplotlib inline
+
+"""The sigmoid function (or the logistic curve) is a
+function that takes any real number, z, and outputs a number (0,1).
+It is useful in neural networks for assigning weights on a relative scale.
+The value z is the weighted sum of parameters involved in the learning algorithm."""
+
+import numpy
+import matplotlib.pyplot as plt
+import math as mt
+
+z = numpy.arange(-5, 5, .1)
+sigma_fn = numpy.vectorize(lambda z: 1/(1+numpy.exp(-z)))
+sigma = sigma_fn(z)
+
+fig = plt.figure()
+ax = fig.add_subplot(111)
+ax.plot(z, sigma)
+ax.set_ylim([-0.1, 1.1])
+ax.set_xlim([-5,5])
+ax.grid(True)
+ax.set_xlabel('z')
+ax.set_title('sigmoid function')
+
+plt.show()
+
+"""Step Function"""
+z = numpy.arange(-5, 5, .02)
+step_fn = numpy.vectorize(lambda z: 1.0 if z >= 0.0 else 0.0)
+step = step_fn(z)
+
+fig = plt.figure()
+ax = fig.add_subplot(111)
+ax.plot(z, step)
+ax.set_ylim([-0.5, 1.5])
+ax.set_xlim([-5,5])
+ax.grid(True)
+ax.set_xlabel('z')
+ax.set_title('step function')
+
+plt.show()
+
+"""tanh Function"""
+z = numpy.arange(-2*mt.pi, 2*mt.pi, 0.1)
+t = numpy.tanh(z)
+
+fig = plt.figure()
+ax = fig.add_subplot(111)
+ax.plot(z, t)
+ax.set_ylim([-1.0, 1.0])
+ax.set_xlim([-2*mt.pi,2*mt.pi])
+ax.grid(True)
+ax.set_xlabel('z')
+ax.set_title('tanh function')
+
+plt.show()
+
+## Two parameters
+
+We assume now that we have two classes with $y_i$ either $0$ or $1$. Furthermore we assume also that we have only two parameters $\beta$ in our fitting of the Sigmoid function, that is we define probabilities
+
+$$
+\begin{align*}
+p(y_i=1|x_i,\hat{\beta}) &= \frac{\exp{(\beta_0+\beta_1x_i)}}{1+\exp{(\beta_0+\beta_1x_i)}},\nonumber\\
+p(y_i=0|x_i,\hat{\beta}) &= 1 - p(y_i=1|x_i,\hat{\beta}),
+\end{align*}
+$$
+
+where $\hat{\beta}$ are the weights we wish to extract from data, in our case $\beta_0$ and $\beta_1$. 
+
+Note that we used
+
+$$
+p(y_i=0\vert x_i, \hat{\beta}) = 1-p(y_i=1\vert x_i, \hat{\beta}).
+$$
+
+<!-- !split  -->
+## Maximum likelihood
+
+In order to define the total likelihood for all possible outcomes from a  
+dataset $\mathcal{D}=\{(y_i,x_i)\}$, with the binary labels
+$y_i\in\{0,1\}$ and where the data points are drawn independently, we use the so-called [Maximum Likelihood Estimation](https://en.wikipedia.org/wiki/Maximum_likelihood_estimation) (MLE) principle. 
+We aim thus at maximizing 
+the probability of seeing the observed data. We can then approximate the 
+likelihood in terms of the product of the individual probabilities of a specific outcome $y_i$, that is
+
+$$
+\begin{align*}
+P(\mathcal{D}|\hat{\beta})& = \prod_{i=1}^n \left[p(y_i=1|x_i,\hat{\beta})\right]^{y_i}\left[1-p(y_i=1|x_i,\hat{\beta}))\right]^{1-y_i}\nonumber \\
+\end{align*}
+$$
+
+from which we obtain the log-likelihood and our **cost/loss** function
+
+$$
+\mathcal{C}(\hat{\beta}) = \sum_{i=1}^n \left( y_i\log{p(y_i=1|x_i,\hat{\beta})} + (1-y_i)\log\left[1-p(y_i=1|x_i,\hat{\beta}))\right]\right).
+$$
+
+## The cost function rewritten
+
+Reordering the logarithms, we can rewrite the **cost/loss** function as
+
+$$
+\mathcal{C}(\hat{\beta}) = \sum_{i=1}^n  \left(y_i(\beta_0+\beta_1x_i) -\log{(1+\exp{(\beta_0+\beta_1x_i)})}\right).
+$$
+
+The maximum likelihood estimator is defined as the set of parameters that maximize the log-likelihood where we maximize with respect to $\beta$.
+Since the cost (error) function is just the negative log-likelihood, for logistic regression we have that
+
+$$
+\mathcal{C}(\hat{\beta})=-\sum_{i=1}^n  \left(y_i(\beta_0+\beta_1x_i) -\log{(1+\exp{(\beta_0+\beta_1x_i)})}\right).
+$$
+
+This equation is known in statistics as the **cross entropy**. Finally, we note that just as in linear regression, 
+in practice we often supplement the cross-entropy with additional regularization terms, usually $L_1$ and $L_2$ regularization as we did for Ridge and Lasso regression.
+
+## Minimizing the cross entropy
+
+The cross entropy is a convex function of the weights $\hat{\beta}$ and,
+therefore, any local minimizer is a global minimizer. 
+
+
+Minimizing this
+cost function with respect to the two parameters $\beta_0$ and $\beta_1$ we obtain
+
+$$
+\frac{\partial \mathcal{C}(\hat{\beta})}{\partial \beta_0} = -\sum_{i=1}^n  \left(y_i -\frac{\exp{(\beta_0+\beta_1x_i)}}{1+\exp{(\beta_0+\beta_1x_i)}}\right),
+$$
+
+and
+
+$$
+\frac{\partial \mathcal{C}(\hat{\beta})}{\partial \beta_1} = -\sum_{i=1}^n  \left(y_ix_i -x_i\frac{\exp{(\beta_0+\beta_1x_i)}}{1+\exp{(\beta_0+\beta_1x_i)}}\right).
+$$
+
+## A more compact expression
+
+Let us now define a vector $\hat{y}$ with $n$ elements $y_i$, an
+$n\times p$ matrix $\hat{X}$ which contains the $x_i$ values and a
+vector $\hat{p}$ of fitted probabilities $p(y_i\vert x_i,\hat{\beta})$. We can rewrite in a more compact form the first
+derivative of cost function as
+
+$$
+\frac{\partial \mathcal{C}(\hat{\beta})}{\partial \hat{\beta}} = -\hat{X}^T\left(\hat{y}-\hat{p}\right).
+$$
+
+If we in addition define a diagonal matrix $\hat{W}$ with elements 
+$p(y_i\vert x_i,\hat{\beta})(1-p(y_i\vert x_i,\hat{\beta})$, we can obtain a compact expression of the second derivative as
+
+$$
+\frac{\partial^2 \mathcal{C}(\hat{\beta})}{\partial \hat{\beta}\partial \hat{\beta}^T} = \hat{X}^T\hat{W}\hat{X}.
+$$
+
+## Extending to more predictors
+
+Within a binary classification problem, we can easily expand our model to include multiple predictors. Our ratio between likelihoods is then with $p$ predictors
+
+$$
+\log{ \frac{p(\hat{\beta}\hat{x})}{1-p(\hat{\beta}\hat{x})}} = \beta_0+\beta_1x_1+\beta_2x_2+\dots+\beta_px_p.
+$$
+
+Here we defined $\hat{x}=[1,x_1,x_2,\dots,x_p]$ and $\hat{\beta}=[\beta_0, \beta_1, \dots, \beta_p]$ leading to
+
+$$
+p(\hat{\beta}\hat{x})=\frac{ \exp{(\beta_0+\beta_1x_1+\beta_2x_2+\dots+\beta_px_p)}}{1+\exp{(\beta_0+\beta_1x_1+\beta_2x_2+\dots+\beta_px_p)}}.
+$$
+
+## Including more classes
+
+Till now we have mainly focused on two classes, the so-called binary
+system. Suppose we wish to extend to $K$ classes.  Let us for the sake
+of simplicity assume we have only two predictors. We have then
+following model
+
+1
+5
+ 
+<
+<
+<
+!
+!
+M
+A
+T
+H
+_
+B
+L
+O
+C
+K
+
+$$
+\log{\frac{p(C=2\vert x)}{p(K\vert x)}} = \beta_{20}+\beta_{21}x_1,
+$$
+
+and so on till the class $C=K-1$ class
+
+$$
+\log{\frac{p(C=K-1\vert x)}{p(K\vert x)}} = \beta_{(K-1)0}+\beta_{(K-1)1}x_1,
+$$
+
+and the model is specified in term of $K-1$ so-called log-odds or
+**logit** transformations.
+
+
+## More classes
+
+In our discussion of neural networks we will encounter the above again
+in terms of a slightly modified function, the so-called **Softmax** function.
+
+The softmax function is used in various multiclass classification
+methods, such as multinomial logistic regression (also known as
+softmax regression), multiclass linear discriminant analysis, naive
+Bayes classifiers, and artificial neural networks.  Specifically, in
+multinomial logistic regression and linear discriminant analysis, the
+input to the function is the result of $K$ distinct linear functions,
+and the predicted probability for the $k$-th class given a sample
+vector $\hat{x}$ and a weighting vector $\hat{\beta}$ is (with two
+predictors):
+
+$$
+p(C=k\vert \mathbf {x} )=\frac{\exp{(\beta_{k0}+\beta_{k1}x_1)}}{1+\sum_{l=1}^{K-1}\exp{(\beta_{l0}+\beta_{l1}x_1)}}.
+$$
+
+It is easy to extend to more predictors. The final class is
+
+$$
+p(C=K\vert \mathbf {x} )=\frac{1}{1+\sum_{l=1}^{K-1}\exp{(\beta_{l0}+\beta_{l1}x_1)}},
+$$
+
+and they sum to one. Our earlier discussions were all specialized to
+the case with two classes only. It is easy to see from the above that
+what we derived earlier is compatible with these equations.
+
+To find the optimal parameters we would typically use a gradient
+descent method.  Newton's method and gradient descent methods are
+discussed in the material on [optimization
+methods](https://compphysics.github.io/MachineLearning/doc/pub/Splines/html/Splines-bs.html).
+
+
+
+
+## A simple classification problem
+
+import numpy as np
+from sklearn import datasets, linear_model
+import matplotlib.pyplot as plt
+
+
+def generate_data():
+    np.random.seed(0)
+    X, y = datasets.make_moons(200, noise=0.20)
+    return X, y
+
+
+def visualize(X, y, clf):
+    plot_decision_boundary(lambda x: clf.predict(x), X, y)
+
+def plot_decision_boundary(pred_func, X, y):
+    # Set min and max values and give it some padding
+    x_min, x_max = X[:, 0].min() - .5, X[:, 0].max() + .5
+    y_min, y_max = X[:, 1].min() - .5, X[:, 1].max() + .5
+    h = 0.01
+    # Generate a grid of points with distance h between them
+    xx, yy = np.meshgrid(np.arange(x_min, x_max, h), np.arange(y_min, y_max, h))
+    # Predict the function value for the whole gid
+    Z = pred_func(np.c_[xx.ravel(), yy.ravel()])
+    Z = Z.reshape(xx.shape)
+    # Plot the contour and training examples
+    plt.contourf(xx, yy, Z, cmap=plt.cm.Spectral)
+    plt.scatter(X[:, 0], X[:, 1], c=y, cmap=plt.cm.Spectral)
+    plt.show()
+
+
+def classify(X, y):
+    clf = linear_model.LogisticRegressionCV()
+    clf.fit(X, y)
+    return clf
+
+
+def main():
+    X, y = generate_data()
+    # visualize(X, y)
+    clf = classify(X, y)
+    visualize(X, y, clf)
+
+if __name__ == "__main__":
+    main()
+
+## The Credit Card example
+Here we use the the [credit card data](https://archive.ics.uci.edu/ml/datasets/default+of+credit+card+clients). 
+The data are from an extensive database from Taiwan and include more than ten predictors.
+
+For categorical data -Scikit-Learn- provides a so-called **one-hot encoder**.
+This is called one-hot
+encoding, because only one attribute will be equal to 1 (hot), while the others will be 0 (cold).
+**Scikit-Learn** provides a OneHotEncoder encoder to convert integer categorical values into one-hot
+
+from sklearn.preprocessing import OneHotEncoder
+encoder = OneHotEncoder()
+
+## How to read the Credit Card data
+
+import pandas as pd
+import os
+import numpy as np
+
+
+from sklearn.model_selection import train_test_split
+from sklearn.preprocessing import OneHotEncoder
+from sklearn.compose import ColumnTransformer
+from sklearn.preprocessing import StandardScaler, OneHotEncoder
+from sklearn.metrics import confusion_matrix, accuracy_score, roc_auc_score
+
+# Trying to set the seed
+np.random.seed(0)
+import random
+random.seed(0)
+
+# Reading file into data frame
+cwd = os.getcwd()
+filename = cwd + '/default of credit card clients.xls'
+nanDict = {}
+df = pd.read_excel(filename, header=1, skiprows=0, index_col=0, na_values=nanDict)
+
+df.rename(index=str, columns={"default payment next month": "defaultPaymentNextMonth"}, inplace=True)
+
+# Features and targets 
+X = df.loc[:, df.columns != 'defaultPaymentNextMonth'].values
+y = df.loc[:, df.columns == 'defaultPaymentNextMonth'].values
+
+# Categorical variables to one-hot's
+onehotencoder = OneHotEncoder(categories="auto")
+
+X = ColumnTransformer(
+    [("", onehotencoder, [3]),],
+    remainder="passthrough"
+).fit_transform(X)
+
+y.shape
+
+# Train-test split
+trainingShare = 0.5 
+seed  = 1
+XTrain, XTest, yTrain, yTest=train_test_split(X, y, train_size=trainingShare, \
+                                              test_size = 1-trainingShare,
+                                             random_state=seed)
+
+# Input Scaling
+sc = StandardScaler()
+XTrain = sc.fit_transform(XTrain)
+XTest = sc.transform(XTest)
+
+# One-hot's of the target vector
+Y_train_onehot, Y_test_onehot = onehotencoder.fit_transform(yTrain), onehotencoder.fit_transform(yTest)
+
+# Remove instances with zeros only for past bill statements or paid amounts
+'''
+df = df.drop(df[(df.BILL_AMT1 == 0) &
+                (df.BILL_AMT2 == 0) &
+                (df.BILL_AMT3 == 0) &
+                (df.BILL_AMT4 == 0) &
+                (df.BILL_AMT5 == 0) &
+                (df.BILL_AMT6 == 0) &
+                (df.PAY_AMT1 == 0) &
+                (df.PAY_AMT2 == 0) &
+                (df.PAY_AMT3 == 0) &
+                (df.PAY_AMT4 == 0) &
+                (df.PAY_AMT5 == 0) &
+                (df.PAY_AMT6 == 0)].index)
+'''
+df = df.drop(df[(df.BILL_AMT1 == 0) &
+                (df.BILL_AMT2 == 0) &
+                (df.BILL_AMT3 == 0) &
+                (df.BILL_AMT4 == 0) &
+                (df.BILL_AMT5 == 0) &
+                (df.BILL_AMT6 == 0)].index)
+
+df = df.drop(df[(df.PAY_AMT1 == 0) &
+                (df.PAY_AMT2 == 0) &
+                (df.PAY_AMT3 == 0) &
+                (df.PAY_AMT4 == 0) &
+                (df.PAY_AMT5 == 0) &
+                (df.PAY_AMT6 == 0)].index)
+
+from sklearn.linear_model import LogisticRegression
+from sklearn.model_selection import GridSearchCV
+
+lambdas=np.logspace(-5,7,13)
+parameters = [{'C': 1./lambdas, "solver":["lbfgs"]}]#*len(parameters)}]
+scoring = ['accuracy', 'roc_auc']
+logReg = LogisticRegression()
+gridSearch = GridSearchCV(logReg, parameters, cv=5, scoring=scoring, refit='roc_auc')
@@ -1,65 +0,0 @@
-# Content with notebooks
-
-You can also create content with Jupyter Notebooks. This means that you can include
-code blocks and their outputs in your book.
-
-## Markdown + notebooks
-
-As it is markdown, you can embed images, HTML, etc into your posts!
-
-![](https://myst-parser.readthedocs.io/en/latest/_static/logo.png)
-
-You an also $add_{math}$ and
-
-$$
-math^{blocks}
-$$
-
-or
-
-$$
-\begin{aligned}
-\mbox{mean} la_{tex} \\ \\
-math blocks
-\end{aligned}
-$$
-
-But make sure you \$Escape \$your \$dollar signs \$you want to keep!
-
-## MyST markdown
-
-MyST markdown works in Jupyter Notebooks as well. For more information about MyST markdown, check
-out [the MyST guide in Jupyter Book](https://jupyterbook.org/content/myst.html),
-or see [the MyST markdown documentation](https://myst-parser.readthedocs.io/en/latest/).
-
-## Code blocks and outputs
-
-Jupyter Book will also embed your code blocks and output in your book.
-For example, here's some sample Matplotlib code:
-
-from matplotlib import rcParams, cycler
-import matplotlib.pyplot as plt
-import numpy as np
-plt.ion()
-
-# Fixing random state for reproducibility
-np.random.seed(19680801)
-
-N = 10
-data = [np.logspace(0, 1, 100) + np.random.randn(100) + ii for ii in range(N)]
-data = np.array(data).T
-cmap = plt.cm.coolwarm
-rcParams['axes.prop_cycle'] = cycler(color=cmap(np.linspace(0, 1, N)))
-
-
-from matplotlib.lines import Line2D
-custom_lines = [Line2D([0], [0], color=cmap(0.), lw=4),
-                Line2D([0], [0], color=cmap(.5), lw=4),
-                Line2D([0], [0], color=cmap(1.), lw=4)]
-
-fig, ax = plt.subplots(figsize=(10, 5))
-lines = ax.plot(data)
-ax.legend(custom_lines, ['Cold', 'Medium', 'Hot']);
-
-There is a lot more that you can do with outputs (such as including interactive outputs)
-with your book. For more information about this, see [the Jupyter Book documentation](https://jupyterbook.org)
@@ -0,0 +1,101 @@
+;; -*- coding: utf-8; mode: Lisp; -*-
+;; style file for xindy
+;; filename: LICRcyr2utf8.xdy
+;; description: style file for xindy which maps back LaTeX Internal
+;;   Character Representation of Cyrillic to utf-8
+;; usage: for use with pdflatex produced .idx files.
+;; Contributed by the Sphinx team, July 2018.
+(merge-rule "\IeC {\'\CYRG }" "Ѓ" :string)
+(merge-rule "\IeC {\'\CYRK }" "Ќ" :string)
+(merge-rule "\IeC {\'\cyrg }" "ѓ" :string)
+(merge-rule "\IeC {\'\cyrk }" "ќ" :string)
+(merge-rule "\IeC {\CYRA }" "А" :string)
+(merge-rule "\IeC {\CYRB }" "Б" :string)
+(merge-rule "\IeC {\CYRC }" "Ц" :string)
+(merge-rule "\IeC {\CYRCH }" "Ч" :string)
+(merge-rule "\IeC {\CYRD }" "Д" :string)
+(merge-rule "\IeC {\CYRDJE }" "Ђ" :string)
+(merge-rule "\IeC {\CYRDZE }" "Ѕ" :string)
+(merge-rule "\IeC {\CYRDZHE }" "Џ" :string)
+(merge-rule "\IeC {\CYRE }" "Е" :string)
+(merge-rule "\IeC {\CYREREV }" "Э" :string)
+(merge-rule "\IeC {\CYRERY }" "Ы" :string)
+(merge-rule "\IeC {\CYRF }" "Ф" :string)
+(merge-rule "\IeC {\CYRG }" "Г" :string)
+(merge-rule "\IeC {\CYRGUP }" "Ґ" :string)
+(merge-rule "\IeC {\CYRH }" "Х" :string)
+(merge-rule "\IeC {\CYRHRDSN }" "Ъ" :string)
+(merge-rule "\IeC {\CYRI }" "И" :string)
+(merge-rule "\IeC {\CYRIE }" "Є" :string)
+(merge-rule "\IeC {\CYRII }" "І" :string)
+(merge-rule "\IeC {\CYRISHRT }" "Й" :string)
+(merge-rule "\IeC {\CYRJE }" "Ј" :string)
+(merge-rule "\IeC {\CYRK }" "К" :string)
+(merge-rule "\IeC {\CYRL }" "Л" :string)
+(merge-rule "\IeC {\CYRLJE }" "Љ" :string)
+(merge-rule "\IeC {\CYRM }" "М" :string)
+(merge-rule "\IeC {\CYRN }" "Н" :string)
+(merge-rule "\IeC {\CYRNJE }" "Њ" :string)
+(merge-rule "\IeC {\CYRO }" "О" :string)
+(merge-rule "\IeC {\CYRP }" "П" :string)
+(merge-rule "\IeC {\CYRR }" "Р" :string)
+(merge-rule "\IeC {\CYRS }" "С" :string)
+(merge-rule "\IeC {\CYRSFTSN }" "Ь" :string)
+(merge-rule "\IeC {\CYRSH }" "Ш" :string)
+(merge-rule "\IeC {\CYRSHCH }" "Щ" :string)
+(merge-rule "\IeC {\CYRT }" "Т" :string)
+(merge-rule "\IeC {\CYRTSHE }" "Ћ" :string)
+(merge-rule "\IeC {\CYRU }" "У" :string)
+(merge-rule "\IeC {\CYRUSHRT }" "Ў" :string)
+(merge-rule "\IeC {\CYRV }" "В" :string)
+(merge-rule "\IeC {\CYRYA }" "Я" :string)
+(merge-rule "\IeC {\CYRYI }" "Ї" :string)
+(merge-rule "\IeC {\CYRYO }" "Ё" :string)
+(merge-rule "\IeC {\CYRYU }" "Ю" :string)
+(merge-rule "\IeC {\CYRZ }" "З" :string)
+(merge-rule "\IeC {\CYRZH }" "Ж" :string)
+(merge-rule "\IeC {\cyra }" "а" :string)
+(merge-rule "\IeC {\cyrb }" "б" :string)
+(merge-rule "\IeC {\cyrc }" "ц" :string)
+(merge-rule "\IeC {\cyrch }" "ч" :string)
+(merge-rule "\IeC {\cyrd }" "д" :string)
+(merge-rule "\IeC {\cyrdje }" "ђ" :string)
+(merge-rule "\IeC {\cyrdze }" "ѕ" :string)
+(merge-rule "\IeC {\cyrdzhe }" "џ" :string)
+(merge-rule "\IeC {\cyre }" "е" :string)
+(merge-rule "\IeC {\cyrerev }" "э" :string)
+(merge-rule "\IeC {\cyrery }" "ы" :string)
+(merge-rule "\IeC {\cyrf }" "ф" :string)
+(merge-rule "\IeC {\cyrg }" "г" :string)
+(merge-rule "\IeC {\cyrgup }" "ґ" :string)
+(merge-rule "\IeC {\cyrh }" "х" :string)
+(merge-rule "\IeC {\cyrhrdsn }" "ъ" :string)
+(merge-rule "\IeC {\cyri }" "и" :string)
+(merge-rule "\IeC {\cyrie }" "є" :string)
+(merge-rule "\IeC {\cyrii }" "і" :string)
+(merge-rule "\IeC {\cyrishrt }" "й" :string)
+(merge-rule "\IeC {\cyrje }" "ј" :string)
+(merge-rule "\IeC {\cyrk }" "к" :string)
+(merge-rule "\IeC {\cyrl }" "л" :string)
+(merge-rule "\IeC {\cyrlje }" "љ" :string)
+(merge-rule "\IeC {\cyrm }" "м" :string)
+(merge-rule "\IeC {\cyrn }" "н" :string)
+(merge-rule "\IeC {\cyrnje }" "њ" :string)
+(merge-rule "\IeC {\cyro }" "о" :string)
+(merge-rule "\IeC {\cyrp }" "п" :string)
+(merge-rule "\IeC {\cyrr }" "р" :string)
+(merge-rule "\IeC {\cyrs }" "с" :string)
+(merge-rule "\IeC {\cyrsftsn }" "ь" :string)
+(merge-rule "\IeC {\cyrsh }" "ш" :string)
+(merge-rule "\IeC {\cyrshch }" "щ" :string)
+(merge-rule "\IeC {\cyrt }" "т" :string)
+(merge-rule "\IeC {\cyrtshe }" "ћ" :string)
+(merge-rule "\IeC {\cyru }" "у" :string)
+(merge-rule "\IeC {\cyrushrt }" "ў" :string)
+(merge-rule "\IeC {\cyrv }" "в" :string)
+(merge-rule "\IeC {\cyrya }" "я" :string)
+(merge-rule "\IeC {\cyryi }" "ї" :string)
+(merge-rule "\IeC {\cyryo }" "ё" :string)
+(merge-rule "\IeC {\cyryu }" "ю" :string)
+(merge-rule "\IeC {\cyrz }" "з" :string)
+(merge-rule "\IeC {\cyrzh }" "ж" :string)
@@ -0,0 +1,239 @@
+;; style file for xindy
+;; filename: LICRlatin2utf8.xdy
+;; description: style file for xindy which maps back LaTeX Internal
+;;   Character Representation of letters (as arising in .idx index
+;;   file) to UTF-8 encoding for correct sorting by xindy.
+;; usage: for use with the pdflatex engine,
+;;        *not* for use with xelatex or lualatex.
+;;
+;; This is based upon xindy's distributed file tex/inputenc/utf8.xdy.
+;; The modifications include:
+;;
+;; - Updates for compatibility with current LaTeX macro encoding.
+;;
+;; - Systematic usage of the \IeC {...} mark-up, because mark-up in
+;;   tex/inputenc/utf8.xdy was using it on seemingly random basis, and
+;;   Sphinx coercing of xindy usability for both Latin and Cyrillic scripts
+;;   with pdflatex requires its systematic presence here.
+;;
+;; - Support for some extra letters: Ÿ, Ŋ, ŋ, Œ, œ, Ĳ, ĳ, ȷ and ẞ.
+;;
+;;   Indeed Sphinx needs to support for pdflatex engine all Unicode letters
+;;   available in TeX T1 font encoding.  The above letters are found in
+;;   that encoding but not in the Latin1, 2, 3 charsets which are those
+;;   covered by original tex/inputenc/utf8.xdy.
+;;
+;; - There is a problem that ȷ is not supported out-of-the box by LaTeX
+;;   with inputenc, one must add explicitely
+;;       \DeclareUnicodeCharacter{0237}{\j}
+;;   to preamble of LaTeX document.  However this character is not supported
+;;   by the TeX "times" font used by default by Sphinx for pdflatex engine.
+;;
+;;     **Update**: since LaTeX 2018/12/01, the \j as well as \SS, \k{} and
+;;                  \.{} need no extra user declaration anymore.
+;;
+;; - ẞ needs \DeclareUnicodeCharacter{1E9E}{\SS} (but ß needs no extra set-up).
+;;
+;; - U+02DB (˛) and U+02D9 (˙) are also not supported by inputenc
+;;   out of the box and require
+;;       \DeclareUnicodeCharacter{02DB}{\k{}}
+;;       \DeclareUnicodeCharacter{02D9}{\.{}}
+;;   to be added to preamble.
+;;
+;; - U+0127 ħ and U+0126 Ħ are absent from TeX T1+TS1 font encodings.
+;;
+;; - Characters Ŋ and ŋ are not supported by TeX font "times" used by
+;;   default by Sphinx for pdflatex engine but they are supported by
+;;   some TeX fonts, in particular by the default LaTeX font for T1
+;;   encoding.
+;;
+;; - " and ~ must be escaped as ~" and resp. ~~ in xindy merge rules.
+;;
+;; Contributed by the Sphinx team, July 2018.
+;;
+;; See sphinx.xdy for superior figures, as they are escaped by LaTeX writer.
+(merge-rule "\IeC {\textonesuperior }" "¹" :string)
+(merge-rule "\IeC {\texttwosuperior }" "²" :string)
+(merge-rule "\IeC {\textthreesuperior }" "³" :string)
+(merge-rule "\IeC {\'a}" "á" :string)
+(merge-rule "\IeC {\'A}" "Á" :string)
+(merge-rule "\IeC {\`a}" "à" :string)
+(merge-rule "\IeC {\`A}" "À" :string)
+(merge-rule "\IeC {\^a}" "â" :string)
+(merge-rule "\IeC {\^A}" "Â" :string)
+(merge-rule "\IeC {\~"a}" "ä" :string)
+(merge-rule "\IeC {\~"A}" "Ä" :string)
+(merge-rule "\IeC {\~~a}" "ã" :string)
+(merge-rule "\IeC {\~~A}" "Ã" :string)
+(merge-rule "\IeC {\c c}" "ç" :string)
+(merge-rule "\IeC {\c C}" "Ç" :string)
+(merge-rule "\IeC {\'c}" "ć" :string)
+(merge-rule "\IeC {\'C}" "Ć" :string)
+(merge-rule "\IeC {\^c}" "ĉ" :string)
+(merge-rule "\IeC {\^C}" "Ĉ" :string)
+(merge-rule "\IeC {\.c}" "ċ" :string)
+(merge-rule "\IeC {\.C}" "Ċ" :string)
+(merge-rule "\IeC {\c s}" "ş" :string)
+(merge-rule "\IeC {\c S}" "Ş" :string)
+(merge-rule "\IeC {\c t}" "ţ" :string)
+(merge-rule "\IeC {\c T}" "Ţ" :string)
+(merge-rule "\IeC {\-}" "" :string); soft hyphen
+(merge-rule "\IeC {\textdiv }" "÷" :string)
+(merge-rule "\IeC {\'e}" "é" :string)
+(merge-rule "\IeC {\'E}" "É" :string)
+(merge-rule "\IeC {\`e}" "è" :string)
+(merge-rule "\IeC {\`E}" "È" :string)
+(merge-rule "\IeC {\^e}" "ê" :string)
+(merge-rule "\IeC {\^E}" "Ê" :string)
+(merge-rule "\IeC {\~"e}" "ë" :string)
+(merge-rule "\IeC {\~"E}" "Ë" :string)
+(merge-rule "\IeC {\^g}" "ĝ" :string)
+(merge-rule "\IeC {\^G}" "Ĝ" :string)
+(merge-rule "\IeC {\.g}" "ġ" :string)
+(merge-rule "\IeC {\.G}" "Ġ" :string)
+(merge-rule "\IeC {\^h}" "ĥ" :string)
+(merge-rule "\IeC {\^H}" "Ĥ" :string)
+(merge-rule "\IeC {\H o}" "ő" :string)
+(merge-rule "\IeC {\H O}" "Ő" :string)
+(merge-rule "\IeC {\textacutedbl }" "˝" :string)
+(merge-rule "\IeC {\H u}" "ű" :string)
+(merge-rule "\IeC {\H U}" "Ű" :string)
+(merge-rule "\IeC {\ae }" "æ" :string)
+(merge-rule "\IeC {\AE }" "Æ" :string)
+(merge-rule "\IeC {\textcopyright }" "©" :string)
+(merge-rule "\IeC {\c \ }" "¸" :string)
+(merge-rule "\IeC {\dh }" "ð" :string)
+(merge-rule "\IeC {\DH }" "Ð" :string)
+(merge-rule "\IeC {\dj }" "đ" :string)
+(merge-rule "\IeC {\DJ }" "Đ" :string)
+(merge-rule "\IeC {\guillemotleft }" "«" :string)
+(merge-rule "\IeC {\guillemotright }" "»" :string)
+(merge-rule "\IeC {\'\i }" "í" :string)
+(merge-rule "\IeC {\`\i }" "ì" :string)
+(merge-rule "\IeC {\^\i }" "î" :string)
+(merge-rule "\IeC {\~"\i }" "ï" :string)
+(merge-rule "\IeC {\i }" "ı" :string)
+(merge-rule "\IeC {\^\j }" "ĵ" :string)
+(merge-rule "\IeC {\k {}}" "˛" :string)
+(merge-rule "\IeC {\l }" "ł" :string)
+(merge-rule "\IeC {\L }" "Ł" :string)
+(merge-rule "\IeC {\nobreakspace }" " " :string)
+(merge-rule "\IeC {\o }" "ø" :string)
+(merge-rule "\IeC {\O }" "Ø" :string)
+(merge-rule "\IeC {\textsterling }" "£" :string)
+(merge-rule "\IeC {\textparagraph }" "¶" :string)
+(merge-rule "\IeC {\ss }" "ß" :string)
+(merge-rule "\IeC {\textsection }" "§" :string)
+(merge-rule "\IeC {\textbrokenbar }" "¦" :string)
+(merge-rule "\IeC {\textcent }" "¢" :string)
+(merge-rule "\IeC {\textcurrency }" "¤" :string)
+(merge-rule "\IeC {\textdegree }" "°" :string)
+(merge-rule "\IeC {\textexclamdown }" "¡" :string)
+(merge-rule "\IeC {\texthbar }" "ħ" :string)
+(merge-rule "\IeC {\textHbar }" "Ħ" :string)
+(merge-rule "\IeC {\textonehalf }" "½" :string)
+(merge-rule "\IeC {\textonequarter }" "¼" :string)
+(merge-rule "\IeC {\textordfeminine }" "ª" :string)
+(merge-rule "\IeC {\textordmasculine }" "º" :string)
+(merge-rule "\IeC {\textperiodcentered }" "·" :string)
+(merge-rule "\IeC {\textquestiondown }" "¿" :string)
+(merge-rule "\IeC {\textregistered }" "®" :string)
+(merge-rule "\IeC {\textthreequarters }" "¾" :string)
+(merge-rule "\IeC {\textyen }" "¥" :string)
+(merge-rule "\IeC {\th }" "þ" :string)
+(merge-rule "\IeC {\TH }" "Þ" :string)
+(merge-rule "\IeC {\'I}" "Í" :string)
+(merge-rule "\IeC {\`I}" "Ì" :string)
+(merge-rule "\IeC {\^I}" "Î" :string)
+(merge-rule "\IeC {\~"I}" "Ï" :string)
+(merge-rule "\IeC {\.I}" "İ" :string)
+(merge-rule "\IeC {\^J}" "Ĵ" :string)
+(merge-rule "\IeC {\k a}" "ą" :string)
+(merge-rule "\IeC {\k A}" "Ą" :string)
+(merge-rule "\IeC {\k e}" "ę" :string)
+(merge-rule "\IeC {\k E}" "Ę" :string)
+(merge-rule "\IeC {\'l}" "ĺ" :string)
+(merge-rule "\IeC {\'L}" "Ĺ" :string)
+(merge-rule "\IeC {\textlnot }" "¬" :string)
+(merge-rule "\IeC {\textmu }" "µ" :string)
+(merge-rule "\IeC {\'n}" "ń" :string)
+(merge-rule "\IeC {\'N}" "Ń" :string)
+(merge-rule "\IeC {\~~n}" "ñ" :string)
+(merge-rule "\IeC {\~~N}" "Ñ" :string)
+(merge-rule "\IeC {\'o}" "ó" :string)
+(merge-rule "\IeC {\'O}" "Ó" :string)
+(merge-rule "\IeC {\`o}" "ò" :string)
+(merge-rule "\IeC {\`O}" "Ò" :string)
+(merge-rule "\IeC {\^o}" "ô" :string)
+(merge-rule "\IeC {\^O}" "Ô" :string)
+(merge-rule "\IeC {\~"o}" "ö" :string)
+(merge-rule "\IeC {\~"O}" "Ö" :string)
+(merge-rule "\IeC {\~~o}" "õ" :string)
+(merge-rule "\IeC {\~~O}" "Õ" :string)
+(merge-rule "\IeC {\textpm }" "±" :string)
+(merge-rule "\IeC {\r a}" "å" :string)
+(merge-rule "\IeC {\r A}" "Å" :string)
+(merge-rule "\IeC {\'r}" "ŕ" :string)
+(merge-rule "\IeC {\'R}" "Ŕ" :string)
+(merge-rule "\IeC {\r u}" "ů" :string)
+(merge-rule "\IeC {\r U}" "Ů" :string)
+(merge-rule "\IeC {\'s}" "ś" :string)
+(merge-rule "\IeC {\'S}" "Ś" :string)
+(merge-rule "\IeC {\^s}" "ŝ" :string)
+(merge-rule "\IeC {\^S}" "Ŝ" :string)
+(merge-rule "\IeC {\textasciidieresis }" "¨" :string)
+(merge-rule "\IeC {\textasciimacron }" "¯" :string)
+(merge-rule "\IeC {\.{}}" "˙" :string)
+(merge-rule "\IeC {\textasciiacute }" "´" :string)
+(merge-rule "\IeC {\texttimes }" "×" :string)
+(merge-rule "\IeC {\u a}" "ă" :string)
+(merge-rule "\IeC {\u A}" "Ă" :string)
+(merge-rule "\IeC {\u g}" "ğ" :string)
+(merge-rule "\IeC {\u G}" "Ğ" :string)
+(merge-rule "\IeC {\textasciibreve }" "˘" :string)
+(merge-rule "\IeC {\'u}" "ú" :string)
+(merge-rule "\IeC {\'U}" "Ú" :string)
+(merge-rule "\IeC {\`u}" "ù" :string)
+(merge-rule "\IeC {\`U}" "Ù" :string)
+(merge-rule "\IeC {\^u}" "û" :string)
+(merge-rule "\IeC {\^U}" "Û" :string)
+(merge-rule "\IeC {\~"u}" "ü" :string)
+(merge-rule "\IeC {\~"U}" "Ü" :string)
+(merge-rule "\IeC {\u u}" "ŭ" :string)
+(merge-rule "\IeC {\u U}" "Ŭ" :string)
+(merge-rule "\IeC {\v c}" "č" :string)
+(merge-rule "\IeC {\v C}" "Č" :string)
+(merge-rule "\IeC {\v d}" "ď" :string)
+(merge-rule "\IeC {\v D}" "Ď" :string)
+(merge-rule "\IeC {\v e}" "ě" :string)
+(merge-rule "\IeC {\v E}" "Ě" :string)
+(merge-rule "\IeC {\v l}" "ľ" :string)
+(merge-rule "\IeC {\v L}" "Ľ" :string)
+(merge-rule "\IeC {\v n}" "ň" :string)
+(merge-rule "\IeC {\v N}" "Ň" :string)
+(merge-rule "\IeC {\v r}" "ř" :string)
+(merge-rule "\IeC {\v R}" "Ř" :string)
+(merge-rule "\IeC {\v s}" "š" :string)
+(merge-rule "\IeC {\v S}" "Š" :string)
+(merge-rule "\IeC {\textasciicaron }" "ˇ" :string)
+(merge-rule "\IeC {\v t}" "ť" :string)
+(merge-rule "\IeC {\v T}" "Ť" :string)
+(merge-rule "\IeC {\v z}" "ž" :string)
+(merge-rule "\IeC {\v Z}" "Ž" :string)
+(merge-rule "\IeC {\'y}" "ý" :string)
+(merge-rule "\IeC {\'Y}" "Ý" :string)
+(merge-rule "\IeC {\~"y}" "ÿ" :string)
+(merge-rule "\IeC {\'z}" "ź" :string)
+(merge-rule "\IeC {\'Z}" "Ź" :string)
+(merge-rule "\IeC {\.z}" "ż" :string)
+(merge-rule "\IeC {\.Z}" "Ż" :string)
+;; letters not in Latin1, 2, 3 but available in TeX T1 font encoding
+(merge-rule "\IeC {\~"Y}" "Ÿ" :string)
+(merge-rule "\IeC {\NG }" "Ŋ" :string)
+(merge-rule "\IeC {\ng }" "ŋ" :string)
+(merge-rule "\IeC {\OE }" "Œ" :string)
+(merge-rule "\IeC {\oe }" "œ" :string)
+(merge-rule "\IeC {\IJ }" "Ĳ" :string)
+(merge-rule "\IeC {\ij }" "ĳ" :string)
+(merge-rule "\IeC {\j }" "ȷ" :string)
+(merge-rule "\IeC {\SS }" "ẞ" :string)
@@ -0,0 +1,607 @@
+;; style file for xindy
+;; filename: LatinRules.xdy
+;;
+;; It is based upon xindy's files lang/general/utf8.xdy and
+;; lang/general/utf8-lang.xdy which implement
+;; "a general sorting order for Western European languages"
+;;
+;; The aim for Sphinx is to be able to index in a Cyrillic document
+;; also terms using the Latin alphabets, inclusive of letters
+;; with diacritics.  To this effect the xindy rules from lang/general
+;; got manually re-coded to avoid collisions with the encoding
+;; done by xindy for sorting words in Cyrillic languages, which was
+;; observed not to use bytes with octal encoding 0o266 or higher.
+;;
+;; So here we use only 0o266 or higher bytes.
+;; (ÅŠ, Å‹, Ä², and Ä³ are absent from
+;; lang/general/utf8.xdy and not included here)
+;; Contributed by the Sphinx team, 2018.
+
+(define-letter-group "A" :prefixes ("¶"))
+(define-letter-group "B" :after "A" :prefixes ("·"))
+(define-letter-group "C" :after "B" :prefixes ("¸"))
+(define-letter-group "D" :after "C" :prefixes ("¹"))
+(define-letter-group "E" :after "D" :prefixes ("º"))
+(define-letter-group "F" :after "E" :prefixes ("»"))
+(define-letter-group "G" :after "F" :prefixes ("¼"))
+(define-letter-group "H" :after "G" :prefixes ("½"))
+(define-letter-group "I" :after "H" :prefixes ("¾"))
+(define-letter-group "J" :after "I" :prefixes ("¿"))
+(define-letter-group "K" :after "J" :prefixes ("À"))
+(define-letter-group "L" :after "K" :prefixes ("Á"))
+(define-letter-group "M" :after "L" :prefixes ("Â"))
+(define-letter-group "N" :after "M" :prefixes ("Ã"))
+(define-letter-group "O" :after "N" :prefixes ("Ä"))
+(define-letter-group "P" :after "O" :prefixes ("È"))
+(define-letter-group "Q" :after "P" :prefixes ("Ê"))
+(define-letter-group "R" :after "Q" :prefixes ("Ë"))
+(define-letter-group "S" :after "R" :prefixes ("Ð"))
+(define-letter-group "T" :after "S" :prefixes ("Ú"))
+(define-letter-group "U" :after "T" :prefixes ("à"))
+(define-letter-group "V" :after "U" :prefixes ("å"))
+(define-letter-group "W" :after "V" :prefixes ("æ"))
+(define-letter-group "X" :after "W" :prefixes ("ë"))
+(define-letter-group "Y" :after "X" :prefixes ("í"))
+(define-letter-group "Z" :after "Y" :prefixes ("ð"))
+
+(define-rule-set "sphinx-xy-alphabetize"
+
+  :rules  (("Ã€" "¶" :string)
+           ("Ä‚" "¶" :string)
+           ("Ã¢" "¶" :string)
+           ("Ã„" "¶" :string)
+           ("Ã " "¶" :string)
+           ("Ã…" "¶" :string)
+           ("Ãƒ" "¶" :string)
+           ("Ã�" "¶" :string)
+           ("Ã¡" "¶" :string)
+           ("Ã£" "¶" :string)
+           ("Ã‚" "¶" :string)
+           ("Äƒ" "¶" :string)
+           ("Ã¥" "¶" :string)
+           ("Ä…" "¶" :string)
+           ("Ã¤" "¶" :string)
+           ("Ä„" "¶" :string)
+           ("Ã¦" "¶º" :string)
+           ("Ã†" "¶º" :string)
+           ("Ä‡" "¸" :string)
+           ("Ä‰" "¸" :string)
+           ("Ã§" "¸" :string)
+           ("ÄŒ" "¸" :string)
+           ("Ä�" "¸" :string)
+           ("Äˆ" "¸" :string)
+           ("Ã‡" "¸" :string)
+           ("Ä†" "¸" :string)
+           ("Ä�" "¹" :string)
+           ("Ä�" "¹" :string)
+           ("ÄŽ" "¹" :string)
+           ("Ä‘" "¹" :string)
+           ("Ãª" "º" :string)
+           ("Ä˜" "º" :string)
+           ("Äš" "º" :string)
+           ("Ã«" "º" :string)
+           ("Ä›" "º" :string)
+           ("Ã©" "º" :string)
+           ("Ãˆ" "º" :string)
+           ("Ã‹" "º" :string)
+           ("Ã‰" "º" :string)
+           ("Ã¨" "º" :string)
+           ("ÃŠ" "º" :string)
+           ("Ä™" "º" :string)
+           ("Ä�" "¼" :string)
+           ("ÄŸ" "¼" :string)
+           ("Äž" "¼" :string)
+           ("Äœ" "¼" :string)
+           ("Ä¥" "½" :string)
+           ("Ä¤" "½" :string)
+           ("Ã�" "¾" :string)
+           ("Ã�" "¾" :string)
+           ("Ã¯" "¾" :string)
+           ("ÃŽ" "¾" :string)
+           ("Ã®" "¾" :string)
+           ("Ä±" "¾" :string)
+           ("Ä°" "¾" :string)
+           ("Ã" "¾" :string)
+           ("ÃŒ" "¾" :string)
+           ("Ã¬" "¾" :string)
+           ("Ä´" "¿" :string)
+           ("Äµ" "¿" :string)
+           ("Å‚" "Á" :string)
+           ("Å�" "Á" :string)
+           ("Ä¾" "Á" :string)
+           ("Ä½" "Á" :string)
+           ("Å„" "Ã" :string)
+           ("Åƒ" "Ã" :string)
+           ("Ã±" "Ã" :string)
+           ("Åˆ" "Ã" :string)
+           ("Ã‘" "Ã" :string)
+           ("Å‡" "Ã" :string)
+           ("Ã•" "Ä" :string)
+           ("Å�" "Ä" :string)
+           ("Ã³" "Ä" :string)
+           ("Ã¶" "Ä" :string)
+           ("Ã´" "Ä" :string)
+           ("Å‘" "Ä" :string)
+           ("Ã˜" "Ä" :string)
+           ("Ã–" "Ä" :string)
+           ("Ãµ" "Ä" :string)
+           ("Ã”" "Ä" :string)
+           ("Ã¸" "Ä" :string)
+           ("Ã“" "Ä" :string)
+           ("Ã’" "Ä" :string)
+           ("Ã²" "Ä" :string)
+           ("Å“" "Äº" :string)
+           ("Å’" "Äº" :string)
+           ("Å˜" "Ë" :string)
+           ("Å™" "Ë" :string)
+           ("Å”" "Ë" :string)
+           ("Å•" "Ë" :string)
+           ("Å�" "Ð" :string)
+           ("Åš" "Ð" :string)
+           ("È™" "Ð" :string)
+           ("ÅŸ" "Ð" :string)
+           ("Åœ" "Ð" :string)
+           ("Å›" "Ð" :string)
+           ("È˜" "Ð" :string)
+           ("Å¡" "Ð" :string)
+           ("Åž" "Ð" :string)
+           ("Å " "Ð" :string)
+           ("ÃŸ" "ÐÐ" :string)
+           ("Èš" "Ú" :string)
+           ("Å¤" "Ú" :string)
+           ("È›" "Ú" :string)
+           ("Å¥" "Ú" :string)
+           ("Ã»" "à" :string)
+           ("Å" "à" :string)
+           ("Å¯" "à" :string)
+           ("Å±" "à" :string)
+           ("Ã¹" "à" :string)
+           ("Å¬" "à" :string)
+           ("Ã™" "à" :string)
+           ("Å°" "à" :string)
+           ("Ãœ" "à" :string)
+           ("Å®" "à" :string)
+           ("Ãº" "à" :string)
+           ("Ãš" "à" :string)
+           ("Ã›" "à" :string)
+           ("Ã¼" "à" :string)
+           ("Ã¿" "í" :string)
+           ("Ã�" "í" :string)
+           ("Å¸" "í" :string)
+           ("Ã½" "í" :string)
+           ("Å»" "ð" :string)
+           ("Å½" "ð" :string)
+           ("Å¹" "ð" :string)
+           ("Å¾" "ð" :string)
+           ("Å¼" "ð" :string)
+           ("Åº" "ð" :string)
+           ("a" "¶" :string)
+           ("A" "¶" :string)
+           ("b" "·" :string)
+           ("B" "·" :string)
+           ("c" "¸" :string)
+           ("C" "¸" :string)
+           ("d" "¹" :string)
+           ("D" "¹" :string)
+           ("e" "º" :string)
+           ("E" "º" :string)
+           ("F" "»" :string)
+           ("f" "»" :string)
+           ("G" "¼" :string)
+           ("g" "¼" :string)
+           ("H" "½" :string)
+           ("h" "½" :string)
+           ("i" "¾" :string)
+           ("I" "¾" :string)
+           ("J" "¿" :string)
+           ("j" "¿" :string)
+           ("K" "À" :string)
+           ("k" "À" :string)
+           ("L" "Á" :string)
+           ("l" "Á" :string)
+           ("M" "Â" :string)
+           ("m" "Â" :string)
+           ("n" "Ã" :string)
+           ("N" "Ã" :string)
+           ("O" "Ä" :string)
+           ("o" "Ä" :string)
+           ("p" "È" :string)
+           ("P" "È" :string)
+           ("Q" "Ê" :string)
+           ("q" "Ê" :string)
+           ("r" "Ë" :string)
+           ("R" "Ë" :string)
+           ("S" "Ð" :string)
+           ("s" "Ð" :string)
+           ("t" "Ú" :string)
+           ("T" "Ú" :string)
+           ("u" "à" :string)
+           ("U" "à" :string)
+           ("v" "å" :string)
+           ("V" "å" :string)
+           ("W" "æ" :string)
+           ("w" "æ" :string)
+           ("x" "ë" :string)
+           ("X" "ë" :string)
+           ("Y" "í" :string)
+           ("y" "í" :string)
+           ("z" "ð" :string)
+           ("Z" "ð" :string)
+           ))
+
+(define-rule-set "sphinx-xy-resolve-diacritics"
+
+  :rules  (("Ä¤" "£" :string)
+           ("Ã³" "£" :string)
+           ("Ä¾" "£" :string)
+           ("Å˜" "£" :string)
+           ("Ä�" "£" :string)
+           ("Ä�" "£" :string)
+           ("Äš" "£" :string)
+           ("Ä¥" "£" :string)
+           ("ÄŒ" "£" :string)
+           ("Ä´" "£" :string)
+           ("Ä›" "£" :string)
+           ("Å¾" "£" :string)
+           ("ÄŽ" "£" :string)
+           ("Å™" "£" :string)
+           ("Å½" "£" :string)
+           ("Ä±" "£" :string)
+           ("Å¤" "£" :string)
+           ("Ã¡" "£" :string)
+           ("Ä�" "£" :string)
+           ("Ã�" "£" :string)
+           ("Åˆ" "£" :string)
+           ("Å " "£" :string)
+           ("Å‡" "£" :string)
+           ("Äµ" "£" :string)
+           ("Å¥" "£" :string)
+           ("Ã“" "£" :string)
+           ("Ã½" "£" :string)
+           ("Äœ" "£" :string)
+           ("Ãš" "£" :string)
+           ("Ä½" "£" :string)
+           ("Å¡" "£" :string)
+           ("Ã�" "£" :string)
+           ("Ãº" "£" :string)
+           ("Åš" "¤" :string)
+           ("Ä‡" "¤" :string)
+           ("Å�" "¤" :string)
+           ("Å‚" "¤" :string)
+           ("Å„" "¤" :string)
+           ("Ã€" "¤" :string)
+           ("Å¹" "¤" :string)
+           ("Ã " "¤" :string)
+           ("Åƒ" "¤" :string)
+           ("Ä�" "¤" :string)
+           ("Ã¿" "¤" :string)
+           ("Å›" "¤" :string)
+           ("Äž" "¤" :string)
+           ("ÄŸ" "¤" :string)
+           ("Ã™" "¤" :string)
+           ("Ä°" "¤" :string)
+           ("Ä‘" "¤" :string)
+           ("Ã¹" "¤" :string)
+           ("Èš" "¤" :string)
+           ("Ã©" "¤" :string)
+           ("Å•" "¤" :string)
+           ("Ä†" "¤" :string)
+           ("È›" "¤" :string)
+           ("Ã²" "¤" :string)
+           ("Åº" "¤" :string)
+           ("Ã’" "¤" :string)
+           ("Å¸" "¤" :string)
+           ("Å”" "¤" :string)
+           ("Ã‰" "¤" :string)
+           ("Ä‰" "¥" :string)
+           ("Ã´" "¥" :string)
+           ("Ã�" "¥" :string)
+           ("Å�" "¥" :string)
+           ("Å»" "¥" :string)
+           ("Ä‚" "¥" :string)
+           ("Åœ" "¥" :string)
+           ("Ã±" "¥" :string)
+           ("Å" "¥" :string)
+           ("Ã" "¥" :string)
+           ("Ãˆ" "¥" :string)
+           ("Ã”" "¥" :string)
+           ("Å¬" "¥" :string)
+           ("Å¼" "¥" :string)
+           ("Ã‘" "¥" :string)
+           ("Ã¨" "¥" :string)
+           ("Äˆ" "¥" :string)
+           ("Äƒ" "¥" :string)
+           ("Ã¢" "¦" :string)
+           ("Ã»" "¦" :string)
+           ("Ãª" "¦" :string)
+           ("Ã•" "¦" :string)
+           ("Ãµ" "¦" :string)
+           ("È™" "¦" :string)
+           ("Ã§" "¦" :string)
+           ("Ã‚" "¦" :string)
+           ("ÃŠ" "¦" :string)
+           ("Ã›" "¦" :string)
+           ("Ã‡" "¦" :string)
+           ("Ã¬" "¦" :string)
+           ("ÃŒ" "¦" :string)
+           ("È˜" "¦" :string)
+           ("Ã¶" "§" :string)
+           ("Ã–" "§" :string)
+           ("ÅŸ" "§" :string)
+           ("Å¯" "§" :string)
+           ("Ã«" "§" :string)
+           ("Ã£" "§" :string)
+           ("Ã®" "§" :string)
+           ("ÃŽ" "§" :string)
+           ("Ãƒ" "§" :string)
+           ("Åž" "§" :string)
+           ("Å®" "§" :string)
+           ("Ã‹" "§" :string)
+           ("Ã¯" "¨" :string)
+           ("Å�" "¨" :string)
+           ("Ã�" "¨" :string)
+           ("Ä˜" "¨" :string)
+           ("Å‘" "¨" :string)
+           ("Ãœ" "¨" :string)
+           ("Ã…" "¨" :string)
+           ("Ã¼" "¨" :string)
+           ("Ä™" "¨" :string)
+           ("Ã¥" "¨" :string)
+           ("Ã„" "©" :string)
+           ("Å±" "©" :string)
+           ("Ã˜" "©" :string)
+           ("Ã¸" "©" :string)
+           ("Å°" "©" :string)
+           ("Ã¤" "©" :string)
+           ("Ä„" "ª" :string)
+           ("Ä…" "ª" :string)
+           ("Å“" "ÿ" :string)
+           ("ÃŸ" "ÿ" :string)
+           ("Ã†" "ÿ" :string)
+           ("Å’" "ÿ" :string)
+           ("Ã¦" "ÿ" :string)
+           ("e" "¢" :string)
+           ("t" "¢" :string)
+           ("L" "¢" :string)
+           ("Y" "¢" :string)
+           ("J" "¢" :string)
+           ("a" "¢" :string)
+           ("p" "¢" :string)
+           ("u" "¢" :string)
+           ("j" "¢" :string)
+           ("b" "¢" :string)
+           ("G" "¢" :string)
+           ("U" "¢" :string)
+           ("F" "¢" :string)
+           ("H" "¢" :string)
+           ("i" "¢" :string)
+           ("z" "¢" :string)
+           ("c" "¢" :string)
+           ("l" "¢" :string)
+           ("A" "¢" :string)
+           ("Q" "¢" :string)
+           ("w" "¢" :string)
+           ("D" "¢" :string)
+           ("R" "¢" :string)
+           ("d" "¢" :string)
+           ("s" "¢" :string)
+           ("r" "¢" :string)
+           ("k" "¢" :string)
+           ("v" "¢" :string)
+           ("m" "¢" :string)
+           ("P" "¢" :string)
+           ("y" "¢" :string)
+           ("K" "¢" :string)
+           ("q" "¢" :string)
+           ("S" "¢" :string)
+           ("I" "¢" :string)
+           ("C" "¢" :string)
+           ("M" "¢" :string)
+           ("Z" "¢" :string)
+           ("T" "¢" :string)
+           ("W" "¢" :string)
+           ("B" "¢" :string)
+           ("h" "¢" :string)
+           ("x" "¢" :string)
+           ("X" "¢" :string)
+           ("f" "¢" :string)
+           ("E" "¢" :string)
+           ("V" "¢" :string)
+           ("N" "¢" :string)
+           ("O" "¢" :string)
+           ("o" "¢" :string)
+           ("g" "¢" :string)
+           ("n" "¢" :string)
+           ))
+
+(define-rule-set "sphinx-xy-resolve-case"
+
+  :rules  (("Ãš" "8" :string)
+           ("Å¸" "8" :string)
+           ("Ã‡" "8" :string)
+           ("Äˆ" "8" :string)
+           ("Å”" "8" :string)
+           ("Ä½" "8" :string)
+           ("Å®" "8" :string)
+           ("Ã�" "8" :string)
+           ("Ã‰" "8" :string)
+           ("Ã‹" "8" :string)
+           ("È˜" "8" :string)
+           ("ÃŒ" "8" :string)
+           ("ÃŠ" "8" :string)
+           ("Å‡" "8" :string)
+           ("Ä„" "8" :string)
+           ("Å " "8" :string)
+           ("Ã›" "8" :string)
+           ("Åž" "8" :string)
+           ("Ä†" "8" :string)
+           ("Ã’" "8" :string)
+           ("Äœ" "8" :string)
+           ("Ã‘" "8" :string)
+           ("Ã“" "8" :string)
+           ("ÃŽ" "8" :string)
+           ("Ã�" "8" :string)
+           ("Ãƒ" "8" :string)
+           ("Èš" "8" :string)
+           ("Ã…" "8" :string)
+           ("Äž" "8" :string)
+           ("Ãœ" "8" :string)
+           ("Ãˆ" "8" :string)
+           ("Ã”" "8" :string)
+           ("Ä°" "8" :string)
+           ("Å°" "8" :string)
+           ("Ã™" "8" :string)
+           ("Å¬" "8" :string)
+           ("Ã‚" "8" :string)
+           ("Å¤" "8" :string)
+           ("Åƒ" "8" :string)
+           ("ÄŽ" "8" :string)
+           ("Å¹" "8" :string)
+           ("Å½" "8" :string)
+           ("Ä�" "8" :string)
+           ("Åœ" "8" :string)
+           ("ÄŒ" "8" :string)
+           ("Ä´" "8" :string)
+           ("Ã–" "8" :string)
+           ("Ã˜" "8" :string)
+           ("Å»" "8" :string)
+           ("Å�" "8" :string)
+           ("Ä‚" "8" :string)
+           ("Äš" "8" :string)
+           ("Å�" "8" :string)
+           ("Ã•" "8" :string)
+           ("Ä˜" "8" :string)
+           ("Ã�" "8" :string)
+           ("Ã€" "8" :string)
+           ("Ä¤" "8" :string)
+           ("Ã„" "8" :string)
+           ("Åš" "8" :string)
+           ("Å˜" "8" :string)
+           ("Ã�" "8" :string)
+           ("Å’" "89" :string)
+           ("Ã†" "89" :string)
+           ("Ã¬" "9" :string)
+           ("Ã¨" "9" :string)
+           ("Ä…" "9" :string)
+           ("Å¡" "9" :string)
+           ("Ãº" "9" :string)
+           ("Ã¥" "9" :string)
+           ("Äƒ" "9" :string)
+           ("Ä™" "9" :string)
+           ("Ã¼" "9" :string)
+           ("Åº" "9" :string)
+           ("Ã²" "9" :string)
+           ("Å¥" "9" :string)
+           ("È›" "9" :string)
+           ("Äµ" "9" :string)
+           ("Å•" "9" :string)
+           ("Å¼" "9" :string)
+           ("Ã¤" "9" :string)
+           ("Ã½" "9" :string)
+           ("Ã¹" "9" :string)
+           ("Ã¡" "9" :string)
+           ("Ã©" "9" :string)
+           ("Ä�" "9" :string)
+           ("Åˆ" "9" :string)
+           ("Å›" "9" :string)
+           ("Ã¸" "9" :string)
+           ("Ã" "9" :string)
+           ("Ä‘" "9" :string)
+           ("Ä±" "9" :string)
+           ("ÄŸ" "9" :string)
+           ("Ã®" "9" :string)
+           ("Ã£" "9" :string)
+           ("Ã " "9" :string)
+           ("Å™" "9" :string)
+           ("Å‘" "9" :string)
+           ("Å¯" "9" :string)
+           ("È™" "9" :string)
+           ("Ã¿" "9" :string)
+           ("Ã«" "9" :string)
+           ("Å" "9" :string)
+           ("Ã§" "9" :string)
+           ("Å±" "9" :string)
+           ("Ã±" "9" :string)
+           ("Ãµ" "9" :string)
+           ("Ä›" "9" :string)
+           ("ÅŸ" "9" :string)
+           ("Å¾" "9" :string)
+           ("Ä�" "9" :string)
+           ("Å�" "9" :string)
+           ("Å„" "9" :string)
+           ("Ã»" "9" :string)
+           ("Å‚" "9" :string)
+           ("Ä�" "9" :string)
+           ("Ä¥" "9" :string)
+           ("Ãª" "9" :string)
+           ("Ã´" "9" :string)
+           ("Ä‰" "9" :string)
+           ("Ã¢" "9" :string)
+           ("Ä‡" "9" :string)
+           ("Ã¯" "9" :string)
+           ("Ã¶" "9" :string)
+           ("Ä¾" "9" :string)
+           ("Ã³" "9" :string)
+           ("Ã¦" "99" :string)
+           ("ÃŸ" "99" :string)
+           ("Å“" "99" :string)
+           ("N" "8" :string)
+           ("V" "8" :string)
+           ("O" "8" :string)
+           ("X" "8" :string)
+           ("E" "8" :string)
+           ("P" "8" :string)
+           ("K" "8" :string)
+           ("T" "8" :string)
+           ("Z" "8" :string)
+           ("M" "8" :string)
+           ("C" "8" :string)
+           ("I" "8" :string)
+           ("S" "8" :string)
+           ("B" "8" :string)
+           ("W" "8" :string)
+           ("D" "8" :string)
+           ("R" "8" :string)
+           ("H" "8" :string)
+           ("F" "8" :string)
+           ("Q" "8" :string)
+           ("A" "8" :string)
+           ("G" "8" :string)
+           ("U" "8" :string)
+           ("J" "8" :string)
+           ("Y" "8" :string)
+           ("L" "8" :string)
+           ("o" "9" :string)
+           ("n" "9" :string)
+           ("g" "9" :string)
+           ("x" "9" :string)
+           ("f" "9" :string)
+           ("y" "9" :string)
+           ("q" "9" :string)
+           ("h" "9" :string)
+           ("w" "9" :string)
+           ("s" "9" :string)
+           ("d" "9" :string)
+           ("v" "9" :string)
+           ("k" "9" :string)
+           ("r" "9" :string)
+           ("m" "9" :string)
+           ("z" "9" :string)
+           ("c" "9" :string)
+           ("i" "9" :string)
+           ("l" "9" :string)
+           ("b" "9" :string)
+           ("j" "9" :string)
+           ("a" "9" :string)
+           ("p" "9" :string)
+           ("u" "9" :string)
+           ("t" "9" :string)
+           ("e" "9" :string)
+           ))
+
+(use-rule-set :run 0
+	      :rule-set ("sphinx-xy-alphabetize"))
+(use-rule-set :run 1
+	      :rule-set ("sphinx-xy-resolve-diacritics"))
+(use-rule-set :run 2
+	      :rule-set ("sphinx-xy-resolve-case"))
@@ -0,0 +1,64 @@
+# Makefile for Sphinx LaTeX output
+
+ALLDOCS = $(basename $(wildcard *.tex))
+ALLPDF = $(addsuffix .pdf,$(ALLDOCS))
+ALLDVI = $(addsuffix .dvi,$(ALLDOCS))
+ALLXDV =
+ALLPS  = $(addsuffix .ps,$(ALLDOCS))
+
+# Prefix for archive names
+ARCHIVEPREFIX =
+# Additional LaTeX options (passed via variables in latexmkrc/latexmkjarc file)
+export LATEXOPTS ?=
+# Additional latexmk options
+LATEXMKOPTS ?=
+# format: pdf or dvi (used only by archive targets)
+FMT = pdf
+
+LATEX = latexmk -dvi
+PDFLATEX = latexmk -pdf -dvi- -ps-
+
+
+%.dvi: %.tex FORCE_MAKE
+	$(LATEX) $(LATEXMKOPTS) '$<'
+
+%.ps: %.dvi
+	dvips '$<'
+
+%.pdf: %.tex FORCE_MAKE
+	$(PDFLATEX) $(LATEXMKOPTS) '$<'
+
+all: $(ALLPDF)
+
+all-dvi: $(ALLDVI)
+
+all-ps: $(ALLPS)
+
+all-pdf: $(ALLPDF)
+
+zip: all-$(FMT)
+	mkdir $(ARCHIVEPREFIX)docs-$(FMT)
+	cp $(ALLPDF) $(ARCHIVEPREFIX)docs-$(FMT)
+	zip -q -r -9 $(ARCHIVEPREFIX)docs-$(FMT).zip $(ARCHIVEPREFIX)docs-$(FMT)
+	rm -r $(ARCHIVEPREFIX)docs-$(FMT)
+
+tar: all-$(FMT)
+	mkdir $(ARCHIVEPREFIX)docs-$(FMT)
+	cp $(ALLPDF) $(ARCHIVEPREFIX)docs-$(FMT)
+	tar cf $(ARCHIVEPREFIX)docs-$(FMT).tar $(ARCHIVEPREFIX)docs-$(FMT)
+	rm -r $(ARCHIVEPREFIX)docs-$(FMT)
+
+gz: tar
+	gzip -9 < $(ARCHIVEPREFIX)docs-$(FMT).tar > $(ARCHIVEPREFIX)docs-$(FMT).tar.gz
+
+bz2: tar
+	bzip2 -9 -k $(ARCHIVEPREFIX)docs-$(FMT).tar
+
+xz: tar
+	xz -9 -k $(ARCHIVEPREFIX)docs-$(FMT).tar
+
+clean:
+	rm -f *.log *.ind *.aux *.toc *.syn *.idx *.out *.ilg *.pla *.ps *.tar *.tar.gz *.tar.bz2 *.tar.xz $(ALLPDF) $(ALLDVI) $(ALLXDV) *.fls *.fdb_latexmk
+
+.PHONY: all all-pdf all-dvi all-ps clean zip tar gz bz2 xz
+.PHONY: FORCE_MAKE
@@ -0,0 +1,269 @@
+\NeedsTeXFormat{LaTeX2e}
+\ProvidesPackage{footnotehyper-sphinx}%
+ [2017/10/27 v1.7 hyperref aware footnote.sty for sphinx (JFB)]
+%%
+%% Package: footnotehyper-sphinx
+%% Version: based on footnotehyper.sty 2017/03/07 v1.0
+%% as available at https://www.ctan.org/pkg/footnotehyper
+%% License: the one applying to Sphinx
+%%
+%% Refer to the PDF documentation  at https://www.ctan.org/pkg/footnotehyper for
+%% the code comments.
+%%
+%% Differences:
+%% 1. a partial tabulary compatibility layer added (enough for Sphinx mark-up),
+%% 2. use of \spx@opt@BeforeFootnote from sphinx.sty,
+%% 3. use of \sphinxunactivateextrasandspace from sphinx.sty,
+%% 4. macro definition \sphinxfootnotemark,
+%% 5. macro definition \sphinxlongtablepatch
+%% 6. replaced an \undefined by \@undefined
+\DeclareOption*{\PackageWarning{footnotehyper-sphinx}{Option `\CurrentOption' is unknown}}%
+\ProcessOptions\relax
+\newbox\FNH@notes
+\newdimen\FNH@width
+\let\FNH@colwidth\columnwidth
+\newif\ifFNH@savingnotes
+\AtBeginDocument {%
+    \let\FNH@latex@footnote    \footnote
+    \let\FNH@latex@footnotetext\footnotetext
+    \let\FNH@H@@footnotetext   \@footnotetext
+    \newenvironment{savenotes}
+        {\FNH@savenotes\ignorespaces}{\FNH@spewnotes\ignorespacesafterend}%
+    \let\spewnotes      \FNH@spewnotes
+    \let\footnote       \FNH@footnote
+    \let\footnotetext   \FNH@footnotetext
+    \let\endfootnote    \FNH@endfntext
+    \let\endfootnotetext\FNH@endfntext
+    \@ifpackageloaded{hyperref}
+     {\ifHy@hyperfootnotes
+         \let\FNH@H@@footnotetext\H@@footnotetext
+      \else
+         \let\FNH@hyper@fntext\FNH@nohyp@fntext
+      \fi}%
+     {\let\FNH@hyper@fntext\FNH@nohyp@fntext}%
+}%
+\def\FNH@hyper@fntext{\FNH@fntext\FNH@hyper@fntext@i}%
+\def\FNH@nohyp@fntext{\FNH@fntext\FNH@nohyp@fntext@i}%
+\def\FNH@fntext #1{%
+  \ifx\ifmeasuring@\@undefined
+    \expandafter\@secondoftwo\else\expandafter\@firstofone\fi
+% these two lines modified for Sphinx (tabulary compatibility):
+    {\ifmeasuring@\expandafter\@gobbletwo\else\expandafter\@firstofone\fi}%
+    {\ifx\equation$\expandafter\@gobbletwo\fi #1}%$
+}%
+\long\def\FNH@hyper@fntext@i#1{%
+  \global\setbox\FNH@notes\vbox
+  {\unvbox\FNH@notes
+   \FNH@startnote
+   \@makefntext
+    {\rule\z@\footnotesep\ignorespaces
+     \ifHy@nesting\expandafter\ltx@firstoftwo
+             \else\expandafter\ltx@secondoftwo
+     \fi
+     {\expandafter\hyper@@anchor\expandafter{\Hy@footnote@currentHref}{#1}}%
+     {\Hy@raisedlink
+       {\expandafter\hyper@@anchor\expandafter{\Hy@footnote@currentHref}%
+       {\relax}}%
+      \let\@currentHref\Hy@footnote@currentHref
+      \let\@currentlabelname\@empty
+      #1}%
+     \@finalstrut\strutbox
+    }%
+   \FNH@endnote
+  }%
+}%
+\long\def\FNH@nohyp@fntext@i#1{%
+  \global\setbox\FNH@notes\vbox
+  {\unvbox\FNH@notes
+   \FNH@startnote
+   \@makefntext{\rule\z@\footnotesep\ignorespaces#1\@finalstrut\strutbox}%
+   \FNH@endnote
+  }%
+}%
+\def\FNH@startnote{%
+  \hsize\FNH@colwidth
+  \interlinepenalty\interfootnotelinepenalty
+  \reset@font\footnotesize
+  \floatingpenalty\@MM
+  \@parboxrestore
+  \protected@edef\@currentlabel{\csname p@\@mpfn\endcsname\@thefnmark}%
+  \color@begingroup
+}%
+\def\FNH@endnote{\color@endgroup}%
+\def\FNH@savenotes{%
+  \begingroup
+  \ifFNH@savingnotes\else
+    \FNH@savingnotestrue
+    \let\@footnotetext    \FNH@hyper@fntext
+    \let\@mpfootnotetext  \FNH@hyper@fntext
+    \let\H@@mpfootnotetext\FNH@nohyp@fntext
+    \FNH@width\columnwidth
+    \let\FNH@colwidth\FNH@width
+    \global\setbox\FNH@notes\box\voidb@x
+    \let\FNH@thempfn\thempfn
+    \let\FNH@mpfn\@mpfn
+    \ifx\@minipagerestore\relax\let\@minipagerestore\@empty\fi
+    \expandafter\def\expandafter\@minipagerestore\expandafter{%
+      \@minipagerestore
+      \let\thempfn\FNH@thempfn
+      \let\@mpfn\FNH@mpfn
+    }%
+  \fi
+}%
+\def\FNH@spewnotes {%
+  \endgroup
+  \ifFNH@savingnotes\else
+   \ifvoid\FNH@notes\else
+    \begingroup
+     \let\@makefntext\@empty
+     \let\@finalstrut\@gobble
+     \let\rule\@gobbletwo
+     \FNH@H@@footnotetext{\unvbox\FNH@notes}%
+    \endgroup
+   \fi
+  \fi
+}%
+\def\FNH@footnote@envname    {footnote}%
+\def\FNH@footnotetext@envname{footnotetext}%
+\def\FNH@footnote{%
+% this line added for Sphinx:
+    \spx@opt@BeforeFootnote
+    \ifx\@currenvir\FNH@footnote@envname
+        \expandafter\FNH@footnoteenv
+    \else
+        \expandafter\FNH@latex@footnote
+    \fi
+}%
+\def\FNH@footnoteenv{%
+% this line added for Sphinx (footnotes in parsed literal blocks):
+    \catcode13=5 \sphinxunactivateextrasandspace
+    \@ifnextchar[%
+      \FNH@footnoteenv@i %]
+      {\stepcounter\@mpfn
+       \protected@xdef\@thefnmark{\thempfn}%
+       \@footnotemark
+       \def\FNH@endfntext@fntext{\@footnotetext}%
+       \FNH@startfntext}%
+}%
+\def\FNH@footnoteenv@i[#1]{%
+    \begingroup
+     \csname c@\@mpfn\endcsname #1\relax
+     \unrestored@protected@xdef\@thefnmark{\thempfn}%
+    \endgroup
+    \@footnotemark
+    \def\FNH@endfntext@fntext{\@footnotetext}%
+    \FNH@startfntext
+}%
+\def\FNH@footnotetext{%
+    \ifx\@currenvir\FNH@footnotetext@envname
+        \expandafter\FNH@footnotetextenv
+    \else
+        \expandafter\FNH@latex@footnotetext
+    \fi
+}%
+\def\FNH@footnotetextenv{%
+    \@ifnextchar[%
+      \FNH@footnotetextenv@i %]
+      {\protected@xdef\@thefnmark{\thempfn}%
+       \def\FNH@endfntext@fntext{\@footnotetext}%
+       \FNH@startfntext}%
+}%
+\def\FNH@footnotetextenv@i[#1]{%
+    \begingroup
+     \csname c@\@mpfn\endcsname #1\relax
+     \unrestored@protected@xdef\@thefnmark{\thempfn}%
+    \endgroup
+    \ifFNH@savingnotes
+      \def\FNH@endfntext@fntext{\FNH@nohyp@fntext}%
+    \else
+      \def\FNH@endfntext@fntext{\FNH@H@@footnotetext}%
+    \fi
+    \FNH@startfntext
+}%
+\def\FNH@startfntext{%
+  \setbox\z@\vbox\bgroup
+    \FNH@startnote
+    \FNH@prefntext
+    \rule\z@\footnotesep\ignorespaces
+}%
+\def\FNH@endfntext {%
+    \@finalstrut\strutbox
+    \FNH@postfntext
+    \FNH@endnote
+    \egroup
+  \begingroup
+    \let\@makefntext\@empty\let\@finalstrut\@gobble\let\rule\@gobbletwo
+    \FNH@endfntext@fntext {\unvbox\z@}%
+  \endgroup
+}%
+\AtBeginDocument{%
+   \let\FNH@@makefntext\@makefntext
+   \ifx\@makefntextFB\@undefined
+   \expandafter\@gobble\else\expandafter\@firstofone\fi
+   {\ifFBFrenchFootnotes \let\FNH@@makefntext\@makefntextFB \else
+                         \let\FNH@@makefntext\@makefntextORI\fi}%
+   \expandafter\FNH@check@a\FNH@@makefntext{1.2!3?4,}%
+               \FNH@@@1.2!3?4,\FNH@@@\relax
+}%
+\long\def\FNH@check@a #11.2!3?4,#2\FNH@@@#3{%
+    \ifx\relax#3\expandafter\@firstoftwo\else\expandafter\@secondoftwo\fi
+    \FNH@bad@makefntext@alert
+    {\def\FNH@prefntext{#1}\def\FNH@postfntext{#2}\FNH@check@b}%
+}%
+\def\FNH@check@b #1\relax{%
+    \expandafter\expandafter\expandafter\FNH@check@c
+    \expandafter\meaning\expandafter\FNH@prefntext
+    \meaning\FNH@postfntext1.2!3?4,\FNH@check@c\relax
+}%
+\def\FNH@check@c #11.2!3?4,#2#3\relax{%
+    \ifx\FNH@check@c#2\expandafter\@gobble\fi\FNH@bad@makefntext@alert
+}%
+% slight reformulation for Sphinx
+\def\FNH@bad@makefntext@alert{%
+  \PackageWarningNoLine{footnotehyper-sphinx}%
+    {Footnotes will be sub-optimal, sorry. This is due to the document class or^^J
+  some package modifying macro \string\@makefntext.^^J
+  You can try to report this incompatibility at^^J
+  https://github.com/sphinx-doc/sphinx with this info:}%
+    \typeout{\meaning\@makefntext}%
+    \let\FNH@prefntext\@empty\let\FNH@postfntext\@empty
+}%
+% this macro from original footnote.sty is not used anymore by Sphinx
+% but for simplicity sake let's just keep it as is
+\def\makesavenoteenv{\@ifnextchar[\FNH@msne@ii\FNH@msne@i}%]
+\def\FNH@msne@i #1{%
+  \expandafter\let\csname FNH$#1\expandafter\endcsname %$
+                  \csname #1\endcsname
+  \expandafter\let\csname endFNH$#1\expandafter\endcsname %$
+                  \csname end#1\endcsname
+  \FNH@msne@ii[#1]{FNH$#1}%$
+}%
+\def\FNH@msne@ii[#1]#2{%
+  \expandafter\edef\csname#1\endcsname{%
+    \noexpand\savenotes
+    \expandafter\noexpand\csname#2\endcsname
+  }%
+  \expandafter\edef\csname end#1\endcsname{%
+    \expandafter\noexpand\csname end#2\endcsname
+    \noexpand\expandafter
+    \noexpand\spewnotes
+    \noexpand\if@endpe\noexpand\@endpetrue\noexpand\fi
+  }%
+}%
+% end of footnotehyper 2017/02/16 v0.99
+% some extras for Sphinx :
+% \sphinxfootnotemark: usable in section titles and silently removed from TOCs.
+\def\sphinxfootnotemark [#1]%
+   {\ifx\thepage\relax\else\protect\spx@opt@BeforeFootnote
+                             \protect\footnotemark[#1]\fi}%
+\AtBeginDocument{%
+   % let hyperref less complain
+   \pdfstringdefDisableCommands{\def\sphinxfootnotemark [#1]{}}%
+   % to obtain hyperlinked footnotes in longtable environment we must replace
+   % hyperref's patch of longtable's patch of \@footnotetext by our own
+   \let\LT@p@ftntext\FNH@hyper@fntext
+   % this *requires* longtable to be used always wrapped in savenotes environment
+}%
+\endinput
+%%
+%% End of file `footnotehyper-sphinx.sty'.
@@ -0,0 +1,2 @@
+
+<meta http-equiv="Refresh" content="0; url=chapter1.html" />
@@ -0,0 +1,22 @@
+$latex = 'pdflatex ' . $ENV{'LATEXOPTS'} . ' -kanji=utf8 %O %S';
+$dvipdf = 'dvipdfmx %O -o %D %S';
+$makeindex = 'internal mendex %S %B %D';
+sub mendex {
+  my ($source, $basename, $destination) = @_;
+  my $dictfile = $basename . ".dic";
+  unlink($destination);
+  system("mendex", "-U", "-f", "-d", $dictfile, "-s", "python.ist", $source);
+  if ($? > 0) {
+    print("mendex exited with error code $? (ignored)\n");
+  }
+  if (!-e $destination) {
+    # create an empty .ind file if nothing
+    open(FH, ">" . $destination);
+    close(FH);
+  }
+  return 0;
+}
+add_cus_dep( "glo", "gls", 0, "makeglo" );
+sub makeglo {
+ return system( "mendex -J -f -s gglo.ist -o '$_[0].gls' '$_[0].glo'" );
+}
@@ -0,0 +1,9 @@
+$latex = 'latex ' . $ENV{'LATEXOPTS'} . ' %O %S';
+$pdflatex = 'pdflatex ' . $ENV{'LATEXOPTS'} . ' %O %S';
+$lualatex = 'lualatex ' . $ENV{'LATEXOPTS'} . ' %O %S';
+$xelatex = 'xelatex --no-pdf ' . $ENV{'LATEXOPTS'} . ' %O %S';
+$makeindex = 'makeindex -s python.ist %O -o %D %S';
+add_cus_dep( "glo", "gls", 0, "makeglo" );
+sub makeglo {
+ return system( "makeindex -s gglo.ist -o '$_[0].gls' '$_[0].glo'" );
+}
@@ -0,0 +1,31 @@
+@ECHO OFF
+
+REM Command file for Sphinx documentation
+
+pushd %~dp0
+
+set PDFLATEX=latexmk -pdf -dvi- -ps-
+
+set "LATEXOPTS= "
+
+if "%1" == "" goto all-pdf
+
+if "%1" == "all-pdf" (
+	:all-pdf
+	for %%i in (*.tex) do (
+		%PDFLATEX% %LATEXMKOPTS% %%i
+	)
+	goto end
+)
+
+if "%1" == "all-pdf-ja" (
+	goto all-pdf
+)
+
+if "%1" == "clean" (
+	del /q /s *.dvi *.log *.ind *.aux *.toc *.syn *.idx *.out *.ilg *.pla *.ps *.tar *.tar.gz *.tar.bz2 *.tar.xz *.fls *.fdb_latexmk
+	goto end
+)
+
+:end
+popd
@@ -0,0 +1,507 @@
+\relax 
+\providecommand\hyper@newdestlabel[2]{}
+\providecommand\HyperFirstAtBeginDocument{\AtBeginDocument}
+\HyperFirstAtBeginDocument{\ifx\hyper@anchor\@undefined
+\global\let\oldcontentsline\contentsline
+\gdef\contentsline#1#2#3#4{\oldcontentsline{#1}{#2}{#3}}
+\global\let\oldnewlabel\newlabel
+\gdef\newlabel#1#2{\newlabelxx{#1}#2}
+\gdef\newlabelxx#1#2#3#4#5#6{\oldnewlabel{#1}{{#2}{#3}}}
+\AtEndDocument{\ifx\hyper@anchor\@undefined
+\let\contentsline\oldcontentsline
+\let\newlabel\oldnewlabel
+\fi}
+\fi}
+\global\let\hyper@last\relax 
+\gdef\HyperFirstAtBeginDocument#1{#1}
+\providecommand\HyField@AuxAddToFields[1]{}
+\providecommand\HyField@AuxAddToCoFields[2]{}
+\select@language{english}
+\@writefile{toc}{\select@language{english}}
+\@writefile{lof}{\select@language{english}}
+\@writefile{lot}{\select@language{english}}
+\newlabel{chapter1::doc}{{}{1}{}{section*.2}{}}
+\@writefile{toc}{\contentsline {chapter}{\numberline {1}Introduction}{3}{chapter.1}}
+\@writefile{lof}{\addvspace {10\p@ }}
+\@writefile{lot}{\addvspace {10\p@ }}
+\newlabel{chapter1:introduction}{{1}{3}{Introduction}{chapter.1}{}}
+\@writefile{toc}{\contentsline {chapter}{\numberline {2}Learning outcomes}{5}{chapter.2}}
+\@writefile{lof}{\addvspace {10\p@ }}
+\@writefile{lot}{\addvspace {10\p@ }}
+\newlabel{chapter1:learning-outcomes}{{2}{5}{Learning outcomes}{chapter.2}{}}
+\@writefile{toc}{\contentsline {chapter}{\numberline {3}Machine Learning, a small (and probably biased) introduction}{7}{chapter.3}}
+\@writefile{lof}{\addvspace {10\p@ }}
+\@writefile{lot}{\addvspace {10\p@ }}
+\newlabel{chapter1:machine-learning-a-small-and-probably-biased-introduction}{{3}{7}{Machine Learning, a small (and probably biased) introduction}{chapter.3}{}}
+\@writefile{toc}{\contentsline {chapter}{\numberline {4}Machine Learning, an extremely rich field}{9}{chapter.4}}
+\@writefile{lof}{\addvspace {10\p@ }}
+\@writefile{lot}{\addvspace {10\p@ }}
+\newlabel{chapter1:machine-learning-an-extremely-rich-field}{{4}{9}{Machine Learning, an extremely rich field}{chapter.4}{}}
+\@writefile{toc}{\contentsline {chapter}{\numberline {5}A multidisciplinary approach}{11}{chapter.5}}
+\@writefile{lof}{\addvspace {10\p@ }}
+\@writefile{lot}{\addvspace {10\p@ }}
+\newlabel{chapter1:a-multidisciplinary-approach}{{5}{11}{A multidisciplinary approach}{chapter.5}{}}
+\@writefile{toc}{\contentsline {chapter}{\numberline {6}Types of Machine Learning}{13}{chapter.6}}
+\@writefile{lof}{\addvspace {10\p@ }}
+\@writefile{lot}{\addvspace {10\p@ }}
+\newlabel{chapter1:types-of-machine-learning}{{6}{13}{Types of Machine Learning}{chapter.6}{}}
+\@writefile{toc}{\contentsline {chapter}{\numberline {7}Essential elements of ML}{15}{chapter.7}}
+\@writefile{lof}{\addvspace {10\p@ }}
+\@writefile{lot}{\addvspace {10\p@ }}
+\newlabel{chapter1:essential-elements-of-ml}{{7}{15}{Essential elements of ML}{chapter.7}{}}
+\@writefile{toc}{\contentsline {chapter}{\numberline {8}An optimization/minimization problem}{17}{chapter.8}}
+\@writefile{lof}{\addvspace {10\p@ }}
+\@writefile{lot}{\addvspace {10\p@ }}
+\newlabel{chapter1:an-optimization-minimization-problem}{{8}{17}{An optimization/minimization problem}{chapter.8}{}}
+\@writefile{toc}{\contentsline {chapter}{\numberline {9}A Frequentist approach to data analysis}{19}{chapter.9}}
+\@writefile{lof}{\addvspace {10\p@ }}
+\@writefile{lot}{\addvspace {10\p@ }}
+\newlabel{chapter1:a-frequentist-approach-to-data-analysis}{{9}{19}{A Frequentist approach to data analysis}{chapter.9}{}}
+\@writefile{toc}{\contentsline {chapter}{\numberline {10}What is a good model?}{21}{chapter.10}}
+\@writefile{lof}{\addvspace {10\p@ }}
+\@writefile{lot}{\addvspace {10\p@ }}
+\newlabel{chapter1:what-is-a-good-model}{{10}{21}{What is a good model?}{chapter.10}{}}
+\@writefile{toc}{\contentsline {chapter}{\numberline {11}What is a good model? Can we define it?}{23}{chapter.11}}
+\@writefile{lof}{\addvspace {10\p@ }}
+\@writefile{lot}{\addvspace {10\p@ }}
+\newlabel{chapter1:what-is-a-good-model-can-we-define-it}{{11}{23}{What is a good model? Can we define it?}{chapter.11}{}}
+\@writefile{toc}{\contentsline {chapter}{\numberline {12}Choice of Programming Language}{25}{chapter.12}}
+\@writefile{lof}{\addvspace {10\p@ }}
+\@writefile{lot}{\addvspace {10\p@ }}
+\newlabel{chapter1:choice-of-programming-language}{{12}{25}{Choice of Programming Language}{chapter.12}{}}
+\@writefile{toc}{\contentsline {chapter}{\numberline {13}Data handling, machine learning and ethical aspects}{27}{chapter.13}}
+\@writefile{lof}{\addvspace {10\p@ }}
+\@writefile{lot}{\addvspace {10\p@ }}
+\newlabel{chapter1:data-handling-machine-learning-and-ethical-aspects}{{13}{27}{Data handling, machine learning and ethical aspects}{chapter.13}{}}
+\@writefile{toc}{\contentsline {section}{\numberline {13.1}Data Analysis and Machine Learning: Getting started, our first data and Machine Learning encounters}{28}{section.13.1}}
+\newlabel{chapter2:data-analysis-and-machine-learning-getting-started-our-first-data-and-machine-learning-encounters}{{13.1}{28}{Data Analysis and Machine Learning: Getting started, our first data and Machine Learning encounters}{section.13.1}{}}
+\newlabel{chapter2::doc}{{13.1}{28}{Data Analysis and Machine Learning: Getting started, our first data and Machine Learning encounters}{section.13.1}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.1.1}Introduction}{28}{subsection.13.1.1}}
+\newlabel{chapter2:introduction}{{13.1.1}{28}{Introduction}{subsection.13.1.1}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.1.2}What is Machine Learning?}{28}{subsection.13.1.2}}
+\newlabel{chapter2:what-is-machine-learning}{{13.1.2}{28}{What is Machine Learning?}{subsection.13.1.2}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.1.3}Types of Machine Learning}{29}{subsection.13.1.3}}
+\newlabel{chapter2:types-of-machine-learning}{{13.1.3}{29}{Types of Machine Learning}{subsection.13.1.3}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.1.4}Software and needed installations}{30}{subsection.13.1.4}}
+\newlabel{chapter2:software-and-needed-installations}{{13.1.4}{30}{Software and needed installations}{subsection.13.1.4}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.1.5}Python installers}{30}{subsection.13.1.5}}
+\newlabel{chapter2:python-installers}{{13.1.5}{30}{Python installers}{subsection.13.1.5}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.1.6}Useful Python libraries}{31}{subsection.13.1.6}}
+\newlabel{chapter2:useful-python-libraries}{{13.1.6}{31}{Useful Python libraries}{subsection.13.1.6}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.1.7}Installing R, C++, cython or Julia}{31}{subsection.13.1.7}}
+\newlabel{chapter2:installing-r-c-cython-or-julia}{{13.1.7}{31}{Installing R, C++, cython or Julia}{subsection.13.1.7}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.1.8}Installing R, C++, cython, Numba etc}{31}{subsection.13.1.8}}
+\newlabel{chapter2:installing-r-c-cython-numba-etc}{{13.1.8}{31}{Installing R, C++, cython, Numba etc}{subsection.13.1.8}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.1.9}Numpy examples and Important Matrix and vector handling packages}{32}{subsection.13.1.9}}
+\newlabel{chapter2:numpy-examples-and-important-matrix-and-vector-handling-packages}{{13.1.9}{32}{Numpy examples and Important Matrix and vector handling packages}{subsection.13.1.9}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.1.10}Basic Matrix Features}{32}{subsection.13.1.10}}
+\newlabel{chapter2:basic-matrix-features}{{13.1.10}{32}{Basic Matrix Features}{subsection.13.1.10}{}}
+\@writefile{toc}{\contentsline {subsubsection}{Some famous Matrices}{32}{subsubsection*.3}}
+\newlabel{chapter2:some-famous-matrices}{{13.1.10}{32}{Some famous Matrices}{subsubsection*.3}{}}
+\@writefile{toc}{\contentsline {subsubsection}{More Basic Matrix Features}{33}{subsubsection*.4}}
+\newlabel{chapter2:more-basic-matrix-features}{{13.1.10}{33}{More Basic Matrix Features}{subsubsection*.4}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.1.11}Numpy and arrays}{33}{subsection.13.1.11}}
+\newlabel{chapter2:numpy-and-arrays}{{13.1.11}{33}{Numpy and arrays}{subsection.13.1.11}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.1.12}Matrices in Python}{34}{subsection.13.1.12}}
+\newlabel{chapter2:matrices-in-python}{{13.1.12}{34}{Matrices in Python}{subsection.13.1.12}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.1.13}Meet the Pandas}{38}{subsection.13.1.13}}
+\newlabel{chapter2:meet-the-pandas}{{13.1.13}{38}{Meet the Pandas}{subsection.13.1.13}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.1.14}Reading Data and fitting}{43}{subsection.13.1.14}}
+\newlabel{chapter2:reading-data-and-fitting}{{13.1.14}{43}{Reading Data and fitting}{subsection.13.1.14}{}}
+\@writefile{toc}{\contentsline {subsubsection}{Simple linear regression model using \sphinxstylestrong {scikit\sphinxhyphen {}learn}}{43}{subsubsection*.5}}
+\newlabel{chapter2:simple-linear-regression-model-using-scikit-learn}{{13.1.14}{43}{Simple linear regression model using \sphinxstylestrong {scikit\sphinxhyphen {}learn}}{subsubsection*.5}{}}
+\@writefile{toc}{\contentsline {subsubsection}{To our real data: nuclear binding energies. Brief reminder on masses and binding energies}{51}{subsubsection*.6}}
+\newlabel{chapter2:to-our-real-data-nuclear-binding-energies-brief-reminder-on-masses-and-binding-energies}{{13.1.14}{51}{To our real data: nuclear binding energies. Brief reminder on masses and binding energies}{subsubsection*.6}{}}
+\@writefile{toc}{\contentsline {subsubsection}{Organizing our data}{52}{subsubsection*.7}}
+\newlabel{chapter2:organizing-our-data}{{13.1.14}{52}{Organizing our data}{subsubsection*.7}{}}
+\@writefile{toc}{\contentsline {subsubsection}{Seeing the wood for the trees}{56}{subsubsection*.8}}
+\newlabel{chapter2:seeing-the-wood-for-the-trees}{{13.1.14}{56}{Seeing the wood for the trees}{subsubsection*.8}{}}
+\@writefile{toc}{\contentsline {subsubsection}{And what about using neural networks?}{58}{subsubsection*.9}}
+\newlabel{chapter2:and-what-about-using-neural-networks}{{13.1.14}{58}{And what about using neural networks?}{subsubsection*.9}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.1.15}A first summary}{62}{subsection.13.1.15}}
+\newlabel{chapter2:a-first-summary}{{13.1.15}{62}{A first summary}{subsection.13.1.15}{}}
+\@writefile{toc}{\contentsline {section}{\numberline {13.2}Data Analysis and Machine Learning: Elements of Probability Theory and Statistical Data Analysis}{63}{section.13.2}}
+\newlabel{chapter3:data-analysis-and-machine-learning-elements-of-probability-theory-and-statistical-data-analysis}{{13.2}{63}{Data Analysis and Machine Learning: Elements of Probability Theory and Statistical Data Analysis}{section.13.2}{}}
+\newlabel{chapter3::doc}{{13.2}{63}{Data Analysis and Machine Learning: Elements of Probability Theory and Statistical Data Analysis}{section.13.2}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.1}To do list}{63}{subsection.13.2.1}}
+\newlabel{chapter3:to-do-list}{{13.2.1}{63}{To do list}{subsection.13.2.1}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.2}Domains and probabilities}{63}{subsection.13.2.2}}
+\newlabel{chapter3:domains-and-probabilities}{{13.2.2}{63}{Domains and probabilities}{subsection.13.2.2}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.3}Tossing the dice}{63}{subsection.13.2.3}}
+\newlabel{chapter3:tossing-the-dice}{{13.2.3}{63}{Tossing the dice}{subsection.13.2.3}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.4}Stochastic variables}{63}{subsection.13.2.4}}
+\newlabel{chapter3:stochastic-variables}{{13.2.4}{63}{Stochastic variables}{subsection.13.2.4}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.5}Stochastic variables and the main concepts, the discrete case}{64}{subsection.13.2.5}}
+\newlabel{chapter3:stochastic-variables-and-the-main-concepts-the-discrete-case}{{13.2.5}{64}{Stochastic variables and the main concepts, the discrete case}{subsection.13.2.5}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.6}Stochastic variables and the main concepts, the continuous case}{64}{subsection.13.2.6}}
+\newlabel{chapter3:stochastic-variables-and-the-main-concepts-the-continuous-case}{{13.2.6}{64}{Stochastic variables and the main concepts, the continuous case}{subsection.13.2.6}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.7}The cumulative probability}{64}{subsection.13.2.7}}
+\newlabel{chapter3:the-cumulative-probability}{{13.2.7}{64}{The cumulative probability}{subsection.13.2.7}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.8}Properties of PDFs}{64}{subsection.13.2.8}}
+\newlabel{chapter3:properties-of-pdfs}{{13.2.8}{64}{Properties of PDFs}{subsection.13.2.8}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.9}Important distributions, the uniform distribution}{65}{subsection.13.2.9}}
+\newlabel{chapter3:important-distributions-the-uniform-distribution}{{13.2.9}{65}{Important distributions, the uniform distribution}{subsection.13.2.9}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.10}Gaussian distribution}{65}{subsection.13.2.10}}
+\newlabel{chapter3:gaussian-distribution}{{13.2.10}{65}{Gaussian distribution}{subsection.13.2.10}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.11}Exponential distribution}{67}{subsection.13.2.11}}
+\newlabel{chapter3:exponential-distribution}{{13.2.11}{67}{Exponential distribution}{subsection.13.2.11}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.12}Expectation values}{67}{subsection.13.2.12}}
+\newlabel{chapter3:expectation-values}{{13.2.12}{67}{Expectation values}{subsection.13.2.12}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.13}Stochastic variables and the main concepts, mean values}{67}{subsection.13.2.13}}
+\newlabel{chapter3:stochastic-variables-and-the-main-concepts-mean-values}{{13.2.13}{67}{Stochastic variables and the main concepts, mean values}{subsection.13.2.13}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.14}Stochastic variables and the main concepts, central moments, the variance}{67}{subsection.13.2.14}}
+\newlabel{chapter3:stochastic-variables-and-the-main-concepts-central-moments-the-variance}{{13.2.14}{67}{Stochastic variables and the main concepts, central moments, the variance}{subsection.13.2.14}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.15}Probability Distribution Functions}{68}{subsection.13.2.15}}
+\newlabel{chapter3:probability-distribution-functions}{{13.2.15}{68}{Probability Distribution Functions}{subsection.13.2.15}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.16}Probability Distribution Functions}{68}{subsection.13.2.16}}
+\newlabel{chapter3:id1}{{13.2.16}{68}{Probability Distribution Functions}{subsection.13.2.16}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.17}The three famous Probability Distribution Functions}{68}{subsection.13.2.17}}
+\newlabel{chapter3:the-three-famous-probability-distribution-functions}{{13.2.17}{68}{The three famous Probability Distribution Functions}{subsection.13.2.17}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.18}Probability Distribution Functions, the normal distribution}{69}{subsection.13.2.18}}
+\newlabel{chapter3:probability-distribution-functions-the-normal-distribution}{{13.2.18}{69}{Probability Distribution Functions, the normal distribution}{subsection.13.2.18}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.19}Probability Distribution Functions, the normal distribution}{69}{subsection.13.2.19}}
+\newlabel{chapter3:id2}{{13.2.19}{69}{Probability Distribution Functions, the normal distribution}{subsection.13.2.19}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.20}Probability Distribution Functions, the cumulative distribution}{69}{subsection.13.2.20}}
+\newlabel{chapter3:probability-distribution-functions-the-cumulative-distribution}{{13.2.20}{69}{Probability Distribution Functions, the cumulative distribution}{subsection.13.2.20}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.21}Probability Distribution Functions, other important distribution}{70}{subsection.13.2.21}}
+\newlabel{chapter3:probability-distribution-functions-other-important-distribution}{{13.2.21}{70}{Probability Distribution Functions, other important distribution}{subsection.13.2.21}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.22}Probability Distribution Functions, the binomial distribution}{70}{subsection.13.2.22}}
+\newlabel{chapter3:probability-distribution-functions-the-binomial-distribution}{{13.2.22}{70}{Probability Distribution Functions, the binomial distribution}{subsection.13.2.22}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.23}Probability Distribution Functions, Poisson\IeC {\textquoteright }s distribution}{70}{subsection.13.2.23}}
+\newlabel{chapter3:probability-distribution-functions-poisson-s-distribution}{{13.2.23}{70}{Probability Distribution Functions, Poisson’s distribution}{subsection.13.2.23}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.24}Probability Distribution Functions, Poisson\IeC {\textquoteright }s distribution}{71}{subsection.13.2.24}}
+\newlabel{chapter3:id3}{{13.2.24}{71}{Probability Distribution Functions, Poisson’s distribution}{subsection.13.2.24}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.25}Meet the covariance!}{71}{subsection.13.2.25}}
+\newlabel{chapter3:meet-the-covariance}{{13.2.25}{71}{Meet the covariance!}{subsection.13.2.25}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.26}Meet the covariance in matrix disguise}{71}{subsection.13.2.26}}
+\newlabel{chapter3:meet-the-covariance-in-matrix-disguise}{{13.2.26}{71}{Meet the covariance in matrix disguise}{subsection.13.2.26}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.27}Covariance}{72}{subsection.13.2.27}}
+\newlabel{chapter3:covariance}{{13.2.27}{72}{Covariance}{subsection.13.2.27}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.28}Meet the covariance, uncorrelated events}{73}{subsection.13.2.28}}
+\newlabel{chapter3:meet-the-covariance-uncorrelated-events}{{13.2.28}{73}{Meet the covariance, uncorrelated events}{subsection.13.2.28}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.29}Numerical experiments and the covariance}{73}{subsection.13.2.29}}
+\newlabel{chapter3:numerical-experiments-and-the-covariance}{{13.2.29}{73}{Numerical experiments and the covariance}{subsection.13.2.29}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.30}Numerical experiments and the covariance}{73}{subsection.13.2.30}}
+\newlabel{chapter3:id4}{{13.2.30}{73}{Numerical experiments and the covariance}{subsection.13.2.30}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.31}Numerical experiments and the covariance, actual situations}{73}{subsection.13.2.31}}
+\newlabel{chapter3:numerical-experiments-and-the-covariance-actual-situations}{{13.2.31}{73}{Numerical experiments and the covariance, actual situations}{subsection.13.2.31}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.32}Numerical experiments and the covariance, our observables}{74}{subsection.13.2.32}}
+\newlabel{chapter3:numerical-experiments-and-the-covariance-our-observables}{{13.2.32}{74}{Numerical experiments and the covariance, our observables}{subsection.13.2.32}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.33}Numerical experiments and the covariance, the sample variance}{74}{subsection.13.2.33}}
+\newlabel{chapter3:numerical-experiments-and-the-covariance-the-sample-variance}{{13.2.33}{74}{Numerical experiments and the covariance, the sample variance}{subsection.13.2.33}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.34}Numerical experiments and the covariance, central limit theorem}{75}{subsection.13.2.34}}
+\newlabel{chapter3:numerical-experiments-and-the-covariance-central-limit-theorem}{{13.2.34}{75}{Numerical experiments and the covariance, central limit theorem}{subsection.13.2.34}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.35}Definition of Correlation Functions and Standard Deviation}{75}{subsection.13.2.35}}
+\newlabel{chapter3:definition-of-correlation-functions-and-standard-deviation}{{13.2.35}{75}{Definition of Correlation Functions and Standard Deviation}{subsection.13.2.35}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.36}Definition of Correlation Functions and Standard Deviation}{75}{subsection.13.2.36}}
+\newlabel{chapter3:id5}{{13.2.36}{75}{Definition of Correlation Functions and Standard Deviation}{subsection.13.2.36}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.37}Definition of Correlation Functions and Standard Deviation}{75}{subsection.13.2.37}}
+\newlabel{chapter3:id6}{{13.2.37}{75}{Definition of Correlation Functions and Standard Deviation}{subsection.13.2.37}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.38}Definition of Correlation Functions and Standard Deviation}{76}{subsection.13.2.38}}
+\newlabel{chapter3:id7}{{13.2.38}{76}{Definition of Correlation Functions and Standard Deviation}{subsection.13.2.38}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.39}Definition of Correlation Functions and Standard Deviation, sample variance}{76}{subsection.13.2.39}}
+\newlabel{chapter3:definition-of-correlation-functions-and-standard-deviation-sample-variance}{{13.2.39}{76}{Definition of Correlation Functions and Standard Deviation, sample variance}{subsection.13.2.39}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.40}Definition of Correlation Functions and Standard Deviation}{76}{subsection.13.2.40}}
+\newlabel{chapter3:id8}{{13.2.40}{76}{Definition of Correlation Functions and Standard Deviation}{subsection.13.2.40}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.2.41}Code to compute the Covariance matrix and the Covariance}{77}{subsection.13.2.41}}
+\newlabel{chapter3:code-to-compute-the-covariance-matrix-and-the-covariance}{{13.2.41}{77}{Code to compute the Covariance matrix and the Covariance}{subsection.13.2.41}{}}
+\@writefile{toc}{\contentsline {section}{\numberline {13.3}Random Numbers}{78}{section.13.3}}
+\newlabel{chapter3:random-numbers}{{13.3}{78}{Random Numbers}{section.13.3}{}}
+\@writefile{toc}{\contentsline {section}{\numberline {13.4}Random Numbers, better name: pseudo random numbers}{78}{section.13.4}}
+\newlabel{chapter3:random-numbers-better-name-pseudo-random-numbers}{{13.4}{78}{Random Numbers, better name: pseudo random numbers}{section.13.4}{}}
+\@writefile{toc}{\contentsline {section}{\numberline {13.5}Random number generator RNG}{78}{section.13.5}}
+\newlabel{chapter3:random-number-generator-rng}{{13.5}{78}{Random number generator RNG}{section.13.5}{}}
+\@writefile{toc}{\contentsline {section}{\numberline {13.6}Random number generator RNG and periodic outputs}{78}{section.13.6}}
+\newlabel{chapter3:random-number-generator-rng-and-periodic-outputs}{{13.6}{78}{Random number generator RNG and periodic outputs}{section.13.6}{}}
+\@writefile{toc}{\contentsline {section}{\numberline {13.7}Random number generator RNG and its period}{79}{section.13.7}}
+\newlabel{chapter3:random-number-generator-rng-and-its-period}{{13.7}{79}{Random number generator RNG and its period}{section.13.7}{}}
+\@writefile{toc}{\contentsline {section}{\numberline {13.8}Random number generator RNG, other examples}{79}{section.13.8}}
+\newlabel{chapter3:random-number-generator-rng-other-examples}{{13.8}{79}{Random number generator RNG, other examples}{section.13.8}{}}
+\@writefile{toc}{\contentsline {section}{\numberline {13.9}Random number generator RNG, other examples}{79}{section.13.9}}
+\newlabel{chapter3:id9}{{13.9}{79}{Random number generator RNG, other examples}{section.13.9}{}}
+\@writefile{toc}{\contentsline {section}{\numberline {13.10}Random number generator RNG, RAN0}{80}{section.13.10}}
+\newlabel{chapter3:random-number-generator-rng-ran0}{{13.10}{80}{Random number generator RNG, RAN0}{section.13.10}{}}
+\@writefile{toc}{\contentsline {section}{\numberline {13.11}Random number generator RNG, RAN0}{80}{section.13.11}}
+\newlabel{chapter3:id10}{{13.11}{80}{Random number generator RNG, RAN0}{section.13.11}{}}
+\@writefile{toc}{\contentsline {section}{\numberline {13.12}Random number generator RNG, RAN0}{80}{section.13.12}}
+\newlabel{chapter3:id11}{{13.12}{80}{Random number generator RNG, RAN0}{section.13.12}{}}
+\@writefile{toc}{\contentsline {section}{\numberline {13.13}Random number generator RNG, RAN0}{81}{section.13.13}}
+\newlabel{chapter3:id12}{{13.13}{81}{Random number generator RNG, RAN0}{section.13.13}{}}
+\@writefile{toc}{\contentsline {section}{\numberline {13.14}Random number generator RNG, RAN0 code}{81}{section.13.14}}
+\newlabel{chapter3:random-number-generator-rng-ran0-code}{{13.14}{81}{Random number generator RNG, RAN0 code}{section.13.14}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.14.1}Properties of Selected Random Number Generators}{82}{subsection.13.14.1}}
+\newlabel{chapter3:properties-of-selected-random-number-generators}{{13.14.1}{82}{Properties of Selected Random Number Generators}{subsection.13.14.1}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.14.2}Properties of Selected Random Number Generators}{82}{subsection.13.14.2}}
+\newlabel{chapter3:id13}{{13.14.2}{82}{Properties of Selected Random Number Generators}{subsection.13.14.2}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.14.3}Properties of Selected Random Number Generators}{82}{subsection.13.14.3}}
+\newlabel{chapter3:id14}{{13.14.3}{82}{Properties of Selected Random Number Generators}{subsection.13.14.3}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.14.4}Simple demonstration of RNGs using python}{82}{subsection.13.14.4}}
+\newlabel{chapter3:simple-demonstration-of-rngs-using-python}{{13.14.4}{82}{Simple demonstration of RNGs using python}{subsection.13.14.4}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.14.5}Properties of Selected Random Number Generators}{83}{subsection.13.14.5}}
+\newlabel{chapter3:id15}{{13.14.5}{83}{Properties of Selected Random Number Generators}{subsection.13.14.5}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.14.6}Autocorrelation function}{83}{subsection.13.14.6}}
+\newlabel{chapter3:autocorrelation-function}{{13.14.6}{83}{Autocorrelation function}{subsection.13.14.6}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.14.7}Correlation function and which random number generators should I use}{85}{subsection.13.14.7}}
+\newlabel{chapter3:correlation-function-and-which-random-number-generators-should-i-use}{{13.14.7}{85}{Correlation function and which random number generators should I use}{subsection.13.14.7}{}}
+\@writefile{toc}{\contentsline {section}{\numberline {13.15}Which RNG should I use?}{86}{section.13.15}}
+\newlabel{chapter3:which-rng-should-i-use}{{13.15}{86}{Which RNG should I use?}{section.13.15}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.15.1}How to use the Mersenne generator}{86}{subsection.13.15.1}}
+\newlabel{chapter3:how-to-use-the-mersenne-generator}{{13.15.1}{86}{How to use the Mersenne generator}{subsection.13.15.1}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.15.2}Why blocking?}{86}{subsection.13.15.2}}
+\newlabel{chapter3:why-blocking}{{13.15.2}{86}{Why blocking?}{subsection.13.15.2}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.15.3}Why blocking?}{87}{subsection.13.15.3}}
+\newlabel{chapter3:id16}{{13.15.3}{87}{Why blocking?}{subsection.13.15.3}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.15.4}Code to demonstrate the calculation of the autocorrelation function}{87}{subsection.13.15.4}}
+\newlabel{chapter3:code-to-demonstrate-the-calculation-of-the-autocorrelation-function}{{13.15.4}{87}{Code to demonstrate the calculation of the autocorrelation function}{subsection.13.15.4}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.15.5}What is blocking?}{89}{subsection.13.15.5}}
+\newlabel{chapter3:what-is-blocking}{{13.15.5}{89}{What is blocking?}{subsection.13.15.5}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.15.6}What is blocking?}{89}{subsection.13.15.6}}
+\newlabel{chapter3:id17}{{13.15.6}{89}{What is blocking?}{subsection.13.15.6}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.15.7}What is blocking?}{89}{subsection.13.15.7}}
+\newlabel{chapter3:id18}{{13.15.7}{89}{What is blocking?}{subsection.13.15.7}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.15.8}Implementation}{90}{subsection.13.15.8}}
+\newlabel{chapter3:implementation}{{13.15.8}{90}{Implementation}{subsection.13.15.8}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.15.9}Actual implementation with code, main function}{90}{subsection.13.15.9}}
+\newlabel{chapter3:actual-implementation-with-code-main-function}{{13.15.9}{90}{Actual implementation with code, main function}{subsection.13.15.9}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.15.10}The Bootstrap method}{91}{subsection.13.15.10}}
+\newlabel{chapter3:the-bootstrap-method}{{13.15.10}{91}{The Bootstrap method}{subsection.13.15.10}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.15.11}Bootstrapping}{91}{subsection.13.15.11}}
+\newlabel{chapter3:bootstrapping}{{13.15.11}{91}{Bootstrapping}{subsection.13.15.11}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.15.12}Bootstrapping, recipe}{91}{subsection.13.15.12}}
+\newlabel{chapter3:bootstrapping-recipe}{{13.15.12}{91}{Bootstrapping, recipe}{subsection.13.15.12}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.15.13}Bootstrapping, code}{92}{subsection.13.15.13}}
+\newlabel{chapter3:bootstrapping-code}{{13.15.13}{92}{Bootstrapping, code}{subsection.13.15.13}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.15.14}Jackknife, code}{92}{subsection.13.15.14}}
+\newlabel{chapter3:jackknife-code}{{13.15.14}{92}{Jackknife, code}{subsection.13.15.14}{}}
+\@writefile{toc}{\contentsline {section}{\numberline {13.16}Data Analysis and Machine Learning: Linear Regression and more Advanced Regression Analysis}{92}{section.13.16}}
+\newlabel{chapter4:data-analysis-and-machine-learning-linear-regression-and-more-advanced-regression-analysis}{{13.16}{92}{Data Analysis and Machine Learning: Linear Regression and more Advanced Regression Analysis}{section.13.16}{}}
+\newlabel{chapter4::doc}{{13.16}{92}{Data Analysis and Machine Learning: Linear Regression and more Advanced Regression Analysis}{section.13.16}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.1}Why Linear Regression (aka Ordinary Least Squares and family)}{92}{subsection.13.16.1}}
+\newlabel{chapter4:why-linear-regression-aka-ordinary-least-squares-and-family}{{13.16.1}{92}{Why Linear Regression (aka Ordinary Least Squares and family)}{subsection.13.16.1}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.2}Regression analysis, overarching aims}{93}{subsection.13.16.2}}
+\newlabel{chapter4:regression-analysis-overarching-aims}{{13.16.2}{93}{Regression analysis, overarching aims}{subsection.13.16.2}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.3}Regression analysis, overarching aims II}{93}{subsection.13.16.3}}
+\newlabel{chapter4:regression-analysis-overarching-aims-ii}{{13.16.3}{93}{Regression analysis, overarching aims II}{subsection.13.16.3}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.4}Examples}{93}{subsection.13.16.4}}
+\newlabel{chapter4:examples}{{13.16.4}{93}{Examples}{subsection.13.16.4}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.5}General linear models}{94}{subsection.13.16.5}}
+\newlabel{chapter4:general-linear-models}{{13.16.5}{94}{General linear models}{subsection.13.16.5}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.6}Rewriting the fitting procedure as a linear algebra problem}{94}{subsection.13.16.6}}
+\newlabel{chapter4:rewriting-the-fitting-procedure-as-a-linear-algebra-problem}{{13.16.6}{94}{Rewriting the fitting procedure as a linear algebra problem}{subsection.13.16.6}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.7}Rewriting the fitting procedure as a linear algebra problem, more details}{94}{subsection.13.16.7}}
+\newlabel{chapter4:rewriting-the-fitting-procedure-as-a-linear-algebra-problem-more-details}{{13.16.7}{94}{Rewriting the fitting procedure as a linear algebra problem, more details}{subsection.13.16.7}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.8}Generalizing the fitting procedure as a linear algebra problem}{95}{subsection.13.16.8}}
+\newlabel{chapter4:generalizing-the-fitting-procedure-as-a-linear-algebra-problem}{{13.16.8}{95}{Generalizing the fitting procedure as a linear algebra problem}{subsection.13.16.8}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.9}Generalizing the fitting procedure as a linear algebra problem}{95}{subsection.13.16.9}}
+\newlabel{chapter4:id1}{{13.16.9}{95}{Generalizing the fitting procedure as a linear algebra problem}{subsection.13.16.9}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.10}Optimizing our parameters}{95}{subsection.13.16.10}}
+\newlabel{chapter4:optimizing-our-parameters}{{13.16.10}{95}{Optimizing our parameters}{subsection.13.16.10}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.11}Our model for the nuclear binding energies}{96}{subsection.13.16.11}}
+\newlabel{chapter4:our-model-for-the-nuclear-binding-energies}{{13.16.11}{96}{Our model for the nuclear binding energies}{subsection.13.16.11}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.12}Optimizing our parameters, more details}{98}{subsection.13.16.12}}
+\newlabel{chapter4:optimizing-our-parameters-more-details}{{13.16.12}{98}{Optimizing our parameters, more details}{subsection.13.16.12}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.13}Interpretations and optimizing our parameters}{98}{subsection.13.16.13}}
+\newlabel{chapter4:interpretations-and-optimizing-our-parameters}{{13.16.13}{98}{Interpretations and optimizing our parameters}{subsection.13.16.13}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.14}Interpretations and optimizing our parameters}{99}{subsection.13.16.14}}
+\newlabel{chapter4:id2}{{13.16.14}{99}{Interpretations and optimizing our parameters}{subsection.13.16.14}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.15}Some useful matrix and vector expressions}{99}{subsection.13.16.15}}
+\newlabel{chapter4:some-useful-matrix-and-vector-expressions}{{13.16.15}{99}{Some useful matrix and vector expressions}{subsection.13.16.15}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.16}Interpretations and optimizing our parameters}{99}{subsection.13.16.16}}
+\newlabel{chapter4:id3}{{13.16.16}{99}{Interpretations and optimizing our parameters}{subsection.13.16.16}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.17}Own code for Ordinary Least Squares}{100}{subsection.13.16.17}}
+\newlabel{chapter4:own-code-for-ordinary-least-squares}{{13.16.17}{100}{Own code for Ordinary Least Squares}{subsection.13.16.17}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.18}Adding error analysis and training set up}{101}{subsection.13.16.18}}
+\newlabel{chapter4:adding-error-analysis-and-training-set-up}{{13.16.18}{101}{Adding error analysis and training set up}{subsection.13.16.18}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.19}The \(\chi ^2\) function}{101}{subsection.13.16.19}}
+\newlabel{chapter4:the-chi-2-function}{{13.16.19}{101}{The \protect \(\chi ^2\protect \) function}{subsection.13.16.19}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.20}The \(\chi ^2\) function}{102}{subsection.13.16.20}}
+\newlabel{chapter4:id4}{{13.16.20}{102}{The \protect \(\chi ^2\protect \) function}{subsection.13.16.20}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.21}The \(\chi ^2\) function}{102}{subsection.13.16.21}}
+\newlabel{chapter4:id5}{{13.16.21}{102}{The \protect \(\chi ^2\protect \) function}{subsection.13.16.21}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.22}The \(\chi ^2\) function}{102}{subsection.13.16.22}}
+\newlabel{chapter4:id6}{{13.16.22}{102}{The \protect \(\chi ^2\protect \) function}{subsection.13.16.22}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.23}The \(\chi ^2\) function}{103}{subsection.13.16.23}}
+\newlabel{chapter4:id7}{{13.16.23}{103}{The \protect \(\chi ^2\protect \) function}{subsection.13.16.23}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.24}The \(\chi ^2\) function}{103}{subsection.13.16.24}}
+\newlabel{chapter4:id8}{{13.16.24}{103}{The \protect \(\chi ^2\protect \) function}{subsection.13.16.24}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.25}Fitting an Equation of State for Dense Nuclear Matter}{104}{subsection.13.16.25}}
+\newlabel{chapter4:fitting-an-equation-of-state-for-dense-nuclear-matter}{{13.16.25}{104}{Fitting an Equation of State for Dense Nuclear Matter}{subsection.13.16.25}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.26}The code}{104}{subsection.13.16.26}}
+\newlabel{chapter4:the-code}{{13.16.26}{104}{The code}{subsection.13.16.26}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.27}Splitting our Data in Training and Test data}{106}{subsection.13.16.27}}
+\newlabel{chapter4:splitting-our-data-in-training-and-test-data}{{13.16.27}{106}{Splitting our Data in Training and Test data}{subsection.13.16.27}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.28}The Boston housing data example}{108}{subsection.13.16.28}}
+\newlabel{chapter4:the-boston-housing-data-example}{{13.16.28}{108}{The Boston housing data example}{subsection.13.16.28}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.29}Housing data, the code}{108}{subsection.13.16.29}}
+\newlabel{chapter4:housing-data-the-code}{{13.16.29}{108}{Housing data, the code}{subsection.13.16.29}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.30}Reducing the number of degrees of freedom, overarching view}{114}{subsection.13.16.30}}
+\newlabel{chapter4:reducing-the-number-of-degrees-of-freedom-overarching-view}{{13.16.30}{114}{Reducing the number of degrees of freedom, overarching view}{subsection.13.16.30}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.31}Preprocessing our data}{114}{subsection.13.16.31}}
+\newlabel{chapter4:preprocessing-our-data}{{13.16.31}{114}{Preprocessing our data}{subsection.13.16.31}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.32}More preprocessing}{115}{subsection.13.16.32}}
+\newlabel{chapter4:more-preprocessing}{{13.16.32}{115}{More preprocessing}{subsection.13.16.32}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.33}Simple preprocessing examples, Franke function and regression}{115}{subsection.13.16.33}}
+\newlabel{chapter4:simple-preprocessing-examples-franke-function-and-regression}{{13.16.33}{115}{Simple preprocessing examples, Franke function and regression}{subsection.13.16.33}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.34}The singular value decomposition}{117}{subsection.13.16.34}}
+\newlabel{chapter4:the-singular-value-decomposition}{{13.16.34}{117}{The singular value decomposition}{subsection.13.16.34}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.35}Linear Regression Problems}{117}{subsection.13.16.35}}
+\newlabel{chapter4:linear-regression-problems}{{13.16.35}{117}{Linear Regression Problems}{subsection.13.16.35}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.36}Fixing the singularity}{118}{subsection.13.16.36}}
+\newlabel{chapter4:fixing-the-singularity}{{13.16.36}{118}{Fixing the singularity}{subsection.13.16.36}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.37}Basic math of the SVD}{118}{subsection.13.16.37}}
+\newlabel{chapter4:basic-math-of-the-svd}{{13.16.37}{118}{Basic math of the SVD}{subsection.13.16.37}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.38}The SVD, a Fantastic Algorithm}{119}{subsection.13.16.38}}
+\newlabel{chapter4:the-svd-a-fantastic-algorithm}{{13.16.38}{119}{The SVD, a Fantastic Algorithm}{subsection.13.16.38}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.39}Economy\sphinxhyphen {}size SVD}{119}{subsection.13.16.39}}
+\newlabel{chapter4:economy-size-svd}{{13.16.39}{119}{Economy\sphinxhyphen {}size SVD}{subsection.13.16.39}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.40}Codes for the SVD}{120}{subsection.13.16.40}}
+\newlabel{chapter4:codes-for-the-svd}{{13.16.40}{120}{Codes for the SVD}{subsection.13.16.40}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.41}Mathematical Properties}{121}{subsection.13.16.41}}
+\newlabel{chapter4:mathematical-properties}{{13.16.41}{121}{Mathematical Properties}{subsection.13.16.41}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.42}Ridge and LASSO Regression}{121}{subsection.13.16.42}}
+\newlabel{chapter4:ridge-and-lasso-regression}{{13.16.42}{121}{Ridge and LASSO Regression}{subsection.13.16.42}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.43}More on Ridge Regression}{122}{subsection.13.16.43}}
+\newlabel{chapter4:more-on-ridge-regression}{{13.16.43}{122}{More on Ridge Regression}{subsection.13.16.43}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.44}Interpreting the Ridge results}{123}{subsection.13.16.44}}
+\newlabel{chapter4:interpreting-the-ridge-results}{{13.16.44}{123}{Interpreting the Ridge results}{subsection.13.16.44}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.45}More interpretations}{123}{subsection.13.16.45}}
+\newlabel{chapter4:more-interpretations}{{13.16.45}{123}{More interpretations}{subsection.13.16.45}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.46}A better understanding of regularization}{123}{subsection.13.16.46}}
+\newlabel{chapter4:a-better-understanding-of-regularization}{{13.16.46}{123}{A better understanding of regularization}{subsection.13.16.46}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.47}Decomposing the OLS and Ridge expressions}{124}{subsection.13.16.47}}
+\newlabel{chapter4:decomposing-the-ols-and-ridge-expressions}{{13.16.47}{124}{Decomposing the OLS and Ridge expressions}{subsection.13.16.47}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.48}Introducing the Covariance and Correlation functions}{124}{subsection.13.16.48}}
+\newlabel{chapter4:introducing-the-covariance-and-correlation-functions}{{13.16.48}{124}{Introducing the Covariance and Correlation functions}{subsection.13.16.48}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.49}Correlation Function and Design/Feature Matrix}{125}{subsection.13.16.49}}
+\newlabel{chapter4:correlation-function-and-design-feature-matrix}{{13.16.49}{125}{Correlation Function and Design/Feature Matrix}{subsection.13.16.49}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.50}Covariance Matrix Examples}{125}{subsection.13.16.50}}
+\newlabel{chapter4:covariance-matrix-examples}{{13.16.50}{125}{Covariance Matrix Examples}{subsection.13.16.50}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.51}Correlation Matrix}{126}{subsection.13.16.51}}
+\newlabel{chapter4:correlation-matrix}{{13.16.51}{126}{Correlation Matrix}{subsection.13.16.51}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.52}Correlation Matrix with Pandas}{127}{subsection.13.16.52}}
+\newlabel{chapter4:correlation-matrix-with-pandas}{{13.16.52}{127}{Correlation Matrix with Pandas}{subsection.13.16.52}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.53}Correlation Matrix with Pandas and the Franke function}{128}{subsection.13.16.53}}
+\newlabel{chapter4:correlation-matrix-with-pandas-and-the-franke-function}{{13.16.53}{128}{Correlation Matrix with Pandas and the Franke function}{subsection.13.16.53}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.54}Rewriting the Covariance and/or Correlation Matrix}{129}{subsection.13.16.54}}
+\newlabel{chapter4:rewriting-the-covariance-and-or-correlation-matrix}{{13.16.54}{129}{Rewriting the Covariance and/or Correlation Matrix}{subsection.13.16.54}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.55}Linking with SVD}{130}{subsection.13.16.55}}
+\newlabel{chapter4:linking-with-svd}{{13.16.55}{130}{Linking with SVD}{subsection.13.16.55}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.56}Where are we going?}{130}{subsection.13.16.56}}
+\newlabel{chapter4:where-are-we-going}{{13.16.56}{130}{Where are we going?}{subsection.13.16.56}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.57}Resampling methods}{130}{subsection.13.16.57}}
+\newlabel{chapter4:resampling-methods}{{13.16.57}{130}{Resampling methods}{subsection.13.16.57}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.58}Resampling approaches can be computationally expensive}{130}{subsection.13.16.58}}
+\newlabel{chapter4:resampling-approaches-can-be-computationally-expensive}{{13.16.58}{130}{Resampling approaches can be computationally expensive}{subsection.13.16.58}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.59}Why resampling methods ?}{131}{subsection.13.16.59}}
+\newlabel{chapter4:why-resampling-methods}{{13.16.59}{131}{Why resampling methods ?}{subsection.13.16.59}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.60}Statistical analysis}{131}{subsection.13.16.60}}
+\newlabel{chapter4:statistical-analysis}{{13.16.60}{131}{Statistical analysis}{subsection.13.16.60}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.61}Linking the regression analysis with a statistical interpretation}{131}{subsection.13.16.61}}
+\newlabel{chapter4:linking-the-regression-analysis-with-a-statistical-interpretation}{{13.16.61}{131}{Linking the regression analysis with a statistical interpretation}{subsection.13.16.61}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.62}Assumptions made}{131}{subsection.13.16.62}}
+\newlabel{chapter4:assumptions-made}{{13.16.62}{131}{Assumptions made}{subsection.13.16.62}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.63}Expectation value and variance}{132}{subsection.13.16.63}}
+\newlabel{chapter4:expectation-value-and-variance}{{13.16.63}{132}{Expectation value and variance}{subsection.13.16.63}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.64}Expectation value and variance for \(\boldsymbol  {\beta }\)}{132}{subsection.13.16.64}}
+\newlabel{chapter4:expectation-value-and-variance-for-boldsymbol-beta}{{13.16.64}{132}{Expectation value and variance for \protect \(\boldsymbol {\beta }\protect \)}{subsection.13.16.64}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.65}Resampling methods}{133}{subsection.13.16.65}}
+\newlabel{chapter4:id9}{{13.16.65}{133}{Resampling methods}{subsection.13.16.65}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.66}Resampling methods: Jackknife and Bootstrap}{134}{subsection.13.16.66}}
+\newlabel{chapter4:resampling-methods-jackknife-and-bootstrap}{{13.16.66}{134}{Resampling methods: Jackknife and Bootstrap}{subsection.13.16.66}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.67}Resampling methods: Jackknife}{134}{subsection.13.16.67}}
+\newlabel{chapter4:resampling-methods-jackknife}{{13.16.67}{134}{Resampling methods: Jackknife}{subsection.13.16.67}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.68}Jackknife code example}{134}{subsection.13.16.68}}
+\newlabel{chapter4:jackknife-code-example}{{13.16.68}{134}{Jackknife code example}{subsection.13.16.68}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.69}Resampling methods: Bootstrap}{135}{subsection.13.16.69}}
+\newlabel{chapter4:resampling-methods-bootstrap}{{13.16.69}{135}{Resampling methods: Bootstrap}{subsection.13.16.69}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.70}Resampling methods: Bootstrap background}{135}{subsection.13.16.70}}
+\newlabel{chapter4:resampling-methods-bootstrap-background}{{13.16.70}{135}{Resampling methods: Bootstrap background}{subsection.13.16.70}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.71}Resampling methods: More Bootstrap background}{135}{subsection.13.16.71}}
+\newlabel{chapter4:resampling-methods-more-bootstrap-background}{{13.16.71}{135}{Resampling methods: More Bootstrap background}{subsection.13.16.71}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.72}Resampling methods: Bootstrap approach}{136}{subsection.13.16.72}}
+\newlabel{chapter4:resampling-methods-bootstrap-approach}{{13.16.72}{136}{Resampling methods: Bootstrap approach}{subsection.13.16.72}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.73}Resampling methods: Bootstrap steps}{136}{subsection.13.16.73}}
+\newlabel{chapter4:resampling-methods-bootstrap-steps}{{13.16.73}{136}{Resampling methods: Bootstrap steps}{subsection.13.16.73}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.74}Code example for the Bootstrap method}{136}{subsection.13.16.74}}
+\newlabel{chapter4:code-example-for-the-bootstrap-method}{{13.16.74}{136}{Code example for the Bootstrap method}{subsection.13.16.74}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.75}Various steps in cross\sphinxhyphen {}validation}{139}{subsection.13.16.75}}
+\newlabel{chapter4:various-steps-in-cross-validation}{{13.16.75}{139}{Various steps in cross\sphinxhyphen {}validation}{subsection.13.16.75}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.76}How to set up the cross\sphinxhyphen {}validation for Ridge and/or Lasso}{139}{subsection.13.16.76}}
+\newlabel{chapter4:how-to-set-up-the-cross-validation-for-ridge-and-or-lasso}{{13.16.76}{139}{How to set up the cross\sphinxhyphen {}validation for Ridge and/or Lasso}{subsection.13.16.76}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.77}Cross\sphinxhyphen {}validation in brief}{140}{subsection.13.16.77}}
+\newlabel{chapter4:cross-validation-in-brief}{{13.16.77}{140}{Cross\sphinxhyphen {}validation in brief}{subsection.13.16.77}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.78}Code Example for Cross\sphinxhyphen {}validation and \(k\)\sphinxhyphen {}fold Cross\sphinxhyphen {}validation}{140}{subsection.13.16.78}}
+\newlabel{chapter4:code-example-for-cross-validation-and-k-fold-cross-validation}{{13.16.78}{140}{Code Example for Cross\sphinxhyphen {}validation and \protect \(k\protect \)\sphinxhyphen {}fold Cross\sphinxhyphen {}validation}{subsection.13.16.78}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.79}The bias\sphinxhyphen {}variance tradeoff}{142}{subsection.13.16.79}}
+\newlabel{chapter4:the-bias-variance-tradeoff}{{13.16.79}{142}{The bias\sphinxhyphen {}variance tradeoff}{subsection.13.16.79}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.80}Example code for Bias\sphinxhyphen {}Variance tradeoff}{143}{subsection.13.16.80}}
+\newlabel{chapter4:example-code-for-bias-variance-tradeoff}{{13.16.80}{143}{Example code for Bias\sphinxhyphen {}Variance tradeoff}{subsection.13.16.80}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.81}Understanding what happens}{144}{subsection.13.16.81}}
+\newlabel{chapter4:understanding-what-happens}{{13.16.81}{144}{Understanding what happens}{subsection.13.16.81}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.82}Summing up}{148}{subsection.13.16.82}}
+\newlabel{chapter4:summing-up}{{13.16.82}{148}{Summing up}{subsection.13.16.82}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.83}Another Example from Scikit\sphinxhyphen {}Learn\IeC {\textquoteright }s Repository}{149}{subsection.13.16.83}}
+\newlabel{chapter4:another-example-from-scikit-learn-s-repository}{{13.16.83}{149}{Another Example from Scikit\sphinxhyphen {}Learn’s Repository}{subsection.13.16.83}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.84}More examples on bootstrap and cross\sphinxhyphen {}validation and errors}{150}{subsection.13.16.84}}
+\newlabel{chapter4:more-examples-on-bootstrap-and-cross-validation-and-errors}{{13.16.84}{150}{More examples on bootstrap and cross\sphinxhyphen {}validation and errors}{subsection.13.16.84}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.85}The same example but now with cross\sphinxhyphen {}validation}{151}{subsection.13.16.85}}
+\newlabel{chapter4:the-same-example-but-now-with-cross-validation}{{13.16.85}{151}{The same example but now with cross\sphinxhyphen {}validation}{subsection.13.16.85}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.86}Cross\sphinxhyphen {}validation with Ridge}{153}{subsection.13.16.86}}
+\newlabel{chapter4:cross-validation-with-ridge}{{13.16.86}{153}{Cross\sphinxhyphen {}validation with Ridge}{subsection.13.16.86}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.87}The Ising model}{154}{subsection.13.16.87}}
+\newlabel{chapter4:the-ising-model}{{13.16.87}{154}{The Ising model}{subsection.13.16.87}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.88}Reformulating the problem to suit regression}{154}{subsection.13.16.88}}
+\newlabel{chapter4:reformulating-the-problem-to-suit-regression}{{13.16.88}{154}{Reformulating the problem to suit regression}{subsection.13.16.88}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.89}Linear regression}{155}{subsection.13.16.89}}
+\newlabel{chapter4:linear-regression}{{13.16.89}{155}{Linear regression}{subsection.13.16.89}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.90}Singular Value decomposition}{156}{subsection.13.16.90}}
+\newlabel{chapter4:singular-value-decomposition}{{13.16.90}{156}{Singular Value decomposition}{subsection.13.16.90}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.91}The one\sphinxhyphen {}dimensional Ising model}{157}{subsection.13.16.91}}
+\newlabel{chapter4:the-one-dimensional-ising-model}{{13.16.91}{157}{The one\sphinxhyphen {}dimensional Ising model}{subsection.13.16.91}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.92}Ridge regression}{159}{subsection.13.16.92}}
+\newlabel{chapter4:ridge-regression}{{13.16.92}{159}{Ridge regression}{subsection.13.16.92}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.93}LASSO regression}{159}{subsection.13.16.93}}
+\newlabel{chapter4:lasso-regression}{{13.16.93}{159}{LASSO regression}{subsection.13.16.93}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.94}Performance as function of the regularization parameter}{160}{subsection.13.16.94}}
+\newlabel{chapter4:performance-as-function-of-the-regularization-parameter}{{13.16.94}{160}{Performance as function of the regularization parameter}{subsection.13.16.94}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.16.95}Finding the optimal value of \(\lambda \)}{161}{subsection.13.16.95}}
+\newlabel{chapter4:finding-the-optimal-value-of-lambda}{{13.16.95}{161}{Finding the optimal value of \protect \(\lambda \protect \)}{subsection.13.16.95}{}}
+\@writefile{toc}{\contentsline {section}{\numberline {13.17}Data Analysis and Machine Learning: Logistic Regression}{161}{section.13.17}}
+\newlabel{chapter5:data-analysis-and-machine-learning-logistic-regression}{{13.17}{161}{Data Analysis and Machine Learning: Logistic Regression}{section.13.17}{}}
+\newlabel{chapter5::doc}{{13.17}{161}{Data Analysis and Machine Learning: Logistic Regression}{section.13.17}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.17.1}Logistic Regression}{162}{subsection.13.17.1}}
+\newlabel{chapter5:logistic-regression}{{13.17.1}{162}{Logistic Regression}{subsection.13.17.1}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.17.2}Optimization and Deep learning}{162}{subsection.13.17.2}}
+\newlabel{chapter5:optimization-and-deep-learning}{{13.17.2}{162}{Optimization and Deep learning}{subsection.13.17.2}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.17.3}Basics}{162}{subsection.13.17.3}}
+\newlabel{chapter5:basics}{{13.17.3}{162}{Basics}{subsection.13.17.3}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.17.4}Linear classifier}{163}{subsection.13.17.4}}
+\newlabel{chapter5:linear-classifier}{{13.17.4}{163}{Linear classifier}{subsection.13.17.4}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.17.5}Some selected properties}{163}{subsection.13.17.5}}
+\newlabel{chapter5:some-selected-properties}{{13.17.5}{163}{Some selected properties}{subsection.13.17.5}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.17.6}The logistic function}{163}{subsection.13.17.6}}
+\newlabel{chapter5:the-logistic-function}{{13.17.6}{163}{The logistic function}{subsection.13.17.6}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.17.7}Examples of likelihood functions used in logistic regression and nueral networks}{164}{subsection.13.17.7}}
+\newlabel{chapter5:examples-of-likelihood-functions-used-in-logistic-regression-and-nueral-networks}{{13.17.7}{164}{Examples of likelihood functions used in logistic regression and nueral networks}{subsection.13.17.7}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.17.8}Two parameters}{166}{subsection.13.17.8}}
+\newlabel{chapter5:two-parameters}{{13.17.8}{166}{Two parameters}{subsection.13.17.8}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.17.9}Maximum likelihood}{166}{subsection.13.17.9}}
+\newlabel{chapter5:maximum-likelihood}{{13.17.9}{166}{Maximum likelihood}{subsection.13.17.9}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.17.10}The cost function rewritten}{167}{subsection.13.17.10}}
+\newlabel{chapter5:the-cost-function-rewritten}{{13.17.10}{167}{The cost function rewritten}{subsection.13.17.10}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.17.11}Minimizing the cross entropy}{167}{subsection.13.17.11}}
+\newlabel{chapter5:minimizing-the-cross-entropy}{{13.17.11}{167}{Minimizing the cross entropy}{subsection.13.17.11}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.17.12}A more compact expression}{167}{subsection.13.17.12}}
+\newlabel{chapter5:a-more-compact-expression}{{13.17.12}{167}{A more compact expression}{subsection.13.17.12}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.17.13}Extending to more predictors}{168}{subsection.13.17.13}}
+\newlabel{chapter5:extending-to-more-predictors}{{13.17.13}{168}{Extending to more predictors}{subsection.13.17.13}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.17.14}Including more classes}{168}{subsection.13.17.14}}
+\newlabel{chapter5:including-more-classes}{{13.17.14}{168}{Including more classes}{subsection.13.17.14}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.17.15}More classes}{168}{subsection.13.17.15}}
+\newlabel{chapter5:more-classes}{{13.17.15}{168}{More classes}{subsection.13.17.15}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.17.16}A simple classification problem}{169}{subsection.13.17.16}}
+\newlabel{chapter5:a-simple-classification-problem}{{13.17.16}{169}{A simple classification problem}{subsection.13.17.16}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.17.17}The Credit Card example}{170}{subsection.13.17.17}}
+\newlabel{chapter5:the-credit-card-example}{{13.17.17}{170}{The Credit Card example}{subsection.13.17.17}{}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {13.17.18}How to read the Credit Card data}{170}{subsection.13.17.18}}
+\newlabel{chapter5:how-to-read-the-credit-card-data}{{13.17.18}{170}{How to read the Credit Card data}{subsection.13.17.18}{}}
@@ -0,0 +1,260 @@
+# Fdb version 3
+["makeindex python.idx"] 0 "python.idx" "python.ind" "python" 0
+  "python.idx" 1600635575 0 d41d8cd98f00b204e9800998ecf8427e ""
+  (generated)
+  "python.ind"
+["pdflatex"] 1600635574 "python.tex" "python.pdf" "python" 1600635574
+  "./chapter2_114_1.png" 1600635540 15591 8d0da3384f7960fc97183775b78acecf ""
+  "./chapter2_116_0.png" 1600635540 19228 4ebf60c613f8741f4cd59cb1aa00c1ca ""
+  "./chapter2_118_16.png" 1600635540 25763 57376c74c65e7770bd6031163307c9c9 ""
+  "./chapter2_42_1.png" 1600635540 21611 a6cc4760dd43bbf283547e1277f6d277 ""
+  "./chapter2_54_2.png" 1600635540 44501 3e2b87a0a0c9fd679cf4226969978628 ""
+  "./chapter2_54_3.png" 1600635540 10773 49f6d983b28690b12e9c1e85312624cd ""
+  "./chapter2_60_0.png" 1600635540 10671 65acbf25db081d2600c3f726c04aefdf ""
+  "./chapter2_68_0.png" 1600635540 9516 3ba77c08f1e5972ab5895841ad824280 ""
+  "./chapter2_70_1.png" 1600635540 13869 3b4a21a5862ad30ea8ce8916c896f1ea ""
+  "./chapter2_84_0.png" 1600635540 19796 e8a617f9ed482234ac9cbe1603c734d2 ""
+  "./chapter3_178_0.png" 1600635556 5197 29581201c97247bd0f3a27d0e95126b7 ""
+  "./chapter3_184_1.png" 1600635556 10033 aef078fd07a94b786dd0ca957db41c6f ""
+  "./chapter3_29_0.png" 1600635556 18850 f5949321ef7bd78557eab8badeebae4f ""
+  "./chapter4_117_1.png" 1600635568 15626 79cd0d9c9822bb8640d0382a07198922 ""
+  "./chapter4_129_0.png" 1600635568 24783 07c86e7a04952ab8dfc72aa1ded48d83 ""
+  "./chapter4_131_1.png" 1600635568 97512 4f3f39beb419c377afdd7c720e19aee5 ""
+  "./chapter4_133_0.png" 1600635568 34379 b2804a3b49967c239276dc825191ff2f ""
+  "./chapter4_140_0.png" 1600635568 10372 a6e8162ccdbaa8a68d14864270da40fd ""
+  "./chapter4_278_2.png" 1600635568 9750 5ef5c1c5616f1a6474202de19e78e3cc ""
+  "./chapter4_300_1.png" 1600635568 25861 33d9f2b6aadfc2cf41e97e7b738016d8 ""
+  "./chapter4_70_0.png" 1600635568 11373 8496b40e2cbef905fb43e2848f2e306f ""
+  "./chapter5_42_0.png" 1600635572 23100 3c7dcd60771be0f0aca7699d74d98645 ""
+  "./chapter5_7_0.png" 1600635572 9911 508f70803ad07a00cc222260ac8141df ""
+  "./chapter5_7_1.png" 1600635572 6754 cb0f6b6f1a12924be69587790b4f24c1 ""
+  "./chapter5_7_2.png" 1600635572 10184 de31382dd7bf2f9a0101650be20e8c14 ""
+  "./python.out" 1600635580 8114 be2b67e3ee487e03109aab241c66b4e2 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/enc/dvips/base/8r.enc" 1165713224 4850 80dc9bab7f31fb78a000ccfed0e27cab ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/map/fontname/texfonts.map" 1272929888 3287 e6b82fe08f5336d4d5ebc73fb1152e87 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/courier/pcrb8r.tfm" 1136768653 1292 3059476c50a24578715759f22652f3d0 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/courier/pcrb8t.tfm" 1136768653 1384 87406e4336af44af883a035f17f319d9 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/courier/pcrr8c.tfm" 1136768653 1268 8bd405dc5751cfed76cb6fb2db78cb50 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/courier/pcrr8r.tfm" 1136768653 1292 bd42be2f344128bff6d35d98474adfe3 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/courier/pcrr8t.tfm" 1136768653 1384 4632f5e54900a7dadbb83f555bc61e56 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/courier/pcrro8c.tfm" 1136768653 1344 dab2eee300fafcab19064bcc62d66daa ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/courier/pcrro8r.tfm" 1136768653 1544 4fb84cf2931ec523c2c6a08d939088ba ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/courier/pcrro8t.tfm" 1136768653 1596 04a657f277f0401ba37d66e716627ac4 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/helvetic/phvb8r.tfm" 1136768653 4484 b828043cbd581d289d955903c1339981 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/helvetic/phvb8t.tfm" 1136768653 6628 34c39492c0adc454c1c199922bba8363 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/helvetic/phvbo8t.tfm" 1136768653 6880 fe6c7967f27585f6fa9876f3af14edd2 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/helvetic/phvr8t.tfm" 1136768653 7040 b2bd27e2bfe6f6948cbc3239cae7444f ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/times/ptmb8r.tfm" 1136768653 4524 6bce29db5bc272ba5f332261583fee9c ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/times/ptmb8t.tfm" 1136768653 6880 f19b8995b61c334d78fc734065f6b4d4 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/times/ptmr8c.tfm" 1136768653 1352 fa28a7e6d323c65ce7d13d5342ff6be2 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/times/ptmr8r.tfm" 1136768653 4408 25b74d011a4c66b7f212c0cc3c90061b ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/times/ptmr8t.tfm" 1136768653 6672 e3ab9e37e925f3045c9005e6d1473d56 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/times/ptmri8r.tfm" 1136768653 4640 532ca3305aad10cc01d769f3f91f1029 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/times/ptmri8t.tfm" 1136768653 6944 94c55ad86e6ea2826f78ba2240d50df9 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/jknappen/ec/ecrm1000.tfm" 1136768653 3584 adb004a0c8e7c46ee66cad73671f37b4 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmbsy5.tfm" 1246382020 1120 1e8878807317373affa7f7bba4cf2f6a ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmbsy6.tfm" 1246382020 1124 14ccf5552bc7f77ca02a8a402bea8bfb ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmbsy7.tfm" 1246382020 1120 7f9f170e8aa57527ad6c49feafd45d54 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmbsy8.tfm" 1246382020 1120 200be8b775682cdf80acad4be5ef57e4 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmex7.tfm" 1246382020 1004 54797486969f23fa377b128694d548df ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmex8.tfm" 1246382020 988 bdf658c3bfc2d96d3c8b02cfc1c94c20 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmmib5.tfm" 1246382020 1496 c79f6914c6d39ffb3759967363d1be79 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmmib6.tfm" 1246382020 1516 a3bf6a5e7ec4401b1f52092dfaaed242 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmmib7.tfm" 1246382020 1508 6e807ff901c35a5f1fde0ca275533df8 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmmib8.tfm" 1246382020 1528 dab402b9d3774ca98baa037071cee7ae ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam10.tfm" 1246382020 916 f87d7c45f9c908e672703b83b72241a3 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam5.tfm" 1246382020 924 9904cf1d39e9767e7a3622f2a125a565 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam7.tfm" 1246382020 928 2dc8d444221b7a635bb58038579b861a ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm10.tfm" 1246382020 908 2921f8a10601f252058503cc6570e581 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm5.tfm" 1246382020 940 75ac932a52f80982a9f8ea75d03a34cf ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm7.tfm" 1246382020 940 228d6584342e91276bf566bcf9716b83 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmbsy10.tfm" 1136768653 1116 4e6ba9d7914baa6482fd69f67d126380 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmbx10.tfm" 1136768653 1328 c834bbb027764024c09d3d2bf908b5f0 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmbx12.tfm" 1136768653 1324 c910af8c371558dc20f2d7822f66fe64 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmbx5.tfm" 1136768653 1332 f817c21a1ba54560425663374f1b651a ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmbx6.tfm" 1136768653 1344 8a0be4fe4d376203000810ad4dc81558 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmbx7.tfm" 1136768653 1336 3125ccb448c1a09074e3aa4a9832f130 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmbx8.tfm" 1136768653 1332 1fde11373e221473104d6cc5993f046e ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmex10.tfm" 1136768653 992 662f679a0b3d2d53c1b94050fdaa3f50 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmmi12.tfm" 1136768653 1524 4414a8315f39513458b80dfc63bff03a ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmmi6.tfm" 1136768653 1512 f21f83efb36853c0b70002322c1ab3ad ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmmi8.tfm" 1136768653 1520 eccf95517727cb11801f4f1aee3a21b4 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmmib10.tfm" 1136768653 1524 554068197b70979a55370e6c6495f441 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmr12.tfm" 1136768653 1288 655e228510b4c2a1abe905c368440826 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmr17.tfm" 1136768653 1292 296a67155bdbfc32aa9c636f21e91433 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmr6.tfm" 1136768653 1300 b62933e007d01cfd073f79b963c01526 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmr8.tfm" 1136768653 1292 21c1c5bfeaebccffdb478fd231a0997d ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmsy10.tfm" 1136768653 1124 6c73e740cf17375f03eec0ee63599741 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmsy6.tfm" 1136768653 1116 933a60c408fc0a863a92debe84b2d294 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmsy8.tfm" 1136768653 1120 8b7d695260f3cff42e636090a8002094 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmbx10.pfb" 1248133631 34811 78b52f49e893bcba91bd7581cdc144c0 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmbx7.pfb" 1248133631 32007 e8fa0078355f39467039935974716569 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmex10.pfb" 1248133631 30251 6afa5cb1d0204815a708a080681d4674 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmmi10.pfb" 1248133631 36299 5f9df58c2139e7edcf37c8fca4bd384d ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmmi12.pfb" 1248133631 36741 fa121aac0049305630cf160b86157ee4 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmmi5.pfb" 1248133631 37912 77d683123f92148345f3fc36a38d9ab1 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmmi7.pfb" 1248133631 36281 c355509802a035cadc5f15869451dcee ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmmib10.pfb" 1248133631 36912 b448ef9ad9d7228ec3c6e71005136d55 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmr10.pfb" 1248133631 35752 024fb6c41858982481f6968b5fc26508 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmr5.pfb" 1248133631 31809 8670ca339bf94e56da1fc21c80635e2a ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmr7.pfb" 1248133631 32762 224316ccc9ad3ca0423a14971cfa7fc1 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmr8.pfb" 1248133631 32726 0a1aea6fcd6468ee2cf64d891f5c43c8 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmsy10.pfb" 1248133631 32569 5e5ddc8df908dea60932f3c484a54c0d ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmsy5.pfb" 1248133631 32915 7bf7720c61a5b3a7ff25b0964421c9b6 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmsy7.pfb" 1248133631 32716 08e384dc442464e7285e891af9f45947 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cmextra/cmmib7.pfb" 1248133631 39386 0bb525d495ceab21fe797301a586e0d7 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/symbols/msam10.pfb" 1248133631 31764 459c573c03a4949a528c2cc7f557e217 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/symbols/msbm10.pfb" 1248133631 34694 ad62b13721ee8eda1dcc8993c8bd7041 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/symbols/msbm7.pfb" 1248133631 35309 940e81a5b9e04201a07e8b33a3ae6e64 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/urw/courier/ucrb8a.pfb" 1136849748 50493 4ed1f7e9eba8f1f3e1ec25195460190d ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/urw/courier/ucrr8a.pfb" 1136849748 45758 19968a0990191524e34e1994d4a31cb6 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/urw/courier/ucrro8a.pfb" 1136849748 44404 ea3d9c0311883914133975dd62a9185c ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/urw/helvetic/uhvb8a.pfb" 1136849748 35941 f27169cc74234d5bd5e4cca5abafaabb ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/urw/times/utmb8a.pfb" 1136849748 44729 811d6c62865936705a31c797a1d5dada ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/urw/times/utmr8a.pfb" 1136849748 46026 6dab18b61c907687b520c72847215a68 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/type1/urw/times/utmri8a.pfb" 1136849748 45458 a3faba884469519614ca56ba5f6b1de1 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/courier/pcrb8t.vf" 1136768653 2184 5d20c8b00cd914e50251116c274e2d0b ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/courier/pcrr8c.vf" 1136768653 3552 6a7911d0b338a7c32cbfc3a9e985ccca ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/courier/pcrr8t.vf" 1136768653 2184 8475af1b9cfa983db5f46f5ed4b8f9f7 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/courier/pcrro8c.vf" 1136768653 3560 a297982f0907d62e9886d9e2666bf30b ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/courier/pcrro8t.vf" 1136768653 2280 d7cd083c724c9449e1d12731253966f7 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/helvetic/phvb8t.vf" 1136768653 2340 0efed6a948c3c37d870e4e7ddb85c7c3 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/times/ptmb8t.vf" 1136768653 2340 df9c920cc5688ebbf16a93f45ce7bdd3 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/times/ptmr8c.vf" 1136768653 3556 8a9a6dcbcd146ef985683f677f4758a6 ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/times/ptmr8t.vf" 1136768653 2348 91706c542228501c410c266421fbe30c ""
+  "/usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/times/ptmri8t.vf" 1136768653 2328 6cd7df782b09b29cfc4d93e55b6b9a59 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/context/base/supp-pdf.mkii" 1337017135 71627 94eb9990bed73c364d7f53f960cc8c5b ""
+  "/usr/local/texlive/2015/texmf-dist/tex/generic/babel-english/english.ldf" 1367878877 6963 2e0cb3d93aa64508bdb0db58ae900d97 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/generic/babel/babel.def" 1411763270 49725 b40154b767b0073ee42b35911042b793 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/generic/babel/babel.sty" 1411763270 13212 dc56c11a26f3ea97bcf005eeda274583 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/generic/ifxetex/ifxetex.sty" 1284331290 1458 43ab4710dc82f3edeabecd0d099626b2 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/etexcmds.sty" 1335995445 7612 c47308d923ec19888707b0f1792b326a ""
+  "/usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/gettitlestring.sty" 1303254447 8237 52810bdb4db2270e717422560a104aea ""
+  "/usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/hobsub-generic.sty" 1338332114 189108 8b3553a56c83ff61acecb36b75d817e2 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/hobsub-hyperref.sty" 1338332114 70752 45fa392800e07da61fa13446ad46b34d ""
+  "/usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/ifluatex.sty" 1303254447 7324 11d14f318d865f420e692d4e6c9c18c3 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/ifpdf.sty" 1303254447 7140 ece2cc23d9f20e1f53975ac167f42d3e ""
+  "/usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/ifvtex.sty" 1335995445 6797 68c89f65e01894df882dd523d3fc0a8f ""
+  "/usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/infwarerr.sty" 1335995445 8253 3bdedc8409aa5d290a2339be6f09af03 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/kvsetkeys.sty" 1335995445 14040 8de9f47fabc4ca3bd69b6d795e32751c ""
+  "/usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/ltxcmds.sty" 1335995445 18425 775b341047ce304520cc7c11ca41392e ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/amsfonts/amsfonts.sty" 1359763108 5949 3f3fd50a8cc94c3d4cbf4fc66cd3df1c ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/amsfonts/amssymb.sty" 1359763108 13829 94730e64147574077f8ecfea9bb69af4 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/amsfonts/umsa.fd" 1359763108 961 6518c6525a34feb5e8250ffa91731cff ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/amsfonts/umsb.fd" 1359763108 961 d02606146ba5601b5645f987c92e6193 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/amsmath/amsbsy.sty" 1362954379 2412 2d98314dc5be38f455f8890deeb2d091 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/amsmath/amsgen.sty" 1362954379 4357 ad30ad08920902fc9b38caf35a3b0496 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/amsmath/amsmath.sty" 1362954379 79178 b2e326c351e876df0e5e23df2e02441b ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/amsmath/amsopn.sty" 1362954379 4082 502152465aedb8f6a3c4b0b7c0fa8ae5 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/amsmath/amstext.sty" 1362954379 2637 846ebe982d3549c7ede7ce135456f54a ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/base/alltt.sty" 1428932888 3140 542beed88381d34d18b1f2c2d9b23c35 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/base/fontenc.sty" 1428932888 4572 f29f75cfae3acaf4667f1979db655af9 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/base/inputenc.sty" 1428932888 5619 3f48adceb9004b3fefe24c2d2df7d98e ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/base/makeidx.sty" 1428932888 1940 d6de0410d9ab8e197c80422e5314e9da ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/base/omsenc.dfu" 1428932888 2005 572b09e94d01e22ed7d4000c92b6e220 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/base/ot1enc.dfu" 1428932888 2757 273e079c3d3a9830c5b4fa2a4ce69c51 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/base/report.cls" 1428932888 23767 74c5551841f58a4efbb8c5d892190037 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/base/size10.clo" 1428932888 9179 632e23fed01c842f2eaef1dd9953a446 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/base/t1enc.def" 1428932888 9327 bf6addf718ff386725227c5b52941e7e ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/base/t1enc.dfu" 1428932888 7617 8f111f916836ef9e09db7ecbcd4e01d6 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/base/textcomp.sty" 1428932888 16155 258f35a63ef332879c6629fd0fc875da ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/base/ts1cmr.fd" 1428932888 2217 88eb40cf4b1efa71ba8daf8030a0113f ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/base/ts1enc.def" 1428932888 7767 7f8f29a2f77fdabc077bc233a27c01d3 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/base/ts1enc.dfu" 1428932888 4920 919d74324d79f3b4140842b12ac97e85 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/base/utf8.def" 1428932888 6484 2098550b79b15e713b69d9c8845f4437 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/capt-of/capt-of.sty" 1264379041 1311 063f8536a047a2d9cb1803321f793f37 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/carlisle/remreset.sty" 1137109962 1096 6a75275ca00e32428c6f059d2f618ea7 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/cmap/cmap.sty" 1215522782 2883 427a7f7cb58418a0394dbd85c80668f6 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/cmap/ot1.cmap" 1177721415 1207 4e0d96772f0d338847cbfb4eca683c81 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/cmap/t1.cmap" 1215522782 1938 beaa4a8467aa0074076e0e19f2992e29 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/fancyhdr/fancyhdr.sty" 1160175134 20521 e5d13d98d57bd53d4fed3aa61bd29c86 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/fancyvrb/fancyvrb.sty" 1274829816 45360 a0833d32f1b541964596b02870342d5a ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/float/float.sty" 1137110151 6749 16d2656a1984957e674b149555f1ea1d ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/fncychap/fncychap.sty" 1292029257 19488 fdd52eb173b3197d748e1ec25acb042f ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/framed/framed.sty" 1338588508 22449 7ec15c16d0d66790f28e90343c5434a3 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/geometry/geometry.sty" 1284422013 40502 e003406220954b0716679d7928aedd8a ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/graphics/graphics.sty" 1428932888 14285 20d80486c4ae98139889d8789596c967 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/graphics/graphicx.sty" 1428932888 8125 557ab9f1bfa80d369fb45a914aa8a3b4 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/graphics/keyval.sty" 1428932888 2594 d18d5e19aa8239cf867fa670c556d2e9 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/graphics/trig.sty" 1428932888 3439 44bd4a1da7f27787173f2e99116b0a7f ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/hyperref/hpdftex.def" 1352416072 51837 247bd8424b3835ef78c236dc1e0b4aef ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/hyperref/hyperref.sty" 1352416072 231792 5fc9dc7dd667e773a766ecc63bba7f4b ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/hyperref/nameref.sty" 1351899753 12847 25b617d63258c4f72870c883493a3cf8 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/hyperref/pd1enc.def" 1352416072 14005 155ac8fad2e5dd7c2cdd130fabd96633 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/hyperref/puenc.def" 1352416072 122263 ec12fdd2044f1507e5ae92ee7a5bbfae ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/latexconfig/color.cfg" 1254097189 802 7b8c8d72c24d795ed7720e4dfd29bff3 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/latexconfig/epstopdf-sys.cfg" 1279039959 678 4792914a8f45be57bb98413425e4c7af ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/latexconfig/graphics.cfg" 1278958963 3563 d35e897cae3b8c6848f6677b73370b54 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/latexconfig/hyperref.cfg" 1254097189 235 6031e5765137be07eed51a510b2b8fb7 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/mmap/oml.cmap" 1215649417 1866 c1c12138091b4a8edd4a24a940e6f792 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/mmap/oms.cmap" 1215649417 2370 3b1f71b14b974f07cef532db09ae9ee0 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/mmap/omx.cmap" 1215649417 3001 252c8ca42b06a22cb1a11c0e47790c6e ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/needspace/needspace.sty" 1364856750 852 0e34dbb72efc69fa07602405ad95585e ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/oberdiek/auxhook.sty" 1303254447 3834 707ef09f31d7d2ea47ba89974755dfe0 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/oberdiek/epstopdf-base.sty" 1303254447 12029 04d7fdf76e0464c23b5aa3a727952d7c ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/oberdiek/grfext.sty" 1335995445 7075 bd0c34fbf1ae8fd1debd2a554e41b2d5 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/oberdiek/hypcap.sty" 1335995445 3720 f909bdc3fac6af505c1f55366aa4d44c ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/oberdiek/kvoptions.sty" 1335995445 22417 c74ff4af6a1aa2b65d1924020edbbe11 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/oberdiek/rerunfilecheck.sty" 1303254447 9581 1158efc648bc09d5064db5703c882159 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/parskip/parskip.sty" 1285887441 2763 02a40cc5a32805c41d919cfbdba7e99a ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/pdftex-def/pdftex.def" 1306616590 55368 3c8a0d99822330f2dfabc0dfb09ce897 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/psnfss/t1pcr.fd" 1137110629 798 d5895e9edc628f2be019beb2c0ec66df ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/psnfss/t1phv.fd" 1137110629 1488 9a55ac1cde6b4798a7f56844bb75a553 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/psnfss/t1ptm.fd" 1137110629 774 61d7da1e9f9e74989b196d147e623736 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/psnfss/times.sty" 1156702453 857 6c716f26c5eadfb81029fcd6ce2d45e6 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/psnfss/ts1pcr.fd" 1137110629 643 92c451bb86386a4e36a174603ddb5a13 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/psnfss/ts1ptm.fd" 1137110629 619 96f56dc5d1ef1fe1121f1cfeec70ee0c ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/tabulary/tabulary.sty" 1403566480 13791 8c83287d79183c3bf58fd70871e8a70b ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/titlesec/titlesec.sty" 1324083561 37083 54a2e11f0f208916a9976d9e4837d144 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/tools/array.sty" 1428932888 13285 001a28447062ce32b9b4a62965626fc4 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/tools/longtable.sty" 1428932888 12083 b47235b9e530708f74984b3dda65e60d ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/upquote/upquote.sty" 1334873510 1048 517e01cde97c1c0baf72e69d43aa5a2e ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/url/url.sty" 1388531844 12796 8edb7d69a20b857904dd0ea757c14ec9 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/varwidth/varwidth.sty" 1238697683 10894 d359a13923460b2a73d4312d613554c8 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/wrapfig/wrapfig.sty" 1137111090 26220 3701aebf80ccdef248c0c20dd062fea9 ""
+  "/usr/local/texlive/2015/texmf-dist/tex/latex/xcolor/xcolor.sty" 1169481954 55224 a43bab84e0ac5e6efcaf9a98bde73a94 ""
+  "/usr/local/texlive/2015/texmf-dist/web2c/texmf.cnf" 1428852030 31983 18aeec08f48baa3cf3508d538dd5f459 ""
+  "/usr/local/texlive/2015/texmf-var/fonts/map/pdftex/updmap/pdftex.map" 1432479641 1764542 91654ba72bdb667e84ea24f076ae16d8 ""
+  "/usr/local/texlive/2015/texmf-var/web2c/pdftex/pdflatex.fmt" 1432479681 3849859 39a7d258195bde2394e244961601fbc5 ""
+  "/usr/local/texlive/2015/texmf.cnf" 1432479636 577 0d611272082f3cdb8e80e09a3c69cf07 ""
+  "chapter2_114_1.png" 1600635540 15591 8d0da3384f7960fc97183775b78acecf ""
+  "chapter2_116_0.png" 1600635540 19228 4ebf60c613f8741f4cd59cb1aa00c1ca ""
+  "chapter2_118_16.png" 1600635540 25763 57376c74c65e7770bd6031163307c9c9 ""
+  "chapter2_42_1.png" 1600635540 21611 a6cc4760dd43bbf283547e1277f6d277 ""
+  "chapter2_54_2.png" 1600635540 44501 3e2b87a0a0c9fd679cf4226969978628 ""
+  "chapter2_54_3.png" 1600635540 10773 49f6d983b28690b12e9c1e85312624cd ""
+  "chapter2_60_0.png" 1600635540 10671 65acbf25db081d2600c3f726c04aefdf ""
+  "chapter2_68_0.png" 1600635540 9516 3ba77c08f1e5972ab5895841ad824280 ""
+  "chapter2_70_1.png" 1600635540 13869 3b4a21a5862ad30ea8ce8916c896f1ea ""
+  "chapter2_84_0.png" 1600635540 19796 e8a617f9ed482234ac9cbe1603c734d2 ""
+  "chapter3_178_0.png" 1600635556 5197 29581201c97247bd0f3a27d0e95126b7 ""
+  "chapter3_184_1.png" 1600635556 10033 aef078fd07a94b786dd0ca957db41c6f ""
+  "chapter3_29_0.png" 1600635556 18850 f5949321ef7bd78557eab8badeebae4f ""
+  "chapter4_117_1.png" 1600635568 15626 79cd0d9c9822bb8640d0382a07198922 ""
+  "chapter4_129_0.png" 1600635568 24783 07c86e7a04952ab8dfc72aa1ded48d83 ""
+  "chapter4_131_1.png" 1600635568 97512 4f3f39beb419c377afdd7c720e19aee5 ""
+  "chapter4_133_0.png" 1600635568 34379 b2804a3b49967c239276dc825191ff2f ""
+  "chapter4_140_0.png" 1600635568 10372 a6e8162ccdbaa8a68d14864270da40fd ""
+  "chapter4_278_2.png" 1600635568 9750 5ef5c1c5616f1a6474202de19e78e3cc ""
+  "chapter4_300_1.png" 1600635568 25861 33d9f2b6aadfc2cf41e97e7b738016d8 ""
+  "chapter4_70_0.png" 1600635568 11373 8496b40e2cbef905fb43e2848f2e306f ""
+  "chapter5_42_0.png" 1600635572 23100 3c7dcd60771be0f0aca7699d74d98645 ""
+  "chapter5_7_0.png" 1600635572 9911 508f70803ad07a00cc222260ac8141df ""
+  "chapter5_7_1.png" 1600635572 6754 cb0f6b6f1a12924be69587790b4f24c1 ""
+  "chapter5_7_2.png" 1600635572 10184 de31382dd7bf2f9a0101650be20e8c14 ""
+  "footnotehyper-sphinx.sty" 1594223451 8888 1bbd7bdeae8c8bed1d10d551bddb1cc9 ""
+  "python.aux" 1600635574 8 a94a2480d3289e625eea47cd1b285758 ""
+  "python.ind" 0 -1 0 "makeindex python.idx"
+  "python.tex" 1600635574 577671 865e6a9fc6aa2920764cf52e4c7212a9 ""
+  "sphinx.sty" 1594223451 82020 a38700b8aa22dfd94a8a5b905e69be73 ""
+  "sphinxhighlight.sty" 1600635572 8137 38a433148fcb7611515a989ff1750dd5 ""
+  "sphinxmanual.cls" 1594223451 4236 124cd90deb92742b5d3922bfc2cd70c0 ""
+  "sphinxmessages.sty" 1600635574 745 3f5fcd6cdd7964ed608767954a8ced6f ""
+  "sphinxmulticell.sty" 1594223451 14606 0b6edc2b1a83546ed92026d1f6a311b5 ""
+  (generated)
+  "python.out"
+  "python.aux"
+  "python.toc"
+  "python.idx"
+  "python.log"
+  "python.pdf"
@@ -0,0 +1,471 @@
+PWD /Users/hjensen/Teaching/FYS-STK4150/doc/src/LectureNotes/_build/latex
+INPUT /usr/local/texlive/2015/texmf.cnf
+INPUT /usr/local/texlive/2015/texmf-dist/web2c/texmf.cnf
+INPUT /usr/local/texlive/2015/texmf-var/web2c/pdftex/pdflatex.fmt
+INPUT python.tex
+OUTPUT python.log
+INPUT sphinxmanual.cls
+INPUT sphinxmanual.cls
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/report.cls
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/report.cls
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/size10.clo
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/size10.clo
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/inputenc.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/inputenc.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/utf8.def
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/utf8.def
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/t1enc.dfu
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/t1enc.dfu
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/ot1enc.dfu
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/ot1enc.dfu
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/omsenc.dfu
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/omsenc.dfu
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/cmap/cmap.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/cmap/cmap.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/fontenc.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/fontenc.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/t1enc.def
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/t1enc.def
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/map/fontname/texfonts.map
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/jknappen/ec/ecrm1000.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/cmap/t1.cmap
+OUTPUT python.pdf
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/cmap/t1.cmap
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/amsmath/amsmath.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/amsmath/amsmath.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/amsmath/amstext.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/amsmath/amstext.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/amsmath/amsgen.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/amsmath/amsgen.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/amsmath/amsbsy.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/amsmath/amsbsy.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/amsmath/amsopn.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/amsmath/amsopn.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/amsfonts/amssymb.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/amsfonts/amssymb.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/amsfonts/amsfonts.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/amsfonts/amsfonts.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/babel/babel.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/babel/babel.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/babel-english/english.ldf
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/babel-english/english.ldf
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/babel-english/english.ldf
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/babel/babel.def
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/psnfss/times.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/psnfss/times.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/fncychap/fncychap.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/fncychap/fncychap.sty
+INPUT sphinx.sty
+INPUT sphinx.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/ltxcmds.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/ltxcmds.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/graphics/graphicx.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/graphics/graphicx.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/graphics/keyval.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/graphics/keyval.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/graphics/graphics.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/graphics/graphics.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/graphics/trig.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/graphics/trig.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/latexconfig/graphics.cfg
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/latexconfig/graphics.cfg
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/pdftex-def/pdftex.def
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/pdftex-def/pdftex.def
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/infwarerr.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/infwarerr.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/fancyhdr/fancyhdr.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/fancyhdr/fancyhdr.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/textcomp.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/textcomp.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/ts1enc.def
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/ts1enc.def
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/ts1enc.dfu
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/ts1enc.dfu
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/titlesec/titlesec.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/titlesec/titlesec.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/tabulary/tabulary.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/tabulary/tabulary.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/tools/array.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/tools/array.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/tools/longtable.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/tools/longtable.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/varwidth/varwidth.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/varwidth/varwidth.sty
+INPUT sphinxmulticell.sty
+INPUT sphinxmulticell.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/makeidx.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/makeidx.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/framed/framed.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/framed/framed.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/xcolor/xcolor.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/xcolor/xcolor.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/xcolor/xcolor.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/latexconfig/color.cfg
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/latexconfig/color.cfg
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/fancyvrb/fancyvrb.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/fancyvrb/fancyvrb.sty
+INPUT footnotehyper-sphinx.sty
+INPUT footnotehyper-sphinx.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/float/float.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/float/float.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/wrapfig/wrapfig.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/wrapfig/wrapfig.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/parskip/parskip.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/parskip/parskip.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/alltt.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/alltt.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/upquote/upquote.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/upquote/upquote.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/capt-of/capt-of.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/capt-of/capt-of.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/needspace/needspace.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/needspace/needspace.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/carlisle/remreset.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/carlisle/remreset.sty
+INPUT sphinxhighlight.sty
+INPUT sphinxhighlight.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/oberdiek/kvoptions.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/oberdiek/kvoptions.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/kvsetkeys.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/kvsetkeys.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/etexcmds.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/etexcmds.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/ifluatex.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/ifluatex.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/geometry/geometry.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/geometry/geometry.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/ifpdf.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/ifpdf.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/ifvtex.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/ifvtex.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/ifxetex/ifxetex.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/ifxetex/ifxetex.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/hyperref/hyperref.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/hyperref/hyperref.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/hobsub-hyperref.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/hobsub-hyperref.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/hobsub-hyperref.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/hobsub-generic.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/hobsub-generic.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/oberdiek/auxhook.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/oberdiek/auxhook.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/hyperref/pd1enc.def
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/hyperref/pd1enc.def
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/latexconfig/hyperref.cfg
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/latexconfig/hyperref.cfg
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/hyperref/puenc.def
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/hyperref/puenc.def
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/url/url.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/url/url.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/hyperref/hpdftex.def
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/hyperref/hpdftex.def
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/oberdiek/rerunfilecheck.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/oberdiek/rerunfilecheck.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/oberdiek/hypcap.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/oberdiek/hypcap.sty
+INPUT sphinxmessages.sty
+INPUT sphinxmessages.sty
+OUTPUT python.idx
+INPUT python.aux
+INPUT python.aux
+OUTPUT python.aux
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/ts1cmr.fd
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/base/ts1cmr.fd
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/psnfss/t1ptm.fd
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/psnfss/t1ptm.fd
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/times/ptmr8t.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/tex/context/base/supp-pdf.mkii
+INPUT /usr/local/texlive/2015/texmf-dist/tex/context/base/supp-pdf.mkii
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/oberdiek/epstopdf-base.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/oberdiek/epstopdf-base.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/oberdiek/grfext.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/oberdiek/grfext.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/latexconfig/epstopdf-sys.cfg
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/latexconfig/epstopdf-sys.cfg
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/hyperref/nameref.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/hyperref/nameref.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/gettitlestring.sty
+INPUT /usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/gettitlestring.sty
+OUTPUT python.out
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/psnfss/t1phv.fd
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/psnfss/t1phv.fd
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/helvetic/phvr8t.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/helvetic/phvb8t.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/helvetic/phvb8t.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/helvetic/phvbo8t.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/helvetic/phvbo8t.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/helvetic/phvb8t.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmr17.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/cmap/ot1.cmap
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/cmap/ot1.cmap
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmr12.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmmi12.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/mmap/oml.cmap
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/mmap/oml.cmap
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmmi12.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmsy10.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/mmap/oms.cmap
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/mmap/oms.cmap
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmsy10.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmex10.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/mmap/omx.cmap
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/mmap/omx.cmap
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmex10.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/amsfonts/umsa.fd
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/amsfonts/umsa.fd
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam10.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam10.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam10.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/amsfonts/umsb.fd
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/amsfonts/umsb.fd
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm10.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm10.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm10.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/helvetic/phvb8t.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/helvetic/phvb8t.vf
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/helvetic/phvb8r.tfm
+INPUT /usr/local/texlive/2015/texmf-var/fonts/map/pdftex/updmap/pdftex.map
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/helvetic/phvb8t.vf
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/helvetic/phvb8r.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/helvetic/phvb8t.vf
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/helvetic/phvb8r.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/times/ptmr8t.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/helvetic/phvr8t.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/helvetic/phvb8t.tfm
+OUTPUT python.toc
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/helvetic/phvb8t.vf
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/helvetic/phvb8r.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/helvetic/phvb8t.vf
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/helvetic/phvb8r.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/times/ptmb8t.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/times/ptmb8t.vf
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/times/ptmb8r.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/times/ptmr8t.vf
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/times/ptmr8r.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/times/ptmri8t.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/psnfss/ts1ptm.fd
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/psnfss/ts1ptm.fd
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/times/ptmr8c.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/times/ptmri8t.vf
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/times/ptmri8r.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/times/ptmr8c.vf
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmex7.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmex7.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam7.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam5.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm7.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm5.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmbx10.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmbx7.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmbx5.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmmib10.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmmib7.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmmib5.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmbsy10.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmbsy7.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmbsy5.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/times/ptmr8t.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/helvetic/phvr8t.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/times/ptmr8t.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/psnfss/t1pcr.fd
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/psnfss/t1pcr.fd
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/courier/pcrr8t.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/courier/pcrr8t.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/courier/pcrr8t.vf
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/courier/pcrr8r.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/courier/pcrb8t.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/courier/pcrb8t.vf
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/courier/pcrb8r.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/courier/pcrro8t.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/times/ptmr8t.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/courier/pcrro8t.vf
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/courier/pcrro8r.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/times/ptmr8t.vf
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/times/ptmr8r.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/psnfss/ts1pcr.fd
+INPUT /usr/local/texlive/2015/texmf-dist/tex/latex/psnfss/ts1pcr.fd
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/courier/pcrr8c.tfm
+INPUT chapter2_42_1.png
+INPUT ./chapter2_42_1.png
+INPUT ./chapter2_42_1.png
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/courier/pcrr8t.tfm
+INPUT chapter2_42_1.png
+INPUT ./chapter2_42_1.png
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/courier/pcrr8c.vf
+INPUT chapter2_54_2.png
+INPUT ./chapter2_54_2.png
+INPUT ./chapter2_54_2.png
+INPUT chapter2_54_2.png
+INPUT ./chapter2_54_2.png
+INPUT chapter2_54_3.png
+INPUT ./chapter2_54_3.png
+INPUT ./chapter2_54_3.png
+INPUT chapter2_54_3.png
+INPUT ./chapter2_54_3.png
+INPUT chapter2_60_0.png
+INPUT ./chapter2_60_0.png
+INPUT ./chapter2_60_0.png
+INPUT chapter2_60_0.png
+INPUT ./chapter2_60_0.png
+INPUT chapter2_68_0.png
+INPUT ./chapter2_68_0.png
+INPUT ./chapter2_68_0.png
+INPUT chapter2_68_0.png
+INPUT ./chapter2_68_0.png
+INPUT chapter2_70_1.png
+INPUT ./chapter2_70_1.png
+INPUT ./chapter2_70_1.png
+INPUT chapter2_70_1.png
+INPUT ./chapter2_70_1.png
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/times/ptmr8t.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/times/ptmr8t.tfm
+INPUT chapter2_84_0.png
+INPUT ./chapter2_84_0.png
+INPUT ./chapter2_84_0.png
+INPUT chapter2_84_0.png
+INPUT ./chapter2_84_0.png
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/courier/pcrro8c.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/courier/pcrro8c.vf
+INPUT chapter2_114_1.png
+INPUT ./chapter2_114_1.png
+INPUT ./chapter2_114_1.png
+INPUT chapter2_114_1.png
+INPUT ./chapter2_114_1.png
+INPUT chapter2_116_0.png
+INPUT ./chapter2_116_0.png
+INPUT ./chapter2_116_0.png
+INPUT chapter2_116_0.png
+INPUT ./chapter2_116_0.png
+INPUT chapter2_118_16.png
+INPUT ./chapter2_118_16.png
+INPUT ./chapter2_118_16.png
+INPUT chapter2_118_16.png
+INPUT ./chapter2_118_16.png
+INPUT chapter3_29_0.png
+INPUT ./chapter3_29_0.png
+INPUT ./chapter3_29_0.png
+INPUT chapter3_29_0.png
+INPUT ./chapter3_29_0.png
+INPUT chapter3_178_0.png
+INPUT ./chapter3_178_0.png
+INPUT ./chapter3_178_0.png
+INPUT chapter3_178_0.png
+INPUT ./chapter3_178_0.png
+INPUT chapter3_184_1.png
+INPUT ./chapter3_184_1.png
+INPUT ./chapter3_184_1.png
+INPUT chapter3_184_1.png
+INPUT ./chapter3_184_1.png
+INPUT chapter4_70_0.png
+INPUT ./chapter4_70_0.png
+INPUT ./chapter4_70_0.png
+INPUT chapter4_70_0.png
+INPUT ./chapter4_70_0.png
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmr8.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmr6.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmmi8.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmmi6.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmsy8.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmsy6.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmex8.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmex7.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmbx12.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmbx8.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmbx6.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam10.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/symbols/msam7.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm10.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/symbols/msbm7.tfm
+INPUT chapter4_117_1.png
+INPUT ./chapter4_117_1.png
+INPUT ./chapter4_117_1.png
+INPUT chapter4_117_1.png
+INPUT ./chapter4_117_1.png
+INPUT chapter4_129_0.png
+INPUT ./chapter4_129_0.png
+INPUT ./chapter4_129_0.png
+INPUT chapter4_129_0.png
+INPUT ./chapter4_129_0.png
+INPUT chapter4_131_1.png
+INPUT ./chapter4_131_1.png
+INPUT ./chapter4_131_1.png
+INPUT chapter4_131_1.png
+INPUT ./chapter4_131_1.png
+INPUT chapter4_133_0.png
+INPUT ./chapter4_133_0.png
+INPUT ./chapter4_133_0.png
+INPUT chapter4_133_0.png
+INPUT ./chapter4_133_0.png
+INPUT chapter4_140_0.png
+INPUT ./chapter4_140_0.png
+INPUT ./chapter4_140_0.png
+INPUT chapter4_140_0.png
+INPUT ./chapter4_140_0.png
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmmib10.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmmib8.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmmib6.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/cm/cmbsy10.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmbsy8.tfm
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/public/amsfonts/cmextra/cmbsy6.tfm
+INPUT chapter4_278_2.png
+INPUT ./chapter4_278_2.png
+INPUT ./chapter4_278_2.png
+INPUT chapter4_278_2.png
+INPUT ./chapter4_278_2.png
+INPUT chapter4_300_1.png
+INPUT ./chapter4_300_1.png
+INPUT ./chapter4_300_1.png
+INPUT chapter4_300_1.png
+INPUT ./chapter4_300_1.png
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/vf/adobe/courier/pcrr8t.vf
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/tfm/adobe/courier/pcrr8r.tfm
+INPUT chapter5_7_0.png
+INPUT ./chapter5_7_0.png
+INPUT ./chapter5_7_0.png
+INPUT chapter5_7_0.png
+INPUT ./chapter5_7_0.png
+INPUT chapter5_7_1.png
+INPUT ./chapter5_7_1.png
+INPUT ./chapter5_7_1.png
+INPUT chapter5_7_1.png
+INPUT ./chapter5_7_1.png
+INPUT chapter5_7_2.png
+INPUT ./chapter5_7_2.png
+INPUT ./chapter5_7_2.png
+INPUT chapter5_7_2.png
+INPUT ./chapter5_7_2.png
+INPUT chapter5_42_0.png
+INPUT ./chapter5_42_0.png
+INPUT ./chapter5_42_0.png
+INPUT chapter5_42_0.png
+INPUT ./chapter5_42_0.png
+INPUT python.aux
+INPUT ./python.out
+INPUT ./python.out
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/enc/dvips/base/8r.enc
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmbx10.pfb
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmbx7.pfb
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmex10.pfb
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmmi10.pfb
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmmi12.pfb
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmmi5.pfb
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmmi7.pfb
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmmib10.pfb
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cmextra/cmmib7.pfb
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmr10.pfb
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmr5.pfb
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmr7.pfb
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmr8.pfb
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmsy10.pfb
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmsy5.pfb
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/cm/cmsy7.pfb
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/symbols/msam10.pfb
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/symbols/msbm10.pfb
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/public/amsfonts/symbols/msbm7.pfb
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/urw/courier/ucrb8a.pfb
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/urw/courier/ucrr8a.pfb
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/urw/courier/ucrro8a.pfb
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/urw/helvetic/uhvb8a.pfb
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/urw/times/utmb8a.pfb
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/urw/times/utmr8a.pfb
+INPUT /usr/local/texlive/2015/texmf-dist/fonts/type1/urw/times/utmri8a.pfb
@@ -0,0 +1,16 @@
+line_max 100
+headings_flag 1
+heading_prefix "  \\bigletter "
+
+preamble "\\begin{sphinxtheindex}
+\\let\\bigletter\\sphinxstyleindexlettergroup
+\\let\\spxpagem \\sphinxstyleindexpagemain
+\\let\\spxentry \\sphinxstyleindexentry
+\\let\\spxextra \\sphinxstyleindexextra
+
+"
+
+postamble "\n\n\\end{sphinxtheindex}\n"
+
+symhead_positive "{\\sphinxsymbolsname}"
+numhead_positive "{\\sphinxnumbersname}"
@@ -0,0 +1,30 @@
+\BOOKMARK [0][-]{chapter.1}{\376\377\000I\000n\000t\000r\000o\000d\000u\000c\000t\000i\000o\000n}{}% 1
+\BOOKMARK [0][-]{chapter.2}{\376\377\000L\000e\000a\000r\000n\000i\000n\000g\000\040\000o\000u\000t\000c\000o\000m\000e\000s}{}% 2
+\BOOKMARK [0][-]{chapter.3}{\376\377\000M\000a\000c\000h\000i\000n\000e\000\040\000L\000e\000a\000r\000n\000i\000n\000g\000,\000\040\000a\000\040\000s\000m\000a\000l\000l\000\040\000\050\000a\000n\000d\000\040\000p\000r\000o\000b\000a\000b\000l\000y\000\040\000b\000i\000a\000s\000e\000d\000\051\000\040\000i\000n\000t\000r\000o\000d\000u\000c\000t\000i\000o\000n}{}% 3
+\BOOKMARK [0][-]{chapter.4}{\376\377\000M\000a\000c\000h\000i\000n\000e\000\040\000L\000e\000a\000r\000n\000i\000n\000g\000,\000\040\000a\000n\000\040\000e\000x\000t\000r\000e\000m\000e\000l\000y\000\040\000r\000i\000c\000h\000\040\000f\000i\000e\000l\000d}{}% 4
+\BOOKMARK [0][-]{chapter.5}{\376\377\000A\000\040\000m\000u\000l\000t\000i\000d\000i\000s\000c\000i\000p\000l\000i\000n\000a\000r\000y\000\040\000a\000p\000p\000r\000o\000a\000c\000h}{}% 5
+\BOOKMARK [0][-]{chapter.6}{\376\377\000T\000y\000p\000e\000s\000\040\000o\000f\000\040\000M\000a\000c\000h\000i\000n\000e\000\040\000L\000e\000a\000r\000n\000i\000n\000g}{}% 6
+\BOOKMARK [0][-]{chapter.7}{\376\377\000E\000s\000s\000e\000n\000t\000i\000a\000l\000\040\000e\000l\000e\000m\000e\000n\000t\000s\000\040\000o\000f\000\040\000M\000L}{}% 7
+\BOOKMARK [0][-]{chapter.8}{\376\377\000A\000n\000\040\000o\000p\000t\000i\000m\000i\000z\000a\000t\000i\000o\000n\000/\000m\000i\000n\000i\000m\000i\000z\000a\000t\000i\000o\000n\000\040\000p\000r\000o\000b\000l\000e\000m}{}% 8
+\BOOKMARK [0][-]{chapter.9}{\376\377\000A\000\040\000F\000r\000e\000q\000u\000e\000n\000t\000i\000s\000t\000\040\000a\000p\000p\000r\000o\000a\000c\000h\000\040\000t\000o\000\040\000d\000a\000t\000a\000\040\000a\000n\000a\000l\000y\000s\000i\000s}{}% 9
+\BOOKMARK [0][-]{chapter.10}{\376\377\000W\000h\000a\000t\000\040\000i\000s\000\040\000a\000\040\000g\000o\000o\000d\000\040\000m\000o\000d\000e\000l\000?}{}% 10
+\BOOKMARK [0][-]{chapter.11}{\376\377\000W\000h\000a\000t\000\040\000i\000s\000\040\000a\000\040\000g\000o\000o\000d\000\040\000m\000o\000d\000e\000l\000?\000\040\000C\000a\000n\000\040\000w\000e\000\040\000d\000e\000f\000i\000n\000e\000\040\000i\000t\000?}{}% 11
+\BOOKMARK [0][-]{chapter.12}{\376\377\000C\000h\000o\000i\000c\000e\000\040\000o\000f\000\040\000P\000r\000o\000g\000r\000a\000m\000m\000i\000n\000g\000\040\000L\000a\000n\000g\000u\000a\000g\000e}{}% 12
+\BOOKMARK [0][-]{chapter.13}{\376\377\000D\000a\000t\000a\000\040\000h\000a\000n\000d\000l\000i\000n\000g\000,\000\040\000m\000a\000c\000h\000i\000n\000e\000\040\000l\000e\000a\000r\000n\000i\000n\000g\000\040\000a\000n\000d\000\040\000e\000t\000h\000i\000c\000a\000l\000\040\000a\000s\000p\000e\000c\000t\000s}{}% 13
+\BOOKMARK [1][-]{section.13.1}{\376\377\000D\000a\000t\000a\000\040\000A\000n\000a\000l\000y\000s\000i\000s\000\040\000a\000n\000d\000\040\000M\000a\000c\000h\000i\000n\000e\000\040\000L\000e\000a\000r\000n\000i\000n\000g\000:\000\040\000G\000e\000t\000t\000i\000n\000g\000\040\000s\000t\000a\000r\000t\000e\000d\000,\000\040\000o\000u\000r\000\040\000f\000i\000r\000s\000t\000\040\000d\000a\000t\000a\000\040\000a\000n\000d\000\040\000M\000a\000c\000h\000i\000n\000e\000\040\000L\000e\000a\000r\000n\000i\000n\000g\000\040\000e\000n\000c\000o\000u\000n\000t\000e\000r\000s}{chapter.13}% 14
+\BOOKMARK [1][-]{section.13.2}{\376\377\000D\000a\000t\000a\000\040\000A\000n\000a\000l\000y\000s\000i\000s\000\040\000a\000n\000d\000\040\000M\000a\000c\000h\000i\000n\000e\000\040\000L\000e\000a\000r\000n\000i\000n\000g\000:\000\040\000E\000l\000e\000m\000e\000n\000t\000s\000\040\000o\000f\000\040\000P\000r\000o\000b\000a\000b\000i\000l\000i\000t\000y\000\040\000T\000h\000e\000o\000r\000y\000\040\000a\000n\000d\000\040\000S\000t\000a\000t\000i\000s\000t\000i\000c\000a\000l\000\040\000D\000a\000t\000a\000\040\000A\000n\000a\000l\000y\000s\000i\000s}{chapter.13}% 15
+\BOOKMARK [1][-]{section.13.3}{\376\377\000R\000a\000n\000d\000o\000m\000\040\000N\000u\000m\000b\000e\000r\000s}{chapter.13}% 16
+\BOOKMARK [1][-]{section.13.4}{\376\377\000R\000a\000n\000d\000o\000m\000\040\000N\000u\000m\000b\000e\000r\000s\000,\000\040\000b\000e\000t\000t\000e\000r\000\040\000n\000a\000m\000e\000:\000\040\000p\000s\000e\000u\000d\000o\000\040\000r\000a\000n\000d\000o\000m\000\040\000n\000u\000m\000b\000e\000r\000s}{chapter.13}% 17
+\BOOKMARK [1][-]{section.13.5}{\376\377\000R\000a\000n\000d\000o\000m\000\040\000n\000u\000m\000b\000e\000r\000\040\000g\000e\000n\000e\000r\000a\000t\000o\000r\000\040\000R\000N\000G}{chapter.13}% 18
+\BOOKMARK [1][-]{section.13.6}{\376\377\000R\000a\000n\000d\000o\000m\000\040\000n\000u\000m\000b\000e\000r\000\040\000g\000e\000n\000e\000r\000a\000t\000o\000r\000\040\000R\000N\000G\000\040\000a\000n\000d\000\040\000p\000e\000r\000i\000o\000d\000i\000c\000\040\000o\000u\000t\000p\000u\000t\000s}{chapter.13}% 19
+\BOOKMARK [1][-]{section.13.7}{\376\377\000R\000a\000n\000d\000o\000m\000\040\000n\000u\000m\000b\000e\000r\000\040\000g\000e\000n\000e\000r\000a\000t\000o\000r\000\040\000R\000N\000G\000\040\000a\000n\000d\000\040\000i\000t\000s\000\040\000p\000e\000r\000i\000o\000d}{chapter.13}% 20
+\BOOKMARK [1][-]{section.13.8}{\376\377\000R\000a\000n\000d\000o\000m\000\040\000n\000u\000m\000b\000e\000r\000\040\000g\000e\000n\000e\000r\000a\000t\000o\000r\000\040\000R\000N\000G\000,\000\040\000o\000t\000h\000e\000r\000\040\000e\000x\000a\000m\000p\000l\000e\000s}{chapter.13}% 21
+\BOOKMARK [1][-]{section.13.9}{\376\377\000R\000a\000n\000d\000o\000m\000\040\000n\000u\000m\000b\000e\000r\000\040\000g\000e\000n\000e\000r\000a\000t\000o\000r\000\040\000R\000N\000G\000,\000\040\000o\000t\000h\000e\000r\000\040\000e\000x\000a\000m\000p\000l\000e\000s}{chapter.13}% 22
+\BOOKMARK [1][-]{section.13.10}{\376\377\000R\000a\000n\000d\000o\000m\000\040\000n\000u\000m\000b\000e\000r\000\040\000g\000e\000n\000e\000r\000a\000t\000o\000r\000\040\000R\000N\000G\000,\000\040\000R\000A\000N\0000}{chapter.13}% 23
+\BOOKMARK [1][-]{section.13.11}{\376\377\000R\000a\000n\000d\000o\000m\000\040\000n\000u\000m\000b\000e\000r\000\040\000g\000e\000n\000e\000r\000a\000t\000o\000r\000\040\000R\000N\000G\000,\000\040\000R\000A\000N\0000}{chapter.13}% 24
+\BOOKMARK [1][-]{section.13.12}{\376\377\000R\000a\000n\000d\000o\000m\000\040\000n\000u\000m\000b\000e\000r\000\040\000g\000e\000n\000e\000r\000a\000t\000o\000r\000\040\000R\000N\000G\000,\000\040\000R\000A\000N\0000}{chapter.13}% 25
+\BOOKMARK [1][-]{section.13.13}{\376\377\000R\000a\000n\000d\000o\000m\000\040\000n\000u\000m\000b\000e\000r\000\040\000g\000e\000n\000e\000r\000a\000t\000o\000r\000\040\000R\000N\000G\000,\000\040\000R\000A\000N\0000}{chapter.13}% 26
+\BOOKMARK [1][-]{section.13.14}{\376\377\000R\000a\000n\000d\000o\000m\000\040\000n\000u\000m\000b\000e\000r\000\040\000g\000e\000n\000e\000r\000a\000t\000o\000r\000\040\000R\000N\000G\000,\000\040\000R\000A\000N\0000\000\040\000c\000o\000d\000e}{chapter.13}% 27
+\BOOKMARK [1][-]{section.13.15}{\376\377\000W\000h\000i\000c\000h\000\040\000R\000N\000G\000\040\000s\000h\000o\000u\000l\000d\000\040\000I\000\040\000u\000s\000e\000?}{chapter.13}% 28
+\BOOKMARK [1][-]{section.13.16}{\376\377\000D\000a\000t\000a\000\040\000A\000n\000a\000l\000y\000s\000i\000s\000\040\000a\000n\000d\000\040\000M\000a\000c\000h\000i\000n\000e\000\040\000L\000e\000a\000r\000n\000i\000n\000g\000:\000\040\000L\000i\000n\000e\000a\000r\000\040\000R\000e\000g\000r\000e\000s\000s\000i\000o\000n\000\040\000a\000n\000d\000\040\000m\000o\000r\000e\000\040\000A\000d\000v\000a\000n\000c\000e\000d\000\040\000R\000e\000g\000r\000e\000s\000s\000i\000o\000n\000\040\000A\000n\000a\000l\000y\000s\000i\000s}{chapter.13}% 29
+\BOOKMARK [1][-]{section.13.17}{\376\377\000D\000a\000t\000a\000\040\000A\000n\000a\000l\000y\000s\000i\000s\000\040\000a\000n\000d\000\040\000M\000a\000c\000h\000i\000n\000e\000\040\000L\000e\000a\000r\000n\000i\000n\000g\000:\000\040\000L\000o\000g\000i\000s\000t\000i\000c\000\040\000R\000e\000g\000r\000e\000s\000s\000i\000o\000n}{chapter.13}% 30
@@ -0,0 +1,228 @@
+\select@language {english}
+\contentsline {chapter}{\numberline {1}Introduction}{3}{chapter.1}
+\contentsline {chapter}{\numberline {2}Learning outcomes}{5}{chapter.2}
+\contentsline {chapter}{\numberline {3}Machine Learning, a small (and probably biased) introduction}{7}{chapter.3}
+\contentsline {chapter}{\numberline {4}Machine Learning, an extremely rich field}{9}{chapter.4}
+\contentsline {chapter}{\numberline {5}A multidisciplinary approach}{11}{chapter.5}
+\contentsline {chapter}{\numberline {6}Types of Machine Learning}{13}{chapter.6}
+\contentsline {chapter}{\numberline {7}Essential elements of ML}{15}{chapter.7}
+\contentsline {chapter}{\numberline {8}An optimization/minimization problem}{17}{chapter.8}
+\contentsline {chapter}{\numberline {9}A Frequentist approach to data analysis}{19}{chapter.9}
+\contentsline {chapter}{\numberline {10}What is a good model?}{21}{chapter.10}
+\contentsline {chapter}{\numberline {11}What is a good model? Can we define it?}{23}{chapter.11}
+\contentsline {chapter}{\numberline {12}Choice of Programming Language}{25}{chapter.12}
+\contentsline {chapter}{\numberline {13}Data handling, machine learning and ethical aspects}{27}{chapter.13}
+\contentsline {section}{\numberline {13.1}Data Analysis and Machine Learning: Getting started, our first data and Machine Learning encounters}{28}{section.13.1}
+\contentsline {subsection}{\numberline {13.1.1}Introduction}{28}{subsection.13.1.1}
+\contentsline {subsection}{\numberline {13.1.2}What is Machine Learning?}{28}{subsection.13.1.2}
+\contentsline {subsection}{\numberline {13.1.3}Types of Machine Learning}{29}{subsection.13.1.3}
+\contentsline {subsection}{\numberline {13.1.4}Software and needed installations}{30}{subsection.13.1.4}
+\contentsline {subsection}{\numberline {13.1.5}Python installers}{30}{subsection.13.1.5}
+\contentsline {subsection}{\numberline {13.1.6}Useful Python libraries}{31}{subsection.13.1.6}
+\contentsline {subsection}{\numberline {13.1.7}Installing R, C++, cython or Julia}{31}{subsection.13.1.7}
+\contentsline {subsection}{\numberline {13.1.8}Installing R, C++, cython, Numba etc}{31}{subsection.13.1.8}
+\contentsline {subsection}{\numberline {13.1.9}Numpy examples and Important Matrix and vector handling packages}{32}{subsection.13.1.9}
+\contentsline {subsection}{\numberline {13.1.10}Basic Matrix Features}{32}{subsection.13.1.10}
+\contentsline {subsubsection}{Some famous Matrices}{32}{subsubsection*.3}
+\contentsline {subsubsection}{More Basic Matrix Features}{33}{subsubsection*.4}
+\contentsline {subsection}{\numberline {13.1.11}Numpy and arrays}{33}{subsection.13.1.11}
+\contentsline {subsection}{\numberline {13.1.12}Matrices in Python}{34}{subsection.13.1.12}
+\contentsline {subsection}{\numberline {13.1.13}Meet the Pandas}{38}{subsection.13.1.13}
+\contentsline {subsection}{\numberline {13.1.14}Reading Data and fitting}{43}{subsection.13.1.14}
+\contentsline {subsubsection}{Simple linear regression model using \sphinxstylestrong {scikit\sphinxhyphen {}learn}}{43}{subsubsection*.5}
+\contentsline {subsubsection}{To our real data: nuclear binding energies. Brief reminder on masses and binding energies}{51}{subsubsection*.6}
+\contentsline {subsubsection}{Organizing our data}{52}{subsubsection*.7}
+\contentsline {subsubsection}{Seeing the wood for the trees}{56}{subsubsection*.8}
+\contentsline {subsubsection}{And what about using neural networks?}{58}{subsubsection*.9}
+\contentsline {subsection}{\numberline {13.1.15}A first summary}{62}{subsection.13.1.15}
+\contentsline {section}{\numberline {13.2}Data Analysis and Machine Learning: Elements of Probability Theory and Statistical Data Analysis}{63}{section.13.2}
+\contentsline {subsection}{\numberline {13.2.1}To do list}{63}{subsection.13.2.1}
+\contentsline {subsection}{\numberline {13.2.2}Domains and probabilities}{63}{subsection.13.2.2}
+\contentsline {subsection}{\numberline {13.2.3}Tossing the dice}{63}{subsection.13.2.3}
+\contentsline {subsection}{\numberline {13.2.4}Stochastic variables}{63}{subsection.13.2.4}
+\contentsline {subsection}{\numberline {13.2.5}Stochastic variables and the main concepts, the discrete case}{64}{subsection.13.2.5}
+\contentsline {subsection}{\numberline {13.2.6}Stochastic variables and the main concepts, the continuous case}{64}{subsection.13.2.6}
+\contentsline {subsection}{\numberline {13.2.7}The cumulative probability}{64}{subsection.13.2.7}
+\contentsline {subsection}{\numberline {13.2.8}Properties of PDFs}{64}{subsection.13.2.8}
+\contentsline {subsection}{\numberline {13.2.9}Important distributions, the uniform distribution}{65}{subsection.13.2.9}
+\contentsline {subsection}{\numberline {13.2.10}Gaussian distribution}{65}{subsection.13.2.10}
+\contentsline {subsection}{\numberline {13.2.11}Exponential distribution}{67}{subsection.13.2.11}
+\contentsline {subsection}{\numberline {13.2.12}Expectation values}{67}{subsection.13.2.12}
+\contentsline {subsection}{\numberline {13.2.13}Stochastic variables and the main concepts, mean values}{67}{subsection.13.2.13}
+\contentsline {subsection}{\numberline {13.2.14}Stochastic variables and the main concepts, central moments, the variance}{67}{subsection.13.2.14}
+\contentsline {subsection}{\numberline {13.2.15}Probability Distribution Functions}{68}{subsection.13.2.15}
+\contentsline {subsection}{\numberline {13.2.16}Probability Distribution Functions}{68}{subsection.13.2.16}
+\contentsline {subsection}{\numberline {13.2.17}The three famous Probability Distribution Functions}{68}{subsection.13.2.17}
+\contentsline {subsection}{\numberline {13.2.18}Probability Distribution Functions, the normal distribution}{69}{subsection.13.2.18}
+\contentsline {subsection}{\numberline {13.2.19}Probability Distribution Functions, the normal distribution}{69}{subsection.13.2.19}
+\contentsline {subsection}{\numberline {13.2.20}Probability Distribution Functions, the cumulative distribution}{69}{subsection.13.2.20}
+\contentsline {subsection}{\numberline {13.2.21}Probability Distribution Functions, other important distribution}{70}{subsection.13.2.21}
+\contentsline {subsection}{\numberline {13.2.22}Probability Distribution Functions, the binomial distribution}{70}{subsection.13.2.22}
+\contentsline {subsection}{\numberline {13.2.23}Probability Distribution Functions, Poisson\IeC {\textquoteright }s distribution}{70}{subsection.13.2.23}
+\contentsline {subsection}{\numberline {13.2.24}Probability Distribution Functions, Poisson\IeC {\textquoteright }s distribution}{71}{subsection.13.2.24}
+\contentsline {subsection}{\numberline {13.2.25}Meet the covariance!}{71}{subsection.13.2.25}
+\contentsline {subsection}{\numberline {13.2.26}Meet the covariance in matrix disguise}{71}{subsection.13.2.26}
+\contentsline {subsection}{\numberline {13.2.27}Covariance}{72}{subsection.13.2.27}
+\contentsline {subsection}{\numberline {13.2.28}Meet the covariance, uncorrelated events}{73}{subsection.13.2.28}
+\contentsline {subsection}{\numberline {13.2.29}Numerical experiments and the covariance}{73}{subsection.13.2.29}
+\contentsline {subsection}{\numberline {13.2.30}Numerical experiments and the covariance}{73}{subsection.13.2.30}
+\contentsline {subsection}{\numberline {13.2.31}Numerical experiments and the covariance, actual situations}{73}{subsection.13.2.31}
+\contentsline {subsection}{\numberline {13.2.32}Numerical experiments and the covariance, our observables}{74}{subsection.13.2.32}
+\contentsline {subsection}{\numberline {13.2.33}Numerical experiments and the covariance, the sample variance}{74}{subsection.13.2.33}
+\contentsline {subsection}{\numberline {13.2.34}Numerical experiments and the covariance, central limit theorem}{75}{subsection.13.2.34}
+\contentsline {subsection}{\numberline {13.2.35}Definition of Correlation Functions and Standard Deviation}{75}{subsection.13.2.35}
+\contentsline {subsection}{\numberline {13.2.36}Definition of Correlation Functions and Standard Deviation}{75}{subsection.13.2.36}
+\contentsline {subsection}{\numberline {13.2.37}Definition of Correlation Functions and Standard Deviation}{75}{subsection.13.2.37}
+\contentsline {subsection}{\numberline {13.2.38}Definition of Correlation Functions and Standard Deviation}{76}{subsection.13.2.38}
+\contentsline {subsection}{\numberline {13.2.39}Definition of Correlation Functions and Standard Deviation, sample variance}{76}{subsection.13.2.39}
+\contentsline {subsection}{\numberline {13.2.40}Definition of Correlation Functions and Standard Deviation}{76}{subsection.13.2.40}
+\contentsline {subsection}{\numberline {13.2.41}Code to compute the Covariance matrix and the Covariance}{77}{subsection.13.2.41}
+\contentsline {section}{\numberline {13.3}Random Numbers}{78}{section.13.3}
+\contentsline {section}{\numberline {13.4}Random Numbers, better name: pseudo random numbers}{78}{section.13.4}
+\contentsline {section}{\numberline {13.5}Random number generator RNG}{78}{section.13.5}
+\contentsline {section}{\numberline {13.6}Random number generator RNG and periodic outputs}{78}{section.13.6}
+\contentsline {section}{\numberline {13.7}Random number generator RNG and its period}{79}{section.13.7}
+\contentsline {section}{\numberline {13.8}Random number generator RNG, other examples}{79}{section.13.8}
+\contentsline {section}{\numberline {13.9}Random number generator RNG, other examples}{79}{section.13.9}
+\contentsline {section}{\numberline {13.10}Random number generator RNG, RAN0}{80}{section.13.10}
+\contentsline {section}{\numberline {13.11}Random number generator RNG, RAN0}{80}{section.13.11}
+\contentsline {section}{\numberline {13.12}Random number generator RNG, RAN0}{80}{section.13.12}
+\contentsline {section}{\numberline {13.13}Random number generator RNG, RAN0}{81}{section.13.13}
+\contentsline {section}{\numberline {13.14}Random number generator RNG, RAN0 code}{81}{section.13.14}
+\contentsline {subsection}{\numberline {13.14.1}Properties of Selected Random Number Generators}{82}{subsection.13.14.1}
+\contentsline {subsection}{\numberline {13.14.2}Properties of Selected Random Number Generators}{82}{subsection.13.14.2}
+\contentsline {subsection}{\numberline {13.14.3}Properties of Selected Random Number Generators}{82}{subsection.13.14.3}
+\contentsline {subsection}{\numberline {13.14.4}Simple demonstration of RNGs using python}{82}{subsection.13.14.4}
+\contentsline {subsection}{\numberline {13.14.5}Properties of Selected Random Number Generators}{83}{subsection.13.14.5}
+\contentsline {subsection}{\numberline {13.14.6}Autocorrelation function}{83}{subsection.13.14.6}
+\contentsline {subsection}{\numberline {13.14.7}Correlation function and which random number generators should I use}{85}{subsection.13.14.7}
+\contentsline {section}{\numberline {13.15}Which RNG should I use?}{86}{section.13.15}
+\contentsline {subsection}{\numberline {13.15.1}How to use the Mersenne generator}{86}{subsection.13.15.1}
+\contentsline {subsection}{\numberline {13.15.2}Why blocking?}{86}{subsection.13.15.2}
+\contentsline {subsection}{\numberline {13.15.3}Why blocking?}{87}{subsection.13.15.3}
+\contentsline {subsection}{\numberline {13.15.4}Code to demonstrate the calculation of the autocorrelation function}{87}{subsection.13.15.4}
+\contentsline {subsection}{\numberline {13.15.5}What is blocking?}{89}{subsection.13.15.5}
+\contentsline {subsection}{\numberline {13.15.6}What is blocking?}{89}{subsection.13.15.6}
+\contentsline {subsection}{\numberline {13.15.7}What is blocking?}{89}{subsection.13.15.7}
+\contentsline {subsection}{\numberline {13.15.8}Implementation}{90}{subsection.13.15.8}
+\contentsline {subsection}{\numberline {13.15.9}Actual implementation with code, main function}{90}{subsection.13.15.9}
+\contentsline {subsection}{\numberline {13.15.10}The Bootstrap method}{91}{subsection.13.15.10}
+\contentsline {subsection}{\numberline {13.15.11}Bootstrapping}{91}{subsection.13.15.11}
+\contentsline {subsection}{\numberline {13.15.12}Bootstrapping, recipe}{91}{subsection.13.15.12}
+\contentsline {subsection}{\numberline {13.15.13}Bootstrapping, code}{92}{subsection.13.15.13}
+\contentsline {subsection}{\numberline {13.15.14}Jackknife, code}{92}{subsection.13.15.14}
+\contentsline {section}{\numberline {13.16}Data Analysis and Machine Learning: Linear Regression and more Advanced Regression Analysis}{92}{section.13.16}
+\contentsline {subsection}{\numberline {13.16.1}Why Linear Regression (aka Ordinary Least Squares and family)}{92}{subsection.13.16.1}
+\contentsline {subsection}{\numberline {13.16.2}Regression analysis, overarching aims}{93}{subsection.13.16.2}
+\contentsline {subsection}{\numberline {13.16.3}Regression analysis, overarching aims II}{93}{subsection.13.16.3}
+\contentsline {subsection}{\numberline {13.16.4}Examples}{93}{subsection.13.16.4}
+\contentsline {subsection}{\numberline {13.16.5}General linear models}{94}{subsection.13.16.5}
+\contentsline {subsection}{\numberline {13.16.6}Rewriting the fitting procedure as a linear algebra problem}{94}{subsection.13.16.6}
+\contentsline {subsection}{\numberline {13.16.7}Rewriting the fitting procedure as a linear algebra problem, more details}{94}{subsection.13.16.7}
+\contentsline {subsection}{\numberline {13.16.8}Generalizing the fitting procedure as a linear algebra problem}{95}{subsection.13.16.8}
+\contentsline {subsection}{\numberline {13.16.9}Generalizing the fitting procedure as a linear algebra problem}{95}{subsection.13.16.9}
+\contentsline {subsection}{\numberline {13.16.10}Optimizing our parameters}{95}{subsection.13.16.10}
+\contentsline {subsection}{\numberline {13.16.11}Our model for the nuclear binding energies}{96}{subsection.13.16.11}
+\contentsline {subsection}{\numberline {13.16.12}Optimizing our parameters, more details}{98}{subsection.13.16.12}
+\contentsline {subsection}{\numberline {13.16.13}Interpretations and optimizing our parameters}{98}{subsection.13.16.13}
+\contentsline {subsection}{\numberline {13.16.14}Interpretations and optimizing our parameters}{99}{subsection.13.16.14}
+\contentsline {subsection}{\numberline {13.16.15}Some useful matrix and vector expressions}{99}{subsection.13.16.15}
+\contentsline {subsection}{\numberline {13.16.16}Interpretations and optimizing our parameters}{99}{subsection.13.16.16}
+\contentsline {subsection}{\numberline {13.16.17}Own code for Ordinary Least Squares}{100}{subsection.13.16.17}
+\contentsline {subsection}{\numberline {13.16.18}Adding error analysis and training set up}{101}{subsection.13.16.18}
+\contentsline {subsection}{\numberline {13.16.19}The \(\chi ^2\) function}{101}{subsection.13.16.19}
+\contentsline {subsection}{\numberline {13.16.20}The \(\chi ^2\) function}{102}{subsection.13.16.20}
+\contentsline {subsection}{\numberline {13.16.21}The \(\chi ^2\) function}{102}{subsection.13.16.21}
+\contentsline {subsection}{\numberline {13.16.22}The \(\chi ^2\) function}{102}{subsection.13.16.22}
+\contentsline {subsection}{\numberline {13.16.23}The \(\chi ^2\) function}{103}{subsection.13.16.23}
+\contentsline {subsection}{\numberline {13.16.24}The \(\chi ^2\) function}{103}{subsection.13.16.24}
+\contentsline {subsection}{\numberline {13.16.25}Fitting an Equation of State for Dense Nuclear Matter}{104}{subsection.13.16.25}
+\contentsline {subsection}{\numberline {13.16.26}The code}{104}{subsection.13.16.26}
+\contentsline {subsection}{\numberline {13.16.27}Splitting our Data in Training and Test data}{106}{subsection.13.16.27}
+\contentsline {subsection}{\numberline {13.16.28}The Boston housing data example}{108}{subsection.13.16.28}
+\contentsline {subsection}{\numberline {13.16.29}Housing data, the code}{108}{subsection.13.16.29}
+\contentsline {subsection}{\numberline {13.16.30}Reducing the number of degrees of freedom, overarching view}{114}{subsection.13.16.30}
+\contentsline {subsection}{\numberline {13.16.31}Preprocessing our data}{114}{subsection.13.16.31}
+\contentsline {subsection}{\numberline {13.16.32}More preprocessing}{115}{subsection.13.16.32}
+\contentsline {subsection}{\numberline {13.16.33}Simple preprocessing examples, Franke function and regression}{115}{subsection.13.16.33}
+\contentsline {subsection}{\numberline {13.16.34}The singular value decomposition}{117}{subsection.13.16.34}
+\contentsline {subsection}{\numberline {13.16.35}Linear Regression Problems}{117}{subsection.13.16.35}
+\contentsline {subsection}{\numberline {13.16.36}Fixing the singularity}{118}{subsection.13.16.36}
+\contentsline {subsection}{\numberline {13.16.37}Basic math of the SVD}{118}{subsection.13.16.37}
+\contentsline {subsection}{\numberline {13.16.38}The SVD, a Fantastic Algorithm}{119}{subsection.13.16.38}
+\contentsline {subsection}{\numberline {13.16.39}Economy\sphinxhyphen {}size SVD}{119}{subsection.13.16.39}
+\contentsline {subsection}{\numberline {13.16.40}Codes for the SVD}{120}{subsection.13.16.40}
+\contentsline {subsection}{\numberline {13.16.41}Mathematical Properties}{121}{subsection.13.16.41}
+\contentsline {subsection}{\numberline {13.16.42}Ridge and LASSO Regression}{121}{subsection.13.16.42}
+\contentsline {subsection}{\numberline {13.16.43}More on Ridge Regression}{122}{subsection.13.16.43}
+\contentsline {subsection}{\numberline {13.16.44}Interpreting the Ridge results}{123}{subsection.13.16.44}
+\contentsline {subsection}{\numberline {13.16.45}More interpretations}{123}{subsection.13.16.45}
+\contentsline {subsection}{\numberline {13.16.46}A better understanding of regularization}{123}{subsection.13.16.46}
+\contentsline {subsection}{\numberline {13.16.47}Decomposing the OLS and Ridge expressions}{124}{subsection.13.16.47}
+\contentsline {subsection}{\numberline {13.16.48}Introducing the Covariance and Correlation functions}{124}{subsection.13.16.48}
+\contentsline {subsection}{\numberline {13.16.49}Correlation Function and Design/Feature Matrix}{125}{subsection.13.16.49}
+\contentsline {subsection}{\numberline {13.16.50}Covariance Matrix Examples}{125}{subsection.13.16.50}
+\contentsline {subsection}{\numberline {13.16.51}Correlation Matrix}{126}{subsection.13.16.51}
+\contentsline {subsection}{\numberline {13.16.52}Correlation Matrix with Pandas}{127}{subsection.13.16.52}
+\contentsline {subsection}{\numberline {13.16.53}Correlation Matrix with Pandas and the Franke function}{128}{subsection.13.16.53}
+\contentsline {subsection}{\numberline {13.16.54}Rewriting the Covariance and/or Correlation Matrix}{129}{subsection.13.16.54}
+\contentsline {subsection}{\numberline {13.16.55}Linking with SVD}{130}{subsection.13.16.55}
+\contentsline {subsection}{\numberline {13.16.56}Where are we going?}{130}{subsection.13.16.56}
+\contentsline {subsection}{\numberline {13.16.57}Resampling methods}{130}{subsection.13.16.57}
+\contentsline {subsection}{\numberline {13.16.58}Resampling approaches can be computationally expensive}{130}{subsection.13.16.58}
+\contentsline {subsection}{\numberline {13.16.59}Why resampling methods ?}{131}{subsection.13.16.59}
+\contentsline {subsection}{\numberline {13.16.60}Statistical analysis}{131}{subsection.13.16.60}
+\contentsline {subsection}{\numberline {13.16.61}Linking the regression analysis with a statistical interpretation}{131}{subsection.13.16.61}
+\contentsline {subsection}{\numberline {13.16.62}Assumptions made}{131}{subsection.13.16.62}
+\contentsline {subsection}{\numberline {13.16.63}Expectation value and variance}{132}{subsection.13.16.63}
+\contentsline {subsection}{\numberline {13.16.64}Expectation value and variance for \(\boldsymbol {\beta }\)}{132}{subsection.13.16.64}
+\contentsline {subsection}{\numberline {13.16.65}Resampling methods}{133}{subsection.13.16.65}
+\contentsline {subsection}{\numberline {13.16.66}Resampling methods: Jackknife and Bootstrap}{134}{subsection.13.16.66}
+\contentsline {subsection}{\numberline {13.16.67}Resampling methods: Jackknife}{134}{subsection.13.16.67}
+\contentsline {subsection}{\numberline {13.16.68}Jackknife code example}{134}{subsection.13.16.68}
+\contentsline {subsection}{\numberline {13.16.69}Resampling methods: Bootstrap}{135}{subsection.13.16.69}
+\contentsline {subsection}{\numberline {13.16.70}Resampling methods: Bootstrap background}{135}{subsection.13.16.70}
+\contentsline {subsection}{\numberline {13.16.71}Resampling methods: More Bootstrap background}{135}{subsection.13.16.71}
+\contentsline {subsection}{\numberline {13.16.72}Resampling methods: Bootstrap approach}{136}{subsection.13.16.72}
+\contentsline {subsection}{\numberline {13.16.73}Resampling methods: Bootstrap steps}{136}{subsection.13.16.73}
+\contentsline {subsection}{\numberline {13.16.74}Code example for the Bootstrap method}{136}{subsection.13.16.74}
+\contentsline {subsection}{\numberline {13.16.75}Various steps in cross\sphinxhyphen {}validation}{139}{subsection.13.16.75}
+\contentsline {subsection}{\numberline {13.16.76}How to set up the cross\sphinxhyphen {}validation for Ridge and/or Lasso}{139}{subsection.13.16.76}
+\contentsline {subsection}{\numberline {13.16.77}Cross\sphinxhyphen {}validation in brief}{140}{subsection.13.16.77}
+\contentsline {subsection}{\numberline {13.16.78}Code Example for Cross\sphinxhyphen {}validation and \(k\)\sphinxhyphen {}fold Cross\sphinxhyphen {}validation}{140}{subsection.13.16.78}
+\contentsline {subsection}{\numberline {13.16.79}The bias\sphinxhyphen {}variance tradeoff}{142}{subsection.13.16.79}
+\contentsline {subsection}{\numberline {13.16.80}Example code for Bias\sphinxhyphen {}Variance tradeoff}{143}{subsection.13.16.80}
+\contentsline {subsection}{\numberline {13.16.81}Understanding what happens}{144}{subsection.13.16.81}
+\contentsline {subsection}{\numberline {13.16.82}Summing up}{148}{subsection.13.16.82}
+\contentsline {subsection}{\numberline {13.16.83}Another Example from Scikit\sphinxhyphen {}Learn\IeC {\textquoteright }s Repository}{149}{subsection.13.16.83}
+\contentsline {subsection}{\numberline {13.16.84}More examples on bootstrap and cross\sphinxhyphen {}validation and errors}{150}{subsection.13.16.84}
+\contentsline {subsection}{\numberline {13.16.85}The same example but now with cross\sphinxhyphen {}validation}{151}{subsection.13.16.85}
+\contentsline {subsection}{\numberline {13.16.86}Cross\sphinxhyphen {}validation with Ridge}{153}{subsection.13.16.86}
+\contentsline {subsection}{\numberline {13.16.87}The Ising model}{154}{subsection.13.16.87}
+\contentsline {subsection}{\numberline {13.16.88}Reformulating the problem to suit regression}{154}{subsection.13.16.88}
+\contentsline {subsection}{\numberline {13.16.89}Linear regression}{155}{subsection.13.16.89}
+\contentsline {subsection}{\numberline {13.16.90}Singular Value decomposition}{156}{subsection.13.16.90}
+\contentsline {subsection}{\numberline {13.16.91}The one\sphinxhyphen {}dimensional Ising model}{157}{subsection.13.16.91}
+\contentsline {subsection}{\numberline {13.16.92}Ridge regression}{159}{subsection.13.16.92}
+\contentsline {subsection}{\numberline {13.16.93}LASSO regression}{159}{subsection.13.16.93}
+\contentsline {subsection}{\numberline {13.16.94}Performance as function of the regularization parameter}{160}{subsection.13.16.94}
+\contentsline {subsection}{\numberline {13.16.95}Finding the optimal value of \(\lambda \)}{161}{subsection.13.16.95}
+\contentsline {section}{\numberline {13.17}Data Analysis and Machine Learning: Logistic Regression}{161}{section.13.17}
+\contentsline {subsection}{\numberline {13.17.1}Logistic Regression}{162}{subsection.13.17.1}
+\contentsline {subsection}{\numberline {13.17.2}Optimization and Deep learning}{162}{subsection.13.17.2}
+\contentsline {subsection}{\numberline {13.17.3}Basics}{162}{subsection.13.17.3}
+\contentsline {subsection}{\numberline {13.17.4}Linear classifier}{163}{subsection.13.17.4}
+\contentsline {subsection}{\numberline {13.17.5}Some selected properties}{163}{subsection.13.17.5}
+\contentsline {subsection}{\numberline {13.17.6}The logistic function}{163}{subsection.13.17.6}
+\contentsline {subsection}{\numberline {13.17.7}Examples of likelihood functions used in logistic regression and nueral networks}{164}{subsection.13.17.7}
+\contentsline {subsection}{\numberline {13.17.8}Two parameters}{166}{subsection.13.17.8}
+\contentsline {subsection}{\numberline {13.17.9}Maximum likelihood}{166}{subsection.13.17.9}
+\contentsline {subsection}{\numberline {13.17.10}The cost function rewritten}{167}{subsection.13.17.10}
+\contentsline {subsection}{\numberline {13.17.11}Minimizing the cross entropy}{167}{subsection.13.17.11}
+\contentsline {subsection}{\numberline {13.17.12}A more compact expression}{167}{subsection.13.17.12}
+\contentsline {subsection}{\numberline {13.17.13}Extending to more predictors}{168}{subsection.13.17.13}
+\contentsline {subsection}{\numberline {13.17.14}Including more classes}{168}{subsection.13.17.14}
+\contentsline {subsection}{\numberline {13.17.15}More classes}{168}{subsection.13.17.15}
+\contentsline {subsection}{\numberline {13.17.16}A simple classification problem}{169}{subsection.13.17.16}
+\contentsline {subsection}{\numberline {13.17.17}The Credit Card example}{170}{subsection.13.17.17}
+\contentsline {subsection}{\numberline {13.17.18}How to read the Credit Card data}{170}{subsection.13.17.18}
@@ -0,0 +1,58 @@
+Traceback (most recent call last):
+  File "/Users/hjensen/opt/anaconda3/lib/python3.8/site-packages/jupyter_cache/executors/utils.py", line 51, in single_nb_execution
+    executenb(
+  File "/Users/hjensen/opt/anaconda3/lib/python3.8/site-packages/nbclient/client.py", line 1082, in execute
+    return NotebookClient(nb=nb, resources=resources, km=km, **kwargs).execute()
+  File "/Users/hjensen/opt/anaconda3/lib/python3.8/site-packages/nbclient/util.py", line 74, in wrapped
+    return just_run(coro(*args, **kwargs))
+  File "/Users/hjensen/opt/anaconda3/lib/python3.8/site-packages/nbclient/util.py", line 53, in just_run
+    return loop.run_until_complete(coro)
+  File "/Users/hjensen/opt/anaconda3/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
+    return future.result()
+  File "/Users/hjensen/opt/anaconda3/lib/python3.8/site-packages/nbclient/client.py", line 535, in async_execute
+    await self.async_execute_cell(
+  File "/Users/hjensen/opt/anaconda3/lib/python3.8/site-packages/nbclient/client.py", line 827, in async_execute_cell
+    self._check_raise_for_error(cell, exec_reply)
+  File "/Users/hjensen/opt/anaconda3/lib/python3.8/site-packages/nbclient/client.py", line 735, in _check_raise_for_error
+    raise CellExecutionError.from_cell_and_msg(cell, exec_reply['content'])
+nbclient.exceptions.CellExecutionError: An error occurred while executing the following cell:
+------------------
+# Blocking
+    @timeFunction
+    def blocking(self, blockSizeMax = 500):
+        blockSizeMin = 1
+
+        self.blockSizes = []
+        self.meanVec = []
+        self.varVec = []
+
+        for i in range(blockSizeMin, blockSizeMax):
+            if(len(self.data) % i != 0):
+                pass#continue
+            blockSize = i
+            meanTempVec = []
+            varTempVec = []
+            startPoint = 0
+            endPoint = blockSize
+
+            while endPoint <= len(self.data):
+                meanTempVec.append(np.average(self.data[startPoint:endPoint]))
+                startPoint = endPoint
+                endPoint += blockSize
+            mean, var = np.average(meanTempVec), np.var(meanTempVec)/len(meanTempVec)
+            self.meanVec.append(mean)
+            self.varVec.append(var)
+            self.blockSizes.append(blockSize)
+
+        self.blockingAvg = np.average(self.meanVec[-200:])
+        self.blockingVar = (np.average(self.varVec[-200:]))
+        self.blockingStd = np.sqrt(self.blockingVar)
+------------------
+
+[0;36m  File [0;32m"<ipython-input-6-2ff97f4bf03b>"[0;36m, line [0;32m2[0m
+[0;31m    @timeFunction[0m
+[0m    ^[0m
+[0;31mIndentationError[0m[0;31m:[0m unexpected indent
+
+IndentationError: unexpected indent (<ipython-input-6-2ff97f4bf03b>, line 2)
+
@@ -0,0 +1,165 @@
+Traceback (most recent call last):
+  File "/Users/hjensen/opt/anaconda3/lib/python3.8/site-packages/jupyter_cache/executors/utils.py", line 51, in single_nb_execution
+    executenb(
+  File "/Users/hjensen/opt/anaconda3/lib/python3.8/site-packages/nbclient/client.py", line 1082, in execute
+    return NotebookClient(nb=nb, resources=resources, km=km, **kwargs).execute()
+  File "/Users/hjensen/opt/anaconda3/lib/python3.8/site-packages/nbclient/util.py", line 74, in wrapped
+    return just_run(coro(*args, **kwargs))
+  File "/Users/hjensen/opt/anaconda3/lib/python3.8/site-packages/nbclient/util.py", line 53, in just_run
+    return loop.run_until_complete(coro)
+  File "/Users/hjensen/opt/anaconda3/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
+    return future.result()
+  File "/Users/hjensen/opt/anaconda3/lib/python3.8/site-packages/nbclient/client.py", line 535, in async_execute
+    await self.async_execute_cell(
+  File "/Users/hjensen/opt/anaconda3/lib/python3.8/site-packages/nbclient/client.py", line 827, in async_execute_cell
+    self._check_raise_for_error(cell, exec_reply)
+  File "/Users/hjensen/opt/anaconda3/lib/python3.8/site-packages/nbclient/client.py", line 735, in _check_raise_for_error
+    raise CellExecutionError.from_cell_and_msg(cell, exec_reply['content'])
+nbclient.exceptions.CellExecutionError: An error occurred while executing the following cell:
+------------------
+import pandas as pd
+import os
+import numpy as np
+
+
+from sklearn.model_selection import train_test_split
+from sklearn.preprocessing import OneHotEncoder
+from sklearn.compose import ColumnTransformer
+from sklearn.preprocessing import StandardScaler, OneHotEncoder
+from sklearn.metrics import confusion_matrix, accuracy_score, roc_auc_score
+
+# Trying to set the seed
+np.random.seed(0)
+import random
+random.seed(0)
+
+# Reading file into data frame
+cwd = os.getcwd()
+filename = cwd + '/default of credit card clients.xls'
+nanDict = {}
+df = pd.read_excel(filename, header=1, skiprows=0, index_col=0, na_values=nanDict)
+
+df.rename(index=str, columns={"default payment next month": "defaultPaymentNextMonth"}, inplace=True)
+
+# Features and targets 
+X = df.loc[:, df.columns != 'defaultPaymentNextMonth'].values
+y = df.loc[:, df.columns == 'defaultPaymentNextMonth'].values
+
+# Categorical variables to one-hot's
+onehotencoder = OneHotEncoder(categories="auto")
+
+X = ColumnTransformer(
+    [("", onehotencoder, [3]),],
+    remainder="passthrough"
+).fit_transform(X)
+
+y.shape
+
+# Train-test split
+trainingShare = 0.5 
+seed  = 1
+XTrain, XTest, yTrain, yTest=train_test_split(X, y, train_size=trainingShare, \
+                                              test_size = 1-trainingShare,
+                                             random_state=seed)
+
+# Input Scaling
+sc = StandardScaler()
+XTrain = sc.fit_transform(XTrain)
+XTest = sc.transform(XTest)
+
+# One-hot's of the target vector
+Y_train_onehot, Y_test_onehot = onehotencoder.fit_transform(yTrain), onehotencoder.fit_transform(yTest)
+
+# Remove instances with zeros only for past bill statements or paid amounts
+'''
+df = df.drop(df[(df.BILL_AMT1 == 0) &
+                (df.BILL_AMT2 == 0) &
+                (df.BILL_AMT3 == 0) &
+                (df.BILL_AMT4 == 0) &
+                (df.BILL_AMT5 == 0) &
+                (df.BILL_AMT6 == 0) &
+                (df.PAY_AMT1 == 0) &
+                (df.PAY_AMT2 == 0) &
+                (df.PAY_AMT3 == 0) &
+                (df.PAY_AMT4 == 0) &
+                (df.PAY_AMT5 == 0) &
+                (df.PAY_AMT6 == 0)].index)
+'''
+df = df.drop(df[(df.BILL_AMT1 == 0) &
+                (df.BILL_AMT2 == 0) &
+                (df.BILL_AMT3 == 0) &
+                (df.BILL_AMT4 == 0) &
+                (df.BILL_AMT5 == 0) &
+                (df.BILL_AMT6 == 0)].index)
+
+df = df.drop(df[(df.PAY_AMT1 == 0) &
+                (df.PAY_AMT2 == 0) &
+                (df.PAY_AMT3 == 0) &
+                (df.PAY_AMT4 == 0) &
+                (df.PAY_AMT5 == 0) &
+                (df.PAY_AMT6 == 0)].index)
+
+from sklearn.linear_model import LogisticRegression
+from sklearn.model_selection import GridSearchCV
+
+lambdas=np.logspace(-5,7,13)
+parameters = [{'C': 1./lambdas, "solver":["lbfgs"]}]#*len(parameters)}]
+scoring = ['accuracy', 'roc_auc']
+logReg = LogisticRegression()
+gridSearch = GridSearchCV(logReg, parameters, cv=5, scoring=scoring, refit='roc_auc')
+------------------
+
+[0;31m---------------------------------------------------------------------------[0m
+[0;31mFileNotFoundError[0m                         Traceback (most recent call last)
+[0;32m<ipython-input-4-4edad39a9543>[0m in [0;36m<module>[0;34m[0m
+[1;32m     19[0m [0mfilename[0m [0;34m=[0m [0mcwd[0m [0;34m+[0m [0;34m'/default of credit card clients.xls'[0m[0;34m[0m[0;34m[0m[0m
+[1;32m     20[0m [0mnanDict[0m [0;34m=[0m [0;34m{[0m[0;34m}[0m[0;34m[0m[0;34m[0m[0m
+[0;32m---> 21[0;31m [0mdf[0m [0;34m=[0m [0mpd[0m[0;34m.[0m[0mread_excel[0m[0;34m([0m[0mfilename[0m[0;34m,[0m [0mheader[0m[0;34m=[0m[0;36m1[0m[0;34m,[0m [0mskiprows[0m[0;34m=[0m[0;36m0[0m[0;34m,[0m [0mindex_col[0m[0;34m=[0m[0;36m0[0m[0;34m,[0m [0mna_values[0m[0;34m=[0m[0mnanDict[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
+[0m[1;32m     22[0m [0;34m[0m[0m
+[1;32m     23[0m [0mdf[0m[0;34m.[0m[0mrename[0m[0;34m([0m[0mindex[0m[0;34m=[0m[0mstr[0m[0;34m,[0m [0mcolumns[0m[0;34m=[0m[0;34m{[0m[0;34m"default payment next month"[0m[0;34m:[0m [0;34m"defaultPaymentNextMonth"[0m[0;34m}[0m[0;34m,[0m [0minplace[0m[0;34m=[0m[0;32mTrue[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
+
+[0;32m~/opt/anaconda3/lib/python3.8/site-packages/pandas/io/excel/_base.py[0m in [0;36mread_excel[0;34m(io, sheet_name, header, names, index_col, usecols, squeeze, dtype, engine, converters, true_values, false_values, skiprows, nrows, na_values, keep_default_na, verbose, parse_dates, date_parser, thousands, comment, skipfooter, convert_float, mangle_dupe_cols, **kwds)[0m
+[1;32m    302[0m [0;34m[0m[0m
+[1;32m    303[0m     [0;32mif[0m [0;32mnot[0m [0misinstance[0m[0;34m([0m[0mio[0m[0;34m,[0m [0mExcelFile[0m[0;34m)[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
+[0;32m--> 304[0;31m         [0mio[0m [0;34m=[0m [0mExcelFile[0m[0;34m([0m[0mio[0m[0;34m,[0m [0mengine[0m[0;34m=[0m[0mengine[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
+[0m[1;32m    305[0m     [0;32melif[0m [0mengine[0m [0;32mand[0m [0mengine[0m [0;34m!=[0m [0mio[0m[0;34m.[0m[0mengine[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
+[1;32m    306[0m         raise ValueError(
+
+[0;32m~/opt/anaconda3/lib/python3.8/site-packages/pandas/io/excel/_base.py[0m in [0;36m__init__[0;34m(self, io, engine)[0m
+[1;32m    822[0m         [0mself[0m[0;34m.[0m[0m_io[0m [0;34m=[0m [0mstringify_path[0m[0;34m([0m[0mio[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
+[1;32m    823[0m [0;34m[0m[0m
+[0;32m--> 824[0;31m         [0mself[0m[0;34m.[0m[0m_reader[0m [0;34m=[0m [0mself[0m[0;34m.[0m[0m_engines[0m[0;34m[[0m[0mengine[0m[0;34m][0m[0;34m([0m[0mself[0m[0;34m.[0m[0m_io[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
+[0m[1;32m    825[0m [0;34m[0m[0m
+[1;32m    826[0m     [0;32mdef[0m [0m__fspath__[0m[0;34m([0m[0mself[0m[0;34m)[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
+
+[0;32m~/opt/anaconda3/lib/python3.8/site-packages/pandas/io/excel/_xlrd.py[0m in [0;36m__init__[0;34m(self, filepath_or_buffer)[0m
+[1;32m     19[0m         [0merr_msg[0m [0;34m=[0m [0;34m"Install xlrd >= 1.0.0 for Excel support"[0m[0;34m[0m[0;34m[0m[0m
+[1;32m     20[0m         [0mimport_optional_dependency[0m[0;34m([0m[0;34m"xlrd"[0m[0;34m,[0m [0mextra[0m[0;34m=[0m[0merr_msg[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
+[0;32m---> 21[0;31m         [0msuper[0m[0;34m([0m[0;34m)[0m[0;34m.[0m[0m__init__[0m[0;34m([0m[0mfilepath_or_buffer[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
+[0m[1;32m     22[0m [0;34m[0m[0m
+[1;32m     23[0m     [0;34m@[0m[0mproperty[0m[0;34m[0m[0;34m[0m[0m
+
+[0;32m~/opt/anaconda3/lib/python3.8/site-packages/pandas/io/excel/_base.py[0m in [0;36m__init__[0;34m(self, filepath_or_buffer)[0m
+[1;32m    351[0m             [0mself[0m[0;34m.[0m[0mbook[0m [0;34m=[0m [0mself[0m[0;34m.[0m[0mload_workbook[0m[0;34m([0m[0mfilepath_or_buffer[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
+[1;32m    352[0m         [0;32melif[0m [0misinstance[0m[0;34m([0m[0mfilepath_or_buffer[0m[0;34m,[0m [0mstr[0m[0;34m)[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
+[0;32m--> 353[0;31m             [0mself[0m[0;34m.[0m[0mbook[0m [0;34m=[0m [0mself[0m[0;34m.[0m[0mload_workbook[0m[0;34m([0m[0mfilepath_or_buffer[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
+[0m[1;32m    354[0m         [0;32melif[0m [0misinstance[0m[0;34m([0m[0mfilepath_or_buffer[0m[0;34m,[0m [0mbytes[0m[0;34m)[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
+[1;32m    355[0m             [0mself[0m[0;34m.[0m[0mbook[0m [0;34m=[0m [0mself[0m[0;34m.[0m[0mload_workbook[0m[0;34m([0m[0mBytesIO[0m[0;34m([0m[0mfilepath_or_buffer[0m[0;34m)[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
+
+[0;32m~/opt/anaconda3/lib/python3.8/site-packages/pandas/io/excel/_xlrd.py[0m in [0;36mload_workbook[0;34m(self, filepath_or_buffer)[0m
+[1;32m     34[0m             [0;32mreturn[0m [0mopen_workbook[0m[0;34m([0m[0mfile_contents[0m[0;34m=[0m[0mdata[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
+[1;32m     35[0m         [0;32melse[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
+[0;32m---> 36[0;31m             [0;32mreturn[0m [0mopen_workbook[0m[0;34m([0m[0mfilepath_or_buffer[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
+[0m[1;32m     37[0m [0;34m[0m[0m
+[1;32m     38[0m     [0;34m@[0m[0mproperty[0m[0;34m[0m[0;34m[0m[0m
+
+[0;32m~/opt/anaconda3/lib/python3.8/site-packages/xlrd/__init__.py[0m in [0;36mopen_workbook[0;34m(filename, logfile, verbosity, use_mmap, file_contents, encoding_override, formatting_info, on_demand, ragged_rows)[0m
+[1;32m    109[0m     [0;32melse[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
+[1;32m    110[0m         [0mfilename[0m [0;34m=[0m [0mos[0m[0;34m.[0m[0mpath[0m[0;34m.[0m[0mexpanduser[0m[0;34m([0m[0mfilename[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
+[0;32m--> 111[0;31m         [0;32mwith[0m [0mopen[0m[0;34m([0m[0mfilename[0m[0;34m,[0m [0;34m"rb"[0m[0;34m)[0m [0;32mas[0m [0mf[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
+[0m[1;32m    112[0m             [0mpeek[0m [0;34m=[0m [0mf[0m[0;34m.[0m[0mread[0m[0;34m([0m[0mpeeksz[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
+[1;32m    113[0m     [0;32mif[0m [0mpeek[0m [0;34m==[0m [0;34mb"PK\x03\x04"[0m[0;34m:[0m [0;31m# a ZIP file[0m[0;34m[0m[0;34m[0m[0m
+
+[0;31mFileNotFoundError[0m: [Errno 2] No such file or directory: '/Users/hjensen/Teaching/FYS-STK4150/doc/src/LectureNotes/default of credit card clients.xls'
+FileNotFoundError: [Errno 2] No such file or directory: '/Users/hjensen/Teaching/FYS-STK4150/doc/src/LectureNotes/default of credit card clients.xls'
+
@@ -1,82 +0,0 @@
-Traceback (most recent call last):
-<<<<<<< HEAD
-  File "/Users/MortenImac/anaconda3/lib/python3.6/site-packages/jupyter_cache/executors/utils.py", line 56, in single_nb_execution
-    record_timing=False,
-  File "/Users/MortenImac/anaconda3/lib/python3.6/site-packages/nbclient/client.py", line 1082, in execute
-    return NotebookClient(nb=nb, resources=resources, km=km, **kwargs).execute()
-  File "/Users/MortenImac/anaconda3/lib/python3.6/site-packages/nbclient/util.py", line 74, in wrapped
-    return just_run(coro(*args, **kwargs))
-  File "/Users/MortenImac/anaconda3/lib/python3.6/site-packages/nbclient/util.py", line 53, in just_run
-    return loop.run_until_complete(coro)
-  File "/Users/MortenImac/anaconda3/lib/python3.6/asyncio/base_events.py", line 484, in run_until_complete
-    return future.result()
-  File "/Users/MortenImac/anaconda3/lib/python3.6/site-packages/nbclient/client.py", line 536, in async_execute
-    cell, index, execution_count=self.code_cells_executed + 1
-  File "/Users/MortenImac/anaconda3/lib/python3.6/site-packages/nbclient/client.py", line 827, in async_execute_cell
-    self._check_raise_for_error(cell, exec_reply)
-  File "/Users/MortenImac/anaconda3/lib/python3.6/site-packages/nbclient/client.py", line 735, in _check_raise_for_error
-=======
-  File "/Users/hjensen/opt/anaconda3/lib/python3.8/site-packages/jupyter_cache/executors/utils.py", line 51, in single_nb_execution
-    executenb(
-  File "/Users/hjensen/opt/anaconda3/lib/python3.8/site-packages/nbclient/client.py", line 1082, in execute
-    return NotebookClient(nb=nb, resources=resources, km=km, **kwargs).execute()
-  File "/Users/hjensen/opt/anaconda3/lib/python3.8/site-packages/nbclient/util.py", line 74, in wrapped
-    return just_run(coro(*args, **kwargs))
-  File "/Users/hjensen/opt/anaconda3/lib/python3.8/site-packages/nbclient/util.py", line 53, in just_run
-    return loop.run_until_complete(coro)
-  File "/Users/hjensen/opt/anaconda3/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
-    return future.result()
-  File "/Users/hjensen/opt/anaconda3/lib/python3.8/site-packages/nbclient/client.py", line 535, in async_execute
-    await self.async_execute_cell(
-  File "/Users/hjensen/opt/anaconda3/lib/python3.8/site-packages/nbclient/client.py", line 827, in async_execute_cell
-    self._check_raise_for_error(cell, exec_reply)
-  File "/Users/hjensen/opt/anaconda3/lib/python3.8/site-packages/nbclient/client.py", line 735, in _check_raise_for_error
->>>>>>> 490fdaaefb7f465badc10b38c531979d063d6c64
-    raise CellExecutionError.from_cell_and_msg(cell, exec_reply['content'])
-nbclient.exceptions.CellExecutionError: An error occurred while executing the following cell:
------------------
-# Common imports
-import numpy as np
-import pandas as pd
-import matplotlib.pyplot as plt
-import sklearn.linear_model as skl
-from sklearn.model_selection import train_test_split
-from sklearn.metrics import mean_squared_error, r2_score, mean_absolute_error
-import os
-
-# Where to save the figures and data files
-PROJECT_ROOT_DIR = "Results"
-FIGURE_ID = "Results/FigureFiles"
-DATA_ID = "DataFiles/"
-
-if not os.path.exists(PROJECT_ROOT_DIR):
-    os.mkdir(PROJECT_ROOT_DIR)
-
-if not os.path.exists(FIGURE_ID):
-    os.makedirs(FIGURE_ID)
-
-if not os.path.exists(DATA_ID):
-    os.makedirs(DATA_ID)
-
-def image_path(fig_id):
-    return os.path.join(FIGURE_ID, fig_id)
-
-def data_path(dat_id):
-    return os.path.join(DATA_ID, dat_id)
-
-def save_fig(fig_id):
-    plt.savefig(image_path(fig_id) + ".png", format='png')
-
-infile = open(data_path("MassEval2016.dat"),'r')
------------------
-
-[0;31m---------------------------------------------------------------------------[0m
-[0;31mFileNotFoundError[0m                         Traceback (most recent call last)
-[0;32m<ipython-input-28-3cd19a0768e1>[0m in [0;36m<module>[0;34m[0m
-[1;32m     31[0m     [0mplt[0m[0;34m.[0m[0msavefig[0m[0;34m([0m[0mimage_path[0m[0;34m([0m[0mfig_id[0m[0;34m)[0m [0;34m+[0m [0;34m".png"[0m[0;34m,[0m [0mformat[0m[0;34m=[0m[0;34m'png'[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
-[1;32m     32[0m [0;34m[0m[0m
-[0;32m---> 33[0;31m [0minfile[0m [0;34m=[0m [0mopen[0m[0;34m([0m[0mdata_path[0m[0;34m([0m[0;34m"MassEval2016.dat"[0m[0;34m)[0m[0;34m,[0m[0;34m'r'[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
-[0m
-[0;31mFileNotFoundError[0m: [Errno 2] No such file or directory: 'DataFiles/MassEval2016.dat'
-FileNotFoundError: [Errno 2] No such file or directory: 'DataFiles/MassEval2016.dat'
-
@@ -0,0 +1,230 @@
+;;; -*- mode: lisp; coding: utf-8; -*-
+
+;; Unfortunately xindy is out-of-the-box hyperref-incompatible.  This
+;; configuration is a workaround, which requires to pass option
+;; hyperindex=false to hyperref.
+;; textit and emph not currently used, spxpagem replaces former textbf
+(define-attributes (("textbf" "textit" "emph" "spxpagem" "default")))
+(markup-locref :open "\textbf{\hyperpage{" :close "}}" :attr "textbf")
+(markup-locref :open "\textit{\hyperpage{" :close "}}" :attr "textit")
+(markup-locref :open "\emph{\hyperpage{" :close "}}" :attr "emph")
+(markup-locref :open "\spxpagem{\hyperpage{" :close "}}" :attr "spxpagem")
+(markup-locref :open "\hyperpage{" :close "}" :attr "default")
+
+(require "numeric-sort.xdy")
+
+;; xindy base module latex.xdy loads tex.xdy and the latter instructs
+;; xindy to ignore **all** TeX macros in .idx entries, except those
+;; explicitely described in merge rule.  But when after applying all
+;; merge rules an empty string results, xindy raises an error:
+
+;;   ERROR: CHAR: index 0 should be less than the length of the string
+
+;; For example when using pdflatex with utf-8 characters the index
+;; file will contain \IeC macros and they will get ignored except if
+;; suitable merge rules are loaded early.  The texindy script coming
+;; with xindy provides this, but only for Latin scripts.  The texindy
+;; man page says to use rather xelatex or lualatex in case of Cyrillic
+;; scripts.
+
+;; Sphinx contributes LICRcyr2utf8.xdy to provide support for Cyrillic
+;; scripts for the pdflatex engine.
+
+;; Another issue caused by xindy ignoring all TeX macros except those
+;; explicitely declared reveals itself when attempting to index ">>>",
+;; as the ">" is converted to "\textgreater{}" by Sphinx's LaTeX
+;; escaping.
+
+;; To fix this, Sphinx does **not** use texindy, and does not even
+;; load the xindy latex.xdy base module.
+
+;(require "latex.xdy")
+
+;; Rather it incorporates some suitable extracts from latex.xdy and
+;; tex.xdy with additional Sphinx contributed rules.
+
+;; But, this means for pdflatex and Latin scripts that the xindy file
+;; tex/inputenc/uf8.xdy is not usable because it refers to the macro
+;; \IeC only sporadically, and as tex.xdy is not loaded, a rule such as
+;;     (merge-rule "\'e" "é" :string)
+;; does not work, it must be
+;;     (merge-rule "\IeC {\'e}" "é" :string)
+;; So Sphinx contributes LICRlatin2utf8.xdy to mitigate that problem.
+
+;;;;;;;; extracts from tex.xdy (discarding most original comments):
+
+;;;
+;;; TeX conventions
+;;;
+
+;; Discard leading and trailing white space. Collapse multiple white
+;; space characters to blank.
+
+(merge-rule "^ +" "" :eregexp)
+(merge-rule " +$" "" :eregexp)
+(merge-rule "  +" " " :eregexp)
+
+;; Handle TeX markup
+
+(merge-rule "\\([{}$%&#])" "\1" :eregexp)
+
+;;;;;;;; end of extracts from xindy's tex.xdy
+
+;;;;;;;; extracts from latex.xdy:
+
+;; Standard location classes: arabic and roman numbers, and alphabets.
+
+(define-location-class "arabic-page-numbers" ("arabic-numbers"))
+(define-location-class "roman-page-numbers"  ("roman-numbers-lowercase"))
+(define-location-class "Roman-page-numbers"  ("roman-numbers-uppercase"))
+(define-location-class "alpha-page-numbers"  ("alpha"))
+(define-location-class "Alpha-page-numbers"  ("ALPHA"))
+
+;; Output Markup
+
+(markup-letter-group-list :sep "~n~n  \indexspace~n")
+
+(markup-indexentry :open "~n  \item "           :depth 0)
+(markup-indexentry :open "~n    \subitem "      :depth 1)
+(markup-indexentry :open "~n      \subsubitem " :depth 2)
+
+(markup-locclass-list :open ", " :sep ", ")
+(markup-locref-list   :sep ", ")
+
+;;;;;;;; end of extracts from latex.xdy
+
+;; The LaTeX \index command turns \ into normal character so the TeX macros
+;; written to .idx files are not followed by a blank. This is different
+;; from non-ascii letters which end up (with pdflatex) as \IeC macros in .idx
+;; file, with a blank space after \IeC
+
+;; Details of the syntax are explained at
+;;     http://xindy.sourceforge.net/doc/manual-3.html
+;; In absence of :string, "xindy uses an auto-detection mechanism to decide,
+;; if the pattern is a regular expression or not". But it is not obvious to
+;; guess, for example "\\_" is not detected as RE but "\\P\{\}" is, so for
+;; being sure we apply the :string switch everywhere and do not use \\ etc...
+
+;; Go back from sphinx.util.texescape TeX macros to UTF-8
+
+(merge-rule "\sphinxleftcurlybrace{}" "{" :string)
+(merge-rule "\sphinxrightcurlybrace{}" "}" :string)
+(merge-rule "\_" "_" :string)
+(merge-rule "{[}" "[" :string)
+(merge-rule "{]}" "]" :string)
+(merge-rule "\textbackslash{}" "\" :string)  ; " for Emacs syntax highlighting
+(merge-rule "\textasciitilde{}" "~~" :string); the ~~ escape is needed here
+(merge-rule "\textasciicircum{}" "^" :string)
+(merge-rule "\sphinxhyphen{}" "-" :string)
+(merge-rule "\textquotesingle{}" "'" :string)
+(merge-rule "\textasciigrave{}" "`" :string)
+(merge-rule "\textless{}" "<" :string)
+(merge-rule "\textgreater{}" ">" :string)
+(merge-rule "\P{}" "¶" :string)
+(merge-rule "\S{}" "§" :string)
+(merge-rule "\texteuro{}" "€" :string)
+(merge-rule "\(\infty\)" "∞" :string)
+(merge-rule "\(\pm\)" "±" :string)
+(merge-rule "\(\rightarrow\)" "→" :string)
+(merge-rule "\(\checkmark\)" "✓" :string)
+(merge-rule "\textendash{}" "–" :string)
+(merge-rule "\textbar{}" "|" :string)
+(merge-rule "\(\sp{\text{0}}\)" "⁰" :string)
+(merge-rule "\(\sp{\text{1}}\)" "¹" :string)
+(merge-rule "\(\sp{\text{2}}\)" "²" :string)
+(merge-rule "\(\sp{\text{3}}\)" "³" :string)
+(merge-rule "\(\sp{\text{4}}\)" "⁴" :string)
+(merge-rule "\(\sp{\text{5}}\)" "⁵" :string)
+(merge-rule "\(\sp{\text{6}}\)" "⁶" :string)
+(merge-rule "\(\sp{\text{7}}\)" "⁷" :string)
+(merge-rule "\(\sp{\text{8}}\)" "⁸" :string)
+(merge-rule "\(\sp{\text{9}}\)" "⁹" :string)
+(merge-rule "\(\sb{\text{0}}\)" "₀" :string)
+(merge-rule "\(\sb{\text{1}}\)" "₁" :string)
+(merge-rule "\(\sb{\text{2}}\)" "₂" :string)
+(merge-rule "\(\sb{\text{3}}\)" "₃" :string)
+(merge-rule "\(\sb{\text{4}}\)" "₄" :string)
+(merge-rule "\(\sb{\text{5}}\)" "₅" :string)
+(merge-rule "\(\sb{\text{6}}\)" "₆" :string)
+(merge-rule "\(\sb{\text{7}}\)" "₇" :string)
+(merge-rule "\(\sb{\text{8}}\)" "₈" :string)
+(merge-rule "\(\sb{\text{9}}\)" "₉" :string)
+(merge-rule "\IeC {\textalpha }" "α" :string)
+(merge-rule "\IeC {\textbeta }" "β" :string)
+(merge-rule "\IeC {\textgamma }" "γ" :string)
+(merge-rule "\IeC {\textdelta }" "δ" :string)
+(merge-rule "\IeC {\textepsilon }" "ε" :string)
+(merge-rule "\IeC {\textzeta }" "ζ" :string)
+(merge-rule "\IeC {\texteta }" "η" :string)
+(merge-rule "\IeC {\texttheta }" "θ" :string)
+(merge-rule "\IeC {\textiota }" "ι" :string)
+(merge-rule "\IeC {\textkappa }" "κ" :string)
+(merge-rule "\IeC {\textlambda }" "λ" :string)
+(merge-rule "\IeC {\textmu }" "μ" :string)
+(merge-rule "\IeC {\textnu }" "ν" :string)
+(merge-rule "\IeC {\textxi }" "ξ" :string)
+(merge-rule "\IeC {\textomicron }" "ο" :string)
+(merge-rule "\IeC {\textpi }" "π" :string)
+(merge-rule "\IeC {\textrho }" "ρ" :string)
+(merge-rule "\IeC {\textsigma }" "σ" :string)
+(merge-rule "\IeC {\texttau }" "τ" :string)
+(merge-rule "\IeC {\textupsilon }" "υ" :string)
+(merge-rule "\IeC {\textphi }" "φ" :string)
+(merge-rule "\IeC {\textchi }" "χ" :string)
+(merge-rule "\IeC {\textpsi }" "ψ" :string)
+(merge-rule "\IeC {\textomega }" "ω" :string)
+(merge-rule "\IeC {\textAlpha }" "Α" :string)
+(merge-rule "\IeC {\textBeta }" "Β" :string)
+(merge-rule "\IeC {\textGamma }" "Γ" :string)
+(merge-rule "\IeC {\textDelta }" "Δ" :string)
+(merge-rule "\IeC {\textEpsilon }" "Ε" :string)
+(merge-rule "\IeC {\textZeta }" "Ζ" :string)
+(merge-rule "\IeC {\textEta }" "Η" :string)
+(merge-rule "\IeC {\textTheta }" "Θ" :string)
+(merge-rule "\IeC {\textIota }" "Ι" :string)
+(merge-rule "\IeC {\textKappa }" "Κ" :string)
+(merge-rule "\IeC {\textLambda }" "Λ" :string)
+(merge-rule "\IeC {\textMu }" "Μ" :string)
+(merge-rule "\IeC {\textNu }" "Ν" :string)
+(merge-rule "\IeC {\textTheta }" "Θ" :string)
+(merge-rule "\IeC {\textIota }" "Ι" :string)
+(merge-rule "\IeC {\textKappa }" "Κ" :string)
+(merge-rule "\IeC {\textLambda }" "Λ" :string)
+(merge-rule "\IeC {\textMu }" "Μ" :string)
+(merge-rule "\IeC {\textNu }" "Ν" :string)
+(merge-rule "\IeC {\textXi }" "Ξ" :string)
+(merge-rule "\IeC {\textOmicron }" "Ο" :string)
+(merge-rule "\IeC {\textPi }" "Π" :string)
+(merge-rule "\IeC {\textRho }" "Ρ" :string)
+(merge-rule "\IeC {\textSigma }" "Σ" :string)
+(merge-rule "\IeC {\textTau }" "Τ" :string)
+(merge-rule "\IeC {\textUpsilon }" "Υ" :string)
+(merge-rule "\IeC {\textPhi }" "Φ" :string)
+(merge-rule "\IeC {\textChi }" "Χ" :string)
+(merge-rule "\IeC {\textPsi }" "Ψ" :string)
+(merge-rule "\IeC {\textOmega }" "Ω" :string)
+(merge-rule "\IeC {\textohm }" "Ω" :string)
+
+;; This xindy module provides some basic support for "see"
+(require "makeindex.xdy")
+
+;; This creates one-letter headings and works fine with utf-8 letters.
+;; For Cyrillic with pdflatex works thanks to LICRcyr2utf8.xdy
+(require "latin-lettergroups.xdy")
+
+;; currently we don't (know how to easily) separate "Numbers" from
+;; "Symbols" with xindy as is the case with makeindex.
+(markup-index :open  "\begin{sphinxtheindex}
+\let\lettergroup\sphinxstyleindexlettergroup
+\let\lettergroupDefault\sphinxstyleindexlettergroupDefault
+\let\spxpagem\sphinxstyleindexpagemain
+\let\spxentry\sphinxstyleindexentry
+\let\spxextra\sphinxstyleindexextra
+
+"
+	      :close "
+
+\end{sphinxtheindex}
+"
+	      :tree)
+
@@ -0,0 +1,55 @@
+%% CYRILLIC IN NON-CYRILLIC DOCUMENTS (pdflatex only)
+%
+% refs: https://tex.stackexchange.com/q/460271/
+\ProvidesPackage{sphinxcyrillic}%
+  [2018/11/21 v2.0 support for Cyrillic in non-Cyrillic documents]
+\RequirePackage{kvoptions}
+\SetupKeyvalOptions{prefix=spx@cyropt@} % use \spx@cyropt@ prefix
+\DeclareBoolOption[false]{Xtwo}
+\DeclareBoolOption[false]{TtwoA}
+\DeclareDefaultOption{\@unknownoptionerror}
+\ProcessLocalKeyvalOptions* % ignore class options
+
+\ifspx@cyropt@Xtwo
+% original code by tex.sx user egreg (updated 2019/10/28):
+%   https://tex.stackexchange.com/a/460325/
+% 159 Cyrillic glyphs as available in X2 TeX 8bit font encoding
+% This assumes inputenc loaded with utf8 option, or LaTeX release
+% as recent as 2018/04/01 which does it automatically. 
+  \@tfor\next:=%
+    {Ё}{Ђ}{Є}{Ѕ}{І}{Ј}{Љ}{Њ}{Ћ}{Ў}{Џ}{А}{Б}{В}{Г}{Д}{Е}{Ж}{З}{И}{Й}%
+    {К}{Л}{М}{Н}{О}{П}{Р}{С}{Т}{У}{Ф}{Х}{Ц}{Ч}{Ш}{Щ}{Ъ}{Ы}{Ь}{Э}{Ю}%
+    {Я}{а}{б}{в}{г}{д}{е}{ж}{з}{и}{й}{к}{л}{м}{н}{о}{п}{р}{с}{т}{у}%
+    {ф}{х}{ц}{ч}{ш}{щ}{ъ}{ы}{ь}{э}{ю}{я}{ё}{ђ}{є}{ѕ}{і}{ј}{љ}{њ}{ћ}%
+    {ў}{џ}{Ѣ}{ѣ}{Ѫ}{ѫ}{Ѵ}{ѵ}{Ґ}{ґ}{Ғ}{ғ}{Ҕ}{ҕ}{Җ}{җ}{Ҙ}{ҙ}{Қ}{қ}{Ҝ}{ҝ}%
+    {Ҟ}{ҟ}{Ҡ}{ҡ}{Ң}{ң}{Ҥ}{ҥ}{Ҧ}{ҧ}{Ҩ}{ҩ}{Ҫ}{ҫ}{Ҭ}{ҭ}{Ү}{ү}{Ұ}{ұ}{Ҳ}{ҳ}%
+    {Ҵ}{ҵ}{Ҷ}{ҷ}{Ҹ}{ҹ}{Һ}{һ}{Ҽ}{ҽ}{Ҿ}{ҿ}{Ӏ}{Ӄ}{ӄ}{Ӆ}{ӆ}{Ӈ}{ӈ}{Ӌ}{ӌ}%
+    {Ӎ}{ӎ}{Ӕ}{ӕ}{Ә}{ә}{Ӡ}{ӡ}{Ө}{ө}\do
+  {%
+    \begingroup\def\IeC{\protect\DeclareTextSymbolDefault}%
+    \protected@edef\@temp{\endgroup
+    \@ifl@t@r{\fmtversion}{2019/10/01}{\csname u8:\next\endcsname}{\next}}%
+    \@temp{X2}%
+  }%
+\else
+\ifspx@cyropt@TtwoA
+% original code by tex.sx user jfbu:
+%   https://tex.stackexchange.com/a/460305/
+% 63*2+1=127 Cyrillic glyphs as found in T2A 8bit TeX font-encoding
+  \@tfor\@tempa:=%
+    {ae}{a}{b}{chrdsc}{chvcrs}{ch}{c}{dje}{dze}{dzhe}{d}{erev}{ery}{e}%
+    {f}{ghcrs}{gup}{g}{hdsc}{hrdsn}{h}{ie}{ii}{ishrt}{i}{je}%
+    {kbeak}{kdsc}{kvcrs}{k}{lje}{l}{m}{ndsc}{ng}{nje}{n}{otld}{o}{p}{r}%
+    {schwa}{sdsc}{sftsn}{shch}{shha}{sh}{s}{tshe}{t}{ushrt}{u}{v}%
+    {ya}{yhcrs}{yi}{yo}{yu}{y}{zdsc}{zhdsc}{zh}{z}\do
+  {%
+    \expandafter\DeclareTextSymbolDefault\expandafter
+               {\csname cyr\@tempa\endcsname}{T2A}%
+    \expandafter\uppercase\expandafter{\expandafter
+                 \def\expandafter\@tempa\expandafter{\@tempa}}%
+    \expandafter\DeclareTextSymbolDefault\expandafter
+      {\csname CYR\@tempa\endcsname}{T2A}%
+  }%
+  \DeclareTextSymbolDefault{\CYRpalochka}{T2A}%
+\fi\fi
+\endinput
@@ -0,0 +1,105 @@
+\NeedsTeXFormat{LaTeX2e}[1995/12/01]
+\ProvidesPackage{sphinxhighlight}[2016/05/29 stylesheet for highlighting with pygments]
+
+
+\makeatletter
+\def\PYG@reset{\let\PYG@it=\relax \let\PYG@bf=\relax%
+    \let\PYG@ul=\relax \let\PYG@tc=\relax%
+    \let\PYG@bc=\relax \let\PYG@ff=\relax}
+\def\PYG@tok#1{\csname PYG@tok@#1\endcsname}
+\def\PYG@toks#1+{\ifx\relax#1\empty\else%
+    \PYG@tok{#1}\expandafter\PYG@toks\fi}
+\def\PYG@do#1{\PYG@bc{\PYG@tc{\PYG@ul{%
+    \PYG@it{\PYG@bf{\PYG@ff{#1}}}}}}}
+\def\PYG#1#2{\PYG@reset\PYG@toks#1+\relax+\PYG@do{#2}}
+
+\expandafter\def\csname PYG@tok@w\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.73,0.73,0.73}{##1}}}
+\expandafter\def\csname PYG@tok@c\endcsname{\let\PYG@it=\textit\def\PYG@tc##1{\textcolor[rgb]{0.25,0.50,0.56}{##1}}}
+\expandafter\def\csname PYG@tok@cp\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.00,0.44,0.13}{##1}}}
+\expandafter\def\csname PYG@tok@cs\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.25,0.50,0.56}{##1}}\def\PYG@bc##1{\setlength{\fboxsep}{0pt}\colorbox[rgb]{1.00,0.94,0.94}{\strut ##1}}}
+\expandafter\def\csname PYG@tok@k\endcsname{\let\PYG@bf=\textbf\def\PYG@tc##1{\textcolor[rgb]{0.00,0.44,0.13}{##1}}}
+\expandafter\def\csname PYG@tok@kp\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.00,0.44,0.13}{##1}}}
+\expandafter\def\csname PYG@tok@kt\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.56,0.13,0.00}{##1}}}
+\expandafter\def\csname PYG@tok@o\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.40,0.40,0.40}{##1}}}
+\expandafter\def\csname PYG@tok@ow\endcsname{\let\PYG@bf=\textbf\def\PYG@tc##1{\textcolor[rgb]{0.00,0.44,0.13}{##1}}}
+\expandafter\def\csname PYG@tok@nb\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.00,0.44,0.13}{##1}}}
+\expandafter\def\csname PYG@tok@nf\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.02,0.16,0.49}{##1}}}
+\expandafter\def\csname PYG@tok@nc\endcsname{\let\PYG@bf=\textbf\def\PYG@tc##1{\textcolor[rgb]{0.05,0.52,0.71}{##1}}}
+\expandafter\def\csname PYG@tok@nn\endcsname{\let\PYG@bf=\textbf\def\PYG@tc##1{\textcolor[rgb]{0.05,0.52,0.71}{##1}}}
+\expandafter\def\csname PYG@tok@ne\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.00,0.44,0.13}{##1}}}
+\expandafter\def\csname PYG@tok@nv\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.73,0.38,0.84}{##1}}}
+\expandafter\def\csname PYG@tok@no\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.38,0.68,0.84}{##1}}}
+\expandafter\def\csname PYG@tok@nl\endcsname{\let\PYG@bf=\textbf\def\PYG@tc##1{\textcolor[rgb]{0.00,0.13,0.44}{##1}}}
+\expandafter\def\csname PYG@tok@ni\endcsname{\let\PYG@bf=\textbf\def\PYG@tc##1{\textcolor[rgb]{0.84,0.33,0.22}{##1}}}
+\expandafter\def\csname PYG@tok@na\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.25,0.44,0.63}{##1}}}
+\expandafter\def\csname PYG@tok@nt\endcsname{\let\PYG@bf=\textbf\def\PYG@tc##1{\textcolor[rgb]{0.02,0.16,0.45}{##1}}}
+\expandafter\def\csname PYG@tok@nd\endcsname{\let\PYG@bf=\textbf\def\PYG@tc##1{\textcolor[rgb]{0.33,0.33,0.33}{##1}}}
+\expandafter\def\csname PYG@tok@s\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.25,0.44,0.63}{##1}}}
+\expandafter\def\csname PYG@tok@sd\endcsname{\let\PYG@it=\textit\def\PYG@tc##1{\textcolor[rgb]{0.25,0.44,0.63}{##1}}}
+\expandafter\def\csname PYG@tok@si\endcsname{\let\PYG@it=\textit\def\PYG@tc##1{\textcolor[rgb]{0.44,0.63,0.82}{##1}}}
+\expandafter\def\csname PYG@tok@se\endcsname{\let\PYG@bf=\textbf\def\PYG@tc##1{\textcolor[rgb]{0.25,0.44,0.63}{##1}}}
+\expandafter\def\csname PYG@tok@sr\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.14,0.33,0.53}{##1}}}
+\expandafter\def\csname PYG@tok@ss\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.32,0.47,0.09}{##1}}}
+\expandafter\def\csname PYG@tok@sx\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.78,0.36,0.04}{##1}}}
+\expandafter\def\csname PYG@tok@m\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.13,0.50,0.31}{##1}}}
+\expandafter\def\csname PYG@tok@gh\endcsname{\let\PYG@bf=\textbf\def\PYG@tc##1{\textcolor[rgb]{0.00,0.00,0.50}{##1}}}
+\expandafter\def\csname PYG@tok@gu\endcsname{\let\PYG@bf=\textbf\def\PYG@tc##1{\textcolor[rgb]{0.50,0.00,0.50}{##1}}}
+\expandafter\def\csname PYG@tok@gd\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.63,0.00,0.00}{##1}}}
+\expandafter\def\csname PYG@tok@gi\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.00,0.63,0.00}{##1}}}
+\expandafter\def\csname PYG@tok@gr\endcsname{\def\PYG@tc##1{\textcolor[rgb]{1.00,0.00,0.00}{##1}}}
+\expandafter\def\csname PYG@tok@ge\endcsname{\let\PYG@it=\textit}
+\expandafter\def\csname PYG@tok@gs\endcsname{\let\PYG@bf=\textbf}
+\expandafter\def\csname PYG@tok@gp\endcsname{\let\PYG@bf=\textbf\def\PYG@tc##1{\textcolor[rgb]{0.78,0.36,0.04}{##1}}}
+\expandafter\def\csname PYG@tok@go\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.20,0.20,0.20}{##1}}}
+\expandafter\def\csname PYG@tok@gt\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.00,0.27,0.87}{##1}}}
+\expandafter\def\csname PYG@tok@err\endcsname{\def\PYG@bc##1{\setlength{\fboxsep}{0pt}\fcolorbox[rgb]{1.00,0.00,0.00}{1,1,1}{\strut ##1}}}
+\expandafter\def\csname PYG@tok@kc\endcsname{\let\PYG@bf=\textbf\def\PYG@tc##1{\textcolor[rgb]{0.00,0.44,0.13}{##1}}}
+\expandafter\def\csname PYG@tok@kd\endcsname{\let\PYG@bf=\textbf\def\PYG@tc##1{\textcolor[rgb]{0.00,0.44,0.13}{##1}}}
+\expandafter\def\csname PYG@tok@kn\endcsname{\let\PYG@bf=\textbf\def\PYG@tc##1{\textcolor[rgb]{0.00,0.44,0.13}{##1}}}
+\expandafter\def\csname PYG@tok@kr\endcsname{\let\PYG@bf=\textbf\def\PYG@tc##1{\textcolor[rgb]{0.00,0.44,0.13}{##1}}}
+\expandafter\def\csname PYG@tok@bp\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.00,0.44,0.13}{##1}}}
+\expandafter\def\csname PYG@tok@fm\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.02,0.16,0.49}{##1}}}
+\expandafter\def\csname PYG@tok@vc\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.73,0.38,0.84}{##1}}}
+\expandafter\def\csname PYG@tok@vg\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.73,0.38,0.84}{##1}}}
+\expandafter\def\csname PYG@tok@vi\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.73,0.38,0.84}{##1}}}
+\expandafter\def\csname PYG@tok@vm\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.73,0.38,0.84}{##1}}}
+\expandafter\def\csname PYG@tok@sa\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.25,0.44,0.63}{##1}}}
+\expandafter\def\csname PYG@tok@sb\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.25,0.44,0.63}{##1}}}
+\expandafter\def\csname PYG@tok@sc\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.25,0.44,0.63}{##1}}}
+\expandafter\def\csname PYG@tok@dl\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.25,0.44,0.63}{##1}}}
+\expandafter\def\csname PYG@tok@s2\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.25,0.44,0.63}{##1}}}
+\expandafter\def\csname PYG@tok@sh\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.25,0.44,0.63}{##1}}}
+\expandafter\def\csname PYG@tok@s1\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.25,0.44,0.63}{##1}}}
+\expandafter\def\csname PYG@tok@mb\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.13,0.50,0.31}{##1}}}
+\expandafter\def\csname PYG@tok@mf\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.13,0.50,0.31}{##1}}}
+\expandafter\def\csname PYG@tok@mh\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.13,0.50,0.31}{##1}}}
+\expandafter\def\csname PYG@tok@mi\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.13,0.50,0.31}{##1}}}
+\expandafter\def\csname PYG@tok@il\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.13,0.50,0.31}{##1}}}
+\expandafter\def\csname PYG@tok@mo\endcsname{\def\PYG@tc##1{\textcolor[rgb]{0.13,0.50,0.31}{##1}}}
+\expandafter\def\csname PYG@tok@ch\endcsname{\let\PYG@it=\textit\def\PYG@tc##1{\textcolor[rgb]{0.25,0.50,0.56}{##1}}}
+\expandafter\def\csname PYG@tok@cm\endcsname{\let\PYG@it=\textit\def\PYG@tc##1{\textcolor[rgb]{0.25,0.50,0.56}{##1}}}
+\expandafter\def\csname PYG@tok@cpf\endcsname{\let\PYG@it=\textit\def\PYG@tc##1{\textcolor[rgb]{0.25,0.50,0.56}{##1}}}
+\expandafter\def\csname PYG@tok@c1\endcsname{\let\PYG@it=\textit\def\PYG@tc##1{\textcolor[rgb]{0.25,0.50,0.56}{##1}}}
+
+\def\PYGZbs{\char`\\}
+\def\PYGZus{\char`\_}
+\def\PYGZob{\char`\{}
+\def\PYGZcb{\char`\}}
+\def\PYGZca{\char`\^}
+\def\PYGZam{\char`\&}
+\def\PYGZlt{\char`\<}
+\def\PYGZgt{\char`\>}
+\def\PYGZsh{\char`\#}
+\def\PYGZpc{\char`\%}
+\def\PYGZdl{\char`\$}
+\def\PYGZhy{\char`\-}
+\def\PYGZsq{\char`\'}
+\def\PYGZdq{\char`\"}
+\def\PYGZti{\char`\~}
+% for compatibility with earlier versions
+\def\PYGZat{@}
+\def\PYGZlb{[}
+\def\PYGZrb{]}
+\makeatother
+
+\renewcommand\PYGZsq{\textquotesingle}
@@ -0,0 +1,102 @@
+%
+% sphinxhowto.cls for Sphinx (http://sphinx-doc.org/)
+%
+
+\NeedsTeXFormat{LaTeX2e}[1995/12/01]
+\ProvidesClass{sphinxhowto}[2019/12/01 v2.3.0 Document class (Sphinx howto)]
+
+% 'oneside' option overriding the 'twoside' default
+\newif\if@oneside
+\DeclareOption{oneside}{\@onesidetrue}
+% Pass remaining document options to the parent class.
+\DeclareOption*{\PassOptionsToClass{\CurrentOption}{\sphinxdocclass}}
+\ProcessOptions\relax
+
+% Default to two-side document
+\if@oneside
+% nothing to do (oneside is the default)
+\else
+\PassOptionsToClass{twoside}{\sphinxdocclass}
+\fi
+
+\LoadClass{\sphinxdocclass}
+
+% Set some sane defaults for section numbering depth and TOC depth.  You can
+% reset these counters in your preamble.
+%
+\setcounter{secnumdepth}{2}
+\setcounter{tocdepth}{2}% i.e. section and subsection
+
+% Adapt \and command to the flushright context of \sphinxmaketitle, to
+% avoid ragged line endings if author names do not fit all on one single line
+\DeclareRobustCommand{\and}{%
+    \end{tabular}\kern-\tabcolsep
+    \allowbreak
+    \hskip\dimexpr1em+\tabcolsep\@plus.17fil\begin{tabular}[t]{c}%
+}%
+% If it is desired that each author name be on its own line, use in preamble:
+%\DeclareRobustCommand{\and}{%
+%   \end{tabular}\kern-\tabcolsep\\\begin{tabular}[t]{c}%
+%}%
+% Change the title page to look a bit better, and fit in with the fncychap
+% ``Bjarne'' style a bit better.
+%
+\newcommand{\sphinxmaketitle}{%
+  \noindent\rule{\textwidth}{1pt}\par
+    \begingroup % for PDF information dictionary
+       \def\endgraf{ }\def\and{\& }%
+       \pdfstringdefDisableCommands{\def\\{, }}% overwrite hyperref setup
+       \hypersetup{pdfauthor={\@author}, pdftitle={\@title}}%
+    \endgroup
+  \begin{flushright}
+    \sphinxlogo
+    \py@HeaderFamily
+    {\Huge \@title }\par
+    {\itshape\large \py@release \releaseinfo}\par
+    \vspace{25pt}
+    {\Large
+      \begin{tabular}[t]{c}
+        \@author
+      \end{tabular}\kern-\tabcolsep}\par
+    \vspace{25pt}
+    \@date \par
+    \py@authoraddress \par
+  \end{flushright}
+  \@thanks
+  \setcounter{footnote}{0}
+  \let\thanks\relax\let\maketitle\relax
+  %\gdef\@thanks{}\gdef\@author{}\gdef\@title{}
+}
+
+\newcommand{\sphinxtableofcontents}{%
+  \begingroup
+    \parskip \z@skip
+    \sphinxtableofcontentshook
+    \tableofcontents
+  \endgroup
+  \noindent\rule{\textwidth}{1pt}\par
+  \vspace{12pt}%
+}  
+\newcommand\sphinxtableofcontentshook{}
+\pagenumbering{arabic}
+
+% Fix the bibliography environment to add an entry to the Table of
+% Contents.
+% For an article document class this environment is a section,
+% so no page break before it.
+%
+\newenvironment{sphinxthebibliography}[1]{%
+  % \phantomsection % not needed here since TeXLive 2010's hyperref
+  \begin{thebibliography}{#1}%
+  \addcontentsline{toc}{section}{\ifdefined\refname\refname\else\ifdefined\bibname\bibname\fi\fi}}{\end{thebibliography}}
+
+
+% Same for the indices.
+% The memoir class already does this, so we don't duplicate it in that case.
+%
+\@ifclassloaded{memoir}
+ {\newenvironment{sphinxtheindex}{\begin{theindex}}{\end{theindex}}}
+ {\newenvironment{sphinxtheindex}{%
+    \phantomsection % needed because no chapter, section, ... is created by theindex
+    \begin{theindex}%
+    \addcontentsline{toc}{section}{\indexname}}{\end{theindex}}}
--- a/Show More
+++ b/Show More
				`@@ -0,0 +1,2 @@`

				`<meta http-equiv="Refresh" content="0; url=chapter1.html" />`