diff --git a/doc/pub/week34/html/week34-bs.html b/doc/pub/week34/html/week34-bs.html index 7e1e9edca..93dca0db3 100644 --- a/doc/pub/week34/html/week34-bs.html +++ b/doc/pub/week34/html/week34-bs.html @@ -239,7 +239,7 @@ MathJax.Hub.Config({
[2] Department of Physics and Astronomy and National Superconducting Cyclotron Laboratory, Michigan State University

-

Aug 23, 2021

+

Aug 24, 2021


diff --git a/doc/pub/week34/html/week34-reveal.html b/doc/pub/week34/html/week34-reveal.html index 44723bd74..947448e2a 100644 --- a/doc/pub/week34/html/week34-reveal.html +++ b/doc/pub/week34/html/week34-reveal.html @@ -148,7 +148,7 @@ MathJax.Hub.Config({

[2] Department of Physics and Astronomy and National Superconducting Cyclotron Laboratory, Michigan State University

 
-

Aug 23, 2021

+

Aug 24, 2021


@@ -334,7 +334,7 @@ Projects are handed in using Canvas. We use Github as repository for code

-In addition to the electure notes, we recommend the books of Bishop and Goodfellow et al. We will follow these texts closely and the weekly reading assignments refer to these two texts. The text by Hastie et al is also widely used in the Machine Learning community. Finally, we also recommend the hands-on text by Geron, see below. +In addition to the lecture notes, we recommend the books of Bishop and Goodfellow et al. We will follow these texts closely and the weekly reading assignments refer to these two texts. The text by Hastie et al is also widely used in the Machine Learning community. Finally, we also recommend the hands-on text by Geron, see below.

  1. Christopher M. Bishop, Pattern Recognition and Machine Learning, Springer, https://www.springer.com/gp/book/9780387310732.
  2. @@ -374,7 +374,19 @@ Python is the recurring programming language.

    -This course aims at giving you insights and knowledge about many of the central algorithms used in Data Analysis and Machine Learning. The course is project based and through various numerical projects, normally three, you will be exposed to fundamental research problems in these fields, with the aim to reproduce state of the art scientific results. Both supervised and unsupervised methods will be covered. The emphasis is on a frequentist approach, although we will try to link it with a Bayesian approach as well. You will learn to develop and structure large codes for studying different cases where Machine Learning is applied to, get acquainted with computing facilities and learn to handle large scientific projects. A good scientific and ethical conduct is emphasized throughout the course. More specifically, after this course you will +This course aims at giving you insights and knowledge about many of +the central algorithms used in Data Analysis and Machine Learning. +The course is project based and through various numerical projects, +normally three, you will be exposed to fundamental research problems +in these fields, with the aim to reproduce state of the art scientific +results. Both supervised and unsupervised methods will be covered. The +emphasis is on a frequentist approach, although we will try to link it +with a Bayesian approach as well. You will learn to develop and +structure large codes for studying different cases where Machine +Learning is applied to, get acquainted with computing facilities and +learn to handle large scientific projects. A good scientific and +ethical conduct is emphasized throughout the course. More +specifically, after this course you will

    @@ -441,7 +453,7 @@ The following topics will be covered

  3. Support vector machines
  4. Bayesian linear and logistic regression
  5. Boltzmann Machines
  6. -

  7. Unsupervised learning Dimensionality reduction, from PCA to cluster models
  8. +

  9. Unsupervised learning Dimensionality reduction, from PCA to clustering
  10. @@ -462,7 +474,7 @@ Hands-on demonstrations, exercises and projects aim at deepening your understand

  11. GIT for version control, and GitHub or GitLab as repositories, highly recommended. This will be discussed during the first exercise session
  12. -

  13. Anaconda and other Python environments, see intro slides and first exercise session
  14. +

  15. Anaconda and other Python environments, see intro slides and links to programming resources at https://computationalscienceuio.github.io/RefreshProgrammingSkills/intro.html
  16. @@ -476,7 +488,7 @@ The link here STK2100 Machine learning and statistical methods for prediction and classification. -

  17. IN3050 Introduction to Artificial Intelligence and Machine Learning. Introductory course in machine learning and AI with an algorithmic approach.
  18. +

  19. IN3050/4050 Introduction to Artificial Intelligence and Machine Learning. Introductory course in machine learning and AI with an algorithmic approach.
  20. STK-INF3000/4000 Selected Topics in Data Science. The course provides insight into selected contemporary relevant topics within Data Science.
  21. IN4080 Natural Language Processing. Probabilistic and machine learning techniques applied to natural language processing.
  22. STK-IN4300 Statistical learning methods in Data Science. An advanced introduction to statistical and machine learning. For students with a good mathematics and statistics background.
  23. @@ -862,14 +874,14 @@ $$

    - + - - - - - + + + + +
    Relations Name matrix elements
    Relations Name matrix elements
    \( A=A^{T} \) symmetric \( a_{ij}=a_{ji} \)
    \( A=\left (A^{T} \right )^{-1} \) real orthogonal \( \sum_k a_{ik}a_{jk}=\sum_k a_{ki} a_{kj} = \delta_{ij} \)
    \( A=A^{ * } \) real matrix \( a_{ij}=a_{ij}^{ * } \)
    \( A=A^{\dagger} \) hermitian \( a_{ij}=a_{ji}^{ * } \)
    \( A=\left (A^{\dagger} \right )^{-1} \) unitary \( \sum_k a_{ik}a_{jk}^{ * }=\sum_k a_{ki}^{ * } a_{kj}=\delta_{ij} \)
    \( A=A^{T} \) symmetric \( a_{ij}=a_{ji} \)
    \( A=\left (A^{T}\right )^{-1} \) real orthogonal \( \sum_k a_{ik}a_{jk}=\sum_k a_{ki} a_{kj}=\delta_{ij} \)
    \( A=A^{ * } \) real matrix \( a_{ij}=a_{ij}^{ < em>} \)
    \( A=A^{\dagger} \) hermitian \( a_{ij}=a_{ji}^{ < /em>} \)
    \( A=\left(A^{\dagger}\right )^{-1} \) unitary \( \sum_k a_{ik}a_{jk}^{ < em>}=\sum_k a_{ki}^{ < /em> } a_{kj}=\delta_{ij} \)
    @@ -885,17 +897,17 @@ $$

  24. Diagonal if \( a_{ij}=0 \) for \( i\ne j \)
  25. -

  26. Upper triangular if \( a_{ij}=0 \) for \( i > j \)
  27. +

  28. Upper triangular if \( a_{ij}=0 \) for \( i>j \)
  29. Lower triangular if \( a_{ij}=0 \) for \( i < j \)
  30. -

  31. Upper Hessenberg if \( a_{ij}=0 \) for \( i > j+1 \)
  32. +

  33. Upper Hessenberg if \( a_{ij}=0 \) for \( i>j+1 \)
  34. Lower Hessenberg if \( a_{ij}=0 \) for \( i < j+1 \)
  35. -

  36. Tridiagonal if \( a_{ij}=0 \) for \( |i -j| > 1 \)
  37. +

  38. Tridiagonal if \( a_{ij}=0 \) for \( |i -j|>1 \)
  39. -

  40. Lower banded with bandwidth \( p \): \( a_{ij}=0 \) for \( i > j+p \)
  41. +

  42. Lower banded with bandwidth \( p \): \( a_{ij}=0 \) for \( i>j+p \)
  43. Upper banded with bandwidth \( p \): \( a_{ij}=0 \) for \( i < j+p \)
  44. @@ -1005,7 +1017,7 @@ or simply write them as double precision numbers (Python uses 64 bits as default
    import numpy as np
    -x = np.log(np.array([4.0, 7.0, 8.0])
    +x = np.log(np.array([4.0, 7.0, 8.0]))
     print(x)
     

    @@ -1014,7 +1026,7 @@ To check the number of bytes (remember that one byte contains eight bits for dou

    import numpy as np
    -x = np.log(np.array([4.0, 7.0, 8.0])
    +x = np.log(np.array([4.0, 7.0, 8.0]))
     print(x.itemsize)
     
    @@ -1327,7 +1339,7 @@ pretty close the basic mathematical expressions.

    Our first data set is going to be a classic from nuclear physics, namely all -available data on binding energies. Don't be intimidated if you are not familiar with nuclear physics. It serves simply as an example here of a data set. +available data on binding energies. Don't be intimidated if you are not familiar with nuclear physics. It serves merely as an example here of a data set.

    We will show some of the @@ -1571,7 +1583,7 @@ plt.show()

    The function coef gives us the parameter \( \beta \) of our fit while intercept yields -\( \alpha \). Depending on the constant in front of the normal distribution, we get values near or far from \( alpha =2 \) and \( \beta =5 \). Try to play around with different parameters in front of the normal distribution. The function meansquarederror gives us the mean square error, a risk metric corresponding to the expected value of the squared (quadratic) error or loss defined as +\( \alpha \). Depending on the constant in front of the normal distribution, we get values near or far from \( \alpha =2 \) and \( \beta =5 \). Try to play around with different parameters in front of the normal distribution. The function meansquarederror gives us the mean square error, a risk metric corresponding to the expected value of the squared (quadratic) error or loss defined as

     
    $$ MSE(\hat{y},\hat{\tilde{y}}) = \frac{1}{n} \sum_{i=0}^{n-1}(y_i-\tilde{y}_i)^2, @@ -1642,7 +1654,7 @@ ways of dealing with outliers. The Huber cost function is defined as

     
    $$ -H_{\delta}(a)={\begin{cases}{\frac {1}{2}}{a^{2}}&{\text{for }}|a|\leq \delta ,\\\delta (|a|-{\frac {1}{2}}\delta ),&{\text{otherwise.}}\end{cases}}}. +H_{\delta}(a)=\left\{\begin{array}\frac{1}{2}{a^{2}}&{\text{for }}|a|\leq \delta ,\\ \delta (|a|-{\frac {1}{2}}\delta ),&{\text{otherwise.}\end{array}\right. $$

     
    diff --git a/doc/pub/week34/html/week34-solarized.html b/doc/pub/week34/html/week34-solarized.html index 2589481a4..292477361 100644 --- a/doc/pub/week34/html/week34-solarized.html +++ b/doc/pub/week34/html/week34-solarized.html @@ -191,7 +191,7 @@ MathJax.Hub.Config({

    [2] Department of Physics and Astronomy and National Superconducting Cyclotron Laboratory, Michigan State University

    -

    Aug 23, 2021

    +

    Aug 24, 2021












    @@ -366,7 +366,7 @@ Projects are handed in using Canvas. We use Github as repository for code

  45. The lecture notes are collected as a jupyter-book at https://compphysics.github.io/MachineLearning/doc/LectureNotes/_build/html/intro.html.
-In addition to the electure notes, we recommend the books of Bishop and Goodfellow et al. We will follow these texts closely and the weekly reading assignments refer to these two texts. The text by Hastie et al is also widely used in the Machine Learning community. Finally, we also recommend the hands-on text by Geron, see below. +In addition to the lecture notes, we recommend the books of Bishop and Goodfellow et al. We will follow these texts closely and the weekly reading assignments refer to these two texts. The text by Hastie et al is also widely used in the Machine Learning community. Finally, we also recommend the hands-on text by Geron, see below.
  1. Christopher M. Bishop, Pattern Recognition and Machine Learning, Springer, https://www.springer.com/gp/book/9780387310732.
  2. @@ -406,7 +406,19 @@ Python is the recurring programming language.

    -This course aims at giving you insights and knowledge about many of the central algorithms used in Data Analysis and Machine Learning. The course is project based and through various numerical projects, normally three, you will be exposed to fundamental research problems in these fields, with the aim to reproduce state of the art scientific results. Both supervised and unsupervised methods will be covered. The emphasis is on a frequentist approach, although we will try to link it with a Bayesian approach as well. You will learn to develop and structure large codes for studying different cases where Machine Learning is applied to, get acquainted with computing facilities and learn to handle large scientific projects. A good scientific and ethical conduct is emphasized throughout the course. More specifically, after this course you will +This course aims at giving you insights and knowledge about many of +the central algorithms used in Data Analysis and Machine Learning. +The course is project based and through various numerical projects, +normally three, you will be exposed to fundamental research problems +in these fields, with the aim to reproduce state of the art scientific +results. Both supervised and unsupervised methods will be covered. The +emphasis is on a frequentist approach, although we will try to link it +with a Bayesian approach as well. You will learn to develop and +structure large codes for studying different cases where Machine +Learning is applied to, get acquainted with computing facilities and +learn to handle large scientific projects. A good scientific and +ethical conduct is emphasized throughout the course. More +specifically, after this course you will

    @@ -476,7 +488,7 @@ The following topics will be covered
  3. Support vector machines
  4. Bayesian linear and logistic regression
  5. Boltzmann Machines
  6. -
  7. Unsupervised learning Dimensionality reduction, from PCA to cluster models
  8. +
  9. Unsupervised learning Dimensionality reduction, from PCA to clustering
  10. Hands-on demonstrations, exercises and projects aim at deepening your understanding of these topics. @@ -497,7 +509,7 @@ Hands-on demonstrations, exercises and projects aim at deepening your understand @@ -512,7 +524,7 @@ The link here STK2100 Machine learning and statistical methods for prediction and classification. -
  11. IN3050 Introduction to Artificial Intelligence and Machine Learning. Introductory course in machine learning and AI with an algorithmic approach.
  12. +
  13. IN3050/4050 Introduction to Artificial Intelligence and Machine Learning. Introductory course in machine learning and AI with an algorithmic approach.
  14. STK-INF3000/4000 Selected Topics in Data Science. The course provides insight into selected contemporary relevant topics within Data Science.
  15. IN4080 Natural Language Processing. Probabilistic and machine learning techniques applied to natural language processing.
  16. STK-IN4300 Statistical learning methods in Data Science. An advanced introduction to statistical and machine learning. For students with a good mathematics and statistics background.
  17. @@ -880,14 +892,14 @@ $$

    - + - - - - - + + + + +
    Relations Name matrix elements
    Relations Name matrix elements
    \( A=A^{T} \) symmetric \( a_{ij}=a_{ji} \)
    \( A=\left (A^{T} \right )^{-1} \) real orthogonal \( \sum_k a_{ik}a_{jk}=\sum_k a_{ki} a_{kj} = \delta_{ij} \)
    \( A=A^{ * } \) real matrix \( a_{ij}=a_{ij}^{ * } \)
    \( A=A^{\dagger} \) hermitian \( a_{ij}=a_{ji}^{ * } \)
    \( A=\left (A^{\dagger} \right )^{-1} \) unitary \( \sum_k a_{ik}a_{jk}^{ * }=\sum_k a_{ki}^{ * } a_{kj}=\delta_{ij} \)
    \( A=A^{T} \) symmetric \( a_{ij}=a_{ji} \)
    \( A=\left (A^{T}\right )^{-1} \) real orthogonal \( \sum_k a_{ik}a_{jk}=\sum_k a_{ki} a_{kj}=\delta_{ij} \)
    \( A=A^{ * } \) real matrix \( a_{ij}=a_{ij}^{ < em>} \)
    \( A=A^{\dagger} \) hermitian \( a_{ij}=a_{ji}^{ < /em>} \)
    \( A=\left(A^{\dagger}\right )^{-1} \) unitary \( \sum_k a_{ik}a_{jk}^{ < em>}=\sum_k a_{ki}^{ < /em> } a_{kj}=\delta_{ij} \)
    @@ -901,12 +913,12 @@ $$

    @@ -1007,7 +1019,7 @@ or simply write them as double precision numbers (Python uses 64 bits as default
    import numpy as np
    -x = np.log(np.array([4.0, 7.0, 8.0])
    +x = np.log(np.array([4.0, 7.0, 8.0]))
     print(x)
     

    @@ -1016,7 +1028,7 @@ To check the number of bytes (remember that one byte contains eight bits for dou

    import numpy as np
    -x = np.log(np.array([4.0, 7.0, 8.0])
    +x = np.log(np.array([4.0, 7.0, 8.0]))
     print(x.itemsize)
     

    @@ -1321,7 +1333,7 @@ pretty close the basic mathematical expressions.

    Our first data set is going to be a classic from nuclear physics, namely all -available data on binding energies. Don't be intimidated if you are not familiar with nuclear physics. It serves simply as an example here of a data set. +available data on binding energies. Don't be intimidated if you are not familiar with nuclear physics. It serves merely as an example here of a data set.

    We will show some of the @@ -1556,7 +1568,7 @@ plt.show()

    The function coef gives us the parameter \( \beta \) of our fit while intercept yields -\( \alpha \). Depending on the constant in front of the normal distribution, we get values near or far from \( alpha =2 \) and \( \beta =5 \). Try to play around with different parameters in front of the normal distribution. The function meansquarederror gives us the mean square error, a risk metric corresponding to the expected value of the squared (quadratic) error or loss defined as +\( \alpha \). Depending on the constant in front of the normal distribution, we get values near or far from \( \alpha =2 \) and \( \beta =5 \). Try to play around with different parameters in front of the normal distribution. The function meansquarederror gives us the mean square error, a risk metric corresponding to the expected value of the squared (quadratic) error or loss defined as $$ MSE(\hat{y},\hat{\tilde{y}}) = \frac{1}{n} \sum_{i=0}^{n-1}(y_i-\tilde{y}_i)^2, $$ @@ -1616,7 +1628,7 @@ ways of dealing with outliers.

    The Huber cost function is defined as $$ -H_{\delta}(a)={\begin{cases}{\frac {1}{2}}{a^{2}}&{\text{for }}|a|\leq \delta ,\\\delta (|a|-{\frac {1}{2}}\delta ),&{\text{otherwise.}}\end{cases}}}. +H_{\delta}(a)=\left\{\begin{array}\frac{1}{2}{a^{2}}&{\text{for }}|a|\leq \delta ,\\ \delta (|a|-{\frac {1}{2}}\delta ),&{\text{otherwise.}\end{array}\right. $$ Here \( a=\boldsymbol{y} - \boldsymbol{\tilde{y}} \). diff --git a/doc/pub/week34/html/week34.html b/doc/pub/week34/html/week34.html index e90b09b95..59e5c7f86 100644 --- a/doc/pub/week34/html/week34.html +++ b/doc/pub/week34/html/week34.html @@ -196,7 +196,7 @@ MathJax.Hub.Config({

    [2] Department of Physics and Astronomy and National Superconducting Cyclotron Laboratory, Michigan State University

    -

    Aug 23, 2021

    +

    Aug 24, 2021












    @@ -371,7 +371,7 @@ Projects are handed in using Canvas. We use Github as repository for code

  18. The lecture notes are collected as a jupyter-book at https://compphysics.github.io/MachineLearning/doc/LectureNotes/_build/html/intro.html.
-In addition to the electure notes, we recommend the books of Bishop and Goodfellow et al. We will follow these texts closely and the weekly reading assignments refer to these two texts. The text by Hastie et al is also widely used in the Machine Learning community. Finally, we also recommend the hands-on text by Geron, see below. +In addition to the lecture notes, we recommend the books of Bishop and Goodfellow et al. We will follow these texts closely and the weekly reading assignments refer to these two texts. The text by Hastie et al is also widely used in the Machine Learning community. Finally, we also recommend the hands-on text by Geron, see below.
  1. Christopher M. Bishop, Pattern Recognition and Machine Learning, Springer, https://www.springer.com/gp/book/9780387310732.
  2. @@ -411,7 +411,19 @@ Python is the recurring programming language.

    -This course aims at giving you insights and knowledge about many of the central algorithms used in Data Analysis and Machine Learning. The course is project based and through various numerical projects, normally three, you will be exposed to fundamental research problems in these fields, with the aim to reproduce state of the art scientific results. Both supervised and unsupervised methods will be covered. The emphasis is on a frequentist approach, although we will try to link it with a Bayesian approach as well. You will learn to develop and structure large codes for studying different cases where Machine Learning is applied to, get acquainted with computing facilities and learn to handle large scientific projects. A good scientific and ethical conduct is emphasized throughout the course. More specifically, after this course you will +This course aims at giving you insights and knowledge about many of +the central algorithms used in Data Analysis and Machine Learning. +The course is project based and through various numerical projects, +normally three, you will be exposed to fundamental research problems +in these fields, with the aim to reproduce state of the art scientific +results. Both supervised and unsupervised methods will be covered. The +emphasis is on a frequentist approach, although we will try to link it +with a Bayesian approach as well. You will learn to develop and +structure large codes for studying different cases where Machine +Learning is applied to, get acquainted with computing facilities and +learn to handle large scientific projects. A good scientific and +ethical conduct is emphasized throughout the course. More +specifically, after this course you will

    @@ -481,7 +493,7 @@ The following topics will be covered
  3. Support vector machines
  4. Bayesian linear and logistic regression
  5. Boltzmann Machines
  6. -
  7. Unsupervised learning Dimensionality reduction, from PCA to cluster models
  8. +
  9. Unsupervised learning Dimensionality reduction, from PCA to clustering
  10. Hands-on demonstrations, exercises and projects aim at deepening your understanding of these topics. @@ -502,7 +514,7 @@ Hands-on demonstrations, exercises and projects aim at deepening your understand @@ -517,7 +529,7 @@ The link here STK2100 Machine learning and statistical methods for prediction and classification. -
  11. IN3050 Introduction to Artificial Intelligence and Machine Learning. Introductory course in machine learning and AI with an algorithmic approach.
  12. +
  13. IN3050/4050 Introduction to Artificial Intelligence and Machine Learning. Introductory course in machine learning and AI with an algorithmic approach.
  14. STK-INF3000/4000 Selected Topics in Data Science. The course provides insight into selected contemporary relevant topics within Data Science.
  15. IN4080 Natural Language Processing. Probabilistic and machine learning techniques applied to natural language processing.
  16. STK-IN4300 Statistical learning methods in Data Science. An advanced introduction to statistical and machine learning. For students with a good mathematics and statistics background.
  17. @@ -885,14 +897,14 @@ $$

    - + - - - - - + + + + +
    Relations Name matrix elements
    Relations Name matrix elements
    \( A=A^{T} \) symmetric \( a_{ij}=a_{ji} \)
    \( A=\left (A^{T} \right )^{-1} \) real orthogonal \( \sum_k a_{ik}a_{jk}=\sum_k a_{ki} a_{kj} = \delta_{ij} \)
    \( A=A^{ * } \) real matrix \( a_{ij}=a_{ij}^{ * } \)
    \( A=A^{\dagger} \) hermitian \( a_{ij}=a_{ji}^{ * } \)
    \( A=\left (A^{\dagger} \right )^{-1} \) unitary \( \sum_k a_{ik}a_{jk}^{ * }=\sum_k a_{ki}^{ * } a_{kj}=\delta_{ij} \)
    \( A=A^{T} \) symmetric \( a_{ij}=a_{ji} \)
    \( A=\left (A^{T}\right )^{-1} \) real orthogonal \( \sum_k a_{ik}a_{jk}=\sum_k a_{ki} a_{kj}=\delta_{ij} \)
    \( A=A^{ * } \) real matrix \( a_{ij}=a_{ij}^{ < em>} \)
    \( A=A^{\dagger} \) hermitian \( a_{ij}=a_{ji}^{ < /em>} \)
    \( A=\left(A^{\dagger}\right )^{-1} \) unitary \( \sum_k a_{ik}a_{jk}^{ < em>}=\sum_k a_{ki}^{ < /em> } a_{kj}=\delta_{ij} \)
    @@ -906,12 +918,12 @@ $$

    @@ -1012,7 +1024,7 @@ or simply write them as double precision numbers (Python uses 64 bits as default
    import numpy as np
    -x = np.log(np.array([4.0, 7.0, 8.0])
    +x = np.log(np.array([4.0, 7.0, 8.0]))
     print(x)
     

    @@ -1021,7 +1033,7 @@ To check the number of bytes (remember that one byte contains eight bits for dou

    import numpy as np
    -x = np.log(np.array([4.0, 7.0, 8.0])
    +x = np.log(np.array([4.0, 7.0, 8.0]))
     print(x.itemsize)
     

    @@ -1326,7 +1338,7 @@ pretty close the basic mathematical expressions.

    Our first data set is going to be a classic from nuclear physics, namely all -available data on binding energies. Don't be intimidated if you are not familiar with nuclear physics. It serves simply as an example here of a data set. +available data on binding energies. Don't be intimidated if you are not familiar with nuclear physics. It serves merely as an example here of a data set.

    We will show some of the @@ -1561,7 +1573,7 @@ plt.show()

    The function coef gives us the parameter \( \beta \) of our fit while intercept yields -\( \alpha \). Depending on the constant in front of the normal distribution, we get values near or far from \( alpha =2 \) and \( \beta =5 \). Try to play around with different parameters in front of the normal distribution. The function meansquarederror gives us the mean square error, a risk metric corresponding to the expected value of the squared (quadratic) error or loss defined as +\( \alpha \). Depending on the constant in front of the normal distribution, we get values near or far from \( \alpha =2 \) and \( \beta =5 \). Try to play around with different parameters in front of the normal distribution. The function meansquarederror gives us the mean square error, a risk metric corresponding to the expected value of the squared (quadratic) error or loss defined as $$ MSE(\hat{y},\hat{\tilde{y}}) = \frac{1}{n} \sum_{i=0}^{n-1}(y_i-\tilde{y}_i)^2, $$ @@ -1621,7 +1633,7 @@ ways of dealing with outliers.

    The Huber cost function is defined as $$ -H_{\delta}(a)={\begin{cases}{\frac {1}{2}}{a^{2}}&{\text{for }}|a|\leq \delta ,\\\delta (|a|-{\frac {1}{2}}\delta ),&{\text{otherwise.}}\end{cases}}}. +H_{\delta}(a)=\left\{\begin{array}\frac{1}{2}{a^{2}}&{\text{for }}|a|\leq \delta ,\\ \delta (|a|-{\frac {1}{2}}\delta ),&{\text{otherwise.}\end{array}\right. $$ Here \( a=\boldsymbol{y} - \boldsymbol{\tilde{y}} \). diff --git a/doc/pub/week34/ipynb/Results/FigureFiles/Masses2016.png b/doc/pub/week34/ipynb/Results/FigureFiles/Masses2016.png index 10b85e2ca..b8976c975 100644 Binary files a/doc/pub/week34/ipynb/Results/FigureFiles/Masses2016.png and b/doc/pub/week34/ipynb/Results/FigureFiles/Masses2016.png differ diff --git a/doc/pub/week34/ipynb/Results/FigureFiles/Masses2016Trees.png b/doc/pub/week34/ipynb/Results/FigureFiles/Masses2016Trees.png index d72e85807..1c5a1b4b1 100644 Binary files a/doc/pub/week34/ipynb/Results/FigureFiles/Masses2016Trees.png and b/doc/pub/week34/ipynb/Results/FigureFiles/Masses2016Trees.png differ diff --git a/doc/pub/week34/ipynb/ipynb-week34-src.tar.gz b/doc/pub/week34/ipynb/ipynb-week34-src.tar.gz index f0990de93..744ad83f8 100644 Binary files a/doc/pub/week34/ipynb/ipynb-week34-src.tar.gz and b/doc/pub/week34/ipynb/ipynb-week34-src.tar.gz differ diff --git a/doc/pub/week34/ipynb/week34.ipynb b/doc/pub/week34/ipynb/week34.ipynb index 9ff666182..9cfc3d56e 100644 --- a/doc/pub/week34/ipynb/week34.ipynb +++ b/doc/pub/week34/ipynb/week34.ipynb @@ -10,7 +10,7 @@ " \n", "**Morten Hjorth-Jensen**, Department of Physics, University of Oslo and Department of Physics and Astronomy and National Superconducting Cyclotron Laboratory, Michigan State University\n", "\n", - "Date: **Aug 23, 2021**\n", + "Date: **Aug 24, 2021**\n", "\n", "Copyright 1999-2021, Morten Hjorth-Jensen. Released under CC Attribution-NonCommercial 4.0 license\n", "\n", @@ -151,7 +151,7 @@ "\n", "1. The lecture notes are collected as a jupyter-book at \n", "\n", - "In addition to the electure notes, we recommend the books of Bishop and Goodfellow et al. We will follow these texts closely and the weekly reading assignments refer to these two texts. The text by Hastie et al is also widely used in the Machine Learning community. Finally, we also recommend the hands-on text by Geron, see below.\n", + "In addition to the lecture notes, we recommend the books of Bishop and Goodfellow et al. We will follow these texts closely and the weekly reading assignments refer to these two texts. The text by Hastie et al is also widely used in the Machine Learning community. Finally, we also recommend the hands-on text by Geron, see below.\n", "\n", "1. Christopher M. Bishop, Pattern Recognition and Machine Learning, Springer, \n", "\n", @@ -181,7 +181,19 @@ "\n", "\n", "\n", - "This course aims at giving you insights and knowledge about many of the central algorithms used in Data Analysis and Machine Learning. The course is project based and through various numerical projects, normally three, you will be exposed to fundamental research problems in these fields, with the aim to reproduce state of the art scientific results. Both supervised and unsupervised methods will be covered. The emphasis is on a frequentist approach, although we will try to link it with a Bayesian approach as well. You will learn to develop and structure large codes for studying different cases where Machine Learning is applied to, get acquainted with computing facilities and learn to handle large scientific projects. A good scientific and ethical conduct is emphasized throughout the course. More specifically, after this course you will\n", + "This course aims at giving you insights and knowledge about many of\n", + "the central algorithms used in Data Analysis and Machine Learning.\n", + "The course is project based and through various numerical projects,\n", + "normally three, you will be exposed to fundamental research problems\n", + "in these fields, with the aim to reproduce state of the art scientific\n", + "results. Both supervised and unsupervised methods will be covered. The\n", + "emphasis is on a frequentist approach, although we will try to link it\n", + "with a Bayesian approach as well. You will learn to develop and\n", + "structure large codes for studying different cases where Machine\n", + "Learning is applied to, get acquainted with computing facilities and\n", + "learn to handle large scientific projects. A good scientific and\n", + "ethical conduct is emphasized throughout the course. More\n", + "specifically, after this course you will\n", "\n", "* Learn about basic data analysis, statistical analysis, Bayesian statistics, Monte Carlo sampling, data optimization and machine learning;\n", "\n", @@ -201,7 +213,7 @@ "\n", "* Autoencoders and Reinforcement Learning;\n", "\n", - "* Work on numerical projects to illustrate the theory. The projects play a central role and you are expected to know modern programming languages like Python or C++ and/or Fortran (Fortran2003 or later).\n", + "* Work on numerical projects to illustrate the theory. The projects play a central role and you are expected to know modern programming languages like Python or C++ and/or Fortran (Fortran2003 or later) or Julia or other.\n", "\n", "\n", "\n", @@ -251,7 +263,7 @@ "\n", "* Boltzmann Machines\n", "\n", - "* Unsupervised learning Dimensionality reduction, from PCA to cluster models\n", + "* Unsupervised learning Dimensionality reduction, from PCA to clustering\n", "\n", "Hands-on demonstrations, exercises and projects aim at deepening your understanding of these topics.\n", "\n", @@ -264,7 +276,7 @@ "\n", " * GIT for version control, and GitHub or GitLab as repositories, highly recommended. This will be discussed during the first exercise session\n", "\n", - " * Anaconda and other Python environments, see intro slides and first exercise session\n", + " * Anaconda and other Python environments, see intro slides and links to programming resources at \n", "\n", "\n", "\n", @@ -278,7 +290,7 @@ "\n", "1. [STK2100 Machine learning and statistical methods for prediction and classification](http://www.uio.no/studier/emner/matnat/math/STK2100/index-eng.html). \n", "\n", - "2. [IN3050 Introduction to Artificial Intelligence and Machine Learning](https://www.uio.no/studier/emner/matnat/ifi/IN3050/index-eng.html). Introductory course in machine learning and AI with an algorithmic approach. \n", + "2. [IN3050/4050 Introduction to Artificial Intelligence and Machine Learning](https://www.uio.no/studier/emner/matnat/ifi/IN3050/index-eng.html). Introductory course in machine learning and AI with an algorithmic approach. \n", "\n", "3. [STK-INF3000/4000 Selected Topics in Data Science](http://www.uio.no/studier/emner/matnat/math/STK-INF3000/index-eng.html). The course provides insight into selected contemporary relevant topics within Data Science. \n", "\n", @@ -638,14 +650,14 @@ "source": [ "\n", "\n", - "\n", + "\n", "\n", "\n", - "\n", - "\n", - "\n", - "\n", - "\n", + "\n", + "\n", + "\n", + "\n", + "\n", "\n", "
    Relations Name matrix elements
    Relations Name matrix elements
    $A=A^{T}$ symmetric $a_{ij}=a_{ji}$
    $A=\\left (A^{T} \\right )^{-1}$ real orthogonal $\\sum_k a_{ik}a_{jk}=\\sum_k a_{ki} a_{kj} = \\delta_{ij}$
    $A=A^{ * }$ real matrix $a_{ij}=a_{ij}^{ * }$
    $A=A^{\\dagger}$ hermitian $a_{ij}=a_{ji}^{ * }$
    $A=\\left (A^{\\dagger} \\right )^{-1}$ unitary $\\sum_k a_{ik}a_{jk}^{ * }=\\sum_k a_{ki}^{ * } a_{kj}=\\delta_{ij}$
    $A=A^{T}$ symmetric $a_{ij}=a_{ji}$
    $A=\\left (A^{T}\\right )^{-1}$ real orthogonal $\\sum_k a_{ik}a_{jk}=\\sum_k a_{ki} a_{kj}=\\delta_{ij}$
    $A=A^{ * }$ real matrix $a_{ij}=a_{ij}^{*}$
    $A=A^{\\dagger}$ hermitian $a_{ij}=a_{ji}^{*}$
    $A=\\left(A^{\\dagger}\\right )^{-1}$ unitary $\\sum_k a_{ik}a_{jk}^{*}=\\sum_k a_{ki}^{ * } a_{kj}=\\delta_{ij}$
    \n", "\n", @@ -655,19 +667,19 @@ "\n", " * Diagonal if $a_{ij}=0$ for $i\\ne j$\n", "\n", - " * Upper triangular if $a_{ij}=0$ for $i > j$\n", + " * Upper triangular if $a_{ij}=0$ for $i>j$\n", "\n", - " * Lower triangular if $a_{ij}=0$ for $i < j$\n", + " * Lower triangular if $a_{ij}=0$ for $i j+1$\n", + " * Upper Hessenberg if $a_{ij}=0$ for $i>j+1$\n", "\n", - " * Lower Hessenberg if $a_{ij}=0$ for $i < j+1$\n", + " * Lower Hessenberg if $a_{ij}=0$ for $i 1$\n", + " * Tridiagonal if $a_{ij}=0$ for $|i -j|>1$\n", "\n", - " * Lower banded with bandwidth $p$: $a_{ij}=0$ for $i > j+p$\n", + " * Lower banded with bandwidth $p$: $a_{ij}=0$ for $i>j+p$\n", "\n", - " * Upper banded with bandwidth $p$: $a_{ij}=0$ for $i < j+p$\n", + " * Upper banded with bandwidth $p$: $a_{ij}=0$ for $i j$ - * Lower triangular if $a_{ij}=0$ for $i < j$ - * Upper Hessenberg if $a_{ij}=0$ for $i > j+1$ - * Lower Hessenberg if $a_{ij}=0$ for $i < j+1$ - * Tridiagonal if $a_{ij}=0$ for $|i -j| > 1$ - * Lower banded with bandwidth $p$: $a_{ij}=0$ for $i > j+p$ - * Upper banded with bandwidth $p$: $a_{ij}=0$ for $i < j+p$ + * Upper triangular if $a_{ij}=0$ for $i>j$ + * Lower triangular if $a_{ij}=0$ for $ij+1$ + * Lower Hessenberg if $a_{ij}=0$ for $i1$ + * Lower banded with bandwidth $p$: $a_{ij}=0$ for $i>j+p$ + * Upper banded with bandwidth $p$: $a_{ij}=0$ for $i