From a4758ee8097b3d1fb626f32cb0aaac6df87d22bf Mon Sep 17 00:00:00 2001 From: Morten Hjorth-Jensen Date: Sun, 22 Aug 2021 22:59:10 +0200 Subject: [PATCH] updating --- README.md | 2 +- doc/LectureNotes/schedule.md | 227 ++++++++++++++++------------------- 2 files changed, 103 insertions(+), 126 deletions(-) diff --git a/README.md b/README.md index 95fea7727..57a26112b 100644 --- a/README.md +++ b/README.md @@ -1,4 +1,4 @@ -# Applied Data Analysis and Machine Learning, small change +# Applied Data Analysis and Machine Learning This site contains all material relevant for the course on Applied diff --git a/doc/LectureNotes/schedule.md b/doc/LectureNotes/schedule.md index 7824473e1..abbb326d5 100644 --- a/doc/LectureNotes/schedule.md +++ b/doc/LectureNotes/schedule.md @@ -3,8 +3,8 @@ This course will be delivered in a hybrid mode, with online lectures and on site or online laboratory sessions. -1. Four lectures per week, Fall semester, 10 ECTS. The lectures will be fully online. The lectures will be recorded and linked to this site and the official University of Oslo website for the course; -2. Two hours of laboratory sessions for work on computational projects and exercises for each group. Due to social distancing, at most 15 participants can attend. There will also be fully digital laboratory sessions for those who cannot attend; +1. Four lectures per week, Fall semester, 10 ECTS. The lectures are in person but will be recorded and linked to this site and the official University of Oslo website for the course; +2. Two hours of laboratory sessions for work on computational projects and exercises for each group. There will also be fully digital laboratory sessions for those who cannot attend; 3. Three projects which are graded and count 1/3 each of the final grade; 4. A selected number of weekly assignments; 5. The course is part of the CS Master of Science program, but is open to other bachelor and Master of Science students at the University of Oslo; @@ -13,128 +13,105 @@ This course will be delivered in a hybrid mode, with online lectures and on site 8. Weekly emails with summary of activities will be mailed to all participants; -# Teaching schedule with links to material + +## Weekly Schedule + +For the reading assignments we use the following abbreviations: +- GBC: Goodfellow, Bengio, and Courville, Deep Learning +- CMB: Christopher M. Bishop, Pattern Recognition and Machine Learning +- HTF: Hastie, Tibshirani, and Friedman, The Elements of Statistical Learning +- AG: Aurelien Geron, Hands‑On Machine Learning with Scikit‑Learn and TensorFlow + +### Week 35 August 23-27 +- Lab Wednesday: Introduction to software and repetition of Python Programming +- Lecture Thursday: Introduction to the course, what is Machine Learning and introduction to Linear Regression +- Lecture Friday: Basics of Linear Regression +- Reading recommendations: Refresh linear algebra, GBC chapters 1 and 2. CMB sections 1.1 and 3.1. HTF chapters 2 and 3. Install scikit-learn. See lecture notes for week 35 at https://compphysics.github.io/MachineLearning/doc/web/course.html + +### Week 36 August 30-September 3 +- Lab Wednesday: +- Lecture Thursday: Linear Regression, from ordinary linear regression to Ridge and Lasso regression, linear algebra analysis, examples and discussions of codes +- Lecture Friday: Linear Regression, Linear algebra and Ridge and Lasso Regression, linear algebra analysis, examples and discussions of codes +- Reading recommendations: See lecture notes for week 36 at https://compphysics.github.io/MachineLearning/doc/web/course.html. HTF chapter 3. GBC chapters 1 and and sections 3.1-3.11 and 5.1 and CMB sections 1.1 and 3.1 + +### Week 37 September 6-10 +- Lab Wednesday: +- Lecture Thursday: Statistical interpretation of Linear Regression +- Lecture Friday: Bias-Variance tradeoff +- Reading recommendations: See lecture notes for week 37 at https://compphysics.github.io/MachineLearning/doc/web/course.html. GBC sections 5.2-5.5, CMB section 3.2 + - Chapter +### Week 38 September 13-17 +- Lab Wednesday: +- Lecture Thursday: Resampling methods, cross-validation and Bootstrap +- Lecture Friday: More on Resampling methods and summary of linear regression +- Reading recommendations: See lecture notes for week 38 at https://compphysics.github.io/MachineLearning/doc/web/course.html. + - Chapter +### Week 39 September 20-24 +- Lab Wednesday: +- Lecture Thursday: Classification problems and Logistic Regression, from binary cases to several categories +- Lecture Friday: Logistic Regression and gradient optimization +- Reading recommendations: See lecture notes for week 39 at https://compphysics.github.io/MachineLearning/doc/web/course.html. + - Chapter +### Week 40 September 27- October 1 +- Lab Wednesday: +- Lecture Thursday: Gradient Optimization methods +- Lecture Friday: Deep Learning and Neural Networks +- Reading recommendations: See lecture notes for week 40 at https://compphysics.github.io/MachineLearning/doc/web/course.html. + - Chapter +### Week 41 October 4-8 +- Lab Wednesday: +- Lecture Thursday: Writing a feed-forward Neural Network code for regression and classification +- Lecture Friday: Deep Learning and TensorFlow and Keras +- Reading recommendations: + - Chapter +### Week 42 October 11-15 +- Lab Wednesday: +- Lecture Thursday: Deep learning and Neural Networks +- Lecture Friday: Convolutional Neural Networks, basic elements +- Reading recommendations: + - GoodFellow et al, Chapter 9 +### Week 43 October 18-22 +- Lab Wednesday: +- Lecture Thursday: Convolutional Neural Networks and classification problems +- Lecture Friday: Convolutional Neural Networks and classification problems +- Reading recommendations: + - Chapter +### Week 44 October 25-29 +- Lab Wednesday: +- Lecture Thursday: Recurrent Neural Networks +- Lecture Friday: Recurrent Neural Networks and time series +- Reading recommendations: + - Chapter +### Week 45 November 1-5 +- Lab Wednesday: +- Lecture Thursday: Decision trees, classification and regression +- Lecture Friday: Decision trees, basic algorithms +- Reading recommendations: + - Chapter +### Week 46 November 8-12 +- Lab Wednesday: +- Lecture Thursday: Ensemble methods, bagging and random forests +- Lecture Friday: Boosting and gradient boosting +- Reading recommendations: + - Chapter +### Week 47 November 15-19 +- Lab Wednesday: +- Lecture Thursday: +- Lecture Friday: Unsupervised Learning, k-means +- Reading recommendations: + - Chapter +### Week 48 November 22-26 +- Lab Wednesday: +- Lecture Thursday: Unsupervised Learning, Principal Component Analysis (PCA) +- Lecture Friday: Unsupervised Learning and PCA and Clustering +- Reading recommendations: + - Chapter +### Week 49 November 29- December 2 +- Lab Wednesday: +- Lecture Thursday: Unsupervised Learning and Clustering +- Lecture Friday: Summary of course +- Reading recommendations: + - Chapter -### Week 2, January 11-15, 2021 - -- Introduction to the course and reminder on vectors, space, time and motion, JRT chapters 1.2 and 1.3 and lecture notes (https://mhjensen.github.io/Physics321/doc/pub/week2/html/week2.html). Watch the video at https://mediaspace.msu.edu/media/t/1_zzl90pfu -- Python programming reminder, elements from CMSE 201 and how they are used in this course. Installing software (anaconda). See slides at https://mhjensen.github.io/Physics321/doc/pub/week2/html/week2.html). -- Introduction to Git and GitHub/GitLab. Watch the video at https://mediaspace.msu.edu/media/t/1_8mgx3cyf - - -### Week 3, January 18-22, 2021 - -- Monday 1/18: MLK day, no lecture -- Wednesday 1/20: Getting started and overview of course. JRT chapters 1.2 and 1.3 and lecture notes (https://mhjensen.github.io/Physics321/doc/pub/week2/html/week2.html). AMS chapters 2 and 4 are very useful. 1st homework due January 25. -Video of Lecture at https://mediaspace.msu.edu/media/t/1_xwtfo4i1 (some minor problems in the beginning of video). -- Friday 1/22: Forces and Newton's laws of motion. Free fall problems. JRT chapter 1.4 and lecture notes (https://mhjensen.github.io/Physics321/doc/pub/week3/html/week3.html). AMS chapters 2 and 4 are very useful Homework 1 is due on January 25 (Monday). -Video of lecture at https://mediaspace.msu.edu/media/t/1_ajqd2f42. -Handwritten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesJan22.pdf -- Solution to homeworks are in https://d2l.msu.edu/ and are posted here as well. - -### Week 4, January 25-29, 2021 -- Monday 1/25: Motion and forces, Newton's laws, examples, 2nd homework, due February 1. -Video of lecture at https://mediaspace.msu.edu/media/t/1_7pyc0yts and handwritten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesJan25.pdf -- Wednesday 1/27: Motion and forces, Newton's laws, examples -Video of lecture https://mediaspace.msu.edu/media/t/1_k2acom08 and handwritten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesJan27.pdf -- Friday 1/29: Motion and forces, Newton's laws, examples. -Video of lecture https://mediaspace.msu.edu/media/t/1_ieaw1a6y and handwritten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesJan29.pdf -- Solution to homeworks are in https://d2l.msu.edu/ -- Good reads are Taylor chapters 1.4, 1.5, 1.6, 2.1-2.4 and AMS chapters 4.2 and 5 -- Solutions to homework 1 at https://github.com/mhjensen/Physics321/blob/master/doc/src/Homeworks/Solutions/solutionhw1.ipynb and videos at https://www.youtube.com/playlist?list=PLq9LZ5390Us41TX42XzOPIEPcbHaqX8Hx - -### Week 5, February 1-5, 2021 -- Monday 2/1: We discuss various forces and their pertinent equations of motion. Recommended reading: Taylor 2.1-2.4. Malthe-Sørenssen chapter 6-7 contains many examples. We will cover in particular a falling object in two dimensions with linear air resistance relevant for homework 3, due February 8. Video of lecture at https://mediaspace.msu.edu/media/t/1_smo1913z and handwritten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesFeb1.pdf -- Wednesday 2/3: We discuss other force models with examples such as the gravitational force and a spring force. See Malthe-Sørenssen chapter 7.3-7.5. We start also our discussion of nergy and work, see Taylor 4.1 Video of lecture at https://mediaspace.msu.edu/media/t/1_raywhcdx -and handwritten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesFeb3.pdf. Julie's notes are at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/JulieNotesHW2.pdf -- Friday 2/5: We discuss several examples of energy and work. Taylor 4.1-4.3. Video of lecture at https://mediaspace.msu.edu/media/t/1_rtcxs5op and handwritten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesFeb5.pdf -Solution hw 2 for coding part as Jupyter notebook: https://github.com/mhjensen/Physics321/blob/master/doc/src/Homeworks/Solutions/solutionhw2.ipynb -Solution for analytical part as handwritten note (exercises 1-5): https://github.com/mhjensen/Physics321/blob/master/doc/src/Homeworks/Solutions/SolutionHW2Spring2021.pdf - - - -### Week 6, February 8-12, 2021 -- Monday 2/8: More on Conservation laws, momentum conservation, 4th homework, due February 15 -- Wednesday 2/10: Examples of applications of conservation laws, angular momentum conservation. Video of lecture at https://mediaspace.msu.edu/media/t/1_ff1x7fjr and handwritten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesFeb10.pdf -- Friday 2/12: Conservation laws and further examples. Video of lecture at https://mediaspace.msu.edu/media/t/1_98lgx23c and handwritten notes at -https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesFeb12.pdf -- Good reads are Taylor sections 3.1-3.5 and 4.1-4.3 and AMS chapters 10-14. -Solution hw 3 as Jupyter notebook at: https://github.com/mhjensen/Physics321/blob/master/doc/src/Homeworks/Solutions/solutionhw3.ipynb - -### Week 7, February 15-19, 2021 -- Monday 2/15: Conservation laws. Introducing the Velocity Verlet algorithm and the Earth Sun problem, 5th homework due February 22. -Video of lecture at https://mediaspace.msu.edu/media/t/1_mgqtt4lm and handwritten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesFeb15.pdf -- Wednesday 2/17: Examples of application of conservations laws (see chapter 4 of Taylor). -- Video of lecture at https://mediaspace.msu.edu/media/t/1_a4u97jro and handwritten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesFeb17.pdf -- Friday 2/19: Conservative forces, sumamry plus discussion of homeworks. Video at https://mediaspace.msu.edu/media/t/1_dnoiopq0 and handwritten notes at -- https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesFeb19.pdf -- Good reads are Taylor chapter 4 and AMS chapters 10-14 for the conservation laws and the first sections of chapter 5 of Taylor on oscillations. -- Solution hw 4 as jupyter-notebook at https://github.com/mhjensen/Physics321/blob/master/doc/src/Homeworks/Solutions/solutionhw4.ipynb -- Remember also the videos of the solutions at https://www.youtube.com/playlist?list=PLq9LZ5390Us41TX42XzOPIEPcbHaqX8Hx -### Week 8, February 22-26, 2021 -- Monday 2/22: Oscillations, mathematical details, the sliding block and energy conservation, 6th homework, due March 1. Video of lecture at https://mediaspace.msu.edu/media/t/1_kj8ea37l and handwritten notes at -- https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesFeb22.pdf -- Wednesday 2/24: Oscillations, damped motion and more mathematical details. Taylor chapter 5.1 and 5.2. Video of lecture at https://mediaspace.msu.edu/media/t/1_3e16h2bz and handwritten notes at -- https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesFeb24.pdf -- Friday 2/26: Oscillations, resonances and more on damped motion, video of lecture at https://mediaspace.msu.edu/media/t/1_j5ou5khh and handwritten notes at -- https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesFeb26.pdf. -- First midterm project, available Feb 27/28 and due March 12, 2021 -- Good reads are chapter 5 of Taylor on oscillations. -- Solution hw 5 as jupyter-notebook at https://github.com/mhjensen/Physics321/blob/master/doc/src/Homeworks/Solutions/solutionhw5.ipynb - -### Week 9, March 1-5 -- Monday 3/1: Damped Oscillations, driven oscillations and resonances. Video of Lecture at https://mediaspace.msu.edu/media/t/1_e1qae0lc and handwritten notes at -- https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesMarch1.pdf. -- Wednesday 3/3: Study day, no lectures -- Friday 3/5: Resonances and start discussion of Fourier series. Discussion of first midterm. Video of lecture at https://mediaspace.msu.edu/media/t/1_m67hhyi8 and handwritten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesMarch5.pdf. -- Good reads are sections 5.4-5.7 of Taylor on oscillations. -- Solution hw 6 as jupyter-notebook at https://github.com/mhjensen/Physics321/blob/master/doc/src/Homeworks/Solutions/solutionhw6.ipynb - - -### Week 10, March 8-12, 2021 -- Monday 3/8: Fourier series and oscillations. Discussion of first midterm. Video of lecture at https://mediaspace.msu.edu/media/t/1_8zktj1wn and handwritten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesMarch8.pdf. -- Wednesday 3/10: Discussions of oscillations and time-dependent forces. and Discussion of first midterm. Video of lecture at https://mediaspace.msu.edu/media/t/1_dmio1l34 and handwritten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesMarch10.pdf. -- Friday 3/12: Discussion of first midterm and summary of oscillations. Deadline first midterm at midnight. -There is no video of Friday's session since the lecture was organized in breakout sessions plus a discussion of the first midterm. Thx to all of you for heroic efforts with the first midterm. -- Good reads are sections 5.7-5.8 and 8.2-8.4 of Taylor and Lecture notes -- Solutions to first midterm at https://github.com/mhjensen/Physics321/blob/master/doc/src/Homeworks/Solutions/SolutionFirstMid.ipynb - - -### Week 11, March 15-19, 2021 -- Monday 3/15: Gravity and central force problems, center of mass coordinates. Lecture notes and Taylor chapter 8. 7th homework due March 22. Video of Lecture at https://mediaspace.msu.edu/media/t/1_x34gdl5o and handwritten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesMarch15.pdf. -- Wednesday 3/17: Gravity and central force problems. Video of lecture at https://mediaspace.msu.edu/media/t/1_dwy3ekta and and handwritten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesMarch17.pdf. -- Friday 3/19: Gravity and central force problems, centrifugal barriers. Video of lecture at https://mediaspace.msu.edu/media/t/1_moj8tmsv and handwritten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesMarch19.pdf. Julie's notes on methods and classes are at https://github.com/mhjensen/Physics321/tree/master/doc/pub/PythonClassesMethods - -### Week 12, March 22-26, 2021 -- Monday 3/22: Gravity and central force problems, elliptical orbits and Kepler's laws, 8th homework, due March 29. Video of Lecture at https://mediaspace.msu.edu/media/t/1_4tiot5np and handwritten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesMarch22.pdf. Julie's notes on methods and classes are at https://github.com/mhjensen/Physics321/tree/master/doc/pub/PythonClassesMethods - -- Wednesday 3/24: Gravity and central force problems, elliptical orbits. Video of Lecture at https://mediaspace.msu.edu/media/t/1_zwc05jpy and handwritten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesMarch24.pdf. -- Friday 3/26: Elliptical orbits, examples and two-body scattering problems. Video of lecture at https://mediaspace.msu.edu/media/t/1_w2yisao3 and handwritten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesMarch26.pdf -- Solutions to homework 7 at https://github.com/mhjensen/Physics321/blob/master/doc/src/Homeworks/Solutions/solutionhw7.ipynb - - -### Week 13, March 29-April 2, 2020 -- Monday 3/29: Central force problems, summary and discussion of two-body scattering problems. 9th homework, due April 5. Video of lecture at https://mediaspace.msu.edu/media/t/1_6ryr6atu and handwriten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesMarch29.pdf -- Wednesday 3/31: Two-body scattering. Taylor chapter 14 covers parts of the material. Video of lecture at https://mediaspace.msu.edu/media/t/1_0wmrw1ag and handwriten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesMarch31.pdf -- Friday 4/2: Two-body scattering (Taylor chapter 14). Second midterm available Saturday April 3 at 2pm, due April 18. Video of lecture at https://mediaspace.msu.edu/media/t/1_cnm2f4uq and handwriten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesApril2.pdf -- Solutions to homework 8 at https://github.com/mhjensen/Physics321/blob/master/doc/src/Homeworks/Solutions/solutionhw8.ipynb - -### Week 14, April 5-9, 2021 -- Monday 4/5: Wrapping up two-body scattering and begin Variational calculus and the Euler-Lagrange equations, chapter 6 of Taylor and lecture notes. Video of Lecture https://mediaspace.msu.edu/media/t/1_6xf80nmu and handwriten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesApril5.pdf -- Wednesday 4/7: Variational Calculus, chapter 6 of Taylor. Video of Lecture at https://mediaspace.msu.edu/media/t/1_puzmqtxj and handwriten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesApril7.pdf -- Friday 4/9: Variational calculus and the Euler-Lagrange equations, chapter 6 of Taylor and lecture notes. Video of Lecture at https://mediaspace.msu.edu/media/t/1_rp854yf0 and handwriten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesApril9.pdf -- Solution hw 9 as Jupyter notebook at: https://github.com/mhjensen/Physics321/blob/master/doc/src/Homeworks/Solutions/solutionhw9.ipynb - -### Week 15, April 12-16, 2021 -- Monday 4/12: Variational calculus and the Euler-Lagrange equations, chapter 6 of Taylor and lecture notes. Video at https://mediaspace.msu.edu/media/t/1_glmwe3s1 and handwriten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesApril12.pdf -- Wednesday 4/14: Variational calculus and the Euler-Lagrange equations, chapters 6-7 of Taylor and lecture notes. Video of Lecture at https://mediaspace.msu.edu/media/t/1_foeveqvo and handwriten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesApril14.pdf -- Friday 4/16: Euler-Lagrange equations and Lagrangian formalism. Taylor chapters 6-7 and lecture notes. Deadline 2nd midterm at midnight of April 18. Video of lecture at https://mediaspace.msu.edu/media/t/1_9tdk8c94 and handwriten notes at https://github.com/mhjensen/Physics321\ -/blob/master/doc/HandWrittenNotes/Spring2021/NotesApril16.pdf - -### Week 16, April 19-23, 2021 -- Monday 4/19: Langrangian formalism, discussion of examples. Taylor chapters 6 and 7. 10th homework as extra assignments, due April 26. Video of Lecture at https://mediaspace.msu.edu/media/t/1_o0e6xygq and handwriten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesApril19.pdf -- Wednesday 4/21: Lagrangian formalism, examples such as the linear chain and double pendulum. Summary and discussions of final exam project. Video of Lecture at https://mediaspace.msu.edu/media/t/1_q2jqoj6z and handwriten notes at https://github.com/mhjensen/Physics321/blob/master/doc/HandWrittenNotes/Spring2021/NotesApril21.pdf. Final exam project project due April 30. -- Friday 4/23: Study day. Zoom session 3pm-5pm. - -### Week 17, April 26- April 30, 2021, Finals week +