m
In our discussions of ordinary differential equations +
a +In our discussions of ordinary differential equations we will also study the usage of Autograd in computing gradients for deep learning. For the documentation of Autograd and examples see the lectures slides from week 39 and the Autograd documentation. +t
diff --git a/doc/pub/week42/html/._week42-bs004.html b/doc/pub/week42/html/._week42-bs004.html index 82ca6e260..2354a8ed7 100644 --- a/doc/pub/week42/html/._week42-bs004.html +++ b/doc/pub/week42/html/._week42-bs004.html @@ -425,6 +425,14 @@ and output layer to any given precision.
Using Deep Reinforcement Learning for Active Flow Control, by Marius Holm
+The mathematics of CNNs is based on the mathematical operation of
convolution. In mathematics (in particular in functional analysis),
-convolution is represented by matheematical operation (integration,
+convolution is represented by mathematical operation (integration,
summation etc) on two function in order to produce a third function
that expresses how the shape of one gets modified by the other.
Convolution has a plethora of applications in a variety of disciplines, spanning from statistics to signal processing, computer vision, solutions of differential equations,linear algebra, engineering, and yes, machine learning.
diff --git a/doc/pub/week42/html/week42-bs.html b/doc/pub/week42/html/week42-bs.html
index ab31a2fcd..006fb35be 100644
--- a/doc/pub/week42/html/week42-bs.html
+++ b/doc/pub/week42/html/week42-bs.html
@@ -422,7 +422,7 @@ MathJax.Hub.Config({
m
In our discussions of ordinary differential equations +
a +In our discussions of ordinary differential equations we will also study the usage of Autograd in computing gradients for deep learning. For the documentation of Autograd and examples see the lectures slides from week 39 and the Autograd documentation. +t
+
Using Deep Reinforcement Learning for Active Flow Control, by Marius Holm
+@@ -3291,7 +3300,7 @@ only neighboring neurons in the input instead of connecting all with the first h
The mathematics of CNNs is based on the mathematical operation of
convolution. In mathematics (in particular in functional analysis),
-convolution is represented by matheematical operation (integration,
+convolution is represented by mathematical operation (integration,
summation etc) on two function in order to produce a third function
that expresses how the shape of one gets modified by the other.
Convolution has a plethora of applications in a variety of disciplines, spanning from statistics to signal processing, computer vision, solutions of differential equations,linear algebra, engineering, and yes, machine learning.
diff --git a/doc/pub/week42/html/week42-solarized.html b/doc/pub/week42/html/week42-solarized.html
index d8bf937d1..6b8af1e2b 100644
--- a/doc/pub/week42/html/week42-solarized.html
+++ b/doc/pub/week42/html/week42-solarized.html
@@ -330,7 +330,7 @@ MathJax.Hub.Config({
m
In our discussions of ordinary differential equations +
a +In our discussions of ordinary differential equations we will also study the usage of Autograd in computing gradients for deep learning. For the documentation of Autograd and examples see the lectures slides from week 39 and the Autograd documentation. +t
+
Using Deep Reinforcement Learning for Active Flow Control, by Marius Holm
+@@ -3256,7 +3265,7 @@ only neighboring neurons in the input instead of connecting all with the first h
The mathematics of CNNs is based on the mathematical operation of
convolution. In mathematics (in particular in functional analysis),
-convolution is represented by matheematical operation (integration,
+convolution is represented by mathematical operation (integration,
summation etc) on two function in order to produce a third function
that expresses how the shape of one gets modified by the other.
Convolution has a plethora of applications in a variety of disciplines, spanning from statistics to signal processing, computer vision, solutions of differential equations,linear algebra, engineering, and yes, machine learning.
diff --git a/doc/pub/week42/html/week42.html b/doc/pub/week42/html/week42.html
index 9cbfee91f..bd5188f43 100644
--- a/doc/pub/week42/html/week42.html
+++ b/doc/pub/week42/html/week42.html
@@ -407,7 +407,7 @@ MathJax.Hub.Config({
m
In our discussions of ordinary differential equations +
a +In our discussions of ordinary differential equations we will also study the usage of Autograd in computing gradients for deep learning. For the documentation of Autograd and examples see the lectures slides from week 39 and the Autograd documentation. +t
+
Using Deep Reinforcement Learning for Active Flow Control, by Marius Holm
+@@ -3333,7 +3342,7 @@ only neighboring neurons in the input instead of connecting all with the first h
The mathematics of CNNs is based on the mathematical operation of convolution. In mathematics (in particular in functional analysis), -convolution is represented by matheematical operation (integration, +convolution is represented by mathematical operation (integration, summation etc) on two function in order to produce a third function that expresses how the shape of one gets modified by the other. Convolution has a plethora of applications in a variety of disciplines, spanning from statistics to signal processing, computer vision, solutions of differential equations,linear algebra, engineering, and yes, machine learning. diff --git a/doc/pub/week42/ipynb/ipynb-week42-src.tar.gz b/doc/pub/week42/ipynb/ipynb-week42-src.tar.gz index 8ab936936..10b9edac4 100644 Binary files a/doc/pub/week42/ipynb/ipynb-week42-src.tar.gz and b/doc/pub/week42/ipynb/ipynb-week42-src.tar.gz differ diff --git a/doc/pub/week42/ipynb/week42.ipynb b/doc/pub/week42/ipynb/week42.ipynb index c34757cc2..a2ef6db8a 100644 --- a/doc/pub/week42/ipynb/week42.ipynb +++ b/doc/pub/week42/ipynb/week42.ipynb @@ -2,7 +2,7 @@ "cells": [ { "cell_type": "markdown", - "id": "8b52c8ad", + "id": "06aa5fa6", "metadata": { "editable": true }, @@ -14,7 +14,7 @@ }, { "cell_type": "markdown", - "id": "188ca7cc", + "id": "6effb965", "metadata": { "editable": true }, @@ -22,14 +22,14 @@ "# Week 42 Solving differential equations and Convolutional (CNN)\n", "**Morten Hjorth-Jensen**, Department of Physics, University of Oslo and Department of Physics and Astronomy and National Superconducting Cyclotron Laboratory, Michigan State University\n", "\n", - "Date: **Oct 20, 2022**\n", + "Date: **Oct 21, 2022**\n", "\n", "Copyright 1999-2022, Morten Hjorth-Jensen. Released under CC Attribution-NonCommercial 4.0 license" ] }, { "cell_type": "markdown", - "id": "713e78b0", + "id": "c1bd1705", "metadata": { "editable": true }, @@ -58,6 +58,8 @@ "\n", "* [Video on CNNs from Stanford](https://www.youtube.com/watch?v=bNb2fEVKeEo&list=PLC1qU-LWwrF64f4QKQT-Vg5Wr4qEE1Zxk&index=6&ab_channel=StanfordUniversitySchoolofEngineering)\n", "\n", + "m\n", + "\n", "**And Lecture material on CNNs.**\n", "\n", "* [Lectures from IN5400 spring 2019](https://www.uio.no/studier/emner/matnat/ifi/IN5400/v19/material/week5/in5400_2019_week5_convolutional_nerual_networks.pdf)\n", @@ -69,20 +71,21 @@ }, { "cell_type": "markdown", - "id": "871d932d", + "id": "428b95eb", "metadata": { "editable": true }, "source": [ "## Using Automatic differentiation\n", - "\n", + "a\n", "In our discussions of ordinary differential equations \n", - "we will also study the usage of [Autograd](https://www.youtube.com/watch?v=fRf4l5qaX1M&ab_channel=AlexSmola) in computing gradients for deep learning. For the documentation of Autograd and examples see the lectures slides from [week 39](https://compphysics.github.io/MachineLearning/doc/pub/week39/html/week39.html) and the [Autograd documentation](https://github.com/HIPS/autograd)." + "we will also study the usage of [Autograd](https://www.youtube.com/watch?v=fRf4l5qaX1M&ab_channel=AlexSmola) in computing gradients for deep learning. For the documentation of Autograd and examples see the lectures slides from [week 39](https://compphysics.github.io/MachineLearning/doc/pub/week39/html/week39.html) and the [Autograd documentation](https://github.com/HIPS/autograd).\n", + "t" ] }, { "cell_type": "markdown", - "id": "829924df", + "id": "fc43ab60", "metadata": { "editable": true }, @@ -99,7 +102,7 @@ }, { "cell_type": "markdown", - "id": "16c1a113", + "id": "c5a14822", "metadata": { "editable": true }, @@ -114,6 +117,10 @@ "\n", "[An Introduction to Neural Network Methods for Differential Equations](https://www.springer.com/gp/book/9789401798150), by Yadav and Kumar.\n", "\n", + "**Master thesis on applying deep learning to problems in mechanics.**\n", + "\n", + "[Using Deep Reinforcement Learning for Active Flow Control](https://www.duo.uio.no/handle/10852/79212), by Marius Holm\n", + "\n", "**Thanks to Kristine Baluka Hein.**\n", "\n", "The lectures on differential equations were developed by Kristine Baluka Hein, now PhD student at IFI.\n", @@ -122,7 +129,7 @@ }, { "cell_type": "markdown", - "id": "36200dcc", + "id": "93db6b30", "metadata": { "editable": true }, @@ -136,7 +143,7 @@ }, { "cell_type": "markdown", - "id": "8b84dd18", + "id": "0739c836", "metadata": { "editable": true }, @@ -153,7 +160,7 @@ }, { "cell_type": "markdown", - "id": "54397428", + "id": "aa7fa31b", "metadata": { "editable": true }, @@ -169,7 +176,7 @@ }, { "cell_type": "markdown", - "id": "2d9c6249", + "id": "f424f3e8", "metadata": { "editable": true }, @@ -181,7 +188,7 @@ }, { "cell_type": "markdown", - "id": "ee1455bd", + "id": "5b4455ad", "metadata": { "editable": true }, @@ -199,7 +206,7 @@ }, { "cell_type": "markdown", - "id": "70720b88", + "id": "f6294d79", "metadata": { "editable": true }, @@ -220,7 +227,7 @@ }, { "cell_type": "markdown", - "id": "b5fc980b", + "id": "bff72c0d", "metadata": { "editable": true }, @@ -237,7 +244,7 @@ }, { "cell_type": "markdown", - "id": "0a2534eb", + "id": "1a66d2d7", "metadata": { "editable": true }, @@ -249,7 +256,7 @@ }, { "cell_type": "markdown", - "id": "70672089", + "id": "0fc78ac5", "metadata": { "editable": true }, @@ -260,7 +267,7 @@ }, { "cell_type": "markdown", - "id": "8ff93b80", + "id": "63c55ec7", "metadata": { "editable": true }, @@ -277,7 +284,7 @@ }, { "cell_type": "markdown", - "id": "f3432adb", + "id": "83353413", "metadata": { "editable": true }, @@ -288,7 +295,7 @@ }, { "cell_type": "markdown", - "id": "57ed2ba9", + "id": "6e139096", "metadata": { "editable": true }, @@ -304,7 +311,7 @@ }, { "cell_type": "markdown", - "id": "ac7c34d0", + "id": "95022480", "metadata": { "editable": true }, @@ -316,7 +323,7 @@ }, { "cell_type": "markdown", - "id": "925af4a1", + "id": "fb29e286", "metadata": { "editable": true }, @@ -333,7 +340,7 @@ }, { "cell_type": "markdown", - "id": "1d8e47b6", + "id": "5c075692", "metadata": { "editable": true }, @@ -345,7 +352,7 @@ }, { "cell_type": "markdown", - "id": "8ad2c2ba", + "id": "8ff292b0", "metadata": { "editable": true }, @@ -363,7 +370,7 @@ }, { "cell_type": "markdown", - "id": "10986979", + "id": "2d3cbf94", "metadata": { "editable": true }, @@ -373,7 +380,7 @@ }, { "cell_type": "markdown", - "id": "09c2774b", + "id": "1b73cd7b", "metadata": { "editable": true }, @@ -385,7 +392,7 @@ }, { "cell_type": "markdown", - "id": "1faab5d1", + "id": "a372c1b2", "metadata": { "editable": true }, @@ -402,7 +409,7 @@ }, { "cell_type": "markdown", - "id": "bb99b66e", + "id": "22219434", "metadata": { "editable": true }, @@ -414,7 +421,7 @@ }, { "cell_type": "markdown", - "id": "b9668578", + "id": "83f328a0", "metadata": { "editable": true }, @@ -425,7 +432,7 @@ }, { "cell_type": "markdown", - "id": "b2a00c29", + "id": "90ee09cf", "metadata": { "editable": true }, @@ -437,7 +444,7 @@ }, { "cell_type": "markdown", - "id": "35eec4f7", + "id": "4a73d333", "metadata": { "editable": true }, @@ -447,7 +454,7 @@ }, { "cell_type": "markdown", - "id": "944a47ac", + "id": "0955fcc7", "metadata": { "editable": true }, @@ -467,7 +474,7 @@ }, { "cell_type": "markdown", - "id": "58f03ce4", + "id": "6bb1d1f4", "metadata": { "editable": true }, @@ -484,7 +491,7 @@ }, { "cell_type": "markdown", - "id": "5c08581a", + "id": "5d7408f3", "metadata": { "editable": true }, @@ -503,7 +510,7 @@ }, { "cell_type": "markdown", - "id": "54ed567d", + "id": "fe0b18d1", "metadata": { "editable": true }, @@ -515,7 +522,7 @@ }, { "cell_type": "markdown", - "id": "6742ff21", + "id": "7aeef2d3", "metadata": { "editable": true }, @@ -525,7 +532,7 @@ }, { "cell_type": "markdown", - "id": "f7c536e4", + "id": "762ba00d", "metadata": { "editable": true }, @@ -542,7 +549,7 @@ }, { "cell_type": "markdown", - "id": "790c528e", + "id": "d7f2d36d", "metadata": { "editable": true }, @@ -552,7 +559,7 @@ }, { "cell_type": "markdown", - "id": "11c701d6", + "id": "9d9b898d", "metadata": { "editable": true }, @@ -568,7 +575,7 @@ }, { "cell_type": "markdown", - "id": "bcc9efbc", + "id": "6dfe0df3", "metadata": { "editable": true }, @@ -580,7 +587,7 @@ }, { "cell_type": "markdown", - "id": "e9ad945d", + "id": "104b459a", "metadata": { "editable": true }, @@ -592,7 +599,7 @@ }, { "cell_type": "markdown", - "id": "451e2d32", + "id": "f714bd89", "metadata": { "editable": true }, @@ -604,7 +611,7 @@ }, { "cell_type": "markdown", - "id": "578096ee", + "id": "feb01027", "metadata": { "editable": true }, @@ -614,7 +621,7 @@ }, { "cell_type": "markdown", - "id": "43e5414d", + "id": "c403d712", "metadata": { "editable": true }, @@ -626,7 +633,7 @@ }, { "cell_type": "markdown", - "id": "f42a6547", + "id": "12069c11", "metadata": { "editable": true }, @@ -643,7 +650,7 @@ }, { "cell_type": "markdown", - "id": "f7efccc1", + "id": "d5ecccac", "metadata": { "editable": true }, @@ -653,7 +660,7 @@ }, { "cell_type": "markdown", - "id": "452f05ac", + "id": "9c52d05d", "metadata": { "editable": true }, @@ -665,7 +672,7 @@ }, { "cell_type": "markdown", - "id": "5aa74d84", + "id": "bc769e75", "metadata": { "editable": true }, @@ -679,7 +686,7 @@ }, { "cell_type": "markdown", - "id": "ff60e03f", + "id": "fc6481b7", "metadata": { "editable": true }, @@ -695,7 +702,7 @@ }, { "cell_type": "markdown", - "id": "2a1a59f6", + "id": "cd48aefd", "metadata": { "editable": true }, @@ -707,7 +714,7 @@ }, { "cell_type": "markdown", - "id": "6c4da749", + "id": "5dbfeec5", "metadata": { "editable": true }, @@ -729,7 +736,7 @@ }, { "cell_type": "markdown", - "id": "97e1a2b2", + "id": "0fddedbb", "metadata": { "editable": true }, @@ -741,7 +748,7 @@ }, { "cell_type": "markdown", - "id": "e1933c20", + "id": "164cf6df", "metadata": { "editable": true }, @@ -764,7 +771,7 @@ }, { "cell_type": "markdown", - "id": "168a5d43", + "id": "58d85234", "metadata": { "editable": true }, @@ -780,7 +787,7 @@ }, { "cell_type": "markdown", - "id": "66bbafc9", + "id": "99431b55", "metadata": { "editable": true }, @@ -792,7 +799,7 @@ }, { "cell_type": "markdown", - "id": "e39dfc70", + "id": "9b5b325a", "metadata": { "editable": true }, @@ -816,7 +823,7 @@ }, { "cell_type": "markdown", - "id": "4ba3304c", + "id": "51465c87", "metadata": { "editable": true }, @@ -828,7 +835,7 @@ }, { "cell_type": "markdown", - "id": "bd5b5f92", + "id": "06227b83", "metadata": { "editable": true }, @@ -849,7 +856,7 @@ }, { "cell_type": "markdown", - "id": "eddb9d68", + "id": "89a1f3a6", "metadata": { "editable": true }, @@ -861,7 +868,7 @@ }, { "cell_type": "markdown", - "id": "f3b452a9", + "id": "87b0e9a7", "metadata": { "editable": true }, @@ -880,7 +887,7 @@ }, { "cell_type": "markdown", - "id": "b606823e", + "id": "b6cc3100", "metadata": { "editable": true }, @@ -890,7 +897,7 @@ }, { "cell_type": "markdown", - "id": "71c891da", + "id": "9963b7a5", "metadata": { "editable": true }, @@ -904,7 +911,7 @@ }, { "cell_type": "markdown", - "id": "25ec3642", + "id": "0dd338e0", "metadata": { "editable": true }, @@ -916,7 +923,7 @@ }, { "cell_type": "markdown", - "id": "0ef84ca7", + "id": "3f89be87", "metadata": { "editable": true }, @@ -928,7 +935,7 @@ }, { "cell_type": "markdown", - "id": "bd1531e8", + "id": "46e3ce4d", "metadata": { "editable": true }, @@ -945,7 +952,7 @@ }, { "cell_type": "markdown", - "id": "9a0a493b", + "id": "64a2f4f0", "metadata": { "editable": true }, @@ -957,7 +964,7 @@ }, { "cell_type": "markdown", - "id": "15db3ac3", + "id": "11f7ddd2", "metadata": { "editable": true }, @@ -979,7 +986,7 @@ }, { "cell_type": "markdown", - "id": "892696f2", + "id": "6856b0f1", "metadata": { "editable": true }, @@ -994,7 +1001,7 @@ }, { "cell_type": "markdown", - "id": "9fa7ec86", + "id": "47d0d8c8", "metadata": { "editable": true }, @@ -1005,7 +1012,7 @@ { "cell_type": "code", "execution_count": 1, - "id": "938c6220", + "id": "9f434c08", "metadata": { "collapsed": false, "editable": true @@ -1162,7 +1169,7 @@ }, { "cell_type": "markdown", - "id": "c052095f", + "id": "f881629c", "metadata": { "editable": true }, @@ -1177,7 +1184,7 @@ { "cell_type": "code", "execution_count": 2, - "id": "90e19fd2", + "id": "a4a3362d", "metadata": { "collapsed": false, "editable": true @@ -1346,7 +1353,7 @@ }, { "cell_type": "markdown", - "id": "0d01afd0", + "id": "ecca8e0a", "metadata": { "editable": true }, @@ -1359,7 +1366,7 @@ }, { "cell_type": "markdown", - "id": "74273135", + "id": "0fcbd40d", "metadata": { "editable": true }, @@ -1376,7 +1383,7 @@ }, { "cell_type": "markdown", - "id": "8d8d9ccd", + "id": "66803809", "metadata": { "editable": true }, @@ -1392,7 +1399,7 @@ }, { "cell_type": "markdown", - "id": "3a4efec7", + "id": "9d5fa756", "metadata": { "editable": true }, @@ -1405,7 +1412,7 @@ }, { "cell_type": "markdown", - "id": "02de4302", + "id": "8f77ed41", "metadata": { "editable": true }, @@ -1422,7 +1429,7 @@ }, { "cell_type": "markdown", - "id": "04c9f396", + "id": "eca5252f", "metadata": { "editable": true }, @@ -1434,7 +1441,7 @@ }, { "cell_type": "markdown", - "id": "69e18e82", + "id": "3b5db6b4", "metadata": { "editable": true }, @@ -1461,7 +1468,7 @@ }, { "cell_type": "markdown", - "id": "d5d97158", + "id": "1467bb84", "metadata": { "editable": true }, @@ -1474,7 +1481,7 @@ { "cell_type": "code", "execution_count": 3, - "id": "fe4e59cc", + "id": "b8570f23", "metadata": { "collapsed": false, "editable": true @@ -1648,7 +1655,7 @@ }, { "cell_type": "markdown", - "id": "8383b296", + "id": "d3181cb4", "metadata": { "editable": true }, @@ -1668,7 +1675,7 @@ }, { "cell_type": "markdown", - "id": "2a0dd12c", + "id": "3451640b", "metadata": { "editable": true }, @@ -1683,7 +1690,7 @@ }, { "cell_type": "markdown", - "id": "5c923058", + "id": "246c52c5", "metadata": { "editable": true }, @@ -1697,7 +1704,7 @@ }, { "cell_type": "markdown", - "id": "4fddbb6c", + "id": "b14fe4f8", "metadata": { "editable": true }, @@ -1713,7 +1720,7 @@ }, { "cell_type": "markdown", - "id": "2f4fbe24", + "id": "7ee08627", "metadata": { "editable": true }, @@ -1723,7 +1730,7 @@ }, { "cell_type": "markdown", - "id": "98c934f9", + "id": "934947f6", "metadata": { "editable": true }, @@ -1745,7 +1752,7 @@ }, { "cell_type": "markdown", - "id": "8b5c3eaa", + "id": "e0823ba3", "metadata": { "editable": true }, @@ -1759,7 +1766,7 @@ { "cell_type": "code", "execution_count": 4, - "id": "9a29f5c2", + "id": "2d6c2fc5", "metadata": { "collapsed": false, "editable": true @@ -1835,7 +1842,7 @@ }, { "cell_type": "markdown", - "id": "5ac0deed", + "id": "eb2e23c1", "metadata": { "editable": true }, @@ -1847,7 +1854,7 @@ }, { "cell_type": "markdown", - "id": "de707439", + "id": "c8da3dcd", "metadata": { "editable": true }, @@ -1864,7 +1871,7 @@ }, { "cell_type": "markdown", - "id": "43782c05", + "id": "5f21737c", "metadata": { "editable": true }, @@ -1876,7 +1883,7 @@ }, { "cell_type": "markdown", - "id": "81afc8a3", + "id": "ea830f9b", "metadata": { "editable": true }, @@ -1891,7 +1898,7 @@ }, { "cell_type": "markdown", - "id": "040e9588", + "id": "b29f39a1", "metadata": { "editable": true }, @@ -1903,7 +1910,7 @@ }, { "cell_type": "markdown", - "id": "e7084106", + "id": "c73b97c2", "metadata": { "editable": true }, @@ -1915,7 +1922,7 @@ }, { "cell_type": "markdown", - "id": "9ea84c25", + "id": "abc85897", "metadata": { "editable": true }, @@ -1927,7 +1934,7 @@ }, { "cell_type": "markdown", - "id": "ec08c09b", + "id": "4338dc8c", "metadata": { "editable": true }, @@ -1937,7 +1944,7 @@ }, { "cell_type": "markdown", - "id": "d59768b0", + "id": "af88614f", "metadata": { "editable": true }, @@ -1954,7 +1961,7 @@ }, { "cell_type": "markdown", - "id": "9e93f064", + "id": "c48716cd", "metadata": { "editable": true }, @@ -1966,7 +1973,7 @@ }, { "cell_type": "markdown", - "id": "bdf238d9", + "id": "a3c5fd9e", "metadata": { "editable": true }, @@ -1978,7 +1985,7 @@ }, { "cell_type": "markdown", - "id": "46c08546", + "id": "43d639c7", "metadata": { "editable": true }, @@ -1988,7 +1995,7 @@ }, { "cell_type": "markdown", - "id": "3dd7a0a3", + "id": "2b464634", "metadata": { "editable": true }, @@ -2000,7 +2007,7 @@ }, { "cell_type": "markdown", - "id": "a1dd3459", + "id": "ce910dd6", "metadata": { "editable": true }, @@ -2011,7 +2018,7 @@ { "cell_type": "code", "execution_count": 5, - "id": "877be579", + "id": "2ba4c217", "metadata": { "collapsed": false, "editable": true @@ -2172,7 +2179,7 @@ }, { "cell_type": "markdown", - "id": "24281a76", + "id": "a6fda795", "metadata": { "editable": true }, @@ -2194,7 +2201,7 @@ }, { "cell_type": "markdown", - "id": "9183a7de", + "id": "b8308cfa", "metadata": { "editable": true }, @@ -2211,7 +2218,7 @@ }, { "cell_type": "markdown", - "id": "fcb49c11", + "id": "65b2b67a", "metadata": { "editable": true }, @@ -2221,7 +2228,7 @@ }, { "cell_type": "markdown", - "id": "5b23d216", + "id": "01919f5c", "metadata": { "editable": true }, @@ -2236,7 +2243,7 @@ }, { "cell_type": "markdown", - "id": "bfe69d3c", + "id": "8132915d", "metadata": { "editable": true }, @@ -2246,7 +2253,7 @@ }, { "cell_type": "markdown", - "id": "ab2150f2", + "id": "4e7fc074", "metadata": { "editable": true }, @@ -2261,7 +2268,7 @@ }, { "cell_type": "markdown", - "id": "eac44372", + "id": "f3715987", "metadata": { "editable": true }, @@ -2272,7 +2279,7 @@ }, { "cell_type": "markdown", - "id": "627b221e", + "id": "73d27f0e", "metadata": { "editable": true }, @@ -2292,7 +2299,7 @@ }, { "cell_type": "markdown", - "id": "aca00fa1", + "id": "b5fc7e68", "metadata": { "editable": true }, @@ -2304,7 +2311,7 @@ }, { "cell_type": "markdown", - "id": "6e9b6dc4", + "id": "c22d291c", "metadata": { "editable": true }, @@ -2341,7 +2348,7 @@ }, { "cell_type": "markdown", - "id": "7141e430", + "id": "f530ce79", "metadata": { "editable": true }, @@ -2351,7 +2358,7 @@ }, { "cell_type": "markdown", - "id": "6bc4b5d0", + "id": "b98aa272", "metadata": { "editable": true }, @@ -2364,7 +2371,7 @@ { "cell_type": "code", "execution_count": 6, - "id": "e2dc1cbd", + "id": "234e5f98", "metadata": { "collapsed": false, "editable": true @@ -2565,7 +2572,7 @@ }, { "cell_type": "markdown", - "id": "bfe3c052", + "id": "88deb263", "metadata": { "editable": true }, @@ -2582,7 +2589,7 @@ }, { "cell_type": "markdown", - "id": "09a4bac5", + "id": "1ec3674e", "metadata": { "editable": true }, @@ -2599,7 +2606,7 @@ }, { "cell_type": "markdown", - "id": "30c3653f", + "id": "f34635c4", "metadata": { "editable": true }, @@ -2609,7 +2616,7 @@ }, { "cell_type": "markdown", - "id": "5620395c", + "id": "f6eaed83", "metadata": { "editable": true }, @@ -2624,7 +2631,7 @@ }, { "cell_type": "markdown", - "id": "ef595f98", + "id": "3c157cbc", "metadata": { "editable": true }, @@ -2638,7 +2645,7 @@ }, { "cell_type": "markdown", - "id": "15ef0cc5", + "id": "38fc14d8", "metadata": { "editable": true }, @@ -2651,7 +2658,7 @@ }, { "cell_type": "markdown", - "id": "d92bf0f5", + "id": "b5ff562f", "metadata": { "editable": true }, @@ -2671,7 +2678,7 @@ }, { "cell_type": "markdown", - "id": "75f6adb4", + "id": "52c6e01f", "metadata": { "editable": true }, @@ -2683,7 +2690,7 @@ }, { "cell_type": "markdown", - "id": "6e961e62", + "id": "6adcbae7", "metadata": { "editable": true }, @@ -2695,7 +2702,7 @@ }, { "cell_type": "markdown", - "id": "9e1abe9c", + "id": "cc7d92d8", "metadata": { "editable": true }, @@ -2707,7 +2714,7 @@ }, { "cell_type": "markdown", - "id": "8facf695", + "id": "3dd34739", "metadata": { "editable": true }, @@ -2717,7 +2724,7 @@ }, { "cell_type": "markdown", - "id": "69b59b60", + "id": "41c42b11", "metadata": { "editable": true }, @@ -2729,7 +2736,7 @@ }, { "cell_type": "markdown", - "id": "87388810", + "id": "cc8ced13", "metadata": { "editable": true }, @@ -2741,7 +2748,7 @@ }, { "cell_type": "markdown", - "id": "62340b30", + "id": "a4f188a9", "metadata": { "editable": true }, @@ -2753,7 +2760,7 @@ }, { "cell_type": "markdown", - "id": "a620d56a", + "id": "79439942", "metadata": { "editable": true }, @@ -2763,7 +2770,7 @@ }, { "cell_type": "markdown", - "id": "1d58fbd6", + "id": "6458a145", "metadata": { "editable": true }, @@ -2779,7 +2786,7 @@ }, { "cell_type": "markdown", - "id": "8cefa694", + "id": "136a65e7", "metadata": { "editable": true }, @@ -2789,7 +2796,7 @@ }, { "cell_type": "markdown", - "id": "92958756", + "id": "8ca9c2f7", "metadata": { "editable": true }, @@ -2801,7 +2808,7 @@ }, { "cell_type": "markdown", - "id": "89b7d64b", + "id": "23f03a32", "metadata": { "editable": true }, @@ -2818,7 +2825,7 @@ }, { "cell_type": "markdown", - "id": "adfef36d", + "id": "362067e7", "metadata": { "editable": true }, @@ -2828,7 +2835,7 @@ }, { "cell_type": "markdown", - "id": "6389808b", + "id": "e1a30d0b", "metadata": { "editable": true }, @@ -2844,7 +2851,7 @@ }, { "cell_type": "markdown", - "id": "8e65feae", + "id": "b73520ab", "metadata": { "editable": true }, @@ -2858,7 +2865,7 @@ }, { "cell_type": "markdown", - "id": "5323bc21", + "id": "92cc6221", "metadata": { "editable": true }, @@ -2877,7 +2884,7 @@ { "cell_type": "code", "execution_count": 7, - "id": "d92a20e4", + "id": "81b76476", "metadata": { "collapsed": false, "editable": true @@ -2932,7 +2939,7 @@ }, { "cell_type": "markdown", - "id": "7234984b", + "id": "d849b324", "metadata": { "editable": true }, @@ -2962,7 +2969,7 @@ }, { "cell_type": "markdown", - "id": "c5c5a52f", + "id": "ce1ff415", "metadata": { "editable": true }, @@ -2991,7 +2998,7 @@ { "cell_type": "code", "execution_count": 8, - "id": "d77f43d2", + "id": "1d018162", "metadata": { "collapsed": false, "editable": true @@ -3038,7 +3045,7 @@ }, { "cell_type": "markdown", - "id": "a6ebedc9", + "id": "42d244a4", "metadata": { "editable": true }, @@ -3064,7 +3071,7 @@ { "cell_type": "code", "execution_count": 9, - "id": "84be3457", + "id": "3eb03f23", "metadata": { "collapsed": false, "editable": true @@ -3298,7 +3305,7 @@ }, { "cell_type": "markdown", - "id": "86936975", + "id": "499ac12b", "metadata": { "editable": true }, @@ -3310,7 +3317,7 @@ }, { "cell_type": "markdown", - "id": "49aa80f5", + "id": "0d7251c6", "metadata": { "editable": true }, @@ -3322,7 +3329,7 @@ }, { "cell_type": "markdown", - "id": "3de61241", + "id": "c98da157", "metadata": { "editable": true }, @@ -3334,7 +3341,7 @@ }, { "cell_type": "markdown", - "id": "d2788eb5", + "id": "d27d0457", "metadata": { "editable": true }, @@ -3351,7 +3358,7 @@ }, { "cell_type": "markdown", - "id": "3c71b7e3", + "id": "52127e52", "metadata": { "editable": true }, @@ -3361,7 +3368,7 @@ }, { "cell_type": "markdown", - "id": "b23be72e", + "id": "9b64268e", "metadata": { "editable": true }, @@ -3373,7 +3380,7 @@ }, { "cell_type": "markdown", - "id": "f309fca9", + "id": "144c875a", "metadata": { "editable": true }, @@ -3390,7 +3397,7 @@ }, { "cell_type": "markdown", - "id": "5bb9e861", + "id": "9154e68f", "metadata": { "editable": true }, @@ -3401,7 +3408,7 @@ }, { "cell_type": "markdown", - "id": "21bc41a1", + "id": "5d285fb0", "metadata": { "editable": true }, @@ -3421,7 +3428,7 @@ }, { "cell_type": "markdown", - "id": "ba4c17ca", + "id": "83c13c01", "metadata": { "editable": true }, @@ -3431,7 +3438,7 @@ }, { "cell_type": "markdown", - "id": "e18c21c2", + "id": "f6991971", "metadata": { "editable": true }, @@ -3457,7 +3464,7 @@ }, { "cell_type": "markdown", - "id": "4e7ee2b5", + "id": "6118478b", "metadata": { "editable": true }, @@ -3473,7 +3480,7 @@ }, { "cell_type": "markdown", - "id": "5374bc3f", + "id": "d2a58446", "metadata": { "editable": true }, @@ -3484,7 +3491,7 @@ { "cell_type": "code", "execution_count": 10, - "id": "98e78cb0", + "id": "dab1f57e", "metadata": { "collapsed": false, "editable": true @@ -3715,7 +3722,7 @@ }, { "cell_type": "markdown", - "id": "1633af10", + "id": "f021259e", "metadata": { "editable": true }, @@ -3733,7 +3740,7 @@ }, { "cell_type": "markdown", - "id": "88733167", + "id": "ebea3a57", "metadata": { "editable": true }, @@ -3760,7 +3767,7 @@ }, { "cell_type": "markdown", - "id": "e91d0001", + "id": "101ac8fa", "metadata": { "editable": true }, @@ -3782,7 +3789,7 @@ }, { "cell_type": "markdown", - "id": "3a23b8d7", + "id": "59c66abd", "metadata": { "editable": true }, @@ -3800,7 +3807,7 @@ }, { "cell_type": "markdown", - "id": "5987c365", + "id": "7faee2f7", "metadata": { "editable": true }, @@ -3830,7 +3837,7 @@ }, { "cell_type": "markdown", - "id": "e8f9616e", + "id": "ac7d7ada", "metadata": { "editable": true }, @@ -3860,7 +3867,7 @@ }, { "cell_type": "markdown", - "id": "d495ddd3", + "id": "a4d3bdc7", "metadata": { "editable": true }, @@ -3900,7 +3907,7 @@ }, { "cell_type": "markdown", - "id": "eb826b36", + "id": "6af48362", "metadata": { "editable": true }, @@ -3929,7 +3936,7 @@ }, { "cell_type": "markdown", - "id": "28752526", + "id": "48251a47", "metadata": { "editable": true }, @@ -3951,7 +3958,7 @@ }, { "cell_type": "markdown", - "id": "76b0e979", + "id": "2039b415", "metadata": { "editable": true }, @@ -3980,7 +3987,7 @@ }, { "cell_type": "markdown", - "id": "0125057a", + "id": "cb8bd4ac", "metadata": { "editable": true }, @@ -3997,7 +4004,7 @@ }, { "cell_type": "markdown", - "id": "58c6793e", + "id": "6f4c2049", "metadata": { "editable": true }, @@ -4006,7 +4013,7 @@ "\n", "The mathematics of CNNs is based on the mathematical operation of\n", "**convolution**. In mathematics (in particular in functional analysis),\n", - "convolution is represented by matheematical operation (integration,\n", + "convolution is represented by mathematical operation (integration,\n", "summation etc) on two function in order to produce a third function\n", "that expresses how the shape of one gets modified by the other.\n", "Convolution has a plethora of applications in a variety of disciplines, spanning from statistics to signal processing, computer vision, solutions of differential equations,linear algebra, engineering, and yes, machine learning.\n", @@ -4017,7 +4024,7 @@ }, { "cell_type": "markdown", - "id": "7bb21e7b", + "id": "194adf46", "metadata": { "editable": true }, @@ -4029,7 +4036,7 @@ }, { "cell_type": "markdown", - "id": "268a63bc", + "id": "216effa0", "metadata": { "editable": true }, @@ -4041,7 +4048,7 @@ }, { "cell_type": "markdown", - "id": "65587ec8", + "id": "6fabe2c9", "metadata": { "editable": true }, @@ -4053,7 +4060,7 @@ }, { "cell_type": "markdown", - "id": "4fb849c2", + "id": "e1ecc441", "metadata": { "editable": true }, @@ -4063,7 +4070,7 @@ }, { "cell_type": "markdown", - "id": "6908ec39", + "id": "d5136cd4", "metadata": { "editable": true }, @@ -4075,7 +4082,7 @@ }, { "cell_type": "markdown", - "id": "3edfc6b1", + "id": "5d5ff8d2", "metadata": { "editable": true }, @@ -4087,7 +4094,7 @@ }, { "cell_type": "markdown", - "id": "1e6ded98", + "id": "87729212", "metadata": { "editable": true }, @@ -4102,7 +4109,7 @@ }, { "cell_type": "markdown", - "id": "a80afafe", + "id": "ddebe957", "metadata": { "editable": true }, @@ -4114,7 +4121,7 @@ }, { "cell_type": "markdown", - "id": "b29c0079", + "id": "672a4a43", "metadata": { "editable": true }, @@ -4124,7 +4131,7 @@ }, { "cell_type": "markdown", - "id": "0527c116", + "id": "488a4c13", "metadata": { "editable": true }, @@ -4136,7 +4143,7 @@ }, { "cell_type": "markdown", - "id": "313f2e6f", + "id": "31e50694", "metadata": { "editable": true }, @@ -4146,7 +4153,7 @@ }, { "cell_type": "markdown", - "id": "462ac708", + "id": "ab8404fd", "metadata": { "editable": true }, @@ -4158,7 +4165,7 @@ }, { "cell_type": "markdown", - "id": "8105210e", + "id": "b8605502", "metadata": { "editable": true }, @@ -4171,7 +4178,7 @@ }, { "cell_type": "markdown", - "id": "66022511", + "id": "7e013e96", "metadata": { "editable": true }, @@ -4190,7 +4197,7 @@ }, { "cell_type": "markdown", - "id": "2874e72e", + "id": "0a8fdfe0", "metadata": { "editable": true }, @@ -4202,7 +4209,7 @@ }, { "cell_type": "markdown", - "id": "efebfc9b", + "id": "3b65e8f6", "metadata": { "editable": true }, @@ -4214,7 +4221,7 @@ }, { "cell_type": "markdown", - "id": "fb347979", + "id": "0d5cb3c8", "metadata": { "editable": true }, @@ -4224,7 +4231,7 @@ }, { "cell_type": "markdown", - "id": "4334d234", + "id": "d5ddec71", "metadata": { "editable": true }, @@ -4236,7 +4243,7 @@ }, { "cell_type": "markdown", - "id": "cdb40090", + "id": "181120ae", "metadata": { "editable": true }, @@ -4246,7 +4253,7 @@ }, { "cell_type": "markdown", - "id": "d9eda0ad", + "id": "86daa797", "metadata": { "editable": true }, @@ -4260,7 +4267,7 @@ }, { "cell_type": "markdown", - "id": "3e58826b", + "id": "cc087e81", "metadata": { "editable": true }, @@ -4278,7 +4285,7 @@ }, { "cell_type": "markdown", - "id": "94ffc6c7", + "id": "26b82c1a", "metadata": { "editable": true }, @@ -4289,7 +4296,7 @@ }, { "cell_type": "markdown", - "id": "9f39d7d4", + "id": "1651d33a", "metadata": { "editable": true }, @@ -4307,7 +4314,7 @@ }, { "cell_type": "markdown", - "id": "d59e39d7", + "id": "e0ebf471", "metadata": { "editable": true }, @@ -4321,7 +4328,7 @@ }, { "cell_type": "markdown", - "id": "411c53d9", + "id": "8971e906", "metadata": { "editable": true }, @@ -4333,7 +4340,7 @@ }, { "cell_type": "markdown", - "id": "436ab0a8", + "id": "62ba93e3", "metadata": { "editable": true }, @@ -4345,7 +4352,7 @@ }, { "cell_type": "markdown", - "id": "bc20693c", + "id": "e613289a", "metadata": { "editable": true }, @@ -4359,7 +4366,7 @@ }, { "cell_type": "markdown", - "id": "f2c49e9a", + "id": "6ece4486", "metadata": { "editable": true }, @@ -4377,7 +4384,7 @@ }, { "cell_type": "markdown", - "id": "b07cbf54", + "id": "0fc5d4e1", "metadata": { "editable": true }, @@ -4398,7 +4405,7 @@ }, { "cell_type": "markdown", - "id": "0f287954", + "id": "6a429777", "metadata": { "editable": true }, @@ -4412,7 +4419,7 @@ }, { "cell_type": "markdown", - "id": "9fc748db", + "id": "85280aab", "metadata": { "editable": true }, @@ -4425,7 +4432,7 @@ }, { "cell_type": "markdown", - "id": "81a3a4fc", + "id": "131de7b1", "metadata": { "editable": true }, @@ -4438,7 +4445,7 @@ { "cell_type": "code", "execution_count": 11, - "id": "37297e83", + "id": "fb68da42", "metadata": { "collapsed": false, "editable": true @@ -4466,7 +4473,7 @@ }, { "cell_type": "markdown", - "id": "3b065515", + "id": "343f6bae", "metadata": { "editable": true }, @@ -4480,7 +4487,7 @@ }, { "cell_type": "markdown", - "id": "af214956", + "id": "5416e300", "metadata": { "editable": true }, @@ -4498,7 +4505,7 @@ }, { "cell_type": "markdown", - "id": "2beca743", + "id": "3c4563fd", "metadata": { "editable": true }, @@ -4513,7 +4520,7 @@ }, { "cell_type": "markdown", - "id": "64eaed05", + "id": "b371e100", "metadata": { "editable": true }, @@ -4531,7 +4538,7 @@ }, { "cell_type": "markdown", - "id": "9ec6d1b3", + "id": "44de0ee3", "metadata": { "editable": true }, @@ -4542,7 +4549,7 @@ }, { "cell_type": "markdown", - "id": "beb72f3d", + "id": "ccc1765a", "metadata": { "editable": true }, @@ -4562,7 +4569,7 @@ }, { "cell_type": "markdown", - "id": "38c4c08b", + "id": "b1b53c8a", "metadata": { "editable": true }, @@ -4581,7 +4588,7 @@ }, { "cell_type": "markdown", - "id": "1ac6c36b", + "id": "f76cb4b0", "metadata": { "editable": true }, @@ -4601,7 +4608,7 @@ }, { "cell_type": "markdown", - "id": "7f4d54c8", + "id": "b8f49d13", "metadata": { "editable": true }, @@ -4614,7 +4621,7 @@ }, { "cell_type": "markdown", - "id": "b05f58f2", + "id": "cc827d97", "metadata": { "editable": true }, @@ -4630,7 +4637,7 @@ }, { "cell_type": "markdown", - "id": "926a9483", + "id": "6fee45c7", "metadata": { "editable": true }, @@ -4647,7 +4654,7 @@ }, { "cell_type": "markdown", - "id": "984ae3a5", + "id": "db02d211", "metadata": { "editable": true }, @@ -4665,7 +4672,7 @@ }, { "cell_type": "markdown", - "id": "bdccb4bb", + "id": "7e55e082", "metadata": { "editable": true }, @@ -4675,7 +4682,7 @@ }, { "cell_type": "markdown", - "id": "663b09e3", + "id": "fd5a7811", "metadata": { "editable": true }, @@ -4691,7 +4698,7 @@ }, { "cell_type": "markdown", - "id": "e4c74881", + "id": "d302bfac", "metadata": { "editable": true }, @@ -4701,7 +4708,7 @@ }, { "cell_type": "markdown", - "id": "60aee159", + "id": "97722acb", "metadata": { "editable": true }, @@ -4720,7 +4727,7 @@ { "cell_type": "code", "execution_count": 12, - "id": "8ba6c1c6", + "id": "32721212", "metadata": { "collapsed": false, "editable": true @@ -4760,7 +4767,7 @@ }, { "cell_type": "markdown", - "id": "9f264ddd", + "id": "03311782", "metadata": { "editable": true }, @@ -4774,7 +4781,7 @@ }, { "cell_type": "markdown", - "id": "74a0f368", + "id": "a61d7447", "metadata": { "editable": true }, @@ -4786,7 +4793,7 @@ }, { "cell_type": "markdown", - "id": "9c1102b8", + "id": "645c6254", "metadata": { "editable": true }, @@ -4796,7 +4803,7 @@ }, { "cell_type": "markdown", - "id": "8eb090b1", + "id": "a33344bb", "metadata": { "editable": true }, @@ -4808,7 +4815,7 @@ }, { "cell_type": "markdown", - "id": "5d416d10", + "id": "84691f1c", "metadata": { "editable": true }, @@ -4818,7 +4825,7 @@ }, { "cell_type": "markdown", - "id": "3cd805c7", + "id": "f12f7a5d", "metadata": { "editable": true }, @@ -4830,7 +4837,7 @@ }, { "cell_type": "markdown", - "id": "436a64aa", + "id": "25b51aae", "metadata": { "editable": true }, @@ -4842,7 +4849,7 @@ }, { "cell_type": "markdown", - "id": "c5f539d4", + "id": "e749fd91", "metadata": { "editable": true }, @@ -4869,7 +4876,7 @@ }, { "cell_type": "markdown", - "id": "08f944f4", + "id": "556556cc", "metadata": { "editable": true }, @@ -4881,7 +4888,7 @@ }, { "cell_type": "markdown", - "id": "605955c0", + "id": "40b4d0fd", "metadata": { "editable": true }, @@ -4891,7 +4898,7 @@ }, { "cell_type": "markdown", - "id": "fe6508bd", + "id": "71ec62ab", "metadata": { "editable": true }, @@ -4917,7 +4924,7 @@ }, { "cell_type": "markdown", - "id": "50ace3ad", + "id": "6ec8caeb", "metadata": { "editable": true }, @@ -4929,7 +4936,7 @@ }, { "cell_type": "markdown", - "id": "554268fe", + "id": "f3aa7b7a", "metadata": { "editable": true }, @@ -4948,7 +4955,7 @@ }, { "cell_type": "markdown", - "id": "c3f9f676", + "id": "8febce0a", "metadata": { "editable": true }, @@ -4961,7 +4968,7 @@ }, { "cell_type": "markdown", - "id": "eb0d4525", + "id": "b397f362", "metadata": { "editable": true }, @@ -4973,7 +4980,7 @@ }, { "cell_type": "markdown", - "id": "f9f3528b", + "id": "c8fc382a", "metadata": { "editable": true }, @@ -4994,7 +5001,7 @@ }, { "cell_type": "markdown", - "id": "de8acbb2", + "id": "86ffb6f6", "metadata": { "editable": true }, @@ -5015,7 +5022,7 @@ }, { "cell_type": "markdown", - "id": "02776616", + "id": "8959f370", "metadata": { "editable": true }, @@ -5040,7 +5047,7 @@ }, { "cell_type": "markdown", - "id": "06fd9cb2", + "id": "ddb56a2f", "metadata": { "editable": true }, @@ -5059,7 +5066,7 @@ }, { "cell_type": "markdown", - "id": "ca92db38", + "id": "b400771a", "metadata": { "editable": true }, @@ -5070,7 +5077,7 @@ { "cell_type": "code", "execution_count": 13, - "id": "baef3c21", + "id": "917d9c6d", "metadata": { "collapsed": false, "editable": true @@ -5121,7 +5128,7 @@ }, { "cell_type": "markdown", - "id": "14041b53", + "id": "e10a5128", "metadata": { "editable": true }, @@ -5132,7 +5139,7 @@ { "cell_type": "code", "execution_count": 14, - "id": "c90dd64d", + "id": "c8098932", "metadata": { "collapsed": false, "editable": true @@ -5165,7 +5172,7 @@ }, { "cell_type": "markdown", - "id": "f8a831f6", + "id": "f6593bd8", "metadata": { "editable": true }, @@ -5176,7 +5183,7 @@ { "cell_type": "code", "execution_count": 15, - "id": "7fb9f0f5", + "id": "0f76b3ba", "metadata": { "collapsed": false, "editable": true @@ -5213,7 +5220,7 @@ }, { "cell_type": "markdown", - "id": "5814f30c", + "id": "7411180e", "metadata": { "editable": true }, @@ -5224,7 +5231,7 @@ { "cell_type": "code", "execution_count": 16, - "id": "8c121671", + "id": "10f7367b", "metadata": { "collapsed": false, "editable": true @@ -5251,7 +5258,7 @@ }, { "cell_type": "markdown", - "id": "1aaa8e5f", + "id": "da245dd9", "metadata": { "editable": true }, @@ -5262,7 +5269,7 @@ { "cell_type": "code", "execution_count": 17, - "id": "57fba01f", + "id": "81dff347", "metadata": { "collapsed": false, "editable": true @@ -5303,7 +5310,7 @@ }, { "cell_type": "markdown", - "id": "7a813b96", + "id": "912c9010", "metadata": { "editable": true }, @@ -5319,7 +5326,7 @@ { "cell_type": "code", "execution_count": 18, - "id": "a03deb67", + "id": "7000e8a1", "metadata": { "collapsed": false, "editable": true @@ -5340,7 +5347,7 @@ }, { "cell_type": "markdown", - "id": "ef32e9f6", + "id": "0bab7ce8", "metadata": { "editable": true }, @@ -5353,7 +5360,7 @@ { "cell_type": "code", "execution_count": 19, - "id": "c260731c", + "id": "8c78e3e6", "metadata": { "collapsed": false, "editable": true @@ -5378,7 +5385,7 @@ }, { "cell_type": "markdown", - "id": "320ecc37", + "id": "7da78343", "metadata": { "editable": true }, @@ -5393,7 +5400,7 @@ { "cell_type": "code", "execution_count": 20, - "id": "1d5aed4c", + "id": "8a578511", "metadata": { "collapsed": false, "editable": true @@ -5414,7 +5421,7 @@ }, { "cell_type": "markdown", - "id": "5d8b2190", + "id": "6c074c0f", "metadata": { "editable": true }, @@ -5424,7 +5431,7 @@ }, { "cell_type": "markdown", - "id": "9f76dfec", + "id": "1b4094f4", "metadata": { "editable": true }, @@ -5443,7 +5450,7 @@ { "cell_type": "code", "execution_count": 21, - "id": "13f4ccae", + "id": "68bfb099", "metadata": { "collapsed": false, "editable": true @@ -5460,7 +5467,7 @@ }, { "cell_type": "markdown", - "id": "b379e7e4", + "id": "417350ae", "metadata": { "editable": true }, @@ -5470,7 +5477,7 @@ }, { "cell_type": "markdown", - "id": "2c9490c4", + "id": "223d7e53", "metadata": { "editable": true }, @@ -5481,7 +5488,7 @@ { "cell_type": "code", "execution_count": 22, - "id": "6a02fe3e", + "id": "897c4149", "metadata": { "collapsed": false, "editable": true @@ -5498,7 +5505,7 @@ }, { "cell_type": "markdown", - "id": "1308a8ca", + "id": "68d9e4ca", "metadata": { "editable": true }, @@ -5509,7 +5516,7 @@ { "cell_type": "code", "execution_count": 23, - "id": "37cb16b1", + "id": "1f02ba2e", "metadata": { "collapsed": false, "editable": true diff --git a/doc/src/week42/week42.do.txt b/doc/src/week42/week42.do.txt index 2b50aeac3..d3846bd8e 100644 --- a/doc/src/week42/week42.do.txt +++ b/doc/src/week42/week42.do.txt @@ -23,7 +23,7 @@ DATE: today * "Video on Convolutional Neural Networks from MIT":"https://www.youtube.com/watch?v=iaSUYvmCekI&ab_channel=AlexanderAmini" * "Video on CNNs from Stanford":"https://www.youtube.com/watch?v=bNb2fEVKeEo&list=PLC1qU-LWwrF64f4QKQT-Vg5Wr4qEE1Zxk&index=6&ab_channel=StanfordUniversitySchoolofEngineering" !eblock - +m !bblock And Lecture material on CNNs * "Lectures from IN5400 spring 2019":"https://www.uio.no/studier/emner/matnat/ifi/IN5400/v19/material/week5/in5400_2019_week5_convolutional_nerual_networks.pdf" @@ -35,10 +35,10 @@ DATE: today !split ===== Using Automatic differentiation ===== - +a In our discussions of ordinary differential equations we will also study the usage of "Autograd":"https://www.youtube.com/watch?v=fRf4l5qaX1M&ab_channel=AlexSmola" in computing gradients for deep learning. For the documentation of Autograd and examples see the lectures slides from "week 39":"https://compphysics.github.io/MachineLearning/doc/pub/week39/html/week39.html" and the "Autograd documentation":"https://github.com/HIPS/autograd". - +t !split ===== Back propagation and automatic differentiation ===== @@ -62,6 +62,12 @@ and output layer to any given precision. "An Introduction to Neural Network Methods for Differential Equations":"https://www.springer.com/gp/book/9789401798150", by Yadav and Kumar. !eblock +!bblock Master thesis on applying deep learning to problems in mechanics +"Using Deep Reinforcement Learning for Active Flow Control":"https://www.duo.uio.no/handle/10852/79212", by Marius Holm +!eblock + + + !bblock Thanks to Kristine Baluka Hein The lectures on differential equations were developed by Kristine Baluka Hein, now PhD student at IFI. A great thanks to Kristine. @@ -2640,7 +2646,7 @@ We say we perform a filtering (convolution is the mathematical operation). The mathematics of CNNs is based on the mathematical operation of _convolution_. In mathematics (in particular in functional analysis), -convolution is represented by matheematical operation (integration, +convolution is represented by mathematical operation (integration, summation etc) on two function in order to produce a third function that expresses how the shape of one gets modified by the other. Convolution has a plethora of applications in a variety of disciplines, spanning from statistics to signal processing, computer vision, solutions of differential equations,linear algebra, engineering, and yes, machine learning.