added more text

2021-10-22 07:55:23 +02:00
parent af905dd693
commit 4618a2a7ee
98 changed files with 3809 additions and 3536 deletions
@@ -2608,6 +2608,18 @@ the course
 "IN5400 – Machine Learning for Image Analysis":"https://www.uio.no/studier/emner/matnat/ifi/IN5400/index-eng.html"
 and the slides of "CS231":"http://cs231n.github.io/convolutional-networks/" which is taught at Stanford University (consistently ranked as one of the top computer science programs in the world). "Michael Nielsen's book is a must read, in particular chapter 6 which deals with CNNs":"http://neuralnetworksanddeeplearning.com/chap6.html".

+The textbook by Goodfellow et al, see chapter 9 contains an in depth discussion as well.
+
+!split
+===== Key Idea =====
+
+A dense neural network is representd by an affine operation (like matrix-matrix multiplication) where all parameters are included.
+
+The key idea in CNNs for say imaging is that in images neighbor pixels tend to be related! So we connect
+only neighboring neurons in the input instead of connecting all with the first hidden layer.
+
+We say we perform a filtering (convolution is the mathematical operation). 
+

 !split
 ===== Mathematics of CNNs =====