update on week 41

2021-10-15 07:41:35 +02:00
parent de819218b1
commit b91376cfb6
2 changed files with 63 additions and 1436 deletions
@@ -1654,6 +1654,19 @@ plot_data(eta,n_neuron,Test_accuracy, 'testing')
 !ec


+!split
+===== The Mathematics of Neural Networks =====
+
+Text will be added here, see handwritten notes for Friday October 15. They contain a discussion on
+o Activation functions and vanishing gradients
+o Brief summary of gradient methods
+o Approximation theorems, in particular the *universal approximation theorem* for neural networks by Cybenko and Hornik
+
+I strongly recommend Michael Nielsen's intuitive approach to the neural networks and the universal approximation theorem, see the slides at URL:"http://neuralnetworksanddeeplearning.com/chap4.html".
+
+
+
+
 !split
 ===== Fine-tuning neural network hyperparameters =====