Week 41 Constructing a Neural Network code, Tensor flow and start Convolutional Neural Networks
Contents
Plan for week 41
Videos on Neural Networks
Setting up the Back propagation algorithm
Setting up a Multi-layer perceptron model for classification
Defining the cost function
Example: binary classification problem
The Softmax function
Developing a code for doing neural networks with back propagation
Collect and pre-process data
Train and test datasets
Define model and architecture
Layers
Weights and biases
Feed-forward pass
Matrix multiplications
Choose cost function and optimizer
Optimizing the cost function
Regularization
Matrix multiplication
Improving performance
Full object-oriented implementation
Evaluate model performance on test data
Adjust hyperparameters
Visualization
scikit-learn implementation
Visualization
Testing our code for the XOR, OR and AND gates
The AND and XOR Gates
Representing the Data Sets
Setting up the Neural Network
The Code using Scikit-Learn
Building neural networks in Tensorflow and Keras
Tensorflow
Using Keras
Collect and pre-process data
The Breast Cancer Data, now with Keras
The Mathematics of Neural Networks
Fine-tuning neural network hyperparameters
Hidden layers
Which activation function should I use?
Is the Logistic activation function (Sigmoid) our choice?
The derivative of the Logistic funtion
The RELU function family
Which activation function should we use?
More on activation functions, output layers
Batch Normalization
Dropout
Gradient Clipping
A very nice website on Neural Networks
A top-down perspective on Neural networks
Limitations of supervised learning with deep networks
Overarching Views, a personal note
From a Spherical Cow to a real one
Convolutional Neural Networks (recognizing images)
Regular NNs don’t scale well to full images
3D volumes of neurons
Layers used to build CNNs
Transforming images
CNNs in brief
CNNs in more detail, building convolutional neural networks in Tensorflow and Keras
Setting it up
The MNIST dataset again
Strong correlations
Layers of a CNN
Systematic reduction
Prerequisites: Collect and pre-process data
Importing Keras and Tensorflow
Running with Keras
Final part
Final visualization
Fun links
A very nice website on Neural Networks
You may find this
website
very useful. Thx a million to Ghadi for sharing.
«
1
...
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
...
72
»