Updated project 2
This commit is contained in:
@@ -255,7 +255,7 @@ standard gradient descent with a given learning rate, or even attempt
|
||||
to use the Newton-Raphson method. Alternatively, it may be useful for
|
||||
the next part on neural networks to implement a stochastic gradient
|
||||
descent. For all gradient methods, you can use _scikit-learn_'s toolbox for
|
||||
optimization methods instead of writing your own code.
|
||||
optimization methods in order to test your own results.
|
||||
|
||||
|
||||
The notebook of "Mehta et al":"https://physics.bu.edu/~pankajm/ML-Notebooks/HTML/NB_CVII-logreg_ising.html" is highly recommended in order to benchmark your code and results.
|
||||
@@ -271,10 +271,10 @@ now the network to find the optimal weights and biases. You are free
|
||||
to use the codes in the above lecture slides as starting points.
|
||||
|
||||
Train your network and compare the results with those from your linear regression code.
|
||||
You can test your results against a similar code using _scikit_learn_ (see the examples in teh above lecture notes) or _tensorflow/keras_.
|
||||
You can test your results against a similar code using _scikit_learn_ (see the examples in the above lecture notes) or _tensorflow/keras_.
|
||||
|
||||
You should have the same elements as in the regression examples, including the $R2$ score, the MSE, and bootstrap or cross-validation.
|
||||
|
||||
You may also need to think of using another activation function than the standard logistic function.
|
||||
|
||||
A useful reference on the back progagation algorithm is "Nielsen's book":"http://neuralnetworksanddeeplearning.com/". It is an excellent read.
|
||||
|
||||
|
||||
Reference in New Issue
Block a user