This commit is contained in:
Morten Hjorth-Jensen
2024-10-23 08:28:13 +02:00
parent bc73a7d17b
commit ffef6940b0
7 changed files with 644 additions and 678 deletions
File diff suppressed because it is too large Load Diff
File diff suppressed because one or more lines are too long
+5 -18
View File
@@ -1515,9 +1515,11 @@ doconce format html week43.do.txt --no_mako -->
<ul class="simple">
<li><p>Building our own Feed-forward Neural Network with intro to Tensorflow</p></li>
<li><p>Solving differential equations with Neural Networks</p></li>
<li><p>Video of lecture at <a class="reference external" href="https://youtu.be/vkBNTn-MLqs">https://youtu.be/vkBNTn-MLqs</a></p></li>
<li><p>Video of lecture at <a class="reference external" href="https://youtu.be/vkBNTn-MLqs">https://youtu.be/vkBNTn-MLqs</a></p></li>
<li><p>Video os second part, solving differential equations with neural networks at <a class="reference external" href="https://youtu.be/2N8To65I2wQ">https://youtu.be/2N8To65I2wQ</a></p></li>
<li><p>Whiteboard notes on solving differential equations at <a class="reference external" href="https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2024/NotesOct21.pdf">https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2024/NotesOct21.pdf</a></p></li>
</ul>
<!-- * [Whiteboard notes](https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2024/NotesOct21.pdf) --></div>
</div>
<div class="section" id="exercises-and-lab-session-week-43">
<h2>Exercises and lab session week 43<a class="headerlink" href="#exercises-and-lab-session-week-43" title="Permalink to this headline"></a></h2>
<p><strong>Lab sessions on Tuesday and Wednesday.</strong></p>
@@ -2351,7 +2353,7 @@ the <em>Hadamard product</em>, meaning element-wise multiplication.</p>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Old accuracy on training data: 0.1440501043841336
</pre></div>
</div>
<div class="output stderr highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>/var/folders/td/3yk470mj5p931p9dtkk0y6jw0000gn/T/ipykernel_96681/953065564.py:4: RuntimeWarning: overflow encountered in exp
<div class="output stderr highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>/var/folders/td/3yk470mj5p931p9dtkk0y6jw0000gn/T/ipykernel_98400/953065564.py:4: RuntimeWarning: overflow encountered in exp
return 1/(1 + np.exp(-x))
</pre></div>
</div>
@@ -2652,21 +2654,6 @@ Lambda = 10.0
Accuracy score on test set: 0.925
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Learning rate = 0.01
Lambda = 1e-05
Accuracy score on test set: 0.9472222222222222
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Learning rate = 0.01
Lambda = 0.0001
Accuracy score on test set: 0.9277777777777778
</pre></div>
</div>
<div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>Learning rate = 0.01
Lambda = 0.001
Accuracy score on test set: 0.9472222222222222
</pre></div>
</div>
<div class="output traceback highlight-ipythontb notranslate"><div class="highlight"><pre><span></span><span class="gt">---------------------------------------------------------------------------</span>
<span class="ne">KeyboardInterrupt</span><span class="g g-Whitespace"> </span>Traceback (most recent call last)
<span class="n">Cell</span> <span class="n">In</span><span class="p">[</span><span class="mi">8</span><span class="p">],</span> <span class="n">line</span> <span class="mi">11</span>