Morten Hjorth-Jensen
251 lines
11 KiB
HTML
251 lines
11 KiB
HTML
<!--
|
|
Automatically generated HTML file from DocOnce source
|
|
(https://github.com/hplgit/doconce/)
|
|
-->
|
|
<html>
|
|
<head>
|
|
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
|
|
<meta name="generator" content="DocOnce: https://github.com/hplgit/doconce/" />
|
|
<meta name="description" content="Project on Machine Learning">
|
|
|
|
<title>Project on Machine Learning</title>
|
|
|
|
<!-- Bootstrap style: bootstrap -->
|
|
<link href="http://netdna.bootstrapcdn.com/bootstrap/3.1.1/css/bootstrap.min.css" rel="stylesheet">
|
|
<!-- not necessary
|
|
<link href="http://netdna.bootstrapcdn.com/font-awesome/4.0.3/css/font-awesome.css" rel="stylesheet">
|
|
-->
|
|
|
|
<style type="text/css">
|
|
|
|
/* Add scrollbar to dropdown menus in bootstrap navigation bar */
|
|
.dropdown-menu {
|
|
height: auto;
|
|
max-height: 400px;
|
|
overflow-x: hidden;
|
|
}
|
|
|
|
/* Adds an invisible element before each target to offset for the navigation
|
|
bar */
|
|
.anchor::before {
|
|
content:"";
|
|
display:block;
|
|
height:50px; /* fixed header height for style bootstrap */
|
|
margin:-50px 0 0; /* negative fixed header height */
|
|
}
|
|
</style>
|
|
|
|
|
|
</head>
|
|
|
|
<!-- tocinfo
|
|
{'highest level': 2,
|
|
'sections': [('Using results from Monte Carlo models for machine learning',
|
|
2,
|
|
None,
|
|
'___sec0'),
|
|
('Introduction', 3, None, '___sec1'),
|
|
('Part a): Producing the data', 3, None, '___sec2'),
|
|
('Part b): Fitting the data using regression analysis and other methods',
|
|
3,
|
|
None,
|
|
'___sec3'),
|
|
('Part c): Introducing Bayesian statistics',
|
|
3,
|
|
None,
|
|
'___sec4'),
|
|
('Part d): Studying the Ising model or the VMC results with Neural networks',
|
|
3,
|
|
None,
|
|
'___sec5'),
|
|
('Background literature', 2, None, '___sec6'),
|
|
('Introduction to numerical projects', 2, None, '___sec7')]}
|
|
end of tocinfo -->
|
|
|
|
<body>
|
|
|
|
|
|
|
|
<script type="text/x-mathjax-config">
|
|
MathJax.Hub.Config({
|
|
TeX: {
|
|
equationNumbers: { autoNumber: "none" },
|
|
extensions: ["AMSmath.js", "AMSsymbols.js", "autobold.js", "color.js"]
|
|
}
|
|
});
|
|
</script>
|
|
<script type="text/javascript"
|
|
src="http://cdn.mathjax.org/mathjax/latest/MathJax.js?config=TeX-AMS-MML_HTMLorMML">
|
|
</script>
|
|
|
|
|
|
|
|
|
|
<!-- Bootstrap navigation bar -->
|
|
<div class="navbar navbar-default navbar-fixed-top">
|
|
<div class="navbar-header">
|
|
<button type="button" class="navbar-toggle" data-toggle="collapse" data-target=".navbar-responsive-collapse">
|
|
<span class="icon-bar"></span>
|
|
<span class="icon-bar"></span>
|
|
<span class="icon-bar"></span>
|
|
</button>
|
|
<a class="navbar-brand" href="Project-bs.html">Project on Machine Learning</a>
|
|
</div>
|
|
|
|
<div class="navbar-collapse collapse navbar-responsive-collapse">
|
|
<ul class="nav navbar-nav navbar-right">
|
|
<li class="dropdown">
|
|
<a href="#" class="dropdown-toggle" data-toggle="dropdown">Contents <b class="caret"></b></a>
|
|
<ul class="dropdown-menu">
|
|
<!-- navigation toc: --> <li><a href="#___sec0" style="font-size: 80%;"><b>Using results from Monte Carlo models for machine learning</b></a></li>
|
|
<!-- navigation toc: --> <li><a href="#___sec1" style="font-size: 80%;"> Introduction</a></li>
|
|
<!-- navigation toc: --> <li><a href="#___sec2" style="font-size: 80%;"> Part a): Producing the data</a></li>
|
|
<!-- navigation toc: --> <li><a href="#___sec3" style="font-size: 80%;"> Part b): Fitting the data using regression analysis and other methods</a></li>
|
|
<!-- navigation toc: --> <li><a href="#___sec4" style="font-size: 80%;"> Part c): Introducing Bayesian statistics</a></li>
|
|
<!-- navigation toc: --> <li><a href="#___sec5" style="font-size: 80%;"> Part d): Studying the Ising model or the VMC results with Neural networks</a></li>
|
|
<!-- navigation toc: --> <li><a href="#___sec6" style="font-size: 80%;"><b>Background literature</b></a></li>
|
|
<!-- navigation toc: --> <li><a href="#___sec7" style="font-size: 80%;"><b>Introduction to numerical projects</b></a></li>
|
|
|
|
</ul>
|
|
</li>
|
|
</ul>
|
|
</div>
|
|
</div>
|
|
</div> <!-- end of navigation bar -->
|
|
|
|
<div class="container">
|
|
|
|
<p> </p><p> </p><p> </p> <!-- add vertical space -->
|
|
|
|
<a name="part0000"></a>
|
|
<!-- ------------------- main content ---------------------- -->
|
|
|
|
|
|
|
|
<div class="jumbotron">
|
|
<center><h1>Project on Machine Learning</h1></center> <!-- document title -->
|
|
|
|
<p>
|
|
<!-- author(s): <a href="http://www.uio.no/studier/emner/matnat/fys/FYS3155/index-eng.html" target="_self">Data Analysis and Machine Learning FYS-MAT3155/FYS4155</a> -->
|
|
|
|
<center>
|
|
<b><a href="http://www.uio.no/studier/emner/matnat/fys/FYS3155/index-eng.html" target="_self">Data Analysis and Machine Learning FYS-MAT3155/FYS4155</a></b>
|
|
</center>
|
|
|
|
<p>
|
|
<!-- institution -->
|
|
|
|
<center><b>Department of Physics, University of Oslo, Norway</b></center>
|
|
<br>
|
|
<p>
|
|
<center><h4>Fall semester 2017</h4></center> <!-- date -->
|
|
<br>
|
|
<p>
|
|
</div> <!-- end jumbotron -->
|
|
|
|
<h2 id="___sec0" class="anchor">Using results from Monte Carlo models for machine learning </h2>
|
|
|
|
<h3 id="___sec1" class="anchor">Introduction </h3>
|
|
|
|
<p>
|
|
The aim of this project is to use an already developed Monte Carlo program (either the ising Model or a variational Monte Carlo code) to produce, in case of the Ising model, the energy as function of temperature. For the variational Monte carlo calculation of interacting electrons in an oscilaltor trap, the data are represented by the ground state energies as functions of the variational parameters.
|
|
|
|
<p>
|
|
In its simplest form
|
|
the energy of the Ising model is expressed as, without an externally applied magnetic field,
|
|
$$
|
|
E=-J\sum_{< kl >}^{N}s_ks_l
|
|
$$
|
|
|
|
with
|
|
\( s_k=\pm 1 \). The quantity \( N \) represents the total number of spins and \( J \) is a coupling
|
|
constant expressing the strength of the interaction between
|
|
neighboring spins. The symbol \( < kl> \) indicates that we sum over
|
|
nearest neighbors only. We will assume that we have a ferromagnetic
|
|
ordering, viz \( J> 0 \). We will use periodic boundary conditions and
|
|
the Metropolis algorithm only. Alternatively we can use the supplied variational Monte Carlo program which solves Schroedinger's equation for two interacting electrons in a harmonic oscillator trap. Both codes can be found at the webpage of the course under programs.
|
|
|
|
<h3 id="___sec2" class="anchor">Part a): Producing the data </h3>
|
|
|
|
<p>
|
|
\( \langle E\rangle \) and \( \langle \vert M\vert \rangle \), the specific heat
|
|
\( C_V \) and the susceptibility \( \chi \) as functions of \( T \) for \( L=40 \),
|
|
\( L=60 \), \( L=100 \) and \( L=140 \) for \( T\in [2.0,2.3] \) with a step in
|
|
temperature \( \Delta T=0.05 \) or smaller. You may find it convenient narrow the domain for \( T \).
|
|
|
|
<p>
|
|
Plot \( \langle E\rangle \),
|
|
\( \langle \vert M\vert\rangle \), \( C_V \) and \( \chi \) as functions of \( T \).
|
|
|
|
<h3 id="___sec3" class="anchor">Part b): Fitting the data using regression analysis and other methods </h3>
|
|
|
|
<p>
|
|
More text to come
|
|
|
|
<h3 id="___sec4" class="anchor">Part c): Introducing Bayesian statistics </h3>
|
|
|
|
More text to come
|
|
|
|
<h3 id="___sec5" class="anchor">Part d): Studying the Ising model or the VMC results with Neural networks </h3>
|
|
|
|
More text to come
|
|
|
|
<h2 id="___sec6" class="anchor">Background literature </h2>
|
|
|
|
<p>
|
|
If you wish to read more about the Ising model and statistical physics here are three suggestions.
|
|
|
|
<ul>
|
|
<li> <a href="http://www.worldscientific.com/worldscibooks/10.1142/5660" target="_self">M. Plischke and B. Bergersen</a>, <em>Equilibrium Statistical Physics</em>, World Scientific, see chapters 5 and 6.</li>
|
|
<li> <a href="http://www.cambridge.org/no/academic/subjects/physics/computational-science-and-modelling/guide-monte-carlo-simulations-statistical-physics-4th-edition?format=HB" target="_self">D. P. Landau and K. Binder</a>, <em>A Guide to Monte Carlo Simulations in Statistical Physics</em>, Cambridge, see chapters 2,3 and 4.</li>
|
|
<li> <a href="https://global.oup.com/academic/product/monte-carlo-methods-in-statistical-physics-9780198517979?cc=no&lang=en&" target="_self">M. E. J. Newman and T. Barkema</a>, <em>Monte Carlo Methods in Statistical Physics</em>, Oxford, see chapters 3 and 4.</li>
|
|
</ul>
|
|
|
|
<h2 id="___sec7" class="anchor">Introduction to numerical projects </h2>
|
|
|
|
<p>
|
|
Here follows a brief recipe and recommendation on how to write a report for each
|
|
project.
|
|
|
|
<ul>
|
|
<li> Give a short description of the nature of the problem and the eventual numerical methods you have used.</li>
|
|
<li> Describe the algorithm you have used and/or developed. Here you may find it convenient to use pseudocoding. In many cases you can describe the algorithm in the program itself.</li>
|
|
<li> Include the source code of your program. Comment your program properly.</li>
|
|
<li> If possible, try to find analytic solutions, or known limits in order to test your program when developing the code.</li>
|
|
<li> Include your results either in figure form or in a table. Remember to label your results. All tables and figures should have relevant captions and labels on the axes.</li>
|
|
<li> Try to evaluate the reliabilty and numerical stability/precision of your results. If possible, include a qualitative and/or quantitative discussion of the numerical stability, eventual loss of precision etc.</li>
|
|
<li> Try to give an interpretation of you results in your answers to the problems.</li>
|
|
<li> Critique: if possible include your comments and reflections about the exercise, whether you felt you learnt something, ideas for improvements and other thoughts you've made when solving the exercise. We wish to keep this course at the interactive level and your comments can help us improve it.</li>
|
|
<li> Try to establish a practice where you log your work at the computerlab. You may find such a logbook very handy at later stages in your work, especially when you don't properly remember what a previous test version of your program did. Here you could also record the time spent on solving the exercise, various algorithms you may have tested or other topics which you feel worthy of mentioning.</li>
|
|
</ul>
|
|
|
|
|
|
<p>
|
|
<!-- navigation buttons at the bottom of the page -->
|
|
<ul class="pagination">
|
|
<li class="active"><a href="._Project-bs000.html">1</a></li>
|
|
</ul>
|
|
<!-- ------------------- end of main content --------------- -->
|
|
|
|
</div> <!-- end container -->
|
|
<!-- include javascript, jQuery *first* -->
|
|
<script src="http://ajax.googleapis.com/ajax/libs/jquery/1.10.2/jquery.min.js"></script>
|
|
<script src="http://netdna.bootstrapcdn.com/bootstrap/3.0.0/js/bootstrap.min.js"></script>
|
|
|
|
<!-- Bootstrap footer
|
|
<footer>
|
|
<a href="http://..."><img width="250" align=right src="http://..."></a>
|
|
</footer>
|
|
-->
|
|
|
|
|
|
<center style="font-size:80%">
|
|
<!-- copyright --> © 1999-2017, "Data Analysis and Machine Learning FYS-MAT3155/FYS4155":"http://www.uio.no/studier/emner/matnat/fys/FYS3155/index-eng.html". Released under CC Attribution-NonCommercial 4.0 license
|
|
</center>
|
|
|
|
|
|
</body>
|
|
</html>
|
|
|
|
|