Adding motivation to BNN
This commit is contained in:
@@ -41,7 +41,7 @@ Automatically generated HTML file from DocOnce source
|
||||
|
||||
<!-- tocinfo
|
||||
{'highest level': 2,
|
||||
'sections': [('What is Bayesian Statistics', 2, None, '___sec0'),
|
||||
'sections': [('Why Bayesian Statistics?', 2, None, '___sec0'),
|
||||
('Inference', 2, None, '___sec1'),
|
||||
('Statistical Inference', 2, None, '___sec2'),
|
||||
('Some history', 2, None, '___sec3'),
|
||||
@@ -115,7 +115,7 @@ MathJax.Hub.Config({
|
||||
<li class="dropdown">
|
||||
<a href="#" class="dropdown-toggle" data-toggle="dropdown">Contents <b class="caret"></b></a>
|
||||
<ul class="dropdown-menu">
|
||||
<!-- navigation toc: --> <li><a href="._Bayesian-bs001.html#___sec0" style="font-size: 80%;"><b>What is Bayesian Statistics</b></a></li>
|
||||
<!-- navigation toc: --> <li><a href="._Bayesian-bs001.html#___sec0" style="font-size: 80%;"><b>Why Bayesian Statistics?</b></a></li>
|
||||
<!-- navigation toc: --> <li><a href="._Bayesian-bs002.html#___sec1" style="font-size: 80%;"><b>Inference</b></a></li>
|
||||
<!-- navigation toc: --> <li><a href="._Bayesian-bs003.html#___sec2" style="font-size: 80%;"><b>Statistical Inference</b></a></li>
|
||||
<!-- navigation toc: --> <li><a href="._Bayesian-bs004.html#___sec3" style="font-size: 80%;"><b>Some history</b></a></li>
|
||||
@@ -175,7 +175,7 @@ MathJax.Hub.Config({
|
||||
<center>[3] <b>Department of Physics and Astronomy and National Superconducting Cyclotron Laboratory, Michigan State University</b></center>
|
||||
<br>
|
||||
<p>
|
||||
<center><h4>Jun 7, 2019</h4></center> <!-- date -->
|
||||
<center><h4>Jun 8, 2019</h4></center> <!-- date -->
|
||||
<br>
|
||||
<p>
|
||||
|
||||
|
||||
@@ -41,7 +41,7 @@ Automatically generated HTML file from DocOnce source
|
||||
|
||||
<!-- tocinfo
|
||||
{'highest level': 2,
|
||||
'sections': [('What is Bayesian Statistics', 2, None, '___sec0'),
|
||||
'sections': [('Why Bayesian Statistics?', 2, None, '___sec0'),
|
||||
('Inference', 2, None, '___sec1'),
|
||||
('Statistical Inference', 2, None, '___sec2'),
|
||||
('Some history', 2, None, '___sec3'),
|
||||
@@ -115,7 +115,7 @@ MathJax.Hub.Config({
|
||||
<li class="dropdown">
|
||||
<a href="#" class="dropdown-toggle" data-toggle="dropdown">Contents <b class="caret"></b></a>
|
||||
<ul class="dropdown-menu">
|
||||
<!-- navigation toc: --> <li><a href="#___sec0" style="font-size: 80%;"><b>What is Bayesian Statistics</b></a></li>
|
||||
<!-- navigation toc: --> <li><a href="#___sec0" style="font-size: 80%;"><b>Why Bayesian Statistics?</b></a></li>
|
||||
<!-- navigation toc: --> <li><a href="._Bayesian-bs002.html#___sec1" style="font-size: 80%;"><b>Inference</b></a></li>
|
||||
<!-- navigation toc: --> <li><a href="._Bayesian-bs003.html#___sec2" style="font-size: 80%;"><b>Statistical Inference</b></a></li>
|
||||
<!-- navigation toc: --> <li><a href="._Bayesian-bs004.html#___sec3" style="font-size: 80%;"><b>Some history</b></a></li>
|
||||
@@ -151,19 +151,29 @@ MathJax.Hub.Config({
|
||||
<a name="part0001"></a>
|
||||
<!-- !split -->
|
||||
|
||||
<h2 id="___sec0" class="anchor">What is Bayesian Statistics </h2>
|
||||
<h2 id="___sec0" class="anchor">Why Bayesian Statistics? </h2>
|
||||
<div class="panel panel-default">
|
||||
<div class="panel-body">
|
||||
<p> <!-- subsequent paragraphs come in larger fonts, so start with a paragraph -->
|
||||
Morten's original plan: Reminder about probabilities from the statistics section
|
||||
|
||||
<ol>
|
||||
<li> Product rule</li>
|
||||
<li> Binomial distribution</li>
|
||||
<li> Gaussian PDF</li>
|
||||
<li> other PDFs</li>
|
||||
<li> Bayesian regression analysis</li>
|
||||
</ol>
|
||||
<p>
|
||||
We have already made ourselves familiar with elements of a statistical
|
||||
data analysis via quantities like the bias-variance tradeoff as well
|
||||
as some central distribution functions such as the Normal
|
||||
distribution, the binomial distribution and other probability
|
||||
distribution functions.
|
||||
|
||||
<p>
|
||||
In essentially all the Machine Learning
|
||||
algorithms we have studied, our focus has been on a so-called
|
||||
<b>frequentist approach</b>, where knowledge of an underlying likelihood
|
||||
function has not been emphasized. Our data, whether we had a classification or a regression problem, have been our central points of departure.
|
||||
|
||||
<p>
|
||||
Here we wish to merge this approach with the derivation of a likelihood function which can be used to make prediction on how our system under study evolves.
|
||||
We will venture into the realm of what is called Bayesian Neural Networks. To get an overarching view on what this entails, the following figure conveys the essential differences between a standard Neural network that we have met earlier and a Bayesian Neural Network. In order to get there, we need to present some of the basic elements of Bayesian statistics, starting with the product rule and Bayes' theorem.
|
||||
|
||||
<p>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
|
||||
@@ -41,7 +41,7 @@ Automatically generated HTML file from DocOnce source
|
||||
|
||||
<!-- tocinfo
|
||||
{'highest level': 2,
|
||||
'sections': [('What is Bayesian Statistics', 2, None, '___sec0'),
|
||||
'sections': [('Why Bayesian Statistics?', 2, None, '___sec0'),
|
||||
('Inference', 2, None, '___sec1'),
|
||||
('Statistical Inference', 2, None, '___sec2'),
|
||||
('Some history', 2, None, '___sec3'),
|
||||
@@ -115,7 +115,7 @@ MathJax.Hub.Config({
|
||||
<li class="dropdown">
|
||||
<a href="#" class="dropdown-toggle" data-toggle="dropdown">Contents <b class="caret"></b></a>
|
||||
<ul class="dropdown-menu">
|
||||
<!-- navigation toc: --> <li><a href="._Bayesian-bs001.html#___sec0" style="font-size: 80%;"><b>What is Bayesian Statistics</b></a></li>
|
||||
<!-- navigation toc: --> <li><a href="._Bayesian-bs001.html#___sec0" style="font-size: 80%;"><b>Why Bayesian Statistics?</b></a></li>
|
||||
<!-- navigation toc: --> <li><a href="._Bayesian-bs002.html#___sec1" style="font-size: 80%;"><b>Inference</b></a></li>
|
||||
<!-- navigation toc: --> <li><a href="._Bayesian-bs003.html#___sec2" style="font-size: 80%;"><b>Statistical Inference</b></a></li>
|
||||
<!-- navigation toc: --> <li><a href="._Bayesian-bs004.html#___sec3" style="font-size: 80%;"><b>Some history</b></a></li>
|
||||
@@ -175,7 +175,7 @@ MathJax.Hub.Config({
|
||||
<center>[3] <b>Department of Physics and Astronomy and National Superconducting Cyclotron Laboratory, Michigan State University</b></center>
|
||||
<br>
|
||||
<p>
|
||||
<center><h4>Jun 7, 2019</h4></center> <!-- date -->
|
||||
<center><h4>Jun 8, 2019</h4></center> <!-- date -->
|
||||
<br>
|
||||
<p>
|
||||
|
||||
|
||||
@@ -153,7 +153,7 @@ MathJax.Hub.Config({
|
||||
<center>[3] <b>Department of Physics and Astronomy and National Superconducting Cyclotron Laboratory, Michigan State University</b></center>
|
||||
<br>
|
||||
<p> <br>
|
||||
<center><h4>Jun 7, 2019</h4></center> <!-- date -->
|
||||
<center><h4>Jun 8, 2019</h4></center> <!-- date -->
|
||||
<br>
|
||||
<p>
|
||||
|
||||
@@ -164,19 +164,27 @@ MathJax.Hub.Config({
|
||||
|
||||
|
||||
<section>
|
||||
<h2 id="___sec0">What is Bayesian Statistics </h2>
|
||||
<h2 id="___sec0">Why Bayesian Statistics? </h2>
|
||||
<div class="alert alert-block alert-block alert-text-normal">
|
||||
<b></b>
|
||||
<p>
|
||||
Morten's original plan: Reminder about probabilities from the statistics section
|
||||
We have already made ourselves familiar with elements of a statistical
|
||||
data analysis via quantities like the bias-variance tradeoff as well
|
||||
as some central distribution functions such as the Normal
|
||||
distribution, the binomial distribution and other probability
|
||||
distribution functions.
|
||||
|
||||
<p>
|
||||
In essentially all the Machine Learning
|
||||
algorithms we have studied, our focus has been on a so-called
|
||||
<b>frequentist approach</b>, where knowledge of an underlying likelihood
|
||||
function has not been emphasized. Our data, whether we had a classification or a regression problem, have been our central points of departure.
|
||||
|
||||
<p>
|
||||
Here we wish to merge this approach with the derivation of a likelihood function which can be used to make prediction on how our system under study evolves.
|
||||
We will venture into the realm of what is called Bayesian Neural Networks. To get an overarching view on what this entails, the following figure conveys the essential differences between a standard Neural network that we have met earlier and a Bayesian Neural Network. In order to get there, we need to present some of the basic elements of Bayesian statistics, starting with the product rule and Bayes' theorem.
|
||||
|
||||
|
||||
<ol>
|
||||
<p><li> Product rule</li>
|
||||
<p><li> Binomial distribution</li>
|
||||
<p><li> Gaussian PDF</li>
|
||||
<p><li> other PDFs</li>
|
||||
<p><li> Bayesian regression analysis</li>
|
||||
</ol>
|
||||
</div>
|
||||
</section>
|
||||
|
||||
|
||||
@@ -61,7 +61,7 @@ div { text-align: justify; text-justify: inter-word; }
|
||||
|
||||
<!-- tocinfo
|
||||
{'highest level': 2,
|
||||
'sections': [('What is Bayesian Statistics', 2, None, '___sec0'),
|
||||
'sections': [('Why Bayesian Statistics?', 2, None, '___sec0'),
|
||||
('Inference', 2, None, '___sec1'),
|
||||
('Statistical Inference', 2, None, '___sec2'),
|
||||
('Some history', 2, None, '___sec3'),
|
||||
@@ -144,24 +144,34 @@ MathJax.Hub.Config({
|
||||
<center>[3] <b>Department of Physics and Astronomy and National Superconducting Cyclotron Laboratory, Michigan State University</b></center>
|
||||
<br>
|
||||
<p>
|
||||
<center><h4>Jun 7, 2019</h4></center> <!-- date -->
|
||||
<center><h4>Jun 8, 2019</h4></center> <!-- date -->
|
||||
<br>
|
||||
<p>
|
||||
<!-- !split --><br><br><br><br><br><br><br><br><br><br>
|
||||
|
||||
<h2 id="___sec0">What is Bayesian Statistics </h2>
|
||||
<h2 id="___sec0">Why Bayesian Statistics? </h2>
|
||||
<div class="alert alert-block alert-block alert-text-normal">
|
||||
<b></b>
|
||||
<p>
|
||||
Morten's original plan: Reminder about probabilities from the statistics section
|
||||
|
||||
<ol>
|
||||
<li> Product rule</li>
|
||||
<li> Binomial distribution</li>
|
||||
<li> Gaussian PDF</li>
|
||||
<li> other PDFs</li>
|
||||
<li> Bayesian regression analysis</li>
|
||||
</ol>
|
||||
<p>
|
||||
We have already made ourselves familiar with elements of a statistical
|
||||
data analysis via quantities like the bias-variance tradeoff as well
|
||||
as some central distribution functions such as the Normal
|
||||
distribution, the binomial distribution and other probability
|
||||
distribution functions.
|
||||
|
||||
<p>
|
||||
In essentially all the Machine Learning
|
||||
algorithms we have studied, our focus has been on a so-called
|
||||
<b>frequentist approach</b>, where knowledge of an underlying likelihood
|
||||
function has not been emphasized. Our data, whether we had a classification or a regression problem, have been our central points of departure.
|
||||
|
||||
<p>
|
||||
Here we wish to merge this approach with the derivation of a likelihood function which can be used to make prediction on how our system under study evolves.
|
||||
We will venture into the realm of what is called Bayesian Neural Networks. To get an overarching view on what this entails, the following figure conveys the essential differences between a standard Neural network that we have met earlier and a Bayesian Neural Network. In order to get there, we need to present some of the basic elements of Bayesian statistics, starting with the product rule and Bayes' theorem.
|
||||
|
||||
|
||||
</div>
|
||||
|
||||
|
||||
|
||||
@@ -66,7 +66,7 @@ div { text-align: justify; text-justify: inter-word; }
|
||||
|
||||
<!-- tocinfo
|
||||
{'highest level': 2,
|
||||
'sections': [('What is Bayesian Statistics', 2, None, '___sec0'),
|
||||
'sections': [('Why Bayesian Statistics?', 2, None, '___sec0'),
|
||||
('Inference', 2, None, '___sec1'),
|
||||
('Statistical Inference', 2, None, '___sec2'),
|
||||
('Some history', 2, None, '___sec3'),
|
||||
@@ -149,24 +149,34 @@ MathJax.Hub.Config({
|
||||
<center>[3] <b>Department of Physics and Astronomy and National Superconducting Cyclotron Laboratory, Michigan State University</b></center>
|
||||
<br>
|
||||
<p>
|
||||
<center><h4>Jun 7, 2019</h4></center> <!-- date -->
|
||||
<center><h4>Jun 8, 2019</h4></center> <!-- date -->
|
||||
<br>
|
||||
<p>
|
||||
<!-- !split --><br><br><br><br><br><br><br><br><br><br>
|
||||
|
||||
<h2 id="___sec0">What is Bayesian Statistics </h2>
|
||||
<h2 id="___sec0">Why Bayesian Statistics? </h2>
|
||||
<div class="alert alert-block alert-block alert-text-normal">
|
||||
<b></b>
|
||||
<p>
|
||||
Morten's original plan: Reminder about probabilities from the statistics section
|
||||
|
||||
<ol>
|
||||
<li> Product rule</li>
|
||||
<li> Binomial distribution</li>
|
||||
<li> Gaussian PDF</li>
|
||||
<li> other PDFs</li>
|
||||
<li> Bayesian regression analysis</li>
|
||||
</ol>
|
||||
<p>
|
||||
We have already made ourselves familiar with elements of a statistical
|
||||
data analysis via quantities like the bias-variance tradeoff as well
|
||||
as some central distribution functions such as the Normal
|
||||
distribution, the binomial distribution and other probability
|
||||
distribution functions.
|
||||
|
||||
<p>
|
||||
In essentially all the Machine Learning
|
||||
algorithms we have studied, our focus has been on a so-called
|
||||
<b>frequentist approach</b>, where knowledge of an underlying likelihood
|
||||
function has not been emphasized. Our data, whether we had a classification or a regression problem, have been our central points of departure.
|
||||
|
||||
<p>
|
||||
Here we wish to merge this approach with the derivation of a likelihood function which can be used to make prediction on how our system under study evolves.
|
||||
We will venture into the realm of what is called Bayesian Neural Networks. To get an overarching view on what this entails, the following figure conveys the essential differences between a standard Neural network that we have met earlier and a Bayesian Neural Network. In order to get there, we need to present some of the basic elements of Bayesian statistics, starting with the product rule and Bayes' theorem.
|
||||
|
||||
|
||||
</div>
|
||||
|
||||
|
||||
|
||||
Reference in New Issue
Block a user