This commit is contained in:
Morten Hjorth-Jensen
2022-09-29 07:58:09 +02:00
parent f77b4566f8
commit 152b1d7d52
5 changed files with 4 additions and 8 deletions
+1 -2
View File
@@ -1809,8 +1809,7 @@ training data can have on order of millions of examples. Hence, it
seems wasteful to compute the full cost function over the entire
training set in order to perform only a single parameter update. A
very common approach to addressing this challenge is to compute the
gradient over batches of the training data. For example, in current
a typical batch could contain some thousand examples from
gradient over batches of the training data. For example, a typical batch could contain some thousand examples from
an entire training set of several millions. This batch is then used to
perform a parameter update.
</p>
+1 -2
View File
@@ -1774,8 +1774,7 @@ training data can have on order of millions of examples. Hence, it
seems wasteful to compute the full cost function over the entire
training set in order to perform only a single parameter update. A
very common approach to addressing this challenge is to compute the
gradient over batches of the training data. For example, in current
a typical batch could contain some thousand examples from
gradient over batches of the training data. For example, a typical batch could contain some thousand examples from
an entire training set of several millions. This batch is then used to
perform a parameter update.
</p>
+1 -2
View File
@@ -1851,8 +1851,7 @@ training data can have on order of millions of examples. Hence, it
seems wasteful to compute the full cost function over the entire
training set in order to perform only a single parameter update. A
very common approach to addressing this challenge is to compute the
gradient over batches of the training data. For example, in current
a typical batch could contain some thousand examples from
gradient over batches of the training data. For example, a typical batch could contain some thousand examples from
an entire training set of several millions. This batch is then used to
perform a parameter update.
</p>
Binary file not shown.
+1 -2
View File
@@ -1217,8 +1217,7 @@ training data can have on order of millions of examples. Hence, it
seems wasteful to compute the full cost function over the entire
training set in order to perform only a single parameter update. A
very common approach to addressing this challenge is to compute the
gradient over batches of the training data. For example, in current
a typical batch could contain some thousand examples from
gradient over batches of the training data. For example, a typical batch could contain some thousand examples from
an entire training set of several millions. This batch is then used to
perform a parameter update.