76 lines
2.9 KiB
TeX
76 lines
2.9 KiB
TeX
\documentclass[amsmath,amssymb,twocolumn,aps,rmp]{revtex4}
|
|
|
|
% allows special characters (including æøå)
|
|
\usepackage[utf8]{inputenc}
|
|
%\usepackage [norsk]{babel} %if you write norwegian
|
|
\usepackage[english]{babel} %if you write english
|
|
|
|
\usepackage{amssymb} % mathematical symbols (physics imports amsmath)
|
|
\usepackage{graphicx} % include graphics such as plots
|
|
\usepackage[table]{xcolor}
|
|
\usepackage{xcolor} % set colors
|
|
\usepackage{hyperref} % automagic cross-referencing
|
|
\usepackage{float} % force placement of tables and figures
|
|
\usepackage{cleveref}
|
|
\usepackage{tikz}
|
|
|
|
\usetikzlibrary{decorations.pathreplacing}
|
|
\usepackage{csquotes}
|
|
|
|
\usepackage{xcolor}
|
|
\definecolor{turq}{RGB}{64,224,208}
|
|
\usepackage{siunitx}
|
|
\newcommand{\norm}[1]{\left\lVert#1\right\rVert}
|
|
\newcommand{\cols}{C_\mathrm{OLS}}
|
|
\newcommand{\colr}{C_\mathrm{Ridge}}
|
|
\newcommand{\coll}{C_\mathrm{Lasso}}
|
|
\newcommand{\mse}{\mathrm{MSE}}
|
|
\newcommand{\bias}{\mathrm{Bias}}
|
|
\newcommand{\var}{\mathrm{Var}}
|
|
\newcommand{\E}{\mathbb{E}}
|
|
\newcommand{\N}{N_\mathrm{train}}
|
|
\newcommand{\Nt}{N_{\mathrm{test}}}
|
|
|
|
|
|
%\usepackage[left]{lineno}
|
|
%\linenumbers
|
|
|
|
|
|
\begin{document}
|
|
%\pagenumbering{gobble}
|
|
|
|
\title{Regularization and Optimization is All You Need?}
|
|
|
|
\author{Lars Bogner}
|
|
\affiliation{\url{https://github.uio.no/larsbog/FYSSTK-Project1}}
|
|
|
|
|
|
\begin{abstract}
|
|
The basis for many data-driven methods is the optimization of numerical models to describe relations in data. With the increasing availability of large datasets and the growing complexity of models, there is an increasing need for efficient optimization techniques that can handle the computational challenges associated with big data. Furthermore, a good optimization metric can be crucial to find the best possible model to describe the data. In this paper different methods of such optimization are studied in the context of large datasets and big data with possibly noise-affected input data. To render the best possible fits a multitude of cost functions, minimization algorithms and other approaches to reduce the computation associated with the optimization process are studied and evaluated. Reducing the computational cost is also important to improve the economical and ecological footprint of training large models on big data, as the spread of data-driven methods in all areas of life is increasing rapidly.
|
|
Using optimal optimization techniques the convergence can be improved by up to one order of magnitude.
|
|
\end{abstract}
|
|
|
|
\maketitle
|
|
|
|
\tableofcontents
|
|
|
|
|
|
\section{Introduction} \label{sec:introduction}
|
|
\input{chapters/introduction.tex}
|
|
|
|
|
|
\section{Methods} \label{sec:methods}
|
|
\input{chapters/methods.tex}
|
|
|
|
\section{Results and Discussion} \label{sec:results}
|
|
\input{chapters/results.tex}
|
|
|
|
\section{Conclusion} \label{sec:conclusion}
|
|
\input{chapters/conclusion.tex}
|
|
|
|
\section{Perspective} \label{sec:perspective}
|
|
\input{chapters/perspective.tex}
|
|
|
|
\bibliography{include/sources/references} % add references to this file
|
|
\end{document}
|