This confirms that an MLP, despite its quite convoluted mathematical form, is nothing more than an analytic function, specifically a mapping of real-valued vectors \( \vec{x} \in \mathbb{R}^n \rightarrow \vec{y} \in \mathbb{R}^m \). In our example, \( n=2 \) and \( m=1 \). Consequentially, the number of input and output values of the function we want to fit must be equal to the number of inputs and outputs of our MLP.
Furthermore, the flexibility and universality of a MLP can be illustrated by realizing that the expression is essentially a nested sum of scaled activation functions of the form $$ \begin{equation} h(x) = c_1 f(c_2 x + c_3) + c_4 \tag{11} \end{equation} $$ where the parameters \( c_i \) are weights and biases. By adjusting these parameters, the activation functions can be shifted up and down or left and right, change slope or be rescaled which is the key to the flexibility of a NN. $$ \begin{equation} f_o = f(u_o) = u_o \tag{12} \end{equation} $$