diff --git a/doc/LectureNotes/_build/.doctrees/environment.pickle b/doc/LectureNotes/_build/.doctrees/environment.pickle index bfdb10086..9a98d1a0a 100644 Binary files a/doc/LectureNotes/_build/.doctrees/environment.pickle and b/doc/LectureNotes/_build/.doctrees/environment.pickle differ diff --git a/doc/LectureNotes/_build/.doctrees/week40.doctree b/doc/LectureNotes/_build/.doctrees/week40.doctree index e50aa9ed2..3cd77a328 100644 Binary files a/doc/LectureNotes/_build/.doctrees/week40.doctree and b/doc/LectureNotes/_build/.doctrees/week40.doctree differ diff --git a/doc/LectureNotes/_build/html/_images/week40_100_1.png b/doc/LectureNotes/_build/html/_images/week40_100_1.png index 64652a3ae..34e6443ac 100644 Binary files a/doc/LectureNotes/_build/html/_images/week40_100_1.png and b/doc/LectureNotes/_build/html/_images/week40_100_1.png differ diff --git a/doc/LectureNotes/_build/html/_images/week40_104_1.png b/doc/LectureNotes/_build/html/_images/week40_104_1.png index 2bc10a52c..0fdc89348 100644 Binary files a/doc/LectureNotes/_build/html/_images/week40_104_1.png and b/doc/LectureNotes/_build/html/_images/week40_104_1.png differ diff --git a/doc/LectureNotes/_build/html/_images/week40_34_1.png b/doc/LectureNotes/_build/html/_images/week40_34_1.png index ba29393bc..b736cd3d6 100644 Binary files a/doc/LectureNotes/_build/html/_images/week40_34_1.png and b/doc/LectureNotes/_build/html/_images/week40_34_1.png differ diff --git a/doc/LectureNotes/_build/html/_sources/week40.ipynb b/doc/LectureNotes/_build/html/_sources/week40.ipynb index cfe6bdd0b..c316b1d31 100644 --- a/doc/LectureNotes/_build/html/_sources/week40.ipynb +++ b/doc/LectureNotes/_build/html/_sources/week40.ipynb @@ -2,8 +2,10 @@ "cells": [ { "cell_type": "markdown", - "id": "54c44098", - "metadata": {}, + "id": "71c0e62a", + "metadata": { + "editable": true + }, "source": [ "\n", @@ -12,8 +14,10 @@ }, { "cell_type": "markdown", - "id": "f64073c9", - "metadata": {}, + "id": "4e0afae4", + "metadata": { + "editable": true + }, "source": [ "# Week 40: Gradient descent methods (continued) and start Neural networks\n", "**Morten Hjorth-Jensen**, Department of Physics, University of Oslo, Norway and Department of Physics and Astronomy and Facility for Rare Ion Beams, Michigan State University, USA\n", @@ -23,29 +27,37 @@ }, { "cell_type": "markdown", - "id": "d2d0f844", - "metadata": {}, + "id": "e6b378ac", + "metadata": { + "editable": true + }, "source": [ "## Plans for week 40" ] }, { "cell_type": "markdown", - "id": "c9630d37", - "metadata": {}, + "id": "1ba91689", + "metadata": { + "editable": true + }, "source": [ "## Lecture Monday September 30, 2024\n", "1. Stochastic Gradient descent with examples and automatic differentiation\n", "\n", "2. If we get time, we start with the basics of Neural Networks, setting up the basic steps, from the simple perceptron model to the multi-layer perceptron model\n", - "\n", - "" + "\n", + "3. [Video of lecture](https://youtu.be/jdJoOrCIdII)\n", + "\n", + "4. Whiteboard notes at " ] }, { "cell_type": "markdown", - "id": "4b447216", - "metadata": {}, + "id": "fb1da492", + "metadata": { + "editable": true + }, "source": [ "## Suggested readings and videos\n", "**Readings and Videos:**\n", @@ -67,8 +79,10 @@ }, { "cell_type": "markdown", - "id": "8fb799c1", - "metadata": {}, + "id": "5e18b164", + "metadata": { + "editable": true + }, "source": [ "## Lab sessions Tuesday and Wednesday\n", "**Material for the active learning sessions on Tuesday and Wednesday.**\n", @@ -84,8 +98,10 @@ }, { "cell_type": "markdown", - "id": "3a202eb3", - "metadata": {}, + "id": "ca1eb3e1", + "metadata": { + "editable": true + }, "source": [ "## Summary from last week, using gradient descent methods, limitations\n", "\n", @@ -104,8 +120,10 @@ }, { "cell_type": "markdown", - "id": "f0b36267", - "metadata": {}, + "id": "d1832283", + "metadata": { + "editable": true + }, "source": [ "## Simple implementation of GD for OLS, Ridge and Lasso\n", "\n", @@ -115,29 +133,13 @@ }, { "cell_type": "code", - "execution_count": 42, - "id": "2d9d73e5", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Parameters for OLS using gradient descent\n", - "[[4.04553909]\n", - " [2.85718534]\n", - " [5.07124072]]\n", - "Parameters for Ridge using gradient descent\n", - "[[3.8048267 ]\n", - " [3.33344121]\n", - " [4.85905287]]\n", - "Parameters for Lasso using gradient descent\n", - "[[3.87867385]\n", - " [3.192587 ]\n", - " [4.93045409]]\n" - ] - } - ], + "execution_count": 1, + "id": "0dee3b51", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "from random import random, seed\n", "import numpy as np\n", @@ -186,8 +188,10 @@ }, { "cell_type": "markdown", - "id": "fcf0f686", - "metadata": {}, + "id": "cda18663", + "metadata": { + "editable": true + }, "source": [ "## But none of these can compete with Newton's method\n", "\n", @@ -196,30 +200,13 @@ }, { "cell_type": "code", - "execution_count": 43, - "id": "1550b223", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Own inversion\n", - "[[4.]\n", - " [3.]\n", - " [5.]]\n", - "0 [-26.91927647] [-35.76071889]\n", - "1 [-6.07158768e-14] [-1.55935271e-13]\n", - "2 [-6.03961325e-16] [-9.79527859e-16]\n", - "3 [-1.54543045e-15] [-2.38042396e-15]\n", - "4 [1.27897692e-15] [1.94409177e-15]\n", - "beta from own Newton code\n", - "[[4.]\n", - " [3.]\n", - " [5.]]\n" - ] - } - ], + "execution_count": 2, + "id": "e1e51c75", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "# Using Newton's method\n", "from random import random, seed\n", @@ -258,8 +245,10 @@ }, { "cell_type": "markdown", - "id": "1777d437", - "metadata": {}, + "id": "8de3d7c1", + "metadata": { + "editable": true + }, "source": [ "## Gradient descent and Logistic regression\n", "\n", @@ -270,18 +259,13 @@ }, { "cell_type": "code", - "execution_count": 44, - "id": "94a3c22b", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Predictions: [1, 1, 1, 1]\n" - ] - } - ], + "execution_count": 3, + "id": "4f87ae26", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "import numpy as np\n", "class LogisticRegression:\n", @@ -318,8 +302,10 @@ }, { "cell_type": "markdown", - "id": "5d9bd47b", - "metadata": {}, + "id": "c2781943", + "metadata": { + "editable": true + }, "source": [ "## Overview video on Stochastic Gradient Descent\n", "\n", @@ -335,8 +321,10 @@ }, { "cell_type": "markdown", - "id": "0107149a", - "metadata": {}, + "id": "1e37491a", + "metadata": { + "editable": true + }, "source": [ "## Batches and mini-batches\n", "\n", @@ -354,8 +342,10 @@ }, { "cell_type": "markdown", - "id": "acb322f8", - "metadata": {}, + "id": "6feab258", + "metadata": { + "editable": true + }, "source": [ "## Stochastic Gradient Descent (SGD)\n", "\n", @@ -384,8 +374,10 @@ }, { "cell_type": "markdown", - "id": "9073ab44", - "metadata": {}, + "id": "204c15af", + "metadata": { + "editable": true + }, "source": [ "## Stochastic Gradient Descent\n", "\n", @@ -399,8 +391,10 @@ }, { "cell_type": "markdown", - "id": "0a457a90", - "metadata": {}, + "id": "c9453416", + "metadata": { + "editable": true + }, "source": [ "$$\n", "C(\\mathbf{\\beta}) = \\sum_{i=1}^n c_i(\\mathbf{x}_i,\n", @@ -410,8 +404,10 @@ }, { "cell_type": "markdown", - "id": "be758e1d", - "metadata": {}, + "id": "19b0403c", + "metadata": { + "editable": true + }, "source": [ "## Computation of gradients\n", "\n", @@ -421,8 +417,10 @@ }, { "cell_type": "markdown", - "id": "411db876", - "metadata": {}, + "id": "37025507", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\nabla_\\beta C(\\mathbf{\\beta}) = \\sum_i^n \\nabla_\\beta c_i(\\mathbf{x}_i,\n", @@ -432,8 +430,10 @@ }, { "cell_type": "markdown", - "id": "c23bb658", - "metadata": {}, + "id": "cc7aaec1", + "metadata": { + "editable": true + }, "source": [ "Stochasticity/randomness is introduced by only taking the\n", "gradient on a subset of the data called minibatches. If there are $n$\n", @@ -444,8 +444,10 @@ }, { "cell_type": "markdown", - "id": "adea87fe", - "metadata": {}, + "id": "3a3a0d11", + "metadata": { + "editable": true + }, "source": [ "## SGD example\n", "As an example, suppose we have $10$ data points $(\\mathbf{x}_1,\\cdots, \\mathbf{x}_{10})$ \n", @@ -464,8 +466,10 @@ }, { "cell_type": "markdown", - "id": "5e5dee91", - "metadata": {}, + "id": "0acfc986", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\nabla_{\\beta}\n", @@ -477,8 +481,10 @@ }, { "cell_type": "markdown", - "id": "97047a5f", - "metadata": {}, + "id": "8d3f995d", + "metadata": { + "editable": true + }, "source": [ "## The gradient step\n", "\n", @@ -487,8 +493,10 @@ }, { "cell_type": "markdown", - "id": "d9a59d5c", - "metadata": {}, + "id": "8c73ac82", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\beta_{j+1} = \\beta_j - \\gamma_j \\sum_{i \\in B_k}^n \\nabla_\\beta c_i(\\mathbf{x}_i,\n", @@ -498,8 +506,10 @@ }, { "cell_type": "markdown", - "id": "a9b20c1c", - "metadata": {}, + "id": "f88656c1", + "metadata": { + "editable": true + }, "source": [ "where $k$ is picked at random with equal\n", "probability from $[1,n/M]$. An iteration over the number of\n", @@ -510,17 +520,22 @@ }, { "cell_type": "markdown", - "id": "3867a529", - "metadata": {}, + "id": "e80a498f", + "metadata": { + "editable": true + }, "source": [ "## Simple example code" ] }, { "cell_type": "code", - "execution_count": 45, - "id": "e5f4f9a8", - "metadata": {}, + "execution_count": 4, + "id": "626ac884", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "import numpy as np \n", @@ -541,8 +556,10 @@ }, { "cell_type": "markdown", - "id": "786c5900", - "metadata": {}, + "id": "3c9a754d", + "metadata": { + "editable": true + }, "source": [ "Taking the gradient only on a subset of the data has two important\n", "benefits. First, it introduces randomness which decreases the chance\n", @@ -555,8 +572,10 @@ }, { "cell_type": "markdown", - "id": "5f510fcf", - "metadata": {}, + "id": "2790ab60", + "metadata": { + "editable": true + }, "source": [ "## When do we stop?\n", "\n", @@ -574,8 +593,10 @@ }, { "cell_type": "markdown", - "id": "1f0043c6", - "metadata": {}, + "id": "3ea3ee12", + "metadata": { + "editable": true + }, "source": [ "## Slightly different approach\n", "\n", @@ -592,8 +613,10 @@ }, { "cell_type": "markdown", - "id": "fbc5d941", - "metadata": {}, + "id": "3c39cc08", + "metadata": { + "editable": true + }, "source": [ "## Time decay rate\n", "\n", @@ -608,18 +631,13 @@ }, { "cell_type": "code", - "execution_count": 46, - "id": "f96c423d", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "gamma_j after 500 epochs: 9.97108e-05\n" - ] - } - ], + "execution_count": 5, + "id": "294edbef", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "import numpy as np \n", "\n", @@ -649,8 +667,10 @@ }, { "cell_type": "markdown", - "id": "cdf1efeb", - "metadata": {}, + "id": "f60f930b", + "metadata": { + "editable": true + }, "source": [ "## Code with a Number of Minibatches which varies\n", "\n", @@ -659,37 +679,13 @@ }, { "cell_type": "code", - "execution_count": 47, - "id": "e221b4f3", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Own inversion\n", - "[[3.8913351 ]\n", - " [2.83275949]]\n", - "Eigenvalues of Hessian Matrix:[0.33918672 3.94965845]\n", - "theta from own gd\n", - "[[3.8913351 ]\n", - " [2.83275949]]\n", - "theta from own sdg\n", - "[[3.9644494 ]\n", - " [2.80907715]]\n" - ] - }, - { - "data": { - "image/png": "iVBORw0KGgoAAAANSUhEUgAAAkMAAAHFCAYAAADxOP3DAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjguMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy81sbWrAAAACXBIWXMAAA9hAAAPYQGoP6dpAABTP0lEQVR4nO3dd3wUZf4H8M+kbWgJBEgPJCCQgnSlRoi0RUAwhwj8jmY5leLlsADqnXDKcXh2UTlOhLOAjYB9ASEBlCJVj14MEAIh1AQCCcnu8/tj2SVLdrMlW2Z2Pu/XK6+8dmZ29pmZncw3T/k+khBCgIiIiEilAnxdACIiIiJfYjBEREREqsZgiIiIiFSNwRARERGpGoMhIiIiUjUGQ0RERKRqDIaIiIhI1RgMERERkaoxGCIiIiJVYzBEJENLliyBJEnmn6CgIMTExGDUqFE4fPiwz8o1a9YsSJLks89XgmPHjkGSJLzyyiu+LgoROSjI1wUgItsWL16M5ORklJWV4eeff8acOXOQk5ODAwcOoFGjRr4uHhGRX2AwRCRjbdu2RZcuXQAAffr0gV6vxwsvvICVK1di4sSJPi4d+VJFRYW51pCIaofNZEQKYgqMzpw5Y15WVlaGJ598Eh06dEB4eDgiIiLQvXt3fPXVV9XeL0kSpkyZgo8++ggpKSmoW7cu2rdvj2+//bbatt999x06dOgAjUaDpKQkm80+ZWVlmDlzJpKSkhASEoK4uDhMnjwZly5dstguMTERQ4YMwbfffouOHTuiTp06SElJMX/2kiVLkJKSgnr16uHOO+/E9u3b7Z4PU3NiTk4OHn/8cTRp0gSNGzdGZmYmTp06Ve3YZ82aVW0fiYmJmDBhQrV9rlu3Do888ggaN26MsLAwjBs3DqWlpSgsLMTIkSPRsGFDxMTE4KmnnkJFRUW1/RoMBsyZMwfNmjVDaGgounTpgrVr11bb7vDhwxgzZgwiIyOh0WiQkpKCd955x2Kb3NxcSJKEjz76CE8++STi4uKg0Whw5MgRXL16FU899RSSkpIQGhqKiIgIdOnSBcuWLbN7/ojIiP9SEClIXl4eAKB169bmZeXl5bhw4QKeeuopxMXF4fr16/jxxx+RmZmJxYsXY9y4cRb7+O6777Bt2zb8/e9/R/369fHyyy/jvvvuw8GDB9GiRQsAwNq1azFs2DB0794dn376KfR6PV5++WWLIAwAhBAYPnw41q5di5kzZyI9PR2//fYbXnjhBWzevBmbN2+GRqMxb//rr79i5syZeO655xAeHo7Zs2cjMzMTM2fOxNq1a/GPf/wDkiRh+vTpGDJkCPLy8lCnTh275+Xhhx/G4MGDsXTpUuTn5+Ppp5/GH//4R6xbt87lc/3www8jMzMTn376KXbt2oVnn30WlZWVOHjwIDIzM/GnP/0JP/74I+bNm4fY2FhMmzbN4v3z589H8+bN8cYbb8BgMODll1/GoEGDsH79enTv3h0AsG/fPvTo0QPNmjXDq6++iujoaKxatQpPPPEEzp07hxdeeMFinzNnzkT37t2xYMECBAQEIDIyEtOmTcNHH32El156CR07dkRpaSn27NmD8+fPu3zsRKojiEh2Fi9eLACILVu2iIqKCnH58mWh0+lEdHS0uOuuu0RFRYXN91ZWVoqKigrx0EMPiY4dO1qsAyCioqJESUmJeVlhYaEICAgQc+fONS/r2rWriI2NFdeuXTMvKykpEREREaLqnw2dTicAiJdfftnicz777DMBQCxcuNC8rHnz5qJOnTri5MmT5mW7d+8WAERMTIwoLS01L1+5cqUAIL7++muHztOkSZMslr/88ssCgDh9+rTFsb/wwgvV9tG8eXMxfvz4avucOnWqxXbDhw8XAMRrr71msbxDhw6iU6dO5td5eXkCgM3z169fP/OygQMHivj4eFFcXGyxzylTpojQ0FBx4cIFIYQQOTk5AoC46667qpW/bdu2Yvjw4dWWE5Hj2ExGJGPdunVDcHAwGjRoAK1Wi0aNGuGrr76q1k/kiy++QM+ePVG/fn0EBQUhODgYixYtwv79+6vtMyMjAw0aNDC/joqKQmRkJI4fPw4AKC0txbZt25CZmYnQ0FDzdg0aNMDQoUMt9mWqeanazAQA999/P+rVq1etWahDhw6Ii4szv05JSQFg7A9Vt27dastNZbLn3nvvtXjdrl07p95vzZAhQyxem8o0ePDgasutfY6t87dhwwbo9XqUlZVh7dq1uO+++1C3bl1UVlaaf+655x6UlZVhy5YtFvv8wx/+UO1z7rzzTvzwww+YMWMGcnNzce3aNZePmUitGAwRydiHH36Ibdu2Yd26dXj00Uexf/9+jB492mKb7OxsjBw5EnFxcfj444+xefNmbNu2DQ8++CDKysqq7bNx48bVlmk0GvND9OLFizAYDIiOjq623a3Lzp8/j6CgIDRt2tRiuSRJiI6OrtZUExERYfE6JCSkxuXWym/NrcdkapqrTWDgTFmtldPW+bt+/TquXLmC8+fPo7KyEm+//TaCg4Mtfu655x4AwLlz5yzeHxMTU22fb731FqZPn46VK1ciIyMDERERGD58uE9TMBApDfsMEclYSkqKudN0RkYG9Ho93n//fXz55ZcYMWIEAODjjz9GUlISPvvsM4scQOXl5S59ZqNGjSBJEgoLC6utu3VZ48aNUVlZibNnz1oEREIIFBYW4o477nCpDJ6g0WisnhNP9a2xdf5CQkJQv359BAcHIzAwEGPHjsXkyZOt7iMpKcnitbUcT/Xq1cPs2bMxe/ZsnDlzxlxLNHToUBw4cMA9B0Pk51gzRKQgL7/8Mho1aoS//e1vMBgMAIwPyJCQEIsHZWFhodXRZI4wjebKzs62qPG4fPkyvvnmG4tt+/btC8AYkFW1fPlylJaWmtfLQWJiIn777TeLZevWrcOVK1c88nm2zl96ejoCAwNRt25dZGRkYNeuXWjXrh26dOlS7cdaLV5NoqKiMGHCBIwePRoHDx7E1atX3X1YRH6JNUNECtKoUSPMnDkTzzzzDJYuXYo//vGPGDJkCLKzszFp0iSMGDEC+fn5ePHFFxETE+NyU8mLL74IrVaL/v3748knn4Rer8e8efNQr149XLhwwbxd//79MXDgQEyfPh0lJSXo2bOneTRZx44dMXbsWHcdeq2NHTsWf/3rX/G3v/0NvXv3xr59+zB//nyEh4d75PMCAwPRv39/TJs2DQaDAfPmzUNJSQlmz55t3ubNN99Er169kJ6ejscffxyJiYm4fPkyjhw5gm+++cah0XBdu3bFkCFD0K5dOzRq1Aj79+/HRx99hO7du1v0wyIi2xgMESnM1KlTMX/+fPz973/H6NGjMXHiRBQVFWHBggX44IMP0KJFC8yYMQMnT560ePA6o3///li5ciWef/55PPDAA4iOjsakSZNw7do1i31KkoSVK1di1qxZWLx4MebMmYMmTZpg7Nix+Mc//mExrN7Xnn76aZSUlGDJkiV45ZVXcOedd+Lzzz/HsGHDPPJ5U6ZMQVlZGZ544gkUFRUhLS0N3333HXr27GneJjU1FTt37sSLL76I559/HkVFRWjYsCFatWpl7jdkz913342vv/4ar7/+Oq5evYq4uDiMGzcOzz33nEeOi8gfSUII4etCEBEREfkK+wwRERGRqjEYIiIiIlVjMERERESqxmCIiIiIVI3BEBEREakagyEiIiJSNVXkGTIYDDh16hQaNGhgNZ09ERERyY8QApcvX0ZsbCwCAjxXf6OKYOjUqVNISEjwdTGIiIjIBfn5+YiPj/fY/lURDDVo0ACA8WSGhYX5uDRERETkiJKSEiQkJJif456iimDI1DQWFhbGYIiIiEhhPN3FhR2oiYiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNV8Hgxt2LABQ4cORWxsLCRJwsqVK21u++ijj0KSJLzxxhteKx8RERH5N58HQ6WlpWjfvj3mz59f43YrV67E1q1bERsb66WSERERkRoE+boAgwYNwqBBg2rcpqCgAFOmTMGqVaswePBgL5WMiIiI1MDnNUP2GAwGjB07Fk8//TTS0tJ8XRwiIiLyMz6vGbJn3rx5CAoKwhNPPOHwe8rLy1FeXm5+XVJS4omiERERkR+Qdc3Qjh078Oabb2LJkiWQJMnh982dOxfh4eHmn4SEBA+WkoiIiJRM1sHQxo0bUVRUhGbNmiEoKAhBQUE4fvw4nnzySSQmJtp838yZM1FcXGz+yc/P916hiYiISFFk3Uw2duxY9OvXz2LZwIEDMXbsWEycONHm+zQaDTQajaeLR0RERH7A58HQlStXcOTIEfPrvLw87N69GxEREWjWrBkaN25ssX1wcDCio6PRpk0bbxeViIiI/JDPg6Ht27cjIyPD/HratGkAgPHjx2PJkiU+KhURERGphc+DoT59+kAI4fD2x44d81xhiIiISHVk3YGaiIiIyNMYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1nwdDGzZswNChQxEbGwtJkrBy5UrzuoqKCkyfPh2333476tWrh9jYWIwbNw6nTp3yXYGJiIjIr/g8GCotLUX79u0xf/78auuuXr2KnTt34q9//St27tyJ7OxsHDp0CPfee68PSkpERET+SBJCCF8XwkSSJKxYsQLDhw+3uc22bdtw55134vjx42jWrJlD+y0pKUF4eDiKi4sRFhbmptISERGRJ3nr+R3ksT17SHFxMSRJQsOGDW1uU15ejvLycvPrkpISL5SMiIiIlMjnzWTOKCsrw4wZMzBmzJgaI8S5c+ciPDzc/JOQkODFUhIREZGSKCYYqqiowKhRo2AwGPDuu+/WuO3MmTNRXFxs/snPz/dSKYmIiEhpFNFMVlFRgZEjRyIvLw/r1q2z226o0Wig0Wi8VDoiIiJSMtkHQ6ZA6PDhw8jJyUHjxo19XSQiIiLyIz4Phq5cuYIjR46YX+fl5WH37t2IiIhAbGwsRowYgZ07d+Lbb7+FXq9HYWEhACAiIgIhISG+KjYRERH5CZ8Prc/NzUVGRka15ePHj8esWbOQlJRk9X05OTno06ePQ5/BofVERETKo5qh9X369EFN8ZiM0iARERGRH1LMaDIiIiIiT2AwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkakG+LgAREZFX6fXAxo3A6dNATAyQng4EBvq6VORDDIaIiEg9srOBP/8ZOHny5rL4eODNN4HMTN+Vi3yKzWRERKQO2dnAiBGWgRAAFBQYl2dn+6Zc5HMMhoiIyP/p9cYaISGqrzMty8oybkeqw2CIiIj838aN1WuEqhICyM83bkeqw2CIiIj83+nT7t2O/AqDISIi8n8xMe7djvwKgyEiIvJ/6enGUWOSZH29JAEJCcbtSHV8Hgxt2LABQ4cORWxsLCRJwsqVKy3WCyEwa9YsxMbGok6dOujTpw/27t3rm8ISEZEyBQYah88D1QMi0+s33mC+IZXyeTBUWlqK9u3bY/78+VbXv/zyy3jttdcwf/58bNu2DdHR0ejfvz8uX77s5ZISEZGiZWYCX34JxMVZLo+PNy5nniHVkoSwNs7QNyRJwooVKzB8+HAAxlqh2NhYZGVlYfr06QCA8vJyREVFYd68eXj00Ucd2m9JSQnCw8NRXFyMsLAwTxWfiIiUwN0ZqJnR2mO89fyWdQbqvLw8FBYWYsCAAeZlGo0GvXv3xqZNm2wGQ+Xl5SgvLze/Likp8XhZiYhIIQIDgT593LMvZrT2Cz5vJqtJYWEhACAqKspieVRUlHmdNXPnzkV4eLj5JyEhwaPlJCIiFfKHjNZ6PZCbCyxbZvztiaST3viMWpJ1MGQi3dLZTQhRbVlVM2fORHFxsfknPz/f00UkIiI18YeM1tnZQGIikJEBjBlj/J2Y6N4gzhuf4QayDoaio6MBoFotUFFRUbXaoqo0Gg3CwsIsfoiIiNxG6RmtvVGrpaCaM1kHQ0lJSYiOjsaaNWvMy65fv47169ejR48ePiwZERGpmpIzWnujVkthNWc+D4auXLmC3bt3Y/fu3QCMnaZ3796NEydOQJIkZGVl4R//+AdWrFiBPXv2YMKECahbty7GjBnj24ITEZF6KTmjtTdqtRRWc+bz0WTbt29HRkaG+fW0adMAAOPHj8eSJUvwzDPP4Nq1a5g0aRIuXryIrl27YvXq1WjQoIGvikxERGpnymhdUGC99kOSjOvlmNHaG7VaCqs583kw1KdPH9SU6kiSJMyaNQuzZs3yXqGIiMh3lJC3x5TResQIY+BT9Tkm94zW3qjVUljNmc+byYiIiMwUMvoIgHIzWntjnjaFzQXHYIiIiORBQaOPzDIzgWPHgJwcYOlS4++8PPkGQoB35mlT2FxwspqOw1M4HQcRkczp9cYaIFudbk19cPLy7D9AldDMJgfWsmcnJBiDFHcFc7X8DG89vxkMERGRkS+DiNxcY5OYPTk5NU+lwekxjBy9lt645i58xu+5J7Dq38fwzbpK/FDUV91zkxERkZf4Oohwx+gjUzPbrf/jm5rZ5NyPx52cuZbunKfNFgc+4+q5q1j/7l7osq9Ct68ZDlUkAWgGwDtzi7JmiIhI7WwFEaa+Hd4IImpbM+TOZjYlk8O1dIAwCBz4/nfo3s+H7qf6WH++LcoRal4fhAr0CN+LPp0L8Pd1Q9hM5g4MhoiIbJBLEGEqh728PbbK4a5mNiWTy7W0oeRkCda+vQ+6r69Dd7gFTujjLdY3CzwJbavfob03BHdPTkF4s3CvPb/ZTEZEpGbOZAr2ZBBR27w9ck/y542+OXK5ljcYKg349YtD0C0phG5rQ2wqTkMlupnXa1CG3o33QNvrCrQPJyD5nhaQAuJr2KPnMBgiIlIzOQURprw91vq7WBt9VDXAOHPGsc/wRZI/b/XHksG1PHfwPNbMPwjd9wasOtYaZwzJAJLN61sH50GbegLazLroPSkNdZt08VhZnMFgiIhIzeSWKTgzExg2zH4tirUAIzDQ/sSf5865v8w18WanbleuZS1rrPTX9dj24X788NE56HY0wbbSVAjcnEi9Hq6gb/ReaPuUY+CjiWjRJwlAksP79xb2GSIiUrPa9tXxBVsBhiMSErx3LN7uw+PstXSxxur07jNYNf8wdKsDsPpkCi6KRhbr24UehLbdaWgfCEePh1OhCdO4fEjsM0RERJ6ntDm29HrjA9zV/+O92GfG6314nLmWTtRYXb9yHZve3wfdp5eg+zUGv5a1ARBlfktD6RIGxO+Dtp8eAybdhrgubQC0qf3xeBGDISIitXO2r44v2QswHOGtTtS+6MPjyLWsKaAUApAkVD4+FYs+b4Qf1tfF2sJUXEEH8yYSDOhSbz+0nc5C+3+Ncef4FASF9qi+LwVhMERERI731fE1dwQO3ur/5Kv+WPaupQM1VkFFp7DsMwnr0RUAECmdxcCkg9BqJfSf0gZNU9LcW2YfYzBERERG3shGXFu1CRxMfWa8NVO6aeZ2e314PFGemq6lgwFlRp0tGNAL0I6PQocH2iAgqJf7yiczDIaIiHyFE4o6z16AYSKH/k8y6491+dRlrJu/D0c/KcI0B7Z/4ftu8g+O3STA1wUgIlKl7GzjyJ+MDGDMGOPvxETjcrLNFGAANwMKE0ky/jz9NBAXZ7kuPt43U1FkZgKffw40aeL18giDwK+fH8S8QbnIaLQLEXGhGD63K54+MQX5iIcBkvU3SpJx1J23atBkgEPriYi8TSHzR8matWHhCQmWnYRdrXVzZ42dtXI2aQK8+y5w//2u7bMGF45exJq39kP3vR6631uj0BBlsf624GPQJh/HhJSt6PTFDGM4ZK3GSibfQW89vxkMERF5k8znj1IUTzQzujNbtBeCXv11PbZ/tB+6j89Bt70xfrmSCgNunoO6KMXdkXuh7X0NAx9NxG19m1uWr6aA0hduuaYl7dsjPCKCwZA7MBgiItnghKLy5c7gxYNBb+FvRVj19iFj0sP8ZFwQERbr22oOQ3t7AbQjw9Dr0bSakx7Kqd+aleCsJDYW4adOMekiEZFfkcH8UWSFA7l3kJVlHLLuSLDgxoSLFVcrsOk/e28kPYzG7mvJACLN68NRjP5x+6DtV4mBk29D/B2tALSyX0bAPSMI3RFQ2QpET52qXdkcxGCIiMib5DYXGBm5O1t0LYPe4z+fxKr3foduXQh+PJ2Ky1WSHgJAl7r7oO1UBO2YCHSdmIqg0O6OfZ67uaNZsbZZxd2AwRARkTf5MvcM2ebuGjsng96yS2XY8N5e6L68DN2eBOy/3hJAvHmzJtI5DGx+EFotMGBKa0SmpQJIdewzPMVdk9C6I6t4LTEYIiLyJpnlnqEb3F1jZyfoFZKEyibRWPCWAT+M3Ibcs2m4hs7m9QHQo3uDvdDeeQHacZHoNCYZAUE9Hftsb3Bns6IMmoQZDBEReZuS5gJTC3fX2AUGAq+/bnX4vIDxIx44Ox8rVtxtXh4XcBra245AOyQIfaekoFFSOxcPxgtyc93XrCiDJmEGQ0REvqCUucDUwt01dtnZEH/5i9W0hvlIQBbewHcYjL6NdkLbowTah+KQNuw2SAG+Dwzsys4GHnnEsW0dqfVxNKu4BzEYIiLyFSXMBaYmbqixu5h3CfufeA/dv30WArAIhgw3fq9OeAgPTojHh5MqUD+6kxsPwAts9ROyxZFan5oCUS9hniEiUh855VbxJ/5yXp04DkOlATs+OQDdh0XQbYvAL5eT8TtaIg4nrc93peSkmvZyJ1XlynFayzMUF4fwggImXXQHBkNEZObODMN0kzvPq8yDqjN7zmL1/IPQ6SSsPtEG58TNecd6Ixe58NOkmo4mDAWMwZArGbZ9lIGazWREpB7uGgpMltx5Xp0JqrwUNFVcrcCWD/ZBt+widLuisPNaCoCm5vVhKEa/2P3Q9r2O+1ruBWY5sFMZjKBymqNlbtwYWLjQtXvp1qbjkhLn9+EC1gwRkTpwTjDPcOd5dWY6DA/X8OVvPQXdO0egWxuCH0+loAThFus71dkPbccz0I5uhG4PpiK4brBxhT9Pt+Losf34I9C3r1s+khO1uhGDISLy64eUL7nrvDoTVH31ldsnQC27VIaNC0xJD+Oxr/w2i/WNpfMY2OwAtFqBAVPaIKptU+s7Mh2HvSH6Sgy6fXBs3np+s5mMiNSBc4J5hrvOq6PTYeTmui3Z35G1x6FbcAw/rK+LHCtJD7s12AvtHTeSHo5ug8AQB5Ie+nNSTT8+NgZDRKQOnBPMM9x1Xh0NqubPdznZ35XCK8h9dx90K69Btz8RRyubA2h+s4gBhdC2PIxBQ4LQb2qVpIe2+ibZWu7PSTX99NjYTEZE6uDPzRe+5K7z6sxIJUcsXQrxwCjs/eoIdIsKoNsUho0X03AdGvMmwbiOXg33Qtu9GNoHY3F7ZitIAbekSbTVN2n0aGDZspr7LMl8VFyteOnY2GfIjRgMERGAmx10AetV/K6OJvPnh54j3HFe7QVVTvpX/Jt489T9KDBY1kglBuVjUJs8aIdpkDE5FQ1iG9jeibMJBmv7PaJqGAy5EYMhIjKz9p9+QoLrVfzMW2TkjvNqK6hyggESTiIeSciDAYEIxTVkNN0DbfpVaP/UDK36J1av/bHGmQSDVbGG0a0YDLkRgyEisuCumhxnhoKrgTvOq7WgykGGG5NfZAXNR1C7VGhHNED6o6moE1HH6X3VutmOoxLdgsHQDZWVlZg1axY++eQTFBYWIiYmBhMmTMDzzz+PgACryc6rYTBERG7HvEWeYwqqli83dph20JW6kbj63EuIfNbBSURrsmwZMGaM6+9futTYr4hqhUPrb5g3bx4WLFiA//73v0hLS8P27dsxceJEhIeH489//rOvi0dEniL3fjiODgW3MqqJ7AgMxMl6bfDr4VYY7MDm+mdmInDQANRPT0d9d31HajuqkKMSFUX2wdDmzZsxbNgwDB5svCUSExOxbNkybN++3cclIyKPUUI/HOYtcqvyknL89O+90H1eAt3/4rCnvBUCMBnH8C/EoQABsD1SLfAfL7o/UE5PN37nnO3QbaoRTE93b3nIoxxrZ/KhXr16Ye3atTh06BAA4Ndff8VPP/2Ee+65x8clIyKPMPXDubXWxTTPVXa2b8p1K+YtqrWj647jnZHrMTTqF0SEV6LfM53wyvY+2FPeChIMuLP+PmxKewQSACHd0unZ00n+TAkGq36WPQpPPKhmsu8zJITAs88+i3nz5iEwMBB6vR5z5szBzJkzbb6nvLwc5eXl5tclJSVISEhgnyEiuVNSPxzmLXJaaVGpMelh9lXoDjTHkYpEi/XRAWegbXEI2nsC0W9KMhq3ijCucPcIQGfY+uxRo6rnGfJWmVSEHahv+PTTT/H000/jX//6F9LS0rB7925kZWXhtddew/jx462+Z9asWZg9e3a15QyGiGROafOHeSpvkZ8QBoH93x6FbtFJ6H5qgA0X0lCOUPP6IFSgV8M90HYrhnZiDNqNaG172Lsv+5A5m4Ga3IbB0A0JCQmYMWMGJk+ebF720ksv4eOPP8aBAwesvoc1Q0QK5egIHjmN1PFlrYW3OfDwLz5RjLXz90P3zXXoDrdEvj7OYn3zwJMY1OZ3Y9LDSSkIi+ffZLKNo8luuHr1arUh9IGBgTAYDDbfo9FooNFobK4nIplSYj+czEzjpKD+XkNgo1O74bXXsft6GnT/PQPd1kbYVJIGPbqZN9GgDH0a74E2vRTaRxLQRpsEKSDeBwdAZJvsg6GhQ4dizpw5aNasGdLS0rBr1y689tprePDBB31dNCJyN3sjeOQ6UicwUB7Ndp5iI7mk4eRJYORIvIQvsQI3a8HahPwObWo+tH+oh7seS0XdJl28XWIip8i+mezy5cv461//ihUrVqCoqAixsbEYPXo0/va3vyEkJMShfTDpIpGCsB+OvOj1EM0TgYKTsNabxwAJBYjFn6M+x4C7KzHwsSQk3ZXg7VL6D/ZDssA+Q27EYIhIYdTUD0emCrafxqp3juDEt79h1rkp9t8gl07tSqaE/Fpexj5DRKReaumHIyPXr1zHzwv3QvdZMX74LRb/K2sNIAaj4OAcYUwuWTu25rkz5ddijahHMRgiInnyRT8clTVR5G3Ih+69POhyNVhbmIZSdDSvk2DAHfX2YUDLM8BvDuxMTp3alUavN9YIWWuoEcLYRJyVZfwHwfR9VNl31dOcCoby8/ORkMC2YCLyQypoorh67irWv7vXmPRwXzMcqkgCcPNvelRAEQYmHoL2ngD0n9IGTdq0BfQpQOKryuvUriTOznOngu+qtzkVDCUnJ2PatGmYMWMG6tWr56kyERF5l582UQiDwIHvf4fu/XzofqqP9efbohx3mNcHoQI9wvdC2/UStBOi0f7+1ggIirTciWlaihEjjIGPtU7tnH6idpyZ585Pv6u+5lQH6k2bNuEvf/kL8vPzMWfOHEycONGTZXMbdqAmIpuUNAWIA0pOlmDt2/ug+/o6dIdb4ITeMqdPQmABBrU6Cu29Ibh7cgrCm4U7tmN2avccRzOv//gjMGGC33xXHSHr0WQffvghnnvuOTRp0gSvv/46+sh8BAGDISKySWlTgNxCGAR+/eIQfvjgNHRbG2JTcRoqEWxer0EZejfeA22vK9A+nIDke1rYnvLCHjn0U3FnGeRwPKZyODLP3eLFQL9+9vcn0++qK2Q9mmzcuHG4//77MXfuXAwePBgDBgzAv/71L9x2223uLh8ROUouf9iVxpkmCpk4f/gC1rx9ALrvDViV1wqFhjYA2pjXtwrOw6DUE9Bm1kXvSWnuS3ro6+SS7uwrI6d+N442RRYVObY/GX1XFUO4qLS0VGzcuFFkZWWJgIAAodFoxLRp00RJSYmru/SY4uJiAUAUFxf7uihEnrF8uRDx8UIY/4waf+LjjcupZjk5lufN1k9Ojs+KWFleKTb/53/ihd45omu9/wkJeoui1cNlMTRqi3jngVxxZO0xn5XTo5YvF0KSql8XSTL+OPNdd+e+3MnafZyQcLM8Cviuupu3nt9ONZMtWLAA27Ztw7Zt27B//34EBgaiXbt26NatGzp06IBPPvkEhw4dwooVK9Cli3zSr7OZjPyarQ6VzNjsGEebKLzcD+P07jNYNf8wdKsDsPpkCi6KRhbrbw89BO3tp6B9IBw9H0mFJkzjv7WD7uzXJfc+YjVdQ5l+Vz3Ja89vZyKn+Ph4MWLECPHKK6+In376SZSVlVXbZs6cOSItLc1NsZp7sGaI/FZlZfX/JG/9Tzchwbgd2WaqKbi1tsCLNQXll8tFzuu7xPSuOaJ96IFql7KhdFHcH79JLJqwQZzcdsr6Mfhr7aA7a0SUXrsig++qN3nr+e10niF7HnroIfz1r391MTQjIqc4m5/EWf5a03CrzExjDZq1PiTuHi1V5ZwWngvCVz83wQ/r62JtYSquoIN5MwkGdKm3H9pOZ6H9v8a4c3wKgkK7W9+nvw+3dme/LgX2EbPgze+qirg9A3VkZCTWrVvn7t0SkTWe/MMupw6m3uCFKUDK/7sM4okshJYYO8JGA7gH8ViFN3EFXdFUOgtt0kFotRL6T2mDpilp9nfqSvZipXE0u7Uj27lzX77C6WrcjhO1EimZp4aFsx+SWwiDwKFVedD9Jx8lP27Fc5dnABAIqLKNARIkCOT9+U0kvjIFAUEBtnZnncJTAzjEnX1lVNjvRsm89fx28q4jIllJTzf+4ZZs5I2RJGNiPGemSrBX0wAYaxr0eqeLqwaXT13GV89uxeNpG9BCcxLJ97TAtBW9MOHy27g1EAKAAAhIkoQW2a8gQHLhf1OlN/s4wjT0HKj+XXc2C7Y790V+g8EQkZJ54g+7M/2Q1ESvN9bCLFtm/H0jGBQGgV8/P4h5g3KR0WgXIuJCMXxuVyzYdxeOVSYgBOXIavA+EnDS9h/c2pxTf2j2cYSpr0xcnOXy+HjnayrduS/yC5y1nkjp3N2hUg01Dc6y0n/qav2m+KD+E/hH0cM4fUvSw9uCj0GbfBzazLroMykV9daGAWMc+BxXzqmpdlANE6m6s68M+91QFQyGiPyBO/+wq6WmwVHZ2RA3+k9VrXsLvXIOk678DeuQilUYiLsj90Lb+xoGPpqI2/omAki8ubEnz6naJlJ1ZxZsX2fUJtlgB2oissQOpgCAwt+KsOat/bhnyf1opD9rtYlLACgPj4KU9zs0jera3pk3zqlSJ1JVS/oGcgk7UBORb6i0g2nF1QpsePtXPNsjF53q7kdM+0gsWiTQ2EYgBAASgNDiM9D8+kvNO/fGOc3MBI4dM44aW7rU+DsvT96BUHa2MUjMyADGjDH+Tkw0LifyIjaTEVF1KknsdmJzAXTvHIVuXQh+PJ2Ky2hvsb5nyDbgugM7cqSvjzfOqZKaffw9USQpCpvJiMg2P2vCKLtUhg3v7YXuy8vQ7UnA/ustLdY3kc5hYPOD0GqBAVNaI/LsXvfn8PGzc+oSuc8PRrLhrec3gyEi8lvCIHB4zTHoFp6AbmNd5J5NwzXc7NsTAD26N9gL7Z0XoB0XiU5jki2THrL/lGeoIVEkuYW3nt9sJiMiv3Kl8Apy3tmHH1aUQXcwEXmVSQCSzOvjAk5De9sRaIcEoe+UFDRKamd7Z2obqeUtTN9AMsNgiIgUTRgE9qw4DN0Hp6DbHIaNF9uiAnea1wfjOtIb7cGgHiXQPhSHtGG3QQpwYgi7SvpPeRXTN5DMsJmMvIv9JfyDj6/jxbxL+PHt/dB9Wwnd0dtwymD50EwKOoFByXnQDq+DjMmpqB9dv/Yfyu+u+7D5kRzEZjLyP2qbBd1f+eA6GioN2PHJAeg+LIJuWwS2XE6DAd3N6+vgKjKa7oX2rqvQPtoct/VtDimgmXsLoaSRWnLH5keSGdYMkXdwFnT/4MXreGbPWayefxA6nYTVJ9rgnGhisT5VcwTatiehHdEA6Y+lIbRhqFs+l7xIqYkiyWs4msyNGAz5GIfR+gcPX8fKskps+WAfdEsvQLcrEjuuplqsD0Mx+sXuh7bvdQx8vCWadY+zsScfY3Oac3i+qAZsJiP/4cws6GyGkC8PXMf8raew6t2j0K0Nwo8FqSiG5ciuTnX2Q9vxDLSjG6Hbg6kIrtutFgfgBWwKdh6bH0kGGAz5Ozn818VhtM6Tw3W7lRuuY3lJOTYu2Avd5yXQ7YnD3vJWAGLN6xtL5zGw2QFotQIDprRBVNsUACm1K7e32Muo/PnnQJMm8rqmRASAwZB/k8t/qYcPO7Ydh9EayeW63crF4dBH1h6HbsEx6DbUQU5RGq6ik3ldAPToWn8ftHech3ZsU3T+v2QEhvR0rlxyCBz1euM1s9brwLRs1CjjdiZyuKZEBIB9hvyXXDos2yrHrWVinyEjuVw3axwcDl26dQ9y3jsA3cpr0O1PxNHK5habxQQUQtvyMLSDA9FvSgoiWja6uX9ngxq5BI6OZlSuSg7XlEjm2IHajVQXDMmlw7K9clS1fDkfCHK5bjUxBWuARUAkIAEQWB4yCpuvd0IhYlGAOGxEOgKhR6+Ge6HtXgztg7G4PbMVpACp+n6dDWrkFDguW2acdd1ZcrimRDLmtee3UIHi4mIBQBQXF/u6KN6RkyOE8RFR809OjjzKMXu2Z8uhFHK5bvYsXy70MbEWZapAoNWyXm0QKa7+52O7+xOSVP39kmT8Wb68+nsqK4WIj7d9jiRJiIQE43be4Oi1k+s1JZIpbz2/A+wFS6RAcumw7Oj+W7XybDmUQi7XzQpDpQE7Pt6POf1zkT6xJUJP/44+yMFryIIBxr4/1tS5XIQ6fxprrMWxxpG+NllZln1tAOdGtnlDerqxhkeS7G9rDQcPEPkUO1D7I7nM+yOXciiFzM7X2f3nsPrtg9DpBFYda4OzwnJk19ngWEzEJ5AqALshQFYWMGxY9aYgV4fryy1wrCmjsiN4DxD5FIMhf2T6L9XevD/p6eooh1L4+HxVllVi6+IbSQ93RmLH1WQI3BzZVR+X0S9mL7QZ1zHw8RZIrDwFZJy1v+Oa8g+5GtTILHAEYHtC18DA6jVbJrwHiGSBwZA/ksu8P3Iph1L44Hyd3HYaq945At2PQVhjJelhhzoHoG1fCO2ohuj+UCpC6ldJeviXV537MGuBj6tBjVwD7cxMYw1Y1VFxZ88CDzxgXM97gEiePNojSSZU14HaZPny6p1MExKsd0hVQzmUwoPnq6y4TKx9Zad4qkuOaKs5VK0fb4R0Xoxq9rNY8vBGcWpXYc1ldEcnYVNHaGsdqO11hDZ1vL71vTV1vPYV3gNELvHW81sRQ+sLCgowffp0/PDDD7h27Rpat26NRYsWoXPnzg69X3VD66uSQ0I6OZVDKdx4vn7PPQHdgjzockOx7kwaSlHfvE6CAV3r74W2y3lo/9gEXcamIDDEzuc4kzIBsD983MZwfYeGyCthok/TtSwoMNYSNW0KxMXxHiByAPMM3XDx4kV07NgRGRkZePzxxxEZGYmjR48iMTERLVu2dGgf1U4mH8zycOt16NED2LRJPtdFod+Tq+euIvedvdBlX4VufzMcrkiyWB8VUARt0iEMGhyAflOS0bhVhHMf4GyCQUmyn/OnNkGNnK+TXJJCEikU8wzdMH36dNGrV69a7cOims1adXV8PKurvc3adQgMlM91UdD3xKA3iL1fHRav3psj+kdsFxpcsyh2EK6L3uG7xNyBOWLXpweEvkJfuw9cutTxpjFnmoIqK41NaUuXGn97K0eQp7iSP4mILLCZ7IbU1FQMHDgQJ0+exPr16xEXF4dJkybhkUcesfme8vJylJeXm1+XlJQgISEBxR99hLBx46p3uGRafO9yZIoOwHfXRU6ZjW0oPlGMtfP3Q/fNdegOt0S+Ps5ifbPAkxjU+ndoh2lw9+QUhMW78T8qR2uGXn8dmDpVPrU03qSEbOJECsBmshtCQ0MBANOmTcP999+PX375BVlZWfj3v/+NcePGWX3PrFmzMHv27GrLi2NjEXbqlPUP4h8n73B3fxN7n+Vs84lMH2KGSgN2f3YQuv+egW5rI2wqSYO+ymBQDcrQp/EeaNNLoX0kAW20SdWnvHAXB+coU/W95GjAmJNTPd0AEZmxmeyG4OBg0b17d4tlU6dOFd26dbP5nrKyMlFcXGz+yc/PN1azMS2+77k6bYGz18XVZi4ZTYlx9sA5sXTKz2Jci40iKuBMtSK0CTkq/twhV/zw4jZRerbU4+WxoKSRXL7gaFPi0qW+LimRrHmrmUz2eYZiYmKQmppqsSwlJQXLly+3+R6NRgONRuPaBzItvmeYamlquG41cua62GrmKigwLq+pmcuHmY0ryyqx7cP90H1yHrodTbCtNBUCPczr6+My+kbvgzajHAMfS0LSXS0AtKh5p57qXGwrwWB8vLxGcvmKHJNCEpFNsg+GevbsiYMHD1osO3ToEJo3b+6ZD1TqHyeljahxlqPXxd5cV5Jke2oIZz7HTd+TUzsLsWr+Yeh+DMSakym4KG63WN8u9CC07U5j0OiG6PFwKkLqd3V8554eyWQtwaCcvne+JNekkERknUfrndzgl19+EUFBQWLOnDni8OHD4pNPPhF169YVH39sZybsKszVbLGxriV3kzs5j3yyNaLG0R9nr0ttm7lqkwTQAeWXy8W6V3eKZ+7MEe1CD1TbfUPpohiZ8LP4YOIGUbDjtEufIYTgSCY5YFMiUa15q5lM9sGQEEJ88803om3btkKj0Yjk5GSxcOFCp95vPpkffeR/f5zk/NAzBRa1CYScPQZ39NVw80Ps9/UnxLuj1ot7o7eI+iix3CX04s56/xN/uytHbPr3b6LiWoVT+7bK3nlXcuAvF46mAWDmaaJaYTDkRnbzDCn1j5PcH3rOdpa+Nc+QK9fFXR2ga/E9KT1bKr6f/Yt4on2uaB38e7WPjpSKxLgWG8XSKT+LswfOOXd8jpBRJ3C/5GxNrL/lTyLyInag9hR/6uewcWPN/XCEsD1buDc408l49mxgxgzHMlDX1D/KXX01nPieCIPAQV0edP/Jh25jPaw/n4Yy3GFeH4hK9AzfA23XS9BOiEb7+1sjIKiX4+fGWT7sBO73XOmcHxjI4fNEMqe+YAjwnz9Ocn/oOdPJ+P33geees39d7HUKNs38/oc/WH+/EI7PEl7D96TkZAnWvbMfuq/KoTvUAsf1liO7EgILMKjVUWjvDcHdk1MQ3qyD/c9zF45k8ozads4nItlSZzDkL+T+0DPV0jgyisyRGqzaDJmvJWEQ+PWLQ9AtPg3dlob4uTgNlbg5sisE5egdsQfaXpehfSgeKUNaQgqIq2GPHuRI7ViTJsb1ubnKrRn1NrnXxBKRy2Sfgdod/HbWeiVkAs7Otl1Lc6ulS4HRo62vczQz9JEjQMuWzmeQttL0dv73Yqx5+wB03xuwKq8VCg1RFrtqFZwHbcoJaDProvfjqagXWc+x4/QGWzPBW8OJQx2zbBkwZoz97Wr6HhORU7z1/GbNkJKZmoRGjDA+5Ks+9EzzaDnaJOQpmZnG/kAvvGB/25pqsBz9r/zdd53/791K09sZKQqTxHxkY4R5WT1cwd1Re6HtU4aBf0pEy7uTAFjOCC8bw4YBs2YZvx8XLtS8rRdq1vyC3GtiichlDIaUzt2ZgD2RvPG554D//Md+bU1NnZod7fd09Khj293Y38VXP0DDpx4yFqPK6qaiCF9gJJ4MfgvBHdpC+0A4ej6SCk2YE0kPfcVav6pGjYzXtqSk+vae6u8i50SgrmAiRSL/5dGxajLhraF5PuWO4bueTN5Y29w9jg4Xf/11h7b7d8rrolPoHnEC8UJvYxsDHEhNILdh07VNcumu4fZyTgRaG0ykSORVzDPkRqoIhpx160P8iy88n7yxNjmeHM0MXV5e43Z6SOI4EkQAKkVv5NQuQJDbA7+2SS4B90wcKudEoO7gT7nKiGTOW89vdqBWI2vNKIGBxmYNa2rbEbtqc0lkpHFZUZHzTSe2OgWb+kfd6PNS/t9lCJlg7OhatenLcOPVQ1iEyqRWeLTlj+j142z7n2utQ6ytkW23lMWrcnOBjIza7SMnp3YjoRzt6O7LTv3u4G9NgEQy5bXnt0dDLZlgzVAVtWlGcaUJxd21J1b2Z0hIECefe1e8cV+u0Db5RYTiqrgPy8UJWG53SdNUHHniTaGv0Bv35WqmZrlm/nZ0KhJPlpnZr4nIjZiBmtyvpqRxjnA2eaMn8gLdyAx9dcUq7PtoBzb8GoZ3Tg7D73MSLTbbFtgNL7b8EP/XYR+69AxFvXYtEZ6ejvCq/7272iFWrvlmXB3F5M6Rh3JPBEpEZAWDIXv8qTrc3kPcHmcetm7O1isMAv/LPgzdB6eg2xyOny71QwXuMa8PQTnuitgDbY/L0D4cj9ShLSEFxAKoodnI1dQEcn3gOxLcRUQAdeq4Z+ShNRx+TkQKxGCoJvamflAaVx/OrgwZdkPtyYWjF/Hj/P3QfaeH7mgrnDa0BtDavL5l0HEMSjkGbWZd9JmUinqRna1/Vk0BrSupCeT6wHckuFu40LNz83H4OREpkUcb4WTCpTZHfxwR4+ws8rU5Xkf7r1QZvVRZXim2frBHzM7IEd3r/yYCUGmxaV1cEYMjt4q3R+SKwz8ec6wcjvZZcmaIvKMj23w1zN7Xo504/JyI3ISjydzI6d7ochkR4+4mOnvTdwDVR5UlJLjWhOLgyKYL72fj261NoVstYfWJZJwXjS3Wp2kOQ9u2ANqRYej1p1SENgx1vAyeHPHl4Mg2n/F18661WlVXv0tEpFreGk3GYMgaR4co13YYck081URn7yH+2WdA06a1f4jaCbwEgDOIRhxOwoCb+2+IC3iiyTL0TilC21G3I/LR+2r3+Z4MaPnAr5mvAzIiUjwGQ27k9Ml0dELG5583zv/k7j/wns5h48pD3JUH243jEAKQcPNYTPl+RuBLrEAmOtfdB23HIvxf6k4kf/8apIKCm/twNQD0VkDLBz4RkccwGHIjj9UMAe7vUO2tJjpnHuJO1lKVXSrDxgV7ofvyMip/3YunKv+JBNx870nE4cumk9DkD73Rf3JrRLVt6v4AkDOMExEpHoMhN3K5z1BNfWtM3N1HRA5NdFU5EKSI4ffhyNrj0P37OHQb6iLnbBquoa550yBcx2N1PsLdLY4hdWhLtJr1fwjQBN/clycCQLmdRyIT1iYSOcxbwRCH1ltT0xDlW7mQM6dGcsphYydXkABwcdTj6GrogCP6FgASzatjA05D2/IItEOC0G9qCholPWT7czyRxJBDvEmO/C1dB5GfCPB1AWTLlH8mLs7+tlUf1rUlpxw2doIUCUBERRHi9CcQjOu4u9FOvHxPLn778hBOVkRj0aF03P9adzRKaljz53giADQFtMDNWixzwd2YcZnIUaZa1lvvKVNG9uxs35SLiBgM1SgzEzh2zNhR2hHuqK0x1Wjc+gCvyks1Gld+PeLQdq8O34gLp69j7YVOePq7Prj9D60hBdRQ/lt5KgC0FdDGx/t+6Dupi72M7ICxdtnWZMlE5FEMhuwJDAT69nVsW3fU1tRUo2Fy7Rrw1Ve1/6xbGCoN2P7hPrzULxc9w37DvVlJDr2v85/TUT+6vusfbC8AlCTjcP+CAmNfIGceGKaANifH2Fk6J8fY98gfAiG93ng+li1z/ryQdznTFExEXscO1I6w16HaE0kYs7OBP/0JOH/e+ucBbqndKNp7FqvnH4JOB6w63gbnRBPzugDoUYB4RKEQVsMUdx63rfxH1rCPBfueKA1HNxK5xFsdqFkz5AhTbY2th7QQ7u9/MmwYEGoj23ItqtUryyrx07u/4fleuehSbx+i2jbF2AU98cmxnjgnmqABSnBfzBYsHLsBeZsKEb38HUiS5Pl+N8700VJ7Hwt39T1hzZL3yKkvIBFV59HJPmTCLXObLF9e8xxb7p5vydF5xHJy7O7qxJYC8Z9xG8Qf4jaJcFyqtouOdfaJmd1zxPq3dovrpdetH7u35royzRH28cdCNGlS85xpvpz/y1dM86LV9rw4OmcbuYfc57MjkinOTeZGbmsm8+ZcZbWoVi8vKTcmPfy8BLo9cdhb3spifWPpPAY0OwDtAIEBU1ojul2k/c/xdm4U5gmyzh3nxdMZzsk6uc9nRyRDzDMkJ57Ig2OPk9XqR9cdxw/vHYNuQx3kFKXhKjqZNwmAHl3r74P2jvPQjm2Kzv+XjMCQns6VJzDQu0GHnPItyUltz4u9UU3uzJlFlkxNwdb6enE+OyKfYjDkCF88mO0kDRSShLIGkZg+1YAfDh7DkYpEAM3N62MCCqFteRjawYHoNyUFES1vd1/ZvIF9LKyr7XnxRWBPN2VmGgNNZqAmkhUGQ45w5gHkruakqlmwrRECb5WMw9t77gYABOM6ejXcC233YmgfjMXtma0gBUQ7/7lywQzS1tX2vLDGzfe8XctKRHYxGHIkeLH3AAKM7/n2W2DsWMv/vCMijNXizz3ndFB0qXNfnOk8Gq23L602tF0AeBqvoGF8GKLH9sfdU1LRILajU/uXtZqmRFFzBunanhfWuBERVaPuDtTO5Gqx1enUUY0bAwsX1tgvwFBpwK5PD0L33zPQ/dIIW0uScRS3IQ4nreZAEJIEyd0dt+3xdkdqa9coIYF9LFw9L77ImUVE5CLOWu9GVk+mKyNqvvwSGDWqdvlYli+32O/Z/eew+u2D0OkEVh1rg7OiqXldb+QiFzIaUeWrRH+c5ds6V88LRzURkUIwGHKjaifT1aHyjg5rroGIj8fmZ7+Bbtkl6HY2xfbSFIgq9T71cRn9YvZCm3Edma1+Q9PZU+3v1BtZazkcuzolB2mscSMiBeDQek9ydUSNGzqVSidP4tlJl7AeN/fboc4BaNsXQjuqIbo/lIqQ+t2MK3INwGwHdurp/h1KH47tiaBF6dNhcFQTEZGZOoMhV0fUuCnoaIXDiGkWAu0AAwZMboWYDskAkqtvKJcRVUoeju2JoMVWLZlpOgyl1JJxVBMREQC1zk3m6ogaO7OrO9reuGB1Cyw73gPj/9MLMR2ibG9Y0wz23hxRpdTh2O6aw6sqe7VkgEtzxhERke+oMxiyE9RAkoz9J26tcakSnIhb3mu48bvGgOjGfgPv7uN4WW1NYBof770aCCUOx/ZU0OJMLRkRESmC4oKhuXPnQpIkZGVlub4TF2pchEFg39dH8Np/IzC73jwUiFiLtxUgHp+GjMe1YBsdvGpTk5OZCRw7Zhw1tnSp8XdenveaYlwNHn3JU0GLUmvJiIjIJkX1Gdq2bRsWLlyIdu3a1X5nDswTVHKyBGvf3gfd19ehO9wCJ/S3AbgNQB/8HdMwIiAb/aP/h+Te0Wg3dzRGN28E6BcBc+YYg60LF6zu1yW+7N+hxASIngpalFhLRkRENVLM0PorV66gU6dOePfdd/HSSy+hQ4cOeOONNxx6b41D86qMNDJERuHXwijoPjwL3daG2FSchkoEmzfVoAx9Gu+BNr0U2kcS0EabBCnARm2Jkodd26Kk4diemvWeSQuJiLyGQ+tvMXnyZAwePBj9+vXDSy+9VOO25eXlKC8vN78uKSmxue25I5ewZnkIdN8nYNWx1jhjiLRY3zo4D9rUExg0oh7ueiwVdZt0cazA/jhSR0nDsT01Ek+JtWRERFQjRQRDn376KXbu3Ilt27Y5tP3cuXMxe7b1BD3663r8smQfdJ+ch25HE2wrTYVAD/P6eriCvtF7oe1TjoGPJqJFnyQASe44DP+glCDPk0GLA02sRESkHLJvJsvPz0eXLl2wevVqtG/fHgDQp0+fGpvJrNUMJSQk4L641cg91QUXRSOL7duFHoS23WloHwhHzz+lIaR+iMeOh7zMk017/tgUSkQkI5yO44aVK1fivvvuQ2CVh4xer4ckSQgICEB5ebnFOmtMJxMoBhCGhtIlDIjfB20/PQZMug1xXdjZ1a8xaCEiUiT2Gbqhb9+++N///mexbOLEiUhOTsb06dPtBkJVTe+xEcPGN8Md41IQFNrD/hvIPyilaY+IiHxC9sFQgwYN0LZtW4tl9erVQ+PGjastt+fZH9I9GlmSCrCWiYjI78g+GCKSDaVPzkpERFbJvs+QO3irzZH8mK3JWU0j05QyOSsRkYKwA7UbKSoY8rdmGH84HlOiRVvTezDRIhGRR3jr+a24ucn8Wna28aGbkQGMGWP8nZjo2uzqcuDr49HrjZmoly0z/nZ1JnlOzkpE5NcYDMmFqRnm1oduQYFxudICIl8fjzsDMU7OSkTk1xgMyYFeb+yYa63F0rQsK8v1mg1v8/XxuDsQ4+SsRER+jcGQHPhbM4wvj8cTgZhpnjPJxqS8kmTMau3sPGdERCQLDIbkwN+aYXx5PJ4IxEzznAHVAyJOzkpEpHgMhuTA35phfHk8ngrETJOzxsVZLo+P57B6IiKFY9JFOTA1wxQUWG/eMQ3dVkozjC+Px5OBWGYmMGyY8lMFEBGRBdYMyYG/NcP48ng83b/HNM/Z6NHG30q5JkREZBODIbnwt2YYXx2PvwWWRETkccxALTf+kLG5Kl8dj7V5xBISjIGQ0gJLIiKV4nQcbiSbYMjfAh254/kmIlI0bz2/2YHaWzjjufeZ+vcQERHVgH2GvMHXU1MQERGRTQyGPM3XU1MQERFRjRgMeZq/TbVBRETkZxgMeZq/TbVBRETkZxgMeZq/TbVBRETkZxgMeRpnPCciIpI1BkOexozIREREssZgyBv8baoNIiIiP8Kki95S04znzJRMRETkMwyGvMlaRmRmpiYiIvIpNpP5EjNTExER+RyDIV9hZmoiIiJZYDDkK8xMTUREJAsMhnyFmamJiIhkgcGQrzAzNRERkSwwGPIVZqYmIiKSBQZDvsLM1ERERLLAYMiXmJmaiIjI55h00ddqykxNREREHsdgSA6sZaYmIiIir2AzGREREakagyEiIiJSNQZDREREpGoMhoiIiEjVGAwRERGRqsk+GJo7dy7uuOMONGjQAJGRkRg+fDgOHjzo62IRERGRn5B9MLR+/XpMnjwZW7ZswZo1a1BZWYkBAwagtLTU10UjIiIiPyAJIYSvC+GMs2fPIjIyEuvXr8ddd93l0HtKSkoQHh6O4uJihIWFebiERERE5A7een4rLulicXExACAiIsLmNuXl5SgvLze/Likp8Xi5iIiISJlk30xWlRAC06ZNQ69evdC2bVub282dOxfh4eHmn4SEBC+WkoiIiJREUc1kkydPxnfffYeffvoJ8fHxNrezVjOUkJDAZjIiIiIFYTPZLaZOnYqvv/4aGzZsqDEQAgCNRgONRuOlkhEREZGSyT4YEkJg6tSpWLFiBXJzc5GUlOTrIhEREZEfkX0wNHnyZCxduhRfffUVGjRogMLCQgBAeHg46tSp4+PSERERkdLJvs+QJElWly9evBgTJkxwaB922xz1emDjRuD0aSAmBkhPBwIDa1FqIiIiqi32GbrB47Fadjbw5z8DJ0/eXBYfD7z5JpCZ6dnPJiIiIp9T1NB6t8vOBkaMsAyEAKCgwLg8O9s35SIiIiKvUW8wpNcba4Ss1TyZlmVlGbcjIiIiv6XeYGjjxuo1QlUJAeTnG7cjIiIiv6XeYOj0afduR0RERIqk3mAoJsa92xEREZEiqTcYSk83jhqzMXQfkgQkJBi3IyIiIr+l3mAoMNA4fB6oHhCZXr/xBvMNERER+Tn1BkOAMY/Ql18CcXGWy+PjjcuZZ4iIiMjvyT7posdlZgLDhjEDNRERkUoxGAKMgU+fPr4uBREREfmAupvJiIiISPUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKqmmGDo3XffRVJSEkJDQ9G5c2ds3LjR10UiIiIiP6CIYOizzz5DVlYWnnvuOezatQvp6ekYNGgQTpw44euiERERkcJJQgjh60LY07VrV3Tq1AnvvfeeeVlKSgqGDx+OuXPn2n1/SUkJwsPDUVxcjLCwME8WlYiIiNzEW89v2dcMXb9+HTt27MCAAQMslg8YMACbNm3yUamIiIjIXwT5ugD2nDt3Dnq9HlFRURbLo6KiUFhYaPU95eXlKC8vN78uLi4GYIwwiYiISBlMz21PN2LJPhgykSTJ4rUQotoyk7lz52L27NnVlickJHikbEREROQ558+fR3h4uMf2L/tgqEmTJggMDKxWC1RUVFSttshk5syZmDZtmvn1pUuX0Lx5c5w4ccKjJ1NuSkpKkJCQgPz8fFX1leJx87jVgMfN41aD4uJiNGvWDBERER79HNkHQyEhIejcuTPWrFmD++67z7x8zZo1GDZsmNX3aDQaaDSaasvDw8NV9SUyCQsL43GrCI9bXXjc6qLW4w4I8GwXZ9kHQwAwbdo0jB07Fl26dEH37t2xcOFCnDhxAo899pivi0ZEREQKp4hg6IEHHsD58+fx97//HadPn0bbtm3x/fffo3nz5r4uGhERESmcIoIhAJg0aRImTZrk0ns1Gg1eeOEFq01n/ozHzeNWAx43j1sNeNyePW5FJF0kIiIi8hTZJ10kIiIi8iQGQ0RERKRqDIaIiIhI1RgMERERkaopMhh69913kZSUhNDQUHTu3BkbN26scfv169ejc+fOCA0NRYsWLbBgwYJq2yxfvhypqanQaDRITU3FihUrPFV8lzlz3NnZ2ejfvz+aNm2KsLAwdO/eHatWrbLYZsmSJZAkqdpPWVmZpw/FKc4cd25urtVjOnDggMV2/na9J0yYYPW409LSzNso4Xpv2LABQ4cORWxsLCRJwsqVK+2+xx/ub2eP21/ub2eP21/ub2eP21/u77lz5+KOO+5AgwYNEBkZieHDh+PgwYN23+eNe1xxwdBnn32GrKwsPPfcc9i1axfS09MxaNAgnDhxwur2eXl5uOeee5Ceno5du3bh2WefxRNPPIHly5ebt9m8eTMeeOABjB07Fr/++ivGjh2LkSNHYuvWrd46LLucPe4NGzagf//++P7777Fjxw5kZGRg6NCh2LVrl8V2YWFhOH36tMVPaGioNw7JIc4et8nBgwctjqlVq1bmdf54vd98802L483Pz0dERATuv/9+i+3kfr1LS0vRvn17zJ8/36Ht/eX+dva4/eX+dva4TZR+fzt73P5yf69fvx6TJ0/Gli1bsGbNGlRWVmLAgAEoLS21+R6v3eNCYe68807x2GOPWSxLTk4WM2bMsLr9M888I5KTky2WPfroo6Jbt27m1yNHjhRardZim4EDB4pRo0a5qdS15+xxW5Oamipmz55tfr148WIRHh7uriJ6hLPHnZOTIwCIixcv2tynGq73ihUrhCRJ4tixY+ZlSrjeVQEQK1asqHEbf7m/q3LkuK1R4v1dlSPH7S/3d1WuXG9/uL+FEKKoqEgAEOvXr7e5jbfucUXVDF2/fh07duzAgAEDLJYPGDAAmzZtsvqezZs3V9t+4MCB2L59OyoqKmrcxtY+vc2V476VwWDA5cuXq012d+XKFTRv3hzx8fEYMmRItf8sfak2x92xY0fExMSgb9++yMnJsVinhuu9aNEi9OvXr1qWdjlfb1f4w/3tDkq8v2tDyfe3O/jL/V1cXAwANU7C6q17XFHB0Llz56DX66vNVh8VFVVtVnuTwsJCq9tXVlbi3LlzNW5ja5/e5spx3+rVV19FaWkpRo4caV6WnJyMJUuW4Ouvv8ayZcsQGhqKnj174vDhw24tv6tcOe6YmBgsXLgQy5cvR3Z2Ntq0aYO+fftiw4YN5m38/XqfPn0aP/zwAx5++GGL5XK/3q7wh/vbHZR4f7vCH+7v2vKX+1sIgWnTpqFXr15o27atze28dY8rZjqOqiRJsngthKi2zN72ty53dp++4GoZly1bhlmzZuGrr75CZGSkeXm3bt3QrVs38+uePXuiU6dOePvtt/HWW2+5r+C15Mxxt2nTBm3atDG/7t69O/Lz8/HKK6/grrvucmmfvuJqGZcsWYKGDRti+PDhFsuVcr2d5S/3t6uUfn87w5/ub1f5y/09ZcoU/Pbbb/jpp5/sbuuNe1xRNUNNmjRBYGBgtWivqKioWlRoEh0dbXX7oKAgNG7cuMZtbO3T21w5bpPPPvsMDz30ED7//HP069evxm0DAgJwxx13yOY/idocd1XdunWzOCZ/vt5CCHzwwQcYO3YsQkJCatxWbtfbFf5wf9eGku9vd1Ha/V0b/nJ/T506FV9//TVycnIQHx9f47beuscVFQyFhISgc+fOWLNmjcXyNWvWoEePHlbf071792rbr169Gl26dEFwcHCN29jap7e5ctyA8T/GCRMmYOnSpRg8eLDdzxFCYPfu3YiJial1md3B1eO+1a5duyyOyV+vN2AcrXHkyBE89NBDdj9HbtfbFf5wf7tK6fe3uyjt/q4Npd/fQghMmTIF2dnZWLduHZKSkuy+x2v3uMNdrWXi008/FcHBwWLRokVi3759IisrS9SrV8/cq37GjBli7Nix5u1///13UbduXfGXv/xF7Nu3TyxatEgEBweLL7/80rzNzz//LAIDA8U///lPsX//fvHPf/5TBAUFiS1btnj9+Gxx9riXLl0qgoKCxDvvvCNOnz5t/rl06ZJ5m1mzZgmdTieOHj0qdu3aJSZOnCiCgoLE1q1bvX58tjh73K+//rpYsWKFOHTokNizZ4+YMWOGACCWL19u3sYfr7fJH//4R9G1a1er+1TC9b58+bLYtWuX2LVrlwAgXnvtNbFr1y5x/PhxIYT/3t/OHre/3N/OHre/3N/OHreJ0u/vxx9/XISHh4vc3FyL7+3Vq1fN2/jqHldcMCSEEO+8845o3ry5CAkJEZ06dbIYljd+/HjRu3dvi+1zc3NFx44dRUhIiEhMTBTvvfdetX1+8cUXok2bNiI4OFgkJydb3Fxy4cxx9+7dWwCo9jN+/HjzNllZWaJZs2YiJCRENG3aVAwYMEBs2rTJi0fkGGeOe968eaJly5YiNDRUNGrUSPTq1Ut899131fbpb9dbCCEuXbok6tSpIxYuXGh1f0q43qah07a+t/56fzt73P5yfzt73P5yf7vyPfeH+9vaMQMQixcvNm/jq3tculFAIiIiIlVSVJ8hIiIiIndjMERERESqxmCIiIiIVI3BEBEREakagyEiIiJSNQZDREREpGoMhoiIiEjVGAwRERGRqjEYIiIiIlVjMERERESqxmCIiBRp2bJlCA0NRUFBgXnZww8/jHbt2qG4uNiHJSMipeHcZESkSEIIdOjQAenp6Zg/fz5mz56N999/H1u2bEFcXJyvi0dEChLk6wIQEblCkiTMmTMHI0aMQGxsLN58801s3LiRgRAROY01Q0SkaJ06dcLevXuxevVq9O7d29fFISIFYp8hIlKsVatW4cCBA9Dr9YiKivJ1cYhIoVgzRESKtHPnTvTp0wfvvPMOPv30U9StWxdffPGFr4tFRArEPkNEpDjHjh3D4MGDMWPGDIwdOxapqam44447sGPHDnTu3NnXxSMihWHNEBEpyoULF9CzZ0/cdddd+Pe//21ePmzYMJSXl0On0/mwdESkRAyGiIiISNXYgZqIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkav8PtFJUDcDRlWgAAAAASUVORK5CYII=", - "text/plain": [ - "
" - ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], + "execution_count": 6, + "id": "41a929b5", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "%matplotlib inline\n", "\n", @@ -763,8 +759,10 @@ }, { "cell_type": "markdown", - "id": "7e858f37", - "metadata": {}, + "id": "af8f3db9", + "metadata": { + "editable": true + }, "source": [ "## Replace or not\n", "\n", @@ -776,8 +774,10 @@ }, { "cell_type": "markdown", - "id": "7dace8c0", - "metadata": {}, + "id": "ce1d1147", + "metadata": { + "editable": true + }, "source": [ "## Momentum based GD\n", "\n", @@ -789,8 +789,10 @@ }, { "cell_type": "markdown", - "id": "3cd079d0", - "metadata": {}, + "id": "b8750f09", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\mathbf{v}_{t}=\\gamma \\mathbf{v}_{t-1}+\\eta_{t}\\nabla_\\theta E(\\boldsymbol{\\theta}_t) \\nonumber\n", @@ -799,8 +801,10 @@ }, { "cell_type": "markdown", - "id": "305a75c3", - "metadata": {}, + "id": "6b18d51a", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -815,8 +819,10 @@ }, { "cell_type": "markdown", - "id": "026d8598", - "metadata": {}, + "id": "efa3113f", + "metadata": { + "editable": true + }, "source": [ "where we have introduced a momentum parameter $\\gamma$, with\n", "$0\\le\\gamma\\le 1$, and for brevity we dropped the explicit notation to\n", @@ -832,8 +838,10 @@ }, { "cell_type": "markdown", - "id": "80e73593", - "metadata": {}, + "id": "2007f72c", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\Delta \\boldsymbol{\\theta}_{t+1} = \\gamma \\Delta \\boldsymbol{\\theta}_t -\\ \\eta_{t}\\nabla_\\theta E(\\boldsymbol{\\theta}_t),\n", @@ -842,16 +850,20 @@ }, { "cell_type": "markdown", - "id": "4a5b87d4", - "metadata": {}, + "id": "149a0faa", + "metadata": { + "editable": true + }, "source": [ "where we have defined $\\Delta \\boldsymbol{\\theta}_{t}= \\boldsymbol{\\theta}_t-\\boldsymbol{\\theta}_{t-1}$." ] }, { "cell_type": "markdown", - "id": "f9bbf0cd", - "metadata": {}, + "id": "3930d988", + "metadata": { + "editable": true + }, "source": [ "## More on momentum based approaches\n", "\n", @@ -864,8 +876,10 @@ }, { "cell_type": "markdown", - "id": "9e7986cc", - "metadata": {}, + "id": "8560c22c", + "metadata": { + "editable": true + }, "source": [ "$$\n", "m {d^2 \\mathbf{w} \\over dt^2} + \\mu {d \\mathbf{w} \\over dt }= -\\nabla_w E(\\mathbf{w}).\n", @@ -874,16 +888,20 @@ }, { "cell_type": "markdown", - "id": "50d69000", - "metadata": {}, + "id": "6f4563fe", + "metadata": { + "editable": true + }, "source": [ "We can discretize this equation in the usual way to get" ] }, { "cell_type": "markdown", - "id": "e7d9df0a", - "metadata": {}, + "id": "8fe2b7ac", + "metadata": { + "editable": true + }, "source": [ "$$\n", "m { \\mathbf{w}_{t+\\Delta t}-2 \\mathbf{w}_{t} +\\mathbf{w}_{t-\\Delta t} \\over (\\Delta t)^2}+\\mu {\\mathbf{w}_{t+\\Delta t}- \\mathbf{w}_{t} \\over \\Delta t} = -\\nabla_w E(\\mathbf{w}).\n", @@ -892,16 +910,20 @@ }, { "cell_type": "markdown", - "id": "e6f67ad8", - "metadata": {}, + "id": "207eae67", + "metadata": { + "editable": true + }, "source": [ "Rearranging this equation, we can rewrite this as" ] }, { "cell_type": "markdown", - "id": "443f0b02", - "metadata": {}, + "id": "9770730e", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\Delta \\mathbf{w}_{t +\\Delta t}= - { (\\Delta t)^2 \\over m +\\mu \\Delta t} \\nabla_w E(\\mathbf{w})+ {m \\over m +\\mu \\Delta t} \\Delta \\mathbf{w}_t.\n", @@ -910,8 +932,10 @@ }, { "cell_type": "markdown", - "id": "d89ab74d", - "metadata": {}, + "id": "c233679d", + "metadata": { + "editable": true + }, "source": [ "## Momentum parameter\n", "\n", @@ -924,8 +948,10 @@ }, { "cell_type": "markdown", - "id": "3401047f", - "metadata": {}, + "id": "cf54be10", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\gamma= {m \\over m +\\mu \\Delta t }, \\qquad \\eta = {(\\Delta t)^2 \\over m +\\mu \\Delta t}.\n", @@ -934,8 +960,10 @@ }, { "cell_type": "markdown", - "id": "c7c24040", - "metadata": {}, + "id": "35f187e7", + "metadata": { + "editable": true + }, "source": [ "Thus, as the name suggests, the momentum parameter is proportional to\n", "the mass of the particle and effectively provides inertia.\n", @@ -965,8 +993,10 @@ }, { "cell_type": "markdown", - "id": "22e04f6c", - "metadata": {}, + "id": "476338d5", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\mathbf{v}_{t}=\\gamma \\mathbf{v}_{t-1}+\\eta_{t}\\nabla_\\theta E(\\boldsymbol{\\theta}_t +\\gamma \\mathbf{v}_{t-1}) \\nonumber\n", @@ -975,8 +1005,10 @@ }, { "cell_type": "markdown", - "id": "65b1fa09", - "metadata": {}, + "id": "c23f6df7", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -991,16 +1023,20 @@ }, { "cell_type": "markdown", - "id": "7acccb8b", - "metadata": {}, + "id": "e36c0680", + "metadata": { + "editable": true + }, "source": [ "One of the major advantages of NAG is that it allows for the use of a larger learning rate than GDM for the same choice of $\\gamma$." ] }, { "cell_type": "markdown", - "id": "795e6ab5", - "metadata": {}, + "id": "484048bb", + "metadata": { + "editable": true + }, "source": [ "## Second moment of the gradient\n", "\n", @@ -1028,8 +1064,10 @@ }, { "cell_type": "markdown", - "id": "dec5061d", - "metadata": {}, + "id": "ed915ab1", + "metadata": { + "editable": true + }, "source": [ "## RMS prop\n", "\n", @@ -1041,8 +1079,10 @@ }, { "cell_type": "markdown", - "id": "3dfb0934", - "metadata": {}, + "id": "c4d8b1a8", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -1057,8 +1097,10 @@ }, { "cell_type": "markdown", - "id": "bf4b7a89", - "metadata": {}, + "id": "6819d54f", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\mathbf{s}_t =\\beta \\mathbf{s}_{t-1} +(1-\\beta)\\mathbf{g}_t^2 \\nonumber\n", @@ -1067,8 +1109,10 @@ }, { "cell_type": "markdown", - "id": "510c8591", - "metadata": {}, + "id": "c38fa00d", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\boldsymbol{\\theta}_{t+1}=\\boldsymbol{\\theta}_t - \\eta_t { \\mathbf{g}_t \\over \\sqrt{\\mathbf{s}_t +\\epsilon}}, \\nonumber\n", @@ -1077,8 +1121,10 @@ }, { "cell_type": "markdown", - "id": "1a0e569f", - "metadata": {}, + "id": "7ff83ef0", + "metadata": { + "editable": true + }, "source": [ "where $\\beta$ controls the averaging time of the second moment and is\n", "typically taken to be about $\\beta=0.9$, $\\eta_t$ is a learning rate\n", @@ -1093,8 +1139,10 @@ }, { "cell_type": "markdown", - "id": "977c9c79", - "metadata": {}, + "id": "ba98f789", + "metadata": { + "editable": true + }, "source": [ "## [ADAM optimizer](https://arxiv.org/abs/1412.6980)\n", "\n", @@ -1120,8 +1168,10 @@ }, { "cell_type": "markdown", - "id": "d188330b", - "metadata": {}, + "id": "03428756", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -1136,8 +1186,10 @@ }, { "cell_type": "markdown", - "id": "776b649a", - "metadata": {}, + "id": "ef5b461b", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\mathbf{m}_t = \\beta_1 \\mathbf{m}_{t-1} + (1-\\beta_1) \\mathbf{g}_t \\nonumber\n", @@ -1146,8 +1198,10 @@ }, { "cell_type": "markdown", - "id": "6f8a0d72", - "metadata": {}, + "id": "0149850a", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\mathbf{s}_t =\\beta_2 \\mathbf{s}_{t-1} +(1-\\beta_2)\\mathbf{g}_t^2 \\nonumber\n", @@ -1156,8 +1210,10 @@ }, { "cell_type": "markdown", - "id": "53f1a2ce", - "metadata": {}, + "id": "4ae41be8", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\boldsymbol{\\mathbf{m}}_t={\\mathbf{m}_t \\over 1-\\beta_1^t} \\nonumber\n", @@ -1166,8 +1222,10 @@ }, { "cell_type": "markdown", - "id": "cc7cd55a", - "metadata": {}, + "id": "5d36d54a", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\boldsymbol{\\mathbf{s}}_t ={\\mathbf{s}_t \\over1-\\beta_2^t} \\nonumber\n", @@ -1176,8 +1234,10 @@ }, { "cell_type": "markdown", - "id": "6bd6e651", - "metadata": {}, + "id": "08eb5528", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\boldsymbol{\\theta}_{t+1}=\\boldsymbol{\\theta}_t - \\eta_t { \\boldsymbol{\\mathbf{m}}_t \\over \\sqrt{\\boldsymbol{\\mathbf{s}}_t} +\\epsilon}, \\nonumber\n", @@ -1186,8 +1246,10 @@ }, { "cell_type": "markdown", - "id": "677f1aef", - "metadata": {}, + "id": "4a5e4b7b", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -1201,8 +1263,10 @@ }, { "cell_type": "markdown", - "id": "4bb1d86d", - "metadata": {}, + "id": "b71679d3", + "metadata": { + "editable": true + }, "source": [ "where $\\beta_1$ and $\\beta_2$ set the memory lifetime of the first and\n", "second moment and are typically taken to be $0.9$ and $0.99$\n", @@ -1218,8 +1282,10 @@ }, { "cell_type": "markdown", - "id": "812cca90", - "metadata": {}, + "id": "a9910c4b", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\Delta \\theta_{t+1}= -\\eta_t { \\boldsymbol{m}_t \\over \\sqrt{\\sigma_t^2 + m_t^2 }+\\epsilon}.\n", @@ -1228,8 +1294,10 @@ }, { "cell_type": "markdown", - "id": "51ddf251", - "metadata": {}, + "id": "85d963d2", + "metadata": { + "editable": true + }, "source": [ "## Algorithms and codes for Adagrad, RMSprop and Adam\n", "\n", @@ -1240,8 +1308,10 @@ }, { "cell_type": "markdown", - "id": "676bc1af", - "metadata": {}, + "id": "bc9de56d", + "metadata": { + "editable": true + }, "source": [ "## AdaGrad algorithm, taken from [Goodfellow et al](https://www.deeplearningbook.org/contents/optimization.html)\n", "\n", @@ -1254,8 +1324,10 @@ }, { "cell_type": "markdown", - "id": "5e0a4bd5", - "metadata": {}, + "id": "e6293208", + "metadata": { + "editable": true + }, "source": [ "## RMSProp algorithm, taken from [Goodfellow et al](https://www.deeplearningbook.org/contents/optimization.html)\n", "\n", @@ -1268,8 +1340,10 @@ }, { "cell_type": "markdown", - "id": "d9eccc07", - "metadata": {}, + "id": "40fde17d", + "metadata": { + "editable": true + }, "source": [ "## ADAM algorithm, taken from [Goodfellow et al](https://www.deeplearningbook.org/contents/optimization.html)\n", "\n", @@ -1282,8 +1356,10 @@ }, { "cell_type": "markdown", - "id": "b81a38cf", - "metadata": {}, + "id": "f9066e5f", + "metadata": { + "editable": true + }, "source": [ "## Practical tips\n", "\n", @@ -1300,8 +1376,10 @@ }, { "cell_type": "markdown", - "id": "2be4b8ad", - "metadata": {}, + "id": "cfac43d8", + "metadata": { + "editable": true + }, "source": [ "## Automatic differentiation\n", "\n", @@ -1336,8 +1414,10 @@ }, { "cell_type": "markdown", - "id": "78ce59cc", - "metadata": {}, + "id": "6c1afa20", + "metadata": { + "editable": true + }, "source": [ "$$\n", "f(x) = \\sin\\left(2\\pi x + x^2\\right)\n", @@ -1346,16 +1426,20 @@ }, { "cell_type": "markdown", - "id": "a1de3aaf", - "metadata": {}, + "id": "4c038cf3", + "metadata": { + "editable": true + }, "source": [ "which has the following derivative" ] }, { "cell_type": "markdown", - "id": "99aa41ec", - "metadata": {}, + "id": "eed0ca87", + "metadata": { + "editable": true + }, "source": [ "$$\n", "f'(x) = \\cos\\left(2\\pi x + x^2\\right)\\left(2\\pi + 2x\\right)\n", @@ -1364,36 +1448,23 @@ }, { "cell_type": "markdown", - "id": "76989f22", - "metadata": {}, + "id": "3f493ed1", + "metadata": { + "editable": true + }, "source": [ "Using **autograd** we have" ] }, { "cell_type": "code", - "execution_count": 48, - "id": "b9cd37f2", - "metadata": {}, - "outputs": [ - { - "data": { - "image/png": "iVBORw0KGgoAAAANSUhEUgAAApMAAAHFCAYAAACuKXKKAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjguMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy81sbWrAAAACXBIWXMAAA9hAAAPYQGoP6dpAACCb0lEQVR4nO3dd1xV9f8H8Ne5wGXvIVNARQRBUXBvza2paZaaOSstKzUbthwN82uZ1dcyrdwrU8u9Rw5UUMGBeyCKKKAMkX0/vz/4cn9eAQUEPsB9PR+P+1AO55z7up97xpszPkcRQggQEREREZWCSnYAIiIiIqq6WEwSERERUamxmCQiIiKiUmMxSURERESlxmKSiIiIiEqNxSQRERERlRqLSSIiIiIqNRaTRERERFRqLCaJiIiIqNRKVEwuWrQIiqJoXyYmJnB2dkaHDh0wY8YM3L17t1xC5r/v9evXy2X+ALBlyxZMnTq10N95eXlh+PDh5fbe+io2NhZTp05FREREmc+7JMvMTz/9hDp16kCtVkNRFCQlJZV5nvIwceJEKIqCXr16PfO8VqxYgTlz5jx7KMkqYluh76ZOnQpFUcpt/oqi6GyLo6KiMHXq1EK/0/bt2yMgIKDU7/X111/j77//LjA8fzkKDw8v9bwru3379kFRFOzbt6/E0z5pe/H491fWnnV/XB75nqUti+vw4cOYOnVqofun9u3bo3379uX23sVRqiOTCxcuRGhoKHbu3Im5c+ciKCgIM2fOhJ+fH3bt2lXWGdGzZ0+EhobCxcWlzOedb8uWLZg2bVqhv1u/fj0+++yzcntvfRUbG4tp06aVSzFZXBEREXjnnXfQoUMH7NmzB6GhobC0tJSWp7iys7OxbNkyAMC2bdtw69atZ5pfdSkmqeoLDQ3F6NGjtT9HRUVh2rRp5fIHQlHFJD3Zk7YXj39/+qBx48YIDQ1F48aNy+09Dh8+jGnTphVaTP7888/4+eefy+29i8OwNBMFBAQgJCRE+3P//v0xYcIEtG7dGi+88AIuXbqEGjVqPHO49PR0mJiYwNHREY6Ojs88v9Jq1KiRtPem8nX27FkAwGuvvYamTZs+cdyHDx/CzMysImI91T///IP4+Hj07NkTmzdvxuLFi/Hxxx/LjlVqlaltq6vs7GwoigJDw1Jt9itM8+bNZUegZ6BP31/+OmVlZSX1c/v7+0t773xlds1kzZo18d133yE1NRW//vqrzu/Cw8Px/PPPw87ODiYmJmjUqBH+/PNPnXHyTyvs2LEDI0eOhKOjI8zMzJCZmVng1NX48eNhbm6OlJSUAjleeukl1KhRA9nZ2QCA1atXo0uXLnBxcYGpqSn8/Pzw0UcfIS0tTTvN8OHDMXfuXADQOY2f/36PHlaPj4+HWq0u9Ejl+fPnoSgKfvzxR+2wuLg4vPHGG3B3d4darYa3tzemTZuGnJycYrXrihUr0KJFC1hYWMDCwgJBQUH4/fffdcb5448/0LBhQ5iYmMDOzg79+vXDuXPndMYZPnw4LCwscP78eXTt2hXm5uZwcXHBN998AwA4cuQIWrduDXNzc9StWxeLFy/WmT7/O9i5cydGjBgBOzs7mJubo3fv3rh69arOuEWdhnj0UPy+ffvQpEkTAMCIESO0bf7o6YfiLDf52Vu1agUTExO4urpi8uTJ2u//Sdq3b49XXnkFANCsWTMoiqLNnX/67N9//0XLli1hZmaGkSNHAgBu3LiBV155BU5OTjA2Noafnx++++47aDQa7byvX78ORVEwa9YszJw5E15eXjA1NUX79u1x8eJFZGdn46OPPoKrqyusra3Rr1+/El0m8vvvv0OtVmPhwoXw8PDAwoULIYTQGaeoU76Pn5Jp3749Nm/ejOjoaJ3lP9+9e/fw5ptvws3NDWq1GrVq1cInn3yCzMxMnfkmJSVh1KhRsLOzg4WFBXr27ImrV68W+F7zT5OeOHECAwYMgK2tLWrXrg0g7zt/+eWXte3l5eWFQYMGITo6ukAblPZ7z3f06FH07t0b9vb2MDExQe3atTF+/HidcQ4ePIhOnTrB0tISZmZmaNmyJTZv3lxoO+/ZswevvfYa7O3tYWVlhVdffRVpaWmIi4vDwIEDYWNjAxcXF0yaNEknZ/6y8p///AdfffUVatasCRMTE4SEhGD37t0673X58mWMGDECPj4+MDMzg5ubG3r37o3Tp0/rjJf/HS9duhTvvfce3NzcYGxsjMuXLwMAdu3ahU6dOsHKygpmZmZo1apVgfcCgM2bNyMoKAjGxsbw9vbGt99+W6y2nTt3LlQqlc4y/d1330FRFLz11lvaYRqNBra2tnjvvfe0wx5dXhYtWoQXX3wRANChQwftsrlo0SKd9wsLC0ObNm1gZmaGWrVq4ZtvvtFZHwujKArS0tKwePFi7XwfP1WYmpqKsWPHwsHBAfb29njhhRcQGxtbYF6rV69GixYtYG5uDgsLC3Tt2hUnT558ajvFx8fjzTffhL+/PywsLODk5ISOHTviwIEDOuPlLyPffvstZs+eDW9vb1hYWKBFixY4cuSIzrglWYcetXTpUiiKgtDQ0AK/mz59OoyMjBAbG/vU7UVhp5Fv3bqF119/HR4eHlCr1XB1dcWAAQNw584dAEBGRgbee+89BAUFwdraGnZ2dmjRogX++eefp7ZhUVJSUrTro4WFBbp164aLFy8WOu6lS5cwePBgnW16fk2Q70nr1OPb1Dlz5kBRFO369qgPP/wQarUaCQkJAICdO3eiT58+cHd3h4mJCerUqYM33nhD+3sgb5v5/vvvAwC8vb21bf7oNjx/2c3OzoaTkxOGDh1a4L2TkpJgamqKiRMn6rTTpEmT4O3tDbVaDTc3N4wfP16nRioWUQILFy4UAERYWFihv3/w4IEwMDAQnTp10g7bs2ePUKvVok2bNmL16tVi27ZtYvjw4QKAWLhwYYF5u7m5iddff11s3bpV/PXXXyInJ0f7u2vXrgkhhIiMjBQAxIIFC3Te//79+8LY2FhMnDhRO+yLL74Q33//vdi8ebPYt2+fmDdvnvD29hYdOnTQjnP58mUxYMAAAUCEhoZqXxkZGUIIITw9PcWwYcO04/fr1094eHiI3Nxcnff/4IMPhFqtFgkJCUIIIW7fvi08PDyEp6en+PXXX8WuXbvEF198IYyNjcXw4cOf2t6fffaZACBeeOEFsWbNGrFjxw4xe/Zs8dlnn2nH+frrrwUAMWjQILF582axZMkSUatWLWFtbS0uXryoHW/YsGFCrVYLPz8/8cMPP4idO3eKESNGCABi8uTJom7duuL3338X27dvF7169RIARHh4eIHvx8PDQ4wcOVJs3bpVzJ8/Xzg5OQkPDw9x//597biPt1e+du3aiXbt2gkhhEhOTtbO89NPP9W2eUxMjBCi+MvN2bNnhZmZmfD39xcrV64U//zzj+jatauoWbOmzjJTmLNnz4pPP/1UO8/Q0FBx+fJlbVY7Ozvh4eEhfvrpJ7F3716xf/9+cffuXeHm5iYcHR3FvHnzxLZt28S4ceMEADF27FjtvK9duyYACE9PT9G7d2+xadMmsWzZMlGjRg1Rt25dMXToUG07zps3T1hYWIjevXs/dZkQQoiYmBihUqnEiy++KIQQ2s+wb98+nfEeX2/y7d27VwAQe/fu1bZDq1athLOzs87yL4QQ6enpokGDBsLc3Fx8++23YseOHeKzzz4ThoaGokePHtp55ubmitatWwsTExPxzTffiB07dohp06YJHx8fAUBMmTJFO+6UKVO0bfPhhx+KnTt3ir///lsIIcSaNWvE559/LtavXy/2798vVq1aJdq1ayccHR1FfHx8mXzvQgixbds2YWRkJBo0aCAWLVok9uzZI/744w/x8ssva8fZt2+fMDIyEsHBwWL16tXi77//Fl26dBGKoohVq1YVaGdvb2/x3nvviR07doiZM2cKAwMDMWjQING4cWPx5Zdfip07d4oPP/xQABDfffeddvr8ZcXDw0O0bt1arF27VqxZs0Y0adJEGBkZicOHD2vH3b9/v3jvvffEX3/9Jfbv3y/Wr18v+vbtK0xNTcX58+cLfMdubm5iwIABYsOGDWLTpk0iMTFRLF26VCiKIvr27SvWrVsnNm7cKHr16iUMDAzErl27tPPYtWuXMDAwEK1btxbr1q3TZspv4yc5f/68ACBWrFihHdatWzdhamoqfHx8tMOOHj0qAIgtW7Zohz26vNy9e1e7jZs7d6522bx7964QIm89tbe3Fz4+PmLevHli586d4s033xQAxOLFi5+YMTQ0VJiamooePXpo53v27Fmd77RWrVri7bffFtu3bxe//fabsLW11dl3CCHEV199JRRFESNHjhSbNm0S69atEy1atBDm5uba+T2pncaOHStWrVol9u3bJzZt2iRGjRolVCqVdv0U4v+XES8vL9GtWzfx999/i7///lsEBgYKW1tbkZSUpB23uOvQ49uBzMxM4ezsLIYMGaKTMTs7W7i6umq3N0/aXjz+/QkhxM2bN4WLi4twcHAQs2fPFrt27RKrV68WI0eOFOfOnRNCCJGUlCSGDx8uli5dKvbs2SO2bdsmJk2aJFQqVYHvsaj9y6M0Go3o0KGDMDY2Fl999ZXYsWOHmDJliqhVq1aBfGfPnhXW1tYiMDBQLFmyROzYsUO89957QqVSialTpxZor8LWqcfbMj4+XqjVavHJJ5/o5MrJyRGurq7ihRde0A775ZdfxIwZM8SGDRvE/v37xeLFi0XDhg2Fr6+vyMrKEkLkbfPffvttAUCsW7dO2+bJyclCCN19qxBCTJgwQZiammp/n+/nn38WAMSpU6eEEEKkpaWJoKAgne/mhx9+ENbW1qJjx45Co9E8sZ0fVabFpBBC1KhRQ/j5+Wl/rlevnmjUqJHIzs7WGa9Xr17CxcVFW5Dlz/vVV18t8n0f3UE0btxYtGzZUme8/IY6ffp0odk0Go3Izs4W+/fvFwBEZGSk9ndvvfVWkRvIxxfeDRs2CABix44d2mH5C0n//v21w9544w1hYWEhoqOjdeb37bffCgBP3NBcvXpVGBgYFFixH3X//n3txvBRN27cEMbGxmLw4MHaYcOGDRMAxNq1a7XDsrOzhaOjowAgTpw4oR2emJgoDAwMdIry/O+gX79+Ou916NAhAUB8+eWX2mHFKSaFECIsLKxAcZivuMvNSy+9JExNTUVcXJx2nJycHFGvXr1iFRVFLdPt2rUTAMTu3bt1hn/00UcCgDh69KjO8LFjxwpFUcSFCxeEEP+/8W/YsKHOHx1z5swRAMTzzz+vM/348eMFgAIrf2GmT58uAIht27YJIfKWFUVRxNChQwv9bE8rJoUQomfPnsLT07PAe82bN08AEH/++afO8JkzZ+qsA5s3bxYAxC+//KIz3owZM4osJj///POnftacnBzx4MEDYW5uLn744Qft8Gf93mvXri1q164t0tPTixynefPmwsnJSaSmpuq8R0BAgHB3d9duaPPb+e2339aZvm/fvgKAmD17ts7woKAg0bhxY+3P+cuKq6urTp6UlBRhZ2cnnnvuuSIz5uTkiKysLOHj4yMmTJigHZ7/Hbdt21Zn/LS0NGFnZ1fgD5fc3FzRsGFD0bRpU+2wZs2aFZmpOMch3N3dxciRI4UQeYWKubm5tpjO3yZ+9dVXwsjISDx48EA73ePLy5o1awosr/ny19PH10d/f3/RtWvXp2Y0NzcvdFuV/52++eabOsP/85//CADi9u3bQoi8ba2hoWGB7z41NVU4OzuLgQMHPjXDo3JyckR2drbo1KmTzrY2fxkJDAwUOTk52uHHjh0TAMTKlSufOM/C1qHCtgNTpkwRarVa3LlzRzts9erVAoDYv3+/dlhR2wshCn5/I0eOFEZGRiIqKqo4TaDNnJ2dLUaNGiUaNWqk87viFJNbt24VAHQ+rxB5y9vj+bp27Src3d0LbHvHjRsnTExMxL1794QQRa9Tj/7u0bZ84YUXhLu7u872f8uWLQKA2LhxY6G582uU6OhoAUD8888/2t/NmjWryG3b4/vWU6dOCQBi/vz5OuM1bdpUBAcHa3+eMWOGUKlUBfZ/f/31V4E/8p6mzLsGEo+cart8+TLOnz+PIUOGAABycnK0rx49euD27du4cOGCzvT9+/cv1vuMGDEChw8f1pl+4cKFaNKkic7dfVevXsXgwYPh7OwMAwMDGBkZoV27dgBQ4FRwcXXv3h3Ozs5YuHChdtj27dsRGxurPRUKAJs2bUKHDh3g6uqq89m7d+8OANi/f3+R77Fz507k5ubqnBJ6XGhoKNLT0wucUvbw8EDHjh0LnLZSFAU9evTQ/mxoaIg6derAxcVF57pQOzs7ODk5FXpaJP+7zNeyZUt4enpi7969ReYsqZIsN3v37kWnTp10rtE1MDDASy+99Mw5bG1t0bFjR51he/bsgb+/f4HrK4cPHw4hBPbs2aMzvEePHlCp/n818/PzA5B3U9mj8offuHHjiZmEENpT2507dwaQd9qjffv2WLt2baGXfjyLPXv2wNzcHAMGDNAZnr/M5S9j+cvywIEDdcYbNGhQkfMubF1/8OABPvzwQ9SpUweGhoYwNDSEhYUF0tLSdNbXZ/neL168iCtXrmDUqFEwMTEpdJy0tDQcPXoUAwYMgIWFhc57DB06FDdv3iyw7Xr8rvonfdeFrVsvvPCCTh5LS0v07t0b//77L3JzcwHkrQtff/01/P39oVarYWhoCLVajUuXLhW6PXu8jQ8fPox79+5h2LBhOuuVRqNBt27dEBYWhrS0NKSlpSEsLKzITMXRqVMn7Q2Zhw8fxsOHDzFx4kQ4ODhg586dAPJOt+efHi4tZ2fnAutjgwYNnnpatzief/75AvMFoJ339u3bkZOTg1dffVWnPU1MTNCuXbti3d07b948NG7cGCYmJjA0NISRkRF2795d6PfZs2dPGBgYFJkHKP46VJixY8cCABYsWKAd9t///heBgYFo27btUz9LYbZu3YoOHTpo14eirFmzBq1atYKFhYW2HX7//fdS7afz90eP768GDx6s83NGRgZ2796Nfv36wczMrMC+JiMjo8BlBCWpUW7evKlzU/LChQvh7OysrQEA4O7duxgzZgw8PDy0n9vT0xNA6WuUwMBABAcH69Qo586dw7FjxwrUKAEBAQgKCtL57F27di3x3ellWkympaUhMTERrq6uAKC9HmLSpEkwMjLSeb355psAoHNdAIBi37E9ZMgQGBsba6+diYqKQlhYGEaMGKEd58GDB2jTpg2OHj2KL7/8Evv27UNYWBjWrVsHIO8Gn9IwNDTE0KFDsX79eu2dVYsWLYKLiwu6du2qHe/OnTvYuHFjgc9ev379Qj/7o+Lj4wEA7u7uRY6TmJgIoPA2c3V11f4+n5mZWYGdp1qthp2dXYHp1Wo1MjIyCgx3dnYudNjj7/UsSrLcJCYmFpnpWRXWromJiUW2d/7vH/V426rV6icOL6zNH7Vnzx5cu3YNL774IlJSUpCUlISkpCQMHDgQDx8+xMqVK5/yqUomv30f7wrGyckJhoaG2s+bmJgIQ0PDAp/rSTfiFdaOgwcPxn//+1+MHj0a27dvx7FjxxAWFgZHR0ed9fVZvvfirFv379+HEKLcvuuSrFtZWVl48OABgLzuoD777DP07dsXGzduxNGjRxEWFoaGDRsWuj17PH/+ujVgwIAC69bMmTMhhMC9e/dw//59aDSaZ1q3nnvuOdy4cQOXLl3Crl270KhRI+01gbt27UJ6ejoOHz6M5557rljzK4q9vX2BYcbGxqXevj9p3sbGxgD+f9+R355NmjQp0J6rV69+4jYeAGbPno2xY8eiWbNmWLt2LY4cOYKwsDB069at0PxPywMUfx0qTI0aNfDSSy/h119/RW5uLk6dOoUDBw5g3LhxT5zuSeLj45+4rgHAunXrMHDgQLi5uWHZsmUIDQ1FWFgYRo4c+dRtYmHyt0ePt9fjy25iYiJycnLw008/Ffj+8g+8lLZG6d69O1xcXLQF3f3797Fhwwa8+uqr2j8INBoNunTpgnXr1uGDDz7A7t27cezYMW0B+yzL8MiRIxEaGorz588DyCtkjY2Ndf7Av3PnDk6dOlXgs1taWkII8dTl91Flelvf5s2bkZubq70Q1MHBAQAwefJkvPDCC4VO4+vrq/Nzcfsvs7W1RZ8+fbBkyRJ8+eWXWLhwIUxMTHQaas+ePYiNjcW+ffu0RyMBlEk/giNGjMCsWbOwatUqvPTSS9iwYQPGjx+v81ejg4MDGjRogK+++qrQeeTvlAqTf/f6zZs34eHhUeg4+SvK7du3C/wuNjZW2/5lKS4urtBhderU0f5sYmJS4OYMIG+lLE6mkiw39vb2RWZ6VoUti/b29kW2N4ByafNH5d98NXv2bMyePbvQ37/xxhsAoP3D4fHvoiQbCHt7exw9ehRCCJ32uHv3LnJycrSf197eHjk5Obh3755O8fSk7+Hx9k1OTsamTZswZcoUfPTRR9rhmZmZuHfvXoFcpf3eH123imJrawuVSlWh33VRn0etVmuPji5btgyvvvoqvv76a53xEhISYGNjU2D6x9s4P/NPP/1U5N2n+TcwKoryTOtWp06dAOQdfdy5c6f2SHqnTp3w6aef4t9//0VmZuYzF5My5bfnX3/9pT2aVBLLli1D+/bt8csvv+gMT01NLVWekqxDRXn33XexdOlS/PPPP9i2bRtsbGwKHOErCUdHxyeua0BeO3h7e2P16tU6y2xh+5HiyN8eJSYm6hSUjy+7tra22rMNRZ0F9Pb21vm5uDVK/nx//PFHJCUlYcWKFcjMzNQ54HXmzBlERkZi0aJFGDZsmHZ4YTfulNSgQYMwceJELFq0CF999RWWLl2Kvn37wtbWVjuOg4MDTE1N8ccffxQ6j5Js48rsyOSNGzcwadIkWFtba3dmvr6+8PHxQWRkJEJCQgp9PUuffiNGjEBsbCy2bNmCZcuWoV+/fjob1PwvPf+vt3yP323+6DjF/UvAz88PzZo1w8KFCwtdSIC8015nzpxB7dq1C/3sTyomu3TpAgMDgwIbmUe1aNECpqam2v4G8928eRN79uzRbszL0vLly3V+Pnz4MKKjo3XugvTy8sKpU6d0xrt48WKB04JFtXlJlpsOHTpg9+7d2iMEAJCbm4vVq1c/82ctTKdOnRAVFYUTJ07oDF+yZAkURUGHDh3K5X2BvL9s169fj1atWmHv3r0FXkOGDEFYWBjOnDkDIO97AFDgu9iwYUOBeRd1JKdTp0548OBBgb74lixZov09AO0fa4+3+6pVq4r9+RRFgRCiwPr622+/aU/z5nuW771u3bqoXbs2/vjjjyJ3Vubm5mjWrBnWrVun0y4ajQbLli2Du7s76tatW+zPVhzr1q3TOQqTmpqKjRs3ok2bNto/UhVFKdA+mzdvLnY/o61atYKNjQ2ioqKKXLfUajXMzc3RtGnTIjMVh4uLC/z9/bF27VocP35cW0x27twZ8fHxmD17NqysrLS9OhSlpNvmknjWI5hdu3aFoaEhrly5UmR7Pklh3+epU6cKvaO6OEqyDhUlODgYLVu2xMyZM7F8+XIMHz68wGUIJWm37t27Y+/evQW2/4/nzn9oRL64uLhS382dvx1+fH+1YsUKnZ/NzMzQoUMHnDx5Eg0aNCj0+yvsyHdxjRgxAhkZGVi5ciUWLVqEFi1aoF69etrfl2eNYmtri759+2LJkiXYtGkT4uLidE5xA3k1ypUrV2Bvb1/oZ8/fhxRHqY5MnjlzRntu/e7duzhw4AAWLlwIAwMDrF+/XqdPyF9//RXdu3dH165dMXz4cLi5ueHevXs4d+4cTpw4gTVr1pQmAoC8gsvd3R1vvvkm4uLiChRzLVu2hK2tLcaMGYMpU6bAyMgIy5cvR2RkZIF5BQYGAgBmzpyJ7t27w8DAAA0aNNCeqirMyJEj8cYbbyA2NhYtW7YscJR1+vTp2LlzJ1q2bIl33nkHvr6+yMjIwPXr17FlyxbMmzevyMP/Xl5e+Pjjj/HFF18gPT0dgwYNgrW1NaKiopCQkIBp06bBxsYGn332GT7++GO8+uqrGDRoEBITEzFt2jSYmJhgypQpJW3SpwoPD8fo0aPx4osvIiYmBp988gnc3Ny0p58BYOjQoXjllVfw5ptvon///oiOjsZ//vOfAn2F1q5dG6ampli+fDn8/PxgYWEBV1dXuLq6Fnu5+fTTT7FhwwZ07NgRn3/+OczMzDB37tySd2tQTBMmTMCSJUvQs2dPTJ8+HZ6enti8eTN+/vlnjB07tswLjEctX74cGRkZeOeddwp92oG9vT2WL1+O33//Hd9//z2aNGkCX19fTJo0CTk5ObC1tcX69etx8ODBAtMGBgZi3bp1+OWXXxAcHAyVSoWQkBC8+uqrmDt3LoYNG4br168jMDAQBw8exNdff40ePXpojyp169YNrVq1wnvvvYeUlBQEBwcjNDRUW3Q+et1oUaysrNC2bVvMmjULDg4O8PLywv79+/H7778XOOr2rN/73Llz0bt3bzRv3hwTJkxAzZo1cePGDWzfvl27A5oxYwY6d+6MDh06YNKkSVCr1fj5559x5swZrFy5ssyfAmNgYIDOnTtj4sSJ0Gg0mDlzJlJSUnQeptCrVy8sWrQI9erVQ4MGDXD8+HHMmjXrqacR81lYWOCnn37CsGHDcO/ePQwYMABOTk6Ij49HZGQk4uPjtX/AfvHFF+jWrRs6d+6M9957D7m5uZg5cybMzc2LfZSrU6dO+Omnn2BqaopWrVoByDvS4+3tjR07duD5559/ar+X+dfAz58/H5aWljAxMYG3t/cz7eTzBQYGYt++fdi4cSNcXFxgaWlZYDv+JF5eXpg+fTo++eQTXL16Fd26dYOtrS3u3LmDY8eOwdzcvMiHYQB53+cXX3yBKVOmoF27drhw4QKmT58Ob2/vYncf96iSrENP8u677+Kll16Coig62/Z8RW0vCjN9+nRs3boVbdu2xccff4zAwEAkJSVh27ZtmDhxIurVq4devXph3bp1ePPNNzFgwADExMTgiy++gIuLCy5dulTidujSpQvatm2LDz74AGlpaQgJCcGhQ4ewdOnSAuP+8MMPaN26Ndq0aYOxY8fCy8sLqampuHz5MjZu3FjgOviSqFevHlq0aIEZM2YgJiYG8+fPL/D72rVr46OPPoIQAnZ2dti4caP2muJH5dcoP/zwA4YNGwYjIyP4+vo+8YDcyJEjsXr1aowbNw7u7u4FzgKMHz8ea9euRdu2bTFhwgQ0aNAAGo0GN27cwI4dO/Dee++hWbNmxfuwxb5VR/z/HW75L7VaLZycnES7du3E119/re2u4XGRkZFi4MCBwsnJSRgZGQlnZ2fRsWNHMW/evALzLuxO8aLuShVCiI8//ljbrcbjXfUIIcThw4dFixYthJmZmXB0dBSjR48WJ06cKHAXcWZmphg9erRwdHQUiqLovF9Rd48lJycLU1PTQrspyhcfHy/eeecd4e3tLYyMjISdnZ0IDg4Wn3zyic4djEVZsmSJaNKkiTAxMREWFhaiUaNGBe5+/u2330SDBg2EWq0W1tbWok+fPgXuFB82bJgwNzcvMP927dqJ+vXrFxju6ekpevbsqf05/zvYsWOHGDp0qLCxsdHeSX7p0iWdaTUajfjPf/4jatWqJUxMTERISIjYs2dPgTvOhBBi5cqVol69esLIyKjAXXbFWW6EyLujvHnz5sLY2Fg4OzuL999/X8yfP/+Z7+YurF2EECI6OloMHjxY2NvbCyMjI+Hr6ytmzZqls/zl3305a9YsnWnz7/pbs2ZNsXI8KigoSDg5OYnMzMwix2nevLlwcHDQjnPx4kXRpUsXYWVlJRwdHcXbb7+tvfP60TsP7927JwYMGCBsbGy0y3++xMREMWbMGOHi4iIMDQ2Fp6enmDx5srbrrEfnMWLECGFjYyPMzMxE586dxZEjRwrcVZl/N/ej3ZTku3nzpujfv7+wtbUVlpaWolu3buLMmTOFroPP8r0Lkdc1TPfu3YW1tbUwNjYWtWvX1rkjWgghDhw4IDp27CjMzc2FqampaN68eYE7MYv67or6nI+vi/nLysyZM8W0adOEu7u7UKvVolGjRmL79u06096/f1+MGjVKODk5CTMzM9G6dWtx4MCBAutWUctZvv3794uePXsKOzs7YWRkJNzc3ETPnj0LjL9hwwbttqVmzZrim2++0X6u4vjnn38EANG5c2ed4a+99poAIH788ccC0zy+HRAirxcEb29vYWBgoLPtLmo9HTZsWJF3Gz8qIiJCtGrVSpiZmQkA2jYs6jst7K5dIYT4+++/RYcOHYSVlZUwNjYWnp6eYsCAATpdLRUmMzNTTJo0Sbi5uQkTExPRuHFj8ffffxfIX9T2RIjCu+IpzjpU1GfJz2VsbCy6detWaO4nbS8K+/5iYmLEyJEjhbOzszAyMhKurq5i4MCBOneNf/PNN8LLy0sYGxsLPz8/sWDBgkKXteLczS1EXndDI0eO1Nke5XdZ9Xi+a9euiZEjRwo3NzdhZGQkHB0dRcuWLXV6KXnSOvWktszfJhXWVY8QQkRFRYnOnTsLS0tLYWtrK1588UVx48aNQnNOnjxZuLq6CpVKpfN+he1bhcjrpcHDw0MAKNBNUb4HDx6ITz/9VPj6+mpriMDAQDFhwgSd3jKeRhHisZ6OiQqxaNEijBgxAmFhYU89dUOUb8WKFRgyZAgOHTqEli1byo5TKV2/fh3e3t6YNWsWJk2aJDsOETZu3Ijnn38emzdv1ukBhKgolfu5WkRUZaxcuRK3bt1CYGAgVCoVjhw5glmzZqFt27YsJImqgKioKERHR2ufRvNoFzZET8JikojKhKWlJVatWoUvv/wSaWlpcHFxwfDhw/Hll1/KjkZExfDmm2/i0KFDaNy4sfYxk0TFwdPcRERERFRqZf4EHCIiIiLSHywmiYiIiKjUWEwSERERUanxBpwyoNFoEBsbC0tLS16wTEREVEUIIZCamgpXV9diPVyBCsdisgzExsYW+fxsIiIiqtxiYmKK/SQpKojFZBnIf5xRTEwMrKysJKchIiKi4khJSYGHh8cTH0tIT8disgzkn9q2srJiMUlERFTF8BK1Z8MLBIiIiIio1FhMEhEREVGpsZgkIiIiolLjNZMVRKPRICsrS3YMKiEjIyMYGBjIjkFERFRpsZisAFlZWbh27Ro0Go3sKFQKNjY2cHZ25gXaREREhWAxWc6EELh9+zYMDAzg4eHBTlGrECEEHj58iLt37wIAXFxcJCciIiKqfFhMlrOcnBw8fPgQrq6uMDMzkx2HSsjU1BQAcPfuXTg5OfGUNxER0WN4mKyc5ebmAgDUarXkJFRa+X8EZGdnS05CRERU+bCYrCC83q7q4ndHRERUNBaTRERERFRqLCZJ712/fh2KoiAiIkJ2FCIioipH74vJnJwcfPrpp/D29oapqSlq1aqF6dOnsxufMrBo0SLY2NjIjkFERETlSO/v5p45cybmzZuHxYsXo379+ggPD8eIESNgbW2Nd999V3Y8Kqbs7GwYGRnJjkFEJIXQaJByPx6ZGQ+hMjCEla0j1MYmsmORntD7I5OhoaHo06cPevbsCS8vLwwYMABdunRBeHi47GjSbdu2Da1bt4aNjQ3s7e3Rq1cvXLlyBQCwb98+KIqCpKQk7fgRERFQFAXXr1/Hvn37MGLECCQnJ0NRFCiKgqlTpwIA7t+/j1dffRW2trYwMzND9+7dcenSJZ33XrBgATw8PGBmZoZ+/fph9uzZOkc5p06diqCgIPzxxx+oVasWjI2NIYR4YuZ8x44dQ6NGjWBiYoKQkBCcPHmyXNqPiKi8JN65iWNrv0fY9y/h+vRAZE9zgPVPdeG0IAgO8wJg+LUz4qd6IfKb5xC68ENcjjwEwTNuVE70/shk69atMW/ePFy8eBF169ZFZGQkDh48iDlz5hQ5TWZmJjIzM7U/p6SkFPv9hBBIz859lsilZmpkUKI7k9PS0jBx4kQEBgYiLS0Nn3/+Ofr161esawtbtmyJOXPm4PPPP8eFCxcAABYWFgCA4cOH49KlS9iwYQOsrKzw4YcfokePHoiKioKRkREOHTqEMWPGYObMmXj++eexa9cufPbZZwXe4/Lly/jzzz+xdu1abf+PT8qsUqmQlpaGXr16oWPHjli2bBmuXbvGI9BEVCXk5uQgcvdKqE/8Br+MSDRVxP//8n+b9hyhgqGigUoRcMR9OGaEAdFhQPQ83PzbGTfrDIZ/z3GwsrGX8yGoWtL7YvLDDz9EcnIy6tWrBwMDA+Tm5uKrr77CoEGDipxmxowZmDZtWqneLz07F/6fby9t3GcSNb0rzNTF/8r79++v8/Pvv/8OJycnREVFPXVatVoNa2trKIoCZ2dn7fD8IvLQoUNo2bIlAGD58uXw8PDA33//jRdffBE//fQTunfvjkmTJgEA6tati8OHD2PTpk0675GVlYWlS5fC0dGxWJkDAgKwfPly5Obm4o8//oCZmRnq16+PmzdvYuzYscVuFyKiiiQ0GhzfvADOJ75HY3E7b6ACXDL0QYJLO5h6NUGNOo1gV8MDxiZmEBoN7ifcRvyNC0i6fBTqmIOo9+AY3BEH90uzkfb9zwitORQNX/oMZhbWcj8cVQt6X0yuXr0ay5Ytw4oVK1C/fn1ERERg/PjxcHV1xbBhwwqdZvLkyZg4caL255SUFHh4eFRU5Apz5coVfPbZZzhy5AgSEhK0NyXduHGj1E/zOXfuHAwNDdGsWTPtMHt7e/j6+uLcuXMAgAsXLqBfv3460zVt2rRAMenp6alTSD4tc0BAAM6dO4eGDRvq5G/RokWpPgsRUXm7FHEAmk2TEJJzHgCQDHNEuQ6AZ+c34eNdDz6FTKOoVLBzcoOdkxsQ0hEA8PBBMo5t/wNOZ3+HlyYGLWIW4O63a3Gu6acI7jGqAj8RVUd6X0y+//77+Oijj/Dyyy8DAAIDAxEdHY0ZM2YUWUwaGxvD2Ni4VO9namSAqOldS533WZgalexRgL1794aHhwcWLFgAV1dXaDQaBAQEICsrS3vKWoj/P81SnCfEPDr+48PzT8E/+v8nTWdubl6izE96fyKiyiQ7KxPhyz5Fk+jfYKho8FAYI9J7JBr0/wgtLG1KPD8zC2s07T8Bot+7OL5tMVzCvoaruAunYxMRfn4LfIbPg7Wd49NnRFQIvS8mHz58CJVK9z4kAwODcusaSFGUEp1qliUxMRHnzp3Dr7/+ijZt2gAADh48qP19/hHB27dvw9bWFgAKXEupVqu1j5PM5+/vj5ycHBw9elR7mjsxMREXL16En58fAKBevXo4duyYznTFuSHqaZnz33/p0qVIT0/XPnf7yJEjT503EVFFuXvrGu4vfBktcs4DCnDcoj1qDv4BLVy9nnneikqF4B4jkNFhIEJXfI4mN/5ASMouxP3YAgkvLEHtBi2f/QOQ3tH7u7l79+6Nr776Cps3b8b169exfv16zJ49u8BpVn1ja2sLe3t7zJ8/H5cvX8aePXt0Tu3XqVMHHh4emDp1Ki5evIjNmzfju+++05mHl5cXHjx4gN27dyMhIQEPHz6Ej48P+vTpg9deew0HDx5EZGQkXnnlFbi5uaFPnz4AgLfffhtbtmzB7NmzcenSJfz666/YunXrU28eelpmABg8eDBUKhVGjRqFqKgobNmyBd9++20ZtRoR0bM5H7YLqgXt4ZtzHikwQ3jILARP+geOZVBIPsrE1BwtRn2HK73X4qbiDGfEw2VtX5zcvrhM34f0hNBzKSkp4t133xU1a9YUJiYmolatWuKTTz4RmZmZxZ5HcnKyACCSk5ML/C49PV1ERUWJ9PT0soxdIXbu3Cn8/PyEsbGxaNCggdi3b58AINavXy+EEOLgwYMiMDBQmJiYiDZt2og1a9YIAOLatWvaeYwZM0bY29sLAGLKlClCCCHu3bsnhg4dKqytrYWpqano2rWruHjxos57z58/X7i5uQlTU1PRt29f8eWXXwpnZ2ft76dMmSIaNmxY4sxCCBEaGioaNmwo1Gq1CAoKEmvXrhUAxMmTJwtth6r8HRJR1RG++Q+R+bmdEFOsxNVpDcTNK1EV8r5JiXdF5IwOQkyxEmKKlQhd8VWFvG9l8KT9NxWfIgQvIntWKSkpsLa2RnJyMqysrHR+l5GRgWvXrsHb2xsmJuxAtrRee+01nD9/HgcOHKjw9+Z3SETlLWzdD2gcOQUGisBJs1aoO3YFzEtxbWRp5WRn4fj8sWgW/xcAINT7LbQY9nWFvb8sT9p/U/Hp/Wluqpy+/fZbREZG4vLly/jpp5+wePHiIm+IIiKqyo6s+BJNTn0OA0XgmG0vNJi4oUILSQAwNFKj6dgFCPV4DQDQ4tpchC78sEIzUNXFYpIqpWPHjqFz584IDAzEvHnz8OOPP2L06NGyYxERlamja75F84uzAABHagxCk7eXwsBQzk2aikqFFqO+xZHaeQ9yaBE9D0dXfyMlC1Utlf+2YtJLf/75p+wIRETl6viWhWhy5ktAAUJdX0Xz0T9AUck/xtN86HSE/pGOFjfmo0nUNwjfZIeQXq/LjkWVmPylloiISM+c/nc9Ao++B5UicNS+T6UpJPM1Hz4TRx36Q6UINAibjPNhu2RHokqs8iy5REREeiD6/Al47R4LtZKL45YdEDL2j0pVSAJ5p7ybjF2AE+ZtoFZy4Lh5JOJuXJIdiyqpyrX0EhERVWPJiXdgsHoQLJV0RKkDEThulbRrJJ9GZWCAemOX44qBN+yRjLTFLyLj4QPZsagSYjFJRERUAbKzMhEzfyDcRRxiFSc4j14NtXHl7m7MzMIa5sPWIBHWqJ17DZG/jZUdiSohFpNEREQV4PgfExCQGYGHwhgZ/ZfBzslNdqRica7pg9iOP0EjFDS7twHhmxfIjkSVDItJIiKicha5ZxWaxy0HAFxoOQu1AppJTlQygW374KjHCACA37FPEXP5tOREVJmwmCSp2rdvj/Hjxz/TPK5fvw5FURAREVEmmYiIylJczGV4/vseAOCI44to1LVqPoChybCZiFIHwlzJQMbK4cjOypQdiSoJFpNUpQwfPhx9+/bVGebh4YHbt28jICBATigioiLkZGfh/pKhsMEDXDKog0ajfpQdqdQMjdRwGLYUKTCHT+5lhK+YIjsSVRIsJqnKMzAwgLOzMwwr6R2RRKS/wpdPhV92FFKFKcyGLIGxiZnsSM/Eyc0bFxt/BgAIvjYfV88clZyIKgMWk1Skbdu2oXXr1rCxsYG9vT169eqFK1euAPj/U8vr1q1Dhw4dYGZmhoYNGyI0NFQ7fWJiIgYNGgR3d3eYmZkhMDAQK1euLPL9pk+fjsDAwALDg4OD8fnnn2Pq1KlYvHgx/vnnHyiKAkVRsG/fvkJPc589exY9e/aElZUVLC0t0aZNG212IqKKcPXMUTS+Ng8AcL7RZ3CrVV9yorIR3OsNnDRrCbWSC836sTzdTSwmK5wQQFaanJcQJYqalpaGiRMnIiwsDLt374ZKpUK/fv2g0Wi043zyySeYNGkSIiIiULduXQwaNAg5OTkAgIyMDAQHB2PTpk04c+YMXn/9dQwdOhRHjxb+l+zIkSMRFRWFsLAw7bBTp07h5MmTGD58OCZNmoSBAweiW7duuH37Nm7fvo2WLVsWmM+tW7fQtm1bmJiYYM+ePTh+/DhGjhypzUVEVN6yMjMg1o+BWsnFSbOWCHm++nSpo6hU8Hj1VyTBAnVyr/B0N/HZ3BUu+yHwtauc9/44FlCbF3v0/v376/z8+++/w8nJCVFRUbCwsAAATJo0CT179gQATJs2DfXr18fly5dRr149uLm5YdKkSdrp3377bWzbtg1r1qxBs2YF72R0d3dH165dsXDhQjRp0gQAsHDhQrRr1w61atUCAJiamiIzMxPOzs5F5p47dy6sra2xatUqGBkZAQDq1q1b7M9NRPSsji/7BC1yryIJFvB49ddK94SbZ+XgXBPhjT9FyImP0Ojab4i9Nhyu3vVkxyJJqtfSTWXqypUrGDx4MGrVqgUrKyt4e3sDAG7cuKEdp0GDBtr/u7i4AADu3r0LAMjNzcVXX32FBg0awN7eHhYWFtixY4fO9I977bXXsHLlSmRkZCA7OxvLly/HyJEjS5Q7IiICbdq00RaSREQV6cqpw2hy44+8/zeZBgfnmpITlY/gXm/grLohTJRsxP/5DsQjZ61Iv/DIZEUzMss7QijrvUugd+/e8PDwwIIFC+Dq6gqNRoOAgABkZWX9/ywfKdgURQEA7Wnw7777Dt9//z3mzJmDwMBAmJubY/z48TrTF/aexsbGWL9+PYyNjZGZmVngCOnTmJqalmh8IqKykpuTg9wN78JQ0eCERVsE9xwtO1K5UVQqWLwwB1krn0PD9KM4uWsFGnV5RXYskoDFZEVTlBKdapYlMTER586dw6+//oo2bdoAAA4ePFiieRw4cAB9+vTBK6/kbVw0Gg0uXboEPz+/IqcxNDTEsGHDsHDhQhgbG+Pll1+Gmdn/F8FqtRq5ublPfN8GDRpg8eLFyM7O5tFJIqpQ4etmo1nORaQKU9Qc/F/ZccqdZ73GCHV7BS1iF8Pl8BQ8bNkbZhbWsmNRBeNpbiqUra0t7O3tMX/+fFy+fBl79uzBxIkTSzSPOnXqYOfOnTh8+DDOnTuHN954A3FxcU+dbvTo0dizZw+2bt1a4BS3l5cXTp06hQsXLiAhIQHZ2dkFph83bhxSUlLw8ssvIzw8HJcuXcLSpUtx4cKFEuUnIiqJhLgb8Iv6HgAQ5T8eDq6ekhNVjKAhX+E2HOGMBET++aXsOCQBi0kqlEqlwqpVq3D8+HEEBARgwoQJmDVrVonm8dlnn6Fx48bo2rUr2rdvD2dn5wIdjhfGx8cHLVu2hK+vb4EbdV577TX4+voiJCQEjo6OOHToUIHp7e3tsWfPHjx48ADt2rVDcHAwFixYwKOURFSuri8fDys8xCVDH4T0n/T0CaoJU3NLxDb9BADQMHox7t66JjkRVTRFiBL2F0MFpKSkwNraGsnJybCystL5XUZGBq5duwZvb2+YmJhISli1CCFQr149vPHGGyU+Gloe+B0S0dOc/vcfBO55FblCwdV+G+ET1EZ2pAolNBpcmNEK9bKjEGbTHU3Gr5IdqVietP+m4uORSapU7t69i9mzZ+PWrVsYMWKE7DhERE+Vk50Fy32fAgDCnfrrXSEJ5N2Mo3T9CgAQfH8bLkcWPGtE1ReLSapUatSogW+++Qbz58+Hra2t7DhERE91fP0ceGlu4D4sUW/QN7LjSOMb0hHhVs9BpQhkbp7MroL0CItJqlSEEIiPj8fgwYNlRyEieqrk+wmoG/UjAOCi3zhY2zlKTiSX+4BvkCmMUD8rEmcO/iM7DlUQFpNERESldG7VJ7BFKq6rPBD8gvxrvGVzrumDkzX6AQCM//2aRyf1BIvJCsL7nKoufndEVJiYS5EIjlsDAEhpOw2GRmrJiSqHOi98jofCGHVzLiJyd9W4EYeeDYvJcmZgYAAAT3zqC1VuDx8+BAB2LUREOhLWT4aRkotI06Zo0L5kT+qqzhycPRDp9jIAwCp0JjRPedAEVX18Ak45MzQ0hJmZGeLj42FkZASVivV7VSGEwMOHD3H37l3Y2Nho/zAgIroQvgeNHh5CrlBg87z+3nRTFP/+nyD1xz9RS3Md4dv+QEjP12RHonLEYrKcKYoCFxcXXLt2DdHR0bLjUCnY2NjA2dlZdgwiqiSERoOcHVMBACdsu6GJX7DcQJWQtX0NhHoNQ4voeagRPhs5XYbxMoBqjMVkBVCr1fDx8Snxqe7zR7Yi895NiMwHQGYKoMkBFBWEygBQW8LQ3B5GVo6wdasDBxdvGBjy6yxrRkZGPCJJRDrOHPwHgVmRyBKGcO83TXacSiuw/0e4P3s5PEQswrcvQkiv12VHonLC6qOCqFSqEj89RX3oWwRlnynWuJnCCDcMPZFo1whG3q1Qq0k32Dq6lCYqEREVQWg0MPk3r3PuEzVeQHNPX8mJKi8LK1uEeg5Bi+h5sD/xX2i6j4KKf5xXSywmK7HkGk1x4r4dcowsoDG2hjBQAyIXiiYHBhlJUGcmwiorHq65t2CsZMMn9zJ84i8D8WuQe1TBWeMApHp1RZ32r8LB1VP2xyEiqvJO7liCxjmX8FAYw6f/FNlxKj3/vu8jdc5ieGuicXL3SjTq8orsSFQO+GzuMiD72Z65OTmIu3EBcedCkXPtMJzuHYe35rr29zlChdPmzaE0fhUNOgzkX4ZERKWQk52F2BlBqKm5hSPuo9B89GzZkaqE0PnvoEXsYlw0rAufj49CqUQ3osref1cXlecblejWrVt45ZVXYG9vDzMzMwQFBeH48eOyYxWbgaEh3GrVR3DP0Wg27g94fx6J2OHHcKTu+zhv6AdDRYNGDw8j6OAYxHzVAMfW/4SszAzZsYmIqpSTmxegpuYW7sMS/gM+kR2nyqjb5wOkCzXq5lzEmYMbZcehcqD3xeT9+/fRqlUrGBkZYevWrYiKisJ3330HGxsb2dGeiauXL5oP/hT1Pj2C6Jf34ojzEKTAHJ6am2ga+Snuz/BH2LofkJuTIzsqEVGll5uTA+fI/wIAznsPg5WNveREVYd9DXdEOvUBAKgOfis5DZUHvT/N/dFHH+HQoUM4cOBAqedRVQ6Tpybfw9kNc1DnymI4IAkAcFXlhbT20xHYto/ccERElVj4xl8RcvwDJMEChhPPwMLKVnakKiUu5jLsfmsKtZKL873WoV5IJ9mRAFSd/Xdlp/dHJjds2ICQkBC8+OKLcHJyQqNGjbBgwYInTpOZmYmUlBSdV1VgaW2H5kOnw+LDKBzxmYgUmKOW5joC97yKE7N6IyHuhuyIRESVTm5ODhxP/gQAOOc1lIVkKTh71EGEbVcAwMN9c+SGoTKn98Xk1atX8csvv8DHxwfbt2/HmDFj8M4772DJkiVFTjNjxgxYW1trXx4eHhWY+NmZmJqj+ZAp0Iw7gSNOA5EtDNA47V8YzWuOY+t/gtBoZEckIqo0InYshqcmBikwR0C/D2THqbIcu0wEADRMPYDYa+clp6GypPenudVqNUJCQnD48GHtsHfeeQdhYWEIDQ0tdJrMzExkZmZqf05JSYGHh0eVPUx+5dRhiH/GoU7uFQBApGlTeIxYBDsnN8nJiIjk0uTmIvqrRvDWRCO05htoMfI/siNVaae+6YgGGcdxxGkgmr/55LOAFYGnucuG3h+ZdHFxgb+/v84wPz8/3LhR9ClfY2NjWFlZ6byqstoNWsLroyM4UvtdZAojNEw/htyfW+HMId51R0T6LXLXMnhropEqTOHPo5LPrvlbAIDAOxuQfD9BchgqK3pfTLZq1QoXLlzQGXbx4kV4eupXJ9+GRmo0HzodsQM3I1rlAUfch/+OoQj9431ocnNlxyMiqnBCo4HVsTkAgLMeg2Ft6yA3UDUQ2LYfrqtqwlzJwLlNP8qOQ2VE74vJCRMm4MiRI/j6669x+fJlrFixAvPnz8dbb70lO5oU3vWbwXHiIRyz6QGVItDixnxEzn4eaalJsqMREVWoMwf+Ru3cq3gojFGvL49KlgVFpUJ8wGgAgPeVZcjOynzKFFQV6H0x2aRJE6xfvx4rV65EQEAAvvjiC8yZMwdDhgyRHU0aMwtrNB2/EscafoksYYhGaQdx5/t2iL1+4ekTExFVE8rhHwAAp2r0hY2Ds+Q01Udg99FIhDVqIBGROxbLjkNlQO+LSQDo1asXTp8+jYyMDJw7dw6vvfaa7EiVQtN+b+Nqz1VIgA1qaa7DZNFzuHTyX9mxiIjK3aWT/yIgMwI5QgWvXu/LjlOtmJia42LNlwAA5pELJaehssBikp6oXtPOyBm1G1cMasEOKXD9+0Wc/vcf2bGIiMpVyu7vAAAR1p3gXNNHcprqx6fbOGQLA/hlR+HKqcNPn4AqNRaT9FTOHnXg9M5unDEOgrmSAd/dI3B882+yYxERlYtbV88iKHU/AMC+K49KlgcHV0+csmwDAEjcO1dyGnpWLCapWCyt7eAzYStOWLSDWslFo2OTELbuB9mxiIjK3M3N/4GBIhBp0gTe9ZvJjlNtmbYaAwAIvLcDyffiJaehZ8FikorN2MQMDcevw1H7vlApAsGRU1hQElG1knjnJhombAYAGLaZIDlN9ebXrCuuqTxhqmTh3NZfZMehZ8BikkrEwNAQTd9aiKMO/aFSBJqc+hzH1s6RHYuIqExc3PgdTJRsXDSsC/8W3WXHqdYUlQp36w0FALhfXsE+jaswFpNUYopKhaZv/oajjgMAAE1PT0HY37zmhYiqtvS0VPjfXA0AeBDyFhQVd5HlLaD7a0gVpnAXt3HmwN+y41ApcU2hUlFUKjQdu0BbUDY6+Skidq2UnIqIqPRObfkV1khDrFIDDZ97RXYcvWBuaYMop54AAM0x+c/qptJhMUmlpqhUaDJmPsKsu8JQ0aDegbcRFbpVdiwiohITGg1qnFsEALhR5xUYGBrKDaRHnJ97GwDQIO0I4mIuS05DpcFikp6JysAAQW8tRYRZC5go2fDYNoJ9hhFRlXPm4D/w0sQgTZjAv6d+Pk5XFk/fIJxVB0KlCFzbOV92HCoFFpP0zIzUxqg37i9EGQXAUkmH9bpBuB3NRy8SUdWhCc27m/iMY09Y2dhLTqN/0gPyLivwvrEOuTk5ktNQSbGYpDJhYmYB97c24KrKCw5IQsbigXiQcl92LCKip4q5FImG6UcBAK7d2B2QDAHPvYIUmMMZ8Th7kE9Zq2pYTFKZsbKxh9mItUiADbw113Hll5f4FyYRVXqx2/P6y400bQaPOoGS0+gnEzMLnHPM64opJ3yR3DBUYiwmqUw5e9TBvecXI0MYoWH6UYTNHys7EhFRkVKSEhEQn9dJuaoFt1cyObZ7HQAQkHoIiXduSk5DJcFikspc3cbtEdV8FgCg+d0/cXTNt5ITEREVLmrzXJgrGbiu8kBA6z6y4+i1WgHNcNGwLtRKLi7tZDdBVQmLSSoXjbuPwBGvvDsiG535GufDd0tORESkKzcnBzUvLwMA3PEbzk7KK4GkeoMAAK5X10BoNJLTUHFxzaFy0+zVL3HCoi3USi7sNo1GQlyM7EhERFqn9qyCq7iDZJijQY83ZMchAP5dRuChMEZNzS2cO7ZDdhwqJhaTVG4UlQp1X1+CaJU7nHAPd/4YhJzsLNmxiIgAAIbHfwcAnHPuC1NzS8lpCAAsrGxxxu45AEBa6B+S01BxsZikcmVhZQu8tBxpwgT1s04j/Ld3ZEciIkLM5dMIzDwBjVDg0eVt2XHoEVYtRgAA6iftQ1pqktwwVCwsJqncefoG4UKLmQCA5ndW4sT2pZITEZG+u7VzLgDgtGkI3Gr5SU5Dj/IN6YQYxRVmSiaidi+XHYeKgcUkVYjG3YbjiPMQAEDt0A8Rd+OS5EREpK8yHj5AvTsbAQAiZJTkNPQ4RaXCzZrPAwBMz/0pOQ0VB4tJqjCNR8zGRcO6sEYa7i8dxusniUiK0zsWwQYPEAdHBLZ/UXYcKoRXx5EAAP+MSB58qAJYTFKFURubwHzwEjwQpvDLPouwJZNlRyIiPWR1ZgkA4LrXQBgYGkpOQ4Vx8fTFWXVDqBSBa3t+lx2HnoLFJFUot1p+ON9kOgCg6Y3fcfbwFsmJiEifXI48BN+cC8gSBqjTjU+8qcwe+g8EALhH/8M+Jys5FpNU4UJ6vY5jNj1goAg47ngLSQlxsiMRkZ64t/8XAMBpq7ZwcPaQnIaexL/TK3gojOEhYnHh+B7ZcegJWEySFAGj5+GGyg1OuIcri8fIjkNEeiAlKREBiXkdYZu2ZCfllZ25pQ3O2rQHACQfWSI3DD0Ri0mSwszCGpm95yFHqBCcuhfHN/8mOxIRVXNRW3+FmZKJ66qa8GvWVXYcKgbTkLxeQPwSdyEjPU1yGioKi0mSxqdRW4TVzLtjr3bYFCTERktORETVldBo4HxpBQDgTt3BfA53FeHfshfi4AArpOHs3lWy41ARuDaRVMGvfIXLBrVhgwe4ufR1XmRNROXiQvhueGli8FAYw6/b67LjUDGpDAwQ7T8GR3wmwiuYR5MrKxaTJJXa2AQG/X9FljBEUPoRhP3zX9mRiKgaSj2c173MGdtOsLKxl5yGSqLZwPfRfMgU2Ndwlx2FisBikqTz9m+CE7XfBAD4R3zNDmqJqEylJCWi/v28u4GtWo6UnIao+mExSZVCk8FTcN7IHxZKOu6sfJOnu4mozJzbuRBmSiaiVR7wDekkOw5RtcNikioFA0NDmA74BVnCEA3Tj+H4Ft7dTURlw+5C3o0bt2u/yBtviMoB1yqqNDx9g3DcazQAoHb4F7gff1tyIiKq6q6cOgyfnEvIEgao23m07DhE1RKLycfMmDEDiqJg/PjxsqPopeDB03BN5QlbpODysndlxyGiKi7h37yzHGcsW8POyU1yGqLqicXkI8LCwjB//nw0aNBAdhS9pTY2QVaPOdAIBU2St+P0/nWyIxFRFZXx8AH8ErYBAIyajpCchqj6YjH5Pw8ePMCQIUOwYMEC2Nrayo6j13xDOuJYjRcBAPb7PsTDB8mSExFRVXRm11JYIQ234Yj6rZ6XHYeo2mIx+T9vvfUWevbsieeee+6p42ZmZiIlJUXnRWUrcOgsxMERruIuTi2bLDsOEVVBpmeWAwCue/aHysBAchqi6ovFJIBVq1bhxIkTmDFjRrHGnzFjBqytrbUvDw+Pck6of8wtbXCn7ZcAgODbqxB97rjkRERUlcRcikT9rNPIFQq8n3tNdhyiak3vi8mYmBi8++67WLZsGUxMTIo1zeTJk5GcnKx9xcTElHNK/dSw48s4adYSRkouHqwfz74niajYbu753403Zk3g7FFHchqi6k3vi8njx4/j7t27CA4OhqGhIQwNDbF//378+OOPMDQ0RG5uboFpjI2NYWVlpfOi8lFj4BxkCCPUzzrFvieJqFiyszLhc3sDACA36FXJaYiqP70vJjt16oTTp08jIiJC+woJCcGQIUMQEREBA15nI5Wrly9Oeo0CAHiGf43U5HuSExFRZXdm3xo4IAkJsEFgh4Gy4xBVe3pfTFpaWiIgIEDnZW5uDnt7ewQEBMiORwAaD5qCGMUVjriPs8s/kh2HiCq7iLwbby4794SR2lhyGKLqT++LSar8jE3McL9d3s04IXfW4OqZo5ITEVFllXjnJgLS8rYRLu1GSU5DpB9YTBZi3759mDNnjuwY9IgG7fvjhHlbGCoaZP4zgTfjEFGhLu1eCCMlFxcN68LTL1h2HCK9wGKSqgzXl7/HQ2EMv+yzOLFtoew4RFQJOV7Je2rWfZ8BkpMQ6Q8Wk1RlOHvUQaTncACA67EZyHj4QG4gIqpUrpw6jNq5V5ElDFHvueGy4xDpDRaTVKUEvfQZ7sAeLojHyT+/lB2HiCqR+IOLAABnLFvC2r6G3DBEeoTFJFUppuaWiAn+EADQ8NofiI+9LjcQEVUK2VmZqHt3KwDAoPEQyWmI9AuLSapygnu+hguG9WCmZOL6n+wqiIiAs/vXwg4pSIAN6rd5QXYcIr3CYpKqHEWlArrlPUe9SdJWXIo4IDkREckm8vuWrNEdhkZqyWmI9AuLSaqSfEM6ItyqMwAgZ/OH7CqISI/dj7+N+g9CAQA12o6QnIZI/7CYpCrLY+DMR7oKWiw7DhFJcmHXQqiVXFw2qA3v+s1kxyHSOywmqcqq4V4bkZ7D8v4f9g2yMjMkJyIiGRwu/wUASKjDviWJZGAxSVVagxc/QQJs4C7icHL997LjEFEFu3b2KOrkXkGWMIDvczzFTSQDi0mq0swtbXDF/y0AgM/5n5GafE9yIiKqSHf+zXsa1hmLlrB1dJGchkg/sZikKq9x33cRo7jCDik4u4YdmRPpi+ysTNS5k9e3pCposOQ0RPqLxSRVeUZqY8Q3y+vIvEHMMiTERktOREQV4eyB9XBAEu7BCvXb9Zcdh0hvsZikaqFRl1e1HZlfWfuZ7DhEVAE0J/P6lrxYoweM1MaS0xDpLxaTVC0oKhVyn5sGAAhO2IgbFyPkBiKicpWSlIj6qXl9Szq0fFVyGiL9xmKSqg3/5t1w0qwlDBUNEv/5RHYcIipH5/eugLGSjWiVB2oHtpAdh0ivsZikasWu95fIFQoapR3E+WM7ZcchonJien4tACDWo2feI1aJSBqugVStePoF47hdTwBA7q7pfMwiUTWUEBsN/4wIAEDNdsOlZiEiFpNUDdXsNxVZwhD1s07h7KGNsuMQURm7vG8JDBSBC4b14FbLT3YcIr3HYpKqHeeaPjjh1A8AYLT/ax6dJKpm7K5uAAAk1ekrNwgRAWAxSdVUnf6fI12o4ZtzHpF7/5Qdh4jKSMzl06ibcxE5QoU6HYbKjkNEYDFJ1ZSDc01EuA4EAFgenglNbq7kRERUFm7+uwQAEGUaDPsa7pLTEBHAYpKqMb/+n+GBMEXt3Ks4uX2J7DhE9IyERgP3mE0AgEy/FySnIaJ8LCap2rJxcMbpmq8AABzCv0VuTo7kRET0LC5HHoSHiEW6UMOvwyDZcYjof1hMUrVWv/9kJMECnpqbOLHpV9lxiOgZJIYuAwBEWbWChZWt5DRElI/FJFVrVjb2OFdrJADALfIHZGdlSk5ERKWRm5ODOne3AwAMGr4kOQ0RPYrFJFV7DV+YhATYwFXcwYl//is7DhGVQtThzXBAEpJgAf82/WTHIaJHsJikas/MwhqXfV8HAHidnYvMjIeSExFRSaWfWAUAuGDfCWpjE8lpiOhRLCZJLwT1HY+7sEMNJCJi48+y4xBRCWSkp8Hv/l4AgGUIb7whqmxYTJJeMDE1x1Xf0QAAz7PzkJWZITkRERVX1P41sFTSEQcH1GvaRXYcInoMi0nSG0F93kUCbOCMeB6dJKpKTv8FALjm0g0qAwPJYYjocSwmSW+YmFngct28o5PuZ3/hnd1EVUDy/QQEPAgFANRo9arkNERUGBaTpFca9hn/vzu77yJi0zzZcYjoKS7uXQ61koPrqprw9m8iOw4RFULvi8kZM2agSZMmsLS0hJOTE/r27YsLFy7IjkXlxNTcEpfrjAAAuJ6ey6OTRJWc6YV1AIDbnr2hqPR+l0VUKen9mrl//3689dZbOHLkCHbu3ImcnBx06dIFaWlpsqNROWnQdwLuwQpu4g4itiyQHYeIihAfex3+GZEAAM92wySnIaKi6H0xuW3bNgwfPhz169dHw4YNsXDhQty4cQPHjx+XHY3KiZmFNS7WGg4AcIn8L3Kys+QGIqJCXdm7GCpF4JyRP1y9fGXHIaIi6H0x+bjk5GQAgJ2dXZHjZGZmIiUlRedFVUtgv/dwH5ZwF7dxcstvsuMQUSHsr24AAKTU6Ss3CBE9EYvJRwghMHHiRLRu3RoBAQFFjjdjxgxYW1trXx4eHhWYksqCuaUNznvn3RnqHPETcnNyJCciokfduBgBn9zLyBYGqNuRd3ETVWYsJh8xbtw4nDp1CitXrnzieJMnT0ZycrL2FRMTU0EJqSwF9nsfSbCAh4jFya2/y45DRI+4dWApACDKLBi2ji6S0xDRk7CY/J+3334bGzZswN69e+Hu7v7EcY2NjWFlZaXzoqrHwsoW57yGAgAcTv4ETW6u5EREBABCo4HHzU0AgGz/AZLTENHT6H0xKYTAuHHjsG7dOuzZswfe3t6yI1EFqt/3faQKU3hpYhC5+8lHpImoYlyK+BfuIg4PhTH82r8kOw4RPYXeF5NvvfUWli1bhhUrVsDS0hJxcXGIi4tDenq67GhUAaxs7HHGPW9nZX7sBwiNRnIiIroXugwAEGXdBuaWNnLDENFT6X0x+csvvyA5ORnt27eHi4uL9rV69WrZ0aiC1H3+fWQII9TNuYizhzbKjkOk13Kys1AnficAwCjoRclpiKg49L6YFEIU+ho+fLjsaFRB7Gu4I9KpT94PB2fLDUOk584d3gQHJOE+LOHfup/sOERUDHpfTBIBgGfvj5AtDBCQGYHz4btlxyHSWxkn8s4KXbTvBCO1seQ0RFQcLCaJADjX9MFJ264AgPQ930pOQ6SfMh4+gF/SfgCAVdPBktMQUXGxmCT6H+ceH0IjFDR6eBjXosJkxyHSO2f3rYGFko7bcIRvyHOy4xBRMbGYJPqfmnWDEGHZFgCQuO0byWmI9I/qzJ8AgOuu3aEyMJCchoiKi8Uk0SOsOn8IAGiUvBu3rp6TnIZIfyTfi0f9tKMAAOfWfHwiUVXCYpLoEXUatsIpkyYwUARubp4hOw6R3riwZynUSi6uqbzg7d9EdhwiKgEWk0SPMWw/CQDQKGEz4mOvyw1DpCfML64HAMR5PS85CRGVFItJosf4N++Gc0b1oVZycOUfXjtJVN7u3LwCv8zTAACvdq9ITkNEJcVikqgQWS0nAAAaxK1DcuIdyWmIqrdr+5ZApQhEGQXAxdNXdhwiKiEWk0SFaNCuP66qvGCmZOLcxh9kxyGq1hyvbQAApPr0lRuEiEqFxSRRIRSVCveCxgIAfK4vQ0Z6muRERNVT9LnjqJ17FdnCAL4dh8qOQ0SlwGKSqAgNu41AHBxhj2REbponOw5RtRR7cCkA4KxZE9g4OEtOQ0SlwWKSqAhGamNcrzsMAOAa9Rtyc3IkJyKqXoRGA8/YLQCAnIABktMQUWmxmCR6gsDebyMZ5vAQsTi1e7nsOETVyoXje+Aq7uChMIZ/u4Gy4xBRKbGYJHoCc0sbRLnl7eTMwuZCaDSSExFVH8lHVwAAoqzbwszCWnIaIiotFpNET+HT+z1kCiP45lzAuWM7ZMchqhayszLhk7ATAGDU6CXJaYjoWbCYJHoKB2cPRDj0AABk7f9echqi6uHcoY2wQwruwQr+rfjUG6KqjMUkUTG4dn8fGqEgKP0Irp8Llx2HqMrLOrkKAHDJ4TkYqY0lpyGiZ8FikqgYPOoEIsKiNQAgfvu3ktMQVW3paanwT/4XAGDdbIjkNET0rFhMEhWTeYeJAICG93fg7q1rktMQVV1n962CmZKJWKUGfIM7yo5DRM+IxSRRMfmGdESUOhBqJRdXN86SHYeoyjI8uxYAEO3aA4qKuyGiqo5rMVEJZDUbBwAIuL0OKUmJktMQVT1JCXGon3YMAODamo9PJKoOWEwSlUCD9i/iusoDFko6ojbMkR2HqMq5sHcZjJRcXDGoBU+/YNlxiKgMsJgkKgGVgQHuBr4BAKh9dSkyMx5KTkRUtVheXA8AiPfqLTkJEZUVFpNEJRTU4zXchR0ccR+ntiyQHYeoyoi7cQn+2WegEQq8OwyTHYeIykilKSaHDx+Of//9V3YMoqdSG5vgau28a70czyzgIxaJiunaviUAgHPGAajhXltyGiIqK5WmmExNTUWXLl3g4+ODr7/+Grdu3ZIdiahI/r3fxQNhCi9NDE7tXys7DlGVUOP6BgBAWt0XJCchorJUaYrJtWvX4tatWxg3bhzWrFkDLy8vdO/eHX/99Reys7NlxyPSYWVjjzPOfQAAqiNzJachqvyuRYWhluY6soQBfDuwo3Ki6qTSFJMAYG9vj3fffRcnT57EsWPHUKdOHQwdOhSurq6YMGECLl26JDsikVbN7hORKxQEZp7EldNHZMchqtTiDi4FAJw1bwZr+xqS0xBRWapUxWS+27dvY8eOHdixYwcMDAzQo0cPnD17Fv7+/vj+++9lxyMCALh6+SLCsh0A4N6u2ZLTEFVemtxceMVuyft/wADJaYiorFWaYjI7Oxtr165Fr1694OnpiTVr1mDChAm4ffs2Fi9ejB07dmDp0qWYPn267KhEWpYdJwAAGibtQnzsdblhiCqpi+G74YJ4pAkT+LcbKDsOEZUxQ9kB8rm4uECj0WDQoEE4duwYgoKCCozTtWtX2NjYVHg2oqLUbdwe57b6wy87Cpc3zYbj6z/KjkRU6SQfWw4AiLJphybmlpLTEFFZqzRHJr///nvExsZi7ty5hRaSAGBra4tr165VbDCip0gPeRMA4B/7Fx4+SJachqhyyc7KRN3E3QAA40YvSU5DROWh0hSTQ4cOhYmJibT3//nnn+Ht7Q0TExMEBwfjwIED0rJQ1dKw0yDcVJxhjTSc3vyL7DhElUrUwfWwRSoSYQ3/VnzqDVF1VGmKSZlWr16N8ePH45NPPsHJkyfRpk0bdO/eHTdu3JAdjaoAA0ND3Ko3AgDgdn4hcnNyJCciqjyyI9YAAC47doahkVpyGiIqDywmAcyePRujRo3C6NGj4efnhzlz5sDDwwO//MKjTFQ8gT3HIhnmcBdxiNy9UnYcokohLTUJ/sl5Z3lsmrFvSaLqSu+LyaysLBw/fhxdunTRGd6lSxccPny40GkyMzORkpKi8yL9ZmZhjSjXvC5PTMN/lpyGqHI4t281zJRM3FScUbdxe9lxiKic6H0xmZCQgNzcXNSooduJbo0aNRAXF1foNDNmzIC1tbX25eHhURFRqZKr02sisoQB/LKjcCF8j+w4RNIZRf0FALjp1hOKSu93N0TVFtfu/1EURednIUSBYfkmT56M5ORk7SsmJqYiIlIl5+jqhUib5wAAD/b9IDkNkVz37t5C/YfhAACXNq9KTkNE5Unvi0kHBwcYGBgUOAp59+7dAkcr8xkbG8PKykrnRQQAds9NBAAEpe5H7PULktMQyXNp7zIYKhpcNqgNT98g2XGIqBzpfTGpVqsRHByMnTt36gzfuXMnWrZsKSkVVVW1A5vjtHEjGCgCN7byEYukv6wu/w0ASPB+Xm4QIip3el9MAsDEiRPx22+/4Y8//sC5c+cwYcIE3LhxA2PGjJEdjaog0XwcACAg7h+kJCVKTkNU8WKvX4BfdhQ0QkGtDsNkxyGicsZiEsBLL72EOXPmYPr06QgKCsK///6LLVu2wNPTU3Y0qoIC272A6yoPWCjpiNrExyuS/rmxbzEAIMqkIZzcvCWnIaLyxmLyf958801cv34dmZmZOH78ONq2bSs7ElVRikqFu/VHAwC8Li9Ddlam5EREFUdoNHC5sQEAkO77guQ0RFQRWEwSlYMGPV5DIqzhjARE7lgsOw5RhblyOhSemhhkCiP4dnxFdhwiqgAsJonKgYmpOS7WfBkAYH3yVwiNRnIiooqRcHgpAOCsZQtY2dhLTkNEFYHFJFE58e31LjKEEXxyL+Pc0e2y4xCVu9ycHNS6k7esKw1ekpyGiCoKi0micmLn5IZIhx4AgMwDvBGHqr9zoZvhhHtIgTn82/J6SSJ9wWKSqBw5d8nrxLxhWihiLkVKTkNUvh4eXwUAOGfXCcYmZpLTEFFFYTFJVI48fYMQYdocKkUgdhs7MafqKyM9DX739wIALJsMlpyGiCoSi0micmbU+h0AQIOELUhKiHvK2ERVU9S+P2GppCMODqjXtIvsOERUgVhMEpUz/xbdcdmgNkyVLJzbNEd2HKJyoZxeAwC45tIDKgMDyWmIqCKxmCQqZ4pKhaSGrwMAfK6vRGbGQ8mJiMpWcuId1E87AgBwbvOq5DREVNFYTBJVgIbdRuAu7OCAJERu/V12HKIydX7PMqiVXFxVecHbv4nsOERUwVhMElUAI7UxrtbKexqI4+nf2Ik5VSuWl9YDAO56PS85CRHJwGKSqIL49XoHD4UxvDXXcebgP7LjEJWJuBuX4J91GhqhwKvDMNlxiEgCFpNEFcTazhGnnXoDAMThuZLTEJWNa3sXAQDOGQfC2aOO3DBEJAWLSaIK5N59EjRCQYOMMFw/Fy47DtEzc47eCABI8+UTb4j0FYtJogrkVssPERatAQB3d7ATc6rarp45Cm9NNLKEIXw7DpUdh4gkYTFJVMHM2r0LAAi6tx0JcTGS0xCV3p1DSwAAZyxawNrWQXIaIpKFxSRRBfMN6YQLhr5QKzm4tHmO7DhEpaLJzUWt21sBAEqDFyWnISKZWEwSVTBFpcKDxmMBAPVi/kTGwweSExGV3Lkj21ADiUiBGfzaDpAdh4gkYjFJJEHDzkNwG46wRQoiN/8qOw5RiaWFrwAAnLftCBNTc8lpiEgmFpNEEhgaqRFdN69PPudzf0CTmys5EVHxZWY8RL37ewEA5iGDJachItlYTBJJUr/nW0gVpvDU3MTp/WtkxyEqtrP7/oQV0nAH9vBr3k12HCKSjMUkkSSW1nY465LXN5/B0V8kpyEqPtWpVQCAq669oDIwkJyGiGRjMUkkkVePCcgRKgRkRuDKqcOy4xA9VeKdm6ifdgwA4Np2uNwwRFQpsJgkksi5pg8irDoAAO7t/l5yGqKnu7RnMYyUXFw0rAvPeo1lxyGiSoDFJJFk1h3HAwCCknbj7q1rcsMQPYX95XUAgPt1+PhEIsrDYpJIMp9GbRGlDoSRkosrm/mIRaq8rp8Lh0/uZWQLA9TtNFx2HCKqJFhMElUCmSFjAAD1Y9ciLTVJbhiiItz+dyEA4Ix5M9g6ukhOQ0SVBYtJokqgYadBuKm4wAppOLOZd3ZT5ZObk4Pat7fk/dDwZblhiKhSYTFJVAmoDAxwq94IAID7hYXIzcmRnIhIV9ThjXDCPSTBAv7t+CxuIvp/LCaJKonAnmOQBAu4iTuI3L1SdhwiHZnhywEAFxy6wNjETHIaIqpMWEwSVRJmFtY45zYAAGAa/rPkNET/70HKffgn/wsAsGk+VHIaIqpsWEwSVSJ1ek5AljCAX3YULoTvkR2HCAAQtXsZzJRMxCiuqNu4vew4RFTJsJgkqkQcXb0QadMZAPBg/4+S0xDlMT+X9+z4m559oKi42yAiXXq9Vbh+/TpGjRoFb29vmJqaonbt2pgyZQqysrJkRyM9ZvfcBABAw5T9uB19QXIa0ne3oy+gflYkAMCrwwjJaYioMtLrYvL8+fPQaDT49ddfcfbsWXz//feYN28ePv74Y9nRSI/VDmyO08aNYKhoEL2Fj1gkuaL3LgYAnFU3gIunr+Q0RFQZGcoOIFO3bt3QrVs37c+1atXChQsX8Msvv+Dbb7+VmIz0nab5W8D+0QiI+xspSV/BysZediTSQ0KjgeuNvwEAaX7sDoiICqfXRyYLk5ycDDs7uyeOk5mZiZSUFJ0XUVlq0K4/rqs8YKGkI2rzf2XHIT118cQ+1NTcQrpQw6/jK7LjEFElxWLyEVeuXMFPP/2EMWPGPHG8GTNmwNraWvvy8PCooISkLxSVCnfrjwIAeF1aipxsXsdLFS8p9H+nuK3bwtL6yX9kE5H+qpbF5NSpU6EoyhNf4eHhOtPExsaiW7duePHFFzF69Ognzn/y5MlITk7WvmJiYsrz45CeatDjddyDFZwRj8gdS2THIT2TnpYK/4TtAACTJq9KTkNElVm1vGZy3LhxePnlJz871svLS/v/2NhYdOjQAS1atMD8+fOfOn9jY2MYGxs/a0yiJzIxNcfJmi+jxY35sDz5K0T3keyWhSrM2d3LEaKk4zYc4d+yl+w4RFSJVcti0sHBAQ4ODsUa99atW+jQoQOCg4OxcOFCqLizpkrEt9d4ZM5diLo5F3EubCf8mnWVHYn0hMnZvEd6XvfoCxcDA8lpiKgy0+vKKTY2Fu3bt4eHhwe+/fZbxMfHIy4uDnFxcbKjEQEA7JzcEGmf1+NAxv4fJKchfRF7/QICMiMAAJ6dXpMbhogqPb0uJnfs2IHLly9jz549cHd3h4uLi/ZFVFnU6DIRANAw7TBuXj4jOQ3pg+jdCwAAZ4yD4OrFviWJ6Mn0upgcPnw4hBCFvogqC896jRFp2hQqReDWttmy41A1p8nNhVfM3wCAjIDBcsMQUZWg18UkUVVh0OptAEBg/CYkJ96RnIaqs6jDm+CCeKTADAGdhsiOQ0RVAItJoiqgfsteuGLgDTMlE1GbeO0klZ+MsLxuqM7Zd4GJmYXkNERUFbCYJKoCFJUK9xu+AQDwubYcGelpkhNRdZR8PwEByfsBALatRkpOQ0RVBYtJoiqiYbeRiIMDHJCEyE3zZMehauj8zoUwUbJxTeUJn6A2suMQURXBYpKoijBSG+N63eEAALeoBcjNyZEbiKod24t/AgDu1B7ADvKJqNi4tSCqQgJ7v41kmMNd3EbkrmWy41A1cu3sUdTNuYhsYYC6nUfJjkNEVQiLSaIqxNzSBufc8x4VahE+F0KjkZyIqos7//4BADhj0QJ2Tm6S0xBRVcJikqiKqfv8e8gQRqibcxFnQzfLjkPVQGbGQ/je2QIAUBq9IjkNEVU1LCaJqhg7JzdEOvYGAGgOzJEbhqqFM7tXwBYpuAs7BLTrLzsOEVUxLCaJqiD3Hh8gVyhokBGOK6cOy45DVZzxqaUAgCseL8DQSC05DRFVNSwmiaogt1p+iLDqAAC4v+s7yWmoKou5fBoBmRHQCAXencfIjkNEVRCLSaIqyvq5SQCAoOQ9iL1+QXIaqqpu7s7rs/S0WRM41/SRnIaIqiIWk0RVVJ2GrXDauDEMFQ1iNs2UHYeqoKzMDNS9vREAoGk0THIaIqqqWEwSVWFK6/EAgAbxG3Hv7i25YajKObNnJeyRjHjYIrDDQNlxiKiKYjFJVIXVb9UblwzqwFTJwoWN38uOQ1WMUcQSAMBl93688YaISo3FJFEVpqhUSAkeBwDwi1mJhw+SJSeiquLW1XMIzDwBjVDg+RxvvCGi0mMxSVTFBXUZipuKM2zwAKc2/ld2HKoibuz6BQBwxjQErl6+ktMQUVXGYpKoijMwNMQtv9EAAK8LC5GdlSk5EVV22VmZ8In9BwCQwxtviOgZsZgkqgYa9hqLRFjDGfGI2PKb7DhUyZ3ZuwoOSEICbHjjDRE9MxaTRNWAiZkFLnoPBQA4nfoZmtxcyYmoMjM4uRgAcMmtL4zUxpLTEFFVx2KSqJoI6PseUmAOT81NROxYIjsOVVIxl0+jQcbx/914M1Z2HCKqBlhMElUTltZ2OOsxCABgHf4DhEYjORFVRrd25t2kddqsKVy960lOQ0TVAYtJomrEr8/7SBMmqJ17Daf2/Sk7DlUy6Wmp8L+T98QbNH1NbhgiqjZYTBJVIzYOzjjlOgAAYHL4ex6dJB2nt/0OK6ThllIDgW1fkB2HiKoJFpNE1YxPn4+QIYzgm3MeZw9vkh2HKgmh0cAuKu9a2pjag6AyMJCciIiqCxaTRNWMg7MHIp36AACUf7+VnIYqiwvH96BO7hVkCCP4dX9TdhwiqkZYTBJVQ57PT0aWMED9rEicP7ZTdhyqBB4cyHvizSnbzrC2ryE5DRFVJywmiaohZ486iLDrDgDI3PsfyWlItsQ7N9EgeR8AwLY9j0oSUdliMUlUTbn2nIxcoaBh+jFcjjwoOw5JdGnrz1ArObhoWBc+QW1kxyGiaobFJFE15V4nACetOwEAUnbMlJyGZMnNyYHX9dUAgOSA4XLDEFG1xGKSqBpz6D4ZANA47V9EnzsuOQ3JcGrPKjgjAfdhhcCuw2XHIaJqiMUkUTXm5ReCE+Z5pzXjt3wlOQ3JYBw+DwBw3rUvTEzNJachouqIxSRRNWfd9WMAQOOUPTw6qWcuRx6Ef9ZpZAsD1O45UXYcIqqmWEz+T2ZmJoKCgqAoCiIiImTHISoztRu0xEnz1lApAglbvpAdhyrQ/T0/AAAirTvAyc1bchoiqq5YTP7PBx98AFdXV9kxiMqFdffPAQCNUvbhWlSY5DRUERJio9EwaTcAwKr9O5LTEFF1xmISwNatW7Fjxw58+y2fFkLVU62AZjhh0RYqReD+lumy41AFuLRlDtRKLs4Z+aNu43ay4xBRNab3xeSdO3fw2muvYenSpTAzMyvWNJmZmUhJSdF5EVV2tj0+h0YoaPzgX1w9c1R2HCpHGQ8foN7NvwAA6cFvSE5DRNWdXheTQggMHz4cY8aMQUhISLGnmzFjBqytrbUvDw+PckxJVDa8/ZvgpGXeEaqkrbx2sjo7tfU32CIFt+GIBp0Gy45DRNVctSwmp06dCkVRnvgKDw/HTz/9hJSUFEyePLlE8588eTKSk5O1r5iYmHL6JERly6Hn/45Oph3AlVOHZcehciA0Gjid/R0AEO0zFIZGasmJiKi6U4QQQnaIspaQkICEhIQnjuPl5YWXX34ZGzduhKIo2uG5ubkwMDDAkCFDsHjx4mK9X0pKCqytrZGcnAwrK6tnyk5U3sK/ewEhqbtx0qwlGn2wVXYcKmOn//0HgXteRZowQe6EKFjZ2MuORFRpcf9dNqplMVlcN27c0LneMTY2Fl27dsVff/2FZs2awd3dvVjz4cJIVUn0hQi4r2gPA0XgUt9NfFZzNRM5szMaph/DEccX0fyt32THIarUuP8uG4ayA8hUs2ZNnZ8tLCwAALVr1y52IUlU1Xj6BiHcuhNCUnYhbfuXQNB22ZGojFw7exQN048hVyjw6D5Bdhwi0hPV8ppJInqyGr0/R65QEJR+BOfDdsmOQ2UkcfssAECkZVu41aovOQ0R6QsWk4/w8vKCEAJBQUGyoxCVKw+fhjhu1wMAoNk5FUKjkZyIntXt6AsISs7rpNzyufclpyEifcJikkhP1XxhOjKFEfyzTuP0/nWy49Azit40C4aKBqeNG/E6WCKqUCwmifSUs0cdnHQeAAAwP/gVNLm5khNRaSUlxKHB3Q15P7TitZJEVLFYTBLpsXovTkWqMEXt3Ks4se0P2XGolM5t+A5mSiYuG9RGQOvesuMQkZ5hMUmkx2wcnHHGaxgAwDn8W2RnZUpORCX18EEy6t1YCQBIDn4LioqbdSKqWNzqEOm5BgMm4x6s4C7icOKfn2THoRI6tXEubJGKm4ozgroMkx2HiPQQi0kiPWduaYOLvmMBALXO/hfpaamSE1FxZWVmwOtC3uUJt/xGw8BQr7sOJiJJWEwSERr1G49YxQmOuI+Itf+RHYeKKWLjz3BGPBJgg4a9xsqOQ0R6isUkEcHYxAy3gvLuAq5/9TckJcRJTkRPk52VCfezvwAALtcdDRMzC8mJiEhfsZgkIgBA456v46rKC1Z4iPOrP5Udh54iYtM8uIq7eUcl+4yXHYeI9BiLSSICABgYGiKt/XQAQPDddYi5FCk5ERUlJzsLrqfnAgAu1xkBU3NLyYmISJ+xmCQircC2fRBp2gxGSi4S1n8kOw4V4eTm+XATd3APVmjQl52UE5FcLCaJSIdNn2+QI1Ro9PAwzh7aLDsOPSYnOwsukf8FAFysNRxmFtaSExGRvmMxSUQ6POs1xnHHvgAA4z2f8TGLlUzE1t/hLm7jPiwR2O892XGIiFhMElFBPgO/RKowRZ3cKzi+cZ7sOPQ/OdlZcIrI61j+vPerMLe0kRuIiAgsJomoEHZObjhb+zUAgGfEt+zIvJI4ufEX1NTcwn1YIqDvJNlxiIgAsJgkoiIEvfgRYhUnOOEeIlZNkx1H72Wkp8Hj1I8AgAt1RsPS2k5yIiKiPCwmiahQJqbmuN3kYwBAoxuLEHvtvORE+i1i/Ww4IwF3YYegF3hUkogqDxaTRFSkxt2G4YxxEEyUbNxZwy5oZHmQch++F+cDAK4HvM2n3RBRpcJikoiKpKhUsOw7G9nCAI0eHkbk3jWyI+ml0399DVukIEZxReM+42THISLSwWKSiJ7I0y8Yx50HAgDs/v0cmRkPJSfSL/fjbyMweikA4G6TSTA0UktORESki8UkET1V/cFfIwE28BCxOLH6S9lx9MqFNVNgoaTjskFtNOo6XHYcIqICWEwS0VNZWtvheuO8xys2vPob4mIuS06kH2IuRSL4zl8AgPS2n0JlYCA5ERFRQSwmiahYgnu9gXNG9WGmZOL2qndlx9ELCes/gpGSi0jTpghs94LsOEREhWIxSUTFoqhUMOn7fd7NOGkHcXLHMtmRqrUzhzai0cPDyBEq2PSZKTsOEVGRWEwSUbF512+GcLdXAABuhz9DavI9yYmqp9ycHJju+RwAcNyxLzzrNZaciIioaCwmiahEGr3yNW4qznDCPUQtZefZ5eH4xp9RO/cqUmCGui99LTsOEdETsZgkohIxMbNAUsf/AACaxK/D+fDdkhNVLw9S7sM7cjYAIKrOG7B1dJGciIjoyVhMElGJBbTpgzDrblApAsZbJiA7K1N2pGrjzPLJcMR93FSc0WjAB7LjEBE9FYtJIiqVOq/MwX1YwVsTjfDln8uOUy1ciwpDSNxqAEBi2y9hbGImORER0dOxmCSiUrF1dMGVxp8AAIKvL8CV00ckJ6rahEaDjPXvwlDR4KR5azTs8KLsSERExcJikohKLbjX6zhp1gpqJRfK+jeQlZkhO1KVFb7hZ/hln8VDYQyXl+bIjkNEVGwsJomo1BSVCh6v/or7sEItzXUcX/KR7EhVUvK9eNSOyOtLMrL2G3Cu6SM5ERFR8bGYJKJn4uDsgWvNpgMAmtxcjIsn9skNVAVdWPIO7JCCaJUHgl/6RHYcIqISYTEJYPPmzWjWrBlMTU3h4OCAF17gY8uISqJx9xEIt3oOhooGxpveQnpaquxIVcbp/evQNGkLNEJBetfZUBubyI5ERFQiel9Mrl27FkOHDsWIESMQGRmJQ4cOYfDgwbJjEVU5PsN+Rjxs4am5iVN/vCU7TpXwIOU+HPbmdf8T5tQf9Zp1kZyIiKjkFCGEkB1ClpycHHh5eWHatGkYNWpUqeeTkpICa2trJCcnw8rKqgwTElUtp//9B/V3D4NKETjR/Ac07jZcdqRK7eh/R6BZwjrEKk6wnhgGc0sb2ZGI9Ar332VDr49MnjhxArdu3YJKpUKjRo3g4uKC7t274+zZs0+cLjMzEykpKTovIgIC2/bBUdehAIA6Rz7G7egLkhNVXlGhW9EsYR0AILHDtywkiajK0uti8urVqwCAqVOn4tNPP8WmTZtga2uLdu3a4d69e0VON2PGDFhbW2tfHh4eFRWZqNILGfEtLhj6wgppSFo2HDnZWbIjVTrJ9xNgt/1tAMAx254IbNtHciIiotKrlsXk1KlToSjKE1/h4eHQaDQAgE8++QT9+/dHcHAwFi5cCEVRsGbNmiLnP3nyZCQnJ2tfMTExFfXRiCo9I7UxLIcsQaowhV92FMIW8ZGAj7u08A04Ix63lBrwG/5f2XGIiJ6JoewA5WHcuHF4+eWXnziOl5cXUlPz7jj19/fXDjc2NkatWrVw48aNIqc1NjaGsbFx2YQlqoZcvevheNMvERz2HlrcWoiInU0R1Jk3tgFA+IZ5CEnZhRyhQmrPn+FmbSc7EhHRM6mWxaSDgwMcHByeOl5wcDCMjY1x4cIFtG7dGgCQnZ2N69evw9PTs7xjElVrwT1H4+j1UDSL/wu1D07EDU9/1KwbJDuWVLHXL8D3+FRAAcI8X0OLJs/JjkRE9Myq5Wnu4rKyssKYMWMwZcoU7NixAxcuXMDYsWMBAC++yOfiEj2rxq/9jCijAFgq6RCrXsGDlPuyI0mTmfEQqcuGwlJJx3kjfzQZ+qXsSEREZUKvi0kAmDVrFl5++WUMHToUTZo0QXR0NPbs2QNbW1vZ0YiqPCO1MZxGrcRd2MFTE4NLv74CTW6u7FhSRCwYC9+cC0iGOayGLIKhkVp2JCKiMqHX/UyWFfZTRfRk58N3o9bGF6FWcnHEfRSaj54tO1KFCvvnZzQ5ORkaoeB0u/lo2HGg7EhEBO6/y4reH5kkovJXL6QTIhp8DgBofvN3HFv/k+REFefqmaMIODEFAHC05mgWkkRU7bCYJKIK0bT/eIS6DgMANIqYgjMH/pGcqPwl3rkJk7WvwFTJwimTJmg2fKbsSEREZY7FJBFVmGajvke4ZScYKbnw3PUGrp09KjtSucl4+AAJC/rDVdzFTcUZNUcvg8rAQHYsIqIyx2KSiCqMysAAgW8t097hbblmIGIun5Ydq8xpcnNx9uch8M05j2SYQzNoNWwcnGXHIiIqFywmiahCGZuYwW3s37hi4A0HJMFoWd9q9QxvodHg2Py3EPxgH7KEAW52XqD3/WsSUfXGYpKIKpy1nSNsXt+EaJU7nJEAzaLeuHvrmuxYZeLIoo/Q/M5KAEBkoy9Qv1VPyYmIiMoXi0kiksK+hjtMR23CLaUG3MQdZP3WvcofoTyyfDpa3Pg17/9130eTvm9JTkREVP5YTBKRNE5u3lCGbUSsUgPu4jYMFnZD9PkTsmOVypEVX6D5pe8AAKGeY9B88KeSExERVQwWk0QklauXLwxHb8d1lQeccA9Wq/rgUsQB2bGKTWg0CP3jAzS/+C0AINTlVTQfNkNyKiKiisNikoikc3LzhvXYnbhk6ANbpMBtfX+c3LFMdqyn0uTm4uivb2pPbYd6jkHz136AouKmlYj0B7d4RFQp2Dq6wPntHTht3AhmSiYaHhqH0MUfQ2g0sqMVKi01CZHf9dLebHOk7iS0GDGThSQR6R1u9Yio0rC0tkO997bjqMMLUCkCLa7NxcnZfZB8P0F2NB23oy8gbk57NHp4GJnCCOHB/0HzwZ/JjkVEJAWLSSKqVIzUxmg2biGO+n+CbGGAxg/+xcMfmuN82C7Z0QAAJ7YtgvnCDqidew0JsMG13qsR0vsN2bGIiKRhMUlElVKzgR/gWp91uKXUgAviUWfTizgy702kp6VKyfMg5T6O/jgUjY+8Cyuk4aJhXeSM3IV6IZ2k5CEiqixYTBJRpVW3cXtYvhuKcMtOMFQ0aB63HPe/DUbk3jUVdi2l0GhwfMtCPJzdGM3ubYBGKAh1fRXeHxyEc02fCslARFSZKUIIITtEVZeSkgJra2skJyfDyspKdhyiaili5wq4HPoUNZAIADirbgCDLlPL9cjgxRP7kLl9KgIzTwIAbirOSOo0CwGtny+39ySiisP9d9lgMVkGuDASVYwHKfdxZvlkNI5bA7WSAwA4bdwIuSGvI7DDQBgYGj7zewiNBmcOboQmdC4aph8FAGQJQxyvORyNBk2DiZnFM78HEVUO3H+XDRaTZYALI1HFuh19ATHrpyL4/lYYKHmbsFjFCdEu3eDQ5EXUadi6RF30CI0G0RdO4PaRNXCL2YiamlsAgFyh4IRNV7j2mQq3Wn7l8lmISB7uv8sGi8kywIWRSI7Ya+dxY/uP8Iv7G9ZI0w6/D0tcNwtEhkMAjBzrwMLJG8aWtlCbWCAn8yEy01Px4M41ZMZfhfHdSLg/OA0n3NNO/0CY4qxjd7h2HQ8Pn4YyPhoRVQDuv8sGi8kywIWRSK70tFRE7VsN5dwG1Es9AjMls8TzyBKGiDILQVbdnvDvNBQWVrblkJSIKhPuv8sGi8kywIWRqPLIyszAtdOHcf/8v1AlXIBF2g1Y58TDVKTDRGQiU1EjEyZIMnTAAzM35Nj5wrJua3g3aAUzC2vZ8YmoAnH/XTae/Wp1IqJKRG1sAt+QjkBIx0J/b/a/f50rLhIRUbXGfiaJiIiIqNRYTBIRERFRqbGYJCIiIqJSYzFJRERERKXGYpKIiIiISo3FJBERERGVGotJIiIiIio1FpNEREREVGosJomIiIio1FhMEhEREVGpsZgkIiIiolJjMUlEREREpcZikoiIiIhKjcUkEREREZWaoewA1YEQAgCQkpIiOQkREREVV/5+O38/TqXDYrIMpKamAgA8PDwkJyEiIqKSSk1NhbW1tewYVZYiWI4/M41Gg9jYWFhaWkJRlDKbb0pKCjw8PBATEwMrK6symy/pYjtXHLZ1xWA7Vwy2c8Uoz3YWQiA1NRWurq5QqXjlX2nxyGQZUKlUcHd3L7f5W1lZcUNVAdjOFYdtXTHYzhWD7VwxyqudeUTy2bEMJyIiIqJSYzFJRERERKXGYrISMzY2xpQpU2BsbCw7SrXGdq44bOuKwXauGGznisF2rvx4Aw4RERERlRqPTBIRERFRqbGYJCIiIqJSYzFJRERERKXGYpKIiIiISo3FpGQ///wzvL29YWJiguDgYBw4cOCJ4+/fvx/BwcEwMTFBrVq1MG/evApKWrWVpJ3XrVuHzp07w9HREVZWVmjRogW2b99egWmrrpIuz/kOHToEQ0NDBAUFlW/AaqSkbZ2ZmYlPPvkEnp6eMDY2Ru3atfHHH39UUNqqq6TtvHz5cjRs2BBmZmZwcXHBiBEjkJiYWEFpq6Z///0XvXv3hqurKxRFwd9///3UabgvrGQESbNq1SphZGQkFixYIKKiosS7774rzM3NRXR0dKHjX716VZiZmYl3331XREVFiQULFggjIyPx119/VXDyqqWk7fzuu++KmTNnimPHjomLFy+KyZMnCyMjI3HixIkKTl61lLSd8yUlJYlatWqJLl26iIYNG1ZM2CquNG39/PPPi2bNmomdO3eKa9euiaNHj4pDhw5VYOqqp6TtfODAAaFSqcQPP/wgrl69Kg4cOCDq168v+vbtW8HJq5YtW7aITz75RKxdu1YAEOvXr3/i+NwXVj4sJiVq2rSpGDNmjM6wevXqiY8++qjQ8T/44ANRr149nWFvvPGGaN68ebllrA5K2s6F8ff3F9OmTSvraNVKadv5pZdeEp9++qmYMmUKi8liKmlbb926VVhbW4vExMSKiFdtlLSdZ82aJWrVqqUz7McffxTu7u7llrG6KU4xyX1h5cPT3JJkZWXh+PHj6NKli87wLl264PDhw4VOExoaWmD8rl27Ijw8HNnZ2eWWtSorTTs/TqPRIDU1FXZ2duURsVoobTsvXLgQV65cwZQpU8o7YrVRmrbesGEDQkJC8J///Adubm6oW7cuJk2ahPT09IqIXCWVpp1btmyJmzdvYsuWLRBC4M6dO/jrr7/Qs2fPioisN7gvrHwMZQfQVwkJCcjNzUWNGjV0hteoUQNxcXGFThMXF1fo+Dk5OUhISICLi0u55a2qStPOj/vuu++QlpaGgQMHlkfEaqE07Xzp0iV89NFHOHDgAAwNuSkqrtK09dWrV3Hw4EGYmJhg/fr1SEhIwJtvvol79+7xuskilKadW7ZsieXLl+Oll15CRkYGcnJy8Pzzz+Onn36qiMh6g/vCyodHJiVTFEXnZyFEgWFPG7+w4aSrpO2cb+XKlZg6dSpWr14NJyen8opXbRS3nXNzczF48GBMmzYNdevWrah41UpJlmmNRgNFUbB8+XI0bdoUPXr0wOzZs7Fo0SIenXyKkrRzVFQU3nnnHXz++ec4fvw4tm3bhmvXrmHMmDEVEVWvcF9YufBwgCQODg4wMDAo8Bfu3bt3C/zFlc/Z2bnQ8Q0NDWFvb19uWauy0rRzvtWrV2PUqFFYs2YNnnvuufKMWeWVtJ1TU1MRHh6OkydPYty4cQDyCh4hBAwNDbFjxw507NixQrJXNaVZpl1cXODm5gZra2vtMD8/PwghcPPmTfj4+JRr5qqoNO08Y8YMtGrVCu+//z4AoEGDBjA3N0ebNm3w5Zdf8ohZGeG+sPLhkUlJ1Go1goODsXPnTp3hO3fuRMuWLQudpkWLFgXG37FjB0JCQmBkZFRuWauy0rQzkHdEcvjw4VixYgWvdyqGkrazlZUVTp8+jYiICO1rzJgx8PX1RUREBJo1a1ZR0auc0izTrVq1QmxsLB48eKAddvHiRahUKri7u5dr3qqqNO388OFDqFS6u1UDAwMA/3/kjJ4d94WVkKQbf0j8f7cTv//+u4iKihLjx48X5ubm4vr160IIIT766CMxdOhQ7fj53SFMmDBBREVFid9//53dIRRDSdt5xYoVwtDQUMydO1fcvn1b+0pKSpL1EaqEkrbz43g3d/GVtK1TU1OFu7u7GDBggDh79qzYv3+/8PHxEaNHj5b1EaqEkrbzwoULhaGhofj555/FlStXxMGDB0VISIho2rSprI9QJaSmpoqTJ0+KkydPCgBi9uzZ4uTJk9oumLgvrPxYTEo2d+5c4enpKdRqtWjcuLHYv3+/9nfDhg0T7dq10xl/3759olGjRkKtVgsvLy/xyy+/VHDiqqkk7dyuXTsBoMBr2LBhFR+8iinp8vwoFpMlU9K2PnfunHjuueeEqampcHd3FxMnThQPHz6s4NRVT0nb+ccffxT+/v7C1NRUuLi4iCFDhoibN29WcOqqZe/evU/c5nJfWPkpQvDYOxERERGVDq+ZJCIiIqJSYzFJRERERKXGYpKIiIiISo3FJBERERGVGotJIiIiIio1FpNEREREVGosJomIiIio1FhMEhEREVGpsZgkIiIiolJjMUlEREREpcZikojoMfHx8XB2dsbXX3+tHXb06FGo1Wrs2LFDYjIiosqHz+YmIirEli1b0LdvXxw+fBj16tVDo0aN0LNnT8yZM0d2NCKiSoXFJBFREd566y3s2rULTZo0QWRkJMLCwmBiYiI7FhFRpcJikoioCOnp6QgICEBMTAzCw8PRoEED2ZGIiCodXjNJRFSEq1evIjY2FhqNBtHR0bLjEBFVSjwySURUiKysLDRt2hRBQUGoV68eZs+ejdOnT6NGjRqyoxERVSosJomICvH+++/jr7/+QmRkJCwsLNChQwdYWlpi06ZNsqMREVUqPM1NRPSYffv2Yc6cOVi6dCmsrKygUqmwdOlSHDx4EL/88ovseERElQqPTBIRERFRqfHIJBERERGVGotJIiIiIio1FpNEREREVGosJomIiIio1FhMEhEREVGpsZgkIiIiolJjMUlEREREpcZikoiIiIhKjcUkEREREZUai0kiIiIiKjUWk0RERERUaiwmiYiIiKjU/g84H4ybSNIaSwAAAABJRU5ErkJggg==", - "text/plain": [ - "
" - ] - }, - "metadata": {}, - "output_type": "display_data" - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "The max absolute difference is: 1.77636e-15\n" - ] - } - ], + "execution_count": 7, + "id": "f42e9964", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "import autograd.numpy as np\n", "\n", @@ -1433,8 +1504,10 @@ }, { "cell_type": "markdown", - "id": "7f495197", - "metadata": {}, + "id": "9a9dd7cb", + "metadata": { + "editable": true + }, "source": [ "## Using autograd\n", "\n", @@ -1447,19 +1520,13 @@ }, { "cell_type": "code", - "execution_count": 49, - "id": "3e79535c", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "The gradient of f1 evaluated at a = 1 using autograd is: 3\n", - "The gradient of f1 evaluated at a = 1 by finding the analytic expression is: 3\n" - ] - } - ], + "execution_count": 8, + "id": "f5d99737", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "import autograd.numpy as np\n", "from autograd import grad\n", @@ -1482,8 +1549,10 @@ }, { "cell_type": "markdown", - "id": "9d764d7c", - "metadata": {}, + "id": "1a033f2a", + "metadata": { + "editable": true + }, "source": [ "## Autograd with more complicated functions\n", "\n", @@ -1494,24 +1563,13 @@ }, { "cell_type": "code", - "execution_count": 50, - "id": "b171c0bc", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Evaluating at x1 = 1, x2 = 3\n", - "------------------------------\n", - "The derivative of f2 w.r.t x1: 12\n", - "The analytical derivative of f2 w.r.t x1: 12\n", - "\n", - "The derivative of f2 w.r.t x2: -4\n", - "The analytical derivative of f2 w.r.t x2: -4\n" - ] - } - ], + "execution_count": 9, + "id": "36ba3883", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "import autograd.numpy as np\n", "from autograd import grad\n", @@ -1550,25 +1608,32 @@ }, { "cell_type": "markdown", - "id": "65098808", - "metadata": {}, + "id": "98a7ad40", + "metadata": { + "editable": true + }, "source": [ "Note that the grad function will not produce the true gradient of the function. The true gradient of a function with two or more variables will produce a vector, where each element is the function differentiated w.r.t a variable." ] }, { "cell_type": "markdown", - "id": "5d60df18", - "metadata": {}, + "id": "a840a46c", + "metadata": { + "editable": true + }, "source": [ "## More complicated functions using the elements of their arguments directly" ] }, { "cell_type": "code", - "execution_count": 16, - "id": "cc4cc7eb", - "metadata": {}, + "execution_count": 10, + "id": "0ce16fc4", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "import autograd.numpy as np\n", @@ -1592,8 +1657,10 @@ }, { "cell_type": "markdown", - "id": "d71a9a54", - "metadata": {}, + "id": "470f7e16", + "metadata": { + "editable": true + }, "source": [ "Note that in this case, when sending an array as input argument, the\n", "output from Autograd is another array. This is the true gradient of\n", @@ -1605,17 +1672,22 @@ }, { "cell_type": "markdown", - "id": "290988a2", - "metadata": {}, + "id": "4d7c7e61", + "metadata": { + "editable": true + }, "source": [ "## Functions using mathematical functions from Numpy" ] }, { "cell_type": "code", - "execution_count": 17, - "id": "4afa9fe3", - "metadata": {}, + "execution_count": 11, + "id": "69eceec6", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "import autograd.numpy as np\n", @@ -1639,17 +1711,22 @@ }, { "cell_type": "markdown", - "id": "ec23dce0", - "metadata": {}, + "id": "02192e06", + "metadata": { + "editable": true + }, "source": [ "## More autograd" ] }, { "cell_type": "code", - "execution_count": 18, - "id": "be794060", - "metadata": {}, + "execution_count": 12, + "id": "6f5d7fa7", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "import autograd.numpy as np\n", @@ -1670,17 +1747,22 @@ }, { "cell_type": "markdown", - "id": "1d8e15c2", - "metadata": {}, + "id": "25b7c609", + "metadata": { + "editable": true + }, "source": [ "## And with loops" ] }, { "cell_type": "code", - "execution_count": 19, - "id": "d696c96c", - "metadata": {}, + "execution_count": 13, + "id": "043eb7de", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "import autograd.numpy as np\n", @@ -1711,9 +1793,12 @@ }, { "cell_type": "code", - "execution_count": 20, - "id": "5cdbff7d", - "metadata": {}, + "execution_count": 14, + "id": "880bc7f0", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "import autograd.numpy as np\n", @@ -1729,17 +1814,22 @@ }, { "cell_type": "markdown", - "id": "ec95c41c", - "metadata": {}, + "id": "322163dd", + "metadata": { + "editable": true + }, "source": [ "## Using recursion" ] }, { "cell_type": "code", - "execution_count": 21, - "id": "06c8423e", - "metadata": {}, + "execution_count": 15, + "id": "09f1a79b", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "import autograd.numpy as np\n", @@ -1773,16 +1863,20 @@ }, { "cell_type": "markdown", - "id": "4675445a", - "metadata": {}, + "id": "33d9596d", + "metadata": { + "editable": true + }, "source": [ "Note that if n is equal to zero or one, Autograd will give an error message. This message appears when the output is independent on input." ] }, { "cell_type": "markdown", - "id": "3ea2267f", - "metadata": {}, + "id": "2b87a3af", + "metadata": { + "editable": true + }, "source": [ "## Using Autograd with OLS\n", "\n", @@ -1793,34 +1887,13 @@ }, { "cell_type": "code", - "execution_count": 51, - "id": "49c5a124", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Own inversion\n", - "[[3.98094809]\n", - " [3.10504501]]\n", - "Eigenvalues of Hessian Matrix:[0.27678028 4.83090115]\n", - "theta from own gd\n", - "[[3.98094809]\n", - " [3.10504501]]\n" - ] - }, - { - "data": { - "image/png": "iVBORw0KGgoAAAANSUhEUgAAAkMAAAHFCAYAAADxOP3DAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjguMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy81sbWrAAAACXBIWXMAAA9hAAAPYQGoP6dpAABWNElEQVR4nO3deXxM5/4H8M9kFyQE2RNCEcS+L0HaotZBVcuvqm53S6toS7UXbdWl2tKr2uu25d660YUwVDclQYtWLbUTGsQSsSaRkGXm+f0xnUkmmWSWnJk5M+fzfr3ySuecM+c8Z8Z0vnme7/N9VEIIASIiIiKF8nJ1A4iIiIhcicEQERERKRqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUjcEQkQytWrUKKpXK+OPj44OIiAg88sgjSE9Pd1m75s6dC5VK5bLru4OzZ89CpVJh8eLFrm4KEVnJx9UNIKLKrVy5EvHx8bh79y5++eUXzJ8/H6mpqThx4gTq1q3r6uYREXkEBkNEMpaQkIBOnToBAPr27QutVos5c+Zgw4YNmDBhgotbR65UXFxs7DUkourhMBmRGzEERleuXDFuu3v3LqZPn4527dohODgYISEh6N69OzQaTYXnq1QqTJ48GZ9//jlatGiBwMBAtG3bFt98802FYzdv3ox27drB398fcXFxlQ773L17F7NmzUJcXBz8/PwQFRWFSZMm4datWybHNWrUCEOGDME333yD9u3bo0aNGmjRooXx2qtWrUKLFi1Qs2ZNdOnSBb///rvF18MwnJiamornnnsO9evXR7169TBy5EhcunSpwr3PnTu3wjkaNWqExx9/vMI5t23bhqeeegr16tVDUFAQHnvsMeTn5yMrKwujR49GnTp1EBERgRkzZqC4uLjCeXU6HebPn4/Y2FgEBASgU6dO2Lp1a4Xj0tPTMXbsWISGhsLf3x8tWrTAhx9+aHJMWloaVCoVPv/8c0yfPh1RUVHw9/fH6dOnUVBQgBkzZiAuLg4BAQEICQlBp06dsGbNGouvHxHp8U8KIjeSkZEBAGjWrJlxW2FhIW7cuIEZM2YgKioKRUVF+OmnnzBy5EisXLkSjz32mMk5Nm/ejL179+KNN95ArVq1sGjRIowYMQInT55E48aNAQBbt26FWq1G9+7d8cUXX0Cr1WLRokUmQRgACCEwfPhwbN26FbNmzUJiYiIOHTqEOXPmYPfu3di9ezf8/f2Nx//xxx+YNWsWZs+ejeDgYMybNw8jR47ErFmzsHXrVrz99ttQqVR45ZVXMGTIEGRkZKBGjRoWX5cnn3wSgwcPRnJyMjIzM/HSSy/h0UcfxbZt2+x+rZ988kmMHDkSX3zxBQ4cOIBXX30VJSUlOHnyJEaOHImnn34aP/30ExYuXIjIyEhMmzbN5PnLli1Dw4YNsWTJEuh0OixatAgDBw7E9u3b0b17dwDAsWPH0KNHD8TGxuLdd99FeHg4fvjhBzz//PO4du0a5syZY3LOWbNmoXv37vj444/h5eWF0NBQTJs2DZ9//jneeusttG/fHvn5+Thy5AiuX79u970TKY4gItlZuXKlACD27NkjiouLRV5envj+++9FeHi46N27tyguLq70uSUlJaK4uFg88cQTon379ib7AIiwsDCRm5tr3JaVlSW8vLzEggULjNu6du0qIiMjxZ07d4zbcnNzRUhIiCj7v43vv/9eABCLFi0yuc6XX34pAIgVK1YYtzVs2FDUqFFDXLhwwbjt4MGDAoCIiIgQ+fn5xu0bNmwQAMTGjRutep0mTpxosn3RokUCgLh8+bLJvc+ZM6fCORo2bCjGjx9f4ZxTpkwxOW748OECgHjvvfdMtrdr10506NDB+DgjI0MAqPT1u//++43bBgwYIKKjo0VOTo7JOSdPniwCAgLEjRs3hBBCpKamCgCid+/eFdqfkJAghg8fXmE7EVmPw2REMtatWzf4+vqidu3aeOCBB1C3bl1oNJoKeSJff/01evbsiVq1asHHxwe+vr749NNPcfz48QrnTEpKQu3atY2Pw8LCEBoainPnzgEA8vPzsXfvXowcORIBAQHG42rXro2hQ4eanMvQ81J2mAkAHnroIdSsWbPCsFC7du0QFRVlfNyiRQsA+nyowMDACtsNbbJk2LBhJo/btGlj0/PNGTJkiMljQ5sGDx5cYbu561T2+u3YsQNarRZ3797F1q1bMWLECAQGBqKkpMT4M2jQINy9exd79uwxOeeDDz5Y4TpdunTBd999h5kzZyItLQ137tyx+56JlIrBEJGM/fe//8XevXuxbds2PPPMMzh+/DjGjBljckxKSgpGjx6NqKgorF69Grt378bevXvxt7/9DXfv3q1wznr16lXY5u/vb/wSvXnzJnQ6HcLDwyscV37b9evX4ePjgwYNGphsV6lUCA8PrzBUExISYvLYz8+vyu3m2m9O+XsyDM1VJzCwpa3m2lnZ61dUVITbt2/j+vXrKCkpwT//+U/4+vqa/AwaNAgAcO3aNZPnR0REVDjnBx98gFdeeQUbNmxAUlISQkJCMHz4cJeWYCByN8wZIpKxFi1aGJOmk5KSoNVq8cknn2Dt2rUYNWoUAGD16tWIi4vDl19+aVIDqLCw0K5r1q1bFyqVCllZWRX2ld9Wr149lJSU4OrVqyYBkRACWVlZ6Ny5s11tcAR/f3+zr4mjcmsqe/38/PxQq1Yt+Pr6wtvbG+PGjcOkSZPMniMuLs7ksbkaTzVr1sS8efMwb948XLlyxdhLNHToUJw4cUKamyHycOwZInIjixYtQt26dfH3v/8dOp0OgP4L0s/Pz+SLMisry+xsMmsYZnOlpKSY9Hjk5eVh06ZNJsfed999APQBWVnr1q1Dfn6+cb8cNGrUCIcOHTLZtm3bNty+fdsh16vs9UtMTIS3tzcCAwORlJSEAwcOoE2bNujUqVOFH3O9eFUJCwvD448/jjFjxuDkyZMoKCiQ+raIPBJ7hojcSN26dTFr1iy8/PLLSE5OxqOPPoohQ4YgJSUFEydOxKhRo5CZmYk333wTERERdg+VvPnmm3jggQfQr18/TJ8+HVqtFgsXLkTNmjVx48YN43H9+vXDgAED8MorryA3Nxc9e/Y0ziZr3749xo0bJ9WtV9u4cePw+uuv4+9//zv69OmDY8eOYdmyZQgODnbI9by9vdGvXz9MmzYNOp0OCxcuRG5uLubNm2c8ZunSpejVqxcSExPx3HPPoVGjRsjLy8Pp06exadMmq2bDde3aFUOGDEGbNm1Qt25dHD9+HJ9//jm6d+9ukodFRJVjMETkZqZMmYJly5bhjTfewJgxYzBhwgRkZ2fj448/xmeffYbGjRtj5syZuHDhgskXry369euHDRs24LXXXsPDDz+M8PBwTJw4EXfu3DE5p0qlwoYNGzB37lysXLkS8+fPR/369TFu3Di8/fbbJtPqXe2ll15Cbm4uVq1ahcWLF6NLly746quvoFarHXK9yZMn4+7du3j++eeRnZ2NVq1aYfPmzejZs6fxmJYtW2L//v1488038dprryE7Oxt16tRB06ZNjXlDltx7773YuHEj3n//fRQUFCAqKgqPPfYYZs+e7ZD7IvJEKiGEcHUjiIiIiFyFOUNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUTRF1hnQ6HS5duoTatWubLWdPRERE8iOEQF5eHiIjI+Hl5bj+G0UEQ5cuXUJMTIyrm0FERER2yMzMRHR0tMPOr4hgqHbt2gD0L2ZQUJCLW0NERETWyM3NRUxMjPF73FEUEQwZhsaCgoIYDBEREbkZR6e4MIGaiIiIFI3BEBERESkagyEiIiJSNAZDREREpGgMhoiIiEjRGAwRERGRojEYIiIiIkVjMERERESKxmCIiIiIFI3BEBERESkagyEiIiJSNAZDREREpGgMhoiIiEjRGAwRERGRojEYIiIiIkVjMERERESKxmCIiIiIFM3lwdCOHTswdOhQREZGQqVSYcOGDZUe+8wzz0ClUmHJkiVOax8RERF5NpcHQ/n5+Wjbti2WLVtW5XEbNmzAr7/+isjISCe1jIiIiJTAx9UNGDhwIAYOHFjlMRcvXsTkyZPxww8/YPDgwU5qGRERESmBy3uGLNHpdBg3bhxeeukltGrVytXNISIiIg/j8p4hSxYuXAgfHx88//zzVj+nsLAQhYWFxse5ubmOaBoRERF5AFn3DO3btw9Lly7FqlWroFKprH7eggULEBwcbPyJiYlxYCuJiIjInck6GNq5cyeys7MRGxsLHx8f+Pj44Ny5c5g+fToaNWpU6fNmzZqFnJwc409mZqbzGk1ERERuRdbDZOPGjcP9999vsm3AgAEYN24cJkyYUOnz/P394e/v7+jmERERkQdweTB0+/ZtnD592vg4IyMDBw8eREhICGJjY1GvXj2T4319fREeHo7mzZs7u6lERETkgVweDP3+++9ISkoyPp42bRoAYPz48Vi1apWLWkVERERK4fJgqG/fvhBCWH382bNnHdcYIiIiUhxZJ1ATERERORqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUjcEQERERKRqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUjcEQERERKRqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUjcEQERERKRqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUjcEQERERKRqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrm8mBox44dGDp0KCIjI6FSqbBhwwbjvuLiYrzyyito3bo1atasicjISDz22GO4dOmS6xpMREREHsXlwVB+fj7atm2LZcuWVdhXUFCA/fv34/XXX8f+/fuRkpKCU6dOYdiwYS5oKREREXkilRBCuLoRBiqVCuvXr8fw4cMrPWbv3r3o0qULzp07h9jYWKvOm5ubi+DgYOTk5CAoKEii1hIREZEjOev728dhZ3aQnJwcqFQq1KlTp9JjCgsLUVhYaHycm5vrhJYRERGRO3L5MJkt7t69i5kzZ2Ls2LFVRogLFixAcHCw8ScmJsaJrSQiIiJ34jbBUHFxMR555BHodDosX768ymNnzZqFnJwc409mZqaTWklERETuxi2GyYqLizF69GhkZGRg27ZtFscN/f394e/v76TWERERkTuTfTBkCITS09ORmpqKevXqubpJRERE5EFcHgzdvn0bp0+fNj7OyMjAwYMHERISgsjISIwaNQr79+/HN998A61Wi6ysLABASEgI/Pz8XNVsIiIi8hAun1qflpaGpKSkCtvHjx+PuXPnIi4uzuzzUlNT0bdvX6uuwan1RERE7kcxU+v79u2LquIxGZVBIiIiIg/kNrPJiIiIiByBwRAREREpGoMhIiIiUjQGQ0RERKRoDIaIiIhI0RgMERERkaK5fGo9ERGR29BqgZ07gcuXgYgIIDER8PZ2dauomhgMERERWSMlBXjhBeDChdJt0dHA0qXAyJGuaxdVG4fJiIiILElJAUaNMg2EAODiRf32lBTXtIskwWCIiIioKlqtvkfI3IoIhm1Tp+qPI7fEYIiIiKgqO3dW7BEqSwggM1N/nLvSaoG0NGDNGv1vhQV2zBkiIiKqyuXL0h7nLNYme9uTC+VhieTsGSIiIqpKRIS0xzlDSgrQqBGQlASMHav/3ahRxdwme3KhrD23G1EJBSwLn5ubi+DgYOTk5CAoKMjVzSEiInei1eq/7C9eNJ83pFLpe1IyMuTRO2IIcMq3VaXS/167Vt/jY7ivyoYAzd2XteeWiLO+v9kzREREVBVvb/2QEVD6pW9geLxkiTwCIUvJ3kLo9xuGuWzJhfLgRHIGQ0RERJaMHKnv9YiKMt0eHW1db4izEpQtBTiAfv/8+bbnQnlwIjkTqImIiKwxciSgVtueOOzMYo0ajXXHzZkDzJtn3bGGXCh3TSS3AoMhIiIia3l7A337Wn98ZTk2hgRlKXNsUlL0w3XW+ve/9UGZpVyoxET9Y3dMJLcSh8mIiIgcwZk5NoZr2eLCBeCpp/T/bU0uVGKiPjgqf2zZ58TElAZPboTBEBERkSM4M8fGmlwhc5o2tT4Xyp0SyW3EYIiIiMgRnJljY+85IiL0Ac/Zs0BqKpCcrP+dkWF++K66ieQyxZwhIiIiR3Bmjo2t5yifD2RLLpS9ieQyxmCIiIjIEQw5NtYmKDvyWuWvC1RvSMvWRHKZ4zAZERGRIzgzx6aqa5Xn5kNajsBgiIiIyFGcmWNT1bXmzbOcD6RgXJuMiIjI0Zy5yrsrVpR30DWd9f3NnCEiIiJHc2aOjbPzeZxZYdtBOExGRERE9jFU2C5f48hQYTslxTXtshGDISIiIrKdB61iz2CIiIiIbOdBq9gzGCIiIiLbedAq9gyGiIiIyHYetIo9gyEiIiKynQetYs9giIiIiGznQavYMxgiIiLydFotkJYGrFmj/y3VDC8PWcWeRReJiIg8maOLInrAKvYMhoiIiDyVoShi+VpAhqKIUvXeOKDqdX52Pr75x++SnrMyXJuMiIjIE2m1QKNGldcCUqn0PUQZGfLoxdFqceO/m3Bw5QFsORyOD26NQwF0ABz//e3ynKEdO3Zg6NChiIyMhEqlwoYNG0z2CyEwd+5cREZGokaNGujbty+OHj3qmsYSERG5Czcpinji2z+xvv0buOIbhZC/jcC9O9/AglsTcQItMEG10iltcHkwlJ+fj7Zt22LZsmVm9y9atAjvvfceli1bhr179yI8PBz9+vVDXl6ek1tKRETkRmRaFFFbpMUvHx3Cy13S0NwvA68OPgj1wbloIK6YHBeNi3hfTHVKm1yeMzRw4EAMHDjQ7D4hBJYsWYLZs2dj5F9jmv/5z38QFhaG5ORkPPPMM85sKhERkW20WtclFsuoKGLBtQL89P5haL4uwqbT8bgq2gAAvKDFT0iECgLlqxWZ2+YoLg+GqpKRkYGsrCz079/fuM3f3x99+vTBrl27Kg2GCgsLUVhYaHycm5vr8LYSERGZcPQsLksMRREvXjS/mKohZ8hBRRGvHr+Gb945Ds13fvgxqzXuoKtxXzByMLjhETzZ6QBi1l10yPVt4fJhsqpkZWUBAMLCwky2h4WFGfeZs2DBAgQHBxt/YmJiHNpOIiIiE4ZZXOVzdgyzuFJSHN8GFxRFTN9yFouHpCEx+A+Et6yLv61MhCarK+4gELHeFzClzXb8tGg/ruYH4n9neyLpwXqSXbs6ZN0zZKAq9yYKISpsK2vWrFmYNm2a8XFubi4DIiIicg6tVt8jZK43Rgh9IDJ1qr42j6OHzAxFEc31UC1ZUu0eKl2JDr+tOgbNp9eg2R+D40VNADQy7m9f4zjUXa9A/WwE2j7UDCqvaNMTyGTdMlkHQ+Hh4QD0PUQRZV6w7OzsCr1FZfn7+8Pf39/h7SMiIqrAlllcEtfmMUviooh3b93F1iWHofnyDjadao4sXYJxnw+K0TfkENT33sawafcgtnsLAC0qP5mloTwnkXUwFBcXh/DwcGzZsgXt27cHABQVFWH79u1YuHChi1tHREQO4cqkYynIcRZXNYsiXk+/gc3vHINmsw9+uJSAfHQ27gtCDgbGHIVaDQyc0Qp1Gna0rV1Ll+qHDlUqlwVELg+Gbt++jdOnTxsfZ2Rk4ODBgwgJCUFsbCymTp2Kt99+G02bNkXTpk3x9ttvIzAwEGPHjnVhq4mIyCFcnXQsBRnN4qqOP9POQ7PkT2jS6mBnTmvo0Mu4L9r7Eoa1SId6bC30ndIafrV62H8hw1De008D16+b7qtbF7h50/5zW8nlwdDvv/+OpKQk42NDrs/48eOxatUqvPzyy7hz5w4mTpyImzdvomvXrvjxxx9Ru3ZtVzWZiMi9uEtPi7OWjnA0F8/ispeusBin5vwPh9afwXcZzfHf4jHQIda4v23ASQzrfBnqp8PQYWw8VF6R0jbgxo2K25wQCAFcjoOIyLO5S0+Lq5aOcFSgaAjsANOAyDD5RyaBXWFuIbYtOYTz//4BQy8sRyRKh+6yUR/b/fpD1aUzOr01Ao36NHTM61XFe58LIBhw/Pe3UICcnBwBQOTk5Li6KUREzrNunRAqlRD6r+PSH5VK/7NunatbWCo1tWI7zf2kpkp3zXXrhIiONj1/dLR0r4u589erJ8S8eUKUlEhzDTvc+POm+PzZn8WoqF2iFnLFCKwTWqiEtqrXPTpaiJdecszrVcV7nwM45fubPUNERJ7I3RbpXLMGsCYXNDkZGDOm+terbEhO6p4brRaYP1/fE1d2GMjJvXNnf74AzXtnoEkNwo5braH9K0vGC1pkIgYRuGxftWcpXq8q3ntn9QzJuugiERHZyU0W6TRyZtKxpTpAgL4OkFZb/WtpNMDcuRXzYRxcfFHoBPatPo6/905D2xonEZcYjanr+yD1Vnto4YME/3TM7pmGo698jkh7AyFAmtdLBonkDIaIiDyRHKd3V8WQdFxZQV2VCoiJkSbp2FmBojODLgBFt4vw44J9mNR6O2L9LqPTuBZ4c2dfHLrbHF7Qok/wQbynTsPpredw+G5TvPVzX8S3laAmX3VfL0vvvRO4fDYZERE5gLtN766q3ozUS0c4K1B0QvHFW+dy8N3io9BogO8yWyEXpTV+auI2BkQegXpwCQa/1BL1mrareAIp3397Xy8Z1BpiMERE5InccXq3g5eOMHJWoOigoOv87ovY+N5paLbVQtqNNihBaY2fMK9sDGt2AuqHa+C+qa0RUKdb1SeTsgJ0dV6vyt77qCh92xyMwRARkSdyZk+LlCReOsIsQwBQVa8NAFy9Wr3rSBR0CZ3AH1+fgubjy9D8GoYDd1oAiDLub+F3BuoOmVA/UR9dHm8JL5/e1rdRil4ZqQJrc+9927ZASEj1zmsFziYjIvJk5uoMxcRI29MiF7bUwFm7FnjooarPFxNTvdl2hhl9lnrnzFyjuKAYOz48DM3qPGw82gTntKULnHpBix5BR6BOvAn1C43QtF8j+9pXlrl/J9ZwcN0kZ31/MxgiIvJ07lKBujpsLS6ZlgaUWf2gUqmp1VtM1Ybii7kXcvH9u0egWS/w7flWuCXqGA+vgQL0Dz8M9cAiDHmpBRq0qG9/mypj+Hei0QCrVwPXrpXui4kBHnlEPw3eiYE1gyEJMRgiItlSQqDiaPbUDHJmXaMqeucuxnbHxnfTodkSiG3X26AYfsZDGqiuYug9J6B+yA/3v9gagfUDq9cOW1T279LJ/14ZDEmIwRB5FH55eg53WSpDzuwtLumsnqGy7dy5E+LiJWSc1mLNjkhs2BOB3wtamhzWzDcD6nbnoJ4Qgm5PtIK3n7I/2wyGJMRgiDwGvzw9h7MqIHs6e4OaauTz2Krkbgl2Lj+MjatzoTkch4yS0sVPVdChW62jUPe6DvWUWMQPalyta3kaZ31/czYZkbvwlBW9yXIxPpVKX4xPrWavnyX2Tl938Gy7vEt5+OHdI9Cs12Lz2Va4Kdob9wXgDu4PPQz1A4UY+lI8whJa23UNkg6DISJ3wC9Pz+KEYnyKUZ3p6xLXNbp88Ao2vnMSmi01sPVqGxShu3FfPdV1DG1yDOpRfuj3YgJqhnax6dzkWAyGiNwBvzw9i7stlSFn1S0uWY26RkIncGzTGWg+vADNrvr4LT8BQJhx/z2+Z6Fucxbqx+uix9MJ8PaTuMClM/MHPTxXkcEQkTvgl6dncbelMuRMiuEub2+r/4jQFmnxy7+OQPOfm9D8EYczJfcAuMe4v2vNI1D3vAb1pGi0GNIEKq9Gtt6RdZyZP6iAXEUmUBO5A2fPfCHHcmLyrmI4sLhkfnY+fnznIE4m78efl/xxCs2wE4nQwRv+uIv7GhyGuv8dDJ3RHBHtwiyf0Fble2WuXgUeftg5yfcuTvTnbDIJMRgit8cvT89jQzE+spKEQzlXjlzFpndOQPO9P2pmn8E7eBkxKA20rns3wKnBL6L1v6agVngtqe6gInNBnqHejzm2/L/A0utlb9kCCTnt+1soQE5OjgAgcnJyXN0UIvutWyeESqX/0X996n8M29atc3ULyVbr1gkRHW36fsbE8L10keObz4h/PJAqutc6JFTQCkCIEVgntFAJbdn3yFmfO8Nnvvy1rflJTbV87vL/9qKjS++npESI99+X5lrV4Kzvb/YMEbkTJa0zpRQenpgqZ9oiLfZ8ehSalTegOdgQp4rjTPZ3qXEYW3T3oXbhVajMncCRPSOWemUsqapytqWhrxkzKi67Ye+1qol1hoioImes6E3OZUPyLlVfwbUC/PT+YWi+LsKm0/G4KtoY9/miCPfWOwR1vwIMm94UUbevA0lVrFzvyFmclmaQWlI2+b5swB0aWnWZDgB45x37r+WmGAwRuRt+eSoPe4+q5erxa/jmnePQfOeHH7Na4w66GvcFIweDGx6BeoQKD0xPQFB0p9Inrkmz7gKOmMVp7znLlxKwdzV6e67lxhgMERHJmQKmNTtC+paz0Cw9C83OutiVmwAdSr+wY70vQN3qDNSP1kbvSa3hG9jT/ElcWQLBnnOWLyVQ2XCYFCSo0i0nzBkiImVwx94VqaY1u+O920hXosNvq45B8+k1aPbH4HhRE5P97Wsch7rrFaifjUDbh5pB5WU2C8iUK2dxWro2UHFWWdn8wermHFnipFxFTq2XEIMhIoVzx94VqaY1u+O9W+nOjTvYuuQwNF/dxab0eFzRhRr3+aAYfUMOQX3vbQybdg9iu0fZdxFXlkCwdO2vvgLq1zcf5Fpbm8we778PTJnilICaU+slxKn1RApW2fRkuZckSE2t/rRmd733Klw7dV2senKnGBGxWwTitsltBeGWeCT2F5E8+Rdx8+wt6S7qyhII9l47Odm+KflV/ahU+muXlDj+vv/CqfUSYs8QkULJoGic3dasAcaOtXxcZdOa3fneyzmz7Rw0SzOg2V4HP+e0hg6l7Y32vgR1y3Sox9ZCn8mt4VfLzzGNcOVQoz3XtqdnKCYGeOQRYPFi/WMZFAPl1Hoioupy5wVuq5u868b3rivR4ffPj0PzyVVo9kXhaGFTAA2N+9sGnIS6y2Wonw5D+zHxUHlFOr5RrpzFac+1rVnANioKWLUKyM42DbK6dTM/tOrB9cwYDBGR53LnBW6ruxp7de7dBb0ghbmF2LbkEDRf3MGmk01xSdfKuM8bJehT9xDUSXkY9mITNOrVHEBzh7bH7VmzgO3SpcB991V8rgLrmTEYIiLP5c6rw1d3NXZ7792JCdc3M25h86Kj0GzywvcXE3AbnY37aiEPA6OPQD1Uh0EvtULduA6SXlsRRo7UD2vZ08ujsHpmzBkiIs/lCQvc2rsEiz337oQVys/+fAGa985AkxqEHbdaQ1vmb/JIr8sYFp8O9ZhAJD3fGv5B/tW6Fv3FjUsrcGq9hBgMESmYJ6wOb83q4ub223LvDkq4FjqB/cknoFlxBZq9ETh013R4K8E/HepOF6F+KhQd/y8eXj5eVp+bPB+DIQkxGCJSOE9e4NbSsJa1927t7KPUVIvDJ0W3i5D2z8PQJN/GxuNNcUFbmuDsBS0Sgw9D3fcW1FMbo3HfWKtuk5SJs8mIiKTiqQmhlQ1rXbgAPPgg8PXX+v3W3Hs1k81vncvBd4uPQqMBvstshVx0NO6ridsYEHkE6sElGPxSS9Rr2s6GmyRyPAZDRKQMUiSEyin3QqutfPVxg0ce0dcreughy/duR8L1+d0XsfG909Bsq4W0G21Qgh7GfWFe2RjW7ATUD9fAfVNbI6BON+vOT+QCDIaIiKwht2UtLNURAvQB0+jRwLp1lttoxVR+ER2NPy6HQpOUBs2vYThwpwWA0mUuWvidgbpDJtRP1EeXx1vCy6e37fdF5ALMGSIissSeWVaO7kWytkI1oM8RsibxuZKEa8N/Peu1Ait0Txm3e0GLHkFHoE68CfULjdC0XyPr209kBSZQS4jBEBHZzZ5ZVs7oRbJ1uQUrEp8BACkp0E2eAq/Ll4ybziMGU7EE6zESNVCAARGHMOyBYgx5qQUatKhvc9PdkpyGSBXEWd/fsp/DWFJSgtdeew1xcXGoUaMGGjdujDfeeAM6nc7VTSMyT6vVf1GtWaP/rdW6ukVUHbYsawGU9q6Uf87Fi/rtKSnStMswrGUtCwnSF/ZexvJHtuOBp2MRePk0+iIVY5CMvkhFF/yGuk0bYONrv+H6dRXWX+qGCZ8lKicQSknRB8RJSfreuKQk/WOp3ktyOdnnDC1cuBAff/wx/vOf/6BVq1b4/fffMWHCBAQHB+OFF15wdfOITMktr4Sqz5ZZVlUlNQuh70WaOlU/u6u6vQqGCtUPPmjd8eUSpIVO4HBKOjQfXYJmTyj2FbQEUHrMZd+G6NIOmDwhBN2eaABvv/DqtdddVTZEaghu3aFOFVkk+2GyIUOGICwsDJ9++qlx24MPPojAwEB8/vnnVp2Dw2TkFE6o3ksuYEv9HUCyWj1WW7tWP2ussh7IMsN4JcUCO5cfhubzXGw8EoeMktIaPyro0L32Eah73YB6SiyaD2wsTfvcmYMKUZL1OEz2l169emHr1q04deoUAOCPP/7Azz//jEGDBrm4ZURlWOoRAPQ9Ahwycz+G4ShDUFueSqVPUE5MdO7CsIbh2OJi4LXXKm2bALCr3XMY13Q3QgPzcO/09lh6sA8ySmIRgDsYGvYrPhm/E5cPX8cvuW3w8rd9GQgZ2DpESm5L9sNkr7zyCnJychAfHw9vb29otVrMnz8fY8aMqfQ5hYWFKCwsND7Ozc11RlNJyWz5n6aCFj/0CLYsmOqshWHNDcfWq6f/ff26cVO2KhSTdUvx9aaHjdvqq65hSJPjUI/yQ78XE1AztGv12uLJnBnckkvJPhj68ssvsXr1aiQnJ6NVq1Y4ePAgpk6disjISIwfP97scxYsWIB58+Y5uaWkaPyfpmezdvVvQy+SpWGVxET721LJcKy4fgOAwArfSUgr7onLiMBOXSJ08MY9vmehbnMW6sfrosfTCfD2q8b1lcRZwS25nOxzhmJiYjBz5kxMmjTJuO2tt97C6tWrceLECbPPMdczFBMTw5whchwJ13UiGbNmevXLLwPvvGP++SpV9XLHLOSw6KDCBUQjDhnoXPM41D2vQT0pGi2GNIHKq5JhPjlz1XR2w3UvXgRefBG4dq3SQpSV5gxxKr4kuDbZXwoKCuDlZZra5O3tXeXUen9/f/j7+zu6aUSlrKjeW+0eAXI9S0t6rF1beSAEADNmVCuJ/s7GH1GjiuFYLwjEIhPZ/9ag3pNunqzvqpmZ5q5rTvkhUkvn4KxSWZN9AvXQoUMxf/58bN68GWfPnsX69evx3nvvYcSIEa5uGlEpQ14JUDHRtqr/aZLn+Ppr/ayuyqhUwBdf2JxEf+XIVXwyfieGhv2GZ0dmW/WcejULLR/kLPbU3XJWrSZrr2tOdLT5Xj5XtZ2qR8hcbm6ueOGFF0RsbKwICAgQjRs3FrNnzxaFhYVWnyMnJ0cAEDk5OQ5sKZEQYt06IaKjhdD3D+l/YmL028lzrVtn+p5X9ZOaavF0xzefEf94IFV0r3VIqKA1PrUPUiW7hlOY+zxER1f9eSgpqficsj8qlf4zVVIibVstXRcQokEDIVav1r++5q7vqrZ7MGd9f8s+Z0gKrDNETsVcAddwZX5JVbVoyktOBsrNhtUWabHn06PQrLwBzcGGOFUcZ7K/U+AxqLtnQ/10GBKm94fK0nCsHOre2Ft3y9n5d4Z/N1u3Am+9Vb3rMndQcswZInJXlvJKSHquzNGwZvX4sv6aeVRwrQA/vX8Ymq+LsOl0PK6KNsZD/FCIe+sfwrD772DY9KaI6tQSQEv9Th8rp/k7W9lgNDQUeP55+ypxO3NmprX5QdZel7NK3RaDISJyb65eLsGGLzZteCT+uxLQjPkVP2a1xh2U1vipo7qFQbFHoR6hwgPTExAU3dn8Sayd5u9MtgYVVdXdcmatJnP/bqpzXU7Fd1s2DZNlZmYiJibGke1xCA6TEXkoOSyXYMPq8X/HXLyJOcbHsd4XoG51BupHa6P3pNbwDfS1/rpyGY61N6gAzA4ZGt9TRw4F2jq0ae11ndF2hZHlchzx8fF4/fXXkZ+f76j2EBFZTw7LJSQmAiEhVh2ajmboUOM45iWl4eCXJ3G2KAof/NEH973UwbZACCgdjh0zRv/bVUNjlS1DYw1zPSTOmJlp69CmtdflrFK3ZVMwtGXLFvz4449o2rQpVq5c6ag2ERFZRw45Gt7eKH56olWHLv3QF/sKWuDv2/qi7ejm8iiEaM/UdwNbgwqDsuu5mWMYCoyKMt1e2XR2W9n678GW6zq67eQQNuUM9ejRA7/++iv++9//Yvbs2fjggw/w/vvvoy+TRYnIFVyYo3E9/Qa+WXQMms0+2HL5JWTgI9TDdZgNb/4aHgl9Rmb10aqbeG5PkGltD8nIkfoEa6mHArVa4MoV64597TXgvvtsv66j2k4OY/fU+jt37mDBggV499130b9/f7zzzju45557pG6fJJgzROSh7M3RsDPf5sy2c9AszYBmex38nNMaOpQ+50mvT7BC95T+suXbALimV6D8ffboAezapX+cng7MmVPxOZW119xrtnOn1flSRjEx8k/0Zm6PbDjt+9veAkX5+fli586dYurUqcLLy0v4+/uLadOmidzcXGkqIEmIRReJPNi6dfpidipVxQJ3KlXFAn82FALUFmvFr58dEa/2SBWt/E9VqKHXNuCE+HvvVLFv9TGh0+rkVXTTXFu8va0r2li+OGBlr9lXX+l/l3/ty54nOlqIn34SIjm58mKFzno9KmunNf9uyCVkWXTx448/xt69e7F3714cP34c3t7eaNOmDbp164Z27drhf//7H06dOoX169ejU6dOjovgbMSeISIPZ+4vfnM9EFYUAiy8fzC2LTkEzRd3sPFkM1zWhRsP80YJ+tQ9BHVSHoa92ASNekVXbIscZnlVZ4ZXWampwI0bVb9mM2YAixfr/9tc3SM55MnYMnvMlT1XVIGzvr9tCoZiYmLQrVs340+nTp0qLIj69ttvIzk5GUeOHJG8sfZiMESyJocvT09g6XW08IUoAFz3DkUT7Unkoo5xey3kYWD0EaiH6jDopVaoG1fH7PNlw55p45VZvRqYOdNy6YL33tOv7m4pGHUVa8sfvP8+MGUKP38yIssK1JmZmRaPeeKJJ/D666/b3SAiReHq1tKxVPnbwswnFYD62my0x0GkezXHsPh0qMcEIun51vAP6i55cx3G3hle5ly9al3pgvr1gbNn5RvUW5voHRYmnzaTU0legTo0NBTbtm2T+rREnsfVlZMVRly8ZH6mVzmfPrsXcf/sDS8fN60SLEUZAUOPT4MG1l9TzsvQsDI0WWBTnSFrqFQq9OnTR+rTEnmWqorVGVI5X3jBtpovVEHR7SL8uGAfJrXejtGP+Vn1nCYPd4aXj+T/a3Se6n6hl536Xr5WjqOu6WiJifrgrnwhRANLdY/I47nxJ57IjVkzlHHhAjB/vnPa40FuncvBmim78EjsLjSofQcDXu2I5Uf6IEU3AhcQBV1lT/SUL0RLX/yWlC0O6ClBBCtDkwVcqJXIFawdypgzB0hIkO9wmUySv8/vvgjNu6eh2VYb22+2Rgl6GPeFe13B0GYnoX64BkKbLIbX+LH6HXJa8V1Khi9+cyvbl2e477lzgaZNK76HVZ3L3V4zOS5wS/Lh0In7MsE6QyQ7qanW1Xsx1KlxVW2WqthQr0dqOq1O7E8+Lub0SRXtahyv8JK19E8Xs7qnij2fHBbaYq3ldruqFpAjWVNnyNr79qTXrKRE//lzdd0jsoos6wy5K06tJ9mxdfpzaqq8klOtqNcj9V/axQXF2L7sMDSr87DxWBOc15bW+PGCFj2DjkDd+yaGPd8ITfs1qvpkMunRcriqKlDbet9Kec1IVmRZZ8hdMRgiWUpJAR580Lpjk5P1q5PLgaVATsKlDHIv5OK7d45AoxH49lwCchBs3FcDBRgQcQjqQSUYPD0eDVrUr9a1iEh+ZFlniIgkNHIkMG+e+fWhypPTbB1Lyd+G2jM7d9rVm3Vh72VsfPcUND/VROr1Niguk/8TqrqKoU1PQD3aH/e/2Bo1QrrZcQNWUHIvSNl7Dw3Vb8vOVt7rQIrCYIjIlWbPBv79b8u9LHKarWNt8reVxwmdwOGUdGg+ugTNnlDsK2gJoDT4a+73J9TtzkP9t3roOqElvP0c/FoouRCmpYVMlfI6kOIwGCJypbKzdQD3mK1jbS/VlSv6XgYzbS+5W4Kdyw9D83kuNEca42xJMwDNAAAq6NC99hGoe92Aekosmg9sDKBx1deSqidHyYUwrVnPTAmvAykSc4aI5MDahUadzVyQAehzhi5etLwQaJmehLxLefjh3SPQrNdi89lWuCnqGg8LwB30CzsE9QNFGDIjHmEJVlY+BqTryXFiLpTs2JLQ78mvA8kOE6glxGCIJOHoPBK55alUFWQA5nuzyhF/1aaZH7QQb+a+gCKULuxcX3UNQ5och3qUH/q9mICaoTXta6NUs9qsXcxTbjP7pGDtvZflia8DyY6zvr9ZgZrIGikp+r+ck5KAsWP1vxs10m+XimFtpzFj9L9dHQiNGlWxp8AwTALoAw0LyzWohICACo/lLkMJfHCP71lM75iGHf/8A1l362JleiKGL+hqXyBkaUkTAJg61folTSTOhXIr9tyTJ74OpFgMhsh5tFr9X6Br1uh/u8u6W5YCAykDIjmwNshQq4GzZ6FdtLjK03lBIBaZOPPWFzh1tyEW/94XiZPbwtuvmsGeLbParKHkxTztuSdPfB1IsRgMkXM4o2fFEaTufXAHVgYZOx/9Fx5vvhvPvVzbqtM2auwFlZed62WZI3VPTo8elnvjvL31x3kaW9Yzc5f1yIhswGCIHM+de1ak7n1wB1YGD8u/qIv/nOmFU3/NArNI6p4EqXtydu2yHNRqtfrjPE1VC5mWJdcZjkTVxGCIHMvde1aUmEdiZfCg8lLhxQ5pmPtubYgoF6xsLvWK6kp8r8syLGRaVR5Y2RXtiTwI6wyRYzm4WrHDKSyPRFukxe4jwUjwbYCg4mvwQsUgVgAorheB/10eBZXvX/8LaeSClc2lXlFdYe+1WSNH6nPBWIGaFIbBEDmWu/+1beh9qKymjhwrRNuo4FoBtrx3GJq1RfjmdDyuivYYgY+xFqOgg8o0IFKpoALgt2IZ4Fvmfx+GXgVzU/EdWStJyusq4L22imFWI5GCMBgix3L3v7al7n2QieyjV/HN4hPQfO+HLVmtcQddjfvqqG4hsGEY9iTMR7d9y4DLl0qfWFWQUb5XwVk9CVJd19b3Wm51oYjIbiy6SI5lqGxr6a9tuVezlWuFaBuc+iEDmg/OQbMzBLvyEiDKpAw29L4AdcIZqMcFIfG5BPgG+up3eMoXvi33Yc17reT1y4iciBWoJcRgyMUMs8kA839tu0tCppsFBroSHX797Cg0n12H5kAMThQ1MdnfocZxqLtdgfrZCLQZ1Uzaae9yYk/gUtV7LWXVayKqEoMhCTEYkgEP6FlxOjuCrzs37mDrksPQfHUXm9LjcUUXatzng2IkhRyC+r7bGDa9KWK6Rjr6DlxP6sBFyeuXEbkAgyEJMRiSCTfrWXEpG3ozrp28js2Lj0Oz2Qc/XG6NApQubRGEHAyKPQq1Ghg4oxWCY4OddQeu54jARcnrlxG5gLO+v5lATc7DWSrWqaw3w1Ckcu1anKnTEZqlGdBsr4Ofc1pDh17Gw6K9L0HdMh3qsbXQZ3Jr+NXywIrJ1nBEWQd3nx1JRGYxGCKSEwtFKgWArAcnoxkyoUND4662ASeh7nIZ6qfD0H5MPFReMhgCc3VPoCMCF3efHUlEZjEYIpITC70ZKgARuIy+SAPq1oU6KQ/DXmyCRr2aA2jurFZaJofZVo4IXFiLiMgjMRhSElf/pU4W3T54GrWsOE6zJAO1XrjP4e2xixXDfE4JiBwRuHho3SkipXOLtckuXryIRx99FPXq1UNgYCDatWuHffv2ubpZ7sVdV41XgIwdmVgyYjuS6h6A+sU4q55Tq+09Dm6VneS0Fl1Vi49WJ3CpbA0vrttF5LZkP5vs5s2baN++PZKSkvDcc88hNDQUZ86cQaNGjdCkSRPLJwBnk7EuirwIncC+1ceh+Xc2Nv4egUN3S4e3vKDFRUQjDFkwW/VH7lO35TjbylFlHdjTSuRwnE32l4ULFyImJgYrV640bmvUqJHrGuRuLP2lrlLp/1JXq/k/cgcqul2E1KWHoFlTgI3Hm+KiriWAlgAAb5Qgsc5hqPvmYtgLcQi/8WHVRSrlPAwjx9lWjlomhLMjiTyG7IOhjRs3YsCAAXjooYewfft2REVFYeLEiXjqqacqfU5hYSEKCwuNj3Nzc53RVHly91Xj3ditczn4dtERaDap8F1mAvLQybivJm7jgajDUA/RYtD0lqjXtH2ZZ8Y6ZtFTZ/RkyHW2FQMXIqqC7IOhP//8Ex999BGmTZuGV199Fb/99huef/55+Pv747HHHjP7nAULFmDevHlObqlMyfEvdQ92fvdFaN49Dc222th+szVK0NO4L9zrCoY1Own1IzVw7wutEVCne+Unkro3w1mzuzjbiojckOxzhvz8/NCpUyfs2rXLuO3555/H3r17sXv3brPPMdczFBMTo8ycITnmcHgQoRM4+OVJaP6VBc1v4Th4J95kf0v/01B3uAD1hLro3Pg6vLKvVC+wsad3x9k5Y3Jci475PURuyWk5v0LmYmNjxRNPPGGybfny5SIyMtLqc+Tk5AgAIicnR+rmyV9JiRDR0UKoVELov5pMf1QqIWJi9MeRVYryi8SWhfvE5NZpItY70+Tl9EKJSAw6KBYPSRXpP53VP2HdOv17UPbA6Gj9dlvYcx7D+2/uvXfk+2+urTExtt+zo9piz+tPRE7nrO9v2Q+T9ezZEydPnjTZdurUKTRs2LCSZ5AJ1kWRRO6FXHz3zhFoNALfnktADjoY99VAAQZEHIJ6UAkGT49HgxZtS58oVc0de8/jqpwxRyUt20ouNY+ISN4cGmpJ4LfffhM+Pj5i/vz5Ij09Xfzvf/8TgYGBYvXq1VafQ9E9QwZy+kvdTWT+dkl8+HCa6F9vr/BFoclLF6rKFk802yE2vvarKLheYP4E9vbKlJQIkZoqRHKy/ndhof29O8nJlT+v7E9ystQvn+u5qleMiCTjrO9v2ecMAcA333yDWbNmIT09HXFxcZg2bVqVs8nKU3ydIQPmTVRJ6AQOp6RD89ElaPaEYl9BS5P9zf3+hLrdeaj/Vg9dJ7SEt5+F186efC1zic716wPXrtl2nuq0wVMo+d6JPATrDJUxZMgQDBkyxNXNcH9ymF4ss4Cs5G4Jdi4/DM3nudAcaYyzJc0ANAMAqKBD99pHoO51A+opsWg+sDGAxtaf3NaZfJUN6VgTCFV2PSXP7uJMSiKyklsEQ+Qh5LB4J4C8S3n44d0j0KzXYvPZVrgpSmv8BOAO+oUdgvqBIgyZEY+whDb2X8iWmjtVFceszvWUnDMm15pHRCQ7bjFMVl0cJpMBFy8Jcml/Fja9ewqaLTWw9WobFMHfuK++6hqGNDkO9Sg/9HsxATVDa0pzUa1Wv/6bpV6ZjAx9b5k1QzrmWLNEh6OWpJAzW15/TwwGiTwAh8nIc0ixJEhREbB8OXDmDNCkCTBxIuDnV+klhU7gqOY0NMsvYuPu+vgtPwFAuHH/Pb5noW5zFsP/FoLuT7aCt58Dhols6ZWxd6jG2t4duczuciYl94oRkW0cmp4tE5xN5mKpqdbNaEpNNf/8l14Swtvb9Fhvb/32MorvFIu0JQfEix1SRROfsxVO37XmYfF2/1RxVJMudFqdw2/byJqZfNa+Rg0acEagrTiTkshtsc4QuYYjEpyrk8j68svAO++Yb+c776CooBjfBD4MzboSbM5ogeuinfEQf9zF/aGHoB5wF0NnxCO8TYJ97a8ua3plrE10Pn0a2LXLtvdHZknrTqfEXjEisglzhqiUoxKc7Z3iXFQEBAbqv8zNEAC08EYNFKAE+iGzENUNDIk7BvWDPug/LQG1wmvZ325nc8QyFjJJWicisoezvr8ZDJGeIxOc7U1kXbIEePFFi6d/U/U6bra/F+rH6qDnMwnwCXDjDk8pE51dnLRORFRdDIYkxGDIAkOwUtmyDVLMurGx10NbpEVW/0cRtf0Li6cWEydB9eEy+9olR1IMaznjPSUicjBnfX97OezM7kir1Q/prFmj/13J8IzHsWX9KnuNHKkPeKKiTLdHRxsDoYJrBdC8+iv+1mwnIgJu4J3tXa06tarpPfa3S44MxTHHjNH/tidYccZ7SkTkIdx4PEFilnIryv+13qOH7YmscuWsSr1mElmzQ+Lxzfvp0Ez6FVuyWuMOSgOg/2Es3sV0eEEHVWXn9PbWT7MnU6y+TERkNQZDgOWVrWfM0PcWlQ2UvL1Ne47cOSnVmZV6vb1xqrAhNKsBzc4Q7MoLhShT/6eh9wWoE85APS4Iic8lwHvudPOzyQymTauy3pBisfoyEZHVmDNkKbfCWu6clOrgSr26Eh1+/ewoNJ9dh+ZADE4UNTHZ36HGcai7XYH62Qi0GdUMKq9y/UAvvwy8955p8OntrQ+EFi2yuT2KwOrLROQBmEAtoSpfTGunfVvD2V8wUtaPkXha950bd7B1yWFovrqLTenxuKILNe7zRRH6hhyG+r7bGDa9KWK6Rlo+oY0VqAmOmapPROREDIYkVOWLuWYNMHastBcsXy/HERxRP6aa07qvnbyOzYuPQ7PZBz9cbo0ClK7xFYQcDIo9CrUaGDijFYJjg+1rI9lGiWuSEZHHYDAkIaf1DBkkJ+tnAjmKo2sC2dDbdHrrOWz8IAOa7XXwc05r6FB6bIz3RQxreRrqsbXQZ3Jr+NViT45LKL0CNRG5LQZDErIqZ6iy3Ap7OLJnyMX1Y3QlOuz9zzFoPr0Gzf5oHCs0ndbeNuAk1F0uQ/10GNqPia+Y/0NERGQlrlrvLFWtbG0rQyCS6IAV0A1sqR8jUUB299ZdbFt6GJov7mDTqWa4rCtd48sHxehT9zDU9+Zh6NQmaNSrOYDmklyXiIjIGRgMAaUFAc3lVjzyCLB4sf5xVYGSYYhqyRLHDkE4qX7MjTM3sfmdo9B8440fLibgNjob99VGLgbGHIF6qMDAGa1QN65Dta5FRETkSgyGDKpa2bpbt4qBkrk6Q85ISnVg/ZiMHZnQvP8nNGlB2HmrNbToZdwX5XUZw1qkQz0mEH2ntIZ/UA+bz09ERCRHzBmyllwqUEtYP0boBPatPg7Nv7Oh+T0Sh+82M9nfOuAU1J0uQf1UKDo+2oL5P0RE5FTMGZIbw3pRZTl6+nxl7agsx8mKobqi20VIXXoImjUF2Hi8KS7qWgJoqT81SpBY5zDUfXMx7IU4NO7bDEAzs+chIiLyFAyG3FFlOU6VDNXdOpeDbxcdgWaTCt9lJiAPnYz7auI2Hog6DPUQLQZNb4l6Tds76SYUitPciYhkh8Nk7qyKL9Zzv1zAxvfPQLOtNrbfbI0S+BqfFu51BcOanYT6kRq494XWCKgT4Ko7UBZHFMokIvJgrDMkIY8NhsoQOoGDX56E5l9Z0PwWjoN34k32t/Q/DXWHC1A/UR+dx7eEl4+Xi1qqUI4slElE5KEYDEnI6cGQk4ZCiguKsX3ZYWhW52HjsSY4r4027vOCFj2DjkDd+ybUU+Nwz30NJb8+WcnFhTKJiNwVE6jdlYOHQnIv5OK7d45AoxH49lwCclBa4ycQ+egfcRjqQSUY8lIL1G/ettrXc2tyyc9xQaFMIiKyHoMhKVU2FHLxon67nUMhmb9ewqb306H5qSZSr7dBMUpr/ISqrmJo0xNQj/bH/S+2Ro2QbtW9C88gp/wcJxXKJCIi+zAYkopWq//yNTfqKIR+KGTqVH1hRyvq/xxaewqajy9DsycM+++0ABBp3N/c70+o252H+m/10HVCS3j7OXD5D1vIpSfGQUGp3RxYKJOIiKqPOUNSSUsDkpIsH1fJIq7FBcXY+dERaD7PxcajjXG2JMa4TwUdetQ+AnXiDQybHIvmAxtL126pyKUnRo75ORIWyiQiUhLmDLkbO4ZC8i7l4fvFR6BZr8O351ripiit8ROAO+gffgjqB4owZEY8Qlu1kbrF0pFTT4wc83OqWSiTiIgci8GQVKwc4riW54+1Y3dAs6UGtl1rgyJ0N+6rr7qGofcch3qUH/pNa43A+l0d1VrpSDg8KAm55ufYWCiTiIich8GQVBIT9V9slQyFCABXVOGIekYNHUqDgqa+GVC3PQf1hBB0f7KVfPJ/rCW3nhg55+dUtRgwERG5DIMhqZQZChEqFVRlAiId9EMhE8WH0MEb3WodhrrndagnxyB+UGOovOJc1erqk1tPjIWg1Jifk+iioNPcGndERORSDIYkcjvrNn7cE4kLoW/iwSvLEYVLxn0XEYX/Bk3GQHV9LJ+RjfA2rV3YUonJrSeG+TlERGQjziarhqxD2di0+AQ0PwTgp+w2KIR+jS8vaDEYmzEwdD9aJYWiw7v/h1pRwZJdV1bkOlPK3Oy2mBjm5xARuREuxyEhqV5MoRM48e2f0CzLhOaXevj1disIlK7x1djnHNRtMqB+rA56PpMAn4AqOt7kUpNHCobZZID5nhhXrbvlSa8xEZECMRiSUHVeTG2RFrs/OQrNyhvQ/NEQ6cWm+T2dax6FuvtVqCdGoZX6Hqi8VJZPKpeaPFJiTwwREUmMwZCEbH0xC64VYMt7h6FZW4RvTsfjqmhg3OeHQtxb/xDU/e5g6LSmiOpkYy6MJ69ezp4YIiKSEIOhSixYsACvvvoqXnjhBSxZssSq51jzYmYfvYpvFp+A5ns/bMlqjTsINO6ro7qFwQ2PQj3CCw/MSEDtyNr2NV6O1ZGJiIhkihWozdi7dy9WrFiBNm2kqcZ88rs/ofnneWh+DsHuvAQIlE63buh9AeqEM1CPC0LicwnwDexZ/QvKrSYPERERuU8wdPv2bfzf//0f/v3vf+Ott96y6xy6Eh12rziMDZ9eh+ZgLE4WNQZQus5Xx8BjGNY1G+pnI9BmVDOovKIlav1f5FaTh4iIiNwnGJo0aRIGDx6M+++/32IwVFhYiMLCQuPj3NxcAECz+tdxVZTW+PFFEZLqHYL6/nwMm94M0Z1bAmjpkPYDkF9NHiIiInKPYOiLL77A/v37sXfvXquOX7BgAebNm1dh+1XRAMHIwaCGR6BWq/DA9FYIju0kdXMrJ/fqyERERArkZfkQ18rMzMQLL7yA1atXIyAgwKrnzJo1Czk5OcafzMxMAMD6OQeQnVcDyWd74uGlPRAcW64QolYLpKUBa9bof2u10t2IYaaVuZlkAKsjExERuYjsZ5Nt2LABI0aMgHeZAEGr1UKlUsHLywuFhYUm+8yxKhvdkbV/zJ3b29s02Cpfk4fT1ImISOE4tf4veXl5OHfunMm2CRMmID4+Hq+88goSEhIsnsPii+nI2j9VnVsIYOpU/UrmPXoAu3bpg5/0dGDFCv1wmoG7F2UkIiKyEafW/6V27doVAp6aNWuiXr16VgVCJr7+GmjSxLSXRavV99qYiwmF0ActhoDF1p4Za869bp0+EGrSpOpp9xcv6oMqORdlZG8WERG5IdnnDEnqySeBpCR94cOUFP02W2r/2Mrac48eXfVxhmMBfWAmZS6TVFJS9K9rUhIwdmzF15mIiEimZN8zZE5aWlr1TlC2l6XMFPwq2VP7R+p6QXItyljZUKA79GYREZHiKatnyKBsL0toqHXPsaf2j6PqBcmpKKOloUBAvr1ZREREUGowBJT2sgD65GRVJavNq1T6mV721P4x1BWq7Nz2klNRRkcOMxIRETmBcoMhg+xs/SwtoGLQUt3aP97els9ti+oEZo7CJUaIiMjNMRiKiNDns6xdC0RFme6Ljq5+vktV5/76a+t7juRalJFLjBARkZuTfZ0hKRjrFAAwVikwLH2RkWE6zd5RU8MrO7ch+Rgwn3djUL4oo1xotfpZY5aWGCn7OhMREVmBRRclVCEYkqKYopQqq3791FNA06byr9lTWUAnt9eZiIjcCoMhCVUIhuTYy+LuBQvNBXRyfJ2JiMhtMBiSkPHF/OQTBJWvQE3ScfeAjoiIZIXLcTjCQw8BDnwxFc/bW17FIImIiKzA2WRERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRVNWArXccTYWERGR0zEYkovKCi8uXco6PURERA7EYTI5MFRwLr/6+8WL+u0pKa5pFxERkQIwGHI1rVbfI2Su9qVh29Sp+uOIiIhIcgyGXG3nzoo9QmUJAWRm6o8jIiIiyTEYcrXLl6U9joiIiGzCYMjVIiKkPY6IiIhswmDI1RIT9bPGVCrz+1Uq/erviYnObRcREZFCMBhyNW9v/fR5oGJAZHi8ZAnrDRERETkIgyE5GDkSWLsWiIoy3R4drd/OOkNEREQOw6KLcjFyJKBWswI1ERGRkzEYkhNvb6BvX1e3goiISFE4TEZERESKxmCIiIiIFI3BEBERESkagyEiIiJSNAZDREREpGgMhoiIiEjRGAwRERGRojEYIiIiIkVjMERERESKxmCIiIiIFI3BEBERESkagyEiIiJSNAZDREREpGiyD4YWLFiAzp07o3bt2ggNDcXw4cNx8uRJVzeLiIiIPITsg6Ht27dj0qRJ2LNnD7Zs2YKSkhL0798f+fn5rm4aEREReQCVEEK4uhG2uHr1KkJDQ7F9+3b07t3bqufk5uYiODgYOTk5CAoKcnALiYiISArO+v72cdiZHSQnJwcAEBISUukxhYWFKCwsND7Ozc11eLuIiIjIPcl+mKwsIQSmTZuGXr16ISEhodLjFixYgODgYONPTEyME1tJRERE7sSthskmTZqEzZs34+eff0Z0dHSlx5nrGYqJieEwGRERkRvhMFk5U6ZMwcaNG7Fjx44qAyEA8Pf3h7+/v5NaRkRERO5M9sGQEAJTpkzB+vXrkZaWhri4OFc3iYiIiDyI7IOhSZMmITk5GRqNBrVr10ZWVhYAIDg4GDVq1HBx64iIiMjdyT5nSKVSmd2+cuVKPP7441adg1PriYiI3A9zhv4i81iNiIiI3JxbTa0nIiIikhqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUjcEQERERKRqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUjcEQERERKRqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUjcEQERERKRqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUjcEQERERKRqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRXObYGj58uWIi4tDQEAAOnbsiJ07d7q6SUREROQB3CIY+vLLLzF16lTMnj0bBw4cQGJiIgYOHIjz58+7umlERETk5lRCCOHqRljStWtXdOjQAR999JFxW4sWLTB8+HAsWLDA4vNzc3MRHByMnJwcBAUFObKpREREJBFnfX/LvmeoqKgI+/btQ//+/U229+/fH7t27XJRq4iIiMhT+Li6AZZcu3YNWq0WYWFhJtvDwsKQlZVl9jmFhYUoLCw0Ps7JyQGgjzCJiIjIPRi+tx09iCX7YMhApVKZPBZCVNhmsGDBAsybN6/C9piYGIe0jYiIiBzn+vXrCA4Odtj5ZR8M1a9fH97e3hV6gbKzsyv0FhnMmjUL06ZNMz6+desWGjZsiPPnzzv0xZSb3NxcxMTEIDMzU1G5Urxv3rcS8L5530qQk5OD2NhYhISEOPQ6sg+G/Pz80LFjR2zZsgUjRowwbt+yZQvUarXZ5/j7+8Pf37/C9uDgYEX9IzIICgrifSsI71tZeN/KotT79vJybIqz7IMhAJg2bRrGjRuHTp06oXv37lixYgXOnz+PZ5991tVNIyIiIjfnFsHQww8/jOvXr+ONN97A5cuXkZCQgG+//RYNGzZ0ddOIiIjIzblFMAQAEydOxMSJE+16rr+/P+bMmWN26MyT8b5530rA++Z9KwHv27H37RZFF4mIiIgcRfZFF4mIiIgcicEQERERKRqDISIiIlI0BkNERESkaG4ZDC1fvhxxcXEICAhAx44dsXPnziqP3759Ozp27IiAgAA0btwYH3/8cYVj1q1bh5YtW8Lf3x8tW7bE+vXrHdV8u9ly3ykpKejXrx8aNGiAoKAgdO/eHT/88IPJMatWrYJKparwc/fuXUffik1sue+0tDSz93TixAmT4zzt/X788cfN3nerVq2Mx7jD+71jxw4MHToUkZGRUKlU2LBhg8XneMLn29b79pTPt6337Smfb1vv21M+3wsWLEDnzp1Ru3ZthIaGYvjw4Th58qTF5znjM+52wdCXX36JqVOnYvbs2Thw4AASExMxcOBAnD9/3uzxGRkZGDRoEBITE3HgwAG8+uqreP7557Fu3TrjMbt378bDDz+McePG4Y8//sC4ceMwevRo/Prrr866LYtsve8dO3agX79++Pbbb7Fv3z4kJSVh6NChOHDggMlxQUFBuHz5sslPQECAM27JKrbet8HJkydN7qlp06bGfZ74fi9dutTkfjMzMxESEoKHHnrI5Di5v9/5+flo27Ytli1bZtXxnvL5tvW+PeXzbet9G7j759vW+/aUz/f27dsxadIk7NmzB1u2bEFJSQn69++P/Pz8Sp/jtM+4cDNdunQRzz77rMm2+Ph4MXPmTLPHv/zyyyI+Pt5k2zPPPCO6detmfDx69GjxwAMPmBwzYMAA8cgjj0jU6uqz9b7NadmypZg3b57x8cqVK0VwcLBUTXQIW+87NTVVABA3b96s9JxKeL/Xr18vVCqVOHv2rHGbO7zfZQEQ69evr/IYT/l8l2XNfZvjjp/vsqy5b0/5fJdlz/vtCZ9vIYTIzs4WAMT27dsrPcZZn3G36hkqKirCvn370L9/f5Pt/fv3x65du8w+Z/fu3RWOHzBgAH7//XcUFxdXeUxl53Q2e+67PJ1Oh7y8vAqL3d2+fRsNGzZEdHQ0hgwZUuEvS1eqzn23b98eERERuO+++5CammqyTwnv96effor777+/QpV2Ob/f9vCEz7cU3PHzXR3u/PmWgqd8vnNycgCgykVYnfUZd6tg6Nq1a9BqtRVWqw8LC6uwqr1BVlaW2eNLSkpw7dq1Ko+p7JzOZs99l/fuu+8iPz8fo0ePNm6Lj4/HqlWrsHHjRqxZswYBAQHo2bMn0tPTJW2/vey574iICKxYsQLr1q1DSkoKmjdvjvvuuw87duwwHuPp7/fly5fx3Xff4cknnzTZLvf32x6e8PmWgjt+vu3hCZ/v6vKUz7cQAtOmTUOvXr2QkJBQ6XHO+oy7zXIcZalUKpPHQogK2ywdX367red0BXvbuGbNGsydOxcajQahoaHG7d26dUO3bt2Mj3v27IkOHTrgn//8Jz744APpGl5Nttx38+bN0bx5c+Pj7t27IzMzE4sXL0bv3r3tOqer2NvGVatWoU6dOhg+fLjJdnd5v23lKZ9ve7n759sWnvT5tpenfL4nT56MQ4cO4eeff7Z4rDM+427VM1S/fn14e3tXiPays7MrRIUG4eHhZo/38fFBvXr1qjymsnM6mz33bfDll1/iiSeewFdffYX777+/ymO9vLzQuXNn2fwlUZ37Lqtbt24m9+TJ77cQAp999hnGjRsHPz+/Ko+V2/ttD0/4fFeHO3++peJun+/q8JTP95QpU7Bx40akpqYiOjq6ymOd9Rl3q2DIz88PHTt2xJYtW0y2b9myBT169DD7nO7du1c4/scff0SnTp3g6+tb5TGVndPZ7LlvQP8X4+OPP47k5GQMHjzY4nWEEDh48CAiIiKq3WYp2Hvf5R04cMDknjz1/Qb0szVOnz6NJ554wuJ15PZ+28MTPt/2cvfPt1Tc7fNdHe7++RZCYPLkyUhJScG2bdsQFxdn8TlO+4xbnWotE1988YXw9fUVn376qTh27JiYOnWqqFmzpjGrfubMmWLcuHHG4//8808RGBgoXnzxRXHs2DHx6aefCl9fX7F27VrjMb/88ovw9vYW//jHP8Tx48fFP/7xD+Hj4yP27Nnj9PurjK33nZycLHx8fMSHH34oLl++bPy5deuW8Zi5c+eK77//Xpw5c0YcOHBATJgwQfj4+Ihff/3V6fdXGVvv+/333xfr168Xp06dEkeOHBEzZ84UAMS6deuMx3ji+23w6KOPiq5du5o9pzu833l5eeLAgQPiwIEDAoB47733xIEDB8S5c+eEEJ77+bb1vj3l823rfXvK59vW+zZw98/3c889J4KDg0VaWprJv9uCggLjMa76jLtdMCSEEB9++KFo2LCh8PPzEx06dDCZljd+/HjRp08fk+PT0tJE+/bthZ+fn2jUqJH46KOPKpzz66+/Fs2bNxe+vr4iPj7e5MMlF7bcd58+fQSACj/jx483HjN16lQRGxsr/Pz8RIMGDUT//v3Frl27nHhH1rHlvhcuXCiaNGkiAgICRN26dUWvXr3E5s2bK5zT095vIYS4deuWqFGjhlixYoXZ87nD+22YOl3Zv1tP/Xzbet+e8vm29b495fNtz79zT/h8m7tnAGLlypXGY1z1GVf91UAiIiIiRXKrnCEiIiIiqTEYIiIiIkVjMERERESKxmCIiIiIFI3BEBERESkagyEiIiJSNAZDREREpGgMhoiIiEjRGAwRERGRojEYIiIiIkVjMEREbmnNmjUICAjAxYsXjduefPJJtGnTBjk5OS5sGRG5G65NRkRuSQiBdu3aITExEcuWLcO8efPwySefYM+ePYiKinJ184jIjfi4ugFERPZQqVSYP38+Ro0ahcjISCxduhQ7d+5kIERENmPPEBG5tQ4dOuDo0aP48ccf0adPH1c3h4jcEHOGiMht/fDDDzhx4gS0Wi3CwsJc3RwiclPsGSIit7R//3707dsXH374Ib744gsEBgbi66+/dnWziMgNMWeIiNzO2bNnMXjwYMycORPjxo1Dy5Yt0blzZ+zbtw8dO3Z0dfOIyM2wZ4iI3MqNGzfQs2dP9O7dG//617+M29VqNQoLC/H999+7sHVE5I4YDBEREZGiMYGaiIiIFI3BEBERESkagyEiIiJSNAZDREREpGgMhoiIiEjRGAwRERGRojEYIiIiIkVjMERERESKxmCIiIiIFI3BEBERESkagyEiIiJSNAZDREREpGj/D1XGC/oCuJA+AAAAAElFTkSuQmCC", - "text/plain": [ - "
" - ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], + "execution_count": 16, + "id": "4674f449", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "# Using Autograd to calculate gradients for OLS\n", "from random import random, seed\n", @@ -1875,95 +1948,23 @@ }, { "cell_type": "markdown", - "id": "f952160a", - "metadata": {}, + "id": "7c4e2d90", + "metadata": { + "editable": true + }, "source": [ "## Same code but now with momentum gradient descent" ] }, { "cell_type": "code", - "execution_count": 52, - "id": "b0595e43", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Own inversion\n", - "[[4.]\n", - " [3.]]\n", - "Eigenvalues of Hessian Matrix:[0.25823312 3.94225609]\n", - "0 [-12.96884773] [-13.21205258]\n", - "1 [-0.22528633] [0.21334212]\n", - "2 [-0.21052919] [0.19936738]\n", - "3 [-0.19673871] [0.18630804]\n", - "4 [-0.18385156] [0.17410414]\n", - "5 [-0.17180857] [0.16269964]\n", - "6 [-0.16055444] [0.15204218]\n", - "7 [-0.1500375] [0.14208282]\n", - "8 [-0.14020946] [0.13277585]\n", - "9 [-0.13102519] [0.12407851]\n", - "10 [-0.12244253] [0.11595089]\n", - "11 [-0.11442207] [0.10835565]\n", - "12 [-0.10692698] [0.10125793]\n", - "13 [-0.09992285] [0.09462515]\n", - "14 [-0.09337751] [0.08842683]\n", - "15 [-0.08726092] [0.08263453]\n", - "16 [-0.08154499] [0.07722165]\n", - "17 [-0.07620348] [0.07216333]\n", - "18 [-0.07121185] [0.06743635]\n", - "19 [-0.0665472] [0.063019]\n", - "20 [-0.0621881] [0.05889101]\n", - "21 [-0.05811453] [0.05503342]\n", - "22 [-0.05430781] [0.05142852]\n", - "23 [-0.05075043] [0.04805975]\n", - "24 [-0.04742608] [0.04491165]\n", - "25 [-0.04431949] [0.04196976]\n", - "26 [-0.04141639] [0.03922058]\n", - "27 [-0.03870346] [0.03665148]\n", - "28 [-0.03616823] [0.03425066]\n", - "29 [-0.03379907] [0.03200711]\n", - "theta from own gd\n", - "[[3.87768766]\n", - " [3.1158276 ]]\n", - "0 [-0.0315851] [0.02991052]\n", - "1 [-0.02951615] [0.02795127]\n", - "2 [-0.02696204] [0.02553257]\n", - "3 [-0.02442969] [0.02313448]\n", - "4 [-0.02206975] [0.02089966]\n", - "5 [-0.01991611] [0.0188602]\n", - "6 [-0.01796544] [0.01701295]\n", - "7 [-0.01620343] [0.01534436]\n", - "8 [-0.01461344] [0.01383866]\n", - "9 [-0.0131792] [0.01248047]\n", - "10 [-0.01188564] [0.01125549]\n", - "11 [-0.01071902] [0.01015072]\n", - "12 [-0.0096669] [0.00915438]\n", - "13 [-0.00871804] [0.00825583]\n", - "14 [-0.00786232] [0.00744547]\n", - "15 [-0.00709059] [0.00671466]\n", - "16 [-0.00639461] [0.00605558]\n", - "17 [-0.00576694] [0.00546119]\n", - "18 [-0.00520089] [0.00492515]\n", - "19 [-0.00469039] [0.00444172]\n", - "20 [-0.00423] [0.00400574]\n", - "21 [-0.0038148] [0.00361255]\n", - "22 [-0.00344036] [0.00325796]\n", - "23 [-0.00310267] [0.00293817]\n", - "24 [-0.00279813] [0.00264978]\n", - "25 [-0.00252348] [0.00238969]\n", - "26 [-0.00227578] [0.00215513]\n", - "27 [-0.0020524] [0.00194359]\n", - "28 [-0.00185095] [0.00175281]\n", - "29 [-0.00166927] [0.00158077]\n", - "theta from own gd wth momentum\n", - "[[3.99417031]\n", - " [3.00552061]]\n" - ] - } - ], + "execution_count": 17, + "id": "be5e6b23", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "# Using Autograd to calculate gradients for OLS\n", "from random import random, seed\n", @@ -2022,8 +2023,10 @@ }, { "cell_type": "markdown", - "id": "43200e36", - "metadata": {}, + "id": "0002f816", + "metadata": { + "editable": true + }, "source": [ "## Including Stochastic Gradient Descent with Autograd\n", "In this code we include the stochastic gradient descent approach discussed above. Note here that we specify which argument we are taking the derivative with respect to when using **autograd**." @@ -2031,43 +2034,13 @@ }, { "cell_type": "code", - "execution_count": 53, - "id": "b369d846", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Own inversion\n", - "[[4.23287562]\n", - " [2.86347636]]\n", - "Eigenvalues of Hessian Matrix:[0.31306035 4.34432759]\n", - "theta from own gd\n", - "[[4.23287562]\n", - " [2.86347636]]\n" - ] - }, - { - "data": { - "image/png": "iVBORw0KGgoAAAANSUhEUgAAAkMAAAHFCAYAAADxOP3DAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjguMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy81sbWrAAAACXBIWXMAAA9hAAAPYQGoP6dpAABVxUlEQVR4nO3deVxU5f4H8M8BBFwABQXZVNwBc98Nl3JhMtO8ZlmZdqtbuWW26a170+4tr95u5ZLX/N3SeyvMSrRuNZgpqOUSbnXdl1ARQVwBQbaZ5/fHyMjADLMwyzlzPu/XixevOeeZM885w3C+8zzf53kkIYQAERERkUr5eLoCRERERJ7EYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIhIhtasWQNJkow/fn5+iIyMxEMPPYSTJ096rF7z58+HJEkee30lOHPmDCRJwttvv+3pqhCRjfw8XQEismz16tXo3LkzSktL8dNPP+HNN99Eeno6jh07hmbNmnm6ekREXoHBEJGMdenSBb179wYADB06FDqdDq+//jo2btyIxx9/3MO1I0+qqKgwthoSUf2wm4xIQaoCo4sXLxq3lZaW4oUXXkD37t0REhKC0NBQDBgwAF999VWt50uShBkzZuDjjz9GfHw8GjVqhG7duuGbb76pVfbbb79F9+7dERAQgLi4OIvdPqWlpZg3bx7i4uLg7++P6OhoTJ8+HdevXzcp16ZNG9x777345ptv0KNHDzRs2BDx8fHG116zZg3i4+PRuHFj9O3bF3v37rV6Paq6E9PT0/Hss8+iefPmCAsLw/jx43HhwoVa5z5//vxax2jTpg2mTp1a65hbt27FU089hbCwMAQHB+Oxxx5DcXEx8vLyMHHiRDRt2hSRkZF48cUXUVFRUeu4er0eb775Jlq1aoXAwED07t0bW7ZsqVXu5MmTePjhhxEeHo6AgADEx8fj/fffNymTkZEBSZLw8ccf44UXXkB0dDQCAgJw6tQplJSU4MUXX0RcXBwCAwMRGhqK3r17Y+3atVavHxEZ8CsFkYJkZWUBADp27GjcVlZWhqtXr+LFF19EdHQ0ysvL8cMPP2D8+PFYvXo1HnvsMZNjfPvtt8jMzMQbb7yBJk2aYPHixbj//vtx/PhxtG3bFgCwZcsWjB07FgMGDMBnn30GnU6HxYsXmwRhACCEwLhx47BlyxbMmzcPSUlJ+PXXX/H6669j165d2LVrFwICAozlf/nlF8ybNw+vvvoqQkJCsGDBAowfPx7z5s3Dli1b8NZbb0GSJLzyyiu49957kZWVhYYNG1q9Lk8++SRGjx6NlJQUZGdn46WXXsKjjz6KrVu3Onytn3zySYwfPx6fffYZDhw4gD/+8Y+orKzE8ePHMX78ePzhD3/ADz/8gEWLFiEqKgpz5swxef7y5cvRunVrvPfee9Dr9Vi8eDE0Gg22bduGAQMGAACOHDmCgQMHolWrVvjHP/6Bli1bYtOmTZg1axYuX76M119/3eSY8+bNw4ABA7By5Ur4+PggPDwcc+bMwccff4y//vWv6NGjB4qLi3Ho0CFcuXLF4XMnUh1BRLKzevVqAUDs3r1bVFRUiKKiIpGWliZatmwpBg8eLCoqKiw+t7KyUlRUVIgnnnhC9OjRw2QfABERESEKCwuN2/Ly8oSPj49YuHChcVu/fv1EVFSUuHnzpnFbYWGhCA0NFdX/baSlpQkAYvHixSavs27dOgFArFq1yritdevWomHDhuL8+fPGbQcPHhQARGRkpCguLjZu37hxowAgvv76a5uu07Rp00y2L168WAAQubm5Juf++uuv1zpG69atxZQpU2odc+bMmSblxo0bJwCId955x2R79+7dRc+ePY2Ps7KyBACL12/48OHGbaNGjRIxMTGioKDA5JgzZswQgYGB4urVq0IIIdLT0wUAMXjw4Fr179Klixg3blyt7URkO3aTEclY//790aBBAwQFBSE5ORnNmjXDV199VStP5IsvvsCgQYPQpEkT+Pn5oUGDBvjwww9x9OjRWsccNmwYgoKCjI8jIiIQHh6Os2fPAgCKi4uRmZmJ8ePHIzAw0FguKCgIY8aMMTlWVctL9W4mAHjggQfQuHHjWt1C3bt3R3R0tPFxfHw8AEM+VKNGjWptr6qTNffdd5/J465du9r1fHPuvfdek8dVdRo9enSt7eZex9L12759O3Q6HUpLS7Flyxbcf//9aNSoESorK40/99xzD0pLS7F7926TY/7ud7+r9Tp9+/aFVqvF3LlzkZGRgZs3bzp8zkRqxWCISMb+85//IDMzE1u3bsXTTz+No0ePYtKkSSZlUlNTMXHiRERHR+OTTz7Brl27kJmZid///vcoLS2tdcywsLBa2wICAow30WvXrkGv16Nly5a1ytXcduXKFfj5+aFFixYm2yVJQsuWLWt11YSGhpo89vf3r3O7ufqbU/Ocqrrm6hMY2FNXc/W0dP3Ky8tx48YNXLlyBZWVlVi2bBkaNGhg8nPPPfcAAC5fvmzy/MjIyFrHXLp0KV555RVs3LgRw4YNQ2hoKMaNG+fRKRiIlIY5Q0QyFh8fb0yaHjZsGHQ6Hf71r3/hyy+/xIQJEwAAn3zyCeLi4rBu3TqTOYDKysoces1mzZpBkiTk5eXV2ldzW1hYGCorK3Hp0iWTgEgIgby8PPTp08ehOrhCQECA2WviqtwaS9fP398fTZo0QYMGDeDr64vJkydj+vTpZo8RFxdn8tjcHE+NGzfGggULsGDBAly8eNHYSjRmzBgcO3bMOSdD5OXYMkSkIIsXL0azZs3w5z//GXq9HoDhBunv729yo8zLyzM7mswWVaO5UlNTTVo8ioqK8N///tek7N133w3AEJBVt379ehQXFxv3y0GbNm3w66+/mmzbunUrbty44ZLXs3T9kpKS4Ovri0aNGmHYsGE4cOAAunbtit69e9f6MdeKV5eIiAhMnToVkyZNwvHjx1FSUuLs0yLySmwZIlKQZs2aYd68eXj55ZeRkpKCRx99FPfeey9SU1Mxbdo0TJgwAdnZ2fjLX/6CyMhIh7tK/vKXvyA5ORkjRozACy+8AJ1Oh0WLFqFx48a4evWqsdyIESMwatQovPLKKygsLMSgQYOMo8l69OiByZMnO+vU623y5Mn405/+hD//+c8YMmQIjhw5guXLlyMkJMQlr+fr64sRI0Zgzpw50Ov1WLRoEQoLC7FgwQJjmSVLluDOO+9EUlISnn32WbRp0wZFRUU4deoU/vvf/9o0Gq5fv36499570bVrVzRr1gxHjx7Fxx9/jAEDBpjkYRGRZQyGiBRm5syZWL58Od544w1MmjQJjz/+OPLz87Fy5Up89NFHaNu2LebOnYvz58+b3HjtMWLECGzcuBGvvfYaHnzwQbRs2RLTpk3DzZs3TY4pSRI2btyI+fPnY/Xq1XjzzTfRvHlzTJ48GW+99ZbJsHpPe+mll1BYWIg1a9bg7bffRt++ffH5559j7NixLnm9GTNmoLS0FLNmzUJ+fj4SExPx7bffYtCgQcYyCQkJ2L9/P/7yl7/gtddeQ35+Ppo2bYoOHToY84asueuuu/D111/j3XffRUlJCaKjo/HYY4/h1Vdfdcl5EXkjSQghPF0JIiIiIk9hzhARERGpGoMhIiIiUjUGQ0RERKRqDIaIiIhI1RgMERERkaoxGCIiIiJVU8U8Q3q9HhcuXEBQUJDZ6eyJiIhIfoQQKCoqQlRUFHx8XNd+o4pg6MKFC4iNjfV0NYiIiMgB2dnZiImJcdnxVREMBQUFATBczODgYA/XhoiIiGxRWFiI2NhY433cVVQRDFV1jQUHBzMYIiIiUhhXp7gwgZqIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUzePB0Pbt2zFmzBhERUVBkiRs3LjRYtmnn34akiThvffec1v9iIiIyLt5PBgqLi5Gt27dsHz58jrLbdy4EXv27EFUVJSbakZERERq4OfpCmg0Gmg0mjrL5OTkYMaMGdi0aRNGjx7tppoRERGRGni8ZcgavV6PyZMn46WXXkJiYqKnq0NERERexuMtQ9YsWrQIfn5+mDVrls3PKSsrQ1lZmfFxYWGhK6pGREREXkDWLUP79u3DkiVLsGbNGkiSZPPzFi5ciJCQEONPbGysC2tJRERESibrYGjHjh3Iz89Hq1at4OfnBz8/P5w9exYvvPAC2rRpY/F58+bNQ0FBgfEnOzvbfZUmIiIiRZF1N9nkyZMxfPhwk22jRo3C5MmT8fjjj1t8XkBAAAICAlxdPSIiIvICHg+Gbty4gVOnThkfZ2Vl4eDBgwgNDUWrVq0QFhZmUr5BgwZo2bIlOnXq5O6qEhERkRfyeDC0d+9eDBs2zPh4zpw5AIApU6ZgzZo1HqoVERERqYXHg6GhQ4dCCGFz+TNnzriuMkRERKQ6sk6gJiIiInI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUzePB0Pbt2zFmzBhERUVBkiRs3LjRuK+iogKvvPIK7rjjDjRu3BhRUVF47LHHcOHCBc9VmIiIiLyKx4Oh4uJidOvWDcuXL6+1r6SkBPv378ef/vQn7N+/H6mpqThx4gTuu+8+D9SUiIiIvJEkhBCerkQVSZKwYcMGjBs3zmKZzMxM9O3bF2fPnkWrVq1sOm5hYSFCQkJQUFCA4OBgJ9WWiIiIXMld928/lx3ZRQoKCiBJEpo2bWqxTFlZGcrKyoyPCwsL3VAzIiIiUiKPd5PZo7S0FHPnzsXDDz9cZ4S4cOFChISEGH9iY2PdWEsiIiJSEsUEQxUVFXjooYeg1+uxYsWKOsvOmzcPBQUFxp/s7Gw31ZKIiIiURhHdZBUVFZg4cSKysrKwdetWq/2GAQEBCAgIcFPtiIiISMlkHwxVBUInT55Eeno6wsLCPF0lIiIi8iIeD4Zu3LiBU6dOGR9nZWXh4MGDCA0NRVRUFCZMmID9+/fjm2++gU6nQ15eHgAgNDQU/v7+nqo2EREReQmPD63PyMjAsGHDam2fMmUK5s+fj7i4OLPPS09Px9ChQ216DQ6tJyIiUh7VDK0fOnQo6orHZDQNEhEREXkhxYwmIyIiInIFBkNERESkah7vJiMiIiIZ0umAHTuA3FwgMhJISgJ8fT1dK5dgMERERESmUlOB554Dzp+/vS0mBliyBBg/3nP1chF2kxEREdFtqanAhAmmgRAA5OQYtqemeqZeLsRgiIiIiAx0OkOLkLmR3FXbZs82lPMiDIaIiIjIYMeO2i1C1QkBZGcbynkRBkNERERkkJvr3HIKwWCIiIiIDCIjnVtOIRgMERERkUFSkmHUmCSZ3y9JQGysoZwXYTBEREREBr6+huHzQO2AqOrxe+953XxDDIaIiIjotvHjgS+/BKKjTbfHxBi2e+E8Q5x0kYiIiEyNHw+MHcsZqImIiEjFfH2BoUM9XQu3YDcZERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqcdV6IiIiW+h0wI4dQG4uEBkJJCUZVnYnxWMwREREZE1qKvDcc8D587e3xcQAS5YA48d7rl7kFOwmIyIiqktqKjBhgmkgBAA5OYbtqameqRc5DYMhIiIiS3Q6Q4uQELX3VW2bPdtQTm50OiAjA1i71vBbjnWUCQZDREREluzYUbtFqDohgOxsQzk5SU0F2rQBhg0DHn7Y8LtNG7ZiWcBgiIiIyJLcXOeWcwd269mNwRAREZElkZHOLedqSu7W8yAGQ0RERJYkJRlGjUmS+f2SBMTGGsrJgVK79TyMQ+uJiIgs8fU1DJ+fMMEQ+FRvcakKkN57Tz7zDdWnW89Z8yiVlwMrVgCnTwPt2gHTpgH+/vYfx43YMkRERN6tvqOqxo8HvvwSiI423R4TY9gup3mGHO3Wc1bC9csvA40aAc8/DyxfbvjdqJFhu4xJQpjrWPQuhYWFCAkJQUFBAYKDgz1dHSIichdnTpaohBmodTpDEJOTYz5vSJIM55+VdbvuVQnXNctXtXzZGvC9/DLw979b3v/SS8DixTadRhV33b893jK0fft2jBkzBlFRUZAkCRs3bjTZL4TA/PnzERUVhYYNG2Lo0KE4fPiwZypLRETK4exRVb6+wNChwKRJht9yC4SA2916QO08J3Pdes5KuC4vB955p+4y77xjKCdDHg+GiouL0a1bNyxfvtzs/sWLF+Odd97B8uXLkZmZiZYtW2LEiBEoKipyc02JiEgx1Dyqyp5uPWclXK9YYf1a6nSGcjLk8QRqjUYDjUZjdp8QAu+99x5effVVjL/15v373/9GREQEUlJS8PTTT7uzqkREpBT23OSHDnVbtdxm/Hhg7Fjr3XrOmkfp9GnbjmNrOTfzeDBUl6ysLOTl5WHkyJHGbQEBARgyZAh27txpMRgqKytDWVmZ8XFhYaHL60pERDKixMkSna2qW68uzppHqV07245jazk383g3WV3y8vIAABERESbbIyIijPvMWbhwIUJCQow/sbGxLq0nERHJjNImS/QUZ82jNG2a9RwqX19DORtcy7qOdc/txLM9dtpUvr5kHQxVkWq8SUKIWtuqmzdvHgoKCow/2dnZrq4iERHJidImS/QUexOuLfH3B+bMqbvMnDkW5xvSV+qx9z9H8NfhGRgU/Cuatw3CQ0sHIuW3gdbPwQlkHQy1bNkSAGq1AuXn59dqLaouICAAwcHBJj9ERKQizrrJq4Gz5lFavNgwfL7mNfX1NTus/srJq1g7cycea/cjIv2voM+UBPxpy1DsLOoKPXyRGHASM3u4Z6ZsWecMxcXFoWXLlti8eTN69OgBACgvL8e2bduwaNEiD9eOiIhkreomb26eoffek9dkiZ5ma8K1NYsXA3/9q9kZqPWVeuz9+Ci0/7mEtL1h+PlGAvS43fLTBEUYHnkYmrvKkTy9HVoN6IDCwggsC3HyuZrh8WDoxo0bOHXqlPFxVlYWDh48iNDQULRq1QqzZ8/GW2+9hQ4dOqBDhw5466230KhRIzz88MMerDURESmCs27yamBLwrUt/P0N0xYAuHz8CjbNzoRWC2w62wmXRaJJ0TsCT0DT9QI0k5pi4JMJ8G/Sv/6v7wCPB0N79+7FsGHDjI/n3OpznDJlCtasWYOXX34ZN2/exLRp03Dt2jX069cP33//PYKCgjxVZSIiUhJn3eTJKl25Dpn/OQrtx5eRtq85MosTIDDIuD8YBRgRfQSa4ZUYNb09Yvp0BNDRcxW+hctxEBERkcPyD1/CpmXHoU2T8P25zrgiwkz2dws8Dk33XGgeboYBTySgQaMGNh/bXfdvj7cMERERkXLoynXYs/oItJ9cgXZ/OPaVJABoYdwfggKMjDkCzYhKjJrRAVE9OwHo5LH62oLBEJEnKWHhRyJSFzP/l/IOX0Ha0hNI+94H35+PxzVxh8lTejQ8Ck2Pi9A8Eor+v0+AX+AAD1XeMQyGiDzFmatpExE5g5n/S3mIwDSswAbc/r/UTLqGkTFHoRmlx6iZHdGyazyA+NrHU8gXPuYMEXlC1WraNT9+VfOf2DO3BxGRE1x9+0M0e+lJAED1mZn0tx7N9X8Xgf26IfmRMPSdEg+/QCvtKU74wueu+zeDISJ30+mANm0sLyIpSYZ/GFlZsvwGReRSCmlJcBsXXo+Kkgrs+vAItCnXsOlAOL4qG4VonDc7G7OQJEj2/F9y0hc+d92/ZT0DNZFXsmc1bSI1SU01fFEYNgx4+GHD7zZtDNttpdMBGRnA2rWG3zqda+rqDs64HjWcz8zFv6bswO+id6N54xIMmdUNf9s9FMFl+Yi1EAgBgGTP/yWdztAiZK6tpWrb7Nmyem+YM0TkblxNm6g2Sy0JOTmG7Z9/DjRvXncLiTfl4Vm7Hja2rJTfKMdPqw4jbV0BtL9G4X+lHQHcXpy2uXQZo1ofxzPtM4AfbKiXLf+X7PnCJ5P5nxgMEbkbV9MmMmVLS8JDD5m2JNQMcuoTPMita87a9ZAkQ8vK2LFm65m95wK0y05Bu9UfW3ITUIQexn0S9OjX5DA0fa5AMyUcvR7pDB+/QUBGBfDDAut1s+X/kgK/8DEYInK3qtW0c3LM/7OryhlS+2rapB7WWhKA2l0q1YOcsWMdDx7k2JpkZ8tKWWEZfvzgMLTrCqE9FIMjZe0BRBmLh0uXkBx3HMn3+GDkrM4I63BH7WM68/+SrV/kTp60rZwbMBgicreq1bQnTDD8g6n+j4eraZMaOdJCUD3ICQlxrFvGSV1RTmfj9fjhj1uxLKshtuQlohg9jdt9oEP/oMPQ9L0KzdQI9HioE3z87qz7YM78v2QtsKoyfz7QpYssujCZQE3kCVWraUdHm26PieGwelIfR7uEq4KcjAzbylcPMuSc5Gvj9fjrrrvwdV4/FKMJWvpcxNT2O7Bu9k5cOlWInwq74rUfhqLXo/Hw8bPxVu+s/0tVgZUtg9VlkkjNliEiT+Fq2kQGtrYk1Ff1IEPOSb63roc4nwMJta+HHhLOIxoiKBhv9s+A5vGW6PZAR/j4Rdj3OuZypZz1f2n8eGDBAuD11y2XqbrGy5YBEREe/R/IYIjIk7iaNlHdXTS2GDoUWLPGvnwXGSb5ll4vxbb3D0H7ZTEqc/+IpZgOAQk+1QIiPQAJAmEr38K2p3taPpg11nKlnPF/qUMH28o9/7z5OrgRu8mIiMjzLHXR+Fi5TYWFGW7cS5YYHlflt1SxlO8ik1Gdp7acxbIJ23BPeCZCm+mR/FpvLDk4BO/rnsWD+AyXpXCT8j4xMZAWLEDjYD/H5lHS6YA33gB+97vaLWNVuVL1mMfIhCPXztl1sBFnoCYiIvmo3nUTHg48+CBw5Yrl8mFhwMWLhkDHXGtHbKwhEKrZ0lA1E7y11iQnzwRfcrkE21YchnZ9CbRHW+NURRuT/dE+udB0OAnNff64e0Y8QqKb3L4eJ08C//d/jo98S00FZs0ynLMlzjxva9fYhjoUFhdzOQ5nYTBERKRAGRmGWZetSU+/3a1j65xBOh3w5pvmc1qcuEag0Auc3HwG2g/OQbu9MbZdSUQpGhr3N0A57mx6GJqBBUj+fRS63N8BktDXPoevvqrf8haWRs5ZUv2a1kfV6wL2d3+mp6OwZ0+33L+ZM0REpHZym3SwiiN5Pbbk4ZlrQaouJsZ8a5KNivOLkbHiCLSpJdAebYPfKuMAxBn3x/rmQNPhNDTjAnD3zAQERd2eFNFs3aKjgdJShydhrHPknCXOypWq6v6s63q7ug42YDBERKRmcpx0sIor8nqstZAsWAC8+qpdwaDQCxxPy4J21TlodwRh+9VElKGPcX8DlGNws0PQDCpE8pMxSBjTDpJPdO0D1TXvUZ0VsDLyzZZJLWtyZq5UzRFqFy+aJk27ow5WsJuMiEitnLSyuMs4O6+n6niWAgM7jncj7wa2LjsM7cYypJ2Iw5nKWJP9rX3P456OJ/FIz6PoNaghAuPj6m5xs1Y3W6SkAJMm1d6+dq1hoVdbuChXyoQd76u7cobYMkREpEb1XP/KLeozK7K5rr96zC0k9AJHvzkN7f+dh/anYOy4lohy9DPu90cZhoQegiapCJo/tEKnkgOQnp8NfHoe+PRWobpa3BxpvanJUkuKvS0srp4BX46z8AsVKCgoEABEQUGBp6tCROQ6lZVCpKcLkZJi+F1ZablseroQhttQ3T/p6e6pe13WrxciJsa0XrGxhu22lo+JEWL2bNvOOSVFCCFEYU6h2DB3t/hD522ilW92rWJt/c6I6XdkiP/+aY+4cfGG6etLUu3jSpLhx1y9U1Jsq5u5H0kyXA9L73dlpeH8zdWp5jWydE1dwYb31V33b3aTERF5A3tzf2ztOrHU9eJutiZ519X1Z+Pt7rN+72LV8SH48XoiKuBv3B6AUgwNOwTN4GJonm6FDiPaQPKpMa+Ro11xto6cM3c8wPbRZID56+BArpRTWHlf3XX/ZjBERKR0juT+ODJsXe5sCUR8fCxOVGhY5iIGcciCHoYbcvsGZ6CJP4vkcQG4q+d1BJZcqzsYc/S62pJHExoKNGxo2zxK5tgzD5NMMBhyIgZDROS1HG2J8NCkgy5lYyBSdbbV23T0tx49jE9R2KI9NINLoHm2Ddrf3dq+Vrf6tLhZar2pHtTWtW6YLa1ncp1GwQK33b9d2gknE8wZIiKvVZ/cn6rclpq5JHXltsiZjXk3/8BscQ6muSpXG4SL/ZMWiZIrJabHtDf/p765WPbmR9X1PHfnALkAc4aciC1DROS16pv7o8CuE4tsbBlKxncIaNEUUxP2YGCSLyLuvsNyK4q9rW7OaHGzt/VG7lMk1IO77t8cWk9EpGT1nZiw5oR4jnSdyKDr5VrWdWxe74vhvi3QVHfZZKX3KgJAaUgENp4ejMCwxgAG1H1QR4biO2PYuC2zaFdRwhQJCsBgiIgsk8FNTnHcfc2SkgwtDdZaIpKSLB/DnptvTR6awVpfqceBz45Du+YitD+HYndRIvRIwv1YiS8xAXpIpgGRJEEC0PCjFUBYY9texJHlQADLS1DUc5kPs+oxdxLdxmCIiMyT8zINcuWJa+bJCezqWj5iwgSnd89cOXkV3y89Bu13emzK6oR8EQ8g3rg/IeAU2nYJxaGExbhjy3vAhWrLWDgSiNSn1c0ZLW62cDRgIxPMGSKi2rw4B8FlPH3N3J3748SlLSzRV+qx79Nj0P47H9rMMPx8I8E45B0AmqAIwyMPQ3NXOZKnt0OrAdXW+3JGC50SRtw5Y4oEGbcAc2i9EzEYIrKDG25yXkcu18ydNzUXzVN0+fgVbFpyDFotsOlsJ1wWzU323xF4Asl3XIDmoRAM+kMi/Jv4WziSk9gy3F3J67fJvAWYCdRE5BnMQbCfXK5ZfXJ/7OWk7hlduQ6Z/zmKtE8uQ7u3OTKLEyAwCADgAx3uwTcY3nQ/OvZtim4LxiOmf0cAHetZeTu4M//HEfXpJnVzN6ecMRgiIlPemIPg6hYTb7xm1tQjnyb/8CVsWnYc2jQJ35/rjCuii8n+boHH8WKrdZiQvwKB1y8C1wF8D+DI3z3TYuGu/B9HORKwcRSaCQZDRGSqvkO15cYd3QDeds1sYccoNl25DntWH4H2kytI2x+OvSUJAFoYi4agACOij0AzohLJMzsg6sxhYMJ8ebVYuLPVzRH2Bmxyac2UCeYMEZEpJSSN2spaUvO6dUCLFvX/tu9N18wedeTTCAAZd/0FH5wYhu/Px+OaaGby1B4Nj0LT4yI0j4Si/+8T4Bd467u5XPKvvJ1CFuplzhAReYYnh2o7k7VuAMDwT776op2Othh5yzWzl4XumTwRgWl4Hxu23L6OTaXrGBlzBJqReoya0QGR3U2HxRuxxcI91NiaWQcGQ0RUm9yTRm1h7aYK1F69vD7dMN5wzex0YX8eNn3TAmliLYpxHUEoQi4isQNJ0MMXvRodgaZnPjSPhqHvlHj4BQ60flBb86pycgwj2uSYw6MEzpis04uwm4yILJPx/CNW2doNUFN9u2GUfM2sqCipwK4Pj0Cbcg3ag5H4pbSTyf5Q6SpGtToKTbLAyBmdENGlhYUj1cHWIfvNmwOXL99+LKPh4Ioh92kDwHmGjCorKzF//nx8+umnyMvLQ2RkJKZOnYrXXnsNPj4+Nh2DwRCRCtl6U7XEzvlxvFXO3lxol51C2hY/bM5JQCFCjPsk6NG78VFoel2CZnJz9HksHr7+9Qz8rOVfWSKjG7iiyHyhXuYM3bJo0SKsXLkS//73v5GYmIi9e/fi8ccfR0hICJ577jlPV4+I5MpaN4A13jQM3g7lN8qx819HoF17Hdpfo/C/0o4AbueNNJcuY1Tr40hOBkbN6oQW8YnOrYC1/CtL76UKh4M7hdynDXAT2QdDu3btwtixYzF69GgAQJs2bbB27Vrs3bvXwzUjIlmr66ZqC5UkjgJA9p4L0C47Be1Wf2zJTUARuhv3SdCjb+Mj0PS5DM1jLdDrkc7w9R/k2gpZyr9q3hy4dMny85hc7Ri5TxvgBrIPhu68806sXLkSJ06cQMeOHfHLL7/gxx9/xHvvvefpqhGR3Fm6qfr61k6erqKCxNHyG+X48YPD0H5WAO3/onG0rC2ScAKRyEJPlOIYOmNk21PQ3OODkbM6I6xDF+sHdTZzLRY5OcCjj1p/rkpb9chxsg+GXnnlFRQUFKBz587w9fWFTqfDm2++iUl1zHtQVlaGsrIy4+PCwkJ3VJWI5MjcTfXyZWDiRMN+lQyDP/vTeWjf/w3a9ABsyUtEMXoAAO5HKrS4C7G4HSyKmBhIf5dBMnLNFouMDNuep6JWPXIO2QdD69atwyeffIKUlBQkJibi4MGDmD17NqKiojBlyhSzz1m4cCEWLFjg5poSkWyZ6waw1A2zYoXngwAnKCssw/YVh5D2ZRG0/4vF0fJ2AGKM+yN88vFqi//DjIuv1XquJNe1qTgcnFxE9qPJYmNjMXfuXEyfPt247a9//Ss++eQTHDt2zOxzzLUMxcbGcjQZEZn64gtg2jSvGaKdtT0b2hW/QZveEFvzE1GCxsZ9vqjEgODDSO57DZqpEeg+oT182rdV3kzPChgO7lFeNrUDR5PdUlJSUmsIva+vL/R6vcXnBAQEICAgwNVVIyIlS00FHnxQXutf2an0eim2vX8I2i+LoT3cCicq4gDEGvdH+uQhud1JaO71w/CZ8WgW1+32kzMylDnTswont7SZO9bh81KyD4bGjBmDN998E61atUJiYiIOHDiAd955B7///e89XTUiUioFr9h9eutZaP95BtptjZB+KRE30du4zxeVGBRyCJr+16H5fSS6TugIyael+QPZmmQsx2RkDgevzdI6fAoK7j1J9t1kRUVF+NOf/oQNGzYgPz8fUVFRmDRpEv785z/D39/fpmNw0kUiMmHrhIwymHjx5tWbyFh+CNr1JdAebY1TFW1M9kf75CK5/Slo7vPD8JkJCGkVYv5ANSnoGpAVXry4LbvJbgkKCsJ7773HofRE5DwybhUReoGTm88gbdU5aLc3QsblLihFH+N+P1TgzqaHoBlQAM0TUehyfwdIPg6MnmIysvfg4rb1JvtgiIgUQu6Jm9Xrd/Gibc9x0xDtksslSF9+GNrUEmiPtsFvlXEA4oz7Y31zoOlwGsn3+ePumQkIjulR/xe1NtMz4JVTDHglGQf3SsFgiIjqT+6Jm+bq58GJF4Ve4HhaFrSrzkG7IwjbryairFrrTwOUI6nZIWgGFkLzVAwSxrSD5BPt/IowGdk72Bq0c/4li+zKGcrOzkZsbKz1gjLDnCGiapzdgmMpcVMuQ50t1c8SF9X7Rt4NpL9/BNoNpdAej8OZStP/pa19z0PT6TdoxgVg2PQEBEUFOe21rZJ7qx7VzdritswZssquYKhx48aYM2cO5s6di8aNG1t/gkwwGCK6xdktOHJP3LRWP6B2C5GTVuwWeoGj35yG9v/OQ/tTMHZcS0Q5bk/54Y8yDA49BM2dRdA8FYvO97SF5CPV6zVJxbx0/iVZBkM7d+7E888/j+zsbLz55pt4/PHHXVYxZ2IwRATXtODIfUSSrfV7910gIqLerSJFF4qwZdkRpH1VBu2JtjinizHZH+d3DprOWdDc3xDDZiSicbhyvlSSApj7suOk4N5TZDmabODAgdizZw/+85//4NVXX8XSpUvx7rvvYiiz08nV2IxfP66aV0fuiZu2vm5EBFDHeoeWCL3A4a9OQfuvHGh3huDH64moQD/j/gCUYmjYISQnFUPzh1h0HBUHyaeV3a9DZBPOv+QwhxKoH3vsMTzwwANYuHAhRo8ejZEjR+Lvf/872rdv7+z6Eck/OVcJXDX0Vu6Jmy6oX+H5Qvyw9Ai0X5cj7VR7nNd1ANDBuL+d31lo4s9A87tGGDo9EY2a97Z8MCJnM7cOH1nl8GgyIQRGjhyJoqIiLF26FFqtFtOnT8f8+fMRFOTGxD/ybpxV1Tlc1YIj97lqnFA/UVGJ395ai8OpJ7D1dGv8s/hRlKO/cX8gbmJYi0PQDC5B8tOt0WFEGwCtnX8uROQyduUMrVy5EpmZmcjMzMTRo0fh6+uLrl27on///ujevTs+/fRTnDhxAhs2bEDv3vL5NsScIYWSe3Kukrgyt0fuiZsO1O/62QL8sPQILq7dgvtzVyAKt4PEbMRgke8f4dslAZoJjTFkWiIahjZ09VkQqZIsE6hjY2PRv39/40/v3r1rLYj61ltvISUlBYcOHXJ6ZR3FYEih5J6cqySuHnrrzsRNR/LHrNRP6AUOrjsO7eo8pO1php2FibgPX+NLTAAgUH2paAHJEEd5OsgjUgFZBkO2uHjxIqKioqCzNJmZBzAYUqi1a4GHH7ZeLiXFoeRX1XF1C447ktzrkz9Wo37XYu7A5vePQ/uNDmm/dUSePsJY1Ac6nEcMWiIPZge7s1WSyC1kOZrMFuHh4di6dauzD0tqJPfkXKVx9WzDrk7crGf+mF5IOHA+Ato1QNrPodhV1BR6DDTub4Ri3B1xCJphZRjXPw+Rs/Ms14VrPRF5FdmvWu8MbBlSKC+eVdWjlDhNgYP5Y1dPX8P3S45C+60em850xEV9uMnTEgJOQdPlPJInBiPpmUQEBN/q9merJJEsKLZliMhpuJCkayhx6K2NUwPoM7Zh3/mW0P47H9rMMPx8I8Gk9acJinB3yyPQ3FWG5Glt0XpQewBmpgSxtbXx4kVD4KSUoJKIzGLLEMmfEmdVVWLri5zUvH45OcCjj1p92tNYiVV42mRbl4CT0HTNgeahEAz6QyL8m/jb9vr2LuPBua+InE6xCdRyxGDICygpuOAkkfVj7vq1aAFcumT1qUORjoPohllhazE0Pg9dJnVF+NP3O/a38vLLwN//bnt5uUwlQORFGAw5EYMhchtPrOCupEDRGgvXT9zqJhWAyTD3KnpIKPRvjpxJLyHhhyWQcnJu73QkELWlZcgc5rERORWDISdiMERu4YlJIpXeClU9kAsPB6ZOtXj99AAkoFZAZJz358UXgbffdk4gauscV5Zw7isip3DX/dvclywicoQ96385Q1UrSs3XrBpqnprqnNdxldRUQ/A4bJhh5Nbw4XVePx8YgqHKxs1MtkuxMcDnnxsSmS0tRAsYFqK1df6z+i4s66mFaYnIIQyGiJzFnSu4W1uFHrDv5u9uqakQEyZA2NsNBcD/g2WGlpeUFMPvrCygeXPbAtFly2y7JvWdu4pzXxEpCoMhImdx5ySR7m6FcpLcgxexZmoGLk98FkII87M7WxMdbeiCmjTJ8NvX1/YA8/nnDa1R1lrNqhZ4leysYVVXqE5naKnKyJBvQEpERgyGiJzF2g1UkgxTAjhjBff6tELpdIabtBtu1hUlFdi+7BfMG5CBHo2OIapHBNb8G2iuy7f/n09d18+eANOWbsSqOa6qXtfW+gkB3Lxp6PJ7+GFDF6AtwRcReRSDISJnqesG6uxJIh1thaqZp+OCm3XO3lx8OHUHJsTsQvPGJRgyqxv+tnsoDt7sDAl63BmQaf9BrV0/e1pybO1GrFq+JDradHtsLPDSS4bXqy401PD7yhXT7UrJ4SJSMY4mI3I2d0wS6chSJS4a9l9RUoGfVh2Gdu11bPolAk3LLiISuchFJHYgCc2k6xjV6hg0GmDkjI4Iv3TY/pFa5q5fzSkFLl0CHnzQsM/Wf2u2jPqyNHWBHSPhOOSeyDEcWu9Esg2GvGl+GDLlrhXcbV2F3snD/rP3XEDa+6eg/cEfP+QmoAjBuB+pWILnEIvbr1HWLAJ+K5fDd+KE20+2JZCLjgbWrAHy881fP0tTCkyaZOj+szUx21lri9k6FJ9D7ons4rb7t1CBgoICAUAUFBR4uiq3rV8vREyMEIbbgeEnJsawXYkqK4VITxciJcXwu7LS0zVSB3N/R7Gxtf+O0tNNy1j6SU83+zJlRWViy9v7xYu900ViwIlaT5uKj4QeEPqaOyTJ8FOzPuvX395nS3lzz7X0Wl98IcS779brfO2WkmLb66WkOOf1iFTCXfdvBkOeYO2fudICIm8L7JTGlkDUgZv1mR+zxT8nbRNjW+4WTVBoUswHlWJAk1/FG3eli8zVvwp9zfe/5t91bGztetkayNU8V1teq6zMUM7c56yuOjmqnsEmEZnnrvs3u8nczROzFLuSK/JQ2H3ofDZ24+z7wwdI2dcR2v/F4mh5O5N94dIlJMcdh2a0D0Y+F4/Qds3sOrbZLiJ732t7XuvqVdu7EevLkRwuIrLKXfdvP5cdmcyzZ34YuecWWJv4T5IMI3bGjrX9BmDv8hIMnGxTNdrKws1aDyAHMei76gnoYbh+PtBhQNBhaPpdhWZqBLo/2Ak+fnfWPnZ9hvn7+tr3d27Pa02aZAh4zP09OTOZHbg9knDChNtD7Ks4eyQhETkdgyF3c+csxa7m7MDOUitT1dDkmt/klb4ulzvdulmLWy0l1Qeg6289eg5LEOFzCcntTiJ5tC9GzEpAs7iu1o/tzskm7X2t8eMNwbg7AuaqofjuCL6IyKkYDLmbO28crubMwM7eViZ7Ayclq2fr1+mtZ6H95xlot8UiWHyKxXjZZMTXJSkcP3adhj/PS0S3ByIg+bS0r07h4YbRXxcu1N1F5IzJJq20cJl9LXtbn+rDncEXETkNgyFns3bjcuSfuVw5M7Czp5UpKcn53XNy5UDr182rN5Gx/BDSUkugPdIKJyviALS+tbcPfpSSMCs6FYO7XUPi5F6ImKDB7+y5Tubq1KTJ7Wvvyi4iR7qj3N2V6s7gi4icw6Xp2TLhttFkto6qqs+wYjmpGtnjjBE79ox2snfkjlKH/dsx6vDE91liyfgMkdz8ZxGIEpPifigXQ0IOiL8lp4tfvjgu9Dq98+tkHGbmY9/osPrUw5aRaBzpSKRoHFrvRG65mPYOl3dkWLEcOSuwsyfAsSdwUurN0MoQcr0kiZLgCDGjyxbRzu9MrSIxvjniqc7bROrLu0RBtpP+7q0Na6/+M3u26wNPa0Gut01hQaRCHFrvRC4fmufocHlvGQnljOUn7BmavGOHbcOrFywA5s+vfTxXDK12NhuHkA9FOrZhKBqgHEnNDiF5QCE0T0YjcWx7SD4OrQlf7zoBMLz/nhxG7m1TWBCpFIfWK4mjo6q8JbfAGUmj9uSCVOVdWVtyYelS5eYV2Zic/mjUVjw/pSHumpGAoKiesqgTAM9PD+FNU1gQkctx1Xpn8Kbh8o6qCuwmTTL8diTAsLRKeEyMaSuOry/wzjvWj1dz9fDqqt8MZULoBY58fQrvjM3AC08X2vScJz+9C2Pf6oegqCAX1w72j3D05N87P5NEZAe2DDmDXIbLe0O3m62tTC1aOOf1PHwzLLpQhK3Lj0C7sQxpJ9rirK49gPbwQRJm46+IRg58UEe3oTtHHSYlAaGhhpmdbeHJ6SFOnrStnBKmsCAil2Mw5AxyGC7vTRMQ2tJ96Kwgxs03Q6EXOPzVKWj/lYO0XcHYca0LKtDPuD8ApRgSdgiapGL4JP4R0lvTAchkRmNfX8Pf2OuvWy/booXnpofQ6YBVq6yXU8oUFkTkcoroJsvJycGjjz6KsLAwNGrUCN27d8e+ffs8Xa3bqvJdgNs3qiruuHFVTUBYM0eiagLC1FTXvK4n1TeIkSRDkq8bboaF5wux4ZXd+EP8drT2v4A7xnfAy98NxdZrPVEBf7T1O4vpd2zDN69n4spFHTZd7o3ZG4Yg+q/PQrKl29CdXn0VCAuzXu799z3XKrljh+Fv35qnnlJeyykRuYTsW4auXbuGQYMGYdiwYdBqtQgPD8fp06fRtGlTT1fNlKem4nfF+mBKYEtrXPUuHTe2rAi9wP9ST0L74QVodzXFTwWJqER/4/5A3MTQ5oegGVwCzTOt0WFEG9yeFLEGuc1o7OtraHX53e8sl3npJeCBB9xXp5psbTXs0MG19SAixZD90Pq5c+fip59+wo56JLq6ddV6d+ft1GfFcKWrahEDzAc7X35p+F3fYf82KDhXgM1LjiDtm0qknWqPHL1py1WHBlnQJJyDZkJjDJmWiIahDZ322h5hrlu2RQtgxYrb74mnqPkzQeRl3HX/ln0wlJCQgFGjRuH8+fPYtm0boqOjMW3aNDz11FMWn1NWVoaysjLj48LCQsTGxronGHK3tWuBhx+2Xi4lxTDSy9vYMseRCwJUoRf45YsT0H6UC+3uZthZmAhdtYbWhijBsBaHoRlSAs2zbdDuLgstP0om14R9e+askkN9icgiBkO3BAYGAgDmzJmDBx54AD///DNmz56NDz74AI899pjZ58yfPx8LFiyotd0rgyF+C3bbTfla1nVsXnoEad/qkHa6A3L1pguadvL/DZrEbGgeaILBzyYisGmg0+tANrKl1VDOAwvkGmgSuRmDoVv8/f3Ru3dv7Ny507ht1qxZyMzMxK5du8w+R1UtQ/wW7DL6Sj0OrjsO7ZqL0O4Jxe6iBJPWn0Yoxl3hh6EZdhOaaW0RNzjWg7VVEHfd6J0xM7oneNPIUKJ64gzUt0RGRiIhIcFkW3x8PNavX2/xOQEBAQgICHB11eTBkVW8yaKrp6/h+yVHof1Wj01nOuKiPh5AvHF/vP9paO7IhmZiMJKeSURAcF/PVVaJ3Hmjl1vyuS2qWrRqfrGpGhkq9xYtIoWSfTA0aNAgHD9+3GTbiRMn0Lq1F+ZgOMqTI9mUdKMxQ1+px75PjyHtP/nQ/hyGPTcSoMdA4/4mKMLdLY9Ac1cZkqe1RetB7QC081yF7SG398cTN3olLXmj1pGhRDIg+26yzMxMDBw4EAsWLMDEiRPx888/46mnnsKqVavwyCOP2HQMt44m8yR33vwU3JR/+fgVfL/0GLRagU1nOuGSMJ3NOjHgJDR35EDzUAjufDoR/k38PVTTepDb++PJhVPlFhRawvw/olrcdv+u/8L3rvff//5XdOnSRQQEBIjOnTuLVatW2fX8goICAUAUFBS4qIYqs369EJIkhOH76u0fSTL8rF/v6RqaqCyrFLv/9T/x+pB00bfx/4QEnUm1g1Ag7o/cJVZN3ibO7c7xdHXrT07vT2WlEOnpQrz2Wu36mPtJT3fu669fL0RMjOlrxMTI7m9UCCFESopt1yglxdM1JXIbd92/Zd8y5AyqaRlyB09+w7fDpaOXsWnpcWi1wKZznXFFmM6afEfgCWi6XoBmUlMMfDJBma0/5sjp/THXOmWNM6eAsNQtJ9cRZWwZIqqFo8mciMGQE8n0H7auXIef1xyB9pMr0O4Lx76SzhDVVpsJRgFGRB+BZnglkme0R3RvL12gUy7vj6VAxBpn1UtOQaGtODKUqBaOJlMbpeQ12LrUgRtWg7946JKh9WeTD77P7oyr4g6T/d0bHoOmex6SJzXDgCcS0KDRAJfXyePk8P7UlQhsibMXM96xo+4WKSGA7GxDObm0snBkKJHHMBiSA7klu9bF1gVSXbAafGVpJfasPgLtp1eh3R+B/TfjAdxOfm4qXceI6KPQjKhE8qyOiOzeGUBnp9ej3lwZ+Hrw/TGyFojU5IobvRyCQkd4amQokcoxGPI0pc0rYssCqfZ8w7cSGOQevIi0pSeg3eyHzTnxuC66mjy9Z8Oj0PS8CM0joej3eAL8AmXe+uPqwNfZ748j7A0wXHGjl0NQ6Cglzo9EpHDMGfIkJeY1AM5b6sBMYCCiY3A0+Xl8cqQntAdb4uBN05adZtI1jIw5Cs0oPUbN7IiWXcPrezbu466EXk8vRWFr3tJrrwF33+2aGz3zb4i8AofWO5Fsh9anp3tmuLEzmBuyHBtr+5BlC8O/dZCEDpK4H+uNm3s3Oiz+lJQudn7wq6i4WeHa83KVysra16vmsPfYWEM5Z6jv+1MfVedqbni/K87Vkqq/sZr1kOkUEERUG4fWO5FsW4aUvuK8g7kvFUWl0LVqg4DrFyGZ2a+HhKu+LZD2+88x8rkEhCe2MFNKYTwxysuTSfmebp2qXg9XrE+mlAEPRArH0WRqoOS8BsCupQ7OZ+ZCu+wktD/4ozT3Cr7DRYtlfSDQXJePRx8WgDcEQoBnEno9uRSFXBKBXZF/o6QBD0RkEwZDnuSuZFcPfIstv1GOHz84DO1nBUj7XzQOlXUAYAjqHsJa2w4it5E+9aH0wNcRckkEdmZQqLQBD0RkEwZDnuSOeUXc+C323K4caJefhnZrALbkJeAGehj3SdCjX5PD0PS5gol9y4BFNhzQmwIDOYzy8gQlLZRqDRdSJfJazBmSA1flNbh49FJZYRl2rDwM7eeF0P4vFkfLTVdzD5cuITnuODSjfTBiZmeEdQg17FDrSB+55NGQY+QyuzeRijBnSE1c0Z3gom+xZ348D+37v0GbHoCtFxNRjJ7GfT7QYUDQYST3vQrN1Aj0eKgTfPzurH0Qtc60K5c8GnKMUidyJCKrGAzJhbO7E5y0HEHp9VJs/+dhaL+4Ae3hWBwvbwsgxri/pc9FJLc9Ac29vhgxKwHN4rpaPJYJtQYGcsmjIfupMe+LSCUYDHmrenyLPb31LLT/PIO07Q2Rnp+IEvQy7vNFJQYGH4am/zUkT22Jbg90hI9fhGN1VGtg4E15NGqi1rwvIhVgMOSt7PgWe/PqTWxbcRjaL4uhPdIKJyviALQ2FonyyUVyu1PQjPHD8FkJaNq6m/PqycCAlEKt3btEKsBgSAkcGRpv5VusgIQbDVvgoQmB2HoFKEVv4z4/VGBQyGFoBlyH5oko3DG+AyQfNv0TqbZ7l8jLcTSZ3NVnaLyF0Uv6W/M+T8CX2ADDMaJ9cqHpcBKa+/xx94x4hLQKceppEHkVzkBN5Bbuun8zGJKzegyNF3qBE5uycGL+p+i/dzla6PON+84hBh/h9/BrFIj2dzRElxeTkTi+EyQfc4tjEBEReQaDISdSZDDkwIr2xfnF2LrsMNI23oT2WByyKlsBMAx5T8IO3CEdwoiw/RhR9g0aFl26fSx3LyWglG/VSqknEZGX4jxDamfj0Piziz/D+t3R0P4YhO1Xu6AcfY1F/FGGpGaHoRlUCM1TMYgvvwJp4hrPLiWglHWdlFJPIiKqN7YMyZWNK9pPQgo+w+0V7dv4ZUPTKQua+wMxbHoCmrRsYtjhQEuT07l4RmynUUo9iYi8HLvJnEiRwZCNU/+PwCZIoWHQJBVB84dW6JQcZz73x9NLCcghGLOFUupJRKQC7CZTscLzhdjybQMM8WuBppWX4QNzQ+OB0uAIbDzWH40jzfyB1Mx3ycmx7cVdtZSAk2bEdjml1JOIiJyGwZAMCL3A/1JPQvvhBaTtDsGP17ugEoNwP1biS0yAHpJJQCQkCRKAhqtXAOYCIXP5Ls2b21YZVy0loJR1nZRSTyIichoGQx4aMVRwrgA/LDsC7deVSDvVHjn6jgA6Gve3b3AGMfFhOBj/N3TfsRS4cLtlR6prgjdL+S6XL9ddIVcvJaCUdZ2UUk8iInIadecMuXHEkNAL/PLFCWg/ykXanqbYWZCISjQw7m+IEgxrcRiaISVIfqYN2t99ezkMmwM2a/kuVSwtJeDKxOCqullb18nTuThKqScRkQowZ8jVLLWgOHGY+bWs6/hh2VFov6lE2ukOyNV3AtDJuL9jgyxoEs9BM6ExBj+biIahfcwfyNb1u6zlu1Rp3hy4VGOeIVcvJaCUdZ2UUk8iInIadbYMuWjEkL5Sj4PrjkO75iK0e0KxuygBumrxZiMU467ww9AMu4nkZ+LQdmgr+07EWguRjcPx8cknQHS0ZyYTNNcaFxsrv3WdlFJPIiIvxqH1TlTrYjpxmPnV09fw/ZKjSPtOj7SsjrioDzfZH+9/GsldsqF5IAhJzyQisGmgYydhS5eeq4bPOzuvSikzOyulnkREXordZK5UjxFD+ko99qccg/bf+dD+HIY9NxKgx0Dj/sa4gbtbHoZmWBmSp7VFmzvbAWhXv/ra2qVnZaV6h5KkXZFXZWu3n6cppZ5ERFQv6gyG7BwxdPn4FXy/9BjS0gQ2ZXVCvkgAkGAslhhwEpo7cqB5KASDnkpAQHA/59VVpzMEI+aCGyEMAc7s2cDYsc7Pd3FDXhUREZGnqbObzMqIISFJKG8WgUV3fILv9kbg5+IECPgY9zdBEYZHHobmrnIkT2+HVgOiXVd5R7q+nJHvwpmYiYjIw9hN5krVW1DMEQLvXZ2M17fdbdx0R+AJaLpegGZSUwx8MgH+Tfq7p66OdOmNH29oKapPvgtnYiYiIpVQZzAEQHfvWOQNn4KozWtQcyUvAeAlvA2pWShCxwxC8oz2iOljOimi2zg6CWB98104EzMREamEqoKh/COXsfGjX6Hd5IMfznXAfvwAAdQKhnwACAl4uckK4KOXPNsN5IqkaFtwJmYiIlIJVQVDHQY0B9AWADAEGYiF5W4gSS7dQHUlRQOGx//4h/MDNk8FYURERG7mY72Id+nR8Cj+ODADKx/fY9sT5NANNH68YeRWtIVE7TlzDEnTzuTrC7zzjuVACOBMzERE5BVU1TJ04qdL6DAwHkA8kAFgtQ1PcnY3kKMT+Y0fD+j1wAMP1N7niqHuqamGIMscdyzfQURE5CaKaxlauHAhJEnC7Nmz7X5uRJcWtx9UdQNJNTOGbpEkw3B0Z3YDpaYahqsPG2ZYNmPYMMNjW1p1dDrg+efN76tqvZk921DOGfWcMMHyaLJ33mEgREREXkNRwVBmZiZWrVqFrl271v9gVbk4QO2AyBXdQJYCjKpWHWsBkT1D3eujrkkeAcO1mTPHOUEXERGRDCgmGLpx4wYeeeQR/N///R+aNWvmnINaysWJiXFul5O1WaQB66067hrq7q6gi4iISCYUEwxNnz4do0ePxvDhw62WLSsrQ2FhocmPRePHA2fOGGZwTkkx/M7Kcm43kDMCDHcNdef8QkREpDKKSKD+7LPPsH//fmRmZtpUfuHChViwYIHtL+DqBTltDRy++spyPdw11F1O8wtx1XgiInID2bcMZWdn47nnnsMnn3yCwMBAm54zb948FBQUGH+ys7NdXEsrbA0cPv3UcleZu3KcPJFYbk59ks2JiIjsIPtgaN++fcjPz0evXr3g5+cHPz8/bNu2DUuXLoWfnx90ZoKHgIAABAcHm/x4VFIS0KKF9XKXLtXdVeaOHCd3J5abU99kcyIiIjvIftX6oqIinD171mTb448/js6dO+OVV15Bly5drB7DXave1un55w1BhDUpKcCkSXWXcUf3UWqqIem7ekASG+v6+YV0OkMLkKUcq6ruwKwsdpkREXk5rlp/S1BQUK2Ap3HjxggLC7MpEJKNsWNtC4Zs6VJzdY4TYAh4xo51f86OPcnmnlwmhYiIvIbsgyGvUZWLY63FQ05rfbkj6KqJo9mIiMjNFBkMZWRkeLoK9qu+4CpgOiKMa33dJqfRbEREpAqyT6D2Ku6a5FHJ5DKajYiIVEORLUP14um5azyVi6MU1VvQJIktaERE5HLqCoa+/hqYN880bycmxnDzdWerjCdycZSkqgWt5mi2mBjXj2YjIiLVkf3QemcwDs0DUGtgXlVrA7up5MfTrXhERORR7hpaz2AI4Nw1REREMuSuYIgJ1ABXYiciIlIxBkPVce4aIiIi1WEwVB3nriEiIlIddY0ms0SOsz8TERGRW6ivZchTK7ETERGRLKkrGPr4Y87+TERERCbU1U12333ApEmGUWM5OcClS0CLFkBoqGFOG7YMERERqY66giHAEPBcvQrMnev5maiJiIjI49TVTQYAqamGda+qB0KAoaVowgTDfiIiIlINdQVDOp1hvStzk25XbZs921COiIiIVEFdwdDOnbVbhKrjTNRERESqo65gKC/PtnKciZqIiEg11BUMtWxpWznORE1ERKQa6gqGBg40jBqrOfFiFUkCYmM5EzUREZGKqCsY8vU1DJ8HOBM1ERERAVBbMAQY5hH68kvORE1EREQA1DjpImAIeMaONYway8015AglJbFFiIiISIXUGQwBhsBn6FBP14KIiIg8TL3BEDlGp2OLGhEReRUGQ2S71FTDDN5c042IiLyI+hKoyTFc042IiLwUgyGyjmu6ERGRF2MwRNbt2ME13YiIyGsxGCLrbF2rjWu6ERGRAjEYIutsXauNa7oREZECMRgi65KSuKYbERF5LQZDZB3XdCMiIi/GYIhswzXdiIjIS3HSRbId13QjIiIvxGCI7MM13YiIyMuwm4yIiIhUjcEQERERqRqDISIiIlI12QdDCxcuRJ8+fRAUFITw8HCMGzcOx48f93S1iIiIyEvIPhjatm0bpk+fjt27d2Pz5s2orKzEyJEjUVxc7OmqERERkReQhDC3FLl8Xbp0CeHh4di2bRsGDx5s03MKCwsREhKCgoICBAcHu7iGRERE5Azuun8rbmh9QUEBACA0NNRimbKyMpSVlRkfFxYWurxeREREpEyy7yarTgiBOXPm4M4770SXLl0sllu4cCFCQkKMP7GxsW6sJRERESmJorrJpk+fjm+//RY//vgjYmJiLJYz1zIUGxvLbjIiIiIFYTdZDTNnzsTXX3+N7du31xkIAUBAQAACAgLcVDMiIiJSMtkHQ0IIzJw5Exs2bEBGRgbi4uI8XSUiIiLyIrIPhqZPn46UlBR89dVXCAoKQl5eHgAgJCQEDRs29HDtiIiISOlknzMkSZLZ7atXr8bUqVNtOgaH1hMRESkPc4ZukXmsRkRERAqnqKH1RERERM7GYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUUEwytWLECcXFxCAwMRK9evbBjxw5PV4mIiIi8gCKCoXXr1mH27Nl49dVXceDAASQlJUGj0eDcuXOerhoREREpnCSEEJ6uhDX9+vVDz5498c9//tO4LT4+HuPGjcPChQutPr+wsBAhISEoKChAcHCwK6tKRERETuKu+7fsW4bKy8uxb98+jBw50mT7yJEjsXPnTg/VioiIiLyFn6crYM3ly5eh0+kQERFhsj0iIgJ5eXlmn1NWVoaysjLj44KCAgCGCJOIiIiUoeq+7epOLNkHQ1UkSTJ5LISota3KwoULsWDBglrbY2NjXVI3IiIicp0rV64gJCTEZceXfTDUvHlz+Pr61moFys/Pr9VaVGXevHmYM2eO8fH169fRunVrnDt3zqUXU24KCwsRGxuL7OxsVeVK8bx53mrA8+Z5q0FBQQFatWqF0NBQl76O7IMhf39/9OrVC5s3b8b9999v3L5582aMHTvW7HMCAgIQEBBQa3tISIiq/oiqBAcH87xVhOetLjxvdVHrefv4uDbFWfbBEADMmTMHkydPRu/evTFgwACsWrUK586dwzPPPOPpqhEREZHCKSIYevDBB3HlyhW88cYbyM3NRZcuXfDdd9+hdevWnq4aERERKZwigiEAmDZtGqZNm+bQcwMCAvD666+b7TrzZjxvnrca8Lx53mrA83bteSti0kUiIiIiV5H9pItERERErsRgiIiIiFSNwRARERGpGoMhIiIiUjVFBkMrVqxAXFwcAgMD0atXL+zYsaPO8tu2bUOvXr0QGBiItm3bYuXKlbXKrF+/HgkJCQgICEBCQgI2bNjgquo7zJ7zTk1NxYgRI9CiRQsEBwdjwIAB2LRpk0mZNWvWQJKkWj+lpaWuPhW72HPeGRkZZs/p2LFjJuW87f2eOnWq2fNOTEw0llHC+719+3aMGTMGUVFRkCQJGzdutPocb/h823ve3vL5tve8veXzbe95e8vne+HChejTpw+CgoIQHh6OcePG4fjx41af547PuOKCoXXr1mH27Nl49dVXceDAASQlJUGj0eDcuXNmy2dlZeGee+5BUlISDhw4gD/+8Y+YNWsW1q9fbyyza9cuPPjgg5g8eTJ++eUXTJ48GRMnTsSePXvcdVpW2Xve27dvx4gRI/Ddd99h3759GDZsGMaMGYMDBw6YlAsODkZubq7JT2BgoDtOySb2nneV48ePm5xThw4djPu88f1esmSJyflmZ2cjNDQUDzzwgEk5ub/fxcXF6NatG5YvX25TeW/5fNt73t7y+bb3vKso/fNt73l7y+d727ZtmD59Onbv3o3NmzejsrISI0eORHFxscXnuO0zLhSmb9++4plnnjHZ1rlzZzF37lyz5V9++WXRuXNnk21PP/206N+/v/HxxIkTRXJyskmZUaNGiYceeshJta4/e8/bnISEBLFgwQLj49WrV4uQkBBnVdEl7D3v9PR0AUBcu3bN4jHV8H5v2LBBSJIkzpw5Y9ymhPe7OgBiw4YNdZbxls93dbactzlK/HxXZ8t5e8vnuzpH3m9v+HwLIUR+fr4AILZt22axjLs+44pqGSovL8e+ffswcuRIk+0jR47Ezp07zT5n165dtcqPGjUKe/fuRUVFRZ1lLB3T3Rw575r0ej2KiopqLXZ348YNtG7dGjExMbj33ntrfbP0pPqcd48ePRAZGYm7774b6enpJvvU8H5/+OGHGD58eK1Z2uX8fjvCGz7fzqDEz3d9KPnz7Qze8vkuKCgAgDoXYXXXZ1xRwdDly5eh0+lqrVYfERFRa1X7Knl5eWbLV1ZW4vLly3WWsXRMd3PkvGv6xz/+geLiYkycONG4rXPnzlizZg2+/vprrF27FoGBgRg0aBBOnjzp1Po7ypHzjoyMxKpVq7B+/XqkpqaiU6dOuPvuu7F9+3ZjGW9/v3Nzc6HVavHkk0+abJf7++0Ib/h8O4MSP9+O8IbPd315y+dbCIE5c+bgzjvvRJcuXSyWc9dnXDHLcVQnSZLJYyFErW3Wytfcbu8xPcHROq5duxbz58/HV199hfDwcOP2/v37o3///sbHgwYNQs+ePbFs2TIsXbrUeRWvJ3vOu1OnTujUqZPx8YABA5CdnY23334bgwcPduiYnuJoHdesWYOmTZti3LhxJtuV8n7by1s+345S+ufbHt70+XaUt3y+Z8yYgV9//RU//vij1bLu+IwrqmWoefPm8PX1rRXt5efn14oKq7Rs2dJseT8/P4SFhdVZxtIx3c2R866ybt06PPHEE/j8888xfPjwOsv6+PigT58+svkmUZ/zrq5///4m5+TN77cQAh999BEmT54Mf3//OsvK7f12hDd8vutDyZ9vZ1Ha57s+vOXzPXPmTHz99ddIT09HTExMnWXd9RlXVDDk7++PXr16YfPmzSbbN2/ejIEDB5p9zoABA2qV//7779G7d280aNCgzjKWjulujpw3YPjGOHXqVKSkpGD06NFWX0cIgYMHDyIyMrLedXYGR8+7pgMHDpick7e+34BhtMapU6fwxBNPWH0dub3fjvCGz7ejlP75dhalfb7rQ+mfbyEEZsyYgdTUVGzduhVxcXFWn+O2z7jNqdYy8dlnn4kGDRqIDz/8UBw5ckTMnj1bNG7c2JhVP3fuXDF58mRj+d9++000atRIPP/88+LIkSPiww8/FA0aNBBffvmlscxPP/0kfH19xd/+9jdx9OhR8be//U34+fmJ3bt3u/38LLH3vFNSUoSfn594//33RW5urvHn+vXrxjLz588XaWlp4vTp0+LAgQPi8ccfF35+fmLPnj1uPz9L7D3vd999V2zYsEGcOHFCHDp0SMydO1cAEOvXrzeW8cb3u8qjjz4q+vXrZ/aYSni/i4qKxIEDB8SBAwcEAPHOO++IAwcOiLNnzwohvPfzbe95e8vn297z9pbPt73nXUXpn+9nn31WhISEiIyMDJO/25KSEmMZT33GFRcMCSHE+++/L1q3bi38/f1Fz549TYblTZkyRQwZMsSkfEZGhujRo4fw9/cXbdq0Ef/85z9rHfOLL74QnTp1Eg0aNBCdO3c2+XDJhT3nPWTIEAGg1s+UKVOMZWbPni1atWol/P39RYsWLcTIkSPFzp073XhGtrHnvBctWiTatWsnAgMDRbNmzcSdd94pvv3221rH9Lb3Wwghrl+/Lho2bChWrVpl9nhKeL+rhk5b+rv11s+3veftLZ9ve8/bWz7fjvyde8Pn29w5AxCrV682lvHUZ1y6VUEiIiIiVVJUzhARERGRszEYIiIiIlVjMERERESqxmCIiIiIVI3BEBEREakagyEiIiJSNQZDREREpGoMhoiIiEjVGAwRERGRqjEYIiIiIlVjMEREirR27VoEBgYiJyfHuO3JJ59E165dUVBQ4MGaEZHScG0yIlIkIQS6d++OpKQkLF++HAsWLMC//vUv7N69G9HR0Z6uHhEpiJ+nK0BE5AhJkvDmm29iwoQJiIqKwpIlS7Bjxw4GQkRkN7YMEZGi9ezZE4cPH8b333+PIUOGeLo6RKRAzBkiIsXatGkTjh07Bp1Oh4iICE9Xh4gUii1DRKRI+/fvx9ChQ/H+++/js88+Q6NGjfDFF194ulpEpEDMGSIixTlz5gxGjx6NuXPnYvLkyUhISECfPn2wb98+9OrVy9PVIyKFYcsQESnK1atXMWjQIAwePBgffPCBcfvYsWNRVlaGtLQ0D9aOiJSIwRARERGpGhOoiYiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKr2/6YB0BXcksAUAAAAAElFTkSuQmCC", - "text/plain": [ - "
" - ] - }, - "metadata": {}, - "output_type": "display_data" - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "theta from own sdg\n", - "[[4.25869167]\n", - " [2.84271642]]\n" - ] - } - ], + "execution_count": 18, + "id": "ccb60a39", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "# Using Autograd to calculate gradients using SGD\n", "# OLS example\n", @@ -2146,35 +2119,23 @@ }, { "cell_type": "markdown", - "id": "1caa8279", - "metadata": {}, + "id": "502d537b", + "metadata": { + "editable": true + }, "source": [ "## Same code but now with momentum gradient descent" ] }, { "cell_type": "code", - "execution_count": 54, - "id": "a9695688", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Own inversion\n", - "[[3.96584049]\n", - " [3.04808331]]\n", - "Eigenvalues of Hessian Matrix:[0.31564325 4.60725403]\n", - "theta from own gd\n", - "[[3.96536405]\n", - " [3.04846625]]\n", - "theta from own sdg with momentum\n", - "[[4.01326831]\n", - " [3.04081676]]\n" - ] - } - ], + "execution_count": 19, + "id": "d62b1fd8", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "# Using Autograd to calculate gradients using SGD\n", "# OLS example\n", @@ -2247,33 +2208,23 @@ }, { "cell_type": "markdown", - "id": "7e8ab93f", - "metadata": {}, + "id": "ab2dfdcf", + "metadata": { + "editable": true + }, "source": [ "## Similar (second order function now) problem but now with AdaGrad" ] }, { "cell_type": "code", - "execution_count": 55, - "id": "be9894c6", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Own inversion\n", - "[[2.]\n", - " [3.]\n", - " [4.]]\n", - "theta from own AdaGrad\n", - "[[1.99993955]\n", - " [3.00039584]\n", - " [3.99962062]]\n" - ] - } - ], + "execution_count": 20, + "id": "24784ec8", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "# Using Autograd to calculate gradients using AdaGrad and Stochastic Gradient descent\n", "# OLS example\n", @@ -2327,41 +2278,33 @@ }, { "cell_type": "markdown", - "id": "f9c181ef", - "metadata": {}, + "id": "b525a878", + "metadata": { + "editable": true + }, "source": [ "Running this code we note an almost perfect agreement with the results from matrix inversion." ] }, { "cell_type": "markdown", - "id": "3f40101d", - "metadata": {}, + "id": "f3de5529", + "metadata": { + "editable": true + }, "source": [ "## RMSprop for adaptive learning rate with Stochastic Gradient Descent" ] }, { "cell_type": "code", - "execution_count": 56, - "id": "da9f2895", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Own inversion\n", - "[[2.]\n", - " [3.]\n", - " [4.]]\n", - "theta from own RMSprop\n", - "[[1.99943878]\n", - " [2.99892878]\n", - " [3.99871777]]\n" - ] - } - ], + "execution_count": 21, + "id": "770a0f44", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "# Using Autograd to calculate gradients using RMSprop and Stochastic Gradient descent\n", "# OLS example\n", @@ -2421,33 +2364,23 @@ }, { "cell_type": "markdown", - "id": "2075df0a", - "metadata": {}, + "id": "2cf458d4", + "metadata": { + "editable": true + }, "source": [ "## And finally [ADAM](https://arxiv.org/pdf/1412.6980.pdf)" ] }, { "cell_type": "code", - "execution_count": 57, - "id": "b9e0fd59", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Own inversion\n", - "[[2.]\n", - " [3.]\n", - " [4.]]\n", - "theta from own ADAM\n", - "[[1.99994314]\n", - " [3.00031228]\n", - " [3.99972037]]\n" - ] - } - ], + "execution_count": 22, + "id": "ebe031fe", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "# Using Autograd to calculate gradients using RMSprop and Stochastic Gradient descent\n", "# OLS example\n", @@ -2512,17 +2445,22 @@ }, { "cell_type": "markdown", - "id": "3186664b", - "metadata": {}, + "id": "df82f58c", + "metadata": { + "editable": true + }, "source": [ "## And Logistic Regression" ] }, { "cell_type": "code", - "execution_count": 29, - "id": "c4119a68", - "metadata": {}, + "execution_count": 23, + "id": "23a3aae7", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "import autograd.numpy as np\n", @@ -2562,8 +2500,10 @@ }, { "cell_type": "markdown", - "id": "55e182eb", - "metadata": {}, + "id": "04692c2e", + "metadata": { + "editable": true + }, "source": [ "## Introducing [JAX](https://jax.readthedocs.io/en/latest/)\n", "\n", @@ -2576,17 +2516,22 @@ }, { "cell_type": "markdown", - "id": "ae059fd0", - "metadata": {}, + "id": "c9531ff9", + "metadata": { + "editable": true + }, "source": [ "### Getting started with Jax, note the way we import numpy" ] }, { "cell_type": "code", - "execution_count": 30, - "id": "1ad5b0d3", - "metadata": {}, + "execution_count": 24, + "id": "1082677a", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "import jax\n", @@ -2599,17 +2544,22 @@ }, { "cell_type": "markdown", - "id": "bc8fd16c", - "metadata": {}, + "id": "ddab1050", + "metadata": { + "editable": true + }, "source": [ "### A warm-up example" ] }, { "cell_type": "code", - "execution_count": 31, - "id": "443386ca", - "metadata": {}, + "execution_count": 25, + "id": "9a64315e", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "def function(x):\n", @@ -2650,17 +2600,22 @@ }, { "cell_type": "markdown", - "id": "b313e4d6", - "metadata": {}, + "id": "fbaa615b", + "metadata": { + "editable": true + }, "source": [ "### A more advanced example" ] }, { "cell_type": "code", - "execution_count": 32, - "id": "7ff7b64d", - "metadata": {}, + "execution_count": 26, + "id": "6400dac8", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "backend = np\n", @@ -2687,8 +2642,10 @@ }, { "cell_type": "markdown", - "id": "b913d744", - "metadata": {}, + "id": "b7cd2078", + "metadata": { + "editable": true + }, "source": [ "## Introduction to Neural networks\n", "\n", @@ -2703,8 +2660,10 @@ }, { "cell_type": "markdown", - "id": "04b70882", - "metadata": {}, + "id": "4b41d4a3", + "metadata": { + "editable": true + }, "source": [ "## Artificial neurons\n", "\n", @@ -2725,8 +2684,10 @@ }, { "cell_type": "markdown", - "id": "44405ff2", - "metadata": {}, + "id": "05bbca92", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -2741,8 +2702,10 @@ }, { "cell_type": "markdown", - "id": "b39653f7", - "metadata": {}, + "id": "63e4ecd2", + "metadata": { + "editable": true + }, "source": [ "Here, the output $y$ of the neuron is the value of its activation function, which have as input\n", "a weighted sum of signals $x_i, \\dots ,x_n$ received by $n$ other neurons.\n", @@ -2779,8 +2742,10 @@ }, { "cell_type": "markdown", - "id": "4db5fb89", - "metadata": {}, + "id": "16405c0c", + "metadata": { + "editable": true + }, "source": [ "## Neural network types\n", "\n", @@ -2806,8 +2771,10 @@ }, { "cell_type": "markdown", - "id": "400c590f", - "metadata": {}, + "id": "49a77aeb", + "metadata": { + "editable": true + }, "source": [ "## Feed-forward neural networks\n", "\n", @@ -2825,8 +2792,10 @@ }, { "cell_type": "markdown", - "id": "1536d443", - "metadata": {}, + "id": "4408658f", + "metadata": { + "editable": true + }, "source": [ "## Convolutional Neural Network\n", "\n", @@ -2852,8 +2821,10 @@ }, { "cell_type": "markdown", - "id": "0ce4aacc", - "metadata": {}, + "id": "cf8d97ad", + "metadata": { + "editable": true + }, "source": [ "## Recurrent neural networks\n", "\n", @@ -2871,8 +2842,10 @@ }, { "cell_type": "markdown", - "id": "c187a3e9", - "metadata": {}, + "id": "3cc3819b", + "metadata": { + "editable": true + }, "source": [ "## Other types of networks\n", "\n", @@ -2890,8 +2863,10 @@ }, { "cell_type": "markdown", - "id": "7a5d9c4f", - "metadata": {}, + "id": "920fd548", + "metadata": { + "editable": true + }, "source": [ "## Multilayer perceptrons\n", "\n", @@ -2905,8 +2880,10 @@ }, { "cell_type": "markdown", - "id": "2abe1a3e", - "metadata": {}, + "id": "d08f461e", + "metadata": { + "editable": true + }, "source": [ "## Why multilayer perceptrons?\n", "\n", @@ -2924,8 +2901,10 @@ }, { "cell_type": "markdown", - "id": "187cb30d", - "metadata": {}, + "id": "dc59c40b", + "metadata": { + "editable": true + }, "source": [ "## Illustration of a single perceptron model and a multi-perceptron model\n", "\n", @@ -2938,8 +2917,10 @@ }, { "cell_type": "markdown", - "id": "6269f804", - "metadata": {}, + "id": "89c1b368", + "metadata": { + "editable": true + }, "source": [ "## Examples of XOR, OR and AND gates\n", "\n", @@ -2952,9 +2933,12 @@ }, { "cell_type": "code", - "execution_count": 33, - "id": "1ad6269c", - "metadata": {}, + "execution_count": 27, + "id": "f2a213fe", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "\"\"\"\n", @@ -2991,25 +2975,32 @@ }, { "cell_type": "markdown", - "id": "a4ac557d", - "metadata": {}, + "id": "046c878f", + "metadata": { + "editable": true + }, "source": [ "What is happening here?" ] }, { "cell_type": "markdown", - "id": "6c5b5b78", - "metadata": {}, + "id": "8dbddf81", + "metadata": { + "editable": true + }, "source": [ "## Does Logistic Regression do a better Job?" ] }, { "cell_type": "code", - "execution_count": 34, - "id": "78d9fe1b", - "metadata": {}, + "execution_count": 28, + "id": "3032a2c1", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "\"\"\"\n", @@ -3065,25 +3056,32 @@ }, { "cell_type": "markdown", - "id": "522ea0b9", - "metadata": {}, + "id": "ea8b4e4b", + "metadata": { + "editable": true + }, "source": [ "Not exactly impressive, but somewhat better." ] }, { "cell_type": "markdown", - "id": "633277bf", - "metadata": {}, + "id": "ef2b283b", + "metadata": { + "editable": true + }, "source": [ "## Adding Neural Networks" ] }, { "cell_type": "code", - "execution_count": 35, - "id": "55106a0e", - "metadata": {}, + "execution_count": 29, + "id": "7415b824", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "\n", @@ -3099,8 +3097,10 @@ }, { "cell_type": "markdown", - "id": "6933a546", - "metadata": {}, + "id": "bbfc7004", + "metadata": { + "editable": true + }, "source": [ "## Mathematical model\n", "\n", @@ -3109,8 +3109,10 @@ }, { "cell_type": "markdown", - "id": "a392cc52", - "metadata": {}, + "id": "973905d4", + "metadata": { + "editable": true + }, "source": [ "$$\n", "y = f\\left(\\sum_{i=1}^n w_ix_i + b_i\\right) = f(z),\n", @@ -3119,8 +3121,10 @@ }, { "cell_type": "markdown", - "id": "bc1e3563", - "metadata": {}, + "id": "9343ae60", + "metadata": { + "editable": true + }, "source": [ "This function receives $x_i$ as inputs.\n", "Here the activation $z=(\\sum_{i=1}^n w_ix_i+b_i)$. \n", @@ -3132,8 +3136,10 @@ }, { "cell_type": "markdown", - "id": "947e6060", - "metadata": {}, + "id": "0fcd0bdf", + "metadata": { + "editable": true + }, "source": [ "## Mathematical model\n", "\n", @@ -3142,8 +3148,10 @@ }, { "cell_type": "markdown", - "id": "190e7764", - "metadata": {}, + "id": "98e91440", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3157,8 +3165,10 @@ }, { "cell_type": "markdown", - "id": "9d4df41f", - "metadata": {}, + "id": "944ccc68", + "metadata": { + "editable": true + }, "source": [ "Here $b_i$ is the so-called bias which is normally needed in\n", "case of zero activation weights or inputs. How to fix the biases and\n", @@ -3170,8 +3180,10 @@ }, { "cell_type": "markdown", - "id": "e8c69c2e", - "metadata": {}, + "id": "17edaee3", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3186,8 +3198,10 @@ }, { "cell_type": "markdown", - "id": "80a632b1", - "metadata": {}, + "id": "dbe292f0", + "metadata": { + "editable": true + }, "source": [ "where we assume that all nodes in the same layer have identical\n", "activation functions, hence the notation $f$. In general, we could assume in the more general case that different layers have different activation functions.\n", @@ -3196,8 +3210,10 @@ }, { "cell_type": "markdown", - "id": "20de39bb", - "metadata": {}, + "id": "ab06ec71", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3212,8 +3228,10 @@ }, { "cell_type": "markdown", - "id": "01031b37", - "metadata": {}, + "id": "0f069e07", + "metadata": { + "editable": true + }, "source": [ "where $N_l$ is the number of nodes in layer $l$. When the output of\n", "all the nodes in the first hidden layer are computed, the values of\n", @@ -3223,8 +3241,10 @@ }, { "cell_type": "markdown", - "id": "9560b5e1", - "metadata": {}, + "id": "3ee71e06", + "metadata": { + "editable": true + }, "source": [ "## Mathematical model\n", "\n", @@ -3233,8 +3253,10 @@ }, { "cell_type": "markdown", - "id": "baaac514", - "metadata": {}, + "id": "cecfe50e", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3249,8 +3271,10 @@ }, { "cell_type": "markdown", - "id": "f2a439d9", - "metadata": {}, + "id": "dc2a6523", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3265,16 +3289,20 @@ }, { "cell_type": "markdown", - "id": "9ba7b5ad", - "metadata": {}, + "id": "3f73c82a", + "metadata": { + "editable": true + }, "source": [ "where we have substituted $y_k^1$ with the inputs $x_k$. Finally, the ANN output reads" ] }, { "cell_type": "markdown", - "id": "bed342fd", - "metadata": {}, + "id": "8b1a1945", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3289,8 +3317,10 @@ }, { "cell_type": "markdown", - "id": "d1beb8c9", - "metadata": {}, + "id": "ecd88770", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3306,8 +3336,10 @@ }, { "cell_type": "markdown", - "id": "a71895ad", - "metadata": {}, + "id": "6b6ce470", + "metadata": { + "editable": true + }, "source": [ "## Mathematical model\n", "\n", @@ -3317,8 +3349,10 @@ }, { "cell_type": "markdown", - "id": "d9bd25ff", - "metadata": {}, + "id": "6e018962", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3333,8 +3367,10 @@ }, { "cell_type": "markdown", - "id": "e7737a5b", - "metadata": {}, + "id": "bf0b66e0", + "metadata": { + "editable": true + }, "source": [ "which illustrates a basic property of MLPs: The only independent\n", "variables are the input values $x_n$." @@ -3342,8 +3378,10 @@ }, { "cell_type": "markdown", - "id": "384040ce", - "metadata": {}, + "id": "4827bb05", + "metadata": { + "editable": true + }, "source": [ "## Mathematical model\n", "\n", @@ -3359,8 +3397,10 @@ }, { "cell_type": "markdown", - "id": "4a27ed92", - "metadata": {}, + "id": "6fc6eadd", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3375,8 +3415,10 @@ }, { "cell_type": "markdown", - "id": "c71650e0", - "metadata": {}, + "id": "f7c37a39", + "metadata": { + "editable": true + }, "source": [ "where the parameters $c_i$ are weights and biases. By adjusting these\n", "parameters, the activation functions can be shifted up and down or\n", @@ -3386,8 +3428,10 @@ }, { "cell_type": "markdown", - "id": "b6291c8a", - "metadata": {}, + "id": "09472aa3", + "metadata": { + "editable": true + }, "source": [ "### Matrix-vector notation\n", "\n", @@ -3404,8 +3448,10 @@ }, { "cell_type": "markdown", - "id": "da4b43f7", - "metadata": {}, + "id": "1824564d", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3435,8 +3481,10 @@ }, { "cell_type": "markdown", - "id": "7fe1f511", - "metadata": {}, + "id": "eafbe02e", + "metadata": { + "editable": true + }, "source": [ "### Matrix-vector notation and activation\n", "\n", @@ -3445,8 +3493,10 @@ }, { "cell_type": "markdown", - "id": "d53241ba", - "metadata": {}, + "id": "f52242e3", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3462,8 +3512,10 @@ }, { "cell_type": "markdown", - "id": "962e06e9", - "metadata": {}, + "id": "72371715", + "metadata": { + "editable": true + }, "source": [ "This is not just a convenient and compact notation, but also a useful\n", "and intuitive way to think about MLPs: The output is calculated by a\n", @@ -3474,8 +3526,10 @@ }, { "cell_type": "markdown", - "id": "6446fdc6", - "metadata": {}, + "id": "b455d9ae", + "metadata": { + "editable": true + }, "source": [ "### Activation functions\n", "\n", @@ -3495,8 +3549,10 @@ }, { "cell_type": "markdown", - "id": "69aff123", - "metadata": {}, + "id": "7de531f8", + "metadata": { + "editable": true + }, "source": [ "### Activation functions, Logistic and Hyperbolic ones\n", "\n", @@ -3512,8 +3568,10 @@ }, { "cell_type": "markdown", - "id": "dbb74732", - "metadata": {}, + "id": "dedb08ff", + "metadata": { + "editable": true + }, "source": [ "$$\n", "f(x) = \\frac{1}{1 + e^{-x}},\n", @@ -3522,16 +3580,20 @@ }, { "cell_type": "markdown", - "id": "216973d6", - "metadata": {}, + "id": "ed7c69c9", + "metadata": { + "editable": true + }, "source": [ "and the *hyperbolic tangent* function" ] }, { "cell_type": "markdown", - "id": "a8643aed", - "metadata": {}, + "id": "37be8225", + "metadata": { + "editable": true + }, "source": [ "$$\n", "f(x) = \\tanh(x)\n", @@ -3540,8 +3602,10 @@ }, { "cell_type": "markdown", - "id": "b6450655", - "metadata": {}, + "id": "a8176533", + "metadata": { + "editable": true + }, "source": [ "### Relevance\n", "\n", @@ -3554,9 +3618,12 @@ }, { "cell_type": "code", - "execution_count": 36, - "id": "0565ead1", - "metadata": {}, + "execution_count": 30, + "id": "1b3252bc", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "\"\"\"The sigmoid function (or the logistic curve) is a \n", @@ -3633,25 +3700,7 @@ ] } ], - "metadata": { - "kernelspec": { - "display_name": "Python 3 (ipykernel)", - "language": "python", - "name": "python3" - }, - "language_info": { - "codemirror_mode": { - "name": "ipython", - "version": 3 - }, - "file_extension": ".py", - "mimetype": "text/x-python", - "name": "python", - "nbconvert_exporter": "python", - "pygments_lexer": "ipython3", - "version": "3.9.18" - } - }, + "metadata": {}, "nbformat": 4, "nbformat_minor": 5 } diff --git a/doc/LectureNotes/_build/html/searchindex.js b/doc/LectureNotes/_build/html/searchindex.js index f8b8c58a4..d40c99bc5 100644 --- a/doc/LectureNotes/_build/html/searchindex.js +++ b/doc/LectureNotes/_build/html/searchindex.js @@ -1 +1 @@ -Search.setIndex({docnames:["chapter1","chapter10","chapter11","chapter12","chapter13","chapter2","chapter3","chapter4","chapter5","chapter6","chapter7","chapter8","chapter9","chapteroptimization","clustering","exercisesweek34","exercisesweek35","exercisesweek36","exercisesweek37","exercisesweek38","exercisesweek39","intro","linalg","project1","schedule","statistics","teachers","textbooks","week34","week35","week36","week37","week38","week39","week40"],envversion:{"sphinx.domains.c":2,"sphinx.domains.changeset":1,"sphinx.domains.citation":1,"sphinx.domains.cpp":4,"sphinx.domains.index":1,"sphinx.domains.javascript":2,"sphinx.domains.math":2,"sphinx.domains.python":3,"sphinx.domains.rst":2,"sphinx.domains.std":2,"sphinx.ext.intersphinx":1,sphinx:56},filenames:["chapter1.ipynb","chapter10.ipynb","chapter11.ipynb","chapter12.ipynb","chapter13.ipynb","chapter2.ipynb","chapter3.ipynb","chapter4.ipynb","chapter5.ipynb","chapter6.ipynb","chapter7.ipynb","chapter8.ipynb","chapter9.ipynb","chapteroptimization.ipynb","clustering.ipynb","exercisesweek34.ipynb","exercisesweek35.ipynb","exercisesweek36.ipynb","exercisesweek37.ipynb","exercisesweek38.ipynb","exercisesweek39.ipynb","intro.md","linalg.ipynb","project1.ipynb","schedule.md","statistics.ipynb","teachers.md","textbooks.md","week34.ipynb","week35.ipynb","week36.ipynb","week37.ipynb","week38.ipynb","week39.ipynb","week40.ipynb"],objects:{},objnames:{},objtypes:{},terms:{"0":[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,22,23,25,26,28,29,30,31,32,33,34],"00":[0,1,5,6,9,11,28,29,30,34],"000":[1,3,9],"0000":[5,9],"00000":[9,33],"000000":[5,11,29],"00000000e":[5,29,34],"00001":33,"00002":33,"00002585e":29,"00003":33,"00005":33,"00007":33,"00009":33,"0001":[1,17],"00010067":33,"00012":33,"000137":25,"00016535":34,"00016719":33,"00017733":[],"00018":33,"00018053":[],"00019998":5,"00021270681344726395":[],"000225":33,"00023":33,"00023813":[],"00024087":5,"00024929":33,"00025662":33,"0002762":33,"00027746":33,"00028":33,"00028167":33,"00029012":5,"0002926":[],"00030601":33,"00031208":33,"00031535148309577417":[6,30],"0003153514830958095":[6,30],"00033904":33,"00034576":33,"00034688149480437765":[],"00034944":5,"0003701342170783489":9,"00037564":33,"00038309":33,"00041619":33,"000417932":2,"00042089":5,"00042093":33,"00042444":33,"00044":33,"00046006":33,"00046111":33,"000464088":2,"00047025":33,"00050694":5,"00051088":33,"00052102":33,"00053001":[],"00053122":[],"00056603":33,"00057726":33,"00058016":[6,30],"00060":33,"00060704":6,"00061058":5,"00062592":6,"00062668":[],"000626681519836":[],"00062713":33,"00063362":31,"00063866":31,"00063957":33,"00066668":[6,30],"00067008":33,"00068091":31,"00068734":[6,30],"00069":33,"00069123":6,"00069482":33,"0007086":33,"00073541":5,"00075590":31,"00076202":33,"00076495":[6,30],"00076908":6,"00076983":33,"0007698473260556325":[6,30],"0007698473260556343":[6,30],"000783":[],"00078324":[],"00078509":33,"00079125":6,"00079904":31,"00079968":5,"00080497":[],"0008297120772365539":[],"00083355":31,"00084707":6,"00085292":33,"00085892":6,"00086984":33,"00087697":[6,30],"00088573":5,"00089193":31,"00092678":6,"00092898":31,"00094499":33,"00096314":5,"00096373":33,"00099778":[],"001":[1,2,8,13,17,30,32,33],"00100519":[6,30],"00100913":[],"001047":33,"0010479245693919886":[6,31],"00105081":[6,30],"00106677":5,"00106776":33,"00107405":[6,30],"00108":33,"00108471":[],"00111756":[6,30],"00114401":[],"00114855":[],"0011526":[6,30],"00115631":33,"00115999":5,"00116001":33,"00118302":33,"00118584":6,"00119688":31,"00126053":33,"00128479":5,"00128523":33,"00131072":33,"001323":[6,30],"00133638":[],"00136125":[],"00137814":6,"00139705":5,"00140846":31,"00141727":33,"00142396":33,"00144539":33,"0014522":33,"001468":[],"00146807":[],"00149311":[6,30],"00149956":[6,30],"00151416":[],"00152117":[6,30],"00154733":5,"00154853":31,"00156374":6,"00157766":33,"00158":33,"00160895":33,"00162921":[],"00167329":33,"00168251":5,"00168745":[],"00169":33,"00170809":[],"00172865":[],"00174276":[6,30],"00174738":[],"00174795":33,"00175331":[6,30],"00178263":33,"001795":34,"00180673":33,"0018310257999764163":[],"00186347":5,"0018798":34,"001880":5,"00193661":33,"00197505":33,"00200":8,"00202624":5,"00202756":[6,30],"00206234":34,"00208188":33,"00209403":[],"00211418":[],"00214559":33,"00217499":[6,30],"00218823":33,"00219195":31,"00220013":[],"00224413":5,"00225842":33,"0022626":34,"00228740":6,"00229111":34,"0023548":[6,30],"00237699":33,"002381316302584885":[6,30],"0023813163025848865":[6,30],"00242441":33,"00242954":31,"00242999":6,"00243186":[6,30],"0024401":5,"00248232":34,"00249435":[6,30],"00250787":[],"00251359":34,"00254973":[],"00256622":[],"00263296":33,"00264":33,"00266858":2,"00268602":33,"00270244":5,"00272337":34,"00274989":[6,30],"00275768":34,"00282226":[],"00282302":33,"00289724":[6,30],"00290613":[],"00291535":33,"00293838":5,"00297571":33,"00298783":34,"00302547":34,"00310113":2,"00312361":[6,30],"00315593":6,"0032153180657605116":[6,31],"00322456":33,"00323332":[6,30],"0032542":5,"00325450":31,"00327797":34,"00329616":33,"00330046":[],"003301":[6,30],"00331927":34,"00334047":[],"0033955154592040936":[6,31],"0034318":33,"00348246":[],"00352878":33,"00353823":5,"00353938":[],"00355614":33,"00359628":34,"0036237":[6,30],"0036367":[6,30],"00364159":34,"00364967":33,"00369758":[6,30],"0038335":[6,30],"00389038":33,"003909404072811226":[6,31],"00391839":5,"0039259":[],"0039455":34,"00399521":34,"0039987":[6,30],"00399972":[],"004":[5,30,31],"00403677":33,"0040792":[],"00408":33,"004091940707753939":[6,31],"00410387":[6,30],"00410478":6,"004113634617443131":[6,29,30],"00411363461744314":[6,29,30],"004113634617443147":[6,29,30],"0041148":[],"00412":33,"00415598634586135":[6,31],"00416103":33,"00420072":31,"00424909":2,"00424967":[6,30],"00426027":5,"0042992":33,"00432864":34,"00433417":11,"00434043":[],"0043587":[],"00438318":34,"00440346":[6,30],"00441097":33,"00443743":[6,30],"0044505":33,"00445186":33,"00445655":11,"00455966":[],"004579219539673834":[6,31],"00458631":[],"00458878":[6,30],"004610275230656212":[6,31],"00462287":[6,30],"00465099":31,"0046544":[],"00468914":25,"00471782":5,"00472199":6,"00472276":[],"00472512":[6,30],"00474898":34,"00476012":33,"00480881":34,"00487029":33,"0049544":[6,30],"00497837":30,"004999999999999991":[],"005":0,"005000000000000001":[],"00507531":[],"00509128":33,"00512599":[],"00512927":5,"00513051":[],"00517114":[6,30],"00519717":[],"00520911":33,"00521014":34,"00522055":[],"00526348":[6,30],"00527578":34,"0053018":[6,30],"00537955":[],"00544547":33,"00551372":33,"00552462":[],"00554202":[],"00554552":[6,30],"00556826":[6,30],"00556946":[],"0055715":33,"00557893":[],"00560098":[],"005643":[],"00564344":[],"00564365":33,"00566707":[],"0056799":5,"00569512":[],"00570321":[],"0057065":[],"00571608":34,"00573727":[],"00574735":[],"00578809":34,"00579953":[6,30],"0058243":33,"00586355":[],"00588657":[6,30],"00593362":[],"0059591":33,"00606382":[],"00607783":6,"006162":[6,30],"00617221":[],"00617499":5,"0062202":[],"00622949":33,"00625051":[],"00627115":34,"00630331":[6,30],"00633289":[],"00634299":[],"00635016":34,"00637188":[],"00637367":33,"00641423":[],"00642221":[6,30],"00644":33,"0064472":30,"00647029":[],"00659604":[],"00660427":[6,30],"00666287":33,"00667611":[],"00672607":[6,30],"00673407":[6,30],"00676256":22,"00676387":[6,30],"00679013":[],"0068011":[6,30],"00681708":33,"00683748":5,"00683875021199284":[],"00683964":[6,30],"00685287":[],"00687309":[],"00688012":34,"00689214":33,"00691012":[],"0069668":34,"007024126888938232":[6,31],"00702721":[],"0071264":33,"00719176":[6,30],"00727646693":[0,28],"00729134":33,"00731392e":29,"007315":29,"00732665":[],"0074331":5,"00747773":[],"00754823":34,"00759119":6,"00762217":33,"00764333":34,"007658477904313023":[],"0076989":34,"00779859":33,"00781918":31,"00784393":[6,30],"00789262":[],"00791263":[],"00798909":[],"00803064":[6,30],"008043811612683473":[],"00805074":31,"00812487":[],"00813803":6,"00815244":33,"00816675":[],"00817631":[6,30],"00823002":5,"00827728":[6,30],"00828121":34,"00831018":[6,30],"00834112":33,"00834567":[6,30],"00838555":34,"00848904":[6,30],"008560581831215528":[],"00859693":[],"00861518":33,"0086649156":[0,28],"008675369724975977":5,"00871959":33,"008753288788081405":29,"00889475":[],"00891702":[],"0089214":33,"00894639":5,"00905423":[6,30],"00908537":34,"009163470508352218":5,"009164545680330616":[6,31],"00917248":[6,30],"00919984":34,"009211602191395454":29,"00925406":33,"00930146":[],"0093262":33,"009338082195270294":[],"00934327e":29,"00934499":[6,30],"00939407":[],"009396472959497925":[],"00940611":[],"00942574":[],"00943959":[],"00954206":33,"00955125":[],"00956827":[],"0096208":[6,30],"00974758":[],"00989834e":[],"00990475":5,"00992331":[6,30],"00996754":[6,30],"00996762":34,"00997502":33,"01":[0,1,2,5,6,9,11,13,17,27,28,29,30,33,34],"010018312644137363":[6,31],"01003519":[],"01006":33,"01006984":[],"0100706":[6,30],"01009321":34,"01013849":[],"01014331":[],"01020588":33,"01024875":[],"01031":33,"01032533":[],"010331721306655127":[6,31],"010348289064969316":[],"01035006":[],"01039879":[],"01044475":[],"010516485576645508":[6,31],"01060492":[],"010612904886352397":[],"01066519":[6,30],"01066897":33,"01075018":[],"01076611":5,"01076897":33,"01080465e":[],"01084359":[],"01091589":33,"01093553":34,"01098247":[],"0110":25,"01107333":34,"011076219011379514":[6,31],"011156605304609659":[],"01119738":[],"011208613520466846":[],"011225":2,"01123792e":29,"0113104":[6,30],"01131771":[],"01141119":33,"01161645":[],"0116753":33,"01178857":[],"01179128":[],"01179415":[],"01179792":[6,30],"011818646101922625":29,"01191824":5,"01199741":34,"01206221":[],"012073649446193166":[6,31],"0121289":[],"01214862":34,"01219292":[6,30],"01220505":33,"01222822":29,"01223198":[6,30],"01231917":[6,30],"01234":[],"01234261":[],"01241284":[],"01244297":[],"01247909":[],"01248754":33,"01250964":[],"01261048":34,"01265755":29,"012658":29,"01266999":[],"01267007":30,"0126711":[],"01288787":[],"01290947":[6,30],"01295356":5,"01305415":33,"013121574015585152":[6,31],"013121574015585155":[6,31],"01315875":[],"01316233":34,"01318643":[6,30],"01327148e":34,"01329403":[],"01332832":34,"01335628":33,"0134113":[],"01346122":33,"01347916":[6,30],"01348565":[6,30],"01349244":[],"01353638":[],"01367553":[6,30],"0137297":33,"01373484":[],"01376216":[],"01393496":[],"01396231":33,"01397146":[6,30],"01405935":[6,30],"01406777":[],"01409478":[],"01416528":[6,30],"01428546":33,"01433809":5,"014436800088904942":[6,31],"01444013":34,"01449782":[6,30],"01458337":[6,30],"014586":29,"01458611":29,"0146081":[6,30],"01462254":34,"01463049":[6,30],"01480256":[],"01493365":33,"014934":33,"01499192":[],"01506354":[],"01507238889517706":[6,30],"01507238889517717":[6,30],"01511937":33,"01527928":33,"01530321":[],"01531845":[6,30],"01532738":[],"01543076":[],"01549377":[6,30],"01551724":[],"015518":[],"01551815":[],"01552874":[],"01558197":5,"01572":33,"01573062":[],"01573768":[],"01584129":34,"01594452":31,"01597256":33,"01604235":34,"01620955":[],"01624447":[],"01625794":[],"01628578269596628":[6,31],"01633913":[6,30],"01634224":33,"01640891":6,"01643795":[],"0164974":[],"01654574":[],"01655318":[6,30],"01655384":[],"016587414993043573":[6,31],"01681612":[],"01682652":33,"01691985":[6,30],"0169643":5,"01706166":[],"01708375":33,"01708781":[6,30],"01708852":[6,30],"01713366":[6,30],"01717549":[],"01724499":5,"017355848195593347":[6,31],"01735584819559336":[6,31],"01737634":34,"01747915":33,"01756114":[],"01759442":[],"01759974":34,"01760144":[],"017665":5,"01772779":[],"01779091e":[],"01783096":[],"01783414e":29,"0178462":[],"01793261":[],"0179826":[],"01811279":[],"01817048":[],"018232":29,"01826811e":[],"01827225":33,"01831050e":[6,30],"01831190e":[6,30],"01844822":[],"01863203":[],"01866537":[6,30],"01869515":33,"01873344":11,"01873869":5,"01881237":[],"01897462":[],"01898855":[6,30],"01905384":34,"01905883":[6,30],"01908936":[6,30],"01922269":[],"0193075":34,"0195302":[],"01954342":33,"01963611":[6,30],"01969145":[6,30],"01975416527185249":[6,31],"01975848":[6,30],"01979808":[],"01999575":33,"02":[0,4,6,7,12,28,29,30,32,34],"02014577":[],"02016185":[],"02024962":[6,30],"02026756":[],"02031987":[],"02032056":[],"02054837e":[6,30],"0206033":[],"02068067":[6,30],"02073509":5,"02077431":30,"02087411":34,"02090304":33,"02091662":[],"02098261":[6,30],"02102403":[],"02103315":33,"0211429":[],"02117843":34,"02123176":[6,30],"02126205":[],"02137508":22,"02138683":33,"02148021":33,"02151521":[],"021544346900318832":30,"02156196":[],"02156565":[],"021592704588025022":[6,31],"021592704588025025":[6,31],"02164667":[],"02175561":22,"02183817":[],"02189863":[],"02198702e":[6,30],"02198703e":[6,30],"022":[],"02207054":[],"02208512":[6,30],"02214409916811925":25,"02218076":[],"02228115":[6,30],"02229529":[6,30],"02235723":33,"02252765":5,"02281004":34,"02286267":[],"02287468":33,"02296298":33,"022999498260366312":[6,31],"0231353":[],"0232":[],"02322297":34,"02322594":[],"023295599127611474":[],"02330799":[],"02334754":[],"02338085":[],"02345858":[],"02348765":[6,30],"02354386":22,"02355756":[],"02358547":[],"02361665":[],"02365049":[6,30],"02374496":[],"02386932":[],"0239126":33,"024":[],"024011020121022356":[],"02404706":[],"0241039":[],"02424794":31,"02432309":[],"02441422":[],"02446604":33,"02447063e":[],"0245528":[6,30],"02456":33,"02459084":33,"02472936":[],"02474828":34,"024792624800382218":5,"02492265":5,"02496085":33,"02498832":[6,30],"02500488":[],"02502325":[],"02503753":[6,30],"02511518":6,"02522069":6,"02527621":[],"0253208":[],"02540212":[],"02544154":34,"02545":33,"02546675":31,"02552966":22,"02557617":33,"02564828":[],"02566356":[],"025709":[11,29],"02572685":[],"02576358":[],"02576685":[],"02586427":[6,30],"02594314":[],"02601643":[],"0260906":[6,30],"02612988e":29,"02616812":33,"02622039":[],"0262517":[],"02625193":8,"02629144":33,"0263106":34,"02631942":[],"02632742":[],"02649469":[],"026495":[],"02651857":[],"02654585":[],"02660572763718093":[6,31],"026605727637180936":[6,31],"02664408":[],"02693015":[],"02693858":30,"02707227":5,"02723445":[6,30],"02735547":33,"02754248":[],"027609773491022525":[6,31],"02760977349102253":[6,31],"02769274":[],"02780107":34,"02784266":[],"02787184":[],"02797154":34,"0279886":33,"02808229":[],"02809972":[],"02850506e":29,"02857":4,"028638258927275215":[],"02895918":30,"02900153e":33,"029003":[],"02901273e":29,"02909574":[],"02920675":[],"02923006":[],"02925855":33,"02928194":[],"02944152":[],"02946852":[],"029483":5,"02965159":[],"029733":29,"02973733":34,"02976145":[6,30],"02980537":[],"02993573":33,"02994311":5,"02f":[6,23],"03":[1,6,29,30],"03015288036252618":[],"03016341":34,"03032441e":[6,30],"03033791":[],"0303586629618948":[],"03057995":[],"030645975175292262":[],"03076019":[],"03077640549":4,"03099776":5,"031":[5,30,31],"03115122":[],"03158013":[],"0316146":34,"0317606":[],"03177331":22,"03196357":[6,30],"03201179e":[],"03201832":33,"03205795":[],"03206757":34,"032142":[],"03214247":[],"03214829":[],"0321956":11,"032196":11,"03239393":[],"03244944":[],"03247316":[],"03251863":5,"03256632e":1,"03267527":[6,30],"03279636":[6,30],"03285784":[],"0328643":33,"0330308045183194":[6,30],"0330308045187757":[6,30],"03306538":33,"03308408":5,"03309191e":29,"03311432":[],"03313259e":29,"03317599":[],"0332335":25,"033233504714921":25,"03358833":[],"03361037":34,"03365012":[],"033657685071527665":[6,31],"0337609":[],"03382942":28,"03396658":[],"034":[],"03400724e":29,"03404758":[],"034048":[],"03409194":34,"0342028":[],"0342458":33,"03447512":[6,30],"034476":11,"03447649":11,"034557":29,"03476611e":29,"03479236":[],"03511387":[],"03529801":[],"03538673e":29,"03562355":[6,30],"03568439":[6,30],"03573214":34,"03578526":[],"0359565":5,"03596557":[],"03624411":34,"0362483569261072":[],"03630548":[6,30],"03642173":[],"03648711":[],"036527092051294":[],"03662823":33,"03664879":[],"03681479262838276":[],"0369544130635358":[],"03701105":[],"03707133":11,"037813671417389005":[6,31],"03781367141738902":[6,31],"03796359":[],"03798785":34,"03814292":[6,30],"03815288":[6,30],"038300":[11,29],"03837":33,"03844073":[],"03846169":30,"03853213":34,"03853268":[],"03853313":[],"03868372":[],"03872795610436844":[],"03873507":[],"03887801":[],"039039":5,"03916813":[],"03948301":[],"03960002":[],"03976851":33,"03979291":[],"039967668952797":[6,30],"0399676689527975":[6,30],"04":[1,6,11,29,30],"040102":5,"04010697":[6,30],"04018985":[],"04038595":34,"04046513":[],"04061345":[],"04063602":[6,30],"040684":[],"04072235":[],"0408223":[],"0409646":34,"041":[6,9],"04101344":[],"04108038":33,"04110474":[],"0411487294305088":[6,30],"0411487294305226":[6,30],"04161572":[],"04191323":[],"04193203":29,"042060":[],"04206048":[],"042136":[],"04216532":[],"0422":[],"04220758":[6,30],"04224929":[],"04238763":[],"04262217":[],"04293545":34,"04295757":31,"043":9,"043072":[],"04307275":25,"04315108":5,"04315855":[],"04323936e":[],"04346721":5,"04353549":[],"04355062":34,"04355837":[6,30],"04362":9,"043637":[],"0437499":2,"043839":[],"04389027":[6,30],"044014":[],"04401421":[],"04413243":[],"04423486":[6,30],"04426744e":29,"044334":29,"044613":[6,30],"04487298":[],"0449":[],"04495752":[],"04504728e":29,"045161":[],"045258":[],"04537385":[6,30],"04543942":[6,30],"045630":[],"04564589":34,"04566964":[6,30],"0458":9,"04588592":[],"045963":[],"0462999":34,"04641529":[],"04648335":5,"04652794":[],"04657426":[],"04664255":6,"046663":[],"046678":[],"046764":[],"04683565":5,"047299":[],"0473916":[],"047447724189861":[],"0474753":33,"047489":[],"04757138":22,"047760":[],"04784395":[6,30],"04794409":[],"048020":[],"04808723":[],"0481872773043029":[6,31],"04832356":[],"04838148":[],"04852743":34,"04877931":[],"048781":[],"04892055":[6,30],"04899367":[],"049060":[],"04909093":[6,30],"04912436":6,"049196":[],"04922273":34,"04926746":31,"049276":[],"049380":[],"049479":[],"049481":[],"049556996627824":[6,30],"0495569966278269":[6,30],"04955942":[],"04963309":[],"049677":[],"05":[1,4,6,23,29,30,33,34],"050015":[],"05002471":[],"05005634426334421":[],"05006037":[],"05009826":[6,30],"05029018":[],"050315327923114654":28,"05034088e":29,"05040878":[],"05045":[],"05054319":29,"05060379":[],"05068486":[],"050796":[],"05087018":[],"05098714":[],"05100875":[6,30],"051021":[],"051042":[],"05135047":33,"051368":[],"05141614":[],"051418":5,"051554":[],"05159088":34,"051645":[],"051649":[11,29],"0517473":5,"05176711":[],"051787":[],"052010":11,"05201041":11,"05224117":[],"052279218012056844":[6,31],"05227921801205686":[6,31],"052305":29,"05233008":34,"052370":[],"05240397":[],"052427":[],"0524497":29,"0525733":[],"05263":9,"052692":[],"052738":[],"052856":[],"05296475":22,"05302":9,"053036":[],"05336637":[],"053387":[],"053417":29,"053462":[],"053599":[],"05364854":8,"053787":[],"05383795":[6,30],"053849":5,"053854":[],"05401912":[],"054197":[],"054286":[],"054434":[],"05447415":[6,30],"054609":[],"054617":29,"054655":29,"05484773":34,"054932":[],"055000":[],"05505310046363":2,"055091049054481":[],"05509105":[],"05519999":30,"05533":9,"055477":[],"05549529":[],"05563358":34,"055653":[],"055676":29,"055734":29,"055737":[],"05577845931438246":[],"055876":[],"055910":29,"055987":29,"056026":[],"056041":[],"05614483":5,"0562":31,"05623":9,"056287":[],"056328":[],"05641352":[],"056414":[],"05648":9,"05651951":[6,30],"05665429e":29,"05667":9,"056683":29,"056717":[],"056826":[],"056856":[],"05716368155342608":[6,31],"057216":[],"057287":[],"057300":29,"057316":[],"057387":[],"057393":29,"057418":29,"057420":[],"057457":29,"05747369":[],"057514":[],"057607":[],"057609":[],"057722":29,"057835":29,"05785343":[6,30],"05789007":[6,30],"057913350391706":[],"057929":[],"05792927":[],"057951":[],"057961":[],"05796251":[6,30],"057964":[],"05804539":[],"05804744e":33,"05807125":[6,30],"058133":[],"058152":[],"058234":[],"058245":[],"058254":[],"05831017":34,"058361":[],"058422":[],"058427":[],"058552":29,"058582":[],"058593":[],"058641":[],"058645":29,"0586484":33,"058721":[],"058770":[],"05883":9,"05884":9,"058854":29,"05888195":[],"058952":29,"058967":[],"058970":[],"058996":29,"058997":[],"059031":29,"05914563":34,"059201":[],"059243":[],"059340":[],"059624":[],"059669":[],"059761":11,"05978512":[],"059807":29,"059876":[],"059951":29,"059956":11,"05996":33,"059977":[],"05999":9,"059992":[],"059993":29,"06":[6,29,30,33,34],"060071":[],"060083":29,"060085":[],"060087":[],"060171":[],"06020264":[],"06020587":[6,30],"060251":[],"060254":29,"060275":11,"060288":[],"060312":[],"06043581":[6,30],"060453":[],"060470":[],"060471":[],"060475":[],"0604888":[],"060490":[],"060547":[],"060629":[],"060631":[],"060652":[],"0606958":[],"060716":29,"06072":33,"060726":11,"060734":[],"060735":[],"060756":29,"060870":[],"060872":29,"060898":[],"060994":[],"061025":[],"061154":[],"061163":29,"061284":[],"061319":11,"061359":29,"061386":[],"061443":29,"061452":29,"061588":[],"061614":29,"061637":[],"061656":[],"061706":[],"061724":[],"061848":[],"061862":[],"061898":11,"061921":[],"06199119":34,"06200174":5,"062016":29,"062053":[],"062058":[],"06208238634231949":[6,31],"062161":[],"06216141":[],"062173":[],"062199":[],"062216":5,"062231":[],"062260":[],"062263":[],"062282":[],"062292565":4,"062300":[],"062337":29,"062356":[],"062429":[],"062520":11,"062599":29,"06260611":[],"062616":[],"062624":29,"062637":[],"062691":[],"062700":[],"062797":[],"062853":[],"062874":29,"06287939":34,"062932":[],"063017":[],"063019":29,"063048":[],"063061":29,"063064":[],"063080":29,"063130":11,"063133":[],"063161":11,"063163":[],"063197":11,"063206":11,"063260":29,"063294":11,"063332":11,"063354":[],"063395":11,"063518":[],"063525":[],"063526":[],"063536":5,"063545":[],"063549":[],"063560":[],"063637":[],"063653":29,"063673":[],"0637712":[],"063781":[],"063786":5,"063791":[],"063802":[],"0638484":33,"063862":[],"063894":29,"06392846":[],"063933":11,"063954":[],"063959":[],"063977":[],"063995":[],"064000":[],"064074":29,"064077":[],"06410638":[],"064107":[],"06416459":[],"064166":[],"06418809":33,"064189":11,"064202":[],"064218":[],"064294":[],"06430789":[],"06432267":[],"064382":[],"064427":[],"064428":[],"06444":9,"06444224":[],"064501":29,"064505":[],"064507":[],"06453579006728324":[6,31],"064547":[],"064573":[],"064604":[],"064606":[5,29],"064609":29,"064615":[],"064668":[],"064690":[],"064695":[],"064699":29,"064728":11,"064739":[],"064793":29,"064820":[],"064834":[],"064873":[],"064878":[],"06491736":[6,30],"064978":[],"065001":[],"065007":[],"065028":[],"065062":[],"065077":29,"065096":11,"065108":[],"065121":5,"065149":[],"065212":[],"065217":11,"065352":[],"065358":[],"06536971":[],"065378":29,"065390":29,"065410":29,"06547790180152355":[6,31],"06547790180152359":[6,31],"065482":[],"065556":[],"065616":[],"065619":5,"065654":5,"065679":[],"065788":[],"065818":[],"065821":5,"065830":[],"06590458":34,"065949":[],"065963":[],"066054":11,"066059":5,"066066":29,"066127":5,"066145":5,"066153":[],"066199":5,"066205":5,"06622369":[],"066256":[],"066286":11,"066358":5,"06637":9,"066425":5,"066458":[],"066474":29,"066500":29,"066612":29,"06662069e":[],"066633":[],"066647":29,"066653":[],"0666807":2,"066686":11,"06674611e":[],"066763":[],"066766":5,"06677444e":[],"066778":5,"066787":29,"066824":[],"066837":[11,29],"066838":[],"06684886":34,"06685171":[],"066854":29,"066855":[],"066865":[],"06690071":[],"066912":5,"066948":5,"066988":11,"066997":[],"066999":29,"067000":5,"067003":[],"067074":[],"067141":[],"067164":[],"067168":[],"06724062":5,"067270675787016":[33,34],"067367":[],"067374":11,"067380":[],"067400":11,"067431":11,"067511":11,"067515":5,"067539":5,"067637":29,"067671":[],"067707":29,"067764":[],"06777772":[],"067793":[],"067809":[],"067843":11,"067922":11,"067948":[],"067967":[],"067974":11,"06804775":[],"06808421":22,"068116":[],"068206":[],"068215":11,"068264":29,"068268":[],"068307":29,"068353":5,"068360":[],"068369":[],"068394":11,"068408":[],"068441":29,"06844519414009445":[6,31],"06844519414009446":[6,31],"068446":[],"06849372":[],"068494":[],"068504":[],"068512":5,"068533":[],"068539":11,"068587":11,"068592":[],"068607":[],"068629":29,"068680":[],"068684":[],"068727":29,"068758":[],"068775":11,"068827":11,"068843":11,"068897":[],"068903":[],"068906":29,"068912":[],"068924":11,"068967":[],"068977":11,"068985":11,"06901081":[],"069028":29,"069045":11,"069129":11,"069179":[],"069203":5,"06926192":28,"069270":11,"069293":5,"069317":[],"069320":11,"069322":[],"069399":[],"06942115e":[],"0694226":[],"069427":[],"069439":[],"069452":29,"069484":[],"069486":[],"069584":29,"069802":[],"069811":11,"06984502":[],"069866":5,"069873":[],"069885":[],"069907":5,"0699274":25,"069978":[],"069979":[],"07":[6,29,30,33],"070024":11,"070027":11,"070043":29,"07006502":34,"070095":[],"070098":11,"070135":5,"070146":29,"070150":[],"07016":9,"07017":9,"070183":11,"070213":29,"070274":11,"070275":11,"07039":9,"070432":[],"070441":[],"070457":29,"070462":[],"070514":[],"070531":5,"070547":11,"070552":5,"070556":[],"070558":[],"070582":29,"070600":[],"070605":5,"070622":5,"07062318":[6,30],"070630":[],"070655":5,"070696":11,"070712":5,"070737":29,"070772":11,"070780":5,"070805":5,"070855":5,"070859":[],"070886":[],"070889":[11,29],"070891":[],"070898":[],"070916":11,"070918":11,"070950":[],"070980":[],"070986":29,"071049":5,"071055":11,"07106891":34,"071103":[],"07115":9,"071173":5,"071186":11,"071191":11,"071208":[],"07123177":[],"071252":[],"071279":[],"071291":[],"071294":5,"0713":[0,28],"071314":[],"071356":[],"071379":11,"071433":[],"071436":5,"071437":5,"071449":[],"07145103":11,"071530":[],"071560":5,"071572":[],"071578":[],"071580":11,"07160048164233102":[6,31],"07160048164233104":[6,31],"071608":[],"071638":5,"071643":11,"071655":[],"071656":11,"071680":5,"071758":[],"071803":[],"071831":[],"0718316":33,"071868":[],"071921":[],"071935":[],"071937":[],"072000":29,"072015":5,"072031":5,"072037":5,"072092":[],"072111":29,"072132":[11,29],"072147":[],"07218473624441492":22,"072200":11,"072209":[],"072286":[],"072290639572326":25,"07229064":25,"072304":[],"072344":[],"072380":5,"07241855":[],"072476":29,"072500":[],"072590":[],"072591":5,"072621":29,"072638":[],"072684":[],"072689":[],"072697":[],"072728":[],"072752":[],"072817":[],"072824":11,"072826":5,"072843":[],"072849":5,"07285":3,"072863":[],"072947":11,"072961":5,"072997":5,"073048":[],"073102":[],"073109":[],"073253":[],"073258":11,"073262":11,"073288":[],"07332248":[],"073339":[],"073405":[],"073408":[],"073415":[],"073422":[],"073499":[],"073514":5,"073528":11,"073576975500551":25,"073598":[11,29],"073612":5,"073644":29,"073647":11,"073672":[],"073685":[],"07373479":[],"07378525":[],"073791":[],"073800":5,"073858":[],"073866":[],"073882":11,"073911":5,"073923":[],"07405556":[],"074067":[11,29],"074084":29,"074112":[],"074114":[],"074115":11,"074130":[],"074210":29,"07421084":5,"074221":[],"07429886e":[],"074323":29,"074368":[],"074374":5,"074417":[],"074454":5,"0744881":34,"074531":[],"074561":11,"07456491":5,"07469645":[],"074807":[],"074824":[],"074859":[],"074892":[],"07490892":[6,30],"074971":[],"075176":[],"075177":[],"075198":[],"075239":5,"075289":5,"075298":[],"075302":11,"07531349":[],"075356":[],"075385":[],"075392":[],"075463":[],"075513":11,"075522":[],"07555537":34,"075557":[],"075602":[],"075615":[],"075771":[],"075794":[],"075816":29,"075822":[],"075842":5,"075876":5,"075885":25,"075889":29,"075909":[],"075956":[],"075978":5,"076066":5,"076071":5,"076091":[],"076138":[],"076150":29,"076161":[],"076167":[],"076232":5,"076244":[],"076259":[],"076321":5,"076333":[],"076351":[],"076389":[],"076393":[],"076396":[],"076418":[],"07641937":31,"076434":11,"076435":[],"076436":[],"076448":5,"076459":[],"076479":11,"0764924":[6,30],"076508":11,"076542":[],"076618":[],"076638":[],"076648":11,"076679":11,"076693":[],"076776262573027":[],"07678":9,"076833":[],"076857":[],"076859":[],"0768805855280187":[],"07692307692307693":9,"076934":[],"076938":[11,29],"076947":11,"076968":[],"077035":5,"07712197e":[],"077141":[],"077168":29,"077226":[],"077248":[],"077280":5,"077301":[],"077304":[],"077329":[],"077341":[],"077382":[],"077391":5,"07740964":25,"077411":[],"07745579":22,"077460":29,"077485":11,"077486":[],"077516":[],"077529":[],"077539":[],"077553":[],"077567":[],"077601":11,"077613":[],"077653":[],"0776532":[],"077683":[],"077736":[],"077745":11,"07776381":11,"077764":11,"07777777777777778":1,"077813":11,"077839":11,"077906":[],"077941":[],"077965":[],"078035":[],"078044":11,"078071":[],"07808426989543932":[],"078110":29,"078118":[],"078123":11,"078146":11,"07820":9,"078210":[],"078238":[],"078268":11,"078282":[],"078284":[],"078313":[],"078324":[],"078336":29,"078359":5,"078363":[],"078386":[],"078447":[],"078540":29,"078541":11,"078544":[],"078557":[],"078573":11,"078588":[],"078636":[],"07864":9,"078684":[],"078688":11,"07871":9,"078731":[],"07890044":[],"078945":5,"078974":29,"078981":[],"078986":29,"079002":5,"079027":[],"079030":5,"079074":[],"079089":[],"079107":11,"079174":11,"07919041":34,"079202":11,"079240":5,"079334":[],"079347":[],"079391":[],"079420":[],"07944154":[22,28],"079444":[],"07950356694388497":[],"079510":[],"079670":5,"0796891867672603":[6,31],"079739":[],"079747":11,"07974741":[],"07978850553011713":[],"079887":[],"079903":[],"079946":29,"079947":[],"079953":[],"079959":[],"079976":5,"079977":[],"07998756":[],"079989":[],"079998":[],"08":[9,25,29,33,34],"080082":[],"080094":5,"080171":[],"080205":[],"080222":[],"08023512":33,"080316":[],"08032505":34,"080345":11,"08043851":5,"080453":[],"080549":5,"080555":[],"080616":29,"080630":[],"080657":[],"080702":[],"080706":5,"080747":[],"080764":29,"080832":[],"080903":[],"080947":[],"080987":[],"081038":[],"081103":[],"081195":[],"081217":5,"081221":[],"081235":[],"081252":[],"081276":29,"08131003":6,"0813156":[],"081431":[],"081457":[],"081494":[],"081527":5,"081544":[],"08156108":[6,30],"08165104":29,"081655":29,"081686":5,"081728":[],"08179906":[],"081835":[],"081871":[],"081955":[],"081978":[],"082115":[],"082126":[],"082170":[],"082173":[],"082174":[],"08227668":[],"082303":[],"08233627":[],"082464":[],"082482":[],"08251519":[6,30],"082518":[],"082519":[],"082533":5,"082653":29,"08266769":28,"082742":5,"082764":[],"082784":11,"082785":[],"082803":[],"082857":[],"082971":[],"08299273e":[6,30],"083016":11,"083119":[],"0831367":[],"083179":5,"083182":[],"08318298e":1,"083248":[],"083259":[],"083260":11,"083268":5,"083288":[],"08333333333333333":9,"083342":11,"08336233266":4,"083446":[],"083465":[],"083471":[],"083479":[],"083499":[],"083501":[],"083527":29,"083547":11,"083548":5,"083564":[],"083734":[],"083765":[],"08376632":[6,29,30],"083766322923899":[6,29,30],"0837663229239043":[6,29,30],"083793":[],"083864":[],"083900":[],"08398399377155011":9,"084018":[],"084042":[],"084076":29,"084091":[],"084122":[],"08418956":34,"084218":11,"08421808":11,"084255":[],"08426840630693411":[6,31],"08426840630693413":[6,31],"084312":11,"084319":[],"084358":[],"084376":[],"084406":[],"084434":[],"084514":[],"08455":9,"08458591":28,"084619":[],"084637":[],"084695":[],"084702":[],"084712":[],"08474":9,"084809":29,"084910":[],"084915":[],"084963":5,"084967":[],"084996":[],"085079":[],"085120":[],"085139":[],"085145":5,"085222":[],"085294":[],"085353":[],"08536248571780691":5,"085390":[],"08539155":33,"085392":[],"08539583":34,"085436":[],"085455":[],"08551306":[6,30],"085518":[],"085548":[],"085592":[],"08576932":6,"085853":5,"085918":[],"08593216":[6,30],"085973":[],"085996":[],"086026":[],"086068":5,"086095":[],"086096":[],"08611111111111111":1,"086125":[],"086212":[],"086230":[],"086239":5,"08624193":[],"086250":[],"086286":[],"086318":[],"086346":[],"086364":[],"086428":[],"086483":5,"08660891":[],"08667591":[],"086694":[],"086712":[],"086730":[],"086799":[],"086808":[],"086809":[],"08687303":33,"08690":9,"08690184845323":11,"086913":[],"086970":[],"08699295e":[],"08702578":34,"087210":[],"087424":[],"087429":5,"0875061":[],"08758":9,"08758013":[],"087864":[],"087871":5,"08793554992813543":[],"087988":[],"088023":[],"088029":[],"088030":[],"088038":[],"088102":[],"088127":[],"0881981":5,"088199":[],"08826182458028335":[],"088375":[],"08839544":[],"088574":[],"088651":[],"08871404":5,"08881497884574564":29,"08888888888888889":1,"088970":[],"08902":9,"08931169286872433":[],"08935132374099551":[],"089376":[],"0894015":[],"089404":[],"08946029":[],"0895043":34,"0895387":29,"089539":29,"089548":[],"089578":[],"089600":[],"089619":[],"089626":5,"089718":[],"08996":9,"089996":5,"09":[1,29],"090033":[],"090038":[],"09028702":[],"090439":[],"090440":[],"090468":[],"09048717285916912":22,"090624":[],"09070064":22,"09078672":34,"0907958":[],"090985":[],"091015":[],"091068":[],"091159":[],"09135059e":[],"091362":5,"091365":[],"091388":[],"09156055":[],"09163947":6,"09166666666666666":1,"0917":9,"09171886":[],"091731":[],"092252":[],"092347":[],"092401":[],"09246293455466892":28,"092486":[],"09251":9,"092607":[],"092608577084595":[],"09291556244521161":[],"09291806":[],"092956":5,"092982":[],"0930438":[],"093094":[],"09346106":[],"093554":[],"09368":33,"09398153":[],"094044":[],"0940821989627646e":[6,30],"0940821989652176e":[6,30],"094099":[],"094254":[],"094362":[],"094439":[],"09444444444444444":[],"09487358":22,"09515455":34,"09529067":[],"095465":[],"095805":[],"09590269e":29,"09604976":[],"09609807":5,"09610694":25,"096270":[],"096365":[],"096511363983559":[],"09651792":34,"0973900819831327":25,"0974119":22,"09744":9,"09755017":[],"09780":9,"09790216282081063":[],"09791":9,"09808622":[],"09829902":25,"098414":[],"09846933":[],"09861229":[22,28],"09903804":8,"09913654":[],"09919198949275869":[6,31],"09928714":22,"09951287404314545":1,"0n":[0,28],"0x0006":[3,4,14],"0x117893340":34,"0x117c17be0":34,"0x11f13fb20":33,"0x120cc1b20":[],"0x121cf68e0":[],"0x1273ffac0":[],"0x1279bd460":[],"0x12e13a850":33,"1":[1,2,3,4,5,6,7,8,9,10,11,12,13,14,19,22,24,25,26,27,30,31,32,33,34],"10":[0,1,2,3,4,5,6,7,8,9,10,11,12,13,22,23,24,25,26,28,29,30,31,32,33,34],"100":[0,1,2,3,4,5,6,8,9,10,11,13,14,15,16,17,22,25,26,28,29,30,31,32,33,34],"1000":[0,1,2,4,5,8,11,13,14,21,25,28,29,32,33,34],"10000":[2,5,6,10,11,13,25,30,31],"100000":8,"10001":10,"100083":[],"10008326":[],"1000911":[],"1001":[9,25],"1002":25,"10029389":33,"1003":25,"10030":9,"10036694":[],"10041812":30,"1005":25,"1007":31,"1007711427354898":[6,31],"1009":25,"10107914":25,"1011":25,"101150":5,"10115017":5,"10116149":34,"101263":[],"1013":25,"1013904243":25,"10141413e":[6,30],"1015":25,"1015491":33,"1015am":28,"1023":25,"10230":9,"1024":3,"1026":25,"10261093":34,"1027":25,"103":1,"1030":25,"10340":9,"1037":25,"10378326e":1,"1038":25,"10391807":[6,30],"10398646080125032":[6,31],"10398646080125035":[6,31],"1040":25,"10405456":11,"10430":9,"104411":29,"1047":25,"10499357":33,"105":30,"10520":9,"10539984":[],"105400":[],"10541723644166373":[],"10555555555555556":1,"10572":31,"10589577":5,"10595991":[],"10604579e":29,"106095":[11,29],"1064601390492845":25,"10646014":25,"10719554":[],"10747579":5,"107476":5,"1074792":[],"10754764":34,"1079":31,"10790125813226321":29,"108":[6,9],"10837392":22,"10888197":34,"10908858":34,"10913":6,"10931453":[6,30],"10960":9,"10994958":[],"10th":9,"10x":[0,28],"11":[0,1,2,5,6,7,8,9,10,11,12,13,15,16,22,23,24,25,26,27,28,29,30,31,32,33,34],"1100":25,"1101":25,"11022302e":[5,34],"11042239":[],"11081083":[],"1108407":[],"111":[1,7,12,32,34],"11100":9,"11113486":11,"111135":11,"1118933":22,"11202337":31,"112383":[11,29],"1124":9,"112619":[],"11261935":[],"11265643e":29,"11277166":5,"112772":5,"11382896":30,"11388888888888889":[],"11390":9,"11433693":34,"114384":11,"11438414":11,"11439407":[],"114550":31,"11462415":5,"11482289e":[6,30],"1148541":[],"11507992e":1,"115356":[],"11535632":[],"11547777218872497":[6,31],"11548661":[],"11571507":34,"115822":6,"11590":9,"11596834":[],"11597515":34,"11660":9,"11666666666666667":1,"11694":23,"117":8,"11715109e":29,"11744554e":[6,30],"11747908":22,"11780":9,"118":[0,2,7,32],"11822173":34,"11830757":30,"118318":29,"1184":31,"11840":9,"11844773":[],"11868033":[],"11890":9,"119":[0,2,7,32],"11922031":[],"11930916":28,"11992194":11,"119922":11,"119936":2,"12":[0,1,2,3,4,5,6,7,8,9,11,12,22,25,27,28,29,31,32,33,34],"120":[0,2,3,7,32],"1203":9,"1203284":8,"120435":5,"12043521":5,"12044974":29,"120450":29,"12081773":33,"121":[8,9,10],"121292":[],"12155483":34,"1215pm":[26,28],"12182967":[6,30],"122":[2,8,9,10],"12206013":34,"12220276":34,"12222222222222222":1,"12235593":[],"123":2,"12318726e":[6,30],"12329646":34,"12330033":29,"12333649":[6,30],"12363332":22,"123711":6,"12380":9,"12382443":[],"124":[0,28],"12400":9,"1242":8,"124228866018077":[],"12466453":33,"12498355":[],"12536737":33,"12552073e":[6,30],"12591227":29,"126":9,"1261":9,"12618549":5,"1265":9,"127":4,"1271":6,"12777777777777777":[],"12790":9,"128":[3,4,13,33,34],"12829994e":29,"12846660e":29,"12871842":29,"129012":6,"12922837":34,"12952339":30,"12957454":25,"1297":9,"1298":9,"129963":31,"12it":[],"12pm":[26,28],"13":[0,1,2,5,6,7,9,11,12,18,22,25,28,29,31,32,33,34],"130":9,"13003291":[6,30],"13024288":[],"13035147135400782":11,"13040489":25,"13055555555555556":[],"13055762":[],"130694":29,"13069442":29,"131":9,"13107995":34,"13134148011170077":[],"13137881":[],"131379":[],"13152828":[],"13164176":28,"132":9,"13220608e":[6,30],"1325":6,"1326":9,"1326197715":28,"13280":9,"133":[7,32],"1332":31,"134":30,"135":9,"1350":31,"13535942":[6,30],"13564988":28,"136":[0,7,32],"13600596":[],"13607502":[],"13646574":5,"13661243e":[6,30],"13663125":28,"13675593":[],"136756":[],"13679863":[6,30],"13699574":[],"136996":[],"137":[0,7,32],"13729154":28,"13738633":34,"13740":9,"137652":[11,29],"138":[0,7,32],"13819592e":29,"13820":33,"13825388":[],"13847167":[],"1385":6,"1385510301651882":[],"13865173":5,"138775":[11,29],"1388888888888889":[],"13890":9,"13896095":28,"139":[0,7,32],"13911934":25,"13913033":[],"139224":[],"1392559585020426e":[6,30],"139255958997547e":[6,30],"1393548":34,"13956654":[],"13it":[],"14":[0,2,4,5,6,7,8,9,10,11,12,22,25,27,29,31,32,33,34],"140":[0,2,7,9,32],"14021063":[6,30],"14046224e":[],"141":[0,2,7,32],"14100":9,"14104212":25,"1412":[33,34],"14122256":[],"1416398":[6,30],"14174745":[6,30],"1418":9,"142":[0,7,9,32],"14213876":[],"14250":9,"14260706":[],"14277718e":29,"143":[0,2,7,9,32],"14369927":[],"1437":1,"144":[0,7,32],"14400":9,"1440501043841336":1,"1441031":[],"14440":9,"1446729567":4,"145":2,"14523337e":[],"14550854":11,"145509":11,"14568914":30,"14599499":[],"146":2,"14605929":34,"14629156":31,"14638":33,"14643345e":[],"14708":[],"14710":9,"14716":6,"14722222222222223":1,"147400":[11,29],"147420":[11,29],"147545":6,"1477190177681485":[],"147836":[],"1479":9,"148":[3,4,14],"14812206":6,"14815202":34,"14824254":[],"14825560e":29,"14828178":22,"14829228":[],"14841322":28,"14880915":33,"1488598":[],"149063":[],"149266":6,"14934258650797513":[],"149353":31,"149388":[],"149466":[],"149483":[],"149904":[],"149921":[],"14g":[6,31],"14it":[],"15":[0,1,2,4,6,7,8,9,12,13,15,16,17,25,28,31,32,33,34],"150":[3,4,8,9,14],"15005476":5,"150527":[],"15079545":[],"15098090e":[6,30],"151":[3,4,14],"15130074e":[6,30],"151522":[],"15173932":[],"152":9,"15200":9,"15202654":[],"152494":6,"1527777777777778":[],"15283463":[],"153":[3,4,14],"153036":29,"15313054":31,"15361856":34,"15384615384615385":9,"154":[3,4,14],"155":[3,4,9,14],"15527976":34,"15546887":[],"15593478":[],"156":[3,4,14],"15605625":[],"15670921":33,"1567286":33,"156956":5,"157":[3,4,14],"15709522":[],"157128":[],"1571284":[],"1575":9,"1575046":34,"158":9,"15830902":33,"15833751":[],"1587":9,"1590":9,"15924557e":29,"15951871":33,"1598058":[],"15990":9,"15991124e":[],"15am":28,"15g":[6,31],"15it":[],"16":[1,2,3,4,5,6,8,9,10,19,25,28,29,30,31,33,34],"1603":3,"16063661":[],"16111111111111112":1,"16118615":[],"16158074":[],"161581":[],"16172219e":[],"16188604":[],"16201555":[],"16211139":5,"16220":9,"162246":5,"16231451":4,"1625":9,"1628":9,"16292908":22,"16304863":29,"163049":29,"1630775253":1,"16312434e":[],"16342407":5,"16343471":[6,30],"1636508":[],"16384":3,"16407038":28,"16411163":[],"164112":[],"16431956":[],"16500":9,"165272":[],"16535252":28,"16567361":[],"166":9,"1664372":[],"166540":[],"16654048":[],"16710567":28,"16744759":34,"16777789":22,"167787":5,"16791183":22,"168":9,"16805821e":[6,30],"16879134":[],"17":[1,2,5,6,7,8,9,13,22,25,29,31,32,33,34],"17021424":25,"1709":9,"171":30,"171525":29,"1715252":29,"17174962e":1,"17214545":22,"17222222222222222":[],"1726":9,"17260271":[],"17272182":25,"173":34,"17300":9,"1731":9,"1732863504708044":[],"17359583e":34,"17367225":[],"17377547":[],"17405911e":[],"17446471":6,"17483760":31,"175":31,"1752":9,"175300":29,"17547294e":[],"17563274":[],"17567503":[],"17641709":[6,30],"17643975e":29,"176762":[],"17676247":[],"1767857":28,"17739525":28,"17748881e":33,"17777777777777778":1,"17801022":5,"17801827":34,"17834506e":[],"17856374":[],"17861098":6,"17861414":[],"17869861e":29,"179":[],"17913653":[],"17917768":5,"1793417":[],"17934801":[],"17949575":5,"17953942":11,"1797":[1,3],"18":[2,6,7,8,9,10,13,25,31,32,33,34],"180":2,"1801709":30,"18019623e":[],"18029127":5,"18043393":25,"1807":4,"1808228":33,"18085537":[],"1809":9,"18093549":33,"18094575":[],"181":9,"1810415856976313":[],"18118338":[],"1812":9,"18120973":[],"181210":[],"18147009":[],"181766185664273":[],"182086698929565":[],"1821":9,"18234308":[],"18277213":[],"18285689e":[],"18307821":30,"18333333333333332":[],"18383522":29,"18388":6,"184":9,"1840":31,"18409254":[],"18418938":[],"184519":29,"18485685":[],"184866696796263":[],"18497496":11,"184975":11,"185":30,"18501900e":29,"18510775":[],"1860":9,"18611111111111112":[],"18613217e":[6,30],"18660":9,"18670072e":29,"18673098":11,"18702469":22,"18742521":[],"18816387":[],"18824338":[],"18840034e":[],"18925625":34,"189496":29,"189622":29,"19":[2,6,9,15,25,28,31,33,34],"19009085621304586":[],"190529":[],"19052935":[],"19069576e":33,"19166666666666668":1,"192":31,"19207979":5,"19220":9,"19299283":[],"1940":0,"194042826649355e":[6,30],"194042826815211e":[6,30],"1943":[12,34],"19433318":[],"1944":6,"19547923":[],"19559737e":29,"1956":9,"19569961":[6,29,30],"19588651":33,"19661197":33,"19677112":[],"1970":[22,28],"1973":9,"197370":[11,29],"19740":9,"1979":[6,31],"19791352":[],"197914":[],"19800":9,"19849513":28,"19852045":[],"1_1":[12,34],"1_2":[12,34],"1_3":[12,34],"1cm":[0,8,10,25,28],"1d":[1,2,3],"1e":[1,2,4,13,14,33,34],"1e10":14,"1e4":6,"1f":1,"1k":22,"1n":[0,28],"1x":[0,28],"2":[1,2,3,4,5,6,7,8,9,10,11,12,13,14,19,21,22,23,24,25,27,31,32,33,34],"20":[0,1,2,6,7,8,9,13,19,25,26,28,30,31,32,33,34],"200":[0,2,3,4,8,9,10],"2000":[0,29],"20015436":6,"2004":[13,32],"20051449":[],"2006":27,"2008":28,"2010":1,"2011":1,"2014":4,"2015":1,"20158083":5,"201581":5,"2016":[0,28],"2018":[0,6,29,31],"2019":[8,9],"2021":[6,14,29,30,32],"20218457":[],"2022":28,"20228273":[],"2023":23,"2024":[15,16,17,18,19,20,28,29,30,31,32],"202698":[],"2026985":[],"2027":9,"20277777777777778":1,"20347912":[],"20357736":[],"20367355":22,"20375464":[],"204049":11,"20404927":11,"20480187":[],"204802":[],"20500":9,"2060":9,"20601797e":29,"20608548e":29,"20651434":[],"206664":5,"20666447":5,"2069":9,"20728198":[],"207545":[11,29],"20755569":[],"2077068":[],"20775115":[],"20833333333333334":1,"20834188":[],"20867052175034223":[6,31],"20912557":[],"20916295":29,"20980":9,"21":[0,1,2,5,6,7,9,12,13,22,28,29,31,32,33,34],"210340":[11,29],"21058097":5,"21070843":28,"21093775":6,"211":[],"21130":9,"2116753732":4,"21169159e":[6,30],"21192602e":[],"212":[],"21277816e":29,"213":[],"213103":[11,29],"2131067":22,"21332621":0,"21333766":28,"213743":[11,29],"21390371e":[],"21430643e":33,"21444055":25,"21517262":6,"21531156":[],"21565007e":29,"21596432":6,"2160073466353432":[],"216290":[11,29],"21631786":28,"21655059e":29,"216683":[11,29],"21680864":[],"21699817":[],"21805426":[],"21813899e":[],"21998973":[],"22":[0,1,2,5,6,9,12,13,22,28,29,31,33,34],"22044605e":[5,29,34],"221":8,"221180":29,"2216":9,"221666864828611":[],"22169087":[],"2218":9,"221805":2,"221921":5,"22217237e":29,"222400":29,"22467274":31,"225":4,"22528536":[],"2257449":[],"22592946e":[],"226014":[],"22601408":[],"22667819":[],"22688898":[],"22690428":5,"22755839e":[],"22810365":[],"228104":[],"22842468702219465":[6,31],"2284246870221947":[6,31],"22847924":5,"22849742":[],"22871":33,"22919456":[],"2293":2,"2294":2,"2296":2,"2297":2,"22977659964799":[],"2297766":[],"22it":6,"23":[1,2,6,9,12,15,20,22,28,31,34],"23002365e":[6,30],"23076923076923078":9,"23093598e":[],"23139242":[],"23164401":[],"23167717":5,"232435":29,"23303727":22,"23333333333333334":[],"23344210e":29,"2338675":29,"233868":29,"234":6,"23423987":[],"234496":5,"23449607":5,"23472994":[],"23481471":28,"2351":6,"23526911":[],"23528337":31,"235969":[],"23596934":[],"2364":9,"23663482":22,"2373286546935638":[],"23794815":25,"23847441":[],"239":31,"2397":9,"23971032":29,"23994188e":[],"24":[0,1,6,9,22,28,31,33,34],"2401":23,"24032019":[],"24071032":[],"24106503":33,"24140":9,"24159785":29,"2416":9,"24175744e":[6,30],"2419":9,"24224776e":[],"24254071":[],"24284399":[],"2430":9,"24346138":25,"24369936":[],"24377554":[],"243776":[],"24390":9,"24398826":[],"24433117":[],"24444444444444444":[],"24454968":[],"24485814":33,"24493666":31,"246":2,"24602146":33,"24613581":28,"24640494":33,"24688853":[],"24692014":[],"2475908482537097":[],"24759085":[],"24768421e":33,"24780663":22,"24829908":5,"24856992e":[],"24906604e":[6,30],"24it":[],"25":[2,3,4,5,6,8,9,11,22,23,29,31,33,34],"250":[2,4,7,9,32],"25000":0,"25185716":30,"251879":29,"252008":5,"25200841":5,"25233253":[],"252333":[],"252436":29,"25343155":31,"253891":[],"25389111":[],"25458506e":[],"2546186":[],"254619":[],"2546817701709956":[],"255":3,"255001":29,"25512598":[],"25555619":[],"256":[2,4],"25617655e":[6,30],"25617658e":[6,30],"25673276":[],"256733":[],"25695398":31,"25705685":[],"2572":9,"2575":9,"25849623":34,"25879315330607":11,"259153":[11,29],"2597":9,"25970297":[],"25986026":[],"25989189":[],"26":[6,9,16,25,31,33,34],"26001134":25,"26048873":[],"26113912":[],"26124692":6,"26152075":28,"26254957e":29,"262648":[],"26264849":[],"26281735":33,"26292364":31,"26297455":29,"26301436":5,"26307235":[],"2630723514841553":[],"26321660e":29,"26378176e":[],"26409315307910025":[6,30],"2640931530791004":[6,30],"26464303e":[],"26479234":[],"2650":9,"265109911":4,"26527089":22,"2654":9,"265868":[],"26586817":[],"2662452":[],"2666905":28,"26680052":[],"266801":[],"26710969":5,"26715191":[],"26775644":[],"26780278":5,"268":9,"26814548":6,"26817703":[],"26995402":29,"27":[0,1,6,20,31,34],"27065633":30,"27124938":34,"271260217275557":25,"27126022":25,"27231287":28,"27352535e":[],"27470622":33,"27482829e":29,"2750":9,"2751616":[],"27597777e":[],"27600259":[],"27602210e":[],"27623637":[],"276263":[11,29],"27693602e":34,"27700":9,"27760":9,"2781456":[],"27861634e":[],"27924636":5,"27933134":22,"27it":[],"27n_":25,"28":[1,3,4,6,9,31,33,34],"28000355":[],"280004":[],"28021598":28,"280573":5,"280647":[11,29],"28109198":[],"2813829":[],"28164443e":34,"28183460e":[],"28205578e":29,"28253033":22,"282727":[11,29],"28306304e":34,"2830637392":4,"28316949":[],"28336218e":[6,30],"28390":9,"28391978":29,"28399125":[],"28415767":[],"28443039":31,"28457291":[],"28475098":8,"28496213":28,"28542801":[],"2861":25,"2871":9,"2873":9,"2876045":[],"28793787":34,"2882":25,"2885519":[],"2886":25,"2890":[0,28],"2892":25,"28923":[],"28956161":[],"2895786617507":11,"28it":[],"29":[2,6,9,31,33,34],"29015871":[],"29033075e":[],"29100624e":[],"291056":[],"2915":25,"29167186":5,"29223521":[],"29238145":[],"29253213e":[],"29306584e":29,"2931":28,"29350":33,"29390668":[],"29398019":[],"29491144e":29,"29541992e":[],"29620357":[],"29653038":33,"2968":28,"297648":5,"29764815":5,"2976637":[],"2980":28,"298037":[],"29803738":[],"29822833":[6,30],"29860173":33,"2986082":[],"29861395":[],"29881308":[],"2990":28,"29902518":33,"299748":29,"2_":[12,34],"2_1":[12,34],"2_2":[12,34],"2_3":[12,34],"2_i":[12,34],"2_m":[6,25,31],"2_t":[13,33,34],"2_x":25,"2b":25,"2c8f433990d1":[33,34],"2cm":8,"2d":[1,3,11,12,21,28,34],"2e":[6,31],"2f":[0,7,9,10,11,12,28,29,32,34],"2g":2,"2g_i":2,"2k":3,"2m":[6,31],"2n":[0,2,3,28,29],"2nd":[9,34],"2p":25,"2pm":26,"2pt":4,"2x":[0,3,8,13,28,33,34],"2x_ix_jy_iy_j":8,"2x_j":8,"2y_i":10,"2y_j":8,"3":[1,2,3,4,5,6,7,8,9,10,11,12,13,14,17,18,21,22,23,24,25,26,30,31,32,33,34],"30":[0,1,2,4,6,7,9,10,13,16,26,29,31,32,33],"300":34,"30000":[0,28],"30005983":[],"30010":9,"300231":5,"30023144":5,"30119421":8,"30124108":[],"30134885":34,"30190897":11,"301909":11,"302":31,"30258509":[22,28],"30269539":22,"30283188":30,"303":6,"30306759":33,"30334592e":[],"30387411e":[],"30400113":[],"30442964":29,"30466214e":[6,30],"30506075e":[],"30607268":33,"3072":3,"3076923076923077":9,"30787294":6,"30915293":[],"309153":[],"30916988":[],"309170":[],"30917499e":34,"30940":9,"3096154":[],"30982436":[],"3099":31,"30it":[],"31":[2,12,22,25,34],"310579":29,"3105791":29,"310957":[],"31095745":[],"31160886":[],"31162122":[],"312":30,"31227657e":[],"3123314713548606":[6,31],"31248425":33,"31276579e":[6,30],"313":30,"313155":11,"31315504":11,"31318084":5,"31453949":[],"31457796":5,"314869":[],"31486917":[],"315":[6,30],"3155":[0,5,6,30,31,32],"31555734196707536":[],"31571995":[],"316":30,"31601423":34,"31664443e":33,"31718909":11,"31727523":[],"317367":11,"31849289":28,"31876431e":[],"31896852":8,"31936237":[],"3194467":[],"31it":[],"32":[2,3,4,6,8,12,13,22,25,33,34],"3200":1,"32003025":[],"320656":[],"32065614":[],"32068736":28,"3207":31,"32084559e":29,"32149601703519115":[6,31],"3214960170351912":[6,31],"3215":9,"323059":5,"32305911":5,"323184775146844":[],"32318478":[],"32393078":[],"324":2,"32419549":[],"3241988":[],"32422234e":34,"3245":2,"32450054":29,"3250":1,"325228546249804":[],"32522855":[],"3260513":[],"3262":6,"326238":29,"32641434":28,"32651488":[],"32684035":[],"32733949":[],"3280928":[],"328093":[],"32906581":[],"32932635":[],"32it":6,"33":[9,12,22,26,34],"33000573":28,"33006628":33,"33025801":[],"33049619":25,"33062878":[],"330629":[],"33066907e":[5,29],"33096549":22,"33107417":[],"33145794":[],"33166055e":5,"331939":29,"33212971":[],"33217312":25,"33220123":[],"33235647":[],"333":[7,32],"33532886":28,"33596404":[],"33615742":[],"33675308":[],"33734605":22,"33742926":28,"33826500e":[],"3388112":[],"33978889":33,"33it":[],"34":[9,22],"340071371496255":29,"34026086":[],"3403":9,"340782":[11,29],"34114547":5,"34225662":22,"342680":29,"34271514":[],"34332677":[],"34346829":[],"3436":[0,28],"34367970":6,"3437":[0,28],"34412923":29,"344176915013831":[],"34427423":[],"34483937":[],"34483955":28,"34568909":[],"34569596":5,"34598722":22,"34599598":[],"346000154268618":22,"34620097":[],"34654596":[],"346546":[],"34661376":[],"346614":[],"3480527":25,"34871778":34,"34904819":[],"35":[0,6,17,23,26,28],"35018806":[],"35098705":[],"35140":9,"3514835":[],"351636":[11,29],"35182854":5,"35196964":[],"35243372":[],"35275513":[],"35320952":[],"35354073":[],"35432563":[],"3544313922":6,"35470445e":[5,29],"35506347e":29,"35520169":[],"35533773":6,"35537114e":[],"35613536e":29,"356399":29,"356673":[],"35667342":[],"35714377":[],"35731585":28,"35736":33,"357508":29,"3581341341":4,"35870701":25,"359":[5,30],"35957915":[],"35966688":[],"35980374":28,"35986305":[],"35it":6,"36":[0,5,6,23,25],"360":1,"36091273":[],"3613":9,"361541":5,"36154104":5,"361556":29,"36185989":[],"3621311":5,"36235052e":[],"36303682e":29,"3632959111950474e":[6,30],"363295916366933e":[6,30],"36339156":[],"36353321":28,"36482524":[],"36545697e":[],"3655222":5,"366375489616074":[],"367":[2,9],"36754671":34,"36880327":22,"36895644":31,"369139":[11,29],"36it":6,"37":[9,23,32,33],"37013105":22,"37055062":[],"370782966":4,"37093787":[],"37135473":[],"37153115":28,"37175575":33,"37239927e":29,"3727791":28,"37396662":[6,30],"37415625e":29,"37449168":22,"37454707":22,"374675":[],"37467515":[],"37532078":[],"37582891":[],"375829":[],"37600869":28,"37685349":[],"37700967e":29,"377372":29,"37737221":29,"3777801602":6,"378271":[],"37827145":[],"37837864":[],"37900111":[6,30],"37919989":28,"38":[0,9,23,25],"380":9,"38102552":[],"38135733e":[6,30],"3817475779":[6,31],"38198866":28,"38203725":[],"38259084":33,"38298234e":29,"38337498":[],"38381781":[],"38399622":[],"38440469":[],"38460453":22,"38461538461538464":9,"38461539":33,"38592549":25,"386":9,"38612299e":29,"386161":[],"38616125":[],"38618024":[],"38629436":[22,28],"387":31,"387620":11,"38762019":11,"3882273":[],"38827994":6,"38865681e":[],"38916861e":[6,30],"3892":31,"38934047":28,"38962192e":[6,30],"39":[0,9,26,28,34],"390334838933238":25,"39033484":25,"39039235":22,"3908470004999506":[],"39090680e":[],"3910042":28,"39197698":29,"391977":29,"39214397":29,"392144":29,"39223923":[],"39279291":28,"39398622":[],"394":9,"39517073":[],"39525059":[],"39540235":[],"39579407":5,"395980256477532":[],"39598026":[],"39614949":[],"39621036e":[],"39692815":[],"39706038":5,"397700":[11,29],"39789527":[22,28],"3983":6,"39855569":[],"39865452":[],"39922082":[],"39929428":[],"39931051e":29,"39952356":[],"399836":29,"3d":[2,3,4,6,13,23,31,33],"3f":[1,3,9],"3n":22,"3x":[2,8],"3x_i":2,"3y":8,"3yk470mj5p931p9dtkk0y6jw0000gn":[1,6,28,31],"4":[1,2,3,4,5,6,7,8,9,10,11,12,13,14,17,22,23,25,28,30,31,32,33,34],"40":[1,6,9,23,26,28,31],"400":4,"4000":[9,28],"40037367e":[],"40072098":[],"40093324":[],"40140374":[],"401842":[11,29],"40184681":22,"40266454":[],"40354798e":29,"40415979e":[],"40418675":[],"404783":[],"40478305":[],"405":9,"4050":[27,28],"405890":[11,29],"405964":[],"40596423":[],"40620066":29,"406201":29,"40632663":[],"4069157":[],"407":9,"408":9,"40833375":[],"4087":9,"4087793":5,"40927184e":[6,30],"40it":6,"41":[2,9,22],"4107":9,"41146753":28,"4121966338442804":[],"41310208":[],"41366128e":[],"41408221":[],"41433969":5,"41487642":28,"41511965e":1,"4155":[2,15],"4162706317":6,"41636775":[],"41664613":25,"4166666666666667":9,"41675053":[],"41744203":[],"41764479":[],"417644792969273":[],"41820116":22,"41842093e":29,"418506":[11,29],"41869784":28,"41882037e":[6,30],"41925189":[],"41987877":[],"4198932":28,"42":[1,4,8,9,10,22],"42083463e":[],"42095725":28,"42124182":[],"4215795":22,"42197297e":[],"42305151":[],"4230769230769231":9,"42310878":25,"423646":[],"42364634":[],"42392359":[],"424274":[],"4242743":[],"42441033":5,"42450":9,"42553096":[],"42575338":22,"426":[6,9],"42774546":[],"42873361":28,"429":31,"42945319":[],"43":[0,1,7,9,22,32],"43054282":5,"4310":28,"433":31,"43330971e":[6,30],"43373107":[],"435163":29,"43563433":22,"43579948e":[6,30],"43639284e":29,"436462435":4,"43703545":[],"43727575":[],"43766686":11,"43779698e":[],"438060758":6,"438136":29,"439230":6,"43962226":[],"43976975777097144":[],"43984553e":[],"43it":6,"44":[0,1,22],"44089210e":[5,29],"441":[3,4,14],"442":[3,4,14],"442600":[11,29],"44286735":[],"443":[3,4,14],"443217":29,"44395301":30,"444":[3,4,9,14],"44418124":33,"44454123":28,"445":[3,4,14],"44536331":28,"44563226":[],"446033":31,"44624525e":29,"44658658e":29,"4477214":5,"44830934":[],"44838546":[],"44970586e":1,"44995924":22,"45":[9,26,28],"450":9,"450257":[11,29],"4504":9,"45053025":28,"45193407":[],"45430236":[],"455173":31,"45560415":[],"4557763":11,"455947":29,"456":9,"45620975":[],"457":2,"457311":[],"45731144":[],"45731379":22,"4576811":28,"45781905e":33,"458027":29,"458078":[11,29],"4580854":[],"4591127":22,"45915671e":29,"45960079":5,"45it":6,"46":[2,9,26,28],"460":[9,11],"4601":9,"46065811":22,"46086448":22,"46107913":[],"46134248e":[],"46153846153846156":9,"46170878e":33,"4619526":22,"462":[7,32],"46342934":[],"4635149":[],"46383925e":[6,30],"46383926e":[6,30],"46387965":[],"46415522":[],"46415888336127775":30,"46544987":[],"46593404":[],"46660941e":[],"46713267":30,"46736215":31,"4676059":29,"467606":29,"46891823":[],"46911594e":[],"46954702e":[],"46963249":[],"46984559":[],"46984697e":[6,30],"47":[2,9,26,28],"47042744":5,"47051432":31,"47052809":[],"470714":29,"47075725":6,"47116868e":[6,30],"47125748":5,"47132891":5,"4725246793626128":[],"4729218":[],"47297587e":[],"47313680":31,"47334547e":[],"47433659":[],"4745474":[],"47478922e":[],"47610036":6,"4761747":[],"47729832":[],"47757553":[],"47815203":11,"47823856":33,"47892661":[],"47910545":[],"479465113":4,"47989224":[],"47991892":[],"47it":6,"48":[2,9,31],"48004784":28,"48062913":[],"48151166":22,"48170743":[],"481979":6,"48200792":[],"48257387":[26,28],"48268005e":[],"48306473":[],"48307405":[],"4831139":[],"48326853":[],"48399942":[],"48420061":[],"4843772":28,"48476997":11,"484905":5,"48490503":5,"48494803":30,"48521055":29,"48697869":[],"486979":[],"4870934":34,"48826894e":29,"48827791":[],"48843174e":[],"48867802":[],"48900413":34,"48931464":[],"489315":[],"48994188":5,"48it":[],"49":[5,6,9,11,23,29,33,34],"49074536":[],"49123502e":[],"49152":3,"49156266e":[],"49211524":[],"49224801":[],"4937346":22,"49381549":[],"49392067e":29,"4940954":[0,28],"49470005":[],"49513019":25,"4951301940723654":25,"49584063e":29,"4959161509357395e":[6,30],"4959161509366685e":[6,30],"49611541":[],"4990":25,"49910481e":[],"4992":25,"49939493":[],"499394932852416":[],"4997":25,"49it":6,"4c4c7f":[9,10],"4d":3,"4f":6,"4pm":[26,28],"4y":8,"4y_i":10,"5":[1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,22,23,25,28,29,30,31,32,33,34],"50":[1,2,3,4,6,7,8,9,10,13,28,29,31,32,33,34],"500":[1,3,4,6,9,10,13,31,32,33,34],"50000000e":34,"50000455":5,"50000553":5,"50000718":5,"50000855":5,"50000969":5,"50001063":5,"50001142":5,"50001207":5,"50001261":5,"50001306":5,"50001343":5,"50001374":5,"500014":5,"50001414":5,"50001422":5,"50001439":5,"50001454":5,"50001466":5,"50001476":5,"50001485":5,"50001492":5,"50001498":5,"50001502":5,"50001506":5,"5000151":5,"50001512":5,"50001515":5,"50001517":5,"50001518":5,"50001519":5,"50001521":5,"50001522":5,"50001523":5,"50001524":5,"50001525":5,"5018":25,"5020612":25,"50227564e":[6,30],"502698":[],"50269821":[],"50306335":[],"50321091":5,"50327198":22,"50427787":31,"50530832":31,"506":0,"50610071e":33,"506553":29,"50655336":29,"50667812":[],"50714096e":[],"5076963":22,"507d50":[9,10],"50846111e":[6,30],"50846112e":[6,30],"50850373":[],"50887105":[],"50911289":[],"50it":[],"50j":[13,33],"50x10":1,"51":10,"510":1,"5105332296929628":9,"51069279":22,"51104913":[],"51136852":[],"51154388":[],"5116375":[],"511888":5,"51317506":[],"51364117":22,"51374050":31,"514219":29,"5142856":[],"51437058e":29,"51447004":28,"51512235":34,"51546825":28,"51564682":22,"51643579":[],"51659846":33,"51709529":[],"5177783846":4,"51858116":[],"51914183e":[],"51928402":22,"51937727":22,"52":[32,33,34],"52031552e":29,"52087499":[],"521422502348998":11,"521558":[],"52155823":[],"52173381":[],"5222222222222223":1,"52284329e":29,"52301447e":29,"52317963":[],"52362157e":29,"52397611":[],"52446101":25,"52573336":11,"52635761":22,"52654886":[],"52657934":22,"526744":[11,29],"52698542":[],"52706754":11,"527068":11,"52732966":[],"52780600":31,"52874252":5,"52876551":[],"52888979":[],"52989287e":[],"52it":[],"53":[9,32,33],"5303329":11,"53052247":[],"5305555555555556":1,"53105728":[],"53125507":22,"531280":29,"53149078":[],"532":[],"5321613":[],"53285379":[],"532854":[],"533":[],"53312817":28,"534":[],"535":[],"53512750e":[],"53534008":25,"53585173":[],"535852":[],"53629564":22,"53640693":[],"537":[],"53703498":6,"53723188":[],"53729411e":29,"53738247":31,"5378811":11,"538":[],"5384615384615384":9,"539":[],"539261":[11,29],"53942728":[],"53996947":[],"5399913":[],"53it":6,"54":[6,9,25],"540":9,"54011398":[],"54039921":5,"54041041e":5,"54057582":[],"541605":29,"54175461":33,"5426270409877345":[],"543939":29,"54393936":29,"5443909":[],"544439":29,"54490887":[],"54637219":31,"54725976":[],"54811237":25,"548263635652985":[],"54843215":[],"548432150659993":[],"54856099":[],"54873252":[],"54880148":[],"54921401":[],"54935794":28,"54it":6,"55":[1,9],"55020649":[],"55042779":34,"551023":5,"55102329":5,"55179339":[],"55196383":[],"55386681":28,"55460327e":[],"55542568":[],"5555555555555556":1,"55582742":28,"5567":6,"55688514":25,"557795":[11,29],"55838":33,"55854694":11,"559791959661649":25,"55996153":[],"55it":[],"56":[1,9],"56033697":5,"56042437":[],"56072658":[],"561410":[],"56141009":[],"56198284":5,"56342158":[],"564":9,"56423957":[],"56423957069263":[],"564374":[11,29],"56453869":34,"564759":[],"56475921":[],"56476512e":[],"565":9,"56536":[0,28],"56541622e":[],"56589683":31,"566":9,"56636616e":[6,30],"567":9,"56763673":34,"56783103":22,"56790195e":29,"568":[9,31],"56804783":34,"56832496e":[],"56857739e":[],"569":[1,9],"56912044e":[6,30],"56922102":28,"56939714":5,"56965674":31,"56967917":[],"56977352":[],"56it":[],"57":[0,8,9,26,28],"570":9,"571":[5,30],"571105947979344e":[6,30],"571105947979412e":[6,30],"57192197":[],"57201944e":[6,30],"57252451e":29,"57261202":[],"574465":[11,29],"57468142":28,"57492326":[],"57521514":[],"57584612":[],"575870409023631":[],"576":31,"5769230769230769":9,"57803254":28,"57819238e":[],"57847325":[],"57881465":[],"57886743":[],"57914918":[],"57933547":25,"58":[9,10,26,28],"58084123":[],"5833333333333334":9,"583595":29,"5847256":[],"58492636e":29,"58493493":[],"58493681":[],"58583003":[],"58589719":28,"58735893":34,"58827236":6,"5888888888888889":1,"58890784":[],"58914105":[],"589841":[],"59":9,"59009792":11,"59078383":[],"590784":[],"591317992":4,"59184268":[],"59215613":[],"59244881":[],"59348521":[],"59354079":6,"59355752e":29,"59372982":22,"594241":[],"59424119":[],"5944444444444444":1,"59465457e":[],"59491404e":[],"59630232e":[],"59683811":[],"59698459":25,"59730078":[],"59779819":33,"59875207":[],"59884169":28,"59908884":[],"59963873":[],"59971727":[],"5cm":25,"5f":[8,33],"5x":8,"5y":8,"6":[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,17,22,25,26,28,29,30,31,32,33,34],"60":[1,3,6,9],"60000":4,"60026673":[],"60041459e":[],"600529":[],"60052901":[],"60160003e":29,"6019067271":4,"6029291":[],"60293962":5,"60342978":31,"60375434":22,"6038642":[],"60418171":[],"60420593":5,"60451189e":[],"60543038":29,"60552651":[],"60588173":28,"60605083e":[],"606251":[],"60625144":[],"60664448":[],"60673226":11,"606760":5,"60762863":[],"60921896":[],"60929685":31,"60940356":[],"60943791":[22,28],"60999067":[],"61":1,"61069681":22,"61083596e":[],"61106937e":[],"6111111111111112":1,"61113781":[],"61192203":[],"61192712":22,"612939":29,"61321722e":[],"61325173":[],"613579":29,"61382924":[],"613893902124586":25,"61395701":[],"61414743":22,"61468323":25,"614808":[11,29],"6153846153846154":9,"61564092":[],"6156409232714415":[],"61602014e":[],"61621902":[],"61774362":[],"61775176":31,"618746":[],"61883807":[],"618982":29,"61979664e":[],"62":1,"6200":28,"6201":28,"6202":28,"6203":28,"6204":28,"62113349e":29,"621584":[],"62158409":[],"62275788":33,"62286539":34,"62351789":[],"62373464":11,"625":[7,32],"62551462":25,"62573269":28,"62617788":22,"62620041e":[],"626635268":[6,31],"626678":[],"6266783":[],"6267112":[],"62725226":30,"628":6,"62863106e":29,"62886648":[],"62894215":5,"62905281e":[],"62908496":22,"63":[0,1,6,9,31],"63025821e":[6,30],"63030526":[],"63031478":[],"630315":[],"63037846":6,"63046054":[],"63071772":[],"63142399":28,"63162342":29,"63209435":28,"63249532e":[6,30],"63309898":[],"6333349473431832":25,"63490568":25,"63498144":5,"63546236":34,"63555267e":[],"63619709":29,"6380763200092493":[],"63833441e":34,"6383903":28,"63896182":[],"638962":[],"6389681":[],"63898112e":29,"63919355":5,"639194":5,"64":[1,2,3,4,13,22,28,33,34],"64009263":34,"64012627":5,"6401576":[],"6407249":[],"640x480":[6,13],"64316192":31,"64322974":[],"64361375":28,"64362404":[],"64373221":[],"64373635e":33,"64399916":[],"64411666":[],"64412879":[],"64425744":[],"64564368e":[],"646283":[11,29],"64713979":[],"64742912e":[6,30],"647473":[11,29],"64796751":28,"64857542":[],"64885265":22,"649":[],"64909048":[],"649382":[11,29],"64976691":[],"64x50":1,"65":[1,2,8,9],"650":[],"65082441":[],"651":2,"65183066":[],"651831":[],"652":2,"65293772":[],"653":2,"6533977":[],"653398":[],"6536392":29,"654":2,"65442354":29,"654424":29,"65475653":[],"655":2,"65543115":[],"65554958":[],"65571174e":29,"65591748":[],"65593984":[],"65599456":29,"656":[],"65641173":[],"6568154596723088":[],"6568686180915178":[],"65686862":[],"65720152e":29,"65738717e":29,"65743689":29,"65759901":34,"658":2,"65833132":29,"65885453":5,"65889641e":[],"65891389":29,"658914":29,"659":2,"65900052e":[],"65917558":22,"65944342":33,"65it":[],"66":2,"660":2,"66018725e":29,"66063786":[],"66064822":29,"66080313":29,"66204648":6,"662836197064178":[],"66289235":[],"66294408":29,"6629598":[],"662960":[],"66365453e":[],"6638":9,"664314":5,"66431407":5,"66456459":[],"66487438":[],"66498292":[],"6652177":29,"66560":9,"6663569":[],"667":9,"6671767":[],"66729685":[],"66757105e":[],"66809369":[],"668172":29,"6690108":[],"66951679":34,"67":[1,2,9],"6702":[],"67047975e":[6,30],"67088558":[],"67100236":[],"67231298":[],"67238764e":[],"672721":29,"672759":[],"67275915":[],"67313212":[],"67314874e":5,"67374815":22,"674":31,"67435043":25,"67464946":[],"67490857":33,"67495943":[],"67524588":22,"67561021":28,"67819487e":[],"67875366":[],"678754":[],"67it":[],"68":2,"6801":[],"68072161":22,"6809195":[],"680920":[],"68092237e":[],"6816947":[],"68192193":5,"68257097":[],"68286725":29,"6831505":[],"68352799":[],"68534263e":[6,30],"68542204":5,"68591105":[],"68637642":[],"68655456":22,"6869":9,"68735473":28,"68822559":[],"688226":[],"68826552":28,"68857788":[],"6887363571":4,"68879472":[],"68929213e":[6,30],"689519":[11,29],"69":[2,9,25],"690":9,"690617":29,"69069n_":25,"69089532":22,"691":[],"691364":[],"69136414":[],"69182892e":29,"69227923":[],"69230769":33,"6923076923076923":9,"69247718":22,"6927554":22,"69303453":[],"693035":[],"69391797":[],"69417174":[],"69435454":[],"69438869":[],"69465386":22,"69484813e":5,"69504801":6,"69515531":[],"69566966":28,"69634577e":[6,30],"69695259":5,"697346":[],"69734609":[],"69756791":[],"69768266":11,"6980":[33,34],"6988905":28,"69903406":[],"69983227":[],"6999536":11,"69it":[],"6n_":25,"6pm":28,"7":[0,1,2,3,4,5,6,7,8,9,11,12,13,14,15,22,24,25,27,28,29,30,31,32,33,34],"70":[1,6,7,9,32],"7002164":25,"70037324e":29,"70039784":[],"701370":5,"70241548":[],"7026722043092946":[],"7029975":[],"70301068":[],"70362677":[],"70469324":28,"70474145":[],"70499955":28,"70514808":[],"70587399":[],"705946":[],"70594608":[],"70630967":[],"70653767":4,"70665448":[],"70704566":[],"7070883":28,"70710678":[5,29],"70711022":[],"7074705":[],"70832814":5,"70857635":[],"7086067479626619":29,"70928399":11,"709284":11,"71":1,"71142161":29,"711422":29,"7119":9,"712018":[11,29],"71261809":[],"7127128":28,"71332117":[],"713763":[],"71376303":[],"71384267e":33,"71441086":[],"71469351":[],"7150195":28,"71507714e":[],"71524686":[],"71582784":[],"71737253":29,"71761101":29,"718165":5,"71838601":22,"71860732":[],"7198234":[],"720889407643293":[],"72174172":11,"72236654":[],"72271878e":[6,30],"7228852":[],"72309979e":[],"7236674":5,"724":3,"72427854":[],"7249499":[],"725256":[],"7252563":[],"726017":[],"72601722":[],"72602818":[],"72710494":28,"72744372":[],"72770687":5,"727707":5,"72771857":[],"72848736":[],"72859758":5,"72952595":[],"72962885":22,"72964493e":[],"72981762":8,"72992196":[],"73":[6,9,31],"73018893":[],"73062648":[],"73063053":[],"73068535":[],"73071831":25,"731000":29,"73122034":[],"73176319":22,"73203674":[],"73252708":33,"73265885":33,"73305640e":[],"733096":29,"73337355":[],"73578772":[],"73595198":[],"73646130e":[],"73690387":33,"737184":[],"73718419":[],"73741131e":[],"73785069":[],"737851":[],"73958682":[],"73986200e":29,"73994248":[],"74":[6,31,33,34],"740":9,"74028787e":[],"7403629637766833":11,"74038232":[],"74075864":25,"74081822":8,"74171049":[],"74259663":[],"742597":[],"74272285e":[],"74291603e":29,"74384949":29,"74607851":29,"74613334":[],"74724414e":29,"74724774":33,"74829661":29,"74840212":5,"7487814387207385":[],"74878144":[],"74883972":[],"74900488":5,"74957448":[],"749765":29,"75":[5,6,8,9,11,23,29,31,34],"75018686":[],"750187":[],"75025744":[],"750445":29,"75050135":29,"75080943":[],"7509571":[],"7510197":[],"7511273":[],"75131415":[],"75138064":22,"751699":[11,29],"75170092":5,"75216828e":33,"75269037":29,"75300068":[],"7539148284817965":28,"75406226e":[],"75433448":[],"7546682196464342":[],"75532041":[],"75576555":29,"75600095":[],"756352":29,"75654448":[],"75677341":[],"756828":[],"75682834":[],"75760403":[],"7577":31,"75770568":29,"7577113351177733":[],"75956617":22,"76":[9,26,28,32,33],"76120718":[],"761574":[],"76157429":[],"76190591":30,"76262775":[],"76277254":[],"7642448":[],"764245":[],"765":[7,32],"76527062":[],"76533281":5,"765333":5,"7658599":[],"76612827":[],"766163196245293":[],"76686148":[],"76690383":31,"76692036e":29,"767367275553824":[],"76790092":[],"76807288":[],"76855921":22,"76887316e":29,"7692307692307693":9,"76936315":5,"76940759":25,"76942272":34,"7694444444444445":1,"76996262e":34,"77":[9,26,28,33,34],"77030637":22,"771128":[],"77152076":5,"77152924":[],"7718":9,"77199379e":[],"772588722239781":[33,34],"77352152e":[],"77354301":[],"774498":[],"77449804":[],"77465911":[],"77482712":[],"77507653":[],"77559615":[],"77636e":[33,34],"77652198e":29,"77659961":25,"7766443":[],"77714169":8,"77725472":[],"777255":[],"77803692":[],"7782028952":4,"77845284":[],"77873845e":[],"77959897":[],"78":[],"78009660e":29,"78156479e":5,"78184120e":[6,30],"78186404":22,"78254537":34,"78278086":[],"78326199e":[],"78671736":[],"78745927":[],"78758569":[],"78876155e":[],"78892891":[],"78941903":5,"79":[],"79111643":5,"79135536e":29,"79171202":22,"79247398":[],"79280475":[],"793167":29,"794282":[11,29],"79469098":[],"7953443":30,"79622905":[],"79623487":5,"796235":5,"79633065":31,"79718864":28,"79778008":6,"79787194":11,"797872":11,"797e":6,"79866484":[],"79870689e":29,"7989356":28,"79898903":22,"7d7d58":[9,10],"8":[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,18,22,23,25,28,29,30,31,32,33,34],"80":[0,1,5,6,8,9,29,30,31],"800":[4,7,32],"80056922":[],"801356":[],"8030191":[],"80354994":6,"80410179":[],"80413696":[],"80460179":31,"80469739":5,"8055555555555556":1,"80609615e":[6,30],"80609616e":[6,30],"80637385":[],"80740939":28,"80847477e":[6,30],"8084934":22,"80855691":[],"808557":[],"80907609":33,"80979265":[],"81":1,"81007381":28,"81042619e":29,"81048318e":[6,30],"81160425":5,"81218742e":29,"81246697":25,"81283649":[],"81318307":[],"8133":6,"81333808":6,"81425129e":29,"81479491":[],"81506255":[],"81559586":[],"815am":[26,28],"81622636":[],"81633628":11,"816454":29,"816847":29,"81839897":[],"81919129":[],"819253":[],"81925302":[],"81947005":22,"81979166":25,"82":[],"82060913e":29,"8207274870895702":5,"82079885":[],"82121282":[],"82161167":28,"82198978":5,"82242798":[],"8227":[],"8232102961414203":[],"823417":[],"82341746":[],"82376174e":29,"82418008":[],"82418352":[],"8244":[],"82533209":11,"82551764":22,"82559478":[],"82623709e":[],"8265786":5,"82688363":[],"82802004":[],"82832579":[],"82914126":[],"829252":[],"82925222":[],"83":2,"83020679":[],"8305555555555556":[],"83146596":31,"83363025":34,"83369175":[],"83463634e":29,"83466807":[],"83512277":5,"83641435":33,"83655756":28,"83718206":[],"83823317e":29,"83870189":6,"8387133":[],"83884553e":[],"839957":[],"83995705":[],"84":2,"84159992":[],"842":[0,7,32],"8423144":22,"842436":29,"84254917":[],"843":[0,7,32],"84355903e":1,"844":[0,7,32],"84401886":5,"84443254e":1,"84478178":33,"84605507":34,"8461538461538461":9,"84661230e":[],"84707251e":29,"84711297":[],"84726382":[],"84767088":[],"8476874":[],"84780262":6,"84789579e":[],"8485":31,"84858":31,"84862355":28,"8488":31,"84923989e":[6,30],"84972787":[],"84994524":5,"85":[1,9],"85005989":[],"85014487":[],"850164":5,"8505072899794293":[],"85064942":11,"85079059":[],"85108001":[],"85112594":22,"8517571":[],"85222243":[],"85259666e":[],"85263220":6,"85276538":22,"85278920e":5,"85293303e":29,"85378708":[],"85408468e":33,"85422602":[],"85551266e":29,"85601992":5,"85625134":28,"85711016":28,"85777073":[],"857771":[],"858":9,"8583333333333333":[],"85871255":[],"85945208e":29,"86":2,"86009093":[],"86016288":[],"86062977":6,"86066395":[],"86067818":34,"86117291":5,"86123808e":[],"86134827":5,"86143379":[],"86145244":11,"86174943":[],"86192682e":29,"86197958":[],"86240935":[],"86247117":[],"86267497":[],"862675":[],"86273371":30,"8638888888888889":1,"86416941":[],"86445334":[],"86459987":28,"865":[0,7,32],"86519139":22,"866":[0,7,32],"86602331":34,"86629161":25,"86630":9,"86643649":[],"8666666666666667":1,"867":[0,7,32],"86810":9,"86867512":11,"86891741":[],"8691787":28,"86978877":[],"87":9,"8702784034":4,"870337":34,"87068171":30,"87070464":[],"870704644539707":[],"87072815e":29,"87093752":[],"87148597":[],"87169607e":29,"87186187":25,"8720648":25,"8722222222222222":[],"87340054":[],"87381451":5,"87399194":[],"87494456e":29,"875":1,"87584434":[],"8759":[33,34],"87627342":31,"87696461":[],"877":6,"87732748":34,"87740526":28,"87788573":[],"87818331":[],"87878356":25,"87884833":[],"87981676":[],"88":[28,33,34],"88046261":5,"8805555555555555":[],"88135577e":[],"88157423":28,"88168312e":[6,30],"88182591":29,"88236598e":[],"8825782":[],"88289263":28,"88323026":29,"88336879":5,"8834":[],"88377332":[],"884669":29,"88501323":[],"88529063e":[6,30],"88551766e":29,"88613493":29,"88639567":28,"88653291":28,"88738394e":[],"88809826":28,"88860399":25,"8888888888888888":[],"88960947":[],"8896094720230128":[],"89":9,"890033":11,"89003324":11,"89017198e":29,"89058005":28,"8905826":[],"89126914e":29,"8917148":[],"891715":22,"89184351":[],"89288636":11,"8931686":33,"89408972":[],"89410423":5,"8944444444444445":[],"89457785":[],"89463761e":[],"89533642":28,"89540936":[],"8962":[],"89710385e":[],"89724282":[],"89766337e":[],"8978":[],"89845198":25,"8f":[6,31],"8g":[6,31],"8n":22,"8x8":1,"9":[0,1,2,3,4,5,6,7,8,9,11,12,13,14,18,22,23,24,25,26,28,29,30,32,33,34],"90":[0,1,6,9],"90075537":5,"9011":6,"90114639":28,"90135464e":29,"90220243":5,"90266948":5,"9027777777777778":[],"90300219":34,"90304177e":29,"9040":9,"90475506e":[6,30],"9054":31,"9055555555555556":[],"906589":[],"9065894":[],"906747":5,"90717653":11,"907177":11,"90842732":22,"90860768":22,"90894281":28,"91":[26,28],"910":9,"91099021":[],"91100141e":33,"9111111111111111":[],"91114704":[],"91128596":5,"91270333":[],"91312563":[],"91365263":[],"91410559e":[],"91416944e":[],"91434750e":[],"91492986e":[6,30],"91546928":[],"91648657":[],"9166666666666666":9,"91669165":[],"916692":[],"91672129":28,"91722512e":[],"91760278":5,"91812702":5,"91854134":[],"918785":28,"918992":29,"91933003":22,"919503":11,"9195033":11,"91961463":[],"92":[6,9,26,28],"92192012":[],"9225384545636204":5,"9230769230769231":9,"92308867":[],"92341148":22,"92370959":34,"92376655":34,"924e":6,"925":1,"92507116e":1,"92512799":[],"92527681e":[],"92578916":5,"92599642":[],"92604454":[],"92622842":0,"92661467e":33,"9271707090281667":[],"92756256":30,"9277777777777778":1,"9288904":22,"92921498":25,"9305555555555556":1,"93074023":34,"931":[0,28],"93155188":5,"93158979":5,"93237862":[],"932382":[],"93289669":[],"93293067":25,"933":[5,30],"93366198":[],"933662":[],"93397254e":[],"93492130e":[6,30],"93597168":[],"935972":[],"93601008e":29,"93619369":22,"93668828":[],"936877889972962":[],"937":25,"937057":11,"937082":29,"93787605":[],"93799826":5,"938":25,"9387":9,"93891335e":[],"939":[0,25,28],"93900569e":29,"93909866":[],"93937564":[],"93968601":[],"93970238":25,"93989887":[],"94":[9,25],"94092702":34,"94099173":[],"94141801":[],"94221383":22,"94226022e":[6,30],"94255277":25,"94273542":29,"94284104":5,"94285762":28,"94291287":[],"94320205":5,"9434":5,"94388948":33,"94419718":[],"9444444444444444":1,"94484047e":34,"94499279":33,"9450635":28,"94591015":[22,28],"946167":[],"94616709":[],"94623184":5,"94625725":[],"946276":[],"94627617":[],"946372":[],"94637206":[],"94639099":11,"946957":5,"94704941e":[],"9472222222222222":1,"947607":[],"94766419e":29,"94781064":30,"9482527":5,"9485531":[],"9495484":[],"95":[1,9,11,31],"95008046":6,"95033155e":[],"950423":[],"95053694e":[],"95115528":34,"95166920e":29,"95226607":[],"95231424":5,"952387":29,"9527777777777777":[],"95284275":5,"953065564":1,"95338273":29,"95343966":22,"95351665":5,"95354276":25,"95395895":[],"953959":[],"954":25,"95400323":28,"95511792":29,"955118":29,"95518112":[],"9555555555555556":1,"95563211":[],"955820c21e8b":4,"95611042":33,"95647867":[],"956563":[11,29],"95684892":5,"95703":[33,34],"95715036":[],"95743466e":[],"95793988e":[],"958228616652075":5,"95872127":[],"95890587":28,"95906059":33,"959076":[],"96":[1,6,9,11,31],"960":25,"9601304850035702e":[6,30],"9601304850073734e":[6,30],"96015381":22,"96024953":5,"96075051":33,"96080358":25,"96084663":5,"961":25,"962":25,"96231225":[],"96251859":[],"96305058":[],"963187":[],"9637117593816477":[6,30],"96379806e":[],"96391888":[],"9640435":5,"96432396":[],"96461948":22,"9647801":28,"9649652536":4,"965548":29,"96585824":[],"96631321":29,"96688672":5,"967":6,"9674916":5,"967809":[11,29],"96826039":[],"96853248":22,"968650":[],"96865004":[],"96866031":[],"968704":11,"96870431":11,"96894842":[],"969190":[],"96919021":[],"96919836":[],"9692":[],"96991192":[],"97005689":5,"97065359":31,"970827":[],"97082748":[],"97108e":[33,34],"97120565":[],"9712983":[],"97206657":5,"972067":5,"972149":[],"9722222222222222":[],"97228653":[],"9722865317690382":[],"97243128":5,"97243946":[],"972533":[],"97253307":[],"97272223":[],"97300836":5,"97435908":[],"97480604":[],"97482498":11,"974825":11,"97486336":28,"97497404e":[6,30],"97498674":28,"975":[],"97507735":5,"97512176":28,"975484":[],"97548406":[],"97570392":28,"97626519":[],"97630233":31,"9767506308987675":[],"977":6,"97705827":5,"97716508":[],"97758848":5,"9777777777777777":[],"978":31,"9780387310732":27,"9780387848570":27,"9781098134174":28,"9781492032632":27,"9781801819312":28,"97836358":[],"978553":5,"97898392":[6,29,30],"97906022e":29,"9792":[],"97926491":5,"97935648":[],"97979891":6,"98":[0,1,9],"980":9,"9805555555555555":[],"98091621":5,"981321":29,"98139097":5,"98140006e":[],"98190064":[],"98271562":25,"98275501":5,"98281205":33,"983310":29,"98338288":[],"983383":[],"983450":[],"9834505":[],"9838929":[],"98413059":5,"98413606":[],"9841870203276504":[],"98454786":5,"98473694":[],"985":25,"98566191":5,"986":25,"9861111111111112":[],"98619989":[],"98636199":[],"986362":[],"98654811":[],"986699":5,"98680716":5,"98716878":5,"98740373":22,"98770503":28,"98808176":5,"98822371":6,"9888888888888889":[],"989":25,"9890348":5,"9893447":5,"98947674e":29,"98947894":29,"9898ff":[9,10],"99":[1,6,9,11,13,31,33,34],"990":9,"99003341":[],"99009525":5,"9904314810719695":[],"99088801":5,"991":25,"991047":[],"99104747":[],"99114739e":[],"99115119":5,"99176998":5,"99194201":[],"992":25,"99201684e":[],"99242921":5,"99265097":5,"99294056":34,"993":25,"9930742":22,"99316252":5,"99368326":34,"99370678":22,"99371056":5,"99389612":5,"99427512":22,"9943201":5,"99434472":[],"994345":[],"994474":[],"99447418":[],"99456598":33,"99475306":33,"9947756":5,"9948998579029953":[],"99492986":5,"99498272":[],"9951059931014423":[],"99512017":22,"9952183728736417":[],"9952505213910134":29,"9952537939995855":[],"99528218":5,"99539415":5,"9955318336036834":29,"99566069":5,"99578809":5,"9958589197366403":[],"9958983289118531":[],"9959308805732706":29,"996":[5,30,31],"99608161":5,"9963961":5,"99647992e":[],"99650061":5,"996626":[],"99662602":[],"9967458":5,"9969461173312454":[],"9969513794144311":[],"99700706":5,"99709215":5,"997252717901263":[],"99729756":5,"99751458":5,"99753321e":29,"99758326":5,"99762142":30,"997746":11,"99774602":11,"99775587":5,"99793613":5,"99799099":5,"99802696":33,"99812668e":[],"99813653":5,"99828624":5,"9983295":5,"99835783":33,"99845267":5,"99848215":34,"99848815":33,"99854557":29,"998577":5,"99861053":5,"99862019":29,"99869482":29,"99871521":5,"99876945":29,"99881845":5,"99883628":29,"99884384":5,"99884409":29,"99884986":30,"99887767":34,"99891093":29,"99891873":29,"99893323":5,"99898558":29,"999":[9,25,33,34],"99901896":5,"99903755":5,"99906023":29,"9990927157696581":30,"99911427":5,"99912709":29,"99913489":29,"99916114":33,"99918546":5,"99919837":5,"99920175":29,"99926459":5,"99927642":29,"9993237":5,"99933188":5,"9993511":29,"99938942":5,"99941797":29,"9994385":5,"99944272":5,"99949266":29,"99949306":5,"99953381":5,"99953475":5,"99954925":33,"99956033":[],"99956735":29,"99957911":5,"99961294":5,"99965056":5,"99967865":5,"99968451":34,"99970894":29,"99970988":5,"9997332":5,"99975913":5,"99977375":34,"99977849":5,"99978365":29,"99980002":5,"9998161":5,"99984732":5,"99987324":5,"99989103":33,"99989476":5,"99991263":5,"99992746":5,"99993978":5,"99995":5,"999955585168597":[6,30],"99996755":34,"9x":[6,23],"9y":[6,23],"\u00f8yvind":[6,29,30],"abstract":[1,20,33],"boolean":4,"break":[0,4,6,11,14,28],"byte":[22,28],"case":[0,1,2,3,4,5,6,7,11,12,13,14,16,21,22,23,28,31,34],"catch":0,"class":[0,1,3,4,6,7,8,9,11,12,13,25,28,31,33,34],"default":[0,1,2,4,6,7,8,16,22,23,28,29,30,32],"do":[0,2,3,4,5,6,8,9,10,11,12,13,14,15,16,22,23,28,29,32],"ekstr\u00f8m":4,"export":9,"f\u00f8470":[26,28],"final":[0,1,2,3,4,5,6,7,8,9,10,11,13,14,16,18,19,20,23,24,25,26,28,31,32],"float":[0,3,4,5,9,11,13,14,22,28,29,33,34],"function":[2,3,4,5,9,14,15,16,17,18,19,21,22],"import":[0,1,2,3,4,6,7,8,9,10,11,12,13,14,15,16,17,23,25,31,32,33],"int":[0,1,2,3,4,5,6,11,13,14,22,25,29,31,33,34],"long":[0,1,3,4,12,13,28,32,33,34],"m\u00f8svatn":[6,23],"new":[0,1,2,3,5,6,7,8,9,10,11,13,14,17,22,28,29,32,33,34],"public":[0,21,28],"return":[0,1,2,3,4,5,6,7,8,9,11,13,14,22,23,25,28,29,30,31,32,33,34],"sch\u00f8yen":[6,29,30],"short":[4,5,20,23,30,31],"super":[5,29,30],"switch":0,"throw":[3,6,25,31],"true":[0,1,2,3,4,5,6,7,8,9,10,12,13,14,15,16,19,22,23,25,28,29,30,31,32,33,34],"try":[0,1,2,4,5,6,7,8,9,10,11,13,14,15,16,21,22,23,25,28,29,30,31,32,33,34],"var":[1,5,6,10,11,18,19,23,25,28,29,30,31],"while":[0,1,3,4,5,6,7,8,9,11,12,13,25,28,29,30,31,32,33,34],A:[2,3,5,6,7,10,11,12,13,16,18,20,21,22,23,24,25,26,27,29,33],AND:2,And:[0,3,4,5,6,9,13,20,21,23,25],As:[0,1,2,3,4,5,6,8,10,12,13,16,22,23,25,28,29,30,31,32,33,34],At:[0,4,6,13,23,28,33],BE:[0,28],Be:[2,21,28],Being:[13,33],But:[0,1,2,3,5,6,9,10,25,29,30,31],By:[0,3,5,6,12,13,17,22,28,29,30,31,32,33,34],For:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,21,22,23,24,25,27,28,30,31,32,33,34],IF:[6,30],IN:27,If:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,15,16,21,22,23,25,28,29,30,31,32,33,34],In:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,19,21,22,23,25,27,28,29,30,31,32,33,34],Is:11,Ising:[5,12,29,34],It:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,21,22,23,25,28,29,30,31,32,33,34],Its:[1,2,4,11],NO:[9,11],No:[0,6,7,9,28,30,32,34],Not:[0,1,5,6,29,30,31,34],OR:25,Of:25,On:[0,3,9,15,23,24,25,26,27,28],One:[0,1,3,4,5,6,7,8,11,12,13,17,23,25,29,31,32,33,34],Or:[0,1,6,23,28,32],Such:[0,6,12,16,25,31,32,33,34],That:[0,5,7,10,11,12,14,19,23,25,28,30,31,32],The:[4,10,13,14,15,16,18,19,20,22,23,24,25,26,27],Then:[0,1,6,8,9,10,11,12,13,14,22,23,28,31,32,33,34],There:[0,3,4,5,6,8,9,11,12,14,22,23,24,25,26,28,29,30,32,33,34],These:[0,3,4,5,8,9,10,11,12,13,14,15,16,22,23,25,26,28,29,30,33,34],To:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,22,25,30,31,32,33,34],With:[0,5,6,8,9,10,11,12,14,18,22,23,25,28,29,31,34],_0:[5,8,10,11,13,29,32,33],_1:[2,5,6,8,10,11,12,13,14,22,29,30,32,33,34],_2:[2,5,8,11,12,13,22,29,33,34],_3:22,_4:22,_9:[13,33,34],_:[0,1,2,4,5,6,7,8,9,10,11,12,13,17,18,19,22,23,28,29,30,31,32,33,34],__array_function__:2,__class__:10,__doc__:[6,31],__enter__:[0,7,32],__future__:[8,9],__getattr__:30,__getattribute__:28,__getitem__:[0,7,32],__init__:[0,1,3,4,7,14,30,32,34],__main__:[2,34],__name__:[2,10,30,34],__rtruediv__:[],_accessor:28,_auto10:[6,12,34],_auto11:[6,34],_auto12:[6,34],_auto1:[2,3,4,5,6,7,12,13,22,25,29,32,33,34],_auto2:[2,3,4,5,6,12,13,22,25,33,34],_auto3:[3,4,5,6,12,13,22,33,34],_auto4:[4,6,12,13,22,33,34],_auto5:[4,6,12,13,22,33,34],_auto6:[4,6,12,22,34],_auto7:[4,6,12,22,34],_auto8:[6,12,34],_auto9:[6,12,34],_base:8,_build:[0,17,19,21,23,27,28],_c:1,_can_hold_identifiers_and_holds_nam:28,_check_optimize_result:[9,11],_class:8,_compon:11,_coordinate_desc:6,_depth:9,_fraction:9,_generatorcontextmanag:[0,7,32],_i:[0,1,2,5,6,7,8,11,12,13,15,16,17,19,23,28,29,30,31,32,33,34],_info_axi:28,_j:[0,1,2,3,5,6,8,13,17,19,23,29,30,31,33],_k:[13,32,33,34],_l:[12,34],_lambda:[6,28],_leaf:9,_ll:[3,4,14],_logist:[9,11],_m:10,_make_vjp:[],_multilayer_perceptron:[],_n:[2,5,8,11,13,29,32,33],_node:9,_np:[],_o:[3,4,14],_open_file_or_url:[0,7,32],_p:[5,8,29],_plugin_dir:[3,4,14],_ratio:11,_rc_params_in_fil:[0,7,32],_s:[3,4,14],_sampl:9,_split:[6,9,23],_src:34,_t:[13,33,34],_test:[6,23],_tf_getinputpropertieslist:[3,4,14],_trace:[],_valu:[],_varianc:11,_weight:9,_wrapreduct:2,a0:3,a0faa0:[9,10],a1:[0,28],a2:[0,28],a3:[0,28],a4:[0,28],a_0:[0,28],a_1a:[0,28],a_2a:[0,28],a_3:[0,28],a_3a:[0,28],a_4:[0,28],a_4a:[0,28],a_:[0,1,16,22,28,29],a_h:1,a_i:[0,1,2,12,28],a_j:[1,12],a_k:[0,1,12],aaron:27,ab:[0,2,5,13,14,23,28,29,30,33,34],ab_channel:[21,34],abandon:1,abbrevi:24,abid:25,abil:[0,10],abl:[0,1,4,5,6,7,10,12,13,16,23,29,32,33,34],about:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,21,22,23,26,30,31,32,33,34],abov:[0,1,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,22,23,25,27,28,29,31,32,33,34],abovement:[6,28,31],abscissa:[13,32,33],absolut:[0,2,5,6,13,28,29,30,31,33,34],absorb:[29,30],acceler:[13,33,34],accept:[0,3,6,9,23,28,29],access:[0,3,11,25,28],accid:[4,6,31,32],accompani:[0,28,29],accomplish:[8,9,13,33,34],accord:[0,1,2,5,6,9,12,13,14,15,16,25,28,30,31,32,33,34],accordingli:11,account:[0,3,5,13,15,25,28,30,31,33,34],accumul:[12,13,25,33,34],accur:[0,3,4,6,10,13,31,33,34],accuraci:[0,1,3,4,5,6,7,9,10,11,12,28,29,32,34],accuracy_scor:[0,1,10,28],accuracy_score_numpi:1,achiev:[0,1,5,6,8,12,22,28,30,31,34],aco:25,acquaint:21,acquir:[1,21,28],acr:0,across:[1,3,6,9,21,28,31],act:[1,3,22],action:25,activ:[0,2,3,4,9,24,26,28,32,33],actual:[0,1,4,5,6,8,11,16,22,25,28,29,30,31],ad:[1,3,4,5,8,13,15,16,22,30,31,32,33],ada_clf:10,adaboostclassifi:10,adadelta:[13,33,34],adam:[1,3,4,26,28],adapt:[4,6,13,27,31,32],add:[0,1,2,3,4,5,6,8,10,11,12,15,16,17,23,25,28,29,30,31,33],add_outgrad:2,add_subplot:[1,7,12,14,23,32,33,34],addendum:5,addit:[0,2,3,5,6,7,8,9,10,12,13,15,17,21,22,23,25,26,27,28,29,30,31,32,33,34],addition:[12,13,32,33,34],address:[1,9,11,13,28,33,34],adjac:[3,12,34],adjoint:[5,29,30],adjust:[0,5,12,13,32,33,34],admir:[0,28],advanc:[4,6,12,27,28,31],advantag:[1,3,5,6,10,13,22,30,31,32,33,34],adversari:28,afecionado:28,affect:3,affin:[0,3,8,11,29],afford:3,aficionado:28,aforement:14,african:0,after:[0,1,2,4,5,6,9,11,12,13,15,21,22,23,25,28,29,30,31,33,34],afterward:[0,28],ag:[0,7,24,28,29,32],ag_0:2,again:[0,1,4,5,6,7,8,10,11,12,13,15,16,23,25,28,29,30,31,33,34],against:[1,4,7,10,32],agegroup:[7,32],agegroupmean:[7,32],aggreg:[9,10],agorithm:10,agre:[5,6,25,30,31],agreement:[13,33,34],ahead:9,ai:[0,27],aid:[11,20],aim:[0,1,4,6,7,11,14,15,16,21,22,23,29,31,32],ainv:5,airplan:3,aka:[5,30,31],al:[0,2,4,15,16,17,23,27,28,29,30,31,32,33],alarm:[5,7,30,31],aldo:29,algebra:[0,3,5,13,21,29,30,31,33,34],algorithm:[0,1,2,4,5,6,7,8,13,14,21,22,23,25,27,28,30,31,32],align:[0,2,5,6,7,8,13,23,25,28,29,30,31,32,33],all:[0,1,2,3,4,5,6,7,9,10,11,12,13,14,15,21,22,23,24,25,26,27,28,29,30,31,32,33,34],allevi:[1,13,32,33],alloc:[3,22],allow:[0,1,2,3,5,6,8,10,13,15,16,21,22,23,28,29,30,31,32,33,34],almost:[0,1,6,8,11,13,25,31,32,33,34],alon:[2,9],along:[2,3,4,5,6,9,10,11,21,22,28,29,30,31,32],alpha:[0,1,2,3,4,6,7,8,9,10,13,14,25,28,29,31,32,33],alpha_0:3,alpha_1:3,alpha_2:3,alpha_:10,alpha_i:[3,13,33],alpha_k:[13,33],alpha_m:10,alpha_n:3,alpha_opt:[13,33],alreadi:[2,3,4,5,6,10,12,21,22,25,28,29,30,31,34],also:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,21,22,23,24,25,28,29,30,31,32,33,34],alter:1,altern:[0,1,4,5,6,8,9,11,13,22,23,28,29,30,31,32,33],although:[0,1,5,6,8,10,13,16,28,30,31,33,34],alwai:[0,3,5,6,12,13,16,23,25,28,29,30,31,32,33,34],am:4,ame2016:[0,28],american:0,among:[0,3,5,9,10,12,22,28,29,30,34],amongst:[5,30,31],amount:[0,1,3,4,6,8,10,14,21,31],amp:34,an:[1,2,3,5,6,7,8,9,11,12,13,14,15,16,17,19,20,21,22,23,25,26,27,29,30,31,32,33,34],an_:25,anaconda:[0,1,15,21,23,28],analog:[13,33,34],analys:[6,30,31],analysi:[1,3,4,7,14,15,16,17,19,22,27,32],analyt:[2,3,5,6,7,12,13,15,21,23,28,29,30,31,32,33,34],analytical_gradi:34,analyz:[0,1,3,4,5,6,16,17,23,25,29,30],andrew:1,angl:[0,3,9,29],anharmon:3,ani:[0,1,2,3,4,5,6,7,8,9,10,12,14,18,25,28,29,30,31,34],anim:[4,12,34],ann:[12,34],annot:[0,1,3,7,8,28,32],announc:28,anoth:[0,1,3,4,5,6,7,8,10,11,12,13,22,23,25,28,29,32,33,34],anp:2,ans_vspac:[],ansatz:[0,28],answer:[0,1,3,5,6,22,23,26,28,30,31],antialias:[2,6,23],anticip:4,anymor:[1,8],anyon:[4,8],anyth:[1,25],anytim:[26,28],apach:1,apart:[11,13,32,33],api:[1,21,28],appar:2,appear:[0,1,3,13,16,22,25,33,34],append:[1,3,4,8,9,13,28,33,34],appendix:23,appli:[0,1,2,3,4,6,7,8,9,10,11,12,13,15,16,23,25,27,28,29,30,31,32,33,34],applic:[0,1,3,4,5,6,7,9,12,13,22,23,25,27,28,29,31,32,33,34],apply_gradi:4,approach:[1,2,4,5,6,9,10,11,12,13,17,21,25,27,29,32],appropri:[2,6,9,12,13,21,25,31,33,34],approv:28,approx:[0,2,3,6,10,11,13,25,28,31,32,33,34],approxim:[0,1,2,3,4,5,6,7,10,11,13,18,19,23,25,28,29,30,31,32,33,34],apt:[0,15,21,23,28],aq:25,ar:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,19,21,22,23,24,25,26,27,28,29,30,31,32,33,34],aragorn:28,arang:[1,3,4,6,7,9,10,12,13,23,28,32,33,34],arbitrari:[1,4,6,8,12,13,25,31,32,33,34],arbitrarili:[0,1,11,28],arc:[6,23],architectur:[3,4,12],area:[0,3,6,9,23,27,28],arg:2,argmax:[1,11],argmin:[4,10,14],argnum:2,argnum_0:2,argnum_1:2,argsort:11,argu:[1,13,33,34],argument:[0,2,3,5,6,11,12,13,28,29,30,31],argval:[],aris:[0,6,12,13,25,28,31,32,33],arithmet:[0,13,22,28,33,34],arm:[6,30],armadillo:22,around:[0,1,4,5,6,11,25,28,30,31],arr:[],arr_list:[],arrai:[0,1,2,3,4,5,6,7,8,9,11,12,13,14,21,23,25,29,30,31,32,33,34],arrang:[3,28],arraybox:[13,33],arriv:[0,6,9,11,22,25,28,31],arrow:[12,34],arrowprop:8,art3d:33,art:[0,1,15,21,28],articl:[0,3,4,6,10,18,23,28,29,30,31],artifici:[0,2,7,12,27,28,32],artificialneuron:[12,34],arug:[13,33,34],arxiv:[3,4,23,33,34],asarrai:[0,2,6,9,29,30,33,34],asid:29,ask:[5,6,11,12,23,30,31],aspect:[0,6,21,23,28,29,30],assembl:[0,3,28],assert:4,assess:[0,6,23,28,29,30,31],assici:4,assign:[0,7,8,9,12,13,14,24,26,27,28,32,33,34],associ:[0,6,9,12,14,25,28,31,34],assum:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,19,22,23,25,28,29,30,31,32,33,34],assumpt:[0,3,5,6,9,11,18,23,25,28,29],ast:[0,5,6,18,23,28,30,31,32],astronomi:[28,30,32,33,34],astyp:[4,9,10],asymmetri:[0,28],asymptot:[4,6,31],atleast_2d:[],atom:[0,28],attempt:[0,4,6,7,8,10,28,30,32],attend:24,attent:[0,22,28],attr:30,attract:[0,10,28],attribut:[0,9,28,30],attributeerror:[28,30],audi:[0,28],audio:[3,4],august:[15,16,28],aurelien:[0,15,24,27,28],austfjel:[6,23],author:[0,1,10,25],authour:28,auto:[8,9,10,25],auto_exampl:[23,30],autocor:25,autocorrelation_tim:25,autocorrelform:25,autocovari:25,autoencod:[4,21,28],autoencond:21,autograd:[21,28],autom:[0,21,27,28],automac:22,automag:28,automat:[0,1,2,3,4,11,16,21,22,28],automobil:3,autonom:4,avail:[0,1,4,6,7,10,11,15,20,21,22,23,24,26,27,28,31,32,34],averag:[0,1,3,6,9,10,13,14,25,26,28,29,30,31,32,33,34],avoid:[0,4,5,6,9,11,13,22,28,29,31,32,33,34],awai:[2,3,6,29,30],awar:[2,10],award:[26,28],ax:[0,1,2,3,4,6,7,8,9,10,11,12,13,14,22,23,28,31,32,33,34],axes3d:[2,6,13,23,32,33],axes_grid1:6,axhlin:8,axi:[0,1,2,3,4,6,7,8,9,10,11,12,13,14,22,23,25,28,29,30,31,32,33,34],axiom:[5,30,31],axis_arg:[],axlabel:[0,28],axvlin:[4,8],axvspan:4,b1:8,b2:8,b3:8,b:[0,1,3,4,5,6,8,9,10,12,13,14,15,16,25,26,28,29,30,31,32,34],b_0:0,b_1:[0,2,12,13,33,34],b_2:[0,13,33],b_5:[13,33,34],b_:[0,1,22],b_group:9,b_i:[0,1,2,12,28,34],b_ia_:[0,28],b_ia_i:0,b_index:9,b_j:[1,12,34],b_k:[0,1,12,13,33,34],b_m:[12,34],b_score:9,b_valu:9,babcock:28,bachelor:[24,26],back:[0,3,4,5,6,8,9,10,15,22,25,28,29,30,32,33,34],backbon:22,backend:[0,1,4,7,32,34],background:[27,28,29],backpropag:1,backtrack:9,backup:22,backward:[1,2,4,12,22],backward_pass:2,bad:[6,29,30],badli:25,bag:[9,21,28],bag_clf:10,baggin:28,baggingboot:10,baggingclassifi:10,baggingtre:10,balanc:[6,31,32],band:22,bandwidth:22,bar:[0,6,11,15,16,23,28],barber:27,bare:[4,10],base:[0,1,3,4,5,7,8,9,10,14,21,25,26,27,28,29,30,32],basi:[5,7,8,10,11,12,13,22,29,30,32,33,34],basic:[6,8,12,13,14,21,23,25,28,33,34],batch:[3,4,11,12,13,32],batch_shap:4,batch_siz:[1,3,4],batchnorm:4,bay:[7,32],bayesian:[5,21,27,28,30,31],beam:[28,32,33,34],becattini:26,becaus:[0,1,2,3,4,5,6,8,9,12,13,14,28,30,31,32,33,34],becom:[0,1,2,5,6,7,9,12,13,25,28,29,30,31,32,33,34],been:[0,1,2,3,4,5,6,11,12,13,21,22,23,28,29,30,31,33,34],befor:[0,1,2,3,4,5,6,7,8,12,13,14,20,22,23,25,28,29,30,31,32,33,34],beforehand:[0,25,28],begin:[0,1,2,3,4,5,6,7,8,9,11,12,13,14,22,23,25,26,28,29,30,31,32,33,34],behav:[1,6,13,31,32,33],behavior:[0,1,13,28,32,33,34],behaviour:[12,34],behind:[0,1,6,8,13,28,32,33],being:[0,1,2,3,4,5,7,8,10,11,12,13,17,25,28,29,30,31,32,33,34],believ:[9,22],belong:[7,8,9,13,14,32,33],below:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,22,23,25,28,29,30,31,32,33,34],benchmark:10,benefici:[1,13,33,34],benefit:[0,1,4,11,13,15,21,28,32,33,34],bengio:[1,24,27,28,29,33,34],benign:[1,7,9,32],besid:[4,5,30],bessel:[5,29,30,31],best:[0,1,2,3,4,5,6,7,8,9,10,12,13,23,26,28,29,31,32,33],best_estimator_:32,beta1:[33,34],beta2:[33,34],beta:[0,1,3,5,6,7,10,11,13,16,17,18,19,23,28,29,32,33,34],beta_0:[0,1,3,5,6,7,13,28,29,30,32,33],beta_0x_:[0,28,29],beta_1:[0,1,3,5,6,7,10,13,28,29,30,32,33,34],beta_1x_0:[0,28],beta_1x_1:[0,7,28,32],beta_1x_2:[0,28],beta_1x_:[0,28,29],beta_1x_i:[7,13,29,32,33],beta_2:[0,3,13,28,29,33,34],beta_2x_0:[0,28],beta_2x_1:[0,28],beta_2x_2:[0,7,28,32],beta_2x_:[0,28,29],beta_2x_i:29,beta_3:3,beta_3x_i:29,beta_4x_i:29,beta_:[0,3,6,7,13,28,29,30,32,33,34],beta_i:[0,3,5,28,29,30],beta_j:[0,5,6,13,18,23,28,29,30,31,33,34],beta_k:[13,32,33],beta_lasso:34,beta_linreg:[13,32,33,34],beta_logreg:34,beta_m:10,beta_mg_m:10,beta_n:3,beta_ol:34,beta_p:[7,32],beta_px_p:[7,32],beta_ridg:34,betavalu:5,better:[0,1,2,3,4,6,9,10,11,12,13,28,29,30,31,33],between:[0,1,2,3,4,5,6,7,8,9,11,12,13,14,17,23,25,28,29,30,31,32,33,34],beyond:[0,1,5,6,8,13,23,28,29,32,33,34],bf:[13,14,22,25,32,33],bg:28,bgd:[13,33,34],bia:[0,1,2,3,5,8,9,10,12,13,19,28,29,30,32,33,34],bias:[1,2,3,5,6,9,12,30,34],bibliographi:23,big:[0,1,2,5,6,14,18,30,31],bigger:[1,6,29,30],bigr:[12,34],bike:9,bilbo:28,billion:[3,12,21,34],bin:[0,7,25,32],binari:[0,3,5,7,9,10,12,28,30,31,32],binarycrossentropi:4,bind:[0,29],binomi:[21,25,28],binsboot:[6,31],bioinformat:0,biolog:[1,12,34],bios1100:[21,28],bird:[0,3],birth:28,bishop:[24,27,28],bit:[1,4,22,25,28],bitwis:25,bivari:2,bk:[0,13,33,34],bla:[22,28],black:[8,9,14,34],blob:[16,20,23,32,33,34],block:[6,10,21,22,25,28,31],blog:28,blogpost:4,blue:[0,3],bmatrix:[0,1,3,5,7,8,11,13,22,28,29,30,32,33],bmi:1,bn:[],bodi:[0,1,4,12,28,34],bold:1,boldfac:[0,5,16,29,30],boldsymbol:[0,1,2,3,5,6,7,8,10,11,13,14,15,16,17,18,19,23,28,32,33,34],boltzmann:[12,21,28,34],book1:27,book:[19,23,27,28,29,31],boost:[1,9,21,28],boostrap:10,bootstrap:[1,13,19,21,23,28,32,33,34],borrow:28,boston_dataset:0,bot:8,both:[0,1,4,5,6,8,9,10,13,14,15,16,21,22,23,25,26,28,29,30,31,32,33,34],bottl:[7,32],bound:[0,8,12,33,34],boundari:[2,4,8,11,12],box:[4,9],boxed_arg:[],boyd:[8,13,32,33],bracket:[4,25],brain:[1,7,12,32,34],branch:9,breast:[5,7,11,30,31,32],breviti:[13,33,34],brew:[0,15,21,23,28],brg:8,brief:[23,29],briefli:[0,28],bring:[0,5,6,10,29,30],broad:0,broadcast_idx:2,brought:[13,21,28,33,34],brownle:4,browser:28,brute:[3,5,11,29,30,32],bs:[8,9,10],buffer_s:4,bui:4,build:[0,4,5,6,10,22,25,28,30,31,32,33,34],built:[0,1,3,4,6,31],bunch:11,busi:0,bxe2t:34,c1:[8,11],c2:[8,11],c:[0,1,2,4,5,6,7,8,9,10,11,12,13,14,15,16,19,21,22,25,26,27,29,30,31,32,33,34],c_0:25,c_1:[12,34],c_2:[12,34],c_3:[12,34],c_4:[12,34],c_:[0,8,9,10,13,25,32,33,34],c_i:[12,13,33,34],c_k:25,ca:[1,28],cach:10,cal:[0,8,10,12,13,15,16,28,32,33],calcul:[0,1,2,4,5,6,8,9,10,11,12,13,14,15,16,18,22,25,28,30,31,32,33,34],call:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,16,18,19,21,22,23,25,26,28,29,30,31,32,33,34],calor:[0,29],cambridg:[13,27,32,33],can:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,25,26,27,29,30,32],cancel:[0,13,28,29,33,34],cancer:[5,10,30,31],cancerpd:[7,32],candid:[8,9,10,33],cannot:[0,1,4,5,6,7,8,9,24,25,29,30,32],canopi:[0,15,21,23,28],canva:[23,28],cap:[5,30,31],capabl:[0,1,8,13,21,28,33,34],capac:[2,26],capita:0,caption:23,captur:[4,11,12,34],car:[3,4],card:[0,7,28,32],cardin:1,care:[11,32],carefulli:[13,33],carlo:[0,6,21,25,27,28,31],carri:[2,6,7,23,31,32],cart:10,casella:27,cast:1,cat:[3,4],categor:[0,1,3,9,11,28],categori:[0,1,3,7,10,12,14,28,32,34],categorical_crossentropi:[1,3],caus:[0,5,6,7,25,28,29,30,31,32],causal:0,causat:[0,28],cax:1,cb:[6,28],cbar:1,cc:[0,1,5,13,28,29,30,32,33],ccc:[5,12,30,34],cd_fast:6,cdf:25,cdot:[0,2,6,12,13,14,22,25,28,31,32,33,34],celebr:[13,32,33],cell:[0,1,2,3,4,6,7,8,9,10,13,14,23,30,32],center:[0,1,6,7,8,9,11,14,23,25,28,30,31,32],central:[0,3,5,6,8,16,22,28,29,30],centroid:[14,25],centroid_differ:14,centuri:3,certain:[0,3,6,7,9,25,28,29,31,32],certainti:31,cg:[13,33],cha:0,chain:[0,1,13,21,25,28,33,34],challeng:[33,34],chanc:[1,5,13,25,30,31,33,34],chang:[0,1,2,3,4,5,6,8,9,11,12,13,14,22,23,25,28,29,30,31,32,33,34],channel:3,chapter3:[0,19,23],chapter:[0,6,10,11,16,18,22,23,27,28,29,30,31,32,33,34],charact:[0,3,5,8,28,29],character:[8,9,10,12,25,34],characterist:[0,1,3,10,13,28,33,34],charg:[0,28],charl:0,chase:4,chatgpt:23,chd:[7,32],chddata:[7,32],cheap:[5,29],cheaper:[1,13,33,34],check:[0,1,3,4,5,6,11,13,22,28,33,34],checkmark:3,checkpoint:4,checkpoint_dir:4,checkpoint_prefix:4,chen:10,cheng:29,chiaramont:2,choic:[0,1,2,3,4,6,9,12,13,14,19,22,28,29,31,32,33,34],choleski:[5,22,29],choos:[2,3,6,9,10,11,13,14,23,31,32,33,34],chosen:[0,1,2,6,8,9,10,13,16,25,28,31,32,33,34],chosen_datapoint:1,christian:27,christoph:[24,27,28],cifar10:3,cifar:3,circ:[1,12],circl:[0,8,12,29,34],circuit:3,circumfer:9,circumv:[1,5,13,29,33,34],cite:23,ckpt:4,clariti:25,class_nam:[3,9],class_val:9,class_valu:9,classic:[7,9,13,32,33,34],classif:[0,3,5,6,7,8,11,12,21,23,27,28,29,30,31,33],classifi:[0,1,4,7,9,10,11,28],classificaton:1,classifii:10,clean:1,clear:[1,5,10,12,13,33,34],clearli:[0,3,5,6,7,8,18,25,29,30,31,32],clever:[1,10],clf3:0,clf:[0,6,8,9,10,28,29],clf_lasso:6,clf_ridg:[6,28],clip:[3,25],clone:26,close:[0,1,2,4,6,8,9,11,12,13,14,23,25,27,28,31,32,33,34],closer:[3,5,13,29,33,34],closest:[8,11,13,14,33],closur:[21,28],cloud:[21,28],cluster:[0,1,4,6,11,21,28,31],cluster_label:14,cm:[1,2,3,6,8,9,13,23,32,33],cmap:[0,1,2,3,4,6,8,9,10,23,28],cmap_arg:6,cmb:24,cmd:9,cn_:25,cnn:[12,34],cnn_kera:3,cntk:[21,28],co:[0,2,3,6,9,13,28,31,33,34],code:[3,4,6,7,8,15,16,17,19,21,22,23,25,27],coef0:8,coef:[0,28],coef_:[0,5,6,8,9,13,28,29,30,32,33],coeff:5,coeffici:[0,3,5,6,7,8,9,13,15,16,22,28,29,30,31,32,33,34],coerc:[0,6,28,31],coin:[10,25],coin_toss:10,col:[0,11,28,29],colab:[21,28],cold:9,colinear:0,collabor:23,collaps:8,collect:[0,2,6,10,11,21,25,27,28,31,34],collinear:[5,29,30],color:[0,3,4,6,8,9,10,23,25,33,34],color_channel:3,color_cod:6,colorbar:[1,6,23],colsample_bytre:10,colsaobject:10,column:[0,1,2,5,6,7,8,9,11,12,17,22,28,29,30,31,32,34],columntransform:9,com:[4,6,16,20,21,23,27,28,31,32,33,34],combin:[1,2,5,6,7,10,25,30,31,32,33,34],come:[0,1,3,4,5,12,13,14,15,28,29,30,31,33,34],command:[0,1,28],comment:[0,4,5,6,15,16,23,28,29],commerci:[0,15,21,23,28],commod:[0,28],common:[0,1,3,5,6,7,9,11,13,14,23,25,28,29,31,32,33,34],commonli:[0,1,4,6,7,9,13,14,29,31,32,33,34],commun:[0,12,23,34],commut:3,commutatitav:3,compact:[0,1,3,5,6,7,9,11,12,13,14,28,29,30,31,33,34],compair:0,compar:[0,3,4,5,6,11,13,15,16,22,23,28,29,30,31,32,33,34],comparison:[2,4,13,33,34],compat:[7,32],compet:0,competit:10,compil:[0,1,3,4,13,15,21,22,28,33,34],complet:[0,2,3,4,9,12,28,34],completenn:[12,34],complex:[1,5,8,9,11,12,13,15,16,19,28,31,33,34],complic:[0,1,9,13,28,31,32],compoment:29,compon:[0,1,3,4,5,6,7,9,14,16,21,28,29,30,31,32],components_:11,compos:[9,12,13,14,21,28,33,34],compphys:[0,6,16,17,19,20,21,23,24,26,27,28,32,33,34],compress:[0,28,29],compris:[6,32],compromis:[5,29],compulsori:[21,28],comput:[0,1,2,3,4,5,6,7,8,10,11,12,13,15,16,17,21,22,23,24,25,27,28,29,30,31,32],computation:[0,3,6,9,13,25,28,32,33,34],computationalscienceuio:28,computerlab:23,concaten:[2,4,6,14],concatenate_arg:[],concav:[1,9,13,29,32,33],concentr:[0,10],concept:[0,2,21,28,29],conceptu:[12,13,32,33,34],concern:[0,1,4,7,28,32],concic:28,conclud:[0,5,13,30,31,33,34],conclus:1,cond:2,conda:[0,1,15,21,23,28],condis:29,condit:[0,2,4,5,6,8,9,11,13,25,28,29,34],conduct:21,condwav:2,confid:[0,5,6,7,8,18,23,28,29,30,32],configur:[3,34],confirm:[5,12,30,31,34],confus:[5,6,7,10,22,29,30,31],confusion_matrix:9,congruenti:25,conjug:[4,8],conjugaci:[13,33],conjunct:3,connect:[0,1,3,4,9,11,12,13,22,28,29,32,33,34],consequ:[5,6,8,10,12,13,29,30,31,32,33,34],conserv:[5,14,29],consid:[0,1,2,3,5,6,7,8,9,10,12,13,16,19,22,23,25,28,29,30,31,32,33,34],consider:[0,1,5,13,28,29,30,31,32,33],consist:[0,1,2,3,4,6,12,13,19,23,25,29,31,32,33,34],constant:[0,2,4,5,6,8,12,13,25,28,29,30,31,32,33,34],constitu:[0,28],constitut:[2,6,31,32],constrain:[1,3,5,7,11,30,32],constraint:[5,6,8,13,29,30,31,33,34],construct:[0,1,2,3,5,6,7,8,9,10,11,22,25,28,29,30,31,32],contact:[0,28],contain:[0,2,3,4,5,6,7,8,9,11,12,13,17,19,22,23,25,27,28,29,30,31,32,33,34],contemporari:28,content:[1,21,22,28],context:[6,10,13,23,31,32,33,34],contextlib:[0,7,32],contigu:22,continu:[0,1,2,3,4,5,6,7,8,9,10,12,13,17,18,22,23,25,28,29,30,31,32,33],contour:[9,10,13,33],contourf:[8,9,10],contrast:[1,4,9,10,12,34],contribut:[0,3,5,13,25,28,29,30,33,34],contributor:[0,23],control:[0,1,3,9,13,15,21,28,33,34],conv2d:[3,4],conv2dtranspos:4,conv:[3,4],convei:28,conveni:[0,5,6,12,13,22,23,28,30,31,32,33,34],convent:[12,29],converg:[1,2,4,5,6,8,9,11,13,14,29,30,32,33,34],convergencewarn:[6,8,9,11],convert:[0,1,4,5,9,11,13,22,28,29,33,34],converttomatrix:4,convex:[4,5,7,29],convinc:[13,32,33],convolut:[1,4,21,28],cook:23,cool:[4,9],coolwarm:[6,23],coordin:[5,12,14,29,30,34],coorel:0,copi:[0,1,14,29],core:[0,2,7,10,28,32],corel:28,coronari:[7,32],corr:[0,5,7,11,29,32],correalt:[11,21],correct:[0,1,2,3,4,5,7,13,22,25,28,29,30,31,33,34],correctli:[1,2,6,7,10,23],correl:[0,1,3,5,6,7,10,12,13,21,25,28,30,31,33,34],correlation_matrix:[0,5,7,11,29,32],correspond:[0,3,5,6,8,9,11,12,15,16,17,21,22,23,25,28,29,30,31,34],cortex:[12,34],cosin:[3,6,31],cost:[0,2,3,5,6,7,8,9,12,13,16,17,19,23,28,34],cost_deep_grad:2,cost_funct:2,cost_function_deep:2,cost_function_deep_grad:2,cost_function_grad:2,cost_grad:2,cost_sum:2,costol:[13,33,34],could:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,17,22,23,25,28,29,30,31,32,33,34],coulomb:[0,28],count:[0,9,24,25,26,28],countor:[13,33],coupl:[4,5,6,30,31],cours:[0,1,3,5,11,23,24,26,29,31],courvil:[24,27,28,29,33,34],cov:[5,6,11,22,25,28,29,30,31],cov_xi:[5,11,29],cov_xx:[5,11,29],cov_yi:[5,11,29],covari:[0,7,21,22,28,30,32],covariance_matrix:[5,11,14,29],cover:[0,5,17,21,26,27,29,30],covert:[0,28],covxi:25,covxx:25,covxz:25,covyi:25,covyz:25,covzz:25,cpu:1,craft:3,creat:[1,2,3,4,5,9,10,11,12,21,28,30,32,33,34],create_biases_and_weight:1,create_convolutional_neural_network_kera:3,create_neural_network_kera:1,create_x:[5,11,29],credit:[0,7,26,28,32],crim:0,crime:0,criteria:[0,4,9,10,14,25,28],criterion:[9,10,13,32,33],critic:[6,23,29,30],critiqu:23,cross:[0,1,3,7,9,10,13,21,25,28,29,30,33,34],cross_entropi:4,cross_val_scor:[6,31,32],cross_valid:[7,10,32],crossvalid:[6,31],crucial:[1,25],cs231:3,cs:[24,26],csr_matrix:[22,28],csv:[0,4,6,7,9,28,31,32],ctnk:1,cubic:0,cumbersom:[5,30,31],cumsum:[10,11,28],cumul:[7,10,25],cumulative_heads_ratio:10,cup:[5,30,31],current:[1,2,3,4,13,14,27,32,33,34],curs:[0,29],curv:[6,7,10,12,23,32,34],curvatur:[13,32,33,34],custom:[6,14,23],custom_cmap2:[9,10],custom_cmap:[9,10],cutpoint:9,cv:[6,7,10,31,32],cvxbook:[13,32],cvxopt:[5,8,29],cycl:[1,12,34],cyclotron:30,d2_g_t:2,d:[1,2,3,4,5,6,7,8,9,10,11,13,14,22,25,26,28,29,30,31,32,33,34],d_f:[13,32,33],d_g_t:2,d_net_out:2,da:3,dagger:[5,22,29],dai:[1,9,21],damp:3,daniel:26,darget:9,darkr:25,dat:[0,28],dat_id:[0,6,7,9,28,29,31,32],data1:14,data2:14,data3:14,data4:14,data:[2,4,5,8,10,12,13,14,17,18,19,22,27,31,33,34],data_id:[0,6,7,9,28,29,31,32],data_indic:1,data_panda:28,data_path:[0,6,7,9,28,29,31,32],databas:1,datafil:[0,6,7,9,23,28,29,31,32],datafram:[0,4,5,7,9,11,28,29,32],datapoint:[1,5,6,7,11,13,29,31,32,33,34],dataset:[0,4,6,7,8,9,10,11,13,14,15,16,19,23,28,31,32,33,34],datatyp:4,date:[15,16,17,18,19,20,23,28,29,30,31,32,33,34],daughter:10,david:[27,28],davison:31,dbh:1,dbo:1,dcomposit:22,ddot:2,dead:1,deadlin:[16,17,18,19,20,24],deal:[0,1,3,5,6,8,11,13,14,17,18,22,23,25,28,29,30,32,33,34],dealt:0,debt:[7,32],debug:[0,5,6,30,31,32],decad:[0,3,34],decai:[0,13,25,28],decemb:[24,26,28],decent:10,decid:[0,2,3,5,6,9,23,30,31,32],decim:[0,28],decis:[0,1,8,11,21,27,28],decision_funct:8,decision_tre:9,decisiontreeclassifi:[9,10],decisiontreeregressor:[0,9,10],decisiontreeregressordecisiontreeregressor:9,declar:[0,4,22,28],decompos:[5,6,22,29],decomposit:[0,6,12,23,28,30,34],decompost:[5,29],deconvolut:3,decorrel:[10,13,33,34],decreas:[1,2,4,5,6,10,11,13,30,31,32,33,34],deduc:[0,28],deep:[3,7,12,13,21,24,27,29,33,34],deep_neural_network:2,deep_param:2,deep_tree_clf1:9,deep_tree_clf2:9,deep_tree_clf:[9,10],deepen:[5,21,28],deeper:[0,3,4,28],deeplearningbook:[27,28,30],deer:3,def:[0,1,2,3,4,5,6,7,8,9,10,11,13,14,23,25,28,29,30,31,32,33,34],def_covari:25,default_tim:4,defect:[5,29],defici:[5,29],defin:[0,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,22,23,25,29,30,31,32,33,34],definit:[1,2,5,6,7,8,10,11,12,13,17,22,25,29,30,31,32,33],defint:25,defvjp:2,defvjp_argnum:[],degre:[3,5,6,8,9,10,11,15,16,17,19,23,25,28,30,31,32],deisenroth:29,del:1,delet:6,delimit:4,deliv:[24,28],delta:[0,2,3,6,8,12,13,14,28,33,34],delta_0:3,delta_1:3,delta_2:3,delta_3:3,delta_4:3,delta_5:3,delta_:[1,22],delta_h:[0,1,28],delta_j:[3,12],delta_k:12,delta_l:[1,3],delta_momentum:[13,33,34],delta_n:[0,3,28],delug:21,delv:0,demand:[13,32,33],demonstr:[0,3,5,6,7,11,12,21,28,29,30,31,32],demystifi:34,den:4,denomin:[1,5,30,31],denot:[1,2,6,7,13,25,32,33,34],dens:[1,3,4],densiti:[0,2,6,25,28,31],depart:[26,28,29,30,31,32,33,34],depend:[0,1,2,4,5,6,7,8,11,12,13,15,21,22,23,25,28,29,30,31,32,33,34],depict:25,deploy:[0,15,21,23,28],deprec:2,depth:[0,3,9,10,22,31],deriv:[0,1,2,6,7,8,10,11,13,16,17,19,21,23,28,34],derivati:[13,33,34],derivative_fn:[13,33],descend:[5,9,11,29,30],descent:[0,1,3,7,8,12,28,29],descent_i:34,descent_x:34,describ:[0,2,4,5,6,8,10,11,12,13,18,22,23,28,30,31,33,34],descript:[0,8,9,28],design:[0,1,3,4,5,6,7,10,11,12,13,15,16,17,18,19,23,28,30,31,32,33,34],designmatrix:[0,28],desir:[0,2,4,5,13,14,28,29,32,33],despit:[1,12,34],destroi:22,det:[5,22,29],detail:[0,6,11,13,14,22,23,29,32,33],detect:[3,8,12,34],determin:[0,2,3,4,5,6,8,9,10,11,12,13,16,22,25,28,29,30,31,32,33,34],determinist:[7,13,25,32,33,34],dev:[1,23],develop:[0,3,5,8,10,11,12,21,22,23,28,29,30,31,34],deviat:[0,1,2,4,5,6,19,23,25,28,29,30,31],devic:[3,4,14],devis:[12,34],df1:28,df:[4,8,11,13,28,33],di:0,diag:[5,8,29,30],diagnost:[1,10],diagon:[0,5,7,13,18,22,23,25,28,29,30,32,33,34],diagonaliz:[5,29],diagram:10,diagsvd:6,dice:[6,25,31],dict:[6,8,32],dictionari:0,did:[0,1,5,6,7,10,11,14,23,28,30,31,32,33],die:1,diff1:2,diff2:2,diff:2,diff_ag:2,diffeent:8,differ:[0,1,2,3,4,5,6,7,9,10,11,12,13,14,15,17,21,22,23,25,27,28,29,30,31,32],differenti:[0,3,16,21,22,28,29,32],differential_oper:2,difficult:[0,1,6,10,13,23,25,28,31,33,34],difficulti:[0,1,13,28,32,33,34],diffonedim:2,digit:[0,1,3,4,6,23,24,26,28],dilemma:[13,33,34],dilut:1,dim:[4,11,14,22],dimens:[0,1,2,3,4,5,8,9,11,14,16,17,22,28,29,30],dimension:[0,4,5,6,9,11,13,14,19,21,22,28,30,31,32,33,34],dimensionless:[0,3,28],diment:22,dimnsion:4,diod:3,direct:[0,1,2,4,7,11,12,13,14,28,29,32,33,34],directli:[1,4,5,6,25,29],directori:[0,7,32],disadvantag:[0,28],disappear:[3,6,31],disc_loss:4,disc_tap:4,discard:[6,11,31,32],disciplin:[0,3,12,34],disclaim:25,discord:28,discourag:[13,32,33],discov:[0,28],discover:[5,30],discret:[1,3,5,7,13,30,31,32,33,34],discrimin:[4,7,10,11,32],discriminator_loss:4,discriminator_loss_list:4,discriminator_model:4,discriminator_optim:4,discuss:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,25,27,28,29,30,31,33,34],diseas:[7,32],disguis:[6,29,30],disord:[1,7,32],dispai:34,displai:[0,1,3,4,5,6,7,8,9,10,11,12,14,23,25,28,29,31,32,34],displaystyl:[0,5,17,28,29,30],disregard:[0,28],dissimilar:[11,14],dist:14,distanc:[0,8,9,11,14,25],distance_list:9,distinct:[3,7,8,9,10,14,32],distinctli:8,distinguish:[0,4,7,8,25,28,32],distplot:0,distribut:[0,1,4,6,7,10,11,13,14,15,16,18,19,21,22,23,28,29,32,33],distrubut:[0,15,21,23,28],dive:[0,8,22,28],diverg:[1,13,32,33,34],divid:[0,1,3,5,6,7,8,9,11,12,25,28,29,30,31,32,34],divis:[6,8,9,13,22,25,31,32,33,34],dlopen:[3,4,14],dna:[7,32],dnn1:4,dnn2_gru2:4,dnn:[0,1,2,4,12,28,34],dnn_kera:1,dnn_model:1,dnn_numpi:1,dnn_scikit:[0,1,28],doamin:[30,31],doc:[0,6,16,17,19,20,21,23,24,26,27,28,32,33,34],document:[4,9,11,13,32],doe:[0,1,2,3,4,5,6,8,10,11,12,13,14,16,22,23,25,28,31,32,33],doesn:[3,9,12],dog:[1,3,4],domain:[5,8,13,23,30,31,32,33],domin:[0,28],don:[0,1,3,5,6,7,8,11,13,15,21,23,28,29,32,33,34],done:[0,2,3,4,5,6,9,10,11,13,17,22,23,28,29,30,31,32,33],dot:[0,2,3,5,6,7,8,9,10,11,12,13,22,23,25,28,29,30,31,32,34],doubl:[3,4,22,28],doubli:1,doubt:23,down:[0,3,6,9,11,12,13,32,33,34],download:[0,1,3,5,6,22,23,27,28],downsampl:3,dozen:1,dq:[6,31],drag:[13,33,34],dramat:11,drastic:4,draw:[4,6,10,13,31,32,33],drawback:[0,1,3,13,29,32,33,34],drawn:[1,4,6,7,11,25,28,31,32],drive:[3,4],driven:3,drop:[0,1,5,6,11,13,25,28,29,30,31,33,34],dropna:[0,6,28,31],dropout:4,dt:[2,3,13,25,33,34],dtype:[0,1,2,3,4,14,22,28,29,34],dual:8,dualiti:6,dub:[0,28],due:[1,2,5,6,8,10,12,13,26,28,29,31,32,33,34],dummi:0,dure:[0,1,3,4,8,9,11,17,20,21,23,28,31,33,34],dwell:0,dwh:1,dwo:1,dx:[2,3,8,25],dx_1:25,dx_1p:[6,31],dx_2p:[6,31],dx_mp:[6,31],dx_n:25,dxp:[6,31],dy:[1,8,25],dylib:[3,4,14],dynam:4,dz:8,e:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,18,19,25,26,28,29,30,31,32,33,34],e_:[0,2,28],each:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,17,21,22,24,25,26,28,29,30,31,33,34],eager:31,eapprox:[0,28],earli:[1,13,33,34],earlier:[0,5,7,8,9,11,12,13,20,28,29,32,33,34],earthexplor:[6,23],eas:[6,9,14,31],easi:[0,5,6,7,8,9,10,11,12,13,18,21,22,28,29,30,31,32,33,34],easier:[5,6,8,9,13,25,28,29,31,33,34],easiest:[13,32,33],easili:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,22,23,28,29,30,31,32,33],eastern:[26,28],ebind:[0,28],eblock:9,econometr:28,economi:5,ecosystem:[21,28],ect:24,edg:3,edgecolor:[6,31],edu:[13,32],educ:[0,23,28,32],eff:25,effect:[1,4,10,13,25,33,34],effic:1,effici:[0,3,10,13,21,22,25,28,32,33,34],efron:[6,31],egrad:[13,33,34],eig:[5,11,13,22,25,28,29,32,33,34],eigen:25,eigenpair:[5,11,29],eigenvalu:[0,5,8,11,13,22,28,29,30,32,33,34],eigenvector:[5,11,13,17,29,30,33],eight:[22,28],eigval:[22,25,28],eigvalu:[11,13,32,33,34],eigvec:[22,25,28],eigvector:[11,13,32,33,34],eispack:[22,28],either:[1,5,6,7,8,9,10,11,13,15,16,23,25,28,29,30,31,32,33],elabor:25,elarn:3,electr:[0,3,12,28,34],electron:28,eleg:11,element:[1,2,3,4,5,6,7,8,11,12,13,17,18,20,21,22,23,24,27,29,30,31,32],elementari:[10,13,22,33,34],elementwis:[3,13,33,34],elementwise_grad:[2,13,33,34],elessar:28,elif:[2,14,34],elim:22,elimin:[3,8],els:[1,2,3,4,7,9,12,13,14,22,32,33,34],elu:1,elus:[0,28],email:[24,26,28],embed:[0,11,29],embodi:[6,19,23,31],emit:25,emner:27,emphas:[0,10,21,28],emphasi:[0,21,27,28],empir:[1,11,25],emploi:[0,1,5,6,11,13,23,25,28,29,30,31,32,33],employ:0,empti:[6,10,31],emul:[12,34],en:[21,27],enabl:[11,34],enbodi:[6,31],encod:[0,3,5,7,9,11,14,17,28,29,30,32],encompass:[0,23,25],encount:[0,1,5,6,7,13,25,28,29,31,32,33,34],encourag:23,end:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,16,22,23,25,26,28,29,30,31,32,33,34],end_box:[],end_nod:2,end_valu:[],endpoint:[3,6],energi:[0,4,6,29,31],enet_coordinate_desc:6,enforc:[12,34],eng:27,engin:[0,1,3,4,21,28],english:23,enocurag:23,enoent:[3,4,14],enorm:3,enough:[0,6,13,28,31,32,33],ensembl:[1,9],ensur:[0,1,2,3,5,6,11,13,25,29,30,31,32,33,34],entail:28,enter:[5,6,17,29,30],enthought:[0,15,21,23,28],entir:[1,3,7,9,21,25,28,32,33,34],entiti:[9,12,22,28],entri:[0,5,8,11,12,22,28,29,30,31],entropi:[1,3,7,10,13,28,33,34],enumer:[0,1,2,3,4,6,8,28,29,30],env:[0,2,3,4,6,7,8,9,11,14,25,28,30,32,34],environ:[2,9,21,23,34],eo:[0,6,28,31],eol:[0,28],eosfit:[0,28],epoch:[0,1,3,4,12,13,28,33,34],epsilon:[0,5,6,7,13,19,23,28,29,30,31,32,33,34],epsilon_0:[0,28],epsilon_1:[0,28],epsilon_2:[0,28],epsilon_:[0,28],epsilon_i:[0,28,29],eq:[3,13,14,22,25,32,33],eqnarrai:[3,5,6,30,31],equal:[0,1,2,3,4,5,6,8,9,11,12,13,14,15,22,23,25,28,29,30,31,32,33,34],equat:[1,3,4,5,6,7,8,9,10,11,13,14,16,17,18,19,22,23,25,31,34],equilibrium:[2,12,34],equiv:[3,13,22,25,32,33],equival:[0,1,5,7,8,11,13,21,22,28,29,30,31,33,34],erf:25,eriador:28,eridg:28,err:[0,7,10,32],err_:[6,31],err_sqr:2,errat:[13,32,33],errno:[0,3,4,7,14,32],erron:2,error:[1,2,4,5,6,7,9,11,12,13,15,16,17,18,19,21,22,23,25,30,32,33,34],error_estimate_corr_tim:25,error_hidden:1,error_output:1,escap:[13,32,33,34],especi:[1,3,9,12,13,23,33,34],essenti:[0,5,6,9,10,12,14,23,25,29,34],establish:[0,6,10,11,15,23,28],estim:[0,1,5,6,7,10,11,13,21,25,28,29,32,33,34],estimated_mse_fold:[6,31,32],estimated_mse_kfold:[6,31,32],estimated_mse_sklearn:[6,31,32],et:[0,2,4,15,16,17,23,27,28,29,30,31,32,33],eta0:[8,13,32,33],eta:[0,1,3,8,12,13,28,32,33,34],eta_:[13,33,34],eta_t:[13,33,34],eta_v:[0,1,3,28],etc:[0,1,3,5,7,8,9,11,12,13,14,15,21,22,23,25,29,32,33,34],ethic:21,etsim:31,euclidean:[0,14,29],evalu:[0,2,3,4,5,6,9,13,23,25,28,29,30,31,32,33,34],evaluationform:[20,23,33,34],evaluationgrad:[20,23,33,34],evalut:[13,33,34],even:[0,1,3,4,5,6,8,9,10,11,12,13,14,21,22,25,28,29,30,31,32,33,34],evenli:4,event:[5,7,10,25,30,31,32],eventu:[0,5,6,11,12,13,23,26,29,30,31,32,33,34],everi:[0,1,2,3,4,5,6,9,10,11,12,13,14,21,25,26,28,29,30,31,32,33,34],everyth:[4,12],everywher:[4,13,32,33],evolv:0,exact:[0,5,11,12,13,22,25,28,29,33],exactli:[0,3,4,6,12,21,23,29,31,34],exam:28,examin:[6,31],exampl:[5,11,12,13,15,16,19,20,21,22,23,25,27],exce:[1,12,13,33,34],excel:[0,1,4,5,10,28,29],except:[0,3,4,6,7,8,9,22,32],excess:[0,28],excit:0,exclud:[1,6,12,23,29,30,31,32,34],exclus:[0,1,3,6,25,28,31,32],execut:[2,5,13,29,33,34],exemplifi:[13,33,34],exercic:[26,28],exercis:[5,21,23,24,26,30,31,32,33,34],exercisesweek35:17,exhaust:[6,31,32],exhibit:[0,5,6,8,28,29,31],exist:[0,1,2,3,4,5,6,7,8,9,13,14,18,22,23,28,29,30,31,32,33],exit:[5,22,29],exp:[0,1,2,5,6,7,8,10,11,12,13,15,16,23,25,28,29,30,31,32,33,34],exp_term:1,expand:[5,7,11,13,29,32,33],expandus:[0,7,32],expans:[0,3,5,8,10,12,13,28,29,32,33],expect:[0,1,5,6,7,11,12,13,15,16,19,21,23,28,29,32,33,34],expectation_value_of_h_wrt_p:25,expens:[6,10,13,32,33,34],experi:[0,1,6,8,13,21,23,28,29,31,32,33,34],experiment:[0,4,6,9,25,28,31],expert:[1,9],explain:[0,6,9,10,11,13,19,23,28,32,33],explained_variance_ratio_:11,explanatori:[0,28],explicit:[0,3,6,13,22,23,28,29,30,33,34],explicitli:[0,4,8,34],explod:1,exploit:[0,3,12,13,28,33,34],explor:[1,4,6,8,13,21,23,32,33,34],expon:1,exponenti:[0,1,5,6,10,13,23,25,28,30,31,32,33,34],export_graphviz:9,export_text:9,exporttext:9,expos:21,express:[0,2,3,5,6,7,10,12,13,16,22,23,25,28,30,31,34],exptmean:25,exptvari:25,extend:[0,2,7,11,13,17,21,28],extens:[0,12,15,21,28,34],extent:[0,1,6,27,31],extern:[3,6,9],extra:[1,3,5,26,28,29],extract:[0,3,5,6,7,8,11,13,22,28,29,32,33],extrapol:[0,28],extrem:[0,1,4,5,6,7,8,9,13,16,22,29,30,31,32,33,34],extremum:[13,32,33],extrins:11,ey:[0,5,6,13,14,22,28,30,32,33,34],f11:[0,28],f12:[0,28],f13:[0,28],f1:[13,33,34],f1_grad:[13,33,34],f1d:[13,33],f2:[13,33,34],f2_grad_x1:[13,33,34],f2_grad_x1_analyt:[13,33,34],f2_grad_x2:[13,33,34],f2_grad_x2_analyt:[13,33,34],f3:[13,33,34],f3_grad:[13,33,34],f3_grad_analyt:[13,33,34],f4:[13,33,34],f4_grad:[13,33,34],f4_grad_analyt:[13,33,34],f5:[13,33,34],f5_grad:[13,33,34],f6:[13,33,34],f6_for:[13,33,34],f6_for_grad:[13,33,34],f6_grad_analyt:[13,33,34],f6_while:[13,33,34],f6_while_grad:[13,33,34],f7:[13,33,34],f7_grad:[13,33,34],f7_grad_analyt:[13,33,34],f8:[13,33],f8_grad:[13,33],f9:[0,13,28,33],f9_altern:[13,33],f9_alternative_grad:[13,33],f9_grad:[13,33],f:[0,1,2,3,4,5,6,7,8,10,12,13,14,16,18,19,22,25,26,28,29,30,31,32,33,34],f_0:[3,10],f_1:[10,13,32,33],f_2:[12,13,32,33,34],f_3:[12,34],f_:10,f_d:25,f_grad:[13,33,34],f_grad_analyt:[13,33,34],f_i:[0,6,12,16,31,34],f_m:[3,10],f_n:3,f_raw:2,f_vec:2,f_wrap:2,face:[13,32,33,34],facecolor:[6,8,25,31],facil:[0,15,21,28,32,33,34],facilit:[12,34],fact:[0,1,3,5,9,11,12,13,28,29,30,31,32,33,34],factor:[0,1,3,5,6,9,10,11,13,22,25,28,29,30,31,33,34],factori:[13,33,34],fade:6,fafab0:[9,10],fahimeh:[26,28],fail:[0,6,8,9,11,13,26,28,31,32,33],fail_on_error:[0,7,32],failur:[7,32],fairli:[1,2,25],faisal:[16,29],fake:4,fake_loss:4,fake_output:4,fall:[8,9,24],fals:[0,1,2,3,4,5,6,7,9,10,14,22,23,28,29,30,31,32,33,34],famili:[0,7,8,25,32],familiar:[0,3,5,6,8,15,21,22,23,25,28,30,31],famou:[6,12],far:[0,3,4,5,6,8,11,12,13,14,28,29,32,33,34],fashion:[0,9,10,28],fast:[1,3,6,10,12,13,21,25,28,31,32,33],faster:[1,11,13,33,34],fastest:[13,22,32,33],favor:[7,32],favorit:25,fc:3,fd:[0,7,32],featur:[0,1,3,5,6,7,8,10,11,12,13,18,21,23,25,28,30,31,32,33,34],feature_nam:[0,1,7,9,32],feautur:9,fed:1,feed:[0,2,3,11,21,28],feed_forward:1,feed_forward_out:1,feed_forward_train:1,feedback:[4,20,28],feeddorward:4,feedforward:[1,4,12],feel:[0,5,6,11,13,15,16,21,23,26,28,30,33,34],feet:0,felt:23,fetch:[6,23],few:[1,3,4,5,9,25,28,33],fewer:[0,9,11,28],ffnn:[1,12,34],field:[0,3,6,12,21,34],fifth:[0,6,15,16,23,28],fig:[0,1,2,3,4,6,7,12,13,14,23,28,32,33,34],fig_id:[0,6,7,9,28,29,31,32],figaxi:25,figsiz:[0,1,2,3,4,6,7,8,9,10,28,31,32],figur:[0,1,2,3,4,5,6,7,8,9,10,12,13,14,15,16,21,23,28,29,30,31,32,33,34],figure_id:[0,6,7,9,28,29,31,32],figurefil:[0,6,7,9,28,29,31,32],file:[0,2,3,4,5,6,7,9,14,23,28,29,30,31,32],file_prefix:4,filenam:28,filenotfounderror:[0,7,32],fill:[5,9,29],filter:[0,3,4,7,32],financ:0,find:[0,1,2,3,5,6,7,8,9,10,11,12,13,14,15,16,21,23,25,28,29,30,32,34],fine:[0,14,15,28],finish:2,finit:[3,5,6,12,13,17,25,29,30,31,33,34],first:[0,1,2,3,5,6,7,8,9,10,11,13,14,15,16,17,22,23,25,26,27,31,34],first_moment:[33,34],first_term:[33,34],firsteigvector:11,fit:[1,3,4,5,6,7,8,9,11,12,13,15,16,17,23,25,29,31,32,33,34],fit_beta:[6,29,30],fit_intercept:[0,5,6,29,30,31],fit_mod:9,fit_transform:[0,6,8,9,11,31,32],fiti:[0,28],five:[0,9,17,23,28,29,32],fix:[0,3,4,6,10,11,12,13,23,28,31,32,33,34],fixedloc:6,flag:4,flat:[3,4,12,13,14,32,33,34],flatten:[1,3,4,5,22],flexibl:[1,6,8,10,12,28,31,34],flip:[26,28],float32:[4,9,34],float64:[4,22,28,29,34],floor:[],flop:[5,22,29],flow:[1,4,12,34],fluctuat:[5,30],fly:11,fm:[0,28],fmax:3,fmesh:[13,33],fn:7,fname:[0,7,32],focu:[0,3,4,5,6,15,21,27,28,29,30,31],focus:[1,6,7,22,29,30,32],fold:[6,9,23],folder:[0,1,3,4,6,14,23,28,31],follow:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,21,22,23,24,25,26,27,28,29,30,31,32,33,34],font:[0,7,25,28,32],fontdict:25,fontsiz:[1,6,8,9,10,25],fontweight:1,footprint:3,foral:[8,29],forc:[0,5,6,10,11,28,29,30,32],forcast:4,forecast:[4,12,34],forest:[0,1,9,21,28],forget:11,form:[0,3,4,5,6,7,8,9,11,12,13,17,21,22,23,25,28,29,30,31,32,33,34],formal:[3,4,14,25],format:[0,1,2,3,4,6,7,8,9,10,11,21,25,27,29,30,31,32,34],format_data:4,formatstrformatt:[6,13,23,32,33],formul:[4,6,11,14],formula:[3,13,25,32,33,34],forth:[4,12,34],fortran2003:[21,28],fortran2008:23,fortran90:25,fortran:[0,15,21,22,28],fortun:[0,11,29],forward:[0,3,6,21,22,28,31],foster:28,found:[1,2,3,4,5,6,12,13,14,19,20,23,28,29,30,31,33,34],foundat:[21,28],four:[4,5,6,8,12,22,23,24,26,28,30,34],fourier:[0,28],fourierdef1:3,fourierdef2:3,fourierseriessign:3,fourth:[12,28,29],fp:7,frac:[0,1,2,3,5,6,7,8,9,10,11,12,13,14,15,16,17,19,22,23,25,28,29,30,31,32,33,34],fractal:9,fraction:9,frame:[7,32],framework:[1,3,4,8,10,14,25],frank:[5,11],frankefunct:[5,6,11,23,29],fredli:[26,28],free:[0,6,11,13,15,16,21,22,23,25,26,27,28,33,34],freecodecamp:21,freedom:[5,30],freeli:[0,23],frequenc:[3,6,7,25,31,32],frequent:[0,8,9,13,32,33,34],frequentist:21,fresh:10,fridai:[16,17,18,19,20,26,28],friedman:[6,18,23,24,27,28],friendli:4,frodo:28,frog:3,from:[0,1,2,3,4,6,7,8,9,11,13,14,16,17,18,19,21,22,23,25,26,27,28],from_cod:9,from_logit:[3,4],from_tensor_slic:4,fromnumer:2,front:[0,4,5,15,16,28,29,30],fulfil:[2,5,12,29,34],full:[0,1,3,5,7,9,10,13,25,28,29,32,33,34],full_matric:[5,29],fulli:[3,6,12,24,25,31,32,34],fun:[2,21,28],fun_nam:[],func:2,functionali:11,fundament:[0,6,21,28,31],funtion:2,further:[2,7,9,28],furthermor:[0,3,5,6,7,11,12,13,17,21,23,28,29,30,31,32,33,34],futur:[0,4,8,9,28],futurewarn:8,fy:[15,23,24,26,27,28],fys4155:23,fys5419:[27,28],fys5429:[27,28],g0:2,g:[0,1,2,3,4,6,8,9,10,11,13,25,28,30,31,32,33,34],g_0:2,g_1:[2,10],g_2:[2,10],g_:[2,9,10],g_analyt:2,g_dnn_ag:2,g_euler:2,g_i:2,g_m:[3,10],g_n:3,g_re:2,g_t:2,g_t_d2t:2,g_t_d2x:2,g_t_dt:2,g_t_hessian:2,g_t_hessian_func:2,g_t_jacobian:2,g_t_jacobian_func:2,g_trial:2,g_trial_deep:2,g_vec:2,gain:[1,5,7,9,10,13,29,30,31,33,34],galleri:[0,28],game:4,gamge:28,gamma1:8,gamma2:8,gamma:[0,2,8,9,10,11,13,28,32,33,34],gamma_0:10,gamma_1:10,gamma_1x:10,gamma_:[0,28],gamma_i:[0,8,25,28],gamma_j:[13,33,34],gamma_k:[13,32,33],gamma_m:10,gamma_x:[0,28],gap:[6,8],gate:[4,12],gather:[0,1,12,29,34],gaug:[12,34],gaussbacksub:22,gaussian:[4,5,6,8,14,25,30,31],gaussian_point:14,gaussian_rbf:8,gave:[13,33,34],gavra:28,gbc:[24,28],gca:[2,6,8,13],gd:[1,32],gd_clf:10,gdclassiffiercgain:10,gdclassiffierconfus:10,gdclassiffierroc:10,gdfit:34,gdm:[13,33,34],gdregress:10,ge:[1,5,7,25,29,32],gen:[0,7,32],gen_loss:4,gen_tap:4,gender:[0,28],genener:4,gener:[0,1,2,3,5,6,8,10,11,12,13,14,15,16,17,19,20,22,23,25,27,29,30,31,32,33,34],generallay:[12,34],generate_and_save_imag:4,generate_imag:4,generate_latent_point:4,generate_simple_clustering_dataset:14,generated_imag:4,generator_loss:4,generator_loss_list:4,generator_model:4,generator_optim:4,genom:21,geodes:11,geometr:[0,13,28],geometri:[5,30,31],georg:27,geotif:[6,23],geq:[2,5,8,9,13,29,30,32,33],geron:[0,15,24,27,28,33,34],get:[0,1,2,3,4,5,6,7,9,10,11,13,15,20,21,22,23,25,26,28,29,30,31,32,33],get_dummi:9,get_paramet:2,get_split:9,get_yaxi:8,get_yticklabel:6,getattr:[],gg:28,gibb:[21,28],gif:4,gini:10,gini_index:9,ginvers:13,git:[0,15,21,28],giter:[13,33,34],github:[0,6,9,15,16,17,19,20,21,23,24,26,27,28,29,32,33,34],gitlab:[0,15,21,23,28],give:[0,1,2,3,5,6,7,8,9,10,12,13,14,17,21,23,25,28,29,30,31,32,33,34],given:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,22,23,25,28,29,30,31,32,33,34],global:[6,7,13,23,32,33,34],glorot:1,gnew:13,go:[0,1,3,5,6,8,9,11,12,13,23,28,29,30,31,32,33],goal:[0,7,9,28,32],goe:[0,1,2,5,6,13,14,18,22,28,29,30,31,32,33,34],golden:[13,33],gone:[5,29,30],gong:1,good:[1,3,4,5,6,9,10,11,13,17,21,25,27,29,30,31,32,33,34],goodfellow:[4,24,27,28,29,30,32,33],googl:[1,4,21,28,34],got:[1,6,13,23],gotcha:34,gotten:28,gov:[6,23],gp:27,gpu:[1,13,21,28,33,34],grad:[2,13,33,34],grad_analyt:[13,33,34],grad_concatenate_arg:[],grade:[23,24],gradient:[0,3,4,7,8,9,12,21,28,29],gradient_desc:[33,34],gradientboostingclassifi:10,gradientboostingregressor:10,gradients_of_discrimin:4,gradients_of_gener:4,gradienttap:4,gradual:[1,14],grai:[4,6,23],graph:[1,9,11,12,13,32,33,34],graph_from_dot_data:9,graphic:[0,1,9,28],grasp:0,gray_r:[1,3],grayscal:3,great:[5,13,32,33],greater:[1,7,25,32],greatli:[13,33,34],greedi:[9,32],green:[0,3,9,25],grei:4,grid:[1,3,6,7,8,12,25,29,30,31,34],gridsearch:32,gridsearchcv:32,grossli:[13,32,33],ground:[0,28],group:[0,6,7,9,14,21,23,24,26,28,31],groupbi:[0,28],grow:[1,3,9,10],growth:[0,28],gru:4,guarante:[0,4,13,25,28,29,32,33],guess:[1,4,10,13,14,32,33,34],guestrin:10,guid:1,guidanc:23,guidelin:[20,33,34],h1:2,h:[0,1,5,6,8,13,16,18,23,25,26,27,28,29,32,33,34],h_1:[2,13,32,33],h_2:[2,13,32,33],h_:[0,13,28,32,33],h_m:10,ha:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,16,22,23,25,28,29,30,31,32,33,34],haa:26,habit:[0,29],had:[0,1,6,7,13,28,31,32,33],hadamard:[1,12,13,33,34],half:[1,8,9],halv:10,hand:[0,1,2,3,5,11,12,13,15,21,22,23,24,25,26,27,28,29,30,31,32,33,34],handi:[3,23],handl:[0,1,2,5,9,11,21,30],handle_unknown:9,handsid:12,handwrit:[12,34],handwritten:[1,5],handwrittennot:32,happen:[1,2,3,4,5,6,10,13,25,29,33,34],hard:[1,7,8,10,13,32,33],hardcopi:[21,28],harder:[0,1,29],harmon:3,hasn:[],hassl:[0,15,21,28],hast:[21,28],hasti:[0,6,15,16,17,18,23,24,27,28,29,31,32],hat:[0,1,5,6,7,9,10,11,12,13,17,18,22,23,29,30,31,33,34],have:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,21,22,23,25,26,28,29,30,31,32,33,34],haven:1,he:[7,32],head:[0,4,10,25],header:[0,28],heads_proba:10,health:[0,29],hear:[0,13,28,33,34],heart:[0,7,28,32],heatmap:[0,1,3,7,28,32],heavili:0,heavisid:1,height:[1,3,6,29,30],held:[13,33,34],help:[0,1,4,12,13,16,23,28,33,34],helper:[4,14],henc:[0,5,6,8,9,10,12,13,18,23,28,29,30,31,32,33,34],henrik:[26,28],her:[7,32],here:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,21,22,23,25,28,29,30,31,32,33,34],hereaft:[0,8,12,28],hermitian:22,hessenberg:22,hessian:[0,2,5,13,16,30,34],heterogen:[9,10],hi:[7,32],hidden:[1,3,4,12,34],hidden_bia:1,hidden_bias_gradi:1,hidden_layer_s:[0,1,28],hidden_neuron:4,hidden_weight:1,hidden_weights_gradi:1,hierarch:[5,29,30],high:[0,1,2,3,4,5,6,9,10,11,13,14,21,22,23,28,29,31,32,33,34],higher:[0,1,3,5,6,8,13,23,28,29,30,31,32,33,34],highest:[1,2],highli:[0,3,4,10,18,21,22,27,28,29,30,31],highwai:0,hing:8,hint:[13,16,29,30,32,33],hip:21,hire:0,hist:[4,6,7,25,31,32],histogram:[0,6,7,25,32],histor:[7,11,32],histori:[3,4,12,34],hitherto:[5,30],hjorth:[26,28,29,30,31,32,33,34],hobbi:25,hoc:[5,29],hoff:27,hold:[1,3,6,13,14,31,32,33,34],holder:[0,28],holomorphic_grad:2,home:0,homepag:[23,28],homework:[6,13],homogen:[1,3,9,10,13,33,34],honchar:2,hopefulli:[0,11,25,28,34],horizont:11,hors:[3,7,32],hot:[1,9],hour:[1,21,24,25,26,28],how:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,21,22,23,25,28,29,30,31,33,34],howev:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,21,22,23,25,28,29,30,31,32,33,34],hspace:[0,4,8,10,25,28],hstack:1,htf:[24,28],html:[0,9,11,17,19,21,23,24,26,27,28,30],http:[0,3,4,6,9,11,13,16,17,19,20,21,22,23,24,26,27,28,29,30,31,32,33,34],huang:[0,28],huber:[0,28],huge:[1,3,4,21],human:[0,1,3,6,9,12,29,30,34],humid:9,hundr:1,hungri:1,huse:28,hvae:34,hybrid:24,hydrogen:[0,28],hyperbol:[1,4,12],hyperparam:8,hyperparamet:[3,4,5,6,9,13,17,28,29,30,32,33,34],hyperplan:11,i0:[0,28],i1:[0,6,8,12,28,29,30,34],i2:[0,8,12,28,34],i3:[0,12,28,34],i5:[0,28],i:[0,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,22,23,25,26,28,29,30,31,32,33,34],i_1:[5,6,30,31],i_2:[5,6,30,31],i_:[13,32,33],ian:27,ic:1,id:[7,13,32,33,34],ida:[26,28],idea:[0,1,2,3,4,6,9,10,12,13,22,23,29,30,31,32,33,34],ideal:[0,2,6,8,13,25,28,31,34],idem:[6,31],ident:[5,6,12,13,17,22,23,29,33,34],identical:[30,31],identifi:[0,1,7,9,11,12,13,14,28,29,32,33,34],ieor:25,ifi:27,ifs:[21,28],ignor:[0,1,3,9,29],ii:[22,25],iii:[22,28],ij:[0,1,3,6,8,12,14,16,18,22,23,25,28,29,30,34],ik:[0,22,28,29],illustr:[5,7,10,12,13,14,21,28,31,32,33],ilsvrc:[33,34],im:6,imag:[1,3,4,6,9,11,12,14,27,28,34],image_at_epoch_:4,image_batch:4,image_height:3,image_path:[0,6,7,9,28,29,31,32],image_width:3,imageio:[6,23],images_from_seed_imag:4,imagin:1,immedi:[0,3,4,6,15,21,28],implement:[0,2,3,4,5,6,8,9,10,11,12,13,14,17,23,25,28,29,30,32,33],impli:[3,5,6,7,13,22,29,30,31,32,33],implicit:3,implicitli:[11,25],importantli:3,impos:[0,6,11,12,28,34],imposs:[0,5,28,29],impress:[0,12,28,34],improv:[0,4,5,9,10,11,13,23,29,34],impur:9,imread:[6,23],imshow:[1,3,4,6,23],in1:[],in2:[],in3050:[27,28],in3310:28,in4080:[27,28],in4300:[27,28],in4310:27,in5400:3,in5550:27,in_out_neuron:4,inaccur:[13,32,33],inact:[12,34],inadequ:[0,28],inch:[6,29,30],includ:[0,1,2,3,4,5,6,7,11,12,15,16,17,20,21,23,25,26,27,28,29,30,31],include_bia:[6,9,31],inclus:[17,34],incom:[12,34],incorrect:1,incoveni:8,increas:[0,1,3,4,5,6,8,9,11,12,13,23,25,28,29,30,31,33,34],increasingli:25,increment:33,ind:6,inde:[0,2,4,5,6,13,28,29],indefinit:4,independ:[0,5,6,7,8,12,13,25,28,29,32,33,34],index:[0,1,3,4,10,14,21,22,25,27,28],index_col:[0,28],indic:[0,1,3,4,5,6,9,10,11,13,16,23,28,29,33,34],indispens:[6,31],individu:[1,6,7,10,12,25,28,29,31,32,34],indu:0,indx1:2,indx2:2,indx3:2,indx:22,ineffici:[3,13,33,34],inequ:[8,13],inequaltii:[32,33],inertia:[13,33,34],inf1000:[21,28],inf1100:[21,28],inf1100l:[21,28],inf1110:[21,28],inf3000:28,infeas:9,infer:[0,1,4,6,27,28,31],inferenc:1,infil:[0,6,7,9,28,31,32],infin:[5,6,7,11,18,29,30,31,32],infinit:3,infinitesim:25,influenc:[6,10,31,32],influenti:1,info:28,inform:[0,1,3,4,6,9,11,12,13,14,22,23,27,28,31,32,33,34],infti:[3,6,13,25,31,32,33],ingeni:[13,32,33,34],ingrad:2,ingredi:[0,9,28],inher:[6,31],inherit:[22,28],initi:[0,1,2,6,10,13,14,22,25,28,31,32,33,34],inject:14,inlin:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,22,23,25,28,29,30,31,32,33,34],inner:[0,13,29,33],inp:4,inplac:13,input:[0,1,3,4,5,6,7,8,12,13,14,23,25,28,29,30,31,32,33,34],input_dim:1,input_shap:[3,4],inputs:1,inputs_shuffl:[0,1,29],insert:[3,5,6,8,10,25,29,30,31],insid:[0,4,7,32],insight:[0,1,5,21,28,29,30,31],insist:[6,13,29,30,33],inspect:32,inspir:[0,1,12,28,34],instabl:2,instal:[0,1,5,6,9,15],instanc:[0,1,2,4,6,9,11,13,28,29,31,32,33],instanti:10,instead:[0,1,2,3,4,5,6,8,9,11,13,14,22,23,25,28,29,31,32,33,34],institut:1,instruct:[0,1,15,16,28],int32:10,int_0:25,int_:[3,6,25,31],int_a:25,intak:[0,29],integ:[1,2,13,14,22,25,28,33,34],integer_vector:1,integr:[3,6,25,28,31],intellig:[0,14,27,28],intend:10,intens:1,intention:14,interact:[0,6,9,12,21,23,28,34],intercept:[0,6,8,11,13,16,23,28,30,31,32,33,34],intercept_:[0,6,8,9,13,28,29,30,32,33],interchang:[5,12,22,30,31,34],interconnect:1,interest:[0,1,2,3,4,5,6,7,8,9,12,21,23,25,28,29,30,31,32,33,34],interfac:[0,1,22,29],interior:[0,9,28],intermedi:[22,29],intern:[1,2,10,12,34],interpol:[1,3,4,6,12,23,34],interpr:[5,29,30],interpret:[0,1,6,9,10,12,13,17,19,22,23,25],interv:[0,3,5,6,7,13,18,23,25,28,29,30,32,33],intial:[13,32,33],intract:[0,4,29],intrins:[3,11,22,25,28],intro:[21,27,28],introduc:[0,1,5,6,8,10,12,17,22,23,25,28,31,32],introduct:[1,2,4,13,17,20,27,29,32,33],introductori:[0,4,22,27,28,29],intuit:[0,5,6,8,12,13,23,28,30,31,33,34],inv:[0,5,13,28,29,30,32,33,34],invalid:[1,8],invalu:[0,13,15,21,28,32,33],invari:1,invd:[5,30],inver:[8,34],invers:[0,3,6,13,15,16,17,23,28,29,32,33,34],inverse_transform:8,invert:[0,5,7,10,13,28,30,32,33,34],invh:[13,33,34],invok:[0,8],involv:[0,2,6,7,11,12,29,31,32,33,34],io:[0,17,19,21,23,24,26,27,28,29],ion:34,ip:[0,8,25,28],ipca:11,ipykernel_1323:[],ipykernel_1390:[],ipykernel_1539:[],ipykernel_1579:[],ipykernel_58656:[],ipykernel_58739:[],ipykernel_58840:[],ipykernel_58862:[],ipykernel_6316:[],ipykernel_6403:[],ipykernel_6690:[],ipykernel_6729:[],ipykernel_95354:1,ipykernel_95419:6,ipykernel_95519:28,ipykernel_95542:31,ipynb:[21,23,28],ipython:[0,5,7,9,11,14,15,21,23,28,29,32],iq:[6,31],iri:[8,9],irreduc:[6,31],irrelev:[5,29],irrespect:[0,28],isbox:[],iscomplexobj:2,iseffici:[33,34],isn:[5,30,31],isnul:0,isomap:11,isotop:[28,32,33],issu:[1,9,22,30],it_arrai:[13,33],item:[0,13,28,33],items:[22,28],iter:[1,2,4,6,8,9,11,13,14,25,31,32,34],its:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,18,21,22,23,25,28,30,31,32,33,34],itself:[5,6,12,19,23,25,29,30,31],j1:22,j:[0,1,2,3,4,5,6,8,9,11,12,13,14,16,17,18,19,22,23,25,27,28,29,30,31,32,33,34],j_:6,j_lasso_sk:6,j_ridge_sk:6,j_sk:6,jackknif:[6,21,28,31],jacobian:[2,13,32,33],jacobian_shap:[],jakobsen:26,jason:4,jax:[21,28],jax_descend_i:34,jax_descend_x:34,jax_enable_x64:34,jax_grad:34,jensen:[26,28,29,30,31,32,33,34],jerom:[18,23,27],ji:[12,22],jit:[13,33],jj:[0,5,6,28,30,31],jk:[0,1,6,12,22,28,34],jl:[0,28],jm:22,jnp:[13,33,34],job:[2,8,10],johansen:28,join:[0,3,4,6,7,9,14,28,29,31,32],joint:[4,5,30,31],judg:[13,32,33],judgement:[6,23],julia:[21,22,23],jump:[23,25],junk:4,jupit:28,jupyt:[0,9,15,19,21,23,27,28],just:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,21,23,25,28,29,30,31,32,33,34],justif:0,justifi:[3,10],k0:[7,32],k1:[7,32],k:[0,1,3,5,6,7,8,9,10,11,12,13,14,21,22,23,25,26,28,29,30,33,34],kaggl:[6,23],kappa_d:25,karl:[26,28],karush:8,katrin:[26,28],keep:[0,1,4,5,6,11,13,14,22,23,28,29,30,31,32,33,34],keepdim:[1,2,6,10,22,31],kei:[0,1,3,6,12,29,34],kept:[4,6,14,31],kera:[0,4,21,23,28],kernel:[0,1,3,4,14,21,28,29],kernel_librari:[3,4,14],kernel_regular:[1,3],kernel_s:4,kernelpca:11,kev:[0,28],kevin:[27,28],keyboardinterrupt:[1,2],keyerror:[],keyword:[6,13,22,28],kfold:[6,31,32],kg:1,ki:22,kick:[1,13,33,34],kiener:2,kilomet:[6,29,30],kind:[0,2,3,4,8,12,13,14,28,29,33,34],kj:[6,12,22,29,30],kjm:[21,28],kkt:8,kl:25,km:[12,28,34],kmean:14,kmeanspoint:14,kn_k:14,know:[0,1,2,5,6,8,13,21,28,29,30,32,33,34],knowledg:[0,21,28],known:[1,3,4,5,6,7,8,9,12,22,23,25,27,29,30,31,32,34],kondev:[0,28],kp:25,kpca:11,kroneck:14,kuhn:8,kvalsund:[26,28],kwarg:2,kwown:[0,28],l0:[7,32],l1:[0,1,3,7,28,32],l1_l2:[1,3],l1regl:5,l2:[1,3],l:[0,1,2,3,5,6,7,8,10,11,12,13,19,22,23,25,28,29,32,33,34],l_1:[7,32],l_2:[7,13,32,33],l_:22,l_j:12,la:[13,33],la_i:12,la_k:12,lab:[20,21,23,28],label:[0,1,2,3,4,5,6,7,8,9,10,12,13,14,21,22,23,25,28,29,30,31,32,33,34],label_prob:[33,34],labelencod:[7,10,32],labels:[6,8,9],labels_shuffl:[0,1,29],laboratori:[24,30],lack:[0,28],lagari:2,lagrang:[8,11],lambda:[0,1,2,3,5,6,7,8,10,12,13,17,18,23,25,28,29,30,31,33,34],lambda_0:11,lambda_1:[5,8,11,29],lambda_2:[8,11],lambda_:11,lambda_i:[8,11],lambda_iy_i:8,lambda_jy_iy_j:8,lambda_k:8,lambda_n:[5,8,29],lamda:1,land:[0,8],landmark:8,landscap:[13,32,33,34],langl:[0,6,11,25,28,29],languag:[0,1,4,8,15,21,22,23,27,28],lapack:[22,28],laplac:[5,30,31],laptop:21,larg:[0,1,2,4,5,6,8,9,10,11,13,15,21,22,23,25,27,28,29,31,32,33,34],larger:[0,3,5,6,8,10,11,13,17,25,28,29,30,31,32,33,34],largest:[4,8,11],lasso:[0,7,21,28],lasso_sk:6,last:[0,1,2,3,4,5,6,7,8,10,12,13,14,17,18,22,23,25,26,28,30,31,33],latent:4,latent_dim:4,latent_point:4,latent_space_value_rang:4,later:[0,1,4,7,8,12,13,14,15,21,23,28,32,33,34],latest:[4,21],latest_checkpoint:4,latex:28,latter:[0,3,6,7,8,11,13,16,22,23,25,28,29,30,31,32,33,34],lattic:[12,34],law:0,lax_numpi:34,layer:[0,4,13,28,33,34],lbfg:[7,9,10,11,32],lcc:[5,6,30,31],lda:11,ldot:[0,6,11,19,23,28,31,32],le:[5,7,10,13,17,25,29,30,32,33,34],lead:[0,1,3,5,6,7,8,9,10,11,12,13,16,17,22,25,28,29,30,31,32,33,34],leaf:9,leaki:1,leakyrelu:4,lear:[13,32,33],learn:[3,4,5,6,7,8,9,10,12,18,22,24,26,27],learnabl:3,learner:10,learnig:28,learning_r:[8,10,34],learning_rate_init:[0,1,28],learning_schedul:[13,33,34],learnt:23,least:[0,7,8,10,11,15,16,17,19,21,22,25,31,32],leat:[13,33,34],leav:[0,1,3,5,6,9,11,28,30,31,32],lectur:[0,1,5,10,11,12,13,15,17,21,22,23,24,26,27],lecturenot:[0,17,19,21,23,27,28],left:[0,1,2,3,5,6,7,8,9,10,11,12,13,14,16,17,19,22,23,25,28,29,30,31,32,33,34],leftarrow:[8,12],legend:[0,2,3,4,5,6,7,8,9,10,13,28,29,30,31,32,33,34],len:[0,1,2,3,4,5,6,8,9,10,11,12,22,28,29,30,31,33,34],length:[0,1,2,3,4,8,9,13,16,21,28,29,32,33,34],length_of_sequ:4,leq:[0,5,7,8,13,14,25,28,29,30,32,33],less:[0,1,3,4,5,6,8,9,13,21,25,28,29,30,31,32,33,34],lessen:1,let:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,22,25,28,29,30,31,32,33,34],letter:[0,16,22,25,28,29],level:[0,1,5,6,9,21,22,23,24,26,28,31],li:[8,11],lib:[0,2,3,4,6,7,8,9,11,14,28,30,32,34],liblinear:[8,10],libmetal_plugin:[3,4,14],librari:[0,1,2,3,4,5,6,7,9,10,11,14,15,22,23,25,27,29,30,32],library_loc:[3,4,14],licens:[0,1,15,21,23,28],lie:[0,6,11,25,28,29,31],life:[0,1,8,12,28,34],lifetim:[13,33,34],like:[0,1,2,3,4,5,6,7,9,10,11,12,13,15,16,21,22,23,25,28,29,30,31,32,33,34],likelihood:[0,1,5,9,28,29,33,34],lim_:25,lima:26,limit:[0,5,6,8,9,11,12,22,23,28,29],lin_clf:8,lin_model:0,lin_reg:9,linalg:[0,2,5,6,8,11,13,22,25,28,29,30,32,33,34],line1:8,line2:8,line2d:[33,34],line3:8,line:[0,1,2,3,4,6,7,8,10,11,13,14,23,28,29,30,31,32,33,34],linear:[1,3,5,6,7,9,10,11,12,17,18,21,23,25,31,33,34],linear_model:[0,5,6,7,8,9,10,11,13,28,29,30,31,32,33,34],linear_regress:[6,31],linearli:[5,29],linearloc:[6,13,23,32,33],linearregress:[0,6,7,9,28,29,30,31,32],linearsvc:8,lineat:30,liner:[1,3],linerar:10,linewidth:[0,2,4,6,8,9,10,23,31],link:[0,4,9,12,21,23,26,28],linlag:[5,30],linpack:[22,28],linreg:[0,28],linspac:[0,2,3,4,6,8,9,10,13,15,16,22,25,28,29,30,31,33,34],linu:4,linux:[0,1,15,21,23,28],liquid:[0,28],list:[0,1,2,3,4,7,9,21,23,28,29,32,33,34],listcomp:[],listedcolormap:[9,10],literatur:[1,7,14,27,31,32],littl:[1,3,9,12],live:8,ll:[0,25,28,29],lle:[0,29],lloyd:[4,14],lmb:[0,2,5,6,30,31,32],lmbd:[0,1,3,28],lmbd_val:[0,1,3,28],lmbda:[13,32,33],ln:[1,13,32,33],load:[0,1,3,4,6,7,9,10,14,23,32],load_boston:0,load_breast_canc:[1,7,9,10,11,32],load_data:[3,4],load_digit:[1,3],load_iri:[8,9],load_librari:[3,4,14],load_pluggable_device_librari:[3,4,14],loc:[0,3,6,7,8,9,10,28,31,32],local:[0,1,2,3,7,12,13,29,32,33,34],locat:[2,3,8],log10:[0,5,6,30,31,32],log:[0,1,2,4,5,6,7,9,10,11,13,22,23,28,29,30,31,32,33,34],log_:[0,28],log_clf:10,logaddexp2:[],logaddexp:[],logarithm:[0,5,7,22,28,30,31,32],logbook:23,logic:[0,1,9,28],logist:[0,1,2,8,9,10,11,12,13,21,29],logistic_predict:[33,34],logisticregress:[7,9,10,11,32,34],logit:[7,32],logreg:[7,9,10,11,32,34],logspac:[0,1,3,5,6,28,30,31,32],longer:[2,3,8,10,14,22,25,28],loocv:[6,31,32],look:[0,1,2,3,4,5,6,7,8,9,10,11,13,16,18,22,23,25,28,29,30,31,32,33,34],loop:[1,4,6,10,12,14,21,22,28,31],lose:1,loss:[0,1,3,4,5,6,7,8,10,11,13,22,23,28,30,31,34],loss_fil:4,lossfil:4,lost:4,lot:[0,1,4,6,31,33,34],low:[0,6,9,10,11,23,28,29,31],lower:[0,1,3,6,9,10,16,22,29],lowercas:[22,28],lowest:[9,13,25,33,34],lr:[1,3,4,10],lstat:0,lstm:4,lstm_2layer:4,lstsq:[0,28,29],lt:[6,31],lu:[0,5,28,29],lubksb:22,luckili:2,ludcmp:22,lux:22,lvert:1,lw:[0,28],m:[0,1,2,3,5,6,8,9,10,11,12,13,22,24,25,26,27,28,29,30,31,32,33,34],m_1:14,m_:[9,12],m_h:[0,28],m_k:14,m_l:12,m_n:[0,28],m_p:[0,28],m_t:[13,33,34],ma:11,machin:[1,3,4,5,6,7,9,10,11,12,15,22,24,27,29,30,31,34],machinelearn:[0,6,16,17,19,20,21,23,24,26,27,28,32,33,34],mackai:27,made:[0,1,3,4,5,6,7,9,11,12,18,23,28,29,32,34],mae:[0,28],magic:4,magnitud:[1,6,7,13,29,30,32,33,34],mai:[0,1,2,3,5,6,7,8,9,11,12,13,18,21,22,23,25,28,29,30,31,32,33,34],mail:[24,26],main:[0,1,3,4,5,6,7,9,22,23,27,29,32],mainli:[0,5,6,7,9,28,29,30,31,32],maintain:[6,31],major:[1,6,9,10,13,22,28,31,32,33,34],make:[1,2,3,4,5,6,7,8,11,12,13,21,22,23,25,27,30,31,32,33,34],make_axes_locat:6,make_classif:34,make_moon:[8,9,10],make_pipelin:[0,6,10,29,31],make_vjp:2,makedir:[0,6,7,9,28,29,31,32],makeplot:[0,28],malcondit:22,malign:[1,7,9,32],mammographi:[5,30,31],manag:[0,2,3,15,21,23,28],mandatori:[26,28],mani:[0,1,3,4,5,6,7,8,9,11,13,14,21,22,23,25,27,28,29,30,31,32,33,34],manifold:11,manner:3,manual:[6,29,30,32],map:[0,1,2,6,7,8,11,12,14,23,25,28,32,34],marc:29,margin:[0,5,8],marit:[0,28],mark:28,marker:[0,7,22,28,32,34],markov:[21,28],marsaglia:25,mass:[0,1,5,13,29,33,34],massag:[0,28],masses2016:[0,28],masses2016ol:[0,28],masses2016tre:0,masseval2016:[0,28],master:[6,16,20,23,24,26,32,33,34],mat1100:[21,28],mat1110:[21,28],mat1120:[21,28],mat:[21,28],match:[1,4,5,13,14,29,32,33,34],match_complex:[],materi:[4,5,7,13,17,22,26,33,34],math:[3,7,12,13,22,25,27,28,32,33,34],mathbb:[0,4,5,6,7,8,11,12,13,14,17,18,19,22,23,25,28,29,30,31,32,33,34],mathbf:[0,5,6,7,8,13,18,19,22,23,28,29,30,31,32,33,34],mathcal:[1,5,6,7,13,19,23,30,31,32,33],matheemat:3,mathemat:[0,6,11,12,13,17,21,22,25,27,28,30,32],mathemati:28,mathmlbook:16,mathrm:[0,1,3,4,5,6,7,8,9,10,11,12,13,14,17,18,19,23,25,28,29,30,31,32,33,34],matmul:[1,2,5,30],matnat:27,matplotlib:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,21,22,23,25,28,29,30,31,32,33,34],matric:[0,1,3,4,6,7,8,11,13,16,17,21,29,32,33],matrix:[0,2,3,4,6,7,8,10,13,15,16,17,18,19,23,25,31],matshow:1,matter:[2,3,13,29,32,33,34],max:[0,1,2,3,4,9,10,12,13,26,28,32,33,34],max_depth:[0,9,10],max_diff1:2,max_diff2:2,max_diff:2,max_it:[0,1,8,9,11,13,28,32,33,34],max_iter:14,max_leaf_nod:10,max_sampl:10,maxdegre:[0,6,10,29,31],maxdepth:10,maxim:[1,4,5,7,8,11,30,31,32],maximum:[0,2,3,5,7,8,9,10,13,14,28,29,33,34],maxpolydegre:[5,6,30,31,32],maxpooling2d:3,mbox:[5,6,18,23,29,30,31],mcculloch:[12,34],md:[11,20,23,33,34],mdoel:4,mean:[1,2,3,4,5,6,7,9,10,11,12,13,14,15,16,17,18,19,21,22,23,25,28,31,33,34],mean_absolute_error:[0,28],mean_divisor:14,mean_i:25,mean_matrix:14,mean_squared_error:[0,4,6,7,10,28,29,31,32],mean_squared_log_error:[0,28],mean_vector:14,mean_x:25,meaning:[0,4,7,28,32],meansquarederror:[0,28],meant:[2,3,7,10,13,32,33,34],measur:[0,1,2,5,6,9,11,12,14,19,23,25,28,29,30,31],mechan:[0,4,25,28],median:[0,28,29],medicin:[12,34],medium:[4,8,13,33,34],medv:0,meet:[0,26],mehta:[0,28,29,30],memori:[3,4,11,12,13,22,33,34],mention:[0,12,13,23,25,28,32,33,34],mere:[0,15,28],meshgrid:[2,5,6,8,9,10,11,23,29],messag:[5,13,33,34],messi:2,met:[0,3,8,29],metadata:2,meteorolog:9,meter:[6,29,30],method:[0,1,2,3,4,5,7,8,11,12,14,16,17,18,19,21,22,25,27,29,30],metion:[6,23],metric:[0,1,3,6,7,9,10,14,15,16,28,29,31,32],metropoli:[21,28],mev:[0,25,28],mgd:[13,33,34],mglearn:[21,28],mgrid:[13,33],mhjensen:[2,3,4,6,8,9,11,14,34],mi:10,mia:[26,28],michigan:[28,30,32,33,34],microsoft:27,mid:1,midel:4,midnight:[16,17,18,19,20],midpoint:9,might:[0,1,2,4,6,9,13,29,30,32,33,34],mild:9,millimet:[6,29,30],million:[0,28,29,33,34],mimic:[12,34],min:[0,2,5,8,9],min_:[0,2,5,14,17,28,29,30],min_samples_leaf:9,mind:[0,6,13,23,28,29,30,31,32,33],mindboard:4,mine:[21,28],mini:[1,11,12,13,32],minibatch:[1,11,13],minibathc:[13,33,34],miniforge3:[0,2,3,4,6,7,8,9,11,14,28,30,32,34],minim:[0,1,2,3,5,6,7,8,9,10,11,12,13,14,17,18,23,29,30,31,33,34],minima:[0,1,7,13,28,32,33,34],minimum:[0,1,2,6,8,9,11,13,29,31,32,33,34],minmaxscal:[0,29],minor:25,minst:1,minu:[7,32],mirjalili:28,mirror:9,misc:[6,23],misclassif:[8,9,10],misclassifi:[8,10],miser:0,mismatch:1,miss:[0,7,10],mistak:4,mit:27,mix:[1,2,28],mixtur:[13,33,34],mk:[9,22],mkdir:[0,6,7,9,28,29,31,32],ml:[0,1,10,13,22,23,29,32,33,34],mlab:25,mlbook:28,mle:[5,7,32],mlp:[1,34],mlpclassifi:[1,34],mlpregressor:[0,28],mm:22,mml:29,mn:[12,25,34],mnist:[1,11],mod:25,mode:[24,26,28],model:[2,3,5,7,8,9,10,11,13,14,15,16,18,19,21,23,25,27,29,30,31,32,33],model_select:[0,1,3,5,6,7,9,10,11,28,29,30,31,32],moder:10,modern:[0,6,7,21,28,31,32],modif:[2,12,13,33,34],modifi:[0,1,3,5,7,8,10,12,13,28,29,30,32,33,34],modul:[0,9,11,22,28,30],modular:25,modulo:25,moe:[11,29],moment:[5,6,13,25,30,31],mondai:28,monitor:[13,33,34],monoton:[5,12,25,30,31,34],mont:[0,6,21,25,27,28,31],moor:[5,6,30],more:[0,1,2,4,5,7,8,9,10,11,12,13,14,18,21,25],moreov:[0,3],morten:[26,28,29,30,31,32,33,34],most:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,21,23,25,28,29,30,31,32,33,34],mostli:[1,11],motion:[0,13,33,34],motiv:[1,4],move:[0,4,5,6,7,9,12,13,14,23,25,29,30,31,32,33,34],mpl:[0,7,28,32],mpl_toolkit:[2,6,13,23,32,33],mplot3d:[2,6,13,23,32,33],mplregressor:1,mse:[0,4,5,6,9,10,15,16,17,19,23,28,29,30,31,32],mse_simpletre:10,mselassopredict:[5,30],mselassotrain:[5,30],mseownridgepredict:[6,30],msepredict:[5,30],mseridgepredict:[0,5,6,30,32],msetrain:[5,30],msle:[0,28],mt:[7,12,32,34],mu0:25,mu1:25,mu2:25,mu:[0,6,11,13,25,28,31,33,34],mu_1:29,mu_:[6,25,29,30,31],mu_i:[6,29,30],mu_n:11,mu_x:25,much:[0,1,2,3,4,5,6,8,9,10,11,12,13,22,23,25,28,29,30,31,33,34],multi:[0,1,3,7,21,28,32],multiclass:[1,7,32],multidimension:[11,12,28,34],multilay:1,multinomi:[7,32],multipl:[2,4,5,6,7,12,13,25,29,31,32,33,34],multipli:[3,5,6,11,13,22,25,29,30,33],multiplum:8,multivari:[0,2,10,11,21,25,28],multivariate_norm:[11,14],murphi:[11,27,28],must:[1,2,5,6,8,10,12,13,14,25,29,31,32,33,34],mutat:[7,32],mutual:[1,3,6,13,31,32,33],mx_:25,myenv:[0,2,3,4,6,7,8,9,11,14,28,30,32,34],myriad:[0,15,21,28],mz1:25,mz2:25,n1:22,n2:22,n:[0,1,2,3,4,5,6,7,8,10,11,12,13,14,15,16,17,18,19,22,23,25,28,29,30,31,32,33,34],n_0:[12,25,34],n_:[1,2,3,8,12,25,34],n_boostrap:[6,10,31],n_bootstrap:[6,31],n_categori:[1,3],n_cluster:14,n_compon:11,n_data:34,n_epoch:[13,33,34],n_estim:10,n_examples_to_gener:4,n_featur:1,n_filter:3,n_hidden:2,n_hidden_neuron:[0,1,28],n_i:25,n_input:[0,1,3,29],n_instanc:9,n_iter:[32,33],n_iter_i:[9,11],n_job:10,n_k:14,n_l:[12,25,34],n_layer:1,n_m:9,n_neuron:1,n_neurons_connect:3,n_neurons_layer1:1,n_neurons_layer2:1,n_point:14,n_sampl:[6,8,9,10,14,31,34],n_split:[6,31,32],n_step:4,n_t:2,n_x:2,nabla:[1,13,32,33],nabla_:[2,13,32,33,34],nabla_w:[13,33,34],nag:[13,33,34],naimi:[0,28],naiv:[7,32],naive_kmean:14,najafi:[26,28],name:[0,1,3,4,5,6,7,8,9,10,12,13,14,15,21,22,23,25,26,28,29,30,31,32,33,34],nameerror:[10,23],namespac:[3,4,14],narrow:[13,33,34],nary_f:2,nary_op_arg:2,nary_op_kwarg:2,nary_oper:2,nation:[1,5,30,31],nativ:[21,28],natur:[0,1,4,8,9,12,13,23,25,27,28,32,33,34],navier:[12,34],nb:25,nb_:22,nbconvert:28,nbviewer:9,nd:14,ndarrai:[2,6],ndim:[],ne:[9,10,22,25,29],nearest:[1,3,6,11],nearli:[13,32,33],neat:28,neatli:[],neccesari:[6,31],necess:2,necessari:[0,1,3,4,8,14,28],necessarili:[0,4,11,25,28],necesserali:[5,30,31],neck:[7,32],need:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,17,22,25,29,30,31,32,33,34],neg:[0,1,3,5,6,7,10,13,22,25,28,30,31,32,33,34],neg_mean_squared_error:[6,31,32],neglect:25,neglig:25,neighbor:[3,6,11],neither:[4,13,33,34],neq:[13,14,25,32,33],nervou:[12,34],nest:[2,9,12,34],nesterov:[13,33,34],net:[2,4,12,34],netlib:[22,28],network:[0,9,13,21,27,29,33],neural:[0,13,21,27,29,32,33],neural_network:[0,1,2,28,34],neuralnetwork:1,neuron:[1,2,3,4,12],neutral:[0,28],neutron:[0,28],never:[1,4,6,9,25,31],new_box:2,new_chang:[13,33,34],new_hobbit:28,new_root:[],new_trac:[],newaxi:[0,3,6,9,31,32],newli:[0,28],newton:[1,7,8,13,25],next:[0,1,2,3,4,5,6,7,8,9,13,14,28,29,30,32,33,34],next_guess:[13,33],next_input:4,ng:1,ngini:9,ni:14,nice:[0,1,5,11,28,29,30,31],niter:[13,32,33,34],nitric:0,nlambda:[0,5,6,30,31,32],nlp:27,nm:25,nm_n:[0,28],nmse:[6,31],nn:[2,5,6,12,22,30,31,34],nn_model:1,nnmin:2,node:[1,2,3,9,10,12,34],node_constructor:[],nois:[0,4,5,6,8,9,10,13,15,16,19,23,28,29,30,31,32,33],noise_dimens:4,noisi:[1,6,19,23,31],non:[0,1,3,5,6,7,9,10,11,12,13,14,22,25,28,29,30,31,32,33,34],none:[0,1,2,4,5,9,10,13,25,28,29,30,31,32],nonlinear:[3,6,8,9,11,12,31,34],nonneg:[6,9,13,31,32,33],nonparametr:6,nonsens:25,nonsingular:22,nonumb:[3,7,8,13,22,32,33,34],nor:[1,4,13,33,34],norm:[0,1,5,6,8,11,13,17,28,29,30,31,32,33,34],normal:[3,4,5,6,7,8,9,10,11,12,13,15,16,18,19,21,22,23,25,28,29,30,32,33,34],normali:[22,28],norwai:[6,23,28,31,34],notat:[0,2,5,6,13,14,25,28,29,30,31,33],note:[0,1,2,3,4,5,6,7,8,11,12,13,14,15,16,21,22,25,27,28,31,32,33],notebook:[0,1,3,9,15,21,23,28],notesseptember16:32,notfounderror:[3,4,14],noth:[1,2,5,8,12,14,25,29,30,34],notic:[4,5,12,13,22,25,28,30,33,34],notimplementederror:2,notion:3,novel:[3,6,10,32],novemb:[1,24,26,28],now:[0,2,4,5,6,7,8,10,11,12,14,15,16,17,21,22,23,25,28,29,32],nowadai:[0,1,3,9,21,28],nox:0,np:[0,1,2,3,4,5,6,7,8,9,10,11,13,14,15,16,22,23,25,28,29,30,31,32,33,34],npr:2,nsampl:[6,9,31,32],nt:2,ntrained_model:[6,30],nu:25,nuclear:[5,29],nuclei:[0,25,28],nucleon:[0,28],nucleu:[0,28],num:4,num_coordin:2,num_featur:34,num_hidden_neuron:2,num_it:2,num_iter:34,num_neuron:2,num_neurons_hidden:2,num_point:2,num_tre:10,num_valu:2,number:[1,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,19,22,23,24,26,28,30,31,32],numberid:[7,32],numberparamet:3,numer:[0,5,6,9,10,11,12,13,17,21,22,27,28,29,30,31,32,33,34],numpi:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,21,23,25,29,30,31,32],numpy_box:[],numpy_vjp:2,numpy_wrapp:[],nunmpi:[5,29],nvalu:9,nx:2,nx_test:[6,30],nx_train:[6,30],nx_train_mean:[6,30],ny:25,ny_pr:[6,30],ny_train:[6,30],ny_train_mean:[6,30],o:[0,6,7,8,9,11,15,22,26,27,28,32,34],obei:[6,11,13,29,30,33],obj:2,object:[0,1,2,4,6,8,10,22,28,33],obliqu:[5,29],observ:[0,1,3,5,6,7,8,9,10,11,12,13,14,25,30,31,32,33,34],obtain:[0,1,5,6,7,8,9,10,12,13,14,17,22,23,25,28,29,30,31,32,33,34],obviou:[5,6,11,25,29],obviouli:28,obvious:[0,4,5,6,22,28,30,31],oc:29,occupi:0,occur:[0,6,8,9,22,25,28],octob:[24,26,28,34],od:0,odd:[0,3,7,28,29,32],odenum:2,odesi:2,odin:28,oen:0,off:[1,3,4,5,9,13,19,25,30,31,33,34],offer:[6,11,21,22,24,26,28,31],offic:[26,28],offici:[24,28],often:[0,1,3,4,5,6,7,8,9,10,11,12,13,14,16,21,22,23,25,28,29,31,32,33,34],ofter:[22,28],ol:[0,13,15,16,17,18,28,29],old:[1,5,10,13,30,31,32,33],ols_sk:6,ols_svd:6,olsbeta:[0,5,30],omega:[2,3,6],omega_0:3,omit:[0,5,28,29,30,31],omlmp_kkie0:32,onc:[1,6,9,11,13,31,32,33,34],one:[0,1,3,4,5,6,7,8,9,10,11,13,14,19,21,22,23,25,26,28,29,30,31,34],onehot:1,onehot_vector:1,onehotencod:9,ones:[0,2,5,6,8,9,10,11,13,22,23,28,29,30,31,32,33],ones_lik:4,ong:29,onl:3,onli:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,17,19,22,23,25,28,29,30,31,32,33,34],onlin:[11,24],onto:[5,11,29],open:[0,1,4,6,7,9,15,21,23,24,26,28,31,32],oper:[0,1,3,5,6,10,11,12,13,15,21,25,28,29,30,31,33,34],operation:25,oplu:25,opmiz:[13,33,34],opportun:0,oppos:[6,13,33,34],opposit:[1,5,8,29],opt:[1,5,28,30],optim:[0,2,3,4,5,6,7,9,10,11,14,15,16,17,18,19,23,30,31],optimis:[1,3],option:[0,1,3,5,6,8,9,11,22,23,29,30,31,34],optmiz:[1,8,13,29,33,34],oral:28,orang:0,order:[0,1,2,3,5,6,7,8,9,10,11,12,15,16,22,23,25,28,29,30,31,32],ordinari:[0,2,3,7,11,13,15,16,17,19,21,31,32,33,34],oreilli:[27,28],org:[0,3,4,9,11,21,22,23,27,28,30,33,34],organ:[6,7,10,22,31,32],orient:[1,5,25,29,30],origin:[0,3,5,6,8,11,12,13,22,28,29,31,33,34],orthogn:[5,29],orthogon:[0,5,6,8,11,13,17,22,28,29,30,33],orthonorm:[5,29,30],os:[0,1,4,5,6,7,8,9,26,28,29,30,31,32],oscar:1,oscil:[3,13,33,34],oserror:[0,3,4,7,14,32],oslo:[0,15,21,23,24,26,28,29,30,31,32,33,34],osx:[0,15,21,23,28],other:[0,1,2,3,5,6,7,8,10,13,14,15,19,21,24,25,26,27,30,31,33],otherwis:[0,1,4,7,13,22,28,32,33,34],ouput:[5,7,12,30,31,32],our:[1,2,3,6,7,8,9,10,12,14,15,16,17,18,19,21,22,23,25,30,31,34],ourmodel:0,ourselv:[0,5,6,8,11,13,28,29,30,31,32,33],out1:[],out2:[],out:[0,1,2,4,5,6,7,8,9,10,11,12,13,16,21,22,23,25,28,29,30,31,32,33,34],out_fil:9,outcom:[0,7,9,10,12,25,29,32],outdoor:9,outer:[6,12,13],outfil:4,outgrad:2,outlier:[0,8,28,29],outlin:[6,10,11,31],outlook:9,outperform:10,output:[0,1,3,4,5,6,7,8,9,10,12,13,16,22,23,25,28,29,30,31,32,33,34],output_bia:1,output_bias_gradi:1,output_shap:4,output_weight:1,output_weights_gradi:1,outputlayer1:[12,34],outputlayer2:[12,34],outsid:4,over1:[13,33,34],over:[0,1,3,4,5,6,9,10,12,13,22,23,28,29,30,31,32,33,34],overal:[1,10],overcast:9,overcom:[12,13,33,34],overdetermin:[0,28],overfit:[0,1,3,6,9,10,13,31,33,34],overflow:[1,5,30,31],overhead:12,overlap:[3,7,8,9,32],overlin:[0,5,6,9,10,11,14,22,28,29,30],overst:0,overtrain:4,overview:[3,32],own:[4,5,6,8,12,13,21,22,23,30,33,34],owner:0,ownmsepredict:0,ownmsetrain:0,ownridgebeta:[0,6,30],ownypredictridg:0,ownytilderidg:0,oxid:0,p0:2,p1:2,p:[0,1,2,3,4,5,6,7,8,9,10,11,13,14,17,22,25,28,29,30,31,32,33],p_:[2,4,8,9],p_hidden:2,p_i:[5,25,30,31],p_j:25,p_n:25,p_output:2,p_x:25,pack:[0,28],packag:[0,1,2,3,4,5,6,7,8,9,11,13,14,15,21,23,25,29,30,32,33,34],packtpub:28,packtpublish:28,pad:[3,4],page:[0,9,21,28,30,31,32,33],pai:[0,1,9,13,33,34],pair:[0,2,3,9,21,25,28],panda:[0,4,5,6,7,9,11,15,21,23,30,31,32],panel:28,paper:1,paradigm:[0,28],parallel:[10,13,21,22,28,33,34],param:2,param_distribut:32,param_grid:32,paramat:2,paramet:[0,1,2,3,4,5,6,7,8,9,10,12,13,16,17,18,19,23,25,30,31],parameter:[0,6,10,23,28,29],parametr:[0,6,15,16,28,29,31],paramt:[3,5,30,31],parent:2,parent_argnum:[],part:[0,1,3,5,6,10,17,18,22,24,25,26,28,30,31,34],partial:[0,1,5,6,7,8,10,11,12,13,16,25,28,29,30,32,33],particip:[21,24,26,28],particl:[0,4,13,25,28,33,34],particular:[0,1,2,3,5,6,9,10,11,12,13,16,23,25,27,28,29,30,31,32,33,34],particularli:[5,6,8,11,13,25,29,31,32,33,34],partit:[1,4,9],partli:[6,28,31],pass:[2,3,12,14,32],passkwarg:2,password:23,past:[10,25],patch:[6,25,31],path:[0,3,4,6,7,9,14,15,21,28,29,31,32],pathcollect:34,patient:[7,32],patter:4,pattern:[0,3,4,12,24,27,28,34],pauli:[0,28],pc:[11,21],pca:[0,7,21,28,29,32],pd:[0,4,5,6,7,9,11,28,29,30,31,32],pde:2,pdf:[0,3,4,5,6,9,16,20,23,27,28,30,31,32],pedagog:[0,28,29],penal:[6,29,30],penalti:[6,13,23,29,30,32,33],penros:[5,6,30],pentagon:[13,32,33],peopl:[0,1,9,13,21,33,34],per:[0,1,6,24,26,28,31],percentag:[0,10,11,26],perceptron:[0,1,7,28,32],peregrin:28,perfect:[0,1,13,28,33,34],perfectli:[4,6,31],perform:[0,2,3,4,5,6,8,10,11,12,13,14,15,16,17,19,21,22,23,25,28,29,30,31,32,33,34],performac:4,perhap:[0,5,13,28,29,30,32,33],perimet:[1,9],period:[1,4,25],permut:11,persist:[13,33,34],person:[5,6,7,24,26,28,29,30,31,32],perspect:27,pertin:[12,28],petal:[8,9],peter:[27,29],phantom:25,phase:[6,12,34],phenomena:25,phi:8,phi_k:8,philosophi:[13,33],phone:[26,28],photo:4,phrase:[0,28],physic:[0,1,4,7,12,13,25,26,27,28,29,30,31,32,33,34],pi:[2,3,5,6,7,9,12,13,25,30,31,32,33,34],pick:[1,9,10,11,13,14,33,34],pickl:1,pictur:[0,28],pie:[21,28],piec:[11,14],pillow:[0,15,21,23,28],pinv:[5,6,13,29,30,33,34],pip3:[0,1,15,23,28],pip:[0,1,15,21,23,28],pipelin:[0,6,8,10,29,31],pippin:28,pit:4,pitfal:[6,29,30],pitt:[12,34],pixel:[1,3,4],pixel_height:[1,3],pixel_width:[1,3],place:[0,4,6,8,13,22,23,28,31,32,33],plai:[0,3,4,5,6,8,11,21,28,29,30,31,32],plain:[8,10,12,13,14,32,33],plan:[6,9,26,27,28],plane:[8,9],plateau:[5,30],platform:[21,28],plausibl:[12,34],pleas:[9,11,13,23,26,28,33,34],plenti:1,plethora:[3,12,34],pliahhy2ibx9hdharr6b7xevztgzra1p:34,plot:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,21,22,23,25,28,29,30,33,34],plot_all_sc:[23,30],plot_confusion_matrix:[7,10,32],plot_count:6,plot_cumulative_gain:[7,10,32],plot_data:1,plot_dataset:8,plot_decision_boundari:[9,10],plot_import:10,plot_max:4,plot_min:4,plot_model:4,plot_numb:4,plot_predict:8,plot_regression_predict:9,plot_result:4,plot_roc:[7,10,32],plot_surfac:[2,6,13,23,33],plot_train:9,plot_tre:[9,10],plqvvvaa0qudcjd5baw2dxe6of2tius3v3:34,plt:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,22,23,25,28,29,30,31,32,33,34],plu:[0,3,5,7,28,29,30,32],pluggabl:[3,4,14],plugin:[3,4,14],pm:[8,31],pmatrix:2,pml:27,pn:3,png:[0,4,6,7,9,28,29,31,32],point:[0,1,2,3,5,6,7,8,9,10,11,13,14,15,16,17,19,22,23,25,26,28,29,31,32,33,34],point_1:4,point_2:4,poisson:[21,25,28],poli:[6,8,31,32],poly100_kernel_svm_clf:8,poly3:0,poly3_plot:0,poly3dcollect:33,poly_featur:[8,9],poly_features10:9,poly_fit10:9,poly_fit:9,poly_kernel_svm_clf:8,polydegre:[0,5,6,10,29,30,31],polygon:[13,32,33],polym:[12,34],polymi:23,polynomi:[0,5,6,7,8,9,10,11,15,16,17,19,23,28,29,31,32,34],polynomial_featur:[6,31],polynomial_svm_clf:8,polynomialfeatur:[0,6,8,9,29,31,32],polytrop:[0,6,28,31],pool:3,pool_siz:3,poor:[1,13,32,33,34],poorli:[0,29],pop:2,popul:[0,5,28,29,30,31],popular:[0,1,3,6,7,8,9,11,12,15,21,22,23,25,29,32,34],popularli:[0,28],portabl:10,portion:[11,13,33,34],pose:[0,4,5,6,11,25,28,31],posit:[0,1,2,3,5,7,8,10,11,13,14,22,25,28,29,30,31,32,33,34],possibl:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,15,19,21,22,23,25,26,28,29,30,31,32,33,34],posterior:[5,30,31],postpon:[0,28,29],postscript:23,postul:[5,30,31],potenti:[0,3,5,6,12,13,28,29,30,31,33,34],pott:[12,34],power:[0,1,5,6,8,9,12,13,28,29,31,33,34],pp:[5,6,18,30,31,32],practic:[0,5,6,7,8,23,25,29,30,31,32],practition:[0,1,3,28],pre:28,preced:[1,11,12,25,34],preceed:4,preceq:8,precis:[0,2,5,11,13,22,23,25,28,29,30,31,33,34],pred:[6,31,33,34],predicit:0,predict:[0,1,5,6,7,8,9,10,15,16,21,23,27,28,29,30,31,32,34],predict_prob:1,predict_proba:[7,10,32,34],predictor:[0,5,6,7,9,10,11,28,29,30],prefer:[0,1,6,8,9,11,13,15,21,23,28],prepar:[0,6,22,23,28,29],preprocess:[0,4,6,7,8,9,10,11,23,30,31,32],prerequisit:0,prescript:23,presenc:[13,33,34],present:[0,5,6,7,9,12,13,22,23,25,28,29,30,33,34],preserv:[3,11,22],press:[13,27,32,33],pretrain:[1,4],pretti:[0,4,8,9,15,21,23,28],prev_centroid:14,prevent:[13,25,33,34],previou:[0,1,2,3,4,5,6,8,10,11,12,13,22,23,25,29,32,33,34],previous:[2,3,9,10,25],price:[0,4,9,13,33,34],primal:8,primari:[0,7,28,32],prime:25,primit:2,princip:[0,5,7,21,28,29,32],principl:[0,6,7,8,14,28,31,32],print:[0,1,2,3,4,5,6,7,8,9,10,11,13,14,22,25,28,29,30,31,32,33,34],print_funct:[8,9],printout:[0,28],prior:[0,5,6,28,30,31],privat:0,prob:[1,25],probabilist:[0,27,28,29],probabl:[0,1,3,4,6,7,10,13,21,28,29,32,33,34],problem:[0,3,4,5,6,7,8,9,10,11,12,16,17,21,22,23,25,31],probml:27,proce:[0,5,6,7,8,9,10,11,13,22,28,29,30,31,33],procedur:[2,4,5,6,8,10,11,13,23,29,30,31,32,33,34],proceed:22,process:[0,2,4,6,9,10,12,13,15,21,22,23,25,27,28,31,32,33,34],prod:27,prod_:[1,5,7,30,31,32],produc:[0,3,4,5,6,9,10,11,12,13,21,22,23,25,28,29,30,31,33,34],product:[0,1,3,5,6,7,8,12,13,16,21,22,28,29,30,31,32,34],profess:[0,28],program:[0,1,4,5,6,8,12,14,15,16,21,22,24,25,26,28,29,34],programm:22,progress:[1,4,14,33],prohibit:[6,31],project1:[6,23],project:[0,1,2,3,5,11,13,17,18,19,20,21,24,26,29,30,31,33,34],project_root_dir:[0,6,7,9,28,29,31,32],projectwrit:23,promin:[12,34],promis:8,promot:[26,28],prone:9,pronounc:[13,21,28,33,34],proof:[0,11,12,13,28,31,32,33],propag:[2,3,13,33,34],proper:[0,2,6,7,23,31],properli:[1,6,8,10,13,23,33,34],properti:[0,1,3,12,13,16,17,22,28,31,33,34],proport:[0,1,5,9,11,13,16,25,28,29,33,34],propos:[1,4,6,10,23,28],propto:[5,13,30,31,32,33,34],proton:[0,28],prove:[3,13,32,33,34],provid:[0,1,3,4,5,6,8,9,10,12,13,15,21,22,23,25,28,29,30,31,32,33,34],proxi:[1,13,33,34],prune:9,pseudo:[22,25,33],pseudocod:23,pseudoinv:[5,30],pseudoinvers:[5,6,30],pseudorandom:[6,25,31],psycholog:[0,28],pt:[13,33],punish:[0,1,28],pure:[3,9,25],purest:9,puriti:9,purpos:[0,3,10,12,14,28,34],put:1,py:[0,1,2,3,4,5,6,7,8,9,11,14,28,30,31,32,34],py_tf:[3,4,14],pycod:28,pydata:21,pydot:9,pyhton2:28,pylab:[0,7,28,32],pypi:21,pyplot:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,22,23,25,28,29,30,31,32,33,34],pythagora:[5,30,31],python2:[0,15,23,28],python3:[0,2,3,4,6,7,8,9,11,14,15,21,23,28,30,32,34],python:[1,2,3,4,5,6,8,11,12,13,14,16,23,25,29,30,33,34],pytorch:[0,21,23,28],q:[5,6,8,11,25,29,31],qp:8,qquad:[2,11,13,22,33,34],qr:[5,6,22,29],quad:[1,13,22,33],quadrat:[0,8,9,13,15,16,28,33],qualit:[4,9,23,25],qualiti:[0,9,15,16,21,28,29],quantifi:1,quantil:10,quantit:[0,6,9,23,28,31],quantiti:[0,2,5,6,7,9,10,11,12,14,16,22,25,28,29,30,31,32],quantum:[4,12,27,28,34],quartil:[0,29],quench:5,queri:9,question:[0,5,6,9,11,12,13,23,26,28,29,30,31,33,34],qugan:4,quick:[4,25],quickli:[1,3,9,11,13,32,33],quit:[1,5,6,9,10,12,29,31,34],quot:4,r2:[0,5,6,28,29,30,32],r2_score:[0,28],r2score:[0,28],r:[0,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,21,22,23,25,29,30,31,32,33,34],r_1:9,r_2:9,r_j:9,r_m:9,rad:0,radial:[0,8,12,34],radioact:25,radiu:[0,1,9,29],rag:2,rain:9,rais:[0,2,3,4,7,14,30,32],ramp:1,ran0:25,ran1:25,ran2:25,ran3:25,rand:[0,4,5,6,9,10,13,15,16,22,28,29,30,31,32,33,34],randint:[6,9,13,31,33,34],randn:[0,1,2,5,6,9,11,13,15,16,28,29,30,31,32,33,34],random:[0,1,2,3,4,5,6,8,9,13,14,15,16,21,22,23,28,29,30,31,33,34],random_forest_model:10,random_index:[13,33,34],random_indic:[1,3],random_st:[0,7,8,9,10,11,32,34],randomforestclassifi:10,randomizedsearchcv:32,randomli:[1,6,9,13,14,31,32,33,34],randuniform:32,rang:[0,1,2,3,4,5,6,7,9,10,11,12,13,14,22,25,28,29,30,31,32,33,34],rangl:[0,6,11,25,28,29],rangle_x:25,rank:[5,29],rankdir:4,raphson:[1,8,13],rapidli:0,rare:[1,13,28,32,33,34],raschka:[28,29,30,31,32,33,34],rasckha:28,rate:[0,1,2,3,4,8,9,10,12,13,32],rather:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,22,25,28,29,30,31,32,33,34],ratio:[4,7,9,10,11,32],rational:[0,28],ravel:[5,6,7,8,9,10,11,13,22,29,31,32,33],raw:3,rbf:[8,11,12,34],rbf_kernel_svm_clf:8,rbf_pca:11,rc:[0,25],rc_temp:[0,7,32],rcond:[0,28,29],rcparam:[0,1,3,7,8,9,10,25,28,32],re:[2,4,13,32,33],reach:[1,4,5,6,9,10,11,12,13,14,30,31,32,33,34],read:[0,2,3,4,5,6,7,8,11,12,16,22,23,24,25,27,30,33],read_csv:[0,6,7,9,28,31,32],read_fwf:[0,28],reader:[0,6,22,25,28,29,30],readi:[0,1,5,6,8,10,11,12,22,23,28,30,31],readili:1,readthedoc:21,real:[0,1,2,4,7,10,11,12,22,29,31,32,34],real_loss:4,real_output:4,realist:8,realiti:25,realiz:[1,12,34],realli:[0,1,28],rearrang:[13,33,34],reason:[0,1,3,4,10,13,27,28,32,33,34],reassign:1,recal:[5,6,9,10,11,12,22,25,28,29,30,31,32,33],recast:3,receiv:[1,3,10,12,25,34],recent:[0,1,2,3,4,6,7,10,13,14,23,27,28,30,31,32,33,34],recept:[3,12,34],receptive_field:3,recip:[0,6,7,22,23,28,29,32],reciproc:[5,30],recogn:[0,4,5,10,28,30,31],recognit:[0,1,3,12,24,27,28,34],recommen:28,recommend:[0,2,3,4,5,6,8,13,15,18,21,22,23,27,30,31,33,34],reconsid:9,reconstruct:11,record:[10,23,24,26,28,33,34],rectangl:[9,13,32,33],rectangular:[5,29],rectifi:[1,3,12,34],recur:[0,21,28],recurr:[0,1,21,28],recurs:[9,21,22,28],red:[0,3,4,6,8,9,31,33,34],redefin:[0,10,28,29],redefinit:30,reduc:[1,2,3,5,6,9,10,11,13,28,30,31,32,33,34],reduct:[0,2,10,11,21,25,28,29],refer:[0,1,2,3,5,6,9,11,12,13,14,20,22,27,28,29,31,32,33,34],referenc:2,refin:[12,34],refit:[6,31],reflect:[0,1,4,5,23,25,28],refresh:[21,28],refreshprogrammingskil:28,reg:[10,11],regard:[1,9,13,33],regardless:[12,34],region:[3,4,6,9,12,23,34],regist:[6,23,25],reglasso:[5,30],regr_1:[0,9],regr_2:[0,9],regr_3:[0,9],regress:[1,8,11,12,15,16,21,22],regressor:[0,7,10,28,32],regridg:[0,5,6,30,32],regular:[0,3,4,5,6,7,9,13,17,26,28,29,30,31,33,34],regularis:6,reilli:[0,15,27,28],reinforc:[0,8,21,28],reiter:1,reject:7,rel:[0,4,6,7,9,12,13,25,28,29,31,32,33,34],relat:[0,1,3,4,5,11,13,14,22,25,28,30,31,33,34],relationship:[0,4,9,28],relativeerror:[0,28,29],releas:[1,21,28],relev:[0,1,5,7,11,15,21,23,25,28,30],reli:[0,6,8],reliabilti:23,reliabl:[7,25,32],relu:[3,4,28],remain:[1,2,4,6,12,22,25,29,30,31,32,34],remaind:25,reman:2,remark:1,rememb:[0,8,13,22,23,28,33,34],remind:[0,5,11,13,22,25,29,30,31],remov:[0,4,5,6,29,30],render:[0,9,28,29],reorder:[5,7,29,30,32],reorgan:[0,28],repeat:[0,1,3,4,5,6,9,10,11,13,14,22,23,25,28,30,31,32,33,34],repeated:28,repeatedli:[0,6,10,13,31,33,34],repet:3,repetit:[6,28,29,31,32,33],rephras:[13,32,33],replac:[0,1,3,4,5,6,10,12,14,15,16,21,23,28,29,30,31,32],replica:[6,31],repo:23,report:[20,28,33,34],reportexampl:[20,23],reportsampl:20,repositori:[0,4,23,28],repres:[0,1,2,3,4,5,6,7,8,9,10,12,13,25,28,29,30,31,32,33,34],represent:[0,1,3,6,9,25,28,31,32],representd:3,reproduc:[0,5,6,9,12,15,16,21,23,25,28,29],repuls:[0,28],request:[0,13,33,34],requir:[0,1,3,4,5,6,8,9,11,12,13,17,22,28,29,30,31,32,33,34],rerun:9,res1:2,res2:2,res3:2,res_analyt:2,res_analytical1:2,res_analytical2:2,res_analytical3:2,resaml:[6,23],resampl:[0,7,10,19,21,28,29,32,33],rescal:[0,11,12,29,34],rescu:[5,30,31],reseach:[6,23],research:[0,4,13,21,27,28,33,34],resembl:[6,25,31],reserv:[1,5,6,25,30,31],reshap:[0,1,2,3,4,6,8,9,10,15,16,22,28,29,31],residenti:0,residu:[0,5,13,28,33],resiz:[5,29],resourc:28,respect:[0,1,2,3,5,6,7,8,10,11,12,13,14,16,17,23,25,28,29,30,31,32,33,34],respond:[12,34],respons:[0,7,9,12,28,29,32,34],rest:[0,5,29],restat:[0,12,28],restor:4,restored_discrimin:4,restored_gener:4,restrict:[0,3,9,12,28,34],result:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,21,22,23,25,28,31,32,33,34],retail:0,retain:[5,6,29,31,32],rethink:31,retriev:28,return_data:14,return_sequ:4,return_x_i:9,reus:[1,3,6,18,19,20,23],reveal:[0,12,28,34],revers:[1,22],review:[21,22],revisit:14,revolut:28,reward:[0,4,28],rewrit:[0,3,5,6,7,8,10,11,12,13,19,22,23,25,30,32,33,34],rewritten:[2,6,8,10,25,31],rewrot:[13,32,33],rf:10,rgb:3,rgoj5yh7evk:21,rh:[6,31],rho:[0,10,13,28,33,34],rho_1:10,rho_2:10,rho_m:10,rich:[0,28],ride:9,rideclass:9,ridedata:9,ridg:[7,11,13,21,28],ridge_sk:6,ridgebeta:[5,30],ridgecv:32,right:[0,1,2,3,5,6,7,8,9,10,12,13,14,16,17,19,22,23,25,28,29,30,31,32,33,34],right_sid:2,rightarrow:[0,1,5,6,8,11,12,13,25,28,29,31,32,33,34],rigor:[0,28],ring:6,rise:[0,28],risk:[0,13,15,16,28,32,33,34],rival:4,river:0,rlm:28,rm:[0,25],rmse:0,rmsporp:[13,33,34],rmsprop:[1,3,4,13],rnd_clf:10,rng:25,rnn1:4,rnn2:4,rnn:[4,12,34],rnn_2layer:4,rnn_input:4,rnn_output:4,rnn_train:4,rntrick1:25,rntrick2:25,rntrick3:25,rntrick4:25,ro:[0,13,28,32,33,34],robert:[18,23,27],robust:[0,28],robustscal:[0,29],roc:[7,10],role:[0,2,5,6,8,21,28,29,30,31,32],roll:6,room:[0,26,28],root:[0,5,9,13,25,29,30,32,33,34],rot:28,rotat:[1,8,9,10],rotation_matrix:9,roughli:[1,3],round:[0,7,9,13,32,33,34],routin:[13,22,28,32,33],row:[0,1,2,5,6,9,11,22,28,29,30,31],row_stack:[],rr:[5,29],rrr:[5,29],rug:[13,32,33,34],rule:[0,1,5,6,13,23,28,29,30,31,33,34],run:[0,1,2,4,5,6,8,9,11,13,15,21,23,28,29,30,31,32,33,34],runtim:[1,6,14],runtimewarn:[1,6,31],rust:[0,15,21,22,28],rvert:1,rvert_2:1,s:[0,1,2,3,4,5,6,7,9,11,12,13,16,17,18,21,22,23,25,28,29,30],s_1:6,s_:[3,6],s_i:[6,7,32],s_j:6,s_k:6,saddl:[13,32,33,34],sai:[0,1,2,3,4,5,6,7,8,9,10,11,12,22,23,25,28,29,30,31,32],said:[6,9,13,32,33],sake:[0,5,7,11,28,29,30,32],sale:[0,28],sam:28,same:[0,1,2,3,4,5,6,8,9,11,12,14,17,22,23,25,28,29,30,32],samm:10,sampl:[0,1,2,3,4,5,6,7,8,9,10,13,14,15,16,19,21,22,23,25,28,29,30,31,32,33,34],sample_vari:14,sampleexptvari:25,samwis:28,sastri:11,satisfactori:[0,28],satisfi:[1,2,3,6,8,13,22,25,31,32,33],satur:[1,6,31],save:[0,4,6,7,9,13,28,29,31,32,33,34],save_fig:[0,6,7,9,10,28,29,31,32],savefig:[0,4,6,7,9,25,28,29,31,32],savetxt:4,saw:[5,29],scalabl:10,scalar:[2,5,6,10,29,30,31],scale:[0,1,3,5,6,7,8,9,10,11,12,13,15,16,17,21,22,23,26,28,30,32,33,34],scale_mean:4,scale_std:4,scaler:[0,7,8,9,10,11,23,29,30],scan:[5,7,30,31,32],scari:[5,30,31],scatter:[0,1,6,7,8,9,14,28,29,30,31,32,34],scenario:[6,13,32,33,34],schedul:[13,26,33,34],scheme:[1,13,32,33,34],schrage:25,scienc:[0,1,10,12,13,21,24,25,26,27,32,33,34],scientif:[0,15,21,23,28,33,34],scientist:[0,28],scikit:[3,5,6,8,9,10,13,21,22,23,24,27,34],scikit_learn:[0,16],scikitlearn:28,scikitplot:[7,10,32],scipi:[0,3,5,6,13,15,21,22,23,28,29,30,31,32,33],scl:6,score:[0,1,3,6,7,9,10,11,15,16,23,26,28,29,31,32,33,34],scores_kfold:[6,31,32],scratch:[1,13,34],sdg:[13,33,34],sdv4f4s2sb8:34,seaborn:[0,1,3,6,7,28,32],seamless:[0,15,21,23,28],search:[0,1,3,5,9,13,28,30,33,34],sebastian:28,sebastianraschka:28,sec:6,second:[0,2,3,4,5,6,7,8,9,11,12,14,15,16,21,22,23,25,26,28,29,31,32],second_mo:[33,34],second_term:[33,34],secondeigvector:11,secondli:12,section:[4,11,16,17,22,23,25,29,30,32,33,34],sector:0,see:[0,1,2,3,4,5,6,7,8,10,11,12,13,15,16,17,18,21,22,23,25,28,29,30,31,32,33,34],seed:[0,1,2,3,4,5,6,8,9,11,13,14,15,16,23,25,28,29,30,31,32,33,34],seed_imag:4,seek:[1,2,8],seem:[1,3,4,33,34],seemingli:[0,28],seen:[0,1,3,5,10,12,17,25,28],segment:[13,32,33],seismic:6,seldomli:[0,28],select:[1,5,6,8,9,10,11,17,23,24,25,26,27,28,29,30,31],self:[0,1,5,7,28,29,30,32,34],sell:4,semest:[7,24,32],semi:[8,13,32,33],semilogx:6,send:[5,12,13,26,28,33,34],senior:[24,26],sens:[0,4,6,8,23,28,31],sensibl:3,sensit:[0,5,6,9,13,28,29,30,31,34],sent:2,sentdex:34,sentenc:[4,12,34],separ:[0,1,2,4,6,8,9,12,14,15,21,23,25,28,31,34],septemb:[17,18,19,20,23,28],sequenc:[2,3,4,7,9,10,12,13,21,22,25,28,32,33,34],sequenti:[1,3,4,10,12,25,34],seri:[0,1,2,3,4,5,6,10,11,12,13,22,28,29,30,31,32,33,34],serif:[0,7,25,28,32],serv:[0,1,2,3,5,7,13,23,27,28,29,30,31,32,33,34],servic:23,session:[1,20,23,24,26,28],set:[1,4,5,6,7,8,10,11,13,14,16,17,21,22,23,25,26,30,31,33,34],set_major_formatt:[6,23],set_major_loc:[6,23],set_tick:[1,6,8],set_ticklabel:[1,6],set_titl:[0,1,2,3,7,12,14,28,32,34],set_xlabel:[0,1,2,3,7,12,28,32,34],set_xlim:[7,12,32,34],set_xticklabel:1,set_ylabel:[0,1,2,3,7,28,32],set_ylim:[7,12,32,34],set_ytick:[7,32],set_yticklabel:[1,6],set_zlim:[6,23],seth:4,setminu:[6,32],setosa:[8,9],setosa_or_versicolor:8,setp:[6,31],setup:[1,4,6,8,21,28,29],sever:[0,3,5,6,7,8,9,11,12,13,21,22,25,28,29,30,31,32,33,34],sgd:[1,3,32],sgd_clf:8,sgdclassifi:8,sgdreg:[13,32,33],sgdregressor:[13,32,33],sgn:[5,29,30],shallow:[13,33,34],shape:[0,1,2,3,4,5,6,7,8,9,10,11,13,14,15,16,22,28,29,30,31,32,33,34],shape_bas:[],share:[1,3,28],she:[7,32],shell:34,shift:[1,6,12,25,30,34],ship:3,shire:28,shortcom:[13,32,33,34],shorten:4,shorter:25,shorthand:[28,31],shortli:[22,28],should:[0,2,3,5,6,8,9,11,12,15,16,22,23,25,28,29,30,31],show:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,16,17,18,19,22,23,25,28,29,30,31,32,33,34],show_shap:4,shown:[0,4,5,8,9,11,12,13,22,29,32,33,34],shrink:[3,5,6,8,11,23,29,30],shrinkag:[5,6,29,30],shrunk:11,shuffl:[0,1,4,6,13,29,31,32,33,34],side:[0,2,5,8,12,13,22,28,30,31,32,33,34],sigh:[21,28],sigma0:25,sigma1:25,sigma2:25,sigma:[0,1,5,6,7,10,11,12,13,17,18,19,22,23,25,28,29,30,31,32,33,34],sigma_0:[5,29,30],sigma_1:[5,29,30],sigma_2:[5,29,30],sigma_:[5,22,28,29,30,31],sigma_fn:[7,12,32,34],sigma_i:[0,5,28,29,30],sigma_j:[5,17,29,30],sigma_m:[6,25,31],sigma_n:[11,25],sigma_t:[13,33,34],sigma_x:25,sigmoid:[1,2,4,7,8,10,12,32,33,34],sigmundson:[6,29,30],sign:[1,2,7,8,10,25,26,32,34],signal:[1,3,10,12,34],signifi:4,signific:1,significantli:[1,13,25,32,33,34],sigurd:28,sim:[4,5,6,13,18,23,25,30,31,33,34],similar:[0,1,2,3,4,5,6,7,8,9,10,11,14,17,21,22,23,28,30,31,32],similarli:[0,1,3,5,8,10,13,20,25,28,29,30],simpl:[1,2,3,5,6,7,8,10,11,12,14,15,16,17,19,21,22,23,25,31],simplepredict:10,simpler:[0,1,5,6,7,13,16,19,21,23,28,30,33,34],simplernn:4,simplest:[0,1,3,4,9,10,12,14,28,34],simpletre:10,simpli:[0,1,2,4,5,6,8,9,10,11,12,15,21,22,23,25,28,29,30,31,34],simplic:[2,5,6,7,8,9,10,11,12,14,29,30,32,34],simplicti:[5,29],simplifi:[0,6,9,15,21,23,28,29,30,31],simplist:[3,6,25,31],simul:[6,31],simultan:[6,31],sin:[0,1,2,3,4,9,12,13,22,28,33,34],sinc:[0,1,2,3,5,6,7,8,9,10,11,13,22,25,27,28,29,30,31,32,33,34],sine:[3,12,34],singl:[0,1,2,3,5,6,7,8,9,12,13,22,25,28,29,30,31,32,33],singular:[0,6,13,22,23,28,30,31,32,33],sinusoid:3,site:[0,2,3,4,6,7,8,9,11,14,23,24,28,30,32,34],situat:[0,4,5,7,13,25,28,29,32,33,34],six:[3,25],size:[0,1,2,3,4,5,6,8,9,10,11,13,22,23,25,28,30,31,32,33,34],sketch:10,ski:9,skill:0,skip:11,skl:[0,6,28,29,30],sklearn:[0,1,3,5,6,7,8,9,10,11,13,14,28,29,30,31,32,33,34],skplt:[7,10,32],sl:[6,30,32],slack:8,slice:[2,22,28],slide:[0,3,15,16,23,25,28,29,31,33],slight:[6,13,31,33,34],slightli:[1,2,3,5,6,7,10,25,29,30,31,32],slope:[8,11,12,34],slow:[0,2,8,13,29,32,33,34],slower:[5,22,28,29,30],slowest:22,slowli:12,slp:1,small:[0,1,2,3,5,6,8,9,10,11,12,13,21,22,23,25,28,29,30,31,32,33,34],smaller:[0,1,2,5,6,8,9,11,13,25,28,29,30,31,32,33,34],smallest:[0,4,14,15,16,28,32],smallest_row_index:14,smooth:[0,3,6,9,13,23,28,32,33],sn:[0,1,3,6,7,28,32],sne:11,sneak:28,so:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,16,18,19,21,22,23,25,26,28,29,30,31,32,33,34],soar:6,social:0,soft:[1,7,10,12,32,34],soften:8,softmax:[3,7,32],softwar:[0,8,15,21,22],sol:8,sole:[0,6,28],solid:[0,7,32],solut:[0,1,2,3,5,6,8,10,11,13,17,18,22,23,25,28,29,30,31,32,33,34],solution_ev:33,soluton:2,solv:[0,1,3,5,6,8,10,11,12,13,22,23,28,29,34],solve_expdec:2,solve_ode_deep_neural_network:2,solve_ode_neural_network:2,solve_pde_deep_neural_network:2,solveod:2,solveode_popul:2,solver:[2,7,8,9,10,11,22,28,32,34],some:[0,1,2,3,4,5,6,7,8,9,10,11,12,14,23,25,28,30,31,34],some_model:[6,29,30],somehow:4,someth:[0,1,3,4,7,9,11,23,25,28,29,32],sometim:[0,1,11,12,13,14,28,29,33,34],somewhat:34,soon:[22,26,29],sophist:[0,28],sopt:[13,33],sort:[5,6,9,11,25,29,31],sound:[3,5,30,31],sourc:[0,1,3,6,15,21,22,23,25,28,31],space:[0,1,4,5,8,9,11,12,13,14,25,29,30,31,32,33,34],span:[0,3,5,9,11,22,28,29],spare:1,spars:[3,6,22,28],sparse_mtx:[22,28],sparsecategoricalcrossentropi:3,sparsiti:10,spatial:[1,2,3,12,34],speak:25,special:[6,7,10,12,13,22,25,28,29,30,32,33],specif:[0,1,2,3,4,5,6,7,8,9,11,12,16,21,22,23,25,27,28,29,30,31,32,34],specifi:[0,3,5,6,7,9,11,13,14,23,25,28,30,31,32,33,34],specifici:[0,10,28],spectacular:3,spectral:1,speech:[0,1,3,4,12,34],speed:[1,2,4,13,33,34],spend:25,spent:23,sphere:[0,29],spin:6,spite:0,spline:8,split:[1,3,4,5,6,8,9,10,11,14,17,23,25,30,31,32],splite:0,splitter:[1,10],spontan:25,spot:3,spread:[0,11,25,28,29],springer:[18,23,27,28,31],spuriou:[13,33,34],sqquar:30,sqrsignal:3,sqrt:[0,3,4,5,6,8,10,11,13,17,25,29,30,31,33,34],squar:[1,2,3,4,7,8,9,11,13,14,15,16,17,19,21,22,25,31,32,33,34],squarederror:10,squaredeuclidean:14,squash:[12,34],srtm:[6,23],srtm_data_norway_1:[6,23],stabil:[5,23],stabl:[0,4,5,6,9,11,21,23,28,29,30],stack:[3,4],stage:[5,13,23,33,34],stai:[0,2,4,5,11,17,28,29],stand:[0,5,9,12,28,29,30,34],standadscal:29,standard:[0,1,4,5,6,7,8,10,12,15,16,17,19,22,23,25,28,30,32,34],standard_basi:[],standardscal:[0,6,7,8,9,10,11,29,30],stanford:[13,32],start:[0,1,2,3,4,5,6,8,9,10,11,12,13,14,20,22,25,26,28,29,31,32,33],start_box:[],start_nod:[],start_tim:14,starting_point:34,stat:[6,31,32],state:[1,2,4,5,6,7,8,10,11,12,13,21,25,29,30,31,32,33,34],statement:[0,7,22,28,32],stationari:[32,33],statist:[0,1,3,4,7,9,10,11,12,13,14,18,22,23,24,27,29,32,33,34],statu:[0,7,9,11,28,32],stavang:[6,23],std:[0,4,6,28,29,31],steep:[13,32,33,34],steepest:34,step:[0,1,2,4,6,7,9,10,11,12,13,14,22,23,28],step_fn:[7,12,32,34],step_length:[13,33,34],step_siz:33,steps_list:9,stereo:3,still:[0,2,3,5,6,11,13,17,25,31,32,33,34],stimuli:[12,34],stk2100:[27,28],stk3155:[15,23,24,26],stk4021:[27,28],stk4051:[27,28],stk4155:[24,26],stk5000:27,stk:[27,28],stochast:[0,1,5,6,8,11,12,15,16,23,28,30,31,32],stock:4,stoke:[12,34],stone:[0,7,23,32],stop:[1,4,9,11,13,14,32],stopiter:[0,7,32],storag:[5,29],store:[0,1,2,3,6,11,13,23,25,28,33,34],storehaug:[26,28],str:[1,3,4],straight:[0,6,8,13,28,31,32,33],straightforward:[0,2,3,5,6,8,9,10,13,22,28,29,30,31,32,33],strategi:[0,1,9,28],stratifi:[6,31],strength:[0,5,14,29],stretch:11,strict:[8,13,32,33],strictli:[8,13,32,33],stride:[4,22],strike:6,string:1,stroke:[7,32],strong:[3,6,9,10,12,22,25,31,34],strongli:[0,8,21,22],stronli:0,structur:[0,1,2,3,6,9,10,12,21,28,31,32,33,34],stuck:[1,13,32,33,34],student:[0,23,24,26,27,28],studi:[0,3,4,5,6,7,8,11,12,13,17,19,21,23,27,28,29,30,33,34],studier:27,style:[0,7,9,22,28,32],sub:[9,12,34],subarg:[],subdivid:[0,22,28],subfield:0,subject:[6,8,25],submit:28,subplot:[0,1,3,4,6,7,8,9,10,14,28,31,32],subplots_adjust:[8,25],subprogram:[22,28],subract:[0,29],subroutin:[0,28],subscript:1,subsequ:[1,4,5,6,12,22,25,29,31,34],subset:[1,6,9,12,13,21,28,31,32,33,34],subspac:[0,8,11,29],substanti:[9,10],substep:11,substitut:[3,6,12,22,31,34],subsubset:9,subtask:6,subtl:1,subtract:[0,4,5,6,11,13,17,22,23,25,30,31,33,34],subtre:9,subval:[],succeed:[0,4,28],success:[3,7,9,13,25,32,33],successfulli:[4,9],sudo:[0,15,21,23,28],suffer:[0,1,2,5,10,28,29,30],suffici:[1,6,8,11,13,31,32,33],suggest:[1,13,23,27,33],suit:[8,12,34],suitabl:[0,25,29],sum:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,22,23,25,28,29,30,32,33,34],sum_:[0,1,2,3,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,22,23,25,28,29,30,31,32,33,34],sum_i:[0,2,5,6,8,13,17,19,23,29,30,31,33,34],sum_j:6,sum_ja_:0,sum_k:[6,8,12,22],sum_logist:[13,33],sum_m:3,sum_n:3,sum_nx_:3,summar:[5,6,9,30,31,32,34],summari:[1,3,4,10,24,30],summat:[0,3,16,29],sunni:9,superconduct:30,superfici:3,superscript:[1,12,34],supervis:[0,5,6,7,9,12,21,28,29,31,32,34],supplement:[7,23,32],support:[0,1,9,10,11,13,21,28,29,33],suppos:[0,5,6,7,8,10,11,12,13,22,28,29,30,31,32,33,34],suppress:[5,8,13,30,33,34],sure:[0,1,4,6,23],surf:[6,23],surfac:[0,6,23,28],surpass:6,surpris:[0,28],surround:[3,21],survei:[0,5,6,28,29,30,31],svc:[8,9,10],svd:[0,6,11,17,28,31],svdinv:[5,30],svm:[8,9,10,11],svm_clf:[8,10],swath:[5,29],sy:[13,32,33],symbol:[1,3,4,5,11,13,14,21,25,28,29,30,33,34],symmeteri:1,symmetr:[0,5,8,11,12,13,22,28,29,33,34],symmetri:[6,9],sympi:[0,15,21,23,28],synonim:25,syntax:13,syntaxerror:8,system:[0,1,3,4,6,7,9,10,12,13,15,21,22,23,28,32,33,34],systemat:[4,6,31],t0:[3,6,13,33,34],t1:[2,13,33,34],t2:2,t3:2,t:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,21,22,23,25,26,28,31,32,33,34],t_0:[2,9,13,33,34],t_1:[13,33,34],t_:2,t_b:10,t_i:[1,2,5,12,29],t_j:12,t_k:9,tabl:[9,23,25,26,28,34],tabul:[0,28],tabular:28,tackl:4,tag:[2,3,4,5,6,7,12,13,14,22,25,29,32,33,34],taht:[0,28],tail:25,tailor:[2,8,11,28],taiwan:[0,28],take:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,16,21,22,25,28,29,30,31,32,33,34],taken:[0,1,3,6,10,13,22,28,31,33],tan:3,tangent:[1,4,12,13,32,33,34],tanh:[1,4,7,8,12,32,33,34],target:[0,1,2,3,4,5,6,7,8,9,10,11,12,28,29,30,31,32,33,34],target_iscomplex:2,target_meta:2,target_nam:9,target_ndim:[],target_shap:2,task:[0,1,3,6,9,11,12,14,20,23,28,31,34],tau:[3,5,25,30,31],taught:28,tax:0,taylor:[2,13,32,33],taylornr:[13,32,33],tba:[],tc:8,td:[1,6,28,31],teach:28,team:1,teaser:0,technic:[0,5,6,13,15,23,28,29,33,34],techniqu:[0,1,8,10,13,21,25,27,28,29,31,32,33,34],technolog:[0,1],tell:[0,4,6,10,11,13,25,31,33,34],temp1:1,temp2:1,temp:1,temperatur:[0,9,28],temporarili:1,ten:[3,17,28],tend:[3,5,6,8,9,10,12,13,14,29,30,31,33,34],tendenc:[0,28],tension:[6,31],tensor:3,tensordot:[],tensordot_adjoint_0:[],tensordot_adjoint_1:[],tensorflow:[0,2,4,8,14,15,21,22,23,24,27,28,29],term1:[5,6,11,23,29],term2:[5,6,11,23,29],term3:[5,6,11,23,29],term4:[5,6,11,23,29],term:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,19,23,25,28,29,30,32,33,34],termin:[0,4,5,9,10,13,15,28,29,33,34],terrain1:[6,23],terrain:[6,23],test:[3,4,5,6,7,8,9,10,13,17,19,22,23,25,31,32,33,34],test_acc:3,test_accuraci:[1,3],test_error:6,test_imag:[3,4],test_ind:[6,31,32],test_input:4,test_label:[3,4],test_loss:3,test_pr:1,test_predict:1,test_rnn:4,test_scor:[7,10,32],test_siz:[0,1,3,5,6,10,28,29,30,31,32],test_split:9,tester:30,testerror:[0,6,29,31],testi:4,testpredict:4,testx:4,text:[0,1,2,4,5,8,9,11,13,15,22,25,27,29,31,32,33,34],textbook:[16,17,23,29,31],textual:9,textur:[1,9],tf:[1,3,4,13,14,32,33],tf_loadlibrari:[3,4,14],th:[0,1,2,5,6,7,9,12,13,14,15,16,22,23,25,28,29,30,31,32,33,34],than:[0,1,2,3,4,5,6,7,9,10,11,12,13,17,21,25,28,29,30,31,34],thank:[4,6,29,30],theano:[1,21,28],thei:[0,1,2,3,4,5,6,7,8,9,11,12,13,22,23,25,28,29,30,31,32,33,34],them:[0,1,3,4,6,8,9,10,11,12,13,22,23,28,29,30,33,34],theme:[0,28,33],themselv:[0,25,28],thenc:[6,31],theorem:[2,6,7,29,32,34],theoret:[0,4,10,28],theori:[0,1,3,8,9,12,13,18,21,23,27,28,30,33,34],thereaft:[0,5,6,11,12,15,16,17,22,23,28,31],therebi:[0,5,7,11,28,29,30,32],therefor:[0,1,2,3,4,6,7,8,11,13,25,28,29,31,32,33,34],therein:11,thereof:[0,6,13,28,31,33,34],theta:[1,4,13,25,33,34],theta_:[1,13,33,34],theta_i:1,theta_linreg:[13,33,34],theta_t:[13,33,34],thetaand:34,thetaor:34,thetaxor:34,thi:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,21,22,23,24,25,27,29,30,31,32,33,34],thing:[0,1,2,4,5,7,9,25,28,30,31,32],think:[0,1,3,4,6,9,12,13,14,25,28,31,32,33,34],third:[0,3,6,13,26,28,32,33,34],thirti:[7,32],thorughout:28,those:[0,3,5,6,8,9,10,11,22,23,24,28,29,31],though:[1,2,3,4,13,22,25,33,34],thought:[6,14,23,25,31],thousand:[0,1,23,29,33,34],three:[0,1,3,5,6,8,9,12,15,22,23,24,25,26,28,29,30,31,32,34],threshold:[1,3,9,10,11,12,13,33,34],through:[0,1,2,3,4,5,6,8,11,12,13,14,21,22,25,28,29,30,31,32,33,34],throughout:[0,4,5,14,21,22,25,28],thu:[0,1,2,5,6,7,8,10,11,12,13,23,26,28,29,30,31,32,33,34],thumb:[0,6,23,28,29],thursdai:[26,29],tibshirani:[6,18,23,24,27,28,31],tick:6,tick_param:6,ticker:[6,13,23,25,32,33],tif:[6,23],tight_layout:[1,7,32],tightli:11,tild:[0,5,6,7,11,15,16,17,18,19,23,25,28,29,30,31],till:[0,4,7,8,9,10,12,22,28,29,30,32],time:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,16,17,21,22,23,25,28,29,30,31,32],timeit:4,timer:4,tini:1,tip:3,titl:[0,1,2,3,4,6,7,8,9,10,13,23,25,28,31,32,33,34],tmp:[13,33,34],tn:[2,3,7],to_categor:[1,3,4],to_categorical_numpi:1,to_numer:[0,6,28,31],todai:3,togeth:[0,3,6,8,11,13,21,28,33,34],toi:[14,33,34],told:[13,33],toler:[2,6,14],tolist:4,tomographi:[12,34],too:[0,2,4,5,6,9,11,13,15,25,27,28,29,31,32,33,34],took:[8,28],tool:[0,1,3,6,13,21,29,31,33,34],toolbox:8,top:[0,3,5,6,9,10,18,21,28,30,31],topic:[0,5,6,7,8,21,23,29,30,32],topograph:23,topolog:[1,3,12,34],toposort:2,torkjellsdatt:[26,28],toss:[10,25],total:[0,1,2,3,4,6,7,8,9,10,11,12,13,14,15,16,22,25,26,28,29,31,32,33],total_loss:4,totalclustervari:14,totalscatt:14,toward:[1,2,7,12,13,23,32,33],towardsdatasci:[33,34],town:0,tp:[4,7],tpng:9,tpu:[13,21,28,33,34],tqdm:6,tr:29,trace:2,trace_stack:[],traceback:[0,1,2,3,4,6,7,10,13,14,23,28,30,32],tracer:2,track:[3,13,14,22,29,32,33,34],tract:0,tractabl:[0,28,29],trade:[5,9,19,30,31],tradeoff:[0,5,19,23,28,29,30,32],tradit:[0,1,4,6,28,31],train:[2,3,5,6,8,9,10,11,12,13,17,19,23,30,31,32,33,34],train_accuraci:[0,1,3,28],train_dataset:4,train_end:[0,1,29],train_error:6,train_imag:[3,4],train_ind:[6,31,32],train_label:[3,4],train_pr:1,train_siz:[0,1,3,29],train_step:4,train_test_split:[0,1,3,5,6,7,9,10,11,28,29,30,31,32],train_test_split_numpi:[0,1,29],trainable_vari:4,trained_model:[6,29,30],trainerror:[0,29],traini:4,training_checkpoint:4,training_dataset:4,training_gradi:[13,33,34],training_gradient_fun:[33,34],training_loss:[33,34],trainingerror:[6,31],trainpredict:4,trainscor:4,trainx:4,trait:[0,28],trajectori:4,trajectory_i:34,trajectory_x:34,transfer:9,transform:[0,5,6,7,8,9,10,11,12,13,21,22,28,29,30,31,32,33,34],transit:[6,12,34],translat:[1,4,6,10,28,29,30],transpos:[1,5,11,22,29,30],travers:[0,5],treat:[0,1,3,6,12,13,25,28,29,30,31,32,33,34],tree:[0,1,6,21,23,28],tree_clf:[9,10],tree_clf_:9,tree_clf_sr:9,tree_reg1:9,tree_reg2:9,tree_reg:9,trend:25,treue:7,trevor:[18,23,27],tri:[2,3,4,9,13,32,33],triain:0,trial:[0,2,4,6,13,25,28,31,32,33],triangl:[13,32,33],triangular:22,trick:[3,4,8,11,13,25,33,34],trickier:25,tridiagon:22,trigger:[0,7,32],trillion:21,trivial:[0,1,5,11,25,28,30],troubl:[0,8,12,29],truck:3,true_beta:[6,29,30],true_divid:1,true_fun:[6,31],truncat:34,trust:9,tucker:8,tuesdai:[26,28,31,32,33],tumor:[7,9,32],tumour:[7,32],tunabl:1,tune:[4,9,13,22,28,32,33,34],tup:[],tupl:2,turn:[0,1,5,6,7,8,9,10,11,12,13,19,22,23,25,28,29,31,32,33,34],tutori:[1,4],tv:2,tveito:2,tvw1zdmznwm:34,tweak:[1,4,10,25],twice:[13,32,33],twist:11,two:[0,1,2,4,5,6,7,9,10,11,12,13,15,16,22,24,25,27,28,30,31,33,34],tx:[13,32,33,34],tx_1:[13,32,33],txt:4,ty:[13,32,33],type:[0,1,3,6,8,10,13,16,22,23,25,29,30,31,32,33],typeerror:[2,6,13],typic:[0,1,2,3,4,5,7,9,10,12,13,25,28,29,30,31,32,33,34],typo:23,u:[0,2,5,6,8,10,11,12,17,22,28,29,30,34],u_:22,u_i:[12,34],u_m:10,ua:[0,28],ubuntu:[0,15,21,23,28],uci:0,ufunc:2,uio:[23,26,27],un:14,unabl:9,unari:[22,28],unary_f:2,unary_oper:2,unary_to_nari:2,unbalanc:[6,9,31,32],unbias:[0,5,6,28,30,31],unbroadcast:2,unbroadcast_f:2,uncent:[6,30],uncertainti:[0,5,28,30,31],uncertitud:25,unchang:[1,3],uncorrel:[10,25],undefin:[5,29],under:[0,1,5,6,10,13,15,16,21,23,28,29,30,31,32,33],underdetermin:[0,28],underfit:[1,6,31],underflowproblem:[5,30,31],undergo:[5,30,31],undergradu:[24,26],underli:[0,1,9,13,25,28,33,34],underset:[4,14],understand:[0,1,3,5,6,10,13,14,21,28,29,30,32,33,34],understood:[8,13,33,34],undesir:8,undetermin:[5,8,30,31],undo:4,unexpect:[6,13,31],unexpected:25,unfair:[6,29,30],unfortun:[1,8,9,10],unicode_liter:[8,9],uniform:[0,1,5,6,11,13,15,16,23,25,28,29,32,33],uniformli:[13,25,32,33,34],unifrompdf:25,unimport:[13,32,33],union:[5,6,30,31,32],uniqu:[0,2,6,13,14,22,28,31,32,33],unique_cluster_label:14,unit:[0,1,3,4,5,10,12,25,28,29,30,34],unitari:[5,6,22,29],unitarili:[22,28],uniti:25,univari:25,univers:[0,1,2,13,15,21,23,24,26,28,29,30,31,32,33,34],unix:1,unknow:[0,22,28],unknown:[0,1,3,4,5,6,8,10,13,16,22,28,29,30,31,33,34],unknowwn:12,unlabel:1,unless:[0,3,6,11,13,23,28,31,32,33],unlik:[1,3,8,13,32,33,34],unnecessarili:9,unord:3,unravel:1,unrol:[3,11],unseen:[0,7,9,32],unstabl:1,unsupervis:[0,1,4,12,21,28,34],unsymmetr:[22,28],until:[1,2,4,9,12,13,14,32,33,34],untouch:0,unusu:[12,34],up:[1,3,4,5,6,8,10,11,13,14,16,18,21,22,23,25,26,30,33],updat:[1,2,10,12,13,14,33,34],uploa:28,upload:[21,23,27],upon:[0,1,6,7,11,22,23],upper:[0,8,9,16,22,29],uppercas:[22,28],upsampl:4,upscal:4,url:[0,7,28,29,32,34],us:[4,5,6,8,9,10,11,12,14,15,16,17,18,19,22,24,25,27,30,31],usa:[28,34],usag:[0,8,21,28,29,34],usd10000:0,usd:0,use_bia:4,usecol:[0,28],useless:1,user:[0,1,2,3,4,6,7,8,9,11,14,15,21,22,23,28,29,30,32,34],usernam:23,userwarn:[6,34],usetex:25,usg:[6,23],usr:25,usual:[0,3,4,7,12,13,14,28,32,33,34],ut:[5,30],utf:[0,7,32],util:[1,3,4,6,7,10,14,28,31,32],ux:22,v0:25,v1:25,v2:25,v8xr:34,v:[2,4,5,6,11,13,17,21,29,30,33,34],v_0:11,va:1,vahid:28,val:[13,33,34],val_accuraci:3,val_loss:4,vale:2,valid:[0,1,4,7,9,10,13,21,25,28,29,33,34],validation_data:3,validation_split:4,valu:[0,1,2,3,4,6,7,8,9,10,12,13,14,15,16,19,21,22,23,28,33,34],valuat:9,valueerror:[],valy:4,van:[0,18,23,28,29,30,31],vandenbergh:[8,13,32,33],vandermond:[0,28],vanilla:[0,6,11,14,29,30],vanish:[1,4,13,25,32,33],var_x:25,varabl:8,varepsilon:[5,6,18,23,30,31],varepsilon_:[5,6,30,31],varepsilon_i:[5,6,30,31],vari:[0,1,3,5,6,10,15,16,28,31],variabl:[0,1,2,5,6,7,8,10,11,12,13,14,22,28,29,30,31,34],varianc:[0,1,5,7,9,10,11,13,14,18,19,21,22,25,28,29,32,33,34],variance_i:[5,11,29],variance_x:[5,11,29],variant:[0,1,6,8,12,13,28,29,32,33,34],variat:[3,4,11,28],varieti:[0,3,12,15,21,23,28,34],variou:[1,3,5,6,7,8,9,11,12,13,16,18,21,22,23,25,29,30,33,34],varydimens:4,vastli:3,vaue:1,vault:0,vdot:[2,13,32,33],ve:23,vec:[6,31],vector:[0,1,2,3,4,5,6,7,9,10,11,13,14,16,17,21,30,31,32,33],vector_mean:14,ventur:[0,8,15,21,28],verbos:[1,3,4],veri:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,23,25,27,28,29,30,31,32,33,34],verifi:[3,11,22,28],versatil:[8,28],versicolor:[8,9],version:[0,3,10,13,14,15,21,22,23,25,28,33],versu:1,vert:[0,1,5,6,7,8,9,11,13,17,28,29,30,31,32,33],vert_1:[5,6,29,30,31],vert_2:[5,6,11,17,29,30,31],via:[0,5,6,7,8,9,10,11,12,15,19,21,22,23,24,25,26,28,29,30,31,32,34],vidal:11,video:[0,1,12,21,24,26,28,29,30,31],view:[1,3,5,6,12,13,25,27,28,30,31,33,34],violat:8,virginica:9,viridi:[0,1,2,3,28],virtual:1,viscos:[13,33,34],viscou:[13,33,34],visibledeprecationwarn:2,vision:[0,3],visual:[0,3,11,12,15,21,28,29,34],visualis:1,viz:[6,8,25],vjp:2,vjp_argnum:2,vjpfun:2,vjpmaker:[],vjpnode:[],vmap:[13,33],vmax:[1,6],vmh0zpt0tli:34,vmin:[1,6],voic:3,volum:[0,3,28],vote:10,voting_clf:10,votingclassifi:10,votingsimpl:10,vs:[0,4,6,33],vspace:2,vstack:[5,11,22,25,28,29],vt:[5,29,30],w1:8,w2:[8,11],w3:8,w:[0,1,2,3,4,5,6,7,8,10,11,12,13,14,22,25,28,29,31,32,33,34],w_1:[8,22],w_1x_1:8,w_1x_:8,w_2:[8,22],w_2x_2:8,w_2x_:8,w_3:22,w_4:22,w_:[1,12,34],w_hidden:2,w_i:[1,2,10],w_ix_i:[12,34],w_j:22,w_m:22,w_output:2,w_px_:8,w_px_p:8,wa:[0,1,3,4,5,6,7,10,11,12,14,17,22,23,28,29,30,31,32,34],wai:[0,1,2,3,4,5,6,7,8,10,11,12,13,14,17,22,25,28,29,30,32,33],walk:9,walker:25,wang:[0,28],want:[0,1,2,3,4,5,6,8,9,10,11,12,13,14,15,16,17,21,23,25,28,29,30,31,32,33,34],warn:[4,8],warrant:[6,31,32],wast:[3,33,34],watch:[21,34],wave:3,wavelet:8,we:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,21,22,23,24,25,26,27,29,30,31,32],weak:[9,10,14],weather:[1,12,34],web:[21,24,26,28],webpag:28,websit:[6,22,23,24,28],wedg:[8,25],wednesdai:[26,28,31,32,33],wee:11,week:[0,5,6,7,23,24,26],weekli:[16,21,23,26,27,28,34],weight:[0,1,2,3,6,7,9,10,12,13,23,25,32,33,34],weigth:2,welchlab:34,welcom:[8,21],well:[0,1,2,3,4,5,6,7,8,9,10,12,13,15,16,19,20,21,22,23,25,27,28,29,30,31,32,33,34],went:8,were:[0,1,3,4,5,6,7,8,10,11,12,14,25,28,29,31,32,34],wessel:[0,18,23,28,29,30,31],what:[1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,19,21,22,23,25,32,33,34],whatev:3,when:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,16,17,18,22,23,25,28,29,30,31,32],whenev:[13,25,33,34],where:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,21,22,23,25,26,28,29,30,31,32,33,34],wherea:[6,25,31],wherefrom:23,wherein:[1,12,34],whether:[0,3,5,7,9,23,25,28,30,32],which:[0,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,21,22,23,24,25,26,28,29,30,31,32],whichev:[1,3],white:9,whiteboard:[30,31,32,33,34],who:[0,24],whole:[1,3,4,5,9,11,13,30,31,33,34],whose:[0,6,10,25,29,31],whow:[11,29],why:[0,1,3,6,13,23,30,32,33],wide:[0,1,3,6,7,12,15,21,22,23,28,31,32,34],widehat:[6,31],width:[0,3,8,9,28],wieringen:[0,18,23,28,29,30,31],win:10,wind:9,wing:[26,28],winther:2,wiothout:[6,29],wiscons:[7,32],wisconsin:10,wisdom:[6,30],wise:[0,1,5,12,13,29,33,34],wish:[0,2,5,7,8,11,13,14,22,23,28,29,32,33],with_std:[0,29],wither:6,within:[0,2,3,4,7,9,12,13,14,25,27,28,32,33],withinclust:14,without:[0,1,5,6,8,9,11,12,13,28,29,30,31,33,34],wo5dmep_bbi:34,won:[0,28],wonder:8,word:[0,1,3,4,5,6,7,14,25,28,29,30,31],work:[0,1,4,6,7,8,9,13,15,21,23,24,25,26,28,29,31,32,33,34],workshop:28,world:[0,8,29],worldwid:[0,28],wors:[0,1,3,4,6,28,31],worst:9,worth:9,worthi:23,would:[0,1,3,5,6,7,8,9,10,11,12,13,22,23,25,28,29,30,31,32,33,34],wrap:[6,22,28],wrap_util:2,write:[0,1,2,3,5,6,7,8,12,13,15,16,17,20,22,28,29,31,32,33,34],written:[0,2,3,5,11,12,13,16,21,22,23,25,28,29,30,31,32,33,34],wrong:[1,8],wrongli:10,wrote:[5,11,29],wrt:[2,10,13,33,34],wth:[10,13,33,34],www:[21,22,23,27,28,30,34],wx_1:8,x0:8,x1:[4,8,9,10,13,33,34],x1_exampl:8,x1d:8,x2:[8,9,10,13,33,34],x2d:[8,11],x2d_train:11,x2dsl:11,x3:[8,9],x4:9,x:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,22,23,25,28,31,32,33,34],x_0:[0,5,11,22,28,29,30,31],x_1:[0,2,5,6,7,8,9,10,11,13,22,25,28,29,30,31,32,33,34],x_2:[0,2,5,6,7,8,9,10,11,13,22,25,28,29,31,32,33,34],x_3:[8,22,25],x_4:22,x_:[0,2,3,5,6,8,10,11,13,14,18,22,23,25,28,29,30,31,32,33],x_center:11,x_data:1,x_data_ful:1,x_hidden:2,x_i:[0,1,2,5,6,7,8,9,10,11,12,13,14,17,22,25,28,29,30,31,32,33,34],x_input:2,x_ix_:[0,28],x_iy_i:8,x_j:[0,2,8,9,12,16,25,29,34],x_jy_j:8,x_k:[12,14,22,25,29,34],x_l:25,x_m:[6,12,22,25,31,34],x_n:[0,2,3,6,8,11,12,13,22,25,28,31,32,33,34],x_new:[9,10],x_offset:[6,29,30],x_output:2,x_p:[3,7,9,32],x_poli:9,x_poly10:9,x_pred:4,x_prev:2,x_reduc:11,x_scale:8,x_small:[13,33],x_test:[0,1,3,5,6,7,9,10,11,28,29,30,31,32],x_test_own:6,x_test_scal:[0,6,7,9,10,11,29,30],x_tot:4,x_train:[0,1,3,4,5,6,7,9,10,11,28,29,30,31,32],x_train_mean:[6,29,30],x_train_own:6,x_train_scal:[0,6,7,9,10,11,29,30],x_val:1,xarrai:[21,28],xavier:1,xbkjd4ccgq:28,xbnew:[13,32,33],xcode:[0,15,21,23,28],xdclassiffierconfus:10,xdclassiffierroc:10,xg_clf:10,xgb:10,xgbclassifi:10,xgboost:9,xgboot:10,xgbregressor:10,xgparam:10,xgtree:10,xi:[8,13,33,34],xi_1:8,xi_:8,xi_i:8,xinv:[30,34],xk:8,xla:[13,21,28,33,34],xlabel:[0,1,2,3,4,5,6,7,8,9,10,13,23,25,28,30,31,32,33,34],xlim:[6,10,31],xm:9,xmesh:[13,33],xnew:[0,13,28,32,33,34],xp:25,xpanda:[0,29],xpd:[5,11,29],xplot:0,xs:9,xscale:[0,29],xsr:9,xt_x:[13,32,33,34],xtest:[6,31,32],xtick:[3,6,8,9,31],xtrain:[6,31,32],xu:[0,28],xx:[0,22,28],xy:[0,6,8,22,23,28],xytext:8,xz:[22,28],y1:4,y2:4,y3:4,y:[0,1,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,22,23,25,28,29,30,31,32,33,34],y_0:[0,5,11,22,28,29,30,31],y_1:[0,5,8,9,11,13,22,28,29,30,31,32,33],y_1y_1:8,y_1y_1k:8,y_1y_2:8,y_1y_2k:8,y_1y_n:8,y_1y_nk:8,y_2:[0,5,8,9,11,22,28,29],y_2y_1:8,y_2y_1k:8,y_2y_2:8,y_2y_2k:8,y_3:[0,9,22],y_4:22,y_:[0,1,5,6,10,11,22,28,29,30,31],y_data:[0,1,5,6,28,29,30,32],y_data_ful:1,y_decis:8,y_fit:[0,29],y_i:[0,1,5,6,7,8,9,10,11,12,13,15,16,17,18,19,22,23,28,29,30,31,32,33,34],y_if_:10,y_ix_:[0,28],y_ix_i:[7,8,13,29,32,33],y_iy_jk:8,y_j:[6,8,12,19,23,31,34],y_k:[12,34],y_m:22,y_model:[0,4,5,6,28,29,30,32],y_n:[8,13,32,33],y_ny_1:8,y_ny_1k:8,y_ny_2:8,y_ny_2k:8,y_ny_n:8,y_ny_nk:8,y_offset:[6,29,30],y_plot:9,y_pred1:9,y_pred2:9,y_pred:[0,1,4,6,7,8,9,10,29,30,31,32],y_pred_rf:10,y_pred_tre:10,y_predict:34,y_proba:[7,10,32],y_scaler:[6,30],y_test:[0,1,3,4,5,6,7,9,10,11,28,29,30,31,32],y_test_onehot:1,y_test_predict:0,y_tot:4,y_train:[0,1,3,4,5,6,7,9,10,11,28,29,30,31,32],y_train_mean:[6,29,30],y_train_onehot:1,y_train_predict:0,y_train_scal:[6,30],y_val:1,yand:34,ye:[3,6,7,31,32],year:[0,21,28],yet:[0,1,6,8,11,13,28,32,33],yi:[13,33,34],yield:[0,2,5,6,7,8,10,12,13,14,22,25,28,30,31,32,33,34],yk:8,ylabel:[0,1,2,3,4,5,6,7,8,9,10,13,23,25,28,30,31,32,33,34],ylim:[3,6,31],ym:9,ymesh:[13,33],yn:0,yo:[8,9,10],yor:34,yoshua:[1,27],you:[0,1,2,3,4,5,6,8,9,10,11,13,15,16,17,19,20,21,22,23,25,26,27,28,29,30,31,32,33,34],young:0,your:[1,2,4,5,6,8,11,13,17,19,20,21,22,23,30,31,32,33,34],yourself:[11,13,28,33],youtu:[32,34],youtub:[21,34],ypred:[6,31,32],ypredict2:[13,32,33,34],ypredict:[0,13,28,29,32,33,34],ypredictlasso:[5,30],ypredictol:[0,5,30],ypredictown:[6,29,30],ypredictownridg:[6,30],ypredictridg:[0,5,6,30,32],ypredictskl:[6,29,30],yridg:28,ys:9,ytest:[6,31,32],ytick:[3,6,8,9,31],ytild:[0,6,28,29,31],ytildelasso:[5,30],ytildenp:[0,28,29],ytildeol:[0,5,30],ytildeownridg:[6,30],ytilderidg:[5,6,30],ytrain:[6,31,32],yuxi:28,yx:[22,28],yxor:34,yy:[22,28],yz:[22,28],z:[0,1,2,3,4,5,6,7,8,9,11,12,13,22,23,25,28,29,31,32,33,34],z_0:[22,28],z_1:[22,28],z_2:[22,28],z_:[1,2,12,22,28],z_c:1,z_h:1,z_hidden:2,z_i:[1,12,34],z_j:[1,12],z_k:[12,29],z_m:1,z_mod:9,z_o:1,z_output:2,zaman:25,zaxi:[6,23],zero:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,17,18,19,22,23,25,28,29,30,31,32,33,34],zeros_lik:4,zeroth:29,zfill:4,zip:[2,4,6],zm_h:[0,28],zn:0,zone:0,zoom:28,zx:[22,28],zy:[22,28],zz:[22,28]},titles:["3. Linear Regression","14. Building a Feed Forward Neural Network","15. Solving Differential Equations with Deep Learning","16. Convolutional Neural Networks","17. Recurrent neural networks: Overarching view","4. Ridge and Lasso Regression","5. Resampling Methods","6. Logistic Regression","8. Support Vector Machines, overarching aims","9. Decision trees, overarching aims","10. Ensemble Methods: From a Single Tree to Many Trees and Extreme Boosting, Meet the Jungle of Methods","11. Basic ideas of the Principal Component Analysis (PCA)","13. Neural networks","7. Optimization, the central part of any Machine Learning algortithm","12. Clustering and Unsupervised Learning","Exercises week 34","Exercises week 35","Exercises week 36","Exercises week 37","Exercises week 38","Exercises week 39","Applied Data Analysis and Machine Learning","2. Linear Algebra, Handling of Arrays and more Python Features","Project 1 on Machine Learning, deadline October 7 (midnight), 2024","Teaching schedule with links to material","1. Elements of Probability Theory and Statistical Data Analysis","Teachers and Grading","Textbooks","Week 34: Introduction to the course, Logistics and Practicalities","Week 35: From Ordinary Linear Regression to Ridge and Lasso Regression","Week 36: Linear Regression and Statistical interpretations","Week 37: Statistical interpretations and Resampling Methods","Week 38: Logistic Regression and Optimization","Week 39: Optimization and Gradient Methods","Week 40: Gradient descent methods (continued) and start Neural networks"],titleterms:{"1":[0,15,16,17,18,23,28,29],"16":32,"2":[0,15,16,17,18,28,29,30],"2023":26,"2024":[23,33,34],"21":[],"23":33,"26":29,"27":33,"3":[0,15,16,28,29],"30":34,"34":[15,28],"35":[16,29],"36":[17,30],"37":[18,31],"38":[19,32],"39":[20,33],"4":[0,29],"40":34,"5":0,"7":23,"9":31,"case":[8,10,25,29,30,32,33],"class":32,"do":[1,30,31,33,34],"final":[12,29,30,33,34],"function":[0,1,6,7,8,10,11,12,13,23,25,28,29,30,31,32,33,34],"import":[5,22,28,29,30,34],"new":[4,30,31],A:[0,1,4,8,9,28,30,31,32,34],AND:34,And:[28,29,30,32,33,34],But:[33,34],For:29,In:26,Ising:6,OR:34,The:[0,1,2,3,5,6,7,8,9,11,12,17,21,28,29,30,31,32,33,34],To:[28,29],With:[4,30],about:[28,29],abov:30,activ:[1,12,30,34],ad:[0,6,17,23,28,29,34],adaboost:10,adagrad:[13,33,34],adam:[13,33,34],adapt:[10,33,34],adjust:1,advanc:34,adversari:4,again:[3,9,32],ai:[23,28],aim:[8,9,17,18,19,20,28],aka:[28,29],al:34,algebra:[22,28],algorithm:[9,10,11,12,29,33,34],algortithm:[13,32,33],all:8,an:[0,4,10,28],analys:[5,29],analysi:[0,5,6,11,21,23,25,28,29,30,31],analyt:[0,16,17],ani:[13,32,33],anoth:[9,30,31],appli:21,approach:[0,8,14,28,31,33,34],approxim:12,architectur:1,argument:[33,34],arrai:[22,28],artifici:34,assist:26,assumpt:[30,31],august:29,autocorrel:25,autograd:[2,13,33,34],automat:[13,33,34],avoid:[],b:[17,23,33],back:[1,11,12],background:[21,23,31],bag:10,base:[13,31,33,34],basic:[0,5,7,9,10,11,22,29,30,31,32],batch:[1,33,34],bay:[5,30,31],befor:11,beta:[30,31],better:[8,34],bia:[6,23,31],binari:1,bind:28,bird:10,boldsymbol:[29,30,31],boost:10,bootstrap:[6,10,31],boston:0,breast:1,brief:[28,31,32,33],bring:12,build:[1,3,9],c:[23,28],calcul:29,can:[28,31,33,34],cancer:[1,7,9,11,32],cart:9,center:29,central:[13,21,25,31,32,33],chain:12,challeng:32,chang:10,channel:28,chi:[0,28],choos:1,cifar01:3,classic:11,classif:[1,9,10,32],classifi:[8,32],clip:1,cluster:14,cnn:3,code:[0,1,2,5,9,11,12,13,14,28,29,30,31,32,33,34],collect:[1,3],come:32,commun:28,compact:32,compar:[2,10],comparison:30,compet:[33,34],complet:29,complex:[0,6,23,29],complic:[6,33,34],compon:11,comput:[9,33,34],computation:31,computerlab:28,con:9,concept:25,condit:[30,31,32,33],confid:31,conjug:[13,33],continu:34,contn:28,convex:[8,13,32,33],convolut:[3,12,34],correctli:[30,31],correl:[11,29,32],correspond:[32,33],cost:[1,10,29,30,31,32,33],cours:[21,27,28],covari:[5,11,25,29],cover:28,cross:[6,23,31,32],cython:28,d:23,data:[0,1,3,6,7,9,11,15,16,21,23,25,28,29,30,32],dataset:[1,3],deadlin:[23,28],decai:[2,33,34],decis:[9,10],decomposit:[5,11,17,22,29],deep:[1,2,28,32],defin:[1,28],degre:[0,29],deliveri:23,delta:31,dens:[0,28],deriv:[5,12,29,30,31,32,33],descent:[2,10,13,32,33,34],descript:23,design:29,detail:[3,28],develop:1,diagon:11,differ:[8,33,34],differenti:[2,13,33,34],diffus:2,dimension:[2,3,8,23,29],directli:[33,34],disadvantag:9,discret:25,discuss:32,distribut:[5,25,30,31],distrubut:31,doe:[29,30,34],domain:25,dot:33,down:1,dropout:1,e:23,each:32,economi:29,electron:23,element:[0,25,28,33,34],elimin:22,energi:28,ensembl:10,entropi:[9,32],environ:[0,15,28],equat:[0,2,12,28,29,30,32,33],error:[0,10,28,29,31],essenti:28,estim:[30,31],et:34,etc:28,euler:2,evalu:1,exampl:[0,1,2,3,4,6,7,8,9,10,28,29,30,31,32,33,34],exercis:[0,6,15,16,17,18,19,20,28,29],expect:[18,25,30,31],expens:31,experi:25,explor:[0,15,16,28],exponenti:2,express:[17,18,29,32,33],extend:[32,33],extrapol:4,extrem:[10,28],ey:10,f:23,fall:26,famili:[1,28,29],famou:22,fantast:29,featur:[9,22,29],feed:[1,12,34],find:[31,33],fine:1,first:[4,12,28,29,30,32,33],fit:[0,10,28,30],fix:29,fold:[31,32],forc:3,forest:10,format:[23,28],forward:[1,2,12,34],fourier:3,frank:[6,23,29],freedom:[0,29],frequent:29,frequentist:[0,28],fridai:[],from:[5,10,12,29,30,31,32,33,34],full:2,further:[3,5,29],g:23,gan:4,gate:34,gaussian:22,gd:[13,33,34],gener:[4,9,28],geometr:[11,32,33],get:34,gini:9,good:[0,28],goodfellow:34,grade:[26,28],gradient:[1,2,10,13,32,33,34],grid:32,group:32,growth:2,ha:21,handl:[22,28,29],happen:[30,31],hessian:[29,32,33],hidden:2,histogram:31,homework:[32,33],hous:0,how:32,hyperbol:34,hyperparamet:1,hyperplan:8,i:1,id3:9,idea:11,ideal:[32,33],ident:[30,31],identifi:31,ii:28,iid:[30,31],illustr:[30,34],implement:[1,34],implic:[5,29],improv:[1,33],includ:[13,32,33,34],increment:11,independ:[30,31],index:9,inform:26,input:2,instal:[21,23,28],instructor:26,intercept:29,interpret:[5,11,28,29,30,31,32,33],interv:31,introduc:[11,13,29,33,34],introduct:[0,6,21,22,23,28,34],invers:[5,22,30],invert:29,iter:[10,33],its:29,jacobian:29,jax:[13,33,34],job:34,julia:28,jungl:10,k:[31,32],kera:[1,3],kernel:[8,11],lab:[31,32,33,34],lagrangian:8,lambda:32,lasso:[5,6,23,29,30,31,32,34],last:[29,32,34],later:[5,29],layer:[1,2,3,12],learn:[0,1,2,11,13,14,15,16,21,23,28,29,30,31,32,33,34],least:[5,6,18,23,28,29,30],lectur:[28,29,30,31,32,33,34],level:10,librari:[21,28],likelihood:[7,30,31,32],limit:[1,13,25,31,32,33,34],linear:[0,8,13,22,28,29,30,32],link:[5,11,24,27,29,30,31],literatur:23,logist:[7,28,32,33,34],loop:[33,34],loss:[29,32,33],lu:22,machin:[0,8,13,21,23,28,32,33],made:[30,31],main:[25,28],make:[0,9,10,15,16,28,29],mani:[10,12],manipul:29,margin:[30,31],mass:28,materi:[23,24,28,29,30,31,32],math:[5,29],mathemat:[3,5,8,29,33,34],matric:[5,22,28,30],matrix:[1,5,11,12,22,28,29,30,32,33,34],matter:[0,28],max:29,maximum:[30,31,32],mean:[0,29,30,32],measur:32,meet:[5,10,25,28,29],mercer:8,method:[6,9,10,13,23,28,31,32,33,34],midnight:23,min:29,mini:[33,34],minibatch:[33,34],minim:[28,32],ml:28,mle:[30,31],mlp:12,mnist:[3,4],model:[0,1,4,6,12,28,34],moment:[33,34],momentum:[13,33,34],mondai:[29,30,31,32,33,34],moon:[8,9],more:[3,6,22,23,28,29,30,31,32,33,34],multi:34,multilay:[12,34],multipl:[1,3],multipli:8,need:[23,28],network:[1,2,3,4,7,12,28,32,34],neural:[1,2,3,4,7,12,28,34],neuron:34,newton:[32,33,34],noen:[],non:8,none:[33,34],normal:[0,1,31],notat:[12,34],note:[23,29,30,34],now:[1,9,13,30,31,33,34],nuclear:[0,28],nueral:32,numba:28,number:[0,2,25,29,33,34],numer:[2,23,25],numpi:[22,28,33,34],object:3,obtain:11,octob:23,od:2,off:[6,23],ol:[5,6,23,30,31,33,34],one:[2,12,32,33],ones:34,oper:22,optim:[1,8,13,21,28,29,32,33,34],order:[13,33,34],ordinari:[5,6,18,23,28,29,30],organ:[0,28],oslo:27,other:[4,9,11,12,22,23,28,29,32,34],our:[0,4,5,11,13,28,29,32,33],outcom:[21,28],output:2,overarch:[0,4,8,9,17,18,19,20,28,29],overview:[10,28,33,34],own:[0,10,11,15,16,28,29],packag:[22,28],panda:[28,29],paper:23,paramet:[28,29,32,33,34],part:[13,21,23,29,32,33],partial:2,pass:1,pca:11,pdf:25,pencil:23,perceptron:[12,34],perform:[1,9],period:3,perspect:1,plan:[29,30,31,32,33,34],plot:[31,32],point:4,poisson:2,polynomi:[3,30],popul:2,popular:28,practic:[13,26,28,33,34],pre:[1,3],preambl:23,predict:4,predictor:32,preprocess:29,prerequisit:[3,21,28],princip:11,principl:3,pro:9,probabl:[5,25,30,31],problem:[1,2,13,28,29,30,32,33,34],procedur:[9,28],process:[1,3],product:33,program:[2,13,23,32,33],project:[6,23,28,32],prop:[13,33,34],propag:[1,12],properti:[5,25,29,32],python:[0,9,15,21,22,28],quick:8,r:28,random:[10,11,25,32],raphson:[32,33],rate:[33,34],read:[9,28,29,31,32,34],real:[6,23,28],recommend:[28,29],rectangular:30,recurr:[4,12,34],recurs:[33,34],reduc:[0,29],reduct:3,refer:23,reformul:2,regress:[0,5,6,7,9,10,13,17,18,23,28,29,30,31,32,33,34],regular:[1,32],relat:29,relev:[27,29,32,34],relu:1,remark:3,remind:[6,8,28,32,33],repeat:29,replac:[13,33,34],report:23,repositori:31,requir:[2,21],resampl:[6,23,31],rescal:[6,30],residu:29,resourc:2,result:[29,30],revisit:[13,32,33],rewrit:[28,29,31],rewritten:32,ridg:[0,5,6,17,18,23,29,30,31,32,33,34],rm:[13,33,34],rmsprop:[33,34],rule:12,s:[8,10,31,32,33,34],same:[13,31,33,34],sampl:11,scale:29,schedul:[24,28],schemat:9,scheme:2,scienc:28,scikit:[0,1,11,15,16,28,29,30,31,32,33],search:32,second:[13,33,34],select:32,semest:26,sensit:[32,33],septemb:[30,31,32,33,34],session:[29,30,31,32,33,34],set:[0,2,3,9,12,15,28,29,32],sgd:[13,33,34],should:1,similar:[13,33,34],simpl:[0,4,9,13,28,29,30,32,33,34],singl:[10,34],singular:[5,11,17,29],size:29,slightli:[33,34],soft:8,softmax:1,softwar:[23,28],solv:[2,30,32,33],solver:13,some:[13,22,29,32,33],specifi:2,split:[0,15,16,28,29],squar:[0,5,6,10,18,23,28,29,30],standard:[13,29,31,33],start:34,state:[0,28],statist:[5,6,21,25,28,30,31],steepest:[10,13,32,33],step:[31,32,33,34],still:29,stochast:[13,25,33,34],stop:[33,34],strongli:28,studi:32,subtract:29,suggest:[28,32,34],sum:31,summari:[26,28,34],superposit:3,supervis:1,support:8,svd:[5,29,30],syntax:33,systemat:3,t:[29,30],taken:34,teach:[24,26],teacher:[26,28],technic:30,techniqu:[6,11,23],technolog:21,tensorflow:[1,3],tent:28,term:31,test:[0,1,15,16,28,29,30],text:28,textbook:[27,28],than:[32,33],theorem:[5,8,11,12,25,30,31],theori:25,thi:[17,18,19,20,28],think:29,thursdai:[],time:[33,34],tip:[13,33,34],togeth:12,tool:[23,28],top:1,topic:28,toward:11,trade:[6,23],tradeoff:[6,31],train:[0,1,4,15,16,28,29],transform:3,tree:[9,10],tuesdai:[30,34],tune:1,two:[3,8,21,23,29,32],type:[2,4,12,28,34],uio:28,understand:31,univers:[12,27],unsupervis:14,unsupport:33,up:[0,2,9,12,15,28,29,31,32,34],us:[0,1,2,3,7,13,21,23,28,29,32,33,34],usag:[30,31],valid:[6,23,31,32],valu:[5,11,17,18,25,29,30,31,32],vari:[33,34],variabl:[25,32,33],varianc:[6,23,30,31],variou:[0,15,28,31,32],vector:[8,12,22,28,29,34],video:[32,33,34],view:[0,4,10,29],visual:[1,9],vs:3,wai:[9,31,34],warm:34,wave:2,we:[28,33,34],wednesdai:[30,34],week:[15,16,17,18,19,20,28,29,30,31,32,33,34],weekend:32,weekli:24,what:[0,28,29,30,31],when:[33,34],which:[1,33,34],why:[28,29,31,34],wisconsin:[7,32],wrap:[29,31],write:[4,11,23,30],x:[29,30],xgboost:10,xor:34,yet:30,your:[0,10,15,16,28,29],yourself:32}}) \ No newline at end of file +Search.setIndex({docnames:["chapter1","chapter10","chapter11","chapter12","chapter13","chapter2","chapter3","chapter4","chapter5","chapter6","chapter7","chapter8","chapter9","chapteroptimization","clustering","exercisesweek34","exercisesweek35","exercisesweek36","exercisesweek37","exercisesweek38","exercisesweek39","intro","linalg","project1","schedule","statistics","teachers","textbooks","week34","week35","week36","week37","week38","week39","week40"],envversion:{"sphinx.domains.c":2,"sphinx.domains.changeset":1,"sphinx.domains.citation":1,"sphinx.domains.cpp":4,"sphinx.domains.index":1,"sphinx.domains.javascript":2,"sphinx.domains.math":2,"sphinx.domains.python":3,"sphinx.domains.rst":2,"sphinx.domains.std":2,"sphinx.ext.intersphinx":1,sphinx:56},filenames:["chapter1.ipynb","chapter10.ipynb","chapter11.ipynb","chapter12.ipynb","chapter13.ipynb","chapter2.ipynb","chapter3.ipynb","chapter4.ipynb","chapter5.ipynb","chapter6.ipynb","chapter7.ipynb","chapter8.ipynb","chapter9.ipynb","chapteroptimization.ipynb","clustering.ipynb","exercisesweek34.ipynb","exercisesweek35.ipynb","exercisesweek36.ipynb","exercisesweek37.ipynb","exercisesweek38.ipynb","exercisesweek39.ipynb","intro.md","linalg.ipynb","project1.ipynb","schedule.md","statistics.ipynb","teachers.md","textbooks.md","week34.ipynb","week35.ipynb","week36.ipynb","week37.ipynb","week38.ipynb","week39.ipynb","week40.ipynb"],objects:{},objnames:{},objtypes:{},terms:{"0":[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,22,23,25,26,28,29,30,31,32,33,34],"00":[0,1,5,6,9,11,28,29,30,34],"000":[1,3,9],"0000":[5,9],"00000":[9,33],"000000":[5,11,29],"00000000e":[5,29,34],"00001":33,"00002":33,"00002585e":29,"00003":33,"00005":33,"00007":33,"00009":33,"0001":[1,17],"00010067":33,"00012":33,"000137":25,"00016535":[],"00016719":33,"00017733":[],"00018":33,"00018053":[],"00019998":5,"00021270681344726395":[],"000225":33,"00022969":34,"00023":33,"00023813":[],"00024087":5,"00024929":33,"00025662":33,"0002762":33,"00027746":33,"00028":33,"00028167":33,"00029012":5,"0002926":[],"00030601":33,"00031208":33,"00031535148309577417":[6,30],"0003153514830958095":[6,30],"00033904":33,"00034576":33,"00034688149480437765":[],"00034944":5,"0003701342170783489":9,"00037564":33,"00038309":33,"00041619":33,"000417932":2,"00042089":5,"00042093":33,"00042444":33,"00042721":34,"00044":33,"00046006":33,"00046111":33,"000464088":2,"00046631":34,"00047025":33,"00050694":5,"00051088":33,"00052102":33,"00053001":[],"00053122":[],"00056603":33,"00057726":33,"00058016":[6,30],"00060":33,"00060704":6,"00061058":5,"00062592":6,"00062668":[],"000626681519836":[],"00062713":33,"00063362":31,"00063866":31,"00063957":33,"00066668":[6,30],"00067008":33,"00068091":31,"00068734":[6,30],"00069":33,"00069123":6,"00069482":33,"0007086":33,"00073541":5,"00075590":31,"00076202":33,"00076495":[6,30],"00076908":6,"00076983":33,"0007698473260556325":[6,30],"0007698473260556343":[6,30],"000783":[],"00078324":[],"00078509":33,"00079125":6,"00079904":31,"00079968":5,"00080497":[],"0008297120772365539":[],"00083355":31,"00084707":6,"00085292":33,"00085892":6,"00086984":33,"00087697":[6,30],"00088573":5,"00089193":31,"00092678":6,"00092898":31,"00094499":33,"00095624":34,"00096314":5,"00096373":33,"00099778":[],"001":[1,2,8,13,17,30,32,33],"00100081":34,"00100519":[6,30],"00100913":[],"001047":33,"0010479245693919886":[6,31],"00105081":[6,30],"00106677":5,"00106776":33,"00107405":[6,30],"00108":33,"00108471":[],"00109354":34,"00111756":[6,30],"00114401":[],"00114451":34,"00114855":[],"0011526":[6,30],"00115631":33,"00115999":5,"00116001":33,"00118302":33,"00118584":6,"00119688":31,"00125057":34,"00126053":33,"00128479":5,"00128523":33,"00130885":34,"00131072":33,"001323":[6,30],"00133638":[],"00136125":[],"00137814":6,"00139705":5,"00140846":31,"00141727":33,"00142396":33,"00143013":34,"00144539":33,"0014522":33,"001468":[],"00146807":[],"00149311":[6,30],"00149679":34,"00149956":[6,30],"00151416":[],"00152117":[6,30],"00154733":5,"00154853":31,"00156374":6,"00157766":33,"00158":33,"00160895":33,"00162921":[],"00163548":34,"00167329":33,"00168251":5,"00168745":[],"00169":33,"00170809":[],"00171171":34,"00172865":[],"00174276":[6,30],"00174738":[],"00174795":33,"00175331":[6,30],"00178263":33,"001795":[],"00180673":33,"0018310257999764163":[],"00186347":5,"00187032":34,"0018798":[],"001880":5,"00193661":33,"0019575":34,"00197505":33,"00200":8,"00202624":5,"00202756":[6,30],"00206234":[],"00208188":33,"00209403":[],"00211418":[],"00213888":34,"00214559":33,"00217499":[6,30],"00218823":33,"00219195":31,"00220013":[],"00223857":34,"00224413":5,"00225842":33,"0022626":[],"00228740":6,"00229111":[],"0023548":[6,30],"00237699":33,"002381316302584885":[6,30],"0023813163025848865":[6,30],"00242441":33,"00242954":31,"00242999":6,"00243186":[6,30],"0024401":5,"002446":34,"00248232":[],"00249435":[6,30],"00250787":[],"00251359":[],"00254973":[],"00256001":34,"00256622":[],"00263296":33,"00263755":34,"00264":33,"00266858":2,"00268602":33,"00270244":5,"00272337":[],"00274989":[6,30],"00275768":[],"00279722":34,"00282226":[],"00282302":33,"00289724":[6,30],"00290613":[],"00291535":33,"0029276":34,"00293838":5,"00297571":33,"00298783":[],"00302547":[],"00310113":2,"00312361":[6,30],"00315593":6,"00319887":34,"0032153180657605116":[6,31],"00322456":33,"00323332":[6,30],"0032542":5,"00325450":31,"00327797":[],"00329616":33,"00330046":[],"003301":[6,30],"00331927":[],"00334047":[],"00334797":34,"0033955154592040936":[6,31],"0034318":33,"00348246":[],"00352878":33,"00353823":5,"00353938":[],"00355614":33,"00359628":[],"0036237":[6,30],"0036367":[6,30],"00364159":[],"00364967":33,"00365819":34,"00369758":[6,30],"0038287":34,"0038335":[6,30],"00389038":33,"003909404072811226":[6,31],"00391839":5,"0039259":[],"0039455":[],"00399521":[],"0039987":[6,30],"00399972":[],"004":[5,30,31],"00403677":33,"0040792":[],"00408":33,"004091940707753939":[6,31],"00410387":[6,30],"00410478":6,"004113634617443131":[6,29,30],"00411363461744314":[6,29,30],"004113634617443147":[6,29,30],"0041148":[],"00412":33,"00415598634586135":[6,31],"00416103":33,"00418347":34,"00420072":31,"00424909":2,"00424967":[6,30],"00426027":5,"0042992":33,"00432864":[],"00433417":11,"00434043":[],"0043587":[],"00437846":34,"00438318":[],"00440346":[6,30],"00441097":33,"00443743":[6,30],"0044505":33,"00445186":33,"00445655":11,"00455966":[],"004579219539673834":[6,31],"00458631":[],"00458878":[6,30],"004610275230656212":[6,31],"00462287":[6,30],"00465099":31,"0046544":[],"00468914":25,"00471782":5,"00472199":6,"00472276":[],"00472512":[6,30],"00474898":[],"00476012":33,"00478417":34,"00480881":[],"00487029":33,"0049544":[6,30],"00497837":30,"004999999999999991":[],"005":0,"005000000000000001":[],"00500716":34,"00507531":[],"00509128":33,"00512599":[],"00512927":5,"00513051":[],"00517114":[6,30],"00519717":[],"00520911":33,"00521014":[],"00522055":[],"00526348":[6,30],"00527578":[],"0053018":[6,30],"00537955":[],"00544547":33,"00547113":34,"00551372":33,"00552462":[],"00554202":[],"00554552":[6,30],"00556826":[6,30],"00556946":[],"0055715":33,"00557893":[],"00560098":[],"005643":[],"00564344":[],"00564365":33,"00566707":[],"0056799":5,"00569512":[],"00570321":[],"0057065":[],"00571608":[],"00572613":34,"00573727":[],"00574735":[],"00578809":[],"00579953":[6,30],"0058243":33,"00586355":[],"00588657":[6,30],"00593362":[],"0059591":33,"00606382":[],"00607783":6,"006162":[6,30],"00617221":[],"00617499":5,"0062202":[],"00622949":33,"00625051":[],"00625672":34,"00627115":[],"00630331":[6,30],"00633289":[],"00634299":[],"00635016":[],"00637188":[],"00637367":33,"00641423":[],"00642221":[6,30],"00644":33,"0064472":30,"00647029":[],"00654835":34,"00659604":[],"00660427":[6,30],"00666287":33,"00667611":[],"00672607":[6,30],"00673407":[6,30],"00676256":22,"00676387":[6,30],"00679013":[],"0068011":[6,30],"00681708":33,"00683748":5,"00683875021199284":[],"00683964":[6,30],"00685287":[],"00687309":[],"00688012":[],"00689214":33,"00691012":[],"0069668":[],"007024126888938232":[6,31],"00702721":[],"0071264":33,"00715512":34,"00719176":[6,30],"00727646693":[0,28],"00729134":33,"00731392e":29,"007315":29,"00732665":[],"0074331":5,"00747773":[],"00748862":34,"00754823":[],"00759119":6,"00762217":33,"00764333":[],"007658477904313023":[],"0076989":[],"00779859":33,"00781918":31,"00784393":[6,30],"00789262":[],"00791263":[],"00798909":[],"00803064":[6,30],"008043811612683473":[],"00805074":31,"00812487":[],"00813803":6,"00815244":33,"00816675":[],"00817631":[6,30],"00818251":34,"00823002":5,"00827728":[6,30],"00828121":[],"00831018":[6,30],"00834112":33,"00834567":[6,30],"00838555":[],"00848904":[6,30],"008560581831215528":[],"0085639":34,"00859693":[],"00861518":33,"0086649156":[0,28],"008675369724975977":5,"00871959":33,"008753288788081405":29,"00889475":[],"00891702":[],"0089214":33,"00894639":5,"00905423":[6,30],"00908537":[],"009163470508352218":5,"009164545680330616":[6,31],"00917248":[6,30],"00919984":[],"009211602191395454":29,"00925406":33,"00930146":[],"0093262":33,"009338082195270294":[],"00934327e":29,"00934499":[6,30],"00935742":34,"00939407":[],"009396472959497925":[],"00940611":[],"00942574":[],"00943959":[],"00954206":33,"00955125":[],"00956827":[],"0096208":[6,30],"00974758":[],"00979357":34,"00989834e":[],"00990475":5,"00992331":[6,30],"00996754":[6,30],"00996762":[],"00997502":33,"01":[0,1,2,5,6,9,11,13,17,27,28,29,30,33,34],"010018312644137363":[6,31],"01003519":[],"01006":33,"01006984":[],"0100706":[6,30],"01009321":[],"01013849":[],"01014331":[],"01020588":33,"01024875":[],"01031":33,"01032533":[],"010331721306655127":[6,31],"010348289064969316":[],"01035006":[],"01039879":[],"01044475":[],"010516485576645508":[6,31],"01060492":[],"010612904886352397":[],"01066519":[6,30],"01066897":33,"01070103":34,"01075018":[],"01076611":5,"01076897":33,"01080465e":[],"01084359":[],"01091589":33,"01093553":[],"01098247":[],"0110":25,"01107333":[],"011076219011379514":[6,31],"011156605304609659":[],"01119738":[],"01119981":34,"011208613520466846":[],"011225":2,"01123792e":29,"0113104":[6,30],"01131771":[],"01141119":33,"01161645":[],"0116753":33,"01178857":[],"01179128":[],"01179415":[],"01179792":[6,30],"011818646101922625":29,"01191824":5,"01199741":[],"01206221":[],"012073649446193166":[6,31],"0121289":[],"01214862":[],"01219292":[6,30],"01220505":33,"01222822":29,"01223198":[6,30],"01223754":34,"01231917":[6,30],"01234":[],"01234261":[],"01241284":[],"01244297":[],"01247909":[],"01248754":33,"01250964":[],"01261048":[],"01265755":29,"012658":29,"01266999":[],"01267007":30,"0126711":[],"01280793":34,"01288787":[],"01290947":[6,30],"01295356":5,"01305415":33,"013121574015585152":[6,31],"013121574015585155":[6,31],"01315875":[],"01316233":[],"01318643":[6,30],"01327148e":[],"01329403":[],"01332832":[],"01335628":33,"0134113":[],"01346122":33,"01347916":[6,30],"01348565":[6,30],"01349244":[],"01353638":[],"01367553":[6,30],"0137297":33,"01373484":[],"01376216":[],"01393496":[],"01396231":33,"01397146":[6,30],"01399457":34,"01405935":[6,30],"01406777":[],"01409478":[],"01416528":[6,30],"01428546":33,"01433809":5,"014436800088904942":[6,31],"01444013":[],"01449782":[6,30],"01458337":[6,30],"014586":29,"01458611":29,"0146081":[6,30],"01462254":[],"01463049":[6,30],"01464686":34,"01480256":[],"01493365":33,"014934":33,"01499192":[],"01506354":[],"01507238889517706":[6,30],"01507238889517717":[6,30],"01511937":33,"01527928":33,"01530321":[],"01531845":[6,30],"01532738":[],"01543076":[],"01549377":[6,30],"01551724":[],"015518":[],"01551815":[],"01552874":[],"01558197":5,"01572":33,"01573062":[],"01573768":[],"01584129":[],"01594452":31,"01597256":33,"01600363":34,"01604235":[],"01620955":[],"01624447":[],"01625794":[],"01628578269596628":[6,31],"01633913":[6,30],"01634224":33,"01640891":6,"01643795":[],"0164974":[],"01654574":[],"01655318":[6,30],"01655384":[],"016587414993043573":[6,31],"01674956":34,"01681612":[],"01682652":33,"01691985":[6,30],"0169643":5,"01706166":[],"01708375":33,"01708781":[6,30],"01708852":[6,30],"01713366":[6,30],"01717549":[],"01724499":5,"017355848195593347":[6,31],"01735584819559336":[6,31],"01737634":[],"01747915":33,"01756114":[],"01759442":[],"01759974":[],"01760144":[],"017665":5,"01772779":[],"01779091e":[],"01783096":[],"01783414e":29,"0178462":[],"01793261":[],"0179826":[],"01811279":[],"01817048":[],"018232":29,"01826811e":[],"01827225":33,"01830039":34,"01831050e":[6,30],"01831190e":[6,30],"01844822":[],"01863203":[],"01866537":[6,30],"01869515":33,"01873344":11,"01873869":5,"01881237":[],"01897462":[],"01898855":[6,30],"01905384":[],"01905883":[6,30],"01908936":[6,30],"01915337":34,"01922269":[],"0193075":[],"0195302":[],"01954342":33,"01963611":[6,30],"01969145":[6,30],"01975416527185249":[6,31],"01975848":[6,30],"01979808":[],"01999575":33,"02":[0,4,6,7,12,28,29,30,32,34],"02014577":[],"02016185":[],"02024962":[6,30],"02026756":[],"02031987":[],"02032056":[],"02054837e":[6,30],"0206033":[],"02068067":[6,30],"02073509":5,"02077431":30,"02087411":[],"02090304":33,"02091662":[],"02092464":34,"02098261":[6,30],"02102403":[],"02103315":33,"0211429":[],"02117843":[],"02123176":[6,30],"02126205":[],"02137508":22,"02138683":33,"02148021":33,"02151521":[],"021544346900318832":30,"02156196":[],"02156565":[],"021592704588025022":[6,31],"021592704588025025":[6,31],"02164667":[],"02175561":22,"02183817":[],"02189863":[],"02189994":34,"02198702e":[6,30],"02198703e":[6,30],"022":[],"02207054":[],"02208512":[6,30],"02214409916811925":25,"02218076":[],"02228115":[6,30],"02229529":[6,30],"02235723":33,"02252765":5,"02281004":[],"02286267":[],"02287468":33,"02296298":33,"022999498260366312":[6,31],"0231353":[],"0232":[],"02322297":[],"02322594":[],"023295599127611474":[],"02330799":[],"02334754":[],"02338085":[],"02345858":[],"02348765":[6,30],"02354386":22,"02355756":[],"02358547":[],"02361665":[],"02365049":[6,30],"02374496":[],"02386932":[],"0239126":33,"02391906":34,"024":[],"024011020121022356":[],"02404706":[],"0241039":[],"02424794":31,"02432309":[],"02441422":[],"02446604":33,"02447063e":[],"0245528":[6,30],"02456":33,"02459084":33,"02472936":[],"02474828":[],"024792624800382218":5,"02492265":5,"02496085":33,"02498832":[6,30],"02500488":[],"02502325":[],"02503392":34,"02503753":[6,30],"02511518":6,"02522069":6,"02527621":[],"0253208":[],"02540212":[],"02544154":[],"02545":33,"02546675":31,"02552966":22,"02557617":33,"02564828":[],"02566356":[],"025709":[11,29],"02572685":[],"02576358":[],"02576685":[],"02586427":[6,30],"02594314":[],"02601643":[],"0260906":[6,30],"02612988e":29,"02616812":33,"02622039":[],"0262517":[],"02625193":8,"02629144":33,"0263106":[],"02631942":[],"02632742":[],"02649469":[],"026495":[],"02651857":[],"02654585":[],"02660572763718093":[6,31],"026605727637180936":[6,31],"02664408":[],"02693015":[],"02693858":30,"02707227":5,"02723445":[6,30],"02732402":34,"02735547":33,"02754248":[],"027609773491022525":[6,31],"02760977349102253":[6,31],"02769274":[],"02780107":[],"02784266":[],"02787184":[],"02797154":[],"0279886":33,"02808229":[],"02809972":[],"02850506e":29,"02857":4,"02859759":34,"028638258927275215":[],"02895918":30,"02900153e":33,"029003":[],"02901273e":29,"02909574":[],"02920675":[],"02923006":[],"02925855":33,"02928194":[],"02944152":[],"02946852":[],"029483":5,"02965159":[],"029733":29,"02973733":[],"02976145":[6,30],"02980537":[],"02993573":33,"02994311":5,"02f":[6,23],"03":[1,6,29,30],"03015288036252618":[],"03016341":[],"03032441e":[6,30],"03033791":[],"0303586629618948":[],"03057995":[],"030645975175292262":[],"03076019":[],"03077640549":4,"03099776":5,"031":[5,30,31],"03115122":[],"0311613":34,"03158013":[],"0316146":[],"0317606":[],"03177331":22,"03196357":[6,30],"03201179e":[],"03201832":33,"03205795":[],"03206757":[],"032142":[],"03214247":[],"03214829":[],"0321956":11,"032196":11,"03239393":[],"03244944":[],"03247316":[],"03251863":5,"03256632e":1,"03261373":34,"03267527":[6,30],"03274273":34,"03279636":[6,30],"03285784":[],"0328643":33,"0330308045183194":[6,30],"0330308045187757":[6,30],"03306538":33,"03308408":5,"03309191e":29,"03311432":[],"03313259e":29,"03317599":[],"0332335":25,"033233504714921":25,"03358833":[],"03361037":[],"03365012":[],"033657685071527665":[6,31],"0337609":[],"03382942":28,"03396658":[],"034":[],"03400724e":29,"03404758":[],"034048":[],"03409194":[],"0342028":[],"0342458":33,"03447512":[6,30],"034476":11,"03447649":11,"034557":29,"03476611e":29,"03479236":[],"03511387":[],"03529801":[],"03538463":34,"03538673e":29,"03562355":[6,30],"03568439":[6,30],"03573214":[],"03578526":[],"0359565":5,"03596557":[],"03624411":[],"0362483569261072":[],"03630548":[6,30],"03642173":[],"03648711":[],"036527092051294":[],"03662823":33,"03664879":[],"03681479262838276":[],"0369544130635358":[],"03701105":[],"03703391":34,"03707133":11,"037813671417389005":[6,31],"03781367141738902":[6,31],"03796359":[],"03798785":[],"03814292":[6,30],"03815288":[6,30],"038300":[11,29],"03837":33,"03844073":[],"03846169":30,"03853213":[],"03853268":[],"03853313":[],"03868372":[],"03872795610436844":[],"03873507":[],"03887801":[],"039039":5,"03916813":[],"03948301":[],"03960002":[],"03973359":34,"03976851":33,"03979291":[],"039967668952797":[6,30],"0399676689527975":[6,30],"04":[1,6,11,29,30],"040102":5,"04010697":[6,30],"04018985":[],"04038595":[],"04046513":[],"04061345":[],"04063602":[6,30],"040684":[],"04072235":[],"0408223":[],"0409646":[],"041":[6,9],"04101344":[],"04108038":33,"04110474":[],"0411487294305088":[6,30],"0411487294305226":[6,30],"04158557":34,"04161572":[],"04191323":[],"04193203":29,"042060":[],"04206048":[],"042136":[],"04216532":[],"0422":[],"04220758":[6,30],"04224929":[],"04238763":[],"04262217":[],"04293545":[],"04295757":31,"043":9,"043072":[],"04307275":25,"04315108":5,"04315855":[],"04323936e":[],"04330558":34,"04346721":5,"04353549":[],"04355062":[],"04355837":[6,30],"04362":9,"043637":[],"0437499":2,"043839":[],"04389027":[6,30],"044014":[],"04401421":[],"04413243":[],"04423486":[6,30],"04426744e":29,"044334":29,"044613":[6,30],"04487298":[],"0449":[],"04495752":[],"04504728e":29,"045161":[],"045258":[],"04532405":34,"04537385":[6,30],"04543942":[6,30],"045630":[],"04564589":[],"04566964":[6,30],"0458":9,"04588592":[],"045963":[],"0462999":[],"04641529":[],"04648335":5,"04652794":[],"04657426":[],"04664255":6,"046663":[],"046678":[],"046764":[],"04683565":5,"04719868":34,"047299":[],"0473916":[],"047447724189861":[],"0474753":33,"047489":[],"04757138":22,"047760":[],"04784395":[6,30],"04794409":[],"048020":[],"04808723":[],"0481872773043029":[6,31],"04832356":[],"04838148":[],"04852743":[],"04877931":[],"048781":[],"04892055":[6,30],"04899367":[],"049060":[],"04909093":[6,30],"04912436":6,"049196":[],"04922273":[],"04926746":31,"049276":[],"049380":[],"04939861":34,"049479":[],"049481":[],"049556996627824":[6,30],"0495569966278269":[6,30],"04955942":[],"04963309":[],"049677":[],"05":[1,4,6,23,29,30,33,34],"050015":[],"05002471":[],"05005634426334421":[],"05006037":[],"05009826":[6,30],"05029018":[],"050315327923114654":28,"05034088e":29,"05040878":[],"05045":[],"05054319":29,"05060379":[],"05068486":[],"050796":[],"05087018":[],"05098714":[],"05100875":[6,30],"051021":[],"051042":[],"05135047":33,"051368":[],"05141614":[],"051418":5,"05144177":34,"051554":[],"05159088":[],"051645":[],"051649":[11,29],"0517473":5,"05176711":[],"051787":[],"052010":11,"05201041":11,"05224117":[],"052279218012056844":[6,31],"05227921801205686":[6,31],"052305":29,"05233008":[],"052370":[],"05240397":[],"052427":[],"0524497":29,"0525733":[],"05263":9,"052692":[],"052738":[],"052856":[],"05296475":22,"05302":9,"053036":[],"05336637":[],"053387":[],"053417":29,"053462":[],"053599":[],"05364854":8,"053787":[],"05383795":[6,30],"05383947":34,"053849":5,"053854":[],"05401912":[],"054197":[],"054286":[],"054434":[],"05447415":[6,30],"054609":[],"054617":29,"054655":29,"05484773":[],"054932":[],"055000":[],"05505310046363":2,"055091049054481":[],"05509105":[],"05519999":30,"05533":9,"055477":[],"05549529":[],"05563358":[],"055653":[],"055676":29,"055734":29,"055737":[],"05577845931438246":[],"055876":[],"055910":29,"055987":29,"056026":[],"056041":[],"0560663":34,"05614483":5,"0562":31,"05623":9,"056287":[],"056328":[],"05641352":[],"056414":[],"05648":9,"05651951":[6,30],"05665429e":29,"05667":9,"056683":29,"056717":[],"056826":[],"056856":[],"05716368155342608":[6,31],"057216":[],"057287":[],"057300":29,"057316":[],"057387":[],"057393":29,"057418":29,"057420":[],"057457":29,"05747369":[],"057514":[],"057607":[],"057609":[],"057722":29,"057835":29,"05785343":[6,30],"05789007":[6,30],"057913350391706":[],"057929":[],"05792927":[],"057951":[],"057961":[],"05796251":[6,30],"057964":[],"05804539":[],"05804744e":33,"05807125":[6,30],"058133":[],"058152":[],"058234":[],"058245":[],"058254":[],"05831017":[],"058361":[],"058422":[],"058427":[],"058552":29,"058582":[],"058593":[],"058641":[],"058645":29,"0586484":33,"05867956":34,"058721":[],"058770":[],"05883":9,"05884":9,"058854":29,"05888195":[],"058952":29,"058967":[],"058970":[],"058996":29,"058997":[],"059031":29,"05914563":[],"059201":[],"059243":[],"059340":[],"059624":[],"059669":[],"059761":11,"05978512":[],"059807":29,"059876":[],"059951":29,"059956":11,"05996":33,"059977":[],"05999":9,"059992":[],"059993":29,"06":[6,29,30,33,34],"060071":[],"060083":29,"060085":[],"060087":[],"060171":[],"06020264":[],"06020587":[6,30],"060251":[],"060254":29,"060275":11,"060288":[],"060312":[],"06043581":[6,30],"060453":[],"060470":[],"060471":[],"060475":[],"0604888":[],"060490":[],"060547":[],"060629":[],"060631":[],"060652":[],"0606958":[],"060716":29,"06072":33,"060726":11,"060734":[],"060735":[],"060756":29,"060870":[],"060872":29,"060898":[],"060994":[],"061025":[],"06110658":34,"061154":[],"061163":29,"061284":[],"061319":11,"061359":29,"061386":[],"061443":29,"061452":29,"061588":[],"061614":29,"061637":[],"061656":[],"061706":[],"061724":[],"061848":[],"061862":[],"061898":11,"061921":[],"06199119":[],"06200174":5,"062016":29,"062053":[],"062058":[],"06208238634231949":[6,31],"062161":[],"06216141":[],"062173":[],"062199":[],"062216":5,"062231":[],"062260":[],"062263":[],"062282":[],"062292565":4,"062300":[],"062337":29,"062356":[],"062429":[],"062520":11,"062599":29,"06260611":[],"062616":[],"062624":29,"062637":[],"062691":[],"062700":[],"06277313":34,"062797":[],"062853":[],"062874":29,"06287939":[],"062932":[],"063017":[],"063019":29,"063048":[],"063061":29,"063064":[],"063080":29,"063130":11,"063133":[],"063161":11,"063163":[],"063197":11,"063206":11,"063260":29,"063294":11,"063332":11,"063354":[],"063395":11,"063518":[],"063525":[],"063526":[],"063536":5,"063545":[],"063549":[],"063560":[],"063637":[],"063653":29,"063673":[],"0637712":[],"063781":[],"063786":5,"063791":[],"063802":[],"0638484":33,"063862":[],"063894":29,"06392846":[],"063933":11,"063954":[],"06395476":34,"063959":[],"063977":[],"063995":[],"064000":[],"064074":29,"064077":[],"06410638":[],"064107":[],"06416459":[],"064166":[],"06418809":33,"064189":11,"064202":[],"064218":[],"064294":[],"06430789":[],"06432267":[],"064382":[],"064427":[],"064428":[],"06444":9,"06444224":[],"064501":29,"064505":[],"064507":[],"06453579006728324":[6,31],"064547":[],"064573":[],"064604":[],"064606":[5,29],"064609":29,"064615":[],"064668":[],"064690":[],"064695":[],"064699":29,"064728":11,"064739":[],"064793":29,"064820":[],"064834":[],"064873":[],"064878":[],"06491736":[6,30],"064978":[],"065001":[],"065007":[],"065028":[],"065062":[],"065077":29,"065096":11,"065108":[],"065121":5,"065149":[],"065212":[],"065217":11,"065352":[],"065358":[],"06536971":[],"065378":29,"065390":29,"065410":29,"06547790180152355":[6,31],"06547790180152359":[6,31],"065482":[],"065556":[],"065616":[],"065619":5,"065654":5,"065679":[],"065788":[],"065818":[],"065821":5,"065830":[],"06590458":[],"065949":[],"065963":[],"066054":11,"066059":5,"066066":29,"066127":5,"066145":5,"066153":[],"066199":5,"066205":5,"06622369":[],"066256":[],"066286":11,"066358":5,"06637":9,"066425":5,"066458":[],"066474":29,"066500":29,"06659997":34,"066612":29,"06662069e":[],"066633":[],"066647":29,"066653":[],"0666807":2,"066686":11,"06674611e":[],"066763":[],"066766":5,"06677444e":[],"066778":5,"066787":29,"066824":[],"066837":[11,29],"066838":[],"06684886":[],"06685171":[],"066854":29,"066855":[],"066865":[],"06690071":[],"066912":5,"066948":5,"066988":11,"066997":[],"066999":29,"067000":5,"067003":[],"067074":[],"067141":[],"067164":[],"067168":[],"06724062":5,"067270675787016":[33,34],"067367":[],"067374":11,"067380":[],"067400":11,"067431":11,"067511":11,"067515":5,"067539":5,"067637":29,"067671":[],"067707":29,"067764":[],"06777772":[],"067793":[],"067809":[],"067843":11,"067922":11,"067948":[],"067967":[],"067974":11,"06804775":[],"06808421":22,"068116":[],"068206":[],"068215":11,"068264":29,"068268":[],"068307":29,"068353":5,"068360":[],"068369":[],"068394":11,"068408":[],"068441":29,"06844519414009445":[6,31],"06844519414009446":[6,31],"068446":[],"06849372":[],"068494":[],"068504":[],"068512":5,"068533":[],"068539":11,"068587":11,"068592":[],"068607":[],"068629":29,"068680":[],"068684":[],"068727":29,"068758":[],"068775":11,"068827":11,"068843":11,"068897":[],"068903":[],"068906":29,"068912":[],"068924":11,"068967":[],"068977":11,"068985":11,"06901081":[],"069028":29,"069045":11,"069129":11,"069179":[],"069203":5,"06926192":28,"069270":11,"069293":5,"069317":[],"069320":11,"069322":[],"069399":[],"06942115e":[],"0694226":[],"069427":[],"069439":[],"069452":29,"069484":[],"069486":[],"069584":29,"06970419":34,"069802":[],"069811":11,"06984502":[],"069866":5,"069873":[],"069885":[],"069907":5,"0699274":25,"069978":[],"069979":[],"07":[6,29,30,33],"070024":11,"070027":11,"070043":29,"07006502":[],"070095":[],"070098":11,"070135":5,"070146":29,"070150":[],"07016":9,"07017":9,"070183":11,"070213":29,"070274":11,"070275":11,"07039":9,"070432":[],"070441":[],"070457":29,"070462":[],"070514":[],"070531":5,"070547":11,"070552":5,"070556":[],"070558":[],"070582":29,"070600":[],"070605":5,"070622":5,"07062318":[6,30],"070630":[],"070655":5,"070696":11,"070712":5,"070737":29,"070772":11,"070780":5,"070805":5,"070855":5,"070859":[],"070886":[],"070889":[11,29],"070891":[],"070898":[],"070916":11,"070918":11,"070950":[],"070980":[],"070986":29,"071049":5,"071055":11,"07106891":[],"071103":[],"07115":9,"071173":5,"071186":11,"071191":11,"071208":[],"07123177":[],"071252":[],"071279":[],"071291":[],"071294":5,"0713":[0,28],"071314":[],"071356":[],"071379":11,"071433":[],"071436":5,"071437":5,"071449":[],"07145103":11,"071530":[],"071560":5,"071572":[],"071578":[],"071580":11,"07160048164233102":[6,31],"07160048164233104":[6,31],"071608":[],"071638":5,"071643":11,"071655":[],"071656":11,"071680":5,"071758":[],"071803":[],"071831":[],"0718316":33,"071868":[],"071921":[],"071935":[],"071937":[],"072000":29,"072015":5,"072031":5,"072037":5,"072092":[],"072111":29,"072132":[11,29],"072147":[],"07218473624441492":22,"072200":11,"072209":[],"072286":[],"072290639572326":25,"07229064":25,"072304":[],"072344":[],"072380":5,"07241855":[],"072476":29,"072500":[],"0725872":34,"072590":[],"072591":5,"072621":29,"072638":[],"072684":[],"072689":[],"072697":[],"072728":[],"072752":[],"072817":[],"072824":11,"072826":5,"072843":[],"072849":5,"07285":3,"072863":[],"072947":11,"072961":5,"072997":5,"073048":[],"073102":[],"073109":[],"073253":[],"073258":11,"073262":11,"073288":[],"07332248":[],"073339":[],"073405":[],"073408":[],"073415":[],"073422":[],"073499":[],"073514":5,"073528":11,"073576975500551":25,"073598":[11,29],"073612":5,"073644":29,"073647":11,"073672":[],"073685":[],"07373479":[],"07378525":[],"073791":[],"073800":5,"073858":[],"073866":[],"073882":11,"073911":5,"073923":[],"07405556":[],"074067":[11,29],"074084":29,"074112":[],"074114":[],"074115":11,"074130":[],"074210":29,"07421084":5,"074221":[],"07429886e":[],"074323":29,"074368":[],"074374":5,"074417":[],"074454":5,"0744881":[],"074531":[],"074561":11,"07456491":5,"07469645":[],"074807":[],"074824":[],"074859":[],"074892":[],"07490892":[6,30],"074971":[],"075176":[],"075177":[],"075198":[],"075239":5,"075289":5,"075298":[],"075302":11,"07531349":[],"075356":[],"075385":[],"075392":[],"075463":[],"075513":11,"075522":[],"07555537":[],"075557":[],"075602":[],"075615":[],"075771":[],"075794":[],"075816":29,"075822":[],"075842":5,"075876":5,"075885":25,"075889":29,"075909":[],"075956":[],"07597049":34,"075978":5,"076066":5,"076071":5,"076091":[],"076138":[],"076150":29,"076161":[],"076167":[],"076232":5,"076244":[],"076259":[],"076321":5,"076333":[],"076351":[],"076389":[],"076393":[],"076396":[],"076418":[],"07641937":31,"076434":11,"076435":[],"076436":[],"076448":5,"076459":[],"076479":11,"0764924":[6,30],"076508":11,"076542":[],"076618":[],"076638":[],"076648":11,"076679":11,"076693":[],"076776262573027":[],"07678":9,"076833":[],"076857":[],"076859":[],"0768805855280187":[],"07692307692307693":9,"076934":[],"076938":[11,29],"076947":11,"076968":[],"077035":5,"07712197e":[],"077141":[],"077168":29,"077226":[],"077248":[],"077280":5,"077301":[],"077304":[],"077329":[],"077341":[],"077382":[],"077391":5,"07740964":25,"077411":[],"07745579":22,"077460":29,"077485":11,"077486":[],"077516":[],"077529":[],"077539":[],"077553":[],"077567":[],"077601":11,"077613":[],"077653":[],"0776532":[],"077683":[],"077736":[],"077745":11,"07776381":11,"077764":11,"07777777777777778":1,"077813":11,"077839":11,"077906":[],"077941":[],"077965":[],"078035":[],"078044":11,"078071":[],"07808426989543932":[],"078110":29,"078118":[],"078123":11,"078146":11,"07820":9,"078210":[],"078238":[],"078268":11,"078282":[],"078284":[],"078313":[],"078324":[],"078336":29,"078359":5,"078363":[],"078386":[],"078447":[],"078540":29,"078541":11,"078544":[],"078557":[],"078573":11,"078588":[],"078636":[],"07864":9,"078684":[],"078688":11,"07871":9,"078731":[],"07890044":[],"078945":5,"078974":29,"078981":[],"078986":29,"079002":5,"079027":[],"079030":5,"079074":[],"079089":[],"079107":11,"07911268":34,"079174":11,"07919041":[],"079202":11,"079240":5,"079334":[],"079347":[],"079391":[],"079420":[],"07944154":[22,28],"079444":[],"07950356694388497":[],"079510":[],"079670":5,"0796891867672603":[6,31],"079739":[],"079747":11,"07974741":[],"07978850553011713":[],"079887":[],"079903":[],"079946":29,"079947":[],"079953":[],"079959":[],"079976":5,"079977":[],"07998756":[],"079989":[],"079998":[],"08":[9,25,29,33,34],"080082":[],"080094":5,"080171":[],"080205":[],"080222":[],"08023512":33,"080316":[],"08032505":[],"080345":11,"08043851":5,"080453":[],"080549":5,"080555":[],"080616":29,"080630":[],"080657":[],"080702":[],"080706":5,"080747":[],"080764":29,"080832":[],"080903":[],"080947":[],"080987":[],"081038":[],"081103":[],"081195":[],"081217":5,"081221":[],"081235":[],"081252":[],"081276":29,"08131003":6,"0813156":[],"081431":[],"081457":[],"081494":[],"081527":5,"081544":[],"08156108":[6,30],"08165104":29,"081655":29,"081686":5,"081728":[],"08179906":[],"081835":[],"081871":[],"081955":[],"081978":[],"082115":[],"082126":[],"082170":[],"082173":[],"082174":[],"08227668":[],"082303":[],"08233627":[],"082464":[],"082482":[],"08251519":[6,30],"082518":[],"082519":[],"082533":5,"082653":29,"08266769":28,"082742":5,"082764":[],"082784":11,"082785":[],"08280012":34,"082803":[],"082857":[],"082971":[],"08299273e":[6,30],"083016":11,"083119":[],"0831367":[],"083179":5,"083182":[],"08318298e":1,"083248":[],"083259":[],"083260":11,"083268":5,"083288":[],"08333333333333333":9,"083342":11,"08336233266":4,"083446":[],"083465":[],"083471":[],"083479":[],"083499":[],"083501":[],"083527":29,"083547":11,"083548":5,"083564":[],"083734":[],"083765":[],"08376632":[6,29,30],"083766322923899":[6,29,30],"0837663229239043":[6,29,30],"083793":[],"083864":[],"083900":[],"08398399377155011":9,"084018":[],"084042":[],"084076":29,"084091":[],"084122":[],"08418956":[],"084218":11,"08421808":11,"084255":[],"08426840630693411":[6,31],"08426840630693413":[6,31],"084312":11,"084319":[],"084358":[],"084376":[],"084406":[],"084434":[],"084514":[],"08455":9,"08458591":28,"084619":[],"084637":[],"084695":[],"084702":[],"084712":[],"08474":9,"084809":29,"084910":[],"084915":[],"084963":5,"084967":[],"084996":[],"085079":[],"085120":[],"085139":[],"085145":5,"085222":[],"085294":[],"085353":[],"08536248571780691":5,"085390":[],"08539155":33,"085392":[],"08539583":[],"085436":[],"085455":[],"08551306":[6,30],"085518":[],"085548":[],"085592":[],"08576932":6,"085853":5,"085918":[],"08593216":[6,30],"085973":[],"085996":[],"086026":[],"086068":5,"086095":[],"086096":[],"08611111111111111":1,"086125":[],"086212":[],"08622478":34,"086230":[],"086239":5,"08624193":[],"086250":[],"086286":[],"086318":[],"086346":[],"086364":[],"086428":[],"086483":5,"08660891":[],"08667591":[],"086694":[],"086712":[],"086730":[],"086799":[],"086808":[],"086809":[],"08687303":33,"08690":9,"08690184845323":11,"086913":[],"086970":[],"08699295e":[],"08702578":[],"087210":[],"087424":[],"087429":5,"0875061":[],"08758":9,"08758013":[],"087864":[],"087871":5,"08793554992813543":[],"087988":[],"088023":[],"088029":[],"088030":[],"088038":[],"088102":[],"088127":[],"0881981":5,"088199":[],"08824304e":34,"08826182458028335":[],"088375":[],"08839544":[],"088574":[],"088651":[],"08871404":5,"08881497884574564":29,"08888888888888889":1,"088970":[],"08902":9,"08931169286872433":[],"08935132374099551":[],"089376":[],"0894015":[],"089404":[],"08946029":[],"0895043":[],"0895387":29,"089539":29,"089548":[],"089578":[],"089600":[],"089619":[],"089626":5,"089718":[],"08996":9,"089996":5,"09":[1,29],"090033":[],"090038":[],"09024373":34,"09028702":[],"090439":[],"090440":[],"090468":[],"09048717285916912":22,"090624":[],"09070064":22,"09078672":[],"0907958":[],"090985":[],"091015":[],"091068":[],"091159":[],"09135059e":[],"091362":5,"091365":[],"091388":[],"09156055":[],"09163947":6,"09166666666666666":1,"0917":9,"09171886":[],"091731":[],"092252":[],"092347":[],"092401":[],"09246293455466892":28,"092486":[],"09251":9,"092607":[],"092608577084595":[],"09291556244521161":[],"09291806":[],"092956":5,"092982":[],"0930438":[],"093094":[],"09346106":[],"093554":[],"09360113":34,"09368":33,"09397626":34,"09398153":[],"094044":[],"0940821989627646e":[6,30],"0940821989652176e":[6,30],"094099":[],"094254":[],"094362":[],"094439":[],"09444444444444444":[],"09487358":22,"09515455":[],"09529067":[],"095465":[],"095805":[],"09590269e":29,"09604976":[],"09609807":5,"09610694":25,"096270":[],"096365":[],"096511363983559":[],"09651792":[],"0973900819831327":25,"0974119":22,"09744":9,"09755017":[],"09780":9,"09790216282081063":[],"09791":9,"09808622":[],"09829902":25,"0983565":34,"098414":[],"09846933":[],"09861229":[22,28],"09903804":8,"09913654":[],"09919198949275869":[6,31],"09928714":22,"09951287404314545":1,"0n":[0,28],"0x0006":[3,4,14],"0x117893340":[],"0x117c17be0":[],"0x11975e550":34,"0x11b160a60":34,"0x11f13fb20":33,"0x120cc1b20":[],"0x121cf68e0":[],"0x1273ffac0":[],"0x1279bd460":[],"0x12e13a850":33,"1":[1,2,3,4,5,6,7,8,9,10,11,12,13,14,19,22,24,25,26,27,30,31,32,33,34],"10":[0,1,2,3,4,5,6,7,8,9,10,11,12,13,22,23,24,25,26,28,29,30,31,32,33,34],"100":[0,1,2,3,4,5,6,8,9,10,11,13,14,15,16,17,22,25,26,28,29,30,31,32,33,34],"1000":[0,1,2,4,5,8,11,13,14,21,25,28,29,32,33,34],"10000":[2,5,6,10,11,13,25,30,31],"100000":8,"10001":10,"100083":[],"10008326":[],"1000911":[],"1001":[9,25],"1002":25,"10029389":33,"1003":25,"10030":9,"10036694":[],"10041812":30,"1005":25,"1007":31,"1007711427354898":[6,31],"1009":25,"10107914":25,"1011":25,"101150":5,"10115017":5,"10116149":[],"101263":[],"1013":25,"1013904243":25,"10141413e":[6,30],"1015":25,"1015491":33,"1015am":28,"1023":25,"10230":9,"1024":3,"10242458":34,"1026":25,"10261093":[],"1027":25,"10276112":34,"103":1,"1030":25,"1033455":34,"10340":9,"1037":25,"10378326e":1,"1038":25,"10391807":[6,30],"10398646080125032":[6,31],"10398646080125035":[6,31],"1040":25,"10405456":11,"10430":9,"104411":29,"1047":25,"10499357":33,"105":30,"10520":9,"10539984":[],"105400":[],"10541723644166373":[],"10555555555555556":1,"10572":31,"10587277":34,"10589577":5,"10595991":[],"10604579e":29,"106095":[11,29],"1064601390492845":25,"10646014":25,"10719554":[],"10719859":34,"10747579":5,"107476":5,"1074792":[],"10754764":[],"1079":31,"10790125813226321":29,"108":[6,9],"10837392":22,"10888197":[],"10908858":[],"10913":6,"10931453":[6,30],"10960":9,"10994958":[],"10th":9,"10x":[0,28],"11":[0,1,2,5,6,7,8,9,10,11,12,13,15,16,22,23,24,25,26,27,28,29,30,31,32,33,34],"1100":25,"1101":25,"11022302e":[5,34],"11042239":[],"11081083":[],"1108407":[],"111":[1,7,12,32,34],"11100":9,"11113486":11,"111135":11,"11163239":34,"1118933":22,"11202337":31,"112383":[11,29],"1124":9,"112619":[],"11261935":[],"11265643e":29,"11277166":5,"112772":5,"11382896":30,"11388888888888889":[],"11390":9,"11433693":[],"114384":11,"11438414":11,"11439407":[],"114550":31,"11462415":5,"11482289e":[6,30],"1148541":[],"11507992e":1,"115356":[],"11535632":[],"11547777218872497":[6,31],"11548661":[],"11571507":[],"115822":6,"11590":9,"11596834":[],"11597515":[],"11660":9,"11666666666666667":1,"11683558":34,"11694":23,"117":8,"11715109e":29,"11744554e":[6,30],"11747908":22,"11780":9,"118":[0,2,7,32],"11822173":[],"11830757":30,"118318":29,"1184":31,"11840":9,"11844773":[],"11868033":[],"11890":9,"119":[0,2,7,32],"11922031":[],"11930916":28,"11992194":11,"119922":11,"119936":2,"12":[0,1,2,3,4,5,6,7,8,9,11,12,22,25,27,28,29,31,32,33,34],"120":[0,2,3,7,32],"1203":9,"1203284":8,"120435":5,"12043521":5,"12044974":29,"120450":29,"12081773":33,"121":[8,9,10],"121292":[],"12155483":[],"1215pm":[26,28],"12166797":34,"12182967":[6,30],"122":[2,8,9,10],"12206013":[],"12220276":[],"12222222222222222":1,"12235593":[],"123":2,"12318726e":[6,30],"12329646":[],"12330033":29,"12333649":[6,30],"12363332":22,"123711":6,"12380":9,"12382443":[],"124":[0,28],"12400":9,"1242":8,"124228866018077":[],"12466453":33,"12498355":[],"12536737":33,"12552073e":[6,30],"12591227":29,"126":9,"12600095":34,"1261":9,"12618549":5,"1265":9,"127":4,"1271":6,"12733892":34,"12777777777777777":[],"12790":9,"128":[3,4,13,33,34],"12829994e":29,"12846660e":29,"12871842":29,"129012":6,"12922837":[],"12952339":30,"12957454":25,"1297":9,"1298":9,"129963":31,"12it":[],"12pm":[26,28],"13":[0,1,2,5,6,7,9,11,12,18,22,25,28,29,31,32,33,34],"130":9,"13003291":[6,30],"13024288":[],"13035147135400782":11,"13040489":25,"13055555555555556":[],"13055762":[],"130694":29,"13069442":29,"131":9,"13107995":[],"13134148011170077":[],"13137881":[],"131379":[],"13152828":[],"13164176":28,"132":9,"13220608e":[6,30],"1325":6,"1326":9,"13260573":34,"1326197715":28,"13280":9,"133":[7,32],"1332":31,"134":30,"135":9,"1350":31,"13535942":[6,30],"13564988":28,"136":[0,7,32],"13600596":[],"13607502":[],"13646574":5,"13659941":34,"13661243e":[6,30],"13663125":28,"13675593":[],"136756":[],"13679863":[6,30],"13699574":[],"136996":[],"137":[0,7,32],"13729154":28,"13738633":[],"13740":9,"137652":[11,29],"138":[0,7,32],"13819592e":29,"13820":33,"13825388":[],"13847167":[],"1385":6,"1385510301651882":[],"13865173":5,"138775":[11,29],"13878649":34,"1388888888888889":[],"13890":9,"13896095":28,"139":[0,7,32],"13911934":25,"13913033":[],"139224":[],"1392559585020426e":[6,30],"139255958997547e":[6,30],"1393548":[],"13956654":[],"13it":[],"14":[0,2,4,5,6,7,8,9,10,11,12,22,25,27,29,31,32,33,34],"140":[0,2,7,9,32],"14021063":[6,30],"14046224e":[],"141":[0,2,7,32],"14100":9,"14104212":25,"1412":[33,34],"14122256":[],"1416398":[6,30],"14174745":[6,30],"1418":9,"142":[0,7,9,32],"14213876":[],"14250":9,"14260706":[],"14277718e":29,"143":[0,2,7,9,32],"14369927":[],"1437":1,"144":[0,7,32],"14400":9,"1440501043841336":1,"1441031":[],"14440":9,"14452678":34,"1446729567":4,"145":2,"14523337e":[],"14550854":11,"145509":11,"14568914":30,"14599499":[],"146":2,"14605929":[],"14629156":31,"14638":33,"14643345e":[],"14708":[],"14710":9,"14716":6,"14722222222222223":1,"147400":[11,29],"147420":[11,29],"147545":6,"1477190177681485":[],"147836":[],"1479":9,"148":[3,4,14],"14812206":6,"14815202":[],"14824254":[],"14825560e":29,"14828178":22,"14829228":[],"14841322":28,"14880915":33,"1488598":[],"149063":[],"149266":6,"14934258650797513":[],"149353":31,"149388":[],"149433":34,"149466":[],"149483":[],"149904":[],"149921":[],"14g":[6,31],"14it":[],"15":[0,1,2,4,6,7,8,9,12,13,15,16,17,25,28,31,32,33,34],"150":[3,4,8,9,14],"15005476":5,"150527":[],"15079545":[],"15098090e":[6,30],"151":[3,4,14],"15126318":34,"15130074e":[6,30],"151522":[],"15173932":[],"152":9,"15200":9,"15202654":[],"152494":6,"1527777777777778":[],"15283463":[],"153":[3,4,14],"153036":29,"15313054":31,"15361856":[],"15384615384615385":9,"154":[3,4,14],"1547556":34,"155":[3,4,9,14],"15527976":[],"15546887":[],"15593478":[],"156":[3,4,14],"15605625":[],"15670921":33,"1567286":33,"156956":5,"157":[3,4,14],"15709522":[],"157128":[],"1571284":[],"1575":9,"1575046":[],"15751952":34,"158":9,"15830902":33,"15833751":[],"1587":9,"1590":9,"15924557e":29,"15951871":33,"1598058":[],"15990":9,"15991124e":[],"15am":28,"15g":[6,31],"15it":[],"16":[1,2,3,4,5,6,8,9,10,19,25,28,29,30,31,33,34],"1603":3,"16063661":[],"16111111111111112":1,"16118615":[],"16158074":[],"161581":[],"16172219e":[],"16188604":[],"16201555":[],"16209264e":34,"16211139":5,"16220":9,"162246":5,"16231451":4,"1625":9,"1628":9,"16292908":22,"16304863":29,"163049":29,"1630775253":1,"16312434e":[],"16342407":5,"16343471":[6,30],"1636508":[],"16384":3,"16407038":28,"16411163":[],"164112":[],"16431956":[],"16445858":34,"16486151":34,"16500":9,"165272":[],"16532977":34,"16535252":28,"16567361":[],"166":9,"1664372":[],"166540":[],"16654048":[],"16710567":28,"16744759":[],"16777789":22,"167787":5,"16791183":22,"168":9,"16805821e":[6,30],"16879134":[],"17":[1,2,5,6,7,8,9,13,22,25,29,31,32,33,34],"17021424":25,"1709":9,"171":30,"171525":29,"1715252":29,"17168028":34,"17174962e":1,"17214545":22,"17222222222222222":[],"1726":9,"17260271":[],"17272182":25,"173":34,"17300":9,"1731":9,"1732863504708044":[],"17359583e":[],"17367225":[],"17377547":[],"17405911e":[],"17446471":6,"17483760":31,"175":31,"1752":9,"175300":29,"17547294e":[],"17563274":[],"17567503":[],"17641709":[6,30],"17643975e":29,"176762":[],"17676247":[],"1767857":28,"17739525":28,"17748881e":33,"17777777777777778":1,"17801022":5,"17801827":[],"17834506e":[],"17856374":[],"17861098":6,"17861414":[],"17869861e":29,"179":[],"17913653":[],"17917768":5,"1793417":[],"17934801":[],"17949575":5,"17953942":11,"17968231":34,"1797":[1,3],"18":[2,6,7,8,9,10,13,25,31,32,33,34],"180":2,"1801709":30,"18019623e":[],"18029127":5,"18043393":25,"1807":4,"1808228":33,"18085537":[],"1809":9,"18093549":33,"18094575":[],"181":9,"1810415856976313":[],"18118338":[],"1812":9,"18120973":[],"181210":[],"18147009":[],"181766185664273":[],"182086698929565":[],"1821":9,"18234308":[],"18277213":[],"18285689e":[],"18307821":30,"18333333333333332":[],"18383522":29,"18388":6,"184":9,"1840":31,"18409254":[],"18418938":[],"184519":29,"18485685":[],"184866696796263":[],"18497496":11,"184975":11,"185":30,"18501900e":29,"18510775":[],"1860":9,"18611111111111112":[],"18613217e":[6,30],"18660":9,"18670072e":29,"18673098":11,"18702469":22,"18711407":34,"18742521":[],"18816387":[],"18824338":[],"18840034e":[],"18925625":[],"189496":29,"189622":29,"19":[2,6,9,15,25,28,31,33,34],"19009085621304586":[],"190529":[],"19052935":[],"19069576e":33,"19166666666666668":1,"192":31,"19207979":5,"19220":9,"19299283":[],"1940":0,"194042826649355e":[6,30],"194042826815211e":[6,30],"1943":[12,34],"19433318":[],"1944":6,"19547923":[],"19559737e":29,"1956":9,"19569961":[6,29,30],"19583547":34,"19588651":33,"19661197":33,"19677112":[],"1970":[22,28],"1973":9,"197370":[11,29],"19740":9,"1979":[6,31],"19791352":[],"197914":[],"19800":9,"19849513":28,"19852045":[],"1_1":[12,34],"1_2":[12,34],"1_3":[12,34],"1cm":[0,8,10,25,28],"1d":[1,2,3],"1e":[1,2,4,13,14,33,34],"1e10":14,"1e4":6,"1f":1,"1k":22,"1n":[0,28],"1x":[0,28],"2":[1,2,3,4,5,6,7,8,9,10,11,12,13,14,19,21,22,23,24,25,27,31,32,33,34],"20":[0,1,2,6,7,8,9,13,19,25,26,28,30,31,32,33,34],"200":[0,2,3,4,8,9,10],"2000":[0,29],"20015436":6,"2004":[13,32],"20051449":[],"2006":27,"2008":28,"2010":1,"2011":1,"2014":4,"2015":1,"20158083":5,"201581":5,"2016":[0,28],"2018":[0,6,29,31],"2019":[8,9],"2021":[6,14,29,30,32],"20218457":[],"2022":28,"20228273":[],"2023":23,"2024":[15,16,17,18,19,20,28,29,30,31,32],"202698":[],"2026985":[],"2027":9,"20277777777777778":1,"20288581":34,"20347912":[],"20357736":[],"20367355":22,"20375464":[],"20393534":34,"204049":11,"20404927":11,"20480187":[],"204802":[],"20500":9,"2060":9,"20601797e":29,"20608548e":29,"20651434":[],"206664":5,"20666447":5,"2069":9,"20728198":[],"207545":[11,29],"20755569":[],"2077068":[],"20775115":[],"20833333333333334":1,"20834188":[],"20867052175034223":[6,31],"20912557":[],"20916295":29,"20980":9,"21":[0,1,2,5,6,7,9,12,13,22,28,29,31,32,33,34],"210340":[11,29],"21058097":5,"21070843":28,"21093775":6,"211":[],"21130":9,"2116753732":4,"21169159e":[6,30],"21192602e":[],"212":[],"21277816e":29,"213":[],"213103":[11,29],"2131067":22,"21332621":0,"21333766":28,"21344077":34,"213743":[11,29],"21390371e":[],"21430643e":33,"21444055":25,"21517262":6,"21531156":[],"21565007e":29,"21596432":6,"2160073466353432":[],"216290":[11,29],"21631786":28,"21655059e":29,"216683":[11,29],"21680864":[],"21699817":[],"21805426":[],"21813899e":[],"21998973":[],"22":[0,1,2,5,6,9,12,13,22,28,29,31,33,34],"22044605e":[5,29,34],"221":8,"221180":29,"22128142":34,"2216":9,"221666864828611":[],"22169087":[],"2218":9,"221805":2,"221921":5,"22217237e":29,"22226881":34,"222400":29,"22467274":31,"225":4,"22528536":[],"2257449":[],"22592946e":[],"226014":[],"22601408":[],"22667819":[],"22688898":[],"22690428":5,"22755839e":[],"22810365":[],"228104":[],"22842468702219465":[6,31],"2284246870221947":[6,31],"22847924":5,"22849742":[],"22871":33,"22919456":[],"2293":2,"2294":2,"2296":2,"2297":2,"22977659964799":[],"2297766":[],"22it":6,"23":[1,2,6,9,12,15,20,22,28,31,34],"23002365e":[6,30],"23076923076923078":9,"23093598e":[],"23139242":[],"23164401":[],"23167717":5,"232435":29,"23262877":34,"23303727":22,"23333333333333334":[],"23344210e":29,"2338675":29,"233868":29,"234":6,"23423987":[],"234496":5,"23449607":5,"23472994":[],"23481471":28,"2351":6,"23526911":[],"23528337":31,"235969":[],"23596934":[],"2364":9,"23663482":22,"2373286546935638":[],"23794815":25,"23847441":[],"239":31,"2397":9,"23971032":29,"23994188e":[],"24":[0,1,6,9,22,28,31,33,34],"2401":23,"24032019":[],"24071032":[],"24106503":33,"24140":9,"24159785":29,"2416":9,"24175744e":[6,30],"2419":9,"24224776e":[],"24225043":34,"24254071":[],"24284399":[],"2430":9,"24346138":25,"24369936":[],"24377554":[],"243776":[],"24390":9,"24398826":[],"24433117":[],"24444444444444444":[],"24454968":[],"24485814":33,"24493666":31,"246":2,"24602146":33,"24613581":28,"24640494":33,"24688853":[],"24692014":[],"2475908482537097":[],"24759085":[],"24768421e":33,"24780663":22,"24829908":5,"24856992e":[],"24906604e":[6,30],"24it":[],"25":[2,3,4,5,6,8,9,11,22,23,29,31,33,34],"250":[2,4,7,9,32],"25000":0,"25185716":30,"251879":29,"252008":5,"25200841":5,"25233253":[],"252333":[],"252436":29,"25343155":31,"25354173":34,"253891":[],"25389111":[],"25458506e":[],"2546186":[],"254619":[],"2546817701709956":[],"255":3,"255001":29,"25512598":[],"25555619":[],"256":[2,4],"25617655e":[6,30],"25617658e":[6,30],"25673276":[],"256733":[],"25695398":31,"25705685":[],"2572":9,"2575":9,"25849623":[],"25879315330607":11,"259153":[11,29],"2597":9,"25970297":[],"25986026":[],"25989189":[],"26":[6,9,16,25,31,33,34],"26001134":25,"26048873":[],"26083712":34,"26113912":[],"26124692":6,"26152075":28,"26254957e":29,"262648":[],"26264849":[],"26281735":33,"26292364":31,"26297455":29,"26301436":5,"26307235":[],"2630723514841553":[],"26321660e":29,"26378176e":[],"26402837":34,"26409315307910025":[6,30],"2640931530791004":[6,30],"26464303e":[],"26479234":[],"2650":9,"265109911":4,"26527089":22,"2654":9,"265868":[],"26586817":[],"2662452":[],"2666905":28,"26680052":[],"266801":[],"26710969":5,"26715191":[],"26775644":[],"26780278":5,"268":9,"26814548":6,"26817703":[],"26995402":29,"27":[0,1,6,20,31,34],"27065633":30,"27124938":[],"271260217275557":25,"27126022":25,"27231287":28,"27352535e":[],"27470622":33,"27482829e":29,"2750":9,"2751616":[],"27597777e":[],"27600259":[],"27602210e":[],"27623637":[],"276263":[11,29],"27633474":34,"27693602e":34,"27700":9,"27760":9,"2781456":[],"27861634e":[],"27924636":5,"27933134":22,"27it":[],"27n_":25,"28":[1,3,4,6,9,31,33,34],"28000355":[],"280004":[],"28021598":28,"280464e":34,"280573":5,"280647":[11,29],"28109198":[],"2813829":[],"28164443e":[],"28183460e":[],"28205578e":29,"28253033":22,"282727":[11,29],"28306304e":[],"2830637392":4,"28316949":[],"28336218e":[6,30],"28390":9,"28391978":29,"28399125":[],"28415767":[],"28443039":31,"28457291":[],"28475098":8,"28496213":28,"28542801":[],"2861":25,"2871":9,"2873":9,"2876045":[],"28776411":34,"28793787":[],"2882":25,"2885519":[],"2886":25,"2890":[0,28],"2892":25,"28923":[],"28956161":[],"2895786617507":11,"28it":[],"29":[2,6,9,31,33,34],"29015871":[],"29033075e":[],"29100624e":[],"291056":[],"2915":25,"29167186":5,"29223521":[],"29238145":[],"29253213e":[],"29306584e":29,"2931":28,"29350":33,"29390668":[],"29398019":[],"29491144e":29,"29541992e":[],"29620357":[],"29633608":34,"29653038":33,"2968":28,"297648":5,"29764815":5,"2976637":[],"2980":28,"298037":[],"29803738":[],"29822833":[6,30],"29860173":33,"2986082":[],"29861395":[],"29881308":[],"2990":28,"29902518":33,"299748":29,"2_":[12,34],"2_1":[12,34],"2_2":[12,34],"2_3":[12,34],"2_i":[12,34],"2_m":[6,25,31],"2_t":[13,33,34],"2_x":25,"2b":25,"2c8f433990d1":[33,34],"2cm":8,"2d":[1,3,11,12,21,28,34],"2e":[6,31],"2f":[0,7,9,10,11,12,28,29,32,34],"2g":2,"2g_i":2,"2k":3,"2m":[6,31],"2n":[0,2,3,28,29],"2nd":[9,34],"2p":25,"2pm":26,"2pt":4,"2x":[0,3,8,13,28,33,34],"2x_ix_jy_iy_j":8,"2x_j":8,"2y_i":10,"2y_j":8,"3":[1,2,3,4,5,6,7,8,9,10,11,12,13,14,17,18,21,22,23,24,25,26,30,31,32,33,34],"30":[0,1,2,4,6,7,9,10,13,16,26,29,31,32,33],"300":34,"30000":[0,28],"30000613":34,"30005983":[],"30010":9,"300231":5,"30023144":5,"30117681":34,"30119421":8,"30124108":[],"30134885":[],"30141906":34,"30190897":11,"301909":11,"302":31,"30258509":[22,28],"30269539":22,"30283188":30,"303":6,"30306759":33,"30334592e":[],"30387411e":[],"30400113":[],"30442964":29,"30466214e":[6,30],"30506075e":[],"30607268":33,"30637636":34,"3072":3,"3076923076923077":9,"30787294":6,"30915293":[],"309153":[],"30916988":[],"309170":[],"30917499e":[],"30940":9,"3096154":[],"30982436":[],"3099":31,"30it":[],"31":[2,12,22,25,34],"310579":29,"3105791":29,"310957":[],"31095745":[],"31160886":[],"31162122":[],"312":30,"31227657e":[],"3123314713548606":[6,31],"31248425":33,"31276579e":[6,30],"313":30,"313155":11,"31315504":11,"31318084":5,"31363366":34,"31453949":[],"31457796":5,"314869":[],"31486917":[],"315":[6,30],"3155":[0,5,6,30,31,32],"31555734196707536":[],"31571995":[],"316":30,"31601423":[],"31664443e":33,"31702609":34,"31718909":11,"31727523":[],"317367":11,"31849289":28,"31876431e":[],"31896852":8,"31936237":[],"3194467":[],"31it":[],"32":[2,3,4,6,8,12,13,22,25,33,34],"3200":1,"32003025":[],"320656":[],"32065614":[],"32068736":28,"3207":31,"32084559e":29,"32149601703519115":[6,31],"3214960170351912":[6,31],"3215":9,"323059":5,"32305911":5,"323184775146844":[],"32318478":[],"32393078":[],"324":2,"32419549":[],"3241988":[],"32422234e":[],"3245":2,"32450054":29,"3250":1,"325228546249804":[],"32522855":[],"3260513":[],"32606139":34,"3262":6,"326238":29,"32641434":28,"32651488":[],"32684035":[],"32733949":[],"3280928":[],"328093":[],"32825214":34,"32906581":[],"32932635":[],"32it":6,"33":[9,12,22,26,34],"33000573":28,"33006628":33,"33025801":[],"33049619":25,"33062878":[],"330629":[],"33066907e":[5,29],"33096549":22,"33107417":[],"33145794":[],"33166055e":5,"331939":29,"33212971":[],"33217312":25,"33220123":[],"33235647":[],"333":[7,32],"33532886":28,"33596404":[],"33615742":[],"33675308":[],"33734605":22,"33742926":28,"33826500e":[],"3388112":[],"33978889":33,"33it":[],"34":[9,22],"340071371496255":29,"34026086":[],"3403":9,"340782":[11,29],"34114547":5,"34182884":34,"34225662":22,"342680":29,"34271514":[],"34332677":[],"34346829":[],"3436":[0,28],"34367970":6,"3437":[0,28],"34412923":29,"344176915013831":[],"34427423":[],"34483937":[],"34483955":28,"34568909":[],"34569596":5,"34598722":22,"34599598":[],"346000154268618":22,"34620097":[],"34654596":[],"346546":[],"34661376":[],"346614":[],"34759233":34,"3480527":25,"34871778":[],"34904819":[],"35":[0,6,17,23,26,28],"35018806":[],"35098705":[],"35140":9,"3514835":[],"351636":[11,29],"35182854":5,"35196964":[],"35243372":[],"35275513":[],"35320952":[],"35354073":[],"35432563":[],"3544313922":6,"35470445e":[5,29],"35506347e":29,"35520169":[],"35533773":6,"35537114e":[],"35613536e":29,"356399":29,"356673":[],"35667342":[],"35714377":[],"35731585":28,"35736":33,"357508":29,"3577615":34,"3581341341":4,"35870701":25,"359":[5,30],"35957915":[],"35966688":[],"35980374":28,"35986305":[],"35it":6,"36":[0,5,6,23,25],"360":1,"36091273":[],"3613":9,"361541":5,"36154104":5,"361556":29,"36185989":[],"3621311":5,"36235052e":[],"36303682e":29,"3632959111950474e":[6,30],"363295916366933e":[6,30],"36339156":[],"36353321":28,"36482524":[],"36545697e":[],"3655222":5,"366375489616074":[],"367":[2,9],"36754671":[],"36880327":22,"36895644":31,"369139":[11,29],"36it":6,"37":[9,23,32,33,34],"37013105":22,"37055062":[],"370782966":4,"37093787":[],"37135473":[],"37153115":28,"37175575":33,"37239927e":29,"37255873":34,"3727791":28,"37396662":[6,30],"37415625e":29,"37449168":22,"37454707":22,"374675":[],"37467515":[],"37507799e":34,"37532078":[],"37582891":[],"375829":[],"37600869":28,"37685349":[],"37700967e":29,"377372":29,"37737221":29,"3777801602":6,"378271":[],"37827145":[],"37837864":[],"37900111":[6,30],"37919989":28,"38":[0,9,23,25],"380":9,"38102552":[],"38135733e":[6,30],"3817475779":[6,31],"38198866":28,"38203725":[],"38259084":33,"38298234e":29,"38337498":[],"38381781":[],"38399622":[],"38440469":[],"38460453":22,"38461538461538464":9,"38461539":33,"38592549":25,"386":9,"38612299e":29,"386161":[],"38616125":[],"38618024":[],"38629436":[22,28],"387":31,"387620":11,"38762019":11,"3882273":[],"38827994":6,"38865681e":[],"38916861e":[6,30],"3892":31,"38934047":28,"38962192e":[6,30],"38992371":34,"39":[0,9,26,28,34],"390334838933238":25,"39033484":25,"39039235":22,"3908470004999506":[],"39090680e":[],"3910042":28,"39197698":29,"391977":29,"39214397":29,"392144":29,"39223923":[],"39279291":28,"39398622":[],"394":9,"39517073":[],"39525059":[],"39540235":[],"39579407":5,"395980256477532":[],"39598026":[],"39614949":[],"39621036e":[],"39692815":[],"39706038":5,"397700":[11,29],"39789527":[22,28],"3983":6,"39855569":[],"39865452":[],"39922082":[],"39929428":[],"39931051e":29,"39952356":[],"399836":29,"3d":[2,3,4,6,13,23,31,33],"3f":[1,3,9],"3n":22,"3x":[2,8],"3x_i":2,"3y":8,"3yk470mj5p931p9dtkk0y6jw0000gn":[1,6,28,31],"4":[1,2,3,4,5,6,7,8,9,10,11,12,13,14,17,22,23,25,28,30,31,32,33,34],"40":[1,6,9,23,26,28,31],"400":4,"4000":[9,28],"40037367e":[],"40072098":[],"40093324":[],"40140374":[],"401842":[11,29],"40184681":22,"40266454":[],"40354798e":29,"40415979e":[],"40418675":[],"404783":[],"40478305":[],"405":9,"4050":[27,28],"405890":[11,29],"405964":[],"40596423":[],"40605118":34,"40620066":29,"406201":29,"40632663":[],"4069157":[],"407":9,"408":9,"40833375":[],"4087":9,"4087793":5,"40927184e":[6,30],"40it":6,"41":[2,9,22],"4107":9,"41146753":28,"4121966338442804":[],"41310208":[],"41366128e":[],"41408221":[],"41433969":5,"41487642":28,"41511965e":1,"4155":[2,15],"4162706317":6,"41636775":[],"41664613":25,"4166666666666667":9,"41675053":[],"41744203":[],"41764479":[],"417644792969273":[],"41820116":22,"41842093e":29,"418506":[11,29],"41869784":28,"41882037e":[6,30],"41925189":[],"41987877":[],"4198932":28,"42":[1,4,8,9,10,22],"42083463e":[],"42095725":28,"42124182":[],"4215795":22,"42197297e":[],"42305151":[],"4230769230769231":9,"42310878":25,"423646":[],"42364634":[],"42392359":[],"424274":[],"4242743":[],"42441033":5,"42450":9,"42497724":34,"42553096":[],"42575338":22,"426":[6,9],"42774546":[],"42873361":28,"429":31,"42945319":[],"43":[0,1,7,9,22,32],"43054282":5,"4310":28,"433":31,"43330971e":[6,30],"43373107":[],"435163":29,"43563433":22,"43579948e":[6,30],"43639284e":29,"436462435":4,"43703545":[],"43727575":[],"43766686":11,"43779698e":[],"438060758":6,"438136":29,"439230":6,"43962226":[],"43976975777097144":[],"43984553e":[],"43it":6,"44":[0,1,22],"44089210e":[5,29],"441":[3,4,14],"442":[3,4,14],"44255455":34,"442600":[11,29],"44286735":[],"443":[3,4,14],"443217":29,"44395301":30,"444":[3,4,9,14],"44418124":33,"44454123":28,"445":[3,4,14],"44536331":28,"44563226":[],"446033":31,"44624525e":29,"44658658e":29,"4477214":5,"44830934":[],"44838546":[],"44970586e":1,"44995924":22,"45":[9,26,28],"450":9,"450257":[11,29],"4504":9,"45053025":28,"45193407":[],"45430236":[],"455173":31,"45560415":[],"4557763":11,"455947":29,"456":9,"45620975":[],"457":2,"457311":[],"45731144":[],"45731379":22,"4576811":28,"45781905e":33,"458027":29,"458078":[11,29],"4580854":[],"4591127":22,"45915671e":29,"45960079":5,"45it":6,"46":[2,9,26,28],"460":[9,11],"4601":9,"46065811":22,"46086448":22,"46107913":[],"46134248e":[],"46153846153846156":9,"46170878e":33,"4619526":22,"462":[7,32],"46318204":34,"46342934":[],"4635149":[],"46383925e":[6,30],"46383926e":[6,30],"46387965":[],"46415522":[],"46415888336127775":30,"46544987":[],"46593404":[],"46660941e":[],"46713267":30,"46736215":31,"4676059":29,"467606":29,"46891823":[],"46911594e":[],"46954702e":[],"46963249":[],"46984559":[],"46984697e":[6,30],"47":[2,9,26,28],"47042744":5,"47051432":31,"47052809":[],"470714":29,"47075725":6,"47116868e":[6,30],"47125748":5,"47132891":5,"4725246793626128":[],"4729218":[],"47297587e":[],"47313680":31,"47334547e":[],"47433659":[],"4745474":[],"47478922e":[],"47610036":6,"4761747":[],"47729832":[],"47757553":[],"47815203":11,"47823856":33,"47892661":[],"47910545":[],"479465113":4,"47989224":[],"47991892":[],"47it":6,"48":[2,9,31],"48004784":28,"48062913":[],"48151166":22,"48170743":[],"481979":6,"48200792":[],"48233952":34,"48257387":[26,28],"48268005e":[],"48306473":[],"48307405":[],"4831139":[],"48326853":[],"48399942":[],"48420061":[],"4843772":28,"48476997":11,"484905":5,"48490503":5,"48494803":30,"48521055":29,"48697869":[],"486979":[],"4870934":[],"48826894e":29,"48827791":[],"48843174e":[],"48867802":[],"48900413":[],"48931464":[],"489315":[],"48994188":5,"48it":[],"49":[5,6,9,11,23,29,33,34],"49074536":[],"49123502e":[],"49152":3,"49156266e":[],"49211524":[],"49224801":[],"4937346":22,"49381549":[],"49392067e":29,"4940954":[0,28],"49470005":[],"49513019":25,"4951301940723654":25,"49584063e":29,"4959161509357395e":[6,30],"4959161509366685e":[6,30],"49611541":[],"4990":25,"49910481e":[],"4992":25,"49939493":[],"499394932852416":[],"4997":25,"49it":6,"4c4c7f":[9,10],"4d":3,"4f":6,"4pm":[26,28],"4y":8,"4y_i":10,"5":[1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,22,23,25,28,29,30,31,32,33,34],"50":[1,2,3,4,6,7,8,9,10,13,28,29,31,32,33,34],"500":[1,3,4,6,9,10,13,31,32,33,34],"50000000e":34,"50000455":5,"50000553":5,"50000718":5,"50000855":5,"50000969":5,"50001063":5,"50001142":5,"50001207":5,"50001261":5,"50001306":5,"50001343":5,"50001374":5,"500014":5,"50001414":5,"50001422":5,"50001439":5,"50001454":5,"50001466":5,"50001476":5,"50001485":5,"50001492":5,"50001498":5,"50001502":5,"50001506":5,"5000151":5,"50001512":5,"50001515":5,"50001517":5,"50001518":5,"50001519":5,"50001521":5,"50001522":5,"50001523":5,"50001524":5,"50001525":5,"5018":25,"5020612":25,"50227564e":[6,30],"502698":[],"50269821":[],"50306335":[],"50321091":5,"50327198":22,"50427787":31,"50482139":34,"50530832":31,"506":0,"50600514e":34,"50610071e":33,"506553":29,"50655336":29,"50667812":[],"50714096e":[],"5076963":22,"507d50":[9,10],"50846111e":[6,30],"50846112e":[6,30],"50850373":[],"50887105":[],"50911289":[],"50it":[],"50j":[13,33],"50x10":1,"51":10,"510":1,"5105332296929628":9,"51069279":22,"51104913":[],"51136852":[],"51154388":[],"5116375":[],"511888":5,"51317506":[],"51364117":22,"51374050":31,"514219":29,"5142856":[],"51437058e":29,"51447004":28,"51512235":[],"51546825":28,"51564682":22,"51643579":[],"51659846":33,"51709529":[],"51728978":34,"5177783846":4,"51858116":[],"51914183e":[],"51928402":22,"51937727":22,"52":[32,33,34],"52031552e":29,"52087499":[],"521422502348998":11,"521558":[],"52155823":[],"52173381":[],"5222222222222223":1,"52284329e":29,"52301447e":29,"52317963":[],"52362157e":29,"52397611":[],"52446101":25,"5257011":34,"52573336":11,"52635761":22,"52654886":[],"52657934":22,"526744":[11,29],"52698542":[],"52706754":11,"527068":11,"52732966":[],"52780600":31,"52874252":5,"52876551":[],"52888979":[],"52989287e":[],"52it":[],"53":[9,32,33],"5303329":11,"53052247":[],"5305555555555556":1,"53105728":[],"53125507":22,"531280":29,"53149078":[],"532":[],"5321613":[],"53285379":[],"532854":[],"533":[],"53312817":28,"534":[],"535":[],"53512750e":[],"53534008":25,"53585173":[],"535852":[],"53629564":22,"53640693":[],"537":[],"53703498":6,"53723188":[],"53729411e":29,"53732988":34,"53738247":31,"5378811":11,"538":[],"5384615384615384":9,"539":[],"539261":[11,29],"53942728":[],"53996947":[],"5399913":[],"53it":6,"54":[6,9,25],"540":9,"54011398":[],"54039921":5,"54041041e":5,"54057582":[],"541605":29,"54175461":33,"5426270409877345":[],"543939":29,"54393936":29,"5443909":[],"544439":29,"54490887":[],"54637219":31,"54725976":[],"54811237":25,"548263635652985":[],"54843215":[],"548432150659993":[],"54856099":[],"54873252":[],"54880148":[],"54921401":[],"54935794":28,"54it":6,"55":[1,9],"55020405":34,"55020649":[],"55042779":[],"551023":5,"55102329":5,"55179339":[],"55196383":[],"55386681":28,"55460327e":[],"55542568":[],"5555555555555556":1,"55582742":28,"5567":6,"55688514":25,"557795":[11,29],"55838":33,"55854694":11,"559791959661649":25,"55996153":[],"55it":[],"56":[1,9],"56033697":5,"56042437":[],"56072658":[],"561410":[],"56141009":[],"56198284":5,"56342158":[],"564":9,"56423957":[],"56423957069263":[],"564374":[11,29],"56453869":[],"564759":[],"56475921":[],"56476512e":[],"565":9,"56536":[0,28],"56541622e":[],"56589683":31,"566":9,"56636616e":[6,30],"567":9,"56763673":[],"56783103":22,"56790195e":29,"568":[9,31],"56804783":[],"56832496e":[],"56857739e":[],"569":[1,9],"56912044e":[6,30],"56922102":28,"56939714":5,"56947078":34,"56965674":31,"56967917":[],"56977352":[],"56it":[],"57":[0,8,9,26,28],"570":9,"571":[5,30],"571105947979344e":[6,30],"571105947979412e":[6,30],"57192197":[],"57201944e":[6,30],"57252451e":29,"57261202":[],"574465":[11,29],"57468142":28,"57492326":[],"57521514":[],"57584612":[],"575870409023631":[],"576":31,"5769230769230769":9,"57803254":28,"57819238e":[],"57847325":[],"57881465":[],"57886743":[],"57914918":[],"57933547":25,"58":[9,10,26,28],"58013829":34,"58084123":[],"5833333333333334":9,"583595":29,"5847256":[],"58492636e":29,"58493493":[],"58493681":[],"58583003":[],"58589719":28,"58735893":[],"58827236":6,"5888888888888889":1,"58890784":[],"58914105":[],"589841":[],"59":9,"59009792":11,"59078383":[],"590784":[],"591317992":4,"59184268":[],"59215613":[],"59244881":[],"59348521":[],"59354079":6,"59355752e":29,"59372982":22,"594241":[],"59424119":[],"5944444444444444":1,"59465457e":[],"59491404e":[],"59630232e":[],"59683811":[],"59698459":25,"59730078":[],"59779819":33,"59875207":[],"59884169":28,"59908884":[],"59963873":[],"59971727":[],"5cm":25,"5f":[8,33],"5x":8,"5y":8,"6":[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,17,22,25,26,28,29,30,31,32,33,34],"60":[1,3,6,9],"60000":4,"60026673":[],"60041459e":[],"600529":[],"60052901":[],"60160003e":29,"6019067271":4,"6029291":[],"60293962":5,"60342978":31,"60375434":22,"6038642":[],"60418171":[],"60420593":5,"60451189e":[],"60543038":29,"60552651":[],"60588173":28,"60605083e":[],"606251":[],"60625144":[],"60664448":[],"60673226":11,"606760":5,"60762863":[],"60921896":[],"60929685":31,"60940356":[],"60943791":[22,28],"60999067":[],"61":1,"61069681":22,"61083596e":[],"61106937e":[],"6111111111111112":1,"61113781":[],"61192203":[],"61192712":22,"612939":29,"61321722e":[],"61325173":[],"613579":29,"61382924":[],"613893902124586":25,"61395701":[],"61414743":22,"61468323":25,"614808":[11,29],"6153846153846154":9,"61564092":[],"6156409232714415":[],"61602014e":[],"61621902":[],"61774362":[],"61775176":31,"618746":[],"61883807":[],"618982":29,"61979664e":[],"62":1,"6200":28,"6201":28,"6202":28,"6203":28,"6204":28,"62113349e":29,"621584":[],"62158409":[],"62242138e":34,"62275788":33,"62286539":[],"62351789":[],"62373464":11,"625":[7,32],"62551462":25,"62573269":28,"62617788":22,"62620041e":[],"626635268":[6,31],"626678":[],"6266783":[],"6267112":[],"62671667":34,"62725226":30,"628":6,"62863106e":29,"62886648":[],"62894215":5,"62905281e":[],"62908496":22,"63":[0,1,6,9,31],"63025821e":[6,30],"63030526":[],"63031478":[],"630315":[],"63037846":6,"63046054":[],"63071772":[],"63142399":28,"63142731":34,"63162342":29,"63207408":34,"63209435":28,"63249532e":[6,30],"63309898":[],"6333349473431832":25,"63490568":25,"63498144":5,"63546236":[],"63555267e":[],"63619709":29,"6380763200092493":[],"63833441e":[],"6383903":28,"63896182":[],"638962":[],"6389681":[],"63898112e":29,"63919355":5,"639194":5,"64":[1,2,3,4,13,22,28,33,34],"64009263":[],"64012627":5,"6401576":[],"6407249":[],"640x480":[6,13],"64316192":31,"64322974":[],"64361375":28,"64362404":[],"64373221":[],"64373635e":33,"64399916":[],"64411666":[],"64412879":[],"64425744":[],"64564368e":[],"646283":[11,29],"64713979":[],"64742912e":[6,30],"647473":[11,29],"64796751":28,"64857542":[],"64885265":22,"649":[],"64909048":[],"649382":[11,29],"64976691":[],"64x50":1,"65":[1,2,8,9],"650":[],"65082441":[],"651":2,"65183066":[],"651831":[],"652":2,"65293772":[],"653":2,"6533977":[],"653398":[],"6536392":29,"654":2,"65442354":29,"654424":29,"65475653":[],"655":2,"65543115":[],"65554958":[],"65571174e":29,"65591748":[],"65593984":[],"65599456":29,"656":[],"65641173":[],"6568154596723088":[],"6568686180915178":[],"65686862":[],"65720152e":29,"65738717e":29,"65743689":29,"65759901":[],"658":2,"65833132":29,"65885453":5,"65889641e":[],"65891389":29,"658914":29,"659":2,"65900052e":[],"65917558":22,"65944342":33,"65it":[],"66":2,"660":2,"66018725e":29,"66063786":[],"66064822":29,"66080313":29,"66204648":6,"662836197064178":[],"66289235":[],"66294408":29,"6629598":[],"662960":[],"66365453e":[],"6638":9,"664314":5,"66431407":5,"66456459":[],"66487438":[],"66498292":[],"6652177":29,"66560":9,"6663569":[],"667":9,"6671767":[],"66729685":[],"66757105e":[],"66809369":[],"668172":29,"6690108":[],"66951679":[],"67":[1,2,9],"6702":[],"67047975e":[6,30],"67088558":[],"67100236":[],"67231298":[],"67238764e":[],"672721":29,"672759":[],"67275915":[],"67313212":[],"67314874e":5,"67374815":22,"674":31,"67435043":25,"67464946":[],"67490857":33,"67495943":[],"67524588":22,"67561021":28,"67819487e":[],"67834752":34,"67875366":[],"678754":[],"67it":[],"68":2,"6801":[],"68072161":22,"6809195":[],"680920":[],"68092237e":[],"6816947":[],"68192193":5,"68257097":[],"68286725":29,"6831505":[],"68352799":[],"68534263e":[6,30],"68542204":5,"68591105":[],"68637642":[],"68655456":22,"6869":9,"68735473":28,"68822559":[],"688226":[],"68826552":28,"68857788":[],"6887363571":4,"68879472":[],"68929213e":[6,30],"689519":[11,29],"69":[2,9,25],"690":9,"690617":29,"69069n_":25,"69089532":22,"691":[],"691364":[],"69136414":[],"69182892e":29,"69227923":[],"69230769":33,"6923076923076923":9,"69247718":22,"6927554":22,"69303453":[],"693035":[],"69391797":[],"69417174":[],"69435454":[],"69438869":[],"69465386":22,"69484813e":5,"69504801":6,"69515531":[],"69566966":28,"69634577e":[6,30],"69695259":5,"697346":[],"69734609":[],"69756791":[],"69768266":11,"6980":[33,34],"6988905":28,"69903406":[],"69983227":[],"6999536":11,"69it":[],"6n_":25,"6pm":28,"7":[0,1,2,3,4,5,6,7,8,9,11,12,13,14,15,22,24,25,27,28,29,30,31,32,33,34],"70":[1,6,7,9,32],"7002164":25,"70037324e":29,"70039784":[],"701370":5,"70241548":[],"7026722043092946":[],"7029975":[],"70301068":[],"70362677":[],"70469324":28,"70474145":[],"70499955":28,"70514808":[],"70587399":[],"705946":[],"70594608":[],"70630967":[],"70653767":4,"70665448":[],"70704566":[],"7070883":28,"70710678":[5,29],"70711022":[],"7074705":[],"70832814":5,"70857635":[],"7086067479626619":29,"70928399":11,"709284":11,"71":1,"71142161":29,"711422":29,"7119":9,"712018":[11,29],"71261809":[],"7127128":28,"71332117":[],"713763":[],"71376303":[],"71384267e":33,"71441086":[],"71469351":[],"7150195":28,"71507714e":[],"71524686":[],"71582784":[],"71737253":29,"71761101":29,"718165":5,"71838601":22,"71860732":[],"7198234":[],"720889407643293":[],"72174172":11,"72236654":[],"72271878e":[6,30],"7228852":[],"72309979e":[],"7236674":5,"724":3,"72427854":[],"7249499":[],"725256":[],"7252563":[],"726017":[],"72601722":[],"72602818":[],"72710494":28,"72744372":[],"72770687":5,"727707":5,"72771857":[],"72848736":[],"72859758":5,"72952595":[],"72962885":22,"72964493e":[],"72981762":8,"72992196":[],"73":[6,9,31],"73018893":[],"73062648":[],"73063053":[],"73068535":[],"73071831":25,"731000":29,"73122034":[],"73176319":22,"73203674":[],"73252708":33,"73265885":33,"73305640e":[],"733096":29,"73337355":[],"73578772":[],"73595198":[],"73646130e":[],"73690387":33,"737184":[],"73718419":[],"73741131e":[],"73785069":[],"737851":[],"73853838":34,"73958682":[],"73986200e":29,"73994248":[],"74":[6,31,33,34],"740":9,"74028787e":[],"7403629637766833":11,"74038232":[],"74075864":25,"74081822":8,"74171049":[],"74259663":[],"742597":[],"74272285e":[],"74291603e":29,"74384949":29,"74607851":29,"74613334":[],"74724414e":29,"74724774":33,"74829661":29,"74840212":5,"7487814387207385":[],"74878144":[],"74883972":[],"74900488":5,"74957448":[],"749765":29,"75":[5,6,8,9,11,23,29,31,34],"75018686":[],"750187":[],"75025744":[],"750445":29,"75050135":29,"75080943":[],"7509571":[],"7510197":[],"7511273":[],"75131415":[],"75138064":22,"751699":[11,29],"75170092":5,"75216828e":33,"75269037":29,"75300068":[],"7539148284817965":28,"75406226e":[],"75433448":[],"7546682196464342":[],"75532041":[],"75576555":29,"75600095":[],"756352":29,"75654448":[],"75677341":[],"756828":[],"75682834":[],"75760403":[],"7577":31,"75770568":29,"7577113351177733":[],"75956617":22,"76":[9,26,28,32,33],"76120718":[],"761574":[],"76157429":[],"76190591":30,"76262775":[],"76277254":[],"7642448":[],"764245":[],"765":[7,32],"76527062":[],"76533281":5,"765333":5,"7658599":[],"76612827":[],"766163196245293":[],"76686148":[],"76690383":31,"76692036e":29,"767367275553824":[],"76790092":[],"76807288":[],"76855921":22,"76887316e":29,"7692307692307693":9,"76936315":5,"76940759":25,"76942272":[],"7694444444444445":1,"76996262e":[],"77":[9,26,28,33,34],"77030637":22,"771128":[],"77152076":5,"77152924":[],"7718":9,"77199379e":[],"772588722239781":[33,34],"77352152e":[],"77354301":[],"774498":[],"77449804":[],"77465911":[],"77482712":[],"77507653":[],"77559615":[],"77635684e":34,"77636e":[33,34],"77652198e":29,"77659961":25,"7766443":[],"77714169":8,"77725472":[],"777255":[],"77803692":[],"7782028952":4,"77845284":[],"77873845e":[],"77959897":[],"78":[],"78009660e":29,"78156479e":5,"78184120e":[6,30],"78186404":22,"78254537":[],"78278086":[],"78326199e":[],"78671736":[],"78745927":[],"78758569":[],"78876155e":[],"78892891":[],"78941903":5,"79":[],"79111643":5,"79135536e":29,"79171202":22,"79247398":[],"79280475":[],"793167":29,"794282":[11,29],"79469098":[],"7953443":30,"79622905":[],"79623487":5,"796235":5,"79633065":31,"79718864":28,"79778008":6,"79787194":11,"797872":11,"797e":6,"79849321":34,"79866484":[],"79870689e":29,"7989356":28,"79898903":22,"7d7d58":[9,10],"8":[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,18,22,23,25,28,29,30,31,32,33,34],"80":[0,1,5,6,8,9,29,30,31],"800":[4,7,32],"80056922":[],"801356":[],"8030191":[],"80354994":6,"80410179":[],"80413696":[],"80460179":31,"80469739":5,"8055555555555556":1,"80609615e":[6,30],"80609616e":[6,30],"80637385":[],"80740939":28,"80847477e":[6,30],"8084934":22,"80855691":[],"808557":[],"80907609":33,"80979265":[],"81":1,"81007381":28,"81035098":34,"81042619e":29,"81048318e":[6,30],"81160425":5,"81218742e":29,"81246697":25,"81283649":[],"81318307":[],"8133":6,"81333808":6,"81425129e":29,"81479491":[],"81506255":[],"81559586":[],"815am":[26,28],"81622636":[],"81633628":11,"816454":29,"816847":29,"81839897":[],"81919129":[],"819253":[],"81925302":[],"81947005":22,"81979166":25,"82":[],"82060913e":29,"8207274870895702":5,"82079885":[],"82121282":[],"82161167":28,"82198978":5,"82242798":[],"8227":[],"8232102961414203":[],"823417":[],"82341746":[],"82376174e":29,"82418008":[],"82418352":[],"8244":[],"82533209":11,"82551764":22,"82559478":[],"82623709e":[],"8265786":5,"82688363":[],"82802004":[],"82832579":[],"82914126":[],"829252":[],"82925222":[],"83":2,"83020679":[],"8305555555555556":[],"83146596":31,"83363025":[],"83369175":[],"83463634e":29,"83466807":[],"83512277":5,"83641435":33,"83655756":28,"83718206":[],"83823317e":29,"83870189":6,"8387133":[],"83884553e":[],"839957":[],"83995705":[],"84":2,"84159992":[],"842":[0,7,32],"8423144":22,"842436":29,"84254917":[],"843":[0,7,32],"84351715":34,"84355903e":1,"844":[0,7,32],"84401886":5,"84443254e":1,"84478178":33,"84605507":[],"8461538461538461":9,"84661230e":[],"84707251e":29,"84711297":[],"84726382":[],"84767088":[],"8476874":[],"84780262":6,"84789579e":[],"8485":31,"84858":31,"84862355":28,"8488":31,"84923989e":[6,30],"84972787":[],"84994524":5,"85":[1,9],"85005989":[],"85014487":[],"850164":5,"8505072899794293":[],"85064942":11,"85079059":[],"85108001":[],"85112594":22,"8517571":[],"85222243":[],"85259666e":[],"85263220":6,"85276538":22,"85278920e":5,"85293303e":29,"85378708":[],"85408468e":33,"85422602":[],"85551266e":29,"85601992":5,"85625134":28,"85703369":34,"85711016":28,"85777073":[],"857771":[],"858":9,"8583333333333333":[],"85871255":[],"85945208e":29,"86":2,"86009093":[],"86016288":[],"86062977":6,"86066395":[],"86067818":[],"86117291":5,"86123808e":[],"86134827":5,"86143379":[],"86145244":11,"86174943":[],"86192682e":29,"86197958":[],"86240935":[],"86247117":[],"86267497":[],"862675":[],"86273371":30,"8638888888888889":1,"86416941":[],"86445334":[],"86459987":28,"865":[0,7,32],"86519139":22,"866":[0,7,32],"86602331":[],"86629161":25,"86630":9,"86643649":[],"8666666666666667":1,"867":[0,7,32],"86810":9,"86867512":11,"86891741":[],"8691787":28,"86943859":34,"86978877":[],"87":9,"87020155":34,"8702784034":4,"870337":[],"87068171":30,"87070464":[],"870704644539707":[],"87072815e":29,"87093752":[],"87148597":[],"87169607e":29,"87186187":25,"8720648":25,"8722222222222222":[],"87340054":[],"87381451":5,"87399194":[],"87494456e":29,"875":1,"87584434":[],"8759":[33,34],"87627342":31,"87696461":[],"877":6,"87732748":[],"87740526":28,"87788573":[],"87818331":[],"87878356":25,"87884833":[],"87981676":[],"88":[28,33,34],"88046261":5,"8805555555555555":[],"88064505":34,"88135577e":[],"88157423":28,"88168312e":[6,30],"8817842e":34,"88182591":29,"88236598e":[],"8825782":[],"88289263":28,"88323026":29,"88336879":5,"8834":[],"88377332":[],"884669":29,"88501323":[],"88529063e":[6,30],"88551766e":29,"88613493":29,"88639567":28,"88653291":28,"88738394e":[],"88809826":28,"88860399":25,"8888888888888888":[],"88960947":[],"8896094720230128":[],"89":9,"890033":11,"89003324":11,"89017198e":29,"89058005":28,"8905826":[],"89126914e":29,"8917148":[],"891715":22,"89184351":[],"89288636":11,"8931686":33,"89408972":[],"89410423":5,"8944444444444445":[],"89457785":[],"89463761e":[],"89533642":28,"89540936":[],"8962":[],"89654756":34,"89710385e":[],"89724282":[],"89766337e":[],"8978":[],"89845198":25,"8f":[6,31],"8g":[6,31],"8n":22,"8x8":1,"9":[0,1,2,3,4,5,6,7,8,9,11,12,13,14,18,22,23,24,25,26,28,29,30,32,33,34],"90":[0,1,6,9],"90075537":5,"9011":6,"90114639":28,"90135464e":29,"90220243":5,"90266948":5,"9027777777777778":[],"90300219":[],"90304177e":29,"9040":9,"90475506e":[6,30],"9054":31,"9055555555555556":[],"906589":[],"9065894":[],"906747":5,"90717653":11,"907177":11,"90842732":22,"90860768":22,"90894281":28,"91":[26,28],"910":9,"91099021":[],"91100141e":33,"9111111111111111":[],"91114704":[],"91128596":5,"91270333":[],"91312563":[],"91365263":[],"91410559e":[],"91416944e":[],"91434750e":[],"91492986e":[6,30],"91546928":[],"91648657":[],"9166666666666666":9,"91669165":[],"916692":[],"91672129":28,"91722512e":[],"91760278":5,"91812702":5,"91854134":[],"918785":28,"918992":29,"91933003":22,"919503":11,"9195033":11,"91961463":[],"92":[6,9,26,28],"92192012":[],"9225384545636204":5,"9230769230769231":9,"92308867":[],"92341148":22,"92370959":[],"92376655":[],"924e":6,"925":1,"92507116e":1,"92512799":[],"92527681e":[],"92578916":5,"92599642":[],"92604454":[],"92622842":0,"92661467e":33,"9271707090281667":[],"92756256":30,"9277777777777778":1,"9288904":22,"92921498":25,"9305555555555556":1,"93074023":[],"931":[0,28],"93155188":5,"93158979":5,"93237862":[],"932382":[],"93289669":[],"93293067":25,"933":[5,30],"93366198":[],"933662":[],"93397254e":[],"93492130e":[6,30],"93597168":[],"935972":[],"93601008e":29,"93619369":22,"93668828":[],"936877889972962":[],"937":25,"937057":11,"937082":29,"93787605":[],"93799826":5,"938":25,"9387":9,"93891335e":[],"939":[0,25,28],"93900569e":29,"93909866":[],"93937564":[],"93968601":[],"93970238":25,"93989887":[],"94":[9,25],"94092702":[],"94099173":[],"94141801":[],"94221383":22,"94226022e":[6,30],"94255277":25,"94273542":29,"94284104":5,"94285762":28,"94291287":[],"94320205":5,"9434":5,"94388948":33,"94419718":[],"9444444444444444":1,"94484047e":34,"94499279":33,"9450635":28,"94591015":[22,28],"946167":[],"94616709":[],"94623184":5,"94625725":[],"946276":[],"94627617":[],"946372":[],"94637206":[],"94639099":11,"946957":5,"94704941e":[],"9472222222222222":1,"947607":[],"94766419e":29,"94781064":30,"9482527":5,"9485531":[],"9495484":[],"95":[1,9,11,31],"95008046":6,"95033155e":[],"950423":[],"95053694e":[],"95115528":[],"95166920e":29,"95226607":[],"95231424":5,"952387":29,"9527777777777777":[],"95284275":5,"953065564":1,"95338273":29,"95343966":22,"95351665":5,"95354276":25,"95395895":[],"953959":[],"954":25,"95400323":28,"95511792":29,"955118":29,"95518112":[],"9555555555555556":1,"95563211":[],"955820c21e8b":4,"95611042":33,"95647867":[],"956563":[11,29],"95684892":5,"95703":[33,34],"95715036":[],"95743466e":[],"95793988e":[],"958228616652075":5,"95872127":[],"95890587":28,"95906059":33,"959076":[],"95935439":34,"96":[1,6,9,11,31],"960":25,"9601304850035702e":[6,30],"9601304850073734e":[6,30],"96015381":22,"96024953":5,"96075051":33,"96080358":25,"96084663":5,"961":25,"962":25,"96231225":[],"96251859":[],"96305058":[],"963187":[],"9637117593816477":[6,30],"96379806e":[],"96391888":[],"9640435":5,"96432396":[],"96461948":22,"9647801":28,"9649652536":4,"965548":29,"96585824":[],"96631321":29,"96688672":5,"967":6,"9674916":5,"967809":[11,29],"96826039":[],"96850191":34,"96853248":22,"968650":[],"96865004":[],"96866031":[],"968704":11,"96870431":11,"96894842":[],"96916206":34,"969190":[],"96919021":[],"96919836":[],"9692":[],"96991192":[],"97005689":5,"97065359":31,"970827":[],"97082748":[],"97108e":[33,34],"97120565":[],"9712983":[],"97206657":5,"972067":5,"972149":[],"9722222222222222":[],"97228653":[],"9722865317690382":[],"97243128":5,"97243946":[],"972533":[],"97253307":[],"97272223":[],"97300836":5,"97435908":[],"97480604":[],"97482498":11,"974825":11,"97486336":28,"97497404e":[6,30],"97498674":28,"975":[],"97507735":5,"97512176":28,"975484":[],"97548406":[],"97570392":28,"97626519":[],"97630233":31,"9767506308987675":[],"977":6,"97705827":5,"97716508":[],"97758848":5,"9777777777777777":[],"978":31,"9780387310732":27,"9780387848570":27,"9781098134174":28,"9781492032632":27,"9781801819312":28,"97836358":[],"978553":5,"97898392":[6,29,30],"97906022e":29,"9792":[],"97926491":5,"97935648":[],"97979891":6,"98":[0,1,9],"980":9,"9805555555555555":[],"98091621":5,"981321":29,"98139097":5,"98140006e":[],"98190064":[],"98271562":25,"98275501":5,"98281205":33,"983310":29,"98338288":[],"983383":[],"983450":[],"9834505":[],"9838929":[],"98413059":5,"98413606":[],"9841870203276504":[],"98454786":5,"98473694":[],"985":25,"98566191":5,"986":25,"9861111111111112":[],"98619989":[],"98636199":[],"986362":[],"98654811":[],"986699":5,"98680716":5,"98716878":5,"98740373":22,"98770503":28,"98808176":5,"98822371":6,"9888888888888889":[],"989":25,"9890348":5,"9893447":5,"98947674e":29,"98947894":29,"9898ff":[9,10],"99":[1,6,9,11,13,31,33,34],"990":9,"99003341":[],"99009525":5,"9904314810719695":[],"99072374":34,"99088801":5,"991":25,"991047":[],"99104747":[],"99114739e":[],"99115119":5,"99176998":5,"99194201":[],"992":25,"99201684e":[],"99242921":5,"99265097":5,"99294056":[],"993":25,"9930742":22,"99316252":5,"99368326":[],"99370678":22,"99371056":5,"99389612":5,"99415296":34,"99427512":22,"9943201":5,"99434472":[],"994345":[],"994474":[],"99447418":[],"99456598":33,"99475306":33,"9947756":5,"9948998579029953":[],"99492986":5,"99498272":[],"9951059931014423":[],"99512017":22,"9952183728736417":[],"9952505213910134":29,"9952537939995855":[],"99528218":5,"99539415":5,"9955318336036834":29,"99566069":5,"99578809":5,"9958589197366403":[],"9958983289118531":[],"9959308805732706":29,"996":[5,30,31],"99608161":5,"9963961":5,"99647992e":[],"99650061":5,"996626":[],"99662602":[],"9967458":5,"9969461173312454":[],"9969513794144311":[],"99700706":5,"99709215":5,"99723951":34,"997252717901263":[],"99729756":5,"99751458":5,"99753321e":29,"99758326":5,"99762142":30,"997746":11,"99774602":11,"99775587":5,"99793613":5,"99799099":5,"99802696":33,"99812668e":[],"99813653":5,"99828624":5,"9983295":5,"99835783":33,"99845267":5,"99848215":[],"99848815":33,"99854557":29,"998577":5,"99861053":5,"99862019":29,"99869482":29,"99871521":5,"99876945":29,"99881845":5,"99883628":29,"99884384":5,"99884409":29,"99884986":30,"99887767":[],"99891093":29,"99891873":29,"99893323":5,"99898558":29,"999":[9,25,33,34],"99901896":5,"99903755":5,"99906023":29,"9990927157696581":30,"99911427":5,"99912709":29,"99913489":29,"99916114":33,"99918546":5,"99919837":5,"99920175":29,"99926459":5,"99927642":29,"9993237":5,"99933188":5,"9993511":29,"99938942":5,"99941797":29,"9994385":5,"99944272":5,"99949266":29,"99949306":5,"99953381":5,"99953475":5,"99954278":34,"99954434":34,"99954925":33,"99956033":[],"99956735":29,"99957911":5,"99961294":5,"99965056":5,"99967865":5,"99968451":[],"99970894":29,"99970988":5,"9997332":5,"99975913":5,"99977375":[],"99977849":5,"99978365":29,"99980002":5,"9998161":5,"99984732":5,"99987324":5,"99989103":33,"99989476":5,"99991245":34,"99991263":5,"99992746":5,"99993978":5,"99995":5,"999955585168597":[6,30],"99996755":[],"9x":[6,23],"9y":[6,23],"\u00f8yvind":[6,29,30],"abstract":[1,20,33],"boolean":4,"break":[0,4,6,11,14,28],"byte":[22,28],"case":[0,1,2,3,4,5,6,7,11,12,13,14,16,21,22,23,28,31,34],"catch":0,"class":[0,1,3,4,6,7,8,9,11,12,13,25,28,31,33,34],"default":[0,1,2,4,6,7,8,16,22,23,28,29,30,32],"do":[0,2,3,4,5,6,8,9,10,11,12,13,14,15,16,22,23,28,29,32],"ekstr\u00f8m":4,"export":9,"f\u00f8470":[26,28],"final":[0,1,2,3,4,5,6,7,8,9,10,11,13,14,16,18,19,20,23,24,25,26,28,31,32],"float":[0,3,4,5,9,11,13,14,22,28,29,33,34],"function":[2,3,4,5,9,14,15,16,17,18,19,21,22],"import":[0,1,2,3,4,6,7,8,9,10,11,12,13,14,15,16,17,23,25,31,32,33],"int":[0,1,2,3,4,5,6,11,13,14,22,25,29,31,33,34],"long":[0,1,3,4,12,13,28,32,33,34],"m\u00f8svatn":[6,23],"new":[0,1,2,3,5,6,7,8,9,10,11,13,14,17,22,28,29,32,33,34],"public":[0,21,28],"return":[0,1,2,3,4,5,6,7,8,9,11,13,14,22,23,25,28,29,30,31,32,33,34],"sch\u00f8yen":[6,29,30],"short":[4,5,20,23,30,31],"super":[5,29,30],"switch":0,"throw":[3,6,25,31],"true":[0,1,2,3,4,5,6,7,8,9,10,12,13,14,15,16,19,22,23,25,28,29,30,31,32,33,34],"try":[0,1,2,4,5,6,7,8,9,10,11,13,14,15,16,21,22,23,25,28,29,30,31,32,33,34],"var":[1,5,6,10,11,18,19,23,25,28,29,30,31],"while":[0,1,3,4,5,6,7,8,9,11,12,13,25,28,29,30,31,32,33,34],A:[2,3,5,6,7,10,11,12,13,16,18,20,21,22,23,24,25,26,27,29,33],AND:2,And:[0,3,4,5,6,9,13,20,21,23,25],As:[0,1,2,3,4,5,6,8,10,12,13,16,22,23,25,28,29,30,31,32,33,34],At:[0,4,6,13,23,28,33],BE:[0,28],Be:[2,21,28],Being:[13,33],But:[0,1,2,3,5,6,9,10,25,29,30,31],By:[0,3,5,6,12,13,17,22,28,29,30,31,32,33,34],For:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,21,22,23,24,25,27,28,30,31,32,33,34],IF:[6,30],IN:27,If:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,15,16,21,22,23,25,28,29,30,31,32,33,34],In:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,19,21,22,23,25,27,28,29,30,31,32,33,34],Is:11,Ising:[5,12,29,34],It:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,21,22,23,25,28,29,30,31,32,33,34],Its:[1,2,4,11],NO:[9,11],No:[0,6,7,9,28,30,32,34],Not:[0,1,5,6,29,30,31,34],OR:25,Of:25,On:[0,3,9,15,23,24,25,26,27,28],One:[0,1,3,4,5,6,7,8,11,12,13,17,23,25,29,31,32,33,34],Or:[0,1,6,23,28,32],Such:[0,6,12,16,25,31,32,33,34],That:[0,5,7,10,11,12,14,19,23,25,28,30,31,32],The:[4,10,13,14,15,16,18,19,20,22,23,24,25,26,27],Then:[0,1,6,8,9,10,11,12,13,14,22,23,28,31,32,33,34],There:[0,3,4,5,6,8,9,11,12,14,22,23,24,25,26,28,29,30,32,33,34],These:[0,3,4,5,8,9,10,11,12,13,14,15,16,22,23,25,26,28,29,30,33,34],To:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,22,25,30,31,32,33,34],With:[0,5,6,8,9,10,11,12,14,18,22,23,25,28,29,31,34],_0:[5,8,10,11,13,29,32,33],_1:[2,5,6,8,10,11,12,13,14,22,29,30,32,33,34],_2:[2,5,8,11,12,13,22,29,33,34],_3:22,_4:22,_9:[13,33,34],_:[0,1,2,4,5,6,7,8,9,10,11,12,13,17,18,19,22,23,28,29,30,31,32,33,34],__array_function__:2,__class__:10,__doc__:[6,31],__enter__:[0,7,32],__future__:[8,9],__getattr__:30,__getattribute__:28,__getitem__:[0,7,32],__init__:[0,1,3,4,7,14,30,32,34],__main__:[2,34],__name__:[2,10,30,34],__rtruediv__:[],_accessor:28,_auto10:[6,12,34],_auto11:[6,34],_auto12:[6,34],_auto1:[2,3,4,5,6,7,12,13,22,25,29,32,33,34],_auto2:[2,3,4,5,6,12,13,22,25,33,34],_auto3:[3,4,5,6,12,13,22,33,34],_auto4:[4,6,12,13,22,33,34],_auto5:[4,6,12,13,22,33,34],_auto6:[4,6,12,22,34],_auto7:[4,6,12,22,34],_auto8:[6,12,34],_auto9:[6,12,34],_base:8,_build:[0,17,19,21,23,27,28],_c:1,_can_hold_identifiers_and_holds_nam:28,_check_optimize_result:[9,11],_class:8,_compon:11,_coordinate_desc:6,_depth:9,_fraction:9,_generatorcontextmanag:[0,7,32],_i:[0,1,2,5,6,7,8,11,12,13,15,16,17,19,23,28,29,30,31,32,33,34],_info_axi:28,_j:[0,1,2,3,5,6,8,13,17,19,23,29,30,31,33],_k:[13,32,33,34],_l:[12,34],_lambda:[6,28],_leaf:9,_ll:[3,4,14],_logist:[9,11],_m:10,_make_vjp:[],_multilayer_perceptron:[],_n:[2,5,8,11,13,29,32,33],_node:9,_np:[],_o:[3,4,14],_open_file_or_url:[0,7,32],_p:[5,8,29],_plugin_dir:[3,4,14],_ratio:11,_rc_params_in_fil:[0,7,32],_s:[3,4,14],_sampl:9,_split:[6,9,23],_src:34,_t:[13,33,34],_test:[6,23],_tf_getinputpropertieslist:[3,4,14],_trace:[],_valu:[],_varianc:11,_weight:9,_wrapreduct:2,a0:3,a0faa0:[9,10],a1:[0,28],a2:[0,28],a3:[0,28],a4:[0,28],a_0:[0,28],a_1a:[0,28],a_2a:[0,28],a_3:[0,28],a_3a:[0,28],a_4:[0,28],a_4a:[0,28],a_:[0,1,16,22,28,29],a_h:1,a_i:[0,1,2,12,28],a_j:[1,12],a_k:[0,1,12],aaron:27,ab:[0,2,5,13,14,23,28,29,30,33,34],ab_channel:[21,34],abandon:1,abbrevi:24,abid:25,abil:[0,10],abl:[0,1,4,5,6,7,10,12,13,16,23,29,32,33,34],about:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,21,22,23,26,30,31,32,33,34],abov:[0,1,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,22,23,25,27,28,29,31,32,33,34],abovement:[6,28,31],abscissa:[13,32,33],absolut:[0,2,5,6,13,28,29,30,31,33,34],absorb:[29,30],acceler:[13,33,34],accept:[0,3,6,9,23,28,29],access:[0,3,11,25,28],accid:[4,6,31,32],accompani:[0,28,29],accomplish:[8,9,13,33,34],accord:[0,1,2,5,6,9,12,13,14,15,16,25,28,30,31,32,33,34],accordingli:11,account:[0,3,5,13,15,25,28,30,31,33,34],accumul:[12,13,25,33,34],accur:[0,3,4,6,10,13,31,33,34],accuraci:[0,1,3,4,5,6,7,9,10,11,12,28,29,32,34],accuracy_scor:[0,1,10,28],accuracy_score_numpi:1,achiev:[0,1,5,6,8,12,22,28,30,31,34],aco:25,acquaint:21,acquir:[1,21,28],acr:0,across:[1,3,6,9,21,28,31],act:[1,3,22],action:25,activ:[0,2,3,4,9,24,26,28,32,33],actual:[0,1,4,5,6,8,11,16,22,25,28,29,30,31],ad:[1,3,4,5,8,13,15,16,22,30,31,32,33],ada_clf:10,adaboostclassifi:10,adadelta:[13,33,34],adam:[1,3,4,26,28],adapt:[4,6,13,27,31,32],add:[0,1,2,3,4,5,6,8,10,11,12,15,16,17,23,25,28,29,30,31,33],add_outgrad:2,add_subplot:[1,7,12,14,23,32,33,34],addendum:5,addit:[0,2,3,5,6,7,8,9,10,12,13,15,17,21,22,23,25,26,27,28,29,30,31,32,33,34],addition:[12,13,32,33,34],address:[1,9,11,13,28,33,34],adjac:[3,12,34],adjoint:[5,29,30],adjust:[0,5,12,13,32,33,34],admir:[0,28],advanc:[4,6,12,27,28,31],advantag:[1,3,5,6,10,13,22,30,31,32,33,34],adversari:28,afecionado:28,affect:3,affin:[0,3,8,11,29],afford:3,aficionado:28,aforement:14,african:0,after:[0,1,2,4,5,6,9,11,12,13,15,21,22,23,25,28,29,30,31,33,34],afterward:[0,28],ag:[0,7,24,28,29,32],ag_0:2,again:[0,1,4,5,6,7,8,10,11,12,13,15,16,23,25,28,29,30,31,33,34],against:[1,4,7,10,32],agegroup:[7,32],agegroupmean:[7,32],aggreg:[9,10],agorithm:10,agre:[5,6,25,30,31],agreement:[13,33,34],ahead:9,ai:[0,27],aid:[11,20],aim:[0,1,4,6,7,11,14,15,16,21,22,23,29,31,32],ainv:5,airplan:3,aka:[5,30,31],al:[0,2,4,15,16,17,23,27,28,29,30,31,32,33],alarm:[5,7,30,31],aldo:29,algebra:[0,3,5,13,21,29,30,31,33,34],algorithm:[0,1,2,4,5,6,7,8,13,14,21,22,23,25,27,28,30,31,32],align:[0,2,5,6,7,8,13,23,25,28,29,30,31,32,33],all:[0,1,2,3,4,5,6,7,9,10,11,12,13,14,15,21,22,23,24,25,26,27,28,29,30,31,32,33,34],allevi:[1,13,32,33],alloc:[3,22],allow:[0,1,2,3,5,6,8,10,13,15,16,21,22,23,28,29,30,31,32,33,34],almost:[0,1,6,8,11,13,25,31,32,33,34],alon:[2,9],along:[2,3,4,5,6,9,10,11,21,22,28,29,30,31,32],alpha:[0,1,2,3,4,6,7,8,9,10,13,14,25,28,29,31,32,33],alpha_0:3,alpha_1:3,alpha_2:3,alpha_:10,alpha_i:[3,13,33],alpha_k:[13,33],alpha_m:10,alpha_n:3,alpha_opt:[13,33],alreadi:[2,3,4,5,6,10,12,21,22,25,28,29,30,31,34],also:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,21,22,23,24,25,28,29,30,31,32,33,34],alter:1,altern:[0,1,4,5,6,8,9,11,13,22,23,28,29,30,31,32,33],although:[0,1,5,6,8,10,13,16,28,30,31,33,34],alwai:[0,3,5,6,12,13,16,23,25,28,29,30,31,32,33,34],am:4,ame2016:[0,28],american:0,among:[0,3,5,9,10,12,22,28,29,30,34],amongst:[5,30,31],amount:[0,1,3,4,6,8,10,14,21,31],amp:34,an:[1,2,3,5,6,7,8,9,11,12,13,14,15,16,17,19,20,21,22,23,25,26,27,29,30,31,32,33,34],an_:25,anaconda:[0,1,15,21,23,28],analog:[13,33,34],analys:[6,30,31],analysi:[1,3,4,7,14,15,16,17,19,22,27,32],analyt:[2,3,5,6,7,12,13,15,21,23,28,29,30,31,32,33,34],analytical_gradi:34,analyz:[0,1,3,4,5,6,16,17,23,25,29,30],andrew:1,angl:[0,3,9,29],anharmon:3,ani:[0,1,2,3,4,5,6,7,8,9,10,12,14,18,25,28,29,30,31,34],anim:[4,12,34],ann:[12,34],annot:[0,1,3,7,8,28,32],announc:28,anoth:[0,1,3,4,5,6,7,8,10,11,12,13,22,23,25,28,29,32,33,34],anp:2,ans_vspac:[],ansatz:[0,28],answer:[0,1,3,5,6,22,23,26,28,30,31],antialias:[2,6,23],anticip:4,anymor:[1,8],anyon:[4,8],anyth:[1,25],anytim:[26,28],apach:1,apart:[11,13,32,33],api:[1,21,28],appar:2,appear:[0,1,3,13,16,22,25,33,34],append:[1,3,4,8,9,13,28,33,34],appendix:23,appli:[0,1,2,3,4,6,7,8,9,10,11,12,13,15,16,23,25,27,28,29,30,31,32,33,34],applic:[0,1,3,4,5,6,7,9,12,13,22,23,25,27,28,29,31,32,33,34],apply_gradi:4,approach:[1,2,4,5,6,9,10,11,12,13,17,21,25,27,29,32],appropri:[2,6,9,12,13,21,25,31,33,34],approv:28,approx:[0,2,3,6,10,11,13,25,28,31,32,33,34],approxim:[0,1,2,3,4,5,6,7,10,11,13,18,19,23,25,28,29,30,31,32,33,34],apt:[0,15,21,23,28],aq:25,ar:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,19,21,22,23,24,25,26,27,28,29,30,31,32,33,34],aragorn:28,arang:[1,3,4,6,7,9,10,12,13,23,28,32,33,34],arbitrari:[1,4,6,8,12,13,25,31,32,33,34],arbitrarili:[0,1,11,28],arc:[6,23],architectur:[3,4,12],area:[0,3,6,9,23,27,28],arg:2,argmax:[1,11],argmin:[4,10,14],argnum:2,argnum_0:2,argnum_1:2,argsort:11,argu:[1,13,33,34],argument:[0,2,3,5,6,11,12,13,28,29,30,31],argval:[],aris:[0,6,12,13,25,28,31,32,33],arithmet:[0,13,22,28,33,34],arm:[6,30],armadillo:22,around:[0,1,4,5,6,11,25,28,30,31],arr:[],arr_list:[],arrai:[0,1,2,3,4,5,6,7,8,9,11,12,13,14,21,23,25,29,30,31,32,33,34],arrang:[3,28],arraybox:[13,33],arriv:[0,6,9,11,22,25,28,31],arrow:[12,34],arrowprop:8,art3d:33,art:[0,1,15,21,28],articl:[0,3,4,6,10,18,23,28,29,30,31],artifici:[0,2,7,12,27,28,32],artificialneuron:[12,34],arug:[13,33,34],arxiv:[3,4,23,33,34],asarrai:[0,2,6,9,29,30,33,34],asid:29,ask:[5,6,11,12,23,30,31],aspect:[0,6,21,23,28,29,30],assembl:[0,3,28],assert:4,assess:[0,6,23,28,29,30,31],assici:4,assign:[0,7,8,9,12,13,14,24,26,27,28,32,33,34],associ:[0,6,9,12,14,25,28,31,34],assum:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,19,22,23,25,28,29,30,31,32,33,34],assumpt:[0,3,5,6,9,11,18,23,25,28,29],ast:[0,5,6,18,23,28,30,31,32],astronomi:[28,30,32,33,34],astyp:[4,9,10],asymmetri:[0,28],asymptot:[4,6,31],atleast_2d:[],atom:[0,28],attempt:[0,4,6,7,8,10,28,30,32],attend:24,attent:[0,22,28],attr:30,attract:[0,10,28],attribut:[0,9,28,30],attributeerror:[28,30],audi:[0,28],audio:[3,4],august:[15,16,28],aurelien:[0,15,24,27,28],austfjel:[6,23],author:[0,1,10,25],authour:28,auto:[8,9,10,25],auto_exampl:[23,30],autocor:25,autocorrelation_tim:25,autocorrelform:25,autocovari:25,autoencod:[4,21,28],autoencond:21,autograd:[21,28],autom:[0,21,27,28],automac:22,automag:28,automat:[0,1,2,3,4,11,16,21,22,28],automobil:3,autonom:4,avail:[0,1,4,6,7,10,11,15,20,21,22,23,24,26,27,28,31,32,34],averag:[0,1,3,6,9,10,13,14,25,26,28,29,30,31,32,33,34],avoid:[0,4,5,6,9,11,13,22,28,29,31,32,33,34],awai:[2,3,6,29,30],awar:[2,10],award:[26,28],ax:[0,1,2,3,4,6,7,8,9,10,11,12,13,14,22,23,28,31,32,33,34],axes3d:[2,6,13,23,32,33],axes_grid1:6,axhlin:8,axi:[0,1,2,3,4,6,7,8,9,10,11,12,13,14,22,23,25,28,29,30,31,32,33,34],axiom:[5,30,31],axis_arg:[],axlabel:[0,28],axvlin:[4,8],axvspan:4,b1:8,b2:8,b3:8,b:[0,1,3,4,5,6,8,9,10,12,13,14,15,16,25,26,28,29,30,31,32,34],b_0:0,b_1:[0,2,12,13,33,34],b_2:[0,13,33],b_5:[13,33,34],b_:[0,1,22],b_group:9,b_i:[0,1,2,12,28,34],b_ia_:[0,28],b_ia_i:0,b_index:9,b_j:[1,12,34],b_k:[0,1,12,13,33,34],b_m:[12,34],b_score:9,b_valu:9,babcock:28,bachelor:[24,26],back:[0,3,4,5,6,8,9,10,15,22,25,28,29,30,32,33,34],backbon:22,backend:[0,1,4,7,32,34],background:[27,28,29],backpropag:1,backtrack:9,backup:22,backward:[1,2,4,12,22],backward_pass:2,bad:[6,29,30],badli:25,bag:[9,21,28],bag_clf:10,baggin:28,baggingboot:10,baggingclassifi:10,baggingtre:10,balanc:[6,31,32],band:22,bandwidth:22,bar:[0,6,11,15,16,23,28],barber:27,bare:[4,10],base:[0,1,3,4,5,7,8,9,10,14,21,25,26,27,28,29,30,32],basi:[5,7,8,10,11,12,13,22,29,30,32,33,34],basic:[6,8,12,13,14,21,23,25,28,33,34],batch:[3,4,11,12,13,32],batch_shap:4,batch_siz:[1,3,4],batchnorm:4,bay:[7,32],bayesian:[5,21,27,28,30,31],beam:[28,32,33,34],becattini:26,becaus:[0,1,2,3,4,5,6,8,9,12,13,14,28,30,31,32,33,34],becom:[0,1,2,5,6,7,9,12,13,25,28,29,30,31,32,33,34],been:[0,1,2,3,4,5,6,11,12,13,21,22,23,28,29,30,31,33,34],befor:[0,1,2,3,4,5,6,7,8,12,13,14,20,22,23,25,28,29,30,31,32,33,34],beforehand:[0,25,28],begin:[0,1,2,3,4,5,6,7,8,9,11,12,13,14,22,23,25,26,28,29,30,31,32,33,34],behav:[1,6,13,31,32,33],behavior:[0,1,13,28,32,33,34],behaviour:[12,34],behind:[0,1,6,8,13,28,32,33],being:[0,1,2,3,4,5,7,8,10,11,12,13,17,25,28,29,30,31,32,33,34],believ:[9,22],belong:[7,8,9,13,14,32,33],below:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,22,23,25,28,29,30,31,32,33,34],benchmark:10,benefici:[1,13,33,34],benefit:[0,1,4,11,13,15,21,28,32,33,34],bengio:[1,24,27,28,29,33,34],benign:[1,7,9,32],besid:[4,5,30],bessel:[5,29,30,31],best:[0,1,2,3,4,5,6,7,8,9,10,12,13,23,26,28,29,31,32,33],best_estimator_:32,beta1:[33,34],beta2:[33,34],beta:[0,1,3,5,6,7,10,11,13,16,17,18,19,23,28,29,32,33,34],beta_0:[0,1,3,5,6,7,13,28,29,30,32,33],beta_0x_:[0,28,29],beta_1:[0,1,3,5,6,7,10,13,28,29,30,32,33,34],beta_1x_0:[0,28],beta_1x_1:[0,7,28,32],beta_1x_2:[0,28],beta_1x_:[0,28,29],beta_1x_i:[7,13,29,32,33],beta_2:[0,3,13,28,29,33,34],beta_2x_0:[0,28],beta_2x_1:[0,28],beta_2x_2:[0,7,28,32],beta_2x_:[0,28,29],beta_2x_i:29,beta_3:3,beta_3x_i:29,beta_4x_i:29,beta_:[0,3,6,7,13,28,29,30,32,33,34],beta_i:[0,3,5,28,29,30],beta_j:[0,5,6,13,18,23,28,29,30,31,33,34],beta_k:[13,32,33],beta_lasso:34,beta_linreg:[13,32,33,34],beta_logreg:34,beta_m:10,beta_mg_m:10,beta_n:3,beta_ol:34,beta_p:[7,32],beta_px_p:[7,32],beta_ridg:34,betavalu:5,better:[0,1,2,3,4,6,9,10,11,12,13,28,29,30,31,33],between:[0,1,2,3,4,5,6,7,8,9,11,12,13,14,17,23,25,28,29,30,31,32,33,34],beyond:[0,1,5,6,8,13,23,28,29,32,33,34],bf:[13,14,22,25,32,33],bg:28,bgd:[13,33,34],bia:[0,1,2,3,5,8,9,10,12,13,19,28,29,30,32,33,34],bias:[1,2,3,5,6,9,12,30,34],bibliographi:23,big:[0,1,2,5,6,14,18,30,31],bigger:[1,6,29,30],bigr:[12,34],bike:9,bilbo:28,billion:[3,12,21,34],bin:[0,7,25,32],binari:[0,3,5,7,9,10,12,28,30,31,32],binarycrossentropi:4,bind:[0,29],binomi:[21,25,28],binsboot:[6,31],bioinformat:0,biolog:[1,12,34],bios1100:[21,28],bird:[0,3],birth:28,bishop:[24,27,28],bit:[1,4,22,25,28],bitwis:25,bivari:2,bk:[0,13,33,34],bla:[22,28],black:[8,9,14,34],blob:[16,20,23,32,33,34],block:[6,10,21,22,25,28,31],blog:28,blogpost:4,blue:[0,3],bmatrix:[0,1,3,5,7,8,11,13,22,28,29,30,32,33],bmi:1,bn:[],bodi:[0,1,4,12,28,34],bold:1,boldfac:[0,5,16,29,30],boldsymbol:[0,1,2,3,5,6,7,8,10,11,13,14,15,16,17,18,19,23,28,32,33,34],boltzmann:[12,21,28,34],book1:27,book:[19,23,27,28,29,31],boost:[1,9,21,28],boostrap:10,bootstrap:[1,13,19,21,23,28,32,33,34],borrow:28,boston_dataset:0,bot:8,both:[0,1,4,5,6,8,9,10,13,14,15,16,21,22,23,25,26,28,29,30,31,32,33,34],bottl:[7,32],bound:[0,8,12,33,34],boundari:[2,4,8,11,12],box:[4,9],boxed_arg:[],boyd:[8,13,32,33],bracket:[4,25],brain:[1,7,12,32,34],branch:9,breast:[5,7,11,30,31,32],breviti:[13,33,34],brew:[0,15,21,23,28],brg:8,brief:[23,29],briefli:[0,28],bring:[0,5,6,10,29,30],broad:0,broadcast_idx:2,brought:[13,21,28,33,34],brownle:4,browser:28,brute:[3,5,11,29,30,32],bs:[8,9,10],buffer_s:4,bui:4,build:[0,4,5,6,10,22,25,28,30,31,32,33,34],built:[0,1,3,4,6,31],bunch:11,busi:0,bxe2t:34,c1:[8,11],c2:[8,11],c:[0,1,2,4,5,6,7,8,9,10,11,12,13,14,15,16,19,21,22,25,26,27,29,30,31,32,33,34],c_0:25,c_1:[12,34],c_2:[12,34],c_3:[12,34],c_4:[12,34],c_:[0,8,9,10,13,25,32,33,34],c_i:[12,13,33,34],c_k:25,ca:[1,28],cach:10,cal:[0,8,10,12,13,15,16,28,32,33],calcul:[0,1,2,4,5,6,8,9,10,11,12,13,14,15,16,18,22,25,28,30,31,32,33,34],call:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,16,18,19,21,22,23,25,26,28,29,30,31,32,33,34],calor:[0,29],cambridg:[13,27,32,33],can:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,25,26,27,29,30,32],cancel:[0,13,28,29,33,34],cancer:[5,10,30,31],cancerpd:[7,32],candid:[8,9,10,33],cannot:[0,1,4,5,6,7,8,9,24,25,29,30,32],canopi:[0,15,21,23,28],canva:[23,28],cap:[5,30,31],capabl:[0,1,8,13,21,28,33,34],capac:[2,26],capita:0,caption:23,captur:[4,11,12,34],car:[3,4],card:[0,7,28,32],cardin:1,care:[11,32],carefulli:[13,33],carlo:[0,6,21,25,27,28,31],carri:[2,6,7,23,31,32],cart:10,casella:27,cast:1,cat:[3,4],categor:[0,1,3,9,11,28],categori:[0,1,3,7,10,12,14,28,32,34],categorical_crossentropi:[1,3],caus:[0,5,6,7,25,28,29,30,31,32],causal:0,causat:[0,28],cax:1,cb:[6,28],cbar:1,cc:[0,1,5,13,28,29,30,32,33],ccc:[5,12,30,34],cd_fast:6,cdf:25,cdot:[0,2,6,12,13,14,22,25,28,31,32,33,34],celebr:[13,32,33],cell:[0,1,2,3,4,6,7,8,9,10,13,14,23,30,32],center:[0,1,6,7,8,9,11,14,23,25,28,30,31,32],central:[0,3,5,6,8,16,22,28,29,30],centroid:[14,25],centroid_differ:14,centuri:3,certain:[0,3,6,7,9,25,28,29,31,32],certainti:31,cg:[13,33],cha:0,chain:[0,1,13,21,25,28,33,34],challeng:[33,34],chanc:[1,5,13,25,30,31,33,34],chang:[0,1,2,3,4,5,6,8,9,11,12,13,14,22,23,25,28,29,30,31,32,33,34],channel:3,chapter3:[0,19,23],chapter:[0,6,10,11,16,18,22,23,27,28,29,30,31,32,33,34],charact:[0,3,5,8,28,29],character:[8,9,10,12,25,34],characterist:[0,1,3,10,13,28,33,34],charg:[0,28],charl:0,chase:4,chatgpt:23,chd:[7,32],chddata:[7,32],cheap:[5,29],cheaper:[1,13,33,34],check:[0,1,3,4,5,6,11,13,22,28,33,34],checkmark:3,checkpoint:4,checkpoint_dir:4,checkpoint_prefix:4,chen:10,cheng:29,chiaramont:2,choic:[0,1,2,3,4,6,9,12,13,14,19,22,28,29,31,32,33,34],choleski:[5,22,29],choos:[2,3,6,9,10,11,13,14,23,31,32,33,34],chosen:[0,1,2,6,8,9,10,13,16,25,28,31,32,33,34],chosen_datapoint:1,christian:27,christoph:[24,27,28],cifar10:3,cifar:3,circ:[1,12],circl:[0,8,12,29,34],circuit:3,circumfer:9,circumv:[1,5,13,29,33,34],cite:23,ckpt:4,clariti:25,class_nam:[3,9],class_val:9,class_valu:9,classic:[7,9,13,32,33,34],classif:[0,3,5,6,7,8,11,12,21,23,27,28,29,30,31,33],classifi:[0,1,4,7,9,10,11,28],classificaton:1,classifii:10,clean:1,clear:[1,5,10,12,13,33,34],clearli:[0,3,5,6,7,8,18,25,29,30,31,32],clever:[1,10],clf3:0,clf:[0,6,8,9,10,28,29],clf_lasso:6,clf_ridg:[6,28],clip:[3,25],clone:26,close:[0,1,2,4,6,8,9,11,12,13,14,23,25,27,28,31,32,33,34],closer:[3,5,13,29,33,34],closest:[8,11,13,14,33],closur:[21,28],cloud:[21,28],cluster:[0,1,4,6,11,21,28,31],cluster_label:14,cm:[1,2,3,6,8,9,13,23,32,33],cmap:[0,1,2,3,4,6,8,9,10,23,28],cmap_arg:6,cmb:24,cmd:9,cn_:25,cnn:[12,34],cnn_kera:3,cntk:[21,28],co:[0,2,3,6,9,13,28,31,33,34],code:[3,4,6,7,8,15,16,17,19,21,22,23,25,27],coef0:8,coef:[0,28],coef_:[0,5,6,8,9,13,28,29,30,32,33],coeff:5,coeffici:[0,3,5,6,7,8,9,13,15,16,22,28,29,30,31,32,33,34],coerc:[0,6,28,31],coin:[10,25],coin_toss:10,col:[0,11,28,29],colab:[21,28],cold:9,colinear:0,collabor:23,collaps:8,collect:[0,2,6,10,11,21,25,27,28,31,34],collinear:[5,29,30],color:[0,3,4,6,8,9,10,23,25,33,34],color_channel:3,color_cod:6,colorbar:[1,6,23],colsample_bytre:10,colsaobject:10,column:[0,1,2,5,6,7,8,9,11,12,17,22,28,29,30,31,32,34],columntransform:9,com:[4,6,16,20,21,23,27,28,31,32,33,34],combin:[1,2,5,6,7,10,25,30,31,32,33,34],come:[0,1,3,4,5,12,13,14,15,28,29,30,31,33,34],command:[0,1,28],comment:[0,4,5,6,15,16,23,28,29],commerci:[0,15,21,23,28],commod:[0,28],common:[0,1,3,5,6,7,9,11,13,14,23,25,28,29,31,32,33,34],commonli:[0,1,4,6,7,9,13,14,29,31,32,33,34],commun:[0,12,23,34],commut:3,commutatitav:3,compact:[0,1,3,5,6,7,9,11,12,13,14,28,29,30,31,33,34],compair:0,compar:[0,3,4,5,6,11,13,15,16,22,23,28,29,30,31,32,33,34],comparison:[2,4,13,33,34],compat:[7,32],compet:0,competit:10,compil:[0,1,3,4,13,15,21,22,28,33,34],complet:[0,2,3,4,9,12,28,34],completenn:[12,34],complex:[1,5,8,9,11,12,13,15,16,19,28,31,33,34],complic:[0,1,9,13,28,31,32],compoment:29,compon:[0,1,3,4,5,6,7,9,14,16,21,28,29,30,31,32],components_:11,compos:[9,12,13,14,21,28,33,34],compphys:[0,6,16,17,19,20,21,23,24,26,27,28,32,33,34],compress:[0,28,29],compris:[6,32],compromis:[5,29],compulsori:[21,28],comput:[0,1,2,3,4,5,6,7,8,10,11,12,13,15,16,17,21,22,23,24,25,27,28,29,30,31,32],computation:[0,3,6,9,13,25,28,32,33,34],computationalscienceuio:28,computerlab:23,concaten:[2,4,6,14],concatenate_arg:[],concav:[1,9,13,29,32,33],concentr:[0,10],concept:[0,2,21,28,29],conceptu:[12,13,32,33,34],concern:[0,1,4,7,28,32],concic:28,conclud:[0,5,13,30,31,33,34],conclus:1,cond:2,conda:[0,1,15,21,23,28],condis:29,condit:[0,2,4,5,6,8,9,11,13,25,28,29,34],conduct:21,condwav:2,confid:[0,5,6,7,8,18,23,28,29,30,32],configur:[3,34],confirm:[5,12,30,31,34],confus:[5,6,7,10,22,29,30,31],confusion_matrix:9,congruenti:25,conjug:[4,8],conjugaci:[13,33],conjunct:3,connect:[0,1,3,4,9,11,12,13,22,28,29,32,33,34],consequ:[5,6,8,10,12,13,29,30,31,32,33,34],conserv:[5,14,29],consid:[0,1,2,3,5,6,7,8,9,10,12,13,16,19,22,23,25,28,29,30,31,32,33,34],consider:[0,1,5,13,28,29,30,31,32,33],consist:[0,1,2,3,4,6,12,13,19,23,25,29,31,32,33,34],constant:[0,2,4,5,6,8,12,13,25,28,29,30,31,32,33,34],constitu:[0,28],constitut:[2,6,31,32],constrain:[1,3,5,7,11,30,32],constraint:[5,6,8,13,29,30,31,33,34],construct:[0,1,2,3,5,6,7,8,9,10,11,22,25,28,29,30,31,32],contact:[0,28],contain:[0,2,3,4,5,6,7,8,9,11,12,13,17,19,22,23,25,27,28,29,30,31,32,33,34],contemporari:28,content:[1,21,22,28],context:[6,10,13,23,31,32,33,34],contextlib:[0,7,32],contigu:22,continu:[0,1,2,3,4,5,6,7,8,9,10,12,13,17,18,22,23,25,28,29,30,31,32,33],contour:[9,10,13,33],contourf:[8,9,10],contrast:[1,4,9,10,12,34],contribut:[0,3,5,13,25,28,29,30,33,34],contributor:[0,23],control:[0,1,3,9,13,15,21,28,33,34],conv2d:[3,4],conv2dtranspos:4,conv:[3,4],convei:28,conveni:[0,5,6,12,13,22,23,28,30,31,32,33,34],convent:[12,29],converg:[1,2,4,5,6,8,9,11,13,14,29,30,32,33,34],convergencewarn:[6,8,9,11],convert:[0,1,4,5,9,11,13,22,28,29,33,34],converttomatrix:4,convex:[4,5,7,29],convinc:[13,32,33],convolut:[1,4,21,28],cook:23,cool:[4,9],coolwarm:[6,23],coordin:[5,12,14,29,30,34],coorel:0,copi:[0,1,14,29],core:[0,2,7,10,28,32],corel:28,coronari:[7,32],corr:[0,5,7,11,29,32],correalt:[11,21],correct:[0,1,2,3,4,5,7,13,22,25,28,29,30,31,33,34],correctli:[1,2,6,7,10,23],correl:[0,1,3,5,6,7,10,12,13,21,25,28,30,31,33,34],correlation_matrix:[0,5,7,11,29,32],correspond:[0,3,5,6,8,9,11,12,15,16,17,21,22,23,25,28,29,30,31,34],cortex:[12,34],cosin:[3,6,31],cost:[0,2,3,5,6,7,8,9,12,13,16,17,19,23,28,34],cost_deep_grad:2,cost_funct:2,cost_function_deep:2,cost_function_deep_grad:2,cost_function_grad:2,cost_grad:2,cost_sum:2,costol:[13,33,34],could:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,17,22,23,25,28,29,30,31,32,33,34],coulomb:[0,28],count:[0,9,24,25,26,28],countor:[13,33],coupl:[4,5,6,30,31],cours:[0,1,3,5,11,23,24,26,29,31],courvil:[24,27,28,29,33,34],cov:[5,6,11,22,25,28,29,30,31],cov_xi:[5,11,29],cov_xx:[5,11,29],cov_yi:[5,11,29],covari:[0,7,21,22,28,30,32],covariance_matrix:[5,11,14,29],cover:[0,5,17,21,26,27,29,30],covert:[0,28],covxi:25,covxx:25,covxz:25,covyi:25,covyz:25,covzz:25,cpu:1,craft:3,creat:[1,2,3,4,5,9,10,11,12,21,28,30,32,33,34],create_biases_and_weight:1,create_convolutional_neural_network_kera:3,create_neural_network_kera:1,create_x:[5,11,29],credit:[0,7,26,28,32],crim:0,crime:0,criteria:[0,4,9,10,14,25,28],criterion:[9,10,13,32,33],critic:[6,23,29,30],critiqu:23,cross:[0,1,3,7,9,10,13,21,25,28,29,30,33,34],cross_entropi:4,cross_val_scor:[6,31,32],cross_valid:[7,10,32],crossvalid:[6,31],crucial:[1,25],cs231:3,cs:[24,26],csr_matrix:[22,28],csv:[0,4,6,7,9,28,31,32],ctnk:1,cubic:0,cumbersom:[5,30,31],cumsum:[10,11,28],cumul:[7,10,25],cumulative_heads_ratio:10,cup:[5,30,31],current:[1,2,3,4,13,14,27,32,33,34],curs:[0,29],curv:[6,7,10,12,23,32,34],curvatur:[13,32,33,34],custom:[6,14,23],custom_cmap2:[9,10],custom_cmap:[9,10],cutpoint:9,cv:[6,7,10,31,32],cvxbook:[13,32],cvxopt:[5,8,29],cycl:[1,12,34],cyclotron:30,d2_g_t:2,d:[1,2,3,4,5,6,7,8,9,10,11,13,14,22,25,26,28,29,30,31,32,33,34],d_f:[13,32,33],d_g_t:2,d_net_out:2,da:3,dagger:[5,22,29],dai:[1,9,21],damp:3,daniel:26,darget:9,darkr:25,dat:[0,28],dat_id:[0,6,7,9,28,29,31,32],data1:14,data2:14,data3:14,data4:14,data:[2,4,5,8,10,12,13,14,17,18,19,22,27,31,33,34],data_id:[0,6,7,9,28,29,31,32],data_indic:1,data_panda:28,data_path:[0,6,7,9,28,29,31,32],databas:1,datafil:[0,6,7,9,23,28,29,31,32],datafram:[0,4,5,7,9,11,28,29,32],datapoint:[1,5,6,7,11,13,29,31,32,33,34],dataset:[0,4,6,7,8,9,10,11,13,14,15,16,19,23,28,31,32,33,34],datatyp:4,date:[15,16,17,18,19,20,23,28,29,30,31,32,33,34],daughter:10,david:[27,28],davison:31,dbh:1,dbo:1,dcomposit:22,ddot:2,dead:1,deadlin:[16,17,18,19,20,24],deal:[0,1,3,5,6,8,11,13,14,17,18,22,23,25,28,29,30,32,33,34],dealt:0,debt:[7,32],debug:[0,5,6,30,31,32],decad:[0,3,34],decai:[0,13,25,28],decemb:[24,26,28],decent:10,decid:[0,2,3,5,6,9,23,30,31,32],decim:[0,28],decis:[0,1,8,11,21,27,28],decision_funct:8,decision_tre:9,decisiontreeclassifi:[9,10],decisiontreeregressor:[0,9,10],decisiontreeregressordecisiontreeregressor:9,declar:[0,4,22,28],decompos:[5,6,22,29],decomposit:[0,6,12,23,28,30,34],decompost:[5,29],deconvolut:3,decorrel:[10,13,33,34],decreas:[1,2,4,5,6,10,11,13,30,31,32,33,34],deduc:[0,28],deep:[3,7,12,13,21,24,27,29,33,34],deep_neural_network:2,deep_param:2,deep_tree_clf1:9,deep_tree_clf2:9,deep_tree_clf:[9,10],deepen:[5,21,28],deeper:[0,3,4,28],deeplearningbook:[27,28,30],deer:3,def:[0,1,2,3,4,5,6,7,8,9,10,11,13,14,23,25,28,29,30,31,32,33,34],def_covari:25,default_tim:4,defect:[5,29],defici:[5,29],defin:[0,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,22,23,25,29,30,31,32,33,34],definit:[1,2,5,6,7,8,10,11,12,13,17,22,25,29,30,31,32,33],defint:25,defvjp:2,defvjp_argnum:[],degre:[3,5,6,8,9,10,11,15,16,17,19,23,25,28,30,31,32],deisenroth:29,del:1,delet:6,delimit:4,deliv:[24,28],delta:[0,2,3,6,8,12,13,14,28,33,34],delta_0:3,delta_1:3,delta_2:3,delta_3:3,delta_4:3,delta_5:3,delta_:[1,22],delta_h:[0,1,28],delta_j:[3,12],delta_k:12,delta_l:[1,3],delta_momentum:[13,33,34],delta_n:[0,3,28],delug:21,delv:0,demand:[13,32,33],demonstr:[0,3,5,6,7,11,12,21,28,29,30,31,32],demystifi:34,den:4,denomin:[1,5,30,31],denot:[1,2,6,7,13,25,32,33,34],dens:[1,3,4],densiti:[0,2,6,25,28,31],depart:[26,28,29,30,31,32,33,34],depend:[0,1,2,4,5,6,7,8,11,12,13,15,21,22,23,25,28,29,30,31,32,33,34],depict:25,deploy:[0,15,21,23,28],deprec:2,depth:[0,3,9,10,22,31],deriv:[0,1,2,6,7,8,10,11,13,16,17,19,21,23,28,34],derivati:[13,33,34],derivative_fn:[13,33],descend:[5,9,11,29,30],descent:[0,1,3,7,8,12,28,29],descent_i:34,descent_x:34,describ:[0,2,4,5,6,8,10,11,12,13,18,22,23,28,30,31,33,34],descript:[0,8,9,28],design:[0,1,3,4,5,6,7,10,11,12,13,15,16,17,18,19,23,28,30,31,32,33,34],designmatrix:[0,28],desir:[0,2,4,5,13,14,28,29,32,33],despit:[1,12,34],destroi:22,det:[5,22,29],detail:[0,6,11,13,14,22,23,29,32,33],detect:[3,8,12,34],determin:[0,2,3,4,5,6,8,9,10,11,12,13,16,22,25,28,29,30,31,32,33,34],determinist:[7,13,25,32,33,34],dev:[1,23],develop:[0,3,5,8,10,11,12,21,22,23,28,29,30,31,34],deviat:[0,1,2,4,5,6,19,23,25,28,29,30,31],devic:[3,4,14],devis:[12,34],df1:28,df:[4,8,11,13,28,33],di:0,diag:[5,8,29,30],diagnost:[1,10],diagon:[0,5,7,13,18,22,23,25,28,29,30,32,33,34],diagonaliz:[5,29],diagram:10,diagsvd:6,dice:[6,25,31],dict:[6,8,32],dictionari:0,did:[0,1,5,6,7,10,11,14,23,28,30,31,32,33],die:1,diff1:2,diff2:2,diff:2,diff_ag:2,diffeent:8,differ:[0,1,2,3,4,5,6,7,9,10,11,12,13,14,15,17,21,22,23,25,27,28,29,30,31,32],differenti:[0,3,16,21,22,28,29,32],differential_oper:2,difficult:[0,1,6,10,13,23,25,28,31,33,34],difficulti:[0,1,13,28,32,33,34],diffonedim:2,digit:[0,1,3,4,6,23,24,26,28],dilemma:[13,33,34],dilut:1,dim:[4,11,14,22],dimens:[0,1,2,3,4,5,8,9,11,14,16,17,22,28,29,30],dimension:[0,4,5,6,9,11,13,14,19,21,22,28,30,31,32,33,34],dimensionless:[0,3,28],diment:22,dimnsion:4,diod:3,direct:[0,1,2,4,7,11,12,13,14,28,29,32,33,34],directli:[1,4,5,6,25,29],directori:[0,7,32],disadvantag:[0,28],disappear:[3,6,31],disc_loss:4,disc_tap:4,discard:[6,11,31,32],disciplin:[0,3,12,34],disclaim:25,discord:28,discourag:[13,32,33],discov:[0,28],discover:[5,30],discret:[1,3,5,7,13,30,31,32,33,34],discrimin:[4,7,10,11,32],discriminator_loss:4,discriminator_loss_list:4,discriminator_model:4,discriminator_optim:4,discuss:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,25,27,28,29,30,31,33,34],diseas:[7,32],disguis:[6,29,30],disord:[1,7,32],dispai:34,displai:[0,1,3,4,5,6,7,8,9,10,11,12,14,23,25,28,29,31,32,34],displaystyl:[0,5,17,28,29,30],disregard:[0,28],dissimilar:[11,14],dist:14,distanc:[0,8,9,11,14,25],distance_list:9,distinct:[3,7,8,9,10,14,32],distinctli:8,distinguish:[0,4,7,8,25,28,32],distplot:0,distribut:[0,1,4,6,7,10,11,13,14,15,16,18,19,21,22,23,28,29,32,33],distrubut:[0,15,21,23,28],dive:[0,8,22,28],diverg:[1,13,32,33,34],divid:[0,1,3,5,6,7,8,9,11,12,25,28,29,30,31,32,34],divis:[6,8,9,13,22,25,31,32,33,34],dlopen:[3,4,14],dna:[7,32],dnn1:4,dnn2_gru2:4,dnn:[0,1,2,4,12,28,34],dnn_kera:1,dnn_model:1,dnn_numpi:1,dnn_scikit:[0,1,28],doamin:[30,31],doc:[0,6,16,17,19,20,21,23,24,26,27,28,32,33,34],document:[4,9,11,13,32],doe:[0,1,2,3,4,5,6,8,10,11,12,13,14,16,22,23,25,28,31,32,33],doesn:[3,9,12],dog:[1,3,4],domain:[5,8,13,23,30,31,32,33],domin:[0,28],don:[0,1,3,5,6,7,8,11,13,15,21,23,28,29,32,33,34],done:[0,2,3,4,5,6,9,10,11,13,17,22,23,28,29,30,31,32,33],dot:[0,2,3,5,6,7,8,9,10,11,12,13,22,23,25,28,29,30,31,32,34],doubl:[3,4,22,28],doubli:1,doubt:23,down:[0,3,6,9,11,12,13,32,33,34],download:[0,1,3,5,6,22,23,27,28],downsampl:3,dozen:1,dq:[6,31],drag:[13,33,34],dramat:11,drastic:4,draw:[4,6,10,13,31,32,33],drawback:[0,1,3,13,29,32,33,34],drawn:[1,4,6,7,11,25,28,31,32],drive:[3,4],driven:3,drop:[0,1,5,6,11,13,25,28,29,30,31,33,34],dropna:[0,6,28,31],dropout:4,dt:[2,3,13,25,33,34],dtype:[0,1,2,3,4,14,22,28,29,34],dual:8,dualiti:6,dub:[0,28],due:[1,2,5,6,8,10,12,13,26,28,29,31,32,33,34],dummi:0,dure:[0,1,3,4,8,9,11,17,20,21,23,28,31,33,34],dwell:0,dwh:1,dwo:1,dx:[2,3,8,25],dx_1:25,dx_1p:[6,31],dx_2p:[6,31],dx_mp:[6,31],dx_n:25,dxp:[6,31],dy:[1,8,25],dylib:[3,4,14],dynam:4,dz:8,e:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,18,19,25,26,28,29,30,31,32,33,34],e_:[0,2,28],each:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,17,21,22,24,25,26,28,29,30,31,33,34],eager:31,eapprox:[0,28],earli:[1,13,33,34],earlier:[0,5,7,8,9,11,12,13,20,28,29,32,33,34],earthexplor:[6,23],eas:[6,9,14,31],easi:[0,5,6,7,8,9,10,11,12,13,18,21,22,28,29,30,31,32,33,34],easier:[5,6,8,9,13,25,28,29,31,33,34],easiest:[13,32,33],easili:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,22,23,28,29,30,31,32,33],eastern:[26,28],ebind:[0,28],eblock:9,econometr:28,economi:5,ecosystem:[21,28],ect:24,edg:3,edgecolor:[6,31],edu:[13,32],educ:[0,23,28,32],eff:25,effect:[1,4,10,13,25,33,34],effic:1,effici:[0,3,10,13,21,22,25,28,32,33,34],efron:[6,31],egrad:[13,33,34],eig:[5,11,13,22,25,28,29,32,33,34],eigen:25,eigenpair:[5,11,29],eigenvalu:[0,5,8,11,13,22,28,29,30,32,33,34],eigenvector:[5,11,13,17,29,30,33],eight:[22,28],eigval:[22,25,28],eigvalu:[11,13,32,33,34],eigvec:[22,25,28],eigvector:[11,13,32,33,34],eispack:[22,28],either:[1,5,6,7,8,9,10,11,13,15,16,23,25,28,29,30,31,32,33],elabor:25,elarn:3,electr:[0,3,12,28,34],electron:28,eleg:11,element:[1,2,3,4,5,6,7,8,11,12,13,17,18,20,21,22,23,24,27,29,30,31,32],elementari:[10,13,22,33,34],elementwis:[3,13,33,34],elementwise_grad:[2,13,33,34],elessar:28,elif:[2,14,34],elim:22,elimin:[3,8],els:[1,2,3,4,7,9,12,13,14,22,32,33,34],elu:1,elus:[0,28],email:[24,26,28],embed:[0,11,29],embodi:[6,19,23,31],emit:25,emner:27,emphas:[0,10,21,28],emphasi:[0,21,27,28],empir:[1,11,25],emploi:[0,1,5,6,11,13,23,25,28,29,30,31,32,33],employ:0,empti:[6,10,31],emul:[12,34],en:[21,27],enabl:[11,34],enbodi:[6,31],encod:[0,3,5,7,9,11,14,17,28,29,30,32],encompass:[0,23,25],encount:[0,1,5,6,7,13,25,28,29,31,32,33,34],encourag:23,end:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,16,22,23,25,26,28,29,30,31,32,33,34],end_box:[],end_nod:2,end_valu:[],endpoint:[3,6],energi:[0,4,6,29,31],enet_coordinate_desc:6,enforc:[12,34],eng:27,engin:[0,1,3,4,21,28],english:23,enocurag:23,enoent:[3,4,14],enorm:3,enough:[0,6,13,28,31,32,33],ensembl:[1,9],ensur:[0,1,2,3,5,6,11,13,25,29,30,31,32,33,34],entail:28,enter:[5,6,17,29,30],enthought:[0,15,21,23,28],entir:[1,3,7,9,21,25,28,32,33,34],entiti:[9,12,22,28],entri:[0,5,8,11,12,22,28,29,30,31],entropi:[1,3,7,10,13,28,33,34],enumer:[0,1,2,3,4,6,8,28,29,30],env:[0,2,3,4,6,7,8,9,11,14,25,28,30,32,34],environ:[2,9,21,23,34],eo:[0,6,28,31],eol:[0,28],eosfit:[0,28],epoch:[0,1,3,4,12,13,28,33,34],epsilon:[0,5,6,7,13,19,23,28,29,30,31,32,33,34],epsilon_0:[0,28],epsilon_1:[0,28],epsilon_2:[0,28],epsilon_:[0,28],epsilon_i:[0,28,29],eq:[3,13,14,22,25,32,33],eqnarrai:[3,5,6,30,31],equal:[0,1,2,3,4,5,6,8,9,11,12,13,14,15,22,23,25,28,29,30,31,32,33,34],equat:[1,3,4,5,6,7,8,9,10,11,13,14,16,17,18,19,22,23,25,31,34],equilibrium:[2,12,34],equiv:[3,13,22,25,32,33],equival:[0,1,5,7,8,11,13,21,22,28,29,30,31,33,34],erf:25,eriador:28,eridg:28,err:[0,7,10,32],err_:[6,31],err_sqr:2,errat:[13,32,33],errno:[0,3,4,7,14,32],erron:2,error:[1,2,4,5,6,7,9,11,12,13,15,16,17,18,19,21,22,23,25,30,32,33,34],error_estimate_corr_tim:25,error_hidden:1,error_output:1,escap:[13,32,33,34],especi:[1,3,9,12,13,23,33,34],essenti:[0,5,6,9,10,12,14,23,25,29,34],establish:[0,6,10,11,15,23,28],estim:[0,1,5,6,7,10,11,13,21,25,28,29,32,33,34],estimated_mse_fold:[6,31,32],estimated_mse_kfold:[6,31,32],estimated_mse_sklearn:[6,31,32],et:[0,2,4,15,16,17,23,27,28,29,30,31,32,33],eta0:[8,13,32,33],eta:[0,1,3,8,12,13,28,32,33,34],eta_:[13,33,34],eta_t:[13,33,34],eta_v:[0,1,3,28],etc:[0,1,3,5,7,8,9,11,12,13,14,15,21,22,23,25,29,32,33,34],ethic:21,etsim:31,euclidean:[0,14,29],evalu:[0,2,3,4,5,6,9,13,23,25,28,29,30,31,32,33,34],evaluationform:[20,23,33,34],evaluationgrad:[20,23,33,34],evalut:[13,33,34],even:[0,1,3,4,5,6,8,9,10,11,12,13,14,21,22,25,28,29,30,31,32,33,34],evenli:4,event:[5,7,10,25,30,31,32],eventu:[0,5,6,11,12,13,23,26,29,30,31,32,33,34],everi:[0,1,2,3,4,5,6,9,10,11,12,13,14,21,25,26,28,29,30,31,32,33,34],everyth:[4,12],everywher:[4,13,32,33],evolv:0,exact:[0,5,11,12,13,22,25,28,29,33],exactli:[0,3,4,6,12,21,23,29,31,34],exam:28,examin:[6,31],exampl:[5,11,12,13,15,16,19,20,21,22,23,25,27],exce:[1,12,13,33,34],excel:[0,1,4,5,10,28,29],except:[0,3,4,6,7,8,9,22,32],excess:[0,28],excit:0,exclud:[1,6,12,23,29,30,31,32,34],exclus:[0,1,3,6,25,28,31,32],execut:[2,5,13,29,33,34],exemplifi:[13,33,34],exercic:[26,28],exercis:[5,21,23,24,26,30,31,32,33,34],exercisesweek35:17,exhaust:[6,31,32],exhibit:[0,5,6,8,28,29,31],exist:[0,1,2,3,4,5,6,7,8,9,13,14,18,22,23,28,29,30,31,32,33],exit:[5,22,29],exp:[0,1,2,5,6,7,8,10,11,12,13,15,16,23,25,28,29,30,31,32,33,34],exp_term:1,expand:[5,7,11,13,29,32,33],expandus:[0,7,32],expans:[0,3,5,8,10,12,13,28,29,32,33],expect:[0,1,5,6,7,11,12,13,15,16,19,21,23,28,29,32,33,34],expectation_value_of_h_wrt_p:25,expens:[6,10,13,32,33,34],experi:[0,1,6,8,13,21,23,28,29,31,32,33,34],experiment:[0,4,6,9,25,28,31],expert:[1,9],explain:[0,6,9,10,11,13,19,23,28,32,33],explained_variance_ratio_:11,explanatori:[0,28],explicit:[0,3,6,13,22,23,28,29,30,33,34],explicitli:[0,4,8,34],explod:1,exploit:[0,3,12,13,28,33,34],explor:[1,4,6,8,13,21,23,32,33,34],expon:1,exponenti:[0,1,5,6,10,13,23,25,28,30,31,32,33,34],export_graphviz:9,export_text:9,exporttext:9,expos:21,express:[0,2,3,5,6,7,10,12,13,16,22,23,25,28,30,31,34],exptmean:25,exptvari:25,extend:[0,2,7,11,13,17,21,28],extens:[0,12,15,21,28,34],extent:[0,1,6,27,31],extern:[3,6,9],extra:[1,3,5,26,28,29],extract:[0,3,5,6,7,8,11,13,22,28,29,32,33],extrapol:[0,28],extrem:[0,1,4,5,6,7,8,9,13,16,22,29,30,31,32,33,34],extremum:[13,32,33],extrins:11,ey:[0,5,6,13,14,22,28,30,32,33,34],f11:[0,28],f12:[0,28],f13:[0,28],f1:[13,33,34],f1_grad:[13,33,34],f1d:[13,33],f2:[13,33,34],f2_grad_x1:[13,33,34],f2_grad_x1_analyt:[13,33,34],f2_grad_x2:[13,33,34],f2_grad_x2_analyt:[13,33,34],f3:[13,33,34],f3_grad:[13,33,34],f3_grad_analyt:[13,33,34],f4:[13,33,34],f4_grad:[13,33,34],f4_grad_analyt:[13,33,34],f5:[13,33,34],f5_grad:[13,33,34],f6:[13,33,34],f6_for:[13,33,34],f6_for_grad:[13,33,34],f6_grad_analyt:[13,33,34],f6_while:[13,33,34],f6_while_grad:[13,33,34],f7:[13,33,34],f7_grad:[13,33,34],f7_grad_analyt:[13,33,34],f8:[13,33],f8_grad:[13,33],f9:[0,13,28,33],f9_altern:[13,33],f9_alternative_grad:[13,33],f9_grad:[13,33],f:[0,1,2,3,4,5,6,7,8,10,12,13,14,16,18,19,22,25,26,28,29,30,31,32,33,34],f_0:[3,10],f_1:[10,13,32,33],f_2:[12,13,32,33,34],f_3:[12,34],f_:10,f_d:25,f_grad:[13,33,34],f_grad_analyt:[13,33,34],f_i:[0,6,12,16,31,34],f_m:[3,10],f_n:3,f_raw:2,f_vec:2,f_wrap:2,face:[13,32,33,34],facecolor:[6,8,25,31],facil:[0,15,21,28,32,33,34],facilit:[12,34],fact:[0,1,3,5,9,11,12,13,28,29,30,31,32,33,34],factor:[0,1,3,5,6,9,10,11,13,22,25,28,29,30,31,33,34],factori:[13,33,34],fade:6,fafab0:[9,10],fahimeh:[26,28],fail:[0,6,8,9,11,13,26,28,31,32,33],fail_on_error:[0,7,32],failur:[7,32],fairli:[1,2,25],faisal:[16,29],fake:4,fake_loss:4,fake_output:4,fall:[8,9,24],fals:[0,1,2,3,4,5,6,7,9,10,14,22,23,28,29,30,31,32,33,34],famili:[0,7,8,25,32],familiar:[0,3,5,6,8,15,21,22,23,25,28,30,31],famou:[6,12],far:[0,3,4,5,6,8,11,12,13,14,28,29,32,33,34],fashion:[0,9,10,28],fast:[1,3,6,10,12,13,21,25,28,31,32,33],faster:[1,11,13,33,34],fastest:[13,22,32,33],favor:[7,32],favorit:25,fc:3,fd:[0,7,32],featur:[0,1,3,5,6,7,8,10,11,12,13,18,21,23,25,28,30,31,32,33,34],feature_nam:[0,1,7,9,32],feautur:9,fed:1,feed:[0,2,3,11,21,28],feed_forward:1,feed_forward_out:1,feed_forward_train:1,feedback:[4,20,28],feeddorward:4,feedforward:[1,4,12],feel:[0,5,6,11,13,15,16,21,23,26,28,30,33,34],feet:0,felt:23,fetch:[6,23],few:[1,3,4,5,9,25,28,33],fewer:[0,9,11,28],ffnn:[1,12,34],field:[0,3,6,12,21,34],fifth:[0,6,15,16,23,28],fig:[0,1,2,3,4,6,7,12,13,14,23,28,32,33,34],fig_id:[0,6,7,9,28,29,31,32],figaxi:25,figsiz:[0,1,2,3,4,6,7,8,9,10,28,31,32],figur:[0,1,2,3,4,5,6,7,8,9,10,12,13,14,15,16,21,23,28,29,30,31,32,33,34],figure_id:[0,6,7,9,28,29,31,32],figurefil:[0,6,7,9,28,29,31,32],file:[0,2,3,4,5,6,7,9,14,23,28,29,30,31,32],file_prefix:4,filenam:28,filenotfounderror:[0,7,32],fill:[5,9,29],filter:[0,3,4,7,32],financ:0,find:[0,1,2,3,5,6,7,8,9,10,11,12,13,14,15,16,21,23,25,28,29,30,32,34],fine:[0,14,15,28],finish:2,finit:[3,5,6,12,13,17,25,29,30,31,33,34],first:[0,1,2,3,5,6,7,8,9,10,11,13,14,15,16,17,22,23,25,26,27,31,34],first_moment:[33,34],first_term:[33,34],firsteigvector:11,fit:[1,3,4,5,6,7,8,9,11,12,13,15,16,17,23,25,29,31,32,33,34],fit_beta:[6,29,30],fit_intercept:[0,5,6,29,30,31],fit_mod:9,fit_transform:[0,6,8,9,11,31,32],fiti:[0,28],five:[0,9,17,23,28,29,32],fix:[0,3,4,6,10,11,12,13,23,28,31,32,33,34],fixedloc:6,flag:4,flat:[3,4,12,13,14,32,33,34],flatten:[1,3,4,5,22],flexibl:[1,6,8,10,12,28,31,34],flip:[26,28],float32:[4,9,34],float64:[4,22,28,29,34],floor:[],flop:[5,22,29],flow:[1,4,12,34],fluctuat:[5,30],fly:11,fm:[0,28],fmax:3,fmesh:[13,33],fn:7,fname:[0,7,32],focu:[0,3,4,5,6,15,21,27,28,29,30,31],focus:[1,6,7,22,29,30,32],fold:[6,9,23],folder:[0,1,3,4,6,14,23,28,31],follow:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,21,22,23,24,25,26,27,28,29,30,31,32,33,34],font:[0,7,25,28,32],fontdict:25,fontsiz:[1,6,8,9,10,25],fontweight:1,footprint:3,foral:[8,29],forc:[0,5,6,10,11,28,29,30,32],forcast:4,forecast:[4,12,34],forest:[0,1,9,21,28],forget:11,form:[0,3,4,5,6,7,8,9,11,12,13,17,21,22,23,25,28,29,30,31,32,33,34],formal:[3,4,14,25],format:[0,1,2,3,4,6,7,8,9,10,11,21,25,27,29,30,31,32,34],format_data:4,formatstrformatt:[6,13,23,32,33],formul:[4,6,11,14],formula:[3,13,25,32,33,34],forth:[4,12,34],fortran2003:[21,28],fortran2008:23,fortran90:25,fortran:[0,15,21,22,28],fortun:[0,11,29],forward:[0,3,6,21,22,28,31],foster:28,found:[1,2,3,4,5,6,12,13,14,19,20,23,28,29,30,31,33,34],foundat:[21,28],four:[4,5,6,8,12,22,23,24,26,28,30,34],fourier:[0,28],fourierdef1:3,fourierdef2:3,fourierseriessign:3,fourth:[12,28,29],fp:7,frac:[0,1,2,3,5,6,7,8,9,10,11,12,13,14,15,16,17,19,22,23,25,28,29,30,31,32,33,34],fractal:9,fraction:9,frame:[7,32],framework:[1,3,4,8,10,14,25],frank:[5,11],frankefunct:[5,6,11,23,29],fredli:[26,28],free:[0,6,11,13,15,16,21,22,23,25,26,27,28,33,34],freecodecamp:21,freedom:[5,30],freeli:[0,23],frequenc:[3,6,7,25,31,32],frequent:[0,8,9,13,32,33,34],frequentist:21,fresh:10,fridai:[16,17,18,19,20,26,28],friedman:[6,18,23,24,27,28],friendli:4,frodo:28,frog:3,from:[0,1,2,3,4,6,7,8,9,11,13,14,16,17,18,19,21,22,23,25,26,27,28],from_cod:9,from_logit:[3,4],from_tensor_slic:4,fromnumer:2,front:[0,4,5,15,16,28,29,30],fulfil:[2,5,12,29,34],full:[0,1,3,5,7,9,10,13,25,28,29,32,33,34],full_matric:[5,29],fulli:[3,6,12,24,25,31,32,34],fun:[2,21,28],fun_nam:[],func:2,functionali:11,fundament:[0,6,21,28,31],funtion:2,further:[2,7,9,28],furthermor:[0,3,5,6,7,11,12,13,17,21,23,28,29,30,31,32,33,34],futur:[0,4,8,9,28],futurewarn:8,fy:[15,23,24,26,27,28],fys4155:23,fys5419:[27,28],fys5429:[27,28],g0:2,g:[0,1,2,3,4,6,8,9,10,11,13,25,28,30,31,32,33,34],g_0:2,g_1:[2,10],g_2:[2,10],g_:[2,9,10],g_analyt:2,g_dnn_ag:2,g_euler:2,g_i:2,g_m:[3,10],g_n:3,g_re:2,g_t:2,g_t_d2t:2,g_t_d2x:2,g_t_dt:2,g_t_hessian:2,g_t_hessian_func:2,g_t_jacobian:2,g_t_jacobian_func:2,g_trial:2,g_trial_deep:2,g_vec:2,gain:[1,5,7,9,10,13,29,30,31,33,34],galleri:[0,28],game:4,gamge:28,gamma1:8,gamma2:8,gamma:[0,2,8,9,10,11,13,28,32,33,34],gamma_0:10,gamma_1:10,gamma_1x:10,gamma_:[0,28],gamma_i:[0,8,25,28],gamma_j:[13,33,34],gamma_k:[13,32,33],gamma_m:10,gamma_x:[0,28],gap:[6,8],gate:[4,12],gather:[0,1,12,29,34],gaug:[12,34],gaussbacksub:22,gaussian:[4,5,6,8,14,25,30,31],gaussian_point:14,gaussian_rbf:8,gave:[13,33,34],gavra:28,gbc:[24,28],gca:[2,6,8,13],gd:[1,32],gd_clf:10,gdclassiffiercgain:10,gdclassiffierconfus:10,gdclassiffierroc:10,gdfit:34,gdm:[13,33,34],gdregress:10,ge:[1,5,7,25,29,32],gen:[0,7,32],gen_loss:4,gen_tap:4,gender:[0,28],genener:4,gener:[0,1,2,3,5,6,8,10,11,12,13,14,15,16,17,19,20,22,23,25,27,29,30,31,32,33,34],generallay:[12,34],generate_and_save_imag:4,generate_imag:4,generate_latent_point:4,generate_simple_clustering_dataset:14,generated_imag:4,generator_loss:4,generator_loss_list:4,generator_model:4,generator_optim:4,genom:21,geodes:11,geometr:[0,13,28],geometri:[5,30,31],georg:27,geotif:[6,23],geq:[2,5,8,9,13,29,30,32,33],geron:[0,15,24,27,28,33,34],get:[0,1,2,3,4,5,6,7,9,10,11,13,15,20,21,22,23,25,26,28,29,30,31,32,33],get_dummi:9,get_paramet:2,get_split:9,get_yaxi:8,get_yticklabel:6,getattr:[],gg:28,gibb:[21,28],gif:4,gini:10,gini_index:9,ginvers:13,git:[0,15,21,28],giter:[13,33,34],github:[0,6,9,15,16,17,19,20,21,23,24,26,27,28,29,32,33,34],gitlab:[0,15,21,23,28],give:[0,1,2,3,5,6,7,8,9,10,12,13,14,17,21,23,25,28,29,30,31,32,33,34],given:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,22,23,25,28,29,30,31,32,33,34],global:[6,7,13,23,32,33,34],glorot:1,gnew:13,go:[0,1,3,5,6,8,9,11,12,13,23,28,29,30,31,32,33],goal:[0,7,9,28,32],goe:[0,1,2,5,6,13,14,18,22,28,29,30,31,32,33,34],golden:[13,33],gone:[5,29,30],gong:1,good:[1,3,4,5,6,9,10,11,13,17,21,25,27,29,30,31,32,33,34],goodfellow:[4,24,27,28,29,30,32,33],googl:[1,4,21,28,34],got:[1,6,13,23],gotcha:34,gotten:28,gov:[6,23],gp:27,gpu:[1,13,21,28,33,34],grad:[2,13,33,34],grad_analyt:[13,33,34],grad_concatenate_arg:[],grade:[23,24],gradient:[0,3,4,7,8,9,12,21,28,29],gradient_desc:[33,34],gradientboostingclassifi:10,gradientboostingregressor:10,gradients_of_discrimin:4,gradients_of_gener:4,gradienttap:4,gradual:[1,14],grai:[4,6,23],graph:[1,9,11,12,13,32,33,34],graph_from_dot_data:9,graphic:[0,1,9,28],grasp:0,gray_r:[1,3],grayscal:3,great:[5,13,32,33],greater:[1,7,25,32],greatli:[13,33,34],greedi:[9,32],green:[0,3,9,25],grei:4,grid:[1,3,6,7,8,12,25,29,30,31,34],gridsearch:32,gridsearchcv:32,grossli:[13,32,33],ground:[0,28],group:[0,6,7,9,14,21,23,24,26,28,31],groupbi:[0,28],grow:[1,3,9,10],growth:[0,28],gru:4,guarante:[0,4,13,25,28,29,32,33],guess:[1,4,10,13,14,32,33,34],guestrin:10,guid:1,guidanc:23,guidelin:[20,33,34],h1:2,h:[0,1,5,6,8,13,16,18,23,25,26,27,28,29,32,33,34],h_1:[2,13,32,33],h_2:[2,13,32,33],h_:[0,13,28,32,33],h_m:10,ha:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,16,22,23,25,28,29,30,31,32,33,34],haa:26,habit:[0,29],had:[0,1,6,7,13,28,31,32,33],hadamard:[1,12,13,33,34],half:[1,8,9],halv:10,hand:[0,1,2,3,5,11,12,13,15,21,22,23,24,25,26,27,28,29,30,31,32,33,34],handi:[3,23],handl:[0,1,2,5,9,11,21,30],handle_unknown:9,handsid:12,handwrit:[12,34],handwritten:[1,5],handwrittennot:[32,34],happen:[1,2,3,4,5,6,10,13,25,29,33,34],hard:[1,7,8,10,13,32,33],hardcopi:[21,28],harder:[0,1,29],harmon:3,hasn:[],hassl:[0,15,21,28],hast:[21,28],hasti:[0,6,15,16,17,18,23,24,27,28,29,31,32],hat:[0,1,5,6,7,9,10,11,12,13,17,18,22,23,29,30,31,33,34],have:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,21,22,23,25,26,28,29,30,31,32,33,34],haven:1,he:[7,32],head:[0,4,10,25],header:[0,28],heads_proba:10,health:[0,29],hear:[0,13,28,33,34],heart:[0,7,28,32],heatmap:[0,1,3,7,28,32],heavili:0,heavisid:1,height:[1,3,6,29,30],held:[13,33,34],help:[0,1,4,12,13,16,23,28,33,34],helper:[4,14],henc:[0,5,6,8,9,10,12,13,18,23,28,29,30,31,32,33,34],henrik:[26,28],her:[7,32],here:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,21,22,23,25,28,29,30,31,32,33,34],hereaft:[0,8,12,28],hermitian:22,hessenberg:22,hessian:[0,2,5,13,16,30,34],heterogen:[9,10],hi:[7,32],hidden:[1,3,4,12,34],hidden_bia:1,hidden_bias_gradi:1,hidden_layer_s:[0,1,28],hidden_neuron:4,hidden_weight:1,hidden_weights_gradi:1,hierarch:[5,29,30],high:[0,1,2,3,4,5,6,9,10,11,13,14,21,22,23,28,29,31,32,33,34],higher:[0,1,3,5,6,8,13,23,28,29,30,31,32,33,34],highest:[1,2],highli:[0,3,4,10,18,21,22,27,28,29,30,31],highwai:0,hing:8,hint:[13,16,29,30,32,33],hip:21,hire:0,hist:[4,6,7,25,31,32],histogram:[0,6,7,25,32],histor:[7,11,32],histori:[3,4,12,34],hitherto:[5,30],hjorth:[26,28,29,30,31,32,33,34],hobbi:25,hoc:[5,29],hoff:27,hold:[1,3,6,13,14,31,32,33,34],holder:[0,28],holomorphic_grad:2,home:0,homepag:[23,28],homework:[6,13],homogen:[1,3,9,10,13,33,34],honchar:2,hopefulli:[0,11,25,28,34],horizont:11,hors:[3,7,32],hot:[1,9],hour:[1,21,24,25,26,28],how:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,21,22,23,25,28,29,30,31,33,34],howev:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,21,22,23,25,28,29,30,31,32,33,34],hspace:[0,4,8,10,25,28],hstack:1,htf:[24,28],html:[0,9,11,17,19,21,23,24,26,27,28,30],http:[0,3,4,6,9,11,13,16,17,19,20,21,22,23,24,26,27,28,29,30,31,32,33,34],huang:[0,28],huber:[0,28],huge:[1,3,4,21],human:[0,1,3,6,9,12,29,30,34],humid:9,hundr:1,hungri:1,huse:28,hvae:34,hybrid:24,hydrogen:[0,28],hyperbol:[1,4,12],hyperparam:8,hyperparamet:[3,4,5,6,9,13,17,28,29,30,32,33,34],hyperplan:11,i0:[0,28],i1:[0,6,8,12,28,29,30,34],i2:[0,8,12,28,34],i3:[0,12,28,34],i5:[0,28],i:[0,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,22,23,25,26,28,29,30,31,32,33,34],i_1:[5,6,30,31],i_2:[5,6,30,31],i_:[13,32,33],ian:27,ic:1,id:[7,13,32,33,34],ida:[26,28],idea:[0,1,2,3,4,6,9,10,12,13,22,23,29,30,31,32,33,34],ideal:[0,2,6,8,13,25,28,31,34],idem:[6,31],ident:[5,6,12,13,17,22,23,29,33,34],identical:[30,31],identifi:[0,1,7,9,11,12,13,14,28,29,32,33,34],ieor:25,ifi:27,ifs:[21,28],ignor:[0,1,3,9,29],ii:[22,25],iii:[22,28],ij:[0,1,3,6,8,12,14,16,18,22,23,25,28,29,30,34],ik:[0,22,28,29],illustr:[5,7,10,12,13,14,21,28,31,32,33],ilsvrc:[33,34],im:6,imag:[1,3,4,6,9,11,12,14,27,28,34],image_at_epoch_:4,image_batch:4,image_height:3,image_path:[0,6,7,9,28,29,31,32],image_width:3,imageio:[6,23],images_from_seed_imag:4,imagin:1,immedi:[0,3,4,6,15,21,28],implement:[0,2,3,4,5,6,8,9,10,11,12,13,14,17,23,25,28,29,30,32,33],impli:[3,5,6,7,13,22,29,30,31,32,33],implicit:3,implicitli:[11,25],importantli:3,impos:[0,6,11,12,28,34],imposs:[0,5,28,29],impress:[0,12,28,34],improv:[0,4,5,9,10,11,13,23,29,34],impur:9,imread:[6,23],imshow:[1,3,4,6,23],in1:[],in2:[],in3050:[27,28],in3310:28,in4080:[27,28],in4300:[27,28],in4310:27,in5400:3,in5550:27,in_out_neuron:4,inaccur:[13,32,33],inact:[12,34],inadequ:[0,28],inch:[6,29,30],includ:[0,1,2,3,4,5,6,7,11,12,15,16,17,20,21,23,25,26,27,28,29,30,31],include_bia:[6,9,31],inclus:[17,34],incom:[12,34],incorrect:1,incoveni:8,increas:[0,1,3,4,5,6,8,9,11,12,13,23,25,28,29,30,31,33,34],increasingli:25,increment:33,ind:6,inde:[0,2,4,5,6,13,28,29],indefinit:4,independ:[0,5,6,7,8,12,13,25,28,29,32,33,34],index:[0,1,3,4,10,14,21,22,25,27,28],index_col:[0,28],indic:[0,1,3,4,5,6,9,10,11,13,16,23,28,29,33,34],indispens:[6,31],individu:[1,6,7,10,12,25,28,29,31,32,34],indu:0,indx1:2,indx2:2,indx3:2,indx:22,ineffici:[3,13,33,34],inequ:[8,13],inequaltii:[32,33],inertia:[13,33,34],inf1000:[21,28],inf1100:[21,28],inf1100l:[21,28],inf1110:[21,28],inf3000:28,infeas:9,infer:[0,1,4,6,27,28,31],inferenc:1,infil:[0,6,7,9,28,31,32],infin:[5,6,7,11,18,29,30,31,32],infinit:3,infinitesim:25,influenc:[6,10,31,32],influenti:1,info:28,inform:[0,1,3,4,6,9,11,12,13,14,22,23,27,28,31,32,33,34],infti:[3,6,13,25,31,32,33],ingeni:[13,32,33,34],ingrad:2,ingredi:[0,9,28],inher:[6,31],inherit:[22,28],initi:[0,1,2,6,10,13,14,22,25,28,31,32,33,34],inject:14,inlin:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,22,23,25,28,29,30,31,32,33,34],inner:[0,13,29,33],inp:4,inplac:13,input:[0,1,3,4,5,6,7,8,12,13,14,23,25,28,29,30,31,32,33,34],input_dim:1,input_shap:[3,4],inputs:1,inputs_shuffl:[0,1,29],insert:[3,5,6,8,10,25,29,30,31],insid:[0,4,7,32],insight:[0,1,5,21,28,29,30,31],insist:[6,13,29,30,33],inspect:32,inspir:[0,1,12,28,34],instabl:2,instal:[0,1,5,6,9,15],instanc:[0,1,2,4,6,9,11,13,28,29,31,32,33],instanti:10,instead:[0,1,2,3,4,5,6,8,9,11,13,14,22,23,25,28,29,31,32,33,34],institut:1,instruct:[0,1,15,16,28],int32:10,int_0:25,int_:[3,6,25,31],int_a:25,intak:[0,29],integ:[1,2,13,14,22,25,28,33,34],integer_vector:1,integr:[3,6,25,28,31],intellig:[0,14,27,28],intend:10,intens:1,intention:14,interact:[0,6,9,12,21,23,28,34],intercept:[0,6,8,11,13,16,23,28,30,31,32,33,34],intercept_:[0,6,8,9,13,28,29,30,32,33],interchang:[5,12,22,30,31,34],interconnect:1,interest:[0,1,2,3,4,5,6,7,8,9,12,21,23,25,28,29,30,31,32,33,34],interfac:[0,1,22,29],interior:[0,9,28],intermedi:[22,29],intern:[1,2,10,12,34],interpol:[1,3,4,6,12,23,34],interpr:[5,29,30],interpret:[0,1,6,9,10,12,13,17,19,22,23,25],interv:[0,3,5,6,7,13,18,23,25,28,29,30,32,33],intial:[13,32,33],intract:[0,4,29],intrins:[3,11,22,25,28],intro:[21,27,28],introduc:[0,1,5,6,8,10,12,17,22,23,25,28,31,32],introduct:[1,2,4,13,17,20,27,29,32,33],introductori:[0,4,22,27,28,29],intuit:[0,5,6,8,12,13,23,28,30,31,33,34],inv:[0,5,13,28,29,30,32,33,34],invalid:[1,8],invalu:[0,13,15,21,28,32,33],invari:1,invd:[5,30],inver:[8,34],invers:[0,3,6,13,15,16,17,23,28,29,32,33,34],inverse_transform:8,invert:[0,5,7,10,13,28,30,32,33,34],invh:[13,33,34],invok:[0,8],involv:[0,2,6,7,11,12,29,31,32,33,34],io:[0,17,19,21,23,24,26,27,28,29],ion:34,ip:[0,8,25,28],ipca:11,ipykernel_1323:[],ipykernel_1390:[],ipykernel_1539:[],ipykernel_1579:[],ipykernel_58656:[],ipykernel_58739:[],ipykernel_58840:[],ipykernel_58862:[],ipykernel_6316:[],ipykernel_6403:[],ipykernel_6690:[],ipykernel_6729:[],ipykernel_95354:1,ipykernel_95419:6,ipykernel_95519:28,ipykernel_95542:31,ipynb:[21,23,28],ipython:[0,5,7,9,11,14,15,21,23,28,29,32],iq:[6,31],iri:[8,9],irreduc:[6,31],irrelev:[5,29],irrespect:[0,28],isbox:[],iscomplexobj:2,iseffici:[33,34],isn:[5,30,31],isnul:0,isomap:11,isotop:[28,32,33],issu:[1,9,22,30],it_arrai:[13,33],item:[0,13,28,33],items:[22,28],iter:[1,2,4,6,8,9,11,13,14,25,31,32,34],its:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,18,21,22,23,25,28,30,31,32,33,34],itself:[5,6,12,19,23,25,29,30,31],j1:22,j:[0,1,2,3,4,5,6,8,9,11,12,13,14,16,17,18,19,22,23,25,27,28,29,30,31,32,33,34],j_:6,j_lasso_sk:6,j_ridge_sk:6,j_sk:6,jackknif:[6,21,28,31],jacobian:[2,13,32,33],jacobian_shap:[],jakobsen:26,jason:4,jax:[21,28],jax_descend_i:34,jax_descend_x:34,jax_enable_x64:34,jax_grad:34,jensen:[26,28,29,30,31,32,33,34],jerom:[18,23,27],ji:[12,22],jit:[13,33],jj:[0,5,6,28,30,31],jk:[0,1,6,12,22,28,34],jl:[0,28],jm:22,jnp:[13,33,34],job:[2,8,10],johansen:28,join:[0,3,4,6,7,9,14,28,29,31,32],joint:[4,5,30,31],judg:[13,32,33],judgement:[6,23],julia:[21,22,23],jump:[23,25],junk:4,jupit:28,jupyt:[0,9,15,19,21,23,27,28],just:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,21,23,25,28,29,30,31,32,33,34],justif:0,justifi:[3,10],k0:[7,32],k1:[7,32],k:[0,1,3,5,6,7,8,9,10,11,12,13,14,21,22,23,25,26,28,29,30,33,34],kaggl:[6,23],kappa_d:25,karl:[26,28],karush:8,katrin:[26,28],keep:[0,1,4,5,6,11,13,14,22,23,28,29,30,31,32,33,34],keepdim:[1,2,6,10,22,31],kei:[0,1,3,6,12,29,34],kept:[4,6,14,31],kera:[0,4,21,23,28],kernel:[0,1,3,4,14,21,28,29],kernel_librari:[3,4,14],kernel_regular:[1,3],kernel_s:4,kernelpca:11,kev:[0,28],kevin:[27,28],keyboardinterrupt:[1,2],keyerror:[],keyword:[6,13,22,28],kfold:[6,31,32],kg:1,ki:22,kick:[1,13,33,34],kiener:2,kilomet:[6,29,30],kind:[0,2,3,4,8,12,13,14,28,29,33,34],kj:[6,12,22,29,30],kjm:[21,28],kkt:8,kl:25,km:[12,28,34],kmean:14,kmeanspoint:14,kn_k:14,know:[0,1,2,5,6,8,13,21,28,29,30,32,33,34],knowledg:[0,21,28],known:[1,3,4,5,6,7,8,9,12,22,23,25,27,29,30,31,32,34],kondev:[0,28],kp:25,kpca:11,kroneck:14,kuhn:8,kvalsund:[26,28],kwarg:2,kwown:[0,28],l0:[7,32],l1:[0,1,3,7,28,32],l1_l2:[1,3],l1regl:5,l2:[1,3],l:[0,1,2,3,5,6,7,8,10,11,12,13,19,22,23,25,28,29,32,33,34],l_1:[7,32],l_2:[7,13,32,33],l_:22,l_j:12,la:[13,33],la_i:12,la_k:12,lab:[20,21,23,28],label:[0,1,2,3,4,5,6,7,8,9,10,12,13,14,21,22,23,25,28,29,30,31,32,33,34],label_prob:[33,34],labelencod:[7,10,32],labels:[6,8,9],labels_shuffl:[0,1,29],laboratori:[24,30],lack:[0,28],lagari:2,lagrang:[8,11],lambda:[0,1,2,3,5,6,7,8,10,12,13,17,18,23,25,28,29,30,31,33,34],lambda_0:11,lambda_1:[5,8,11,29],lambda_2:[8,11],lambda_:11,lambda_i:[8,11],lambda_iy_i:8,lambda_jy_iy_j:8,lambda_k:8,lambda_n:[5,8,29],lamda:1,land:[0,8],landmark:8,landscap:[13,32,33,34],langl:[0,6,11,25,28,29],languag:[0,1,4,8,15,21,22,23,27,28],lapack:[22,28],laplac:[5,30,31],laptop:21,larg:[0,1,2,4,5,6,8,9,10,11,13,15,21,22,23,25,27,28,29,31,32,33,34],larger:[0,3,5,6,8,10,11,13,17,25,28,29,30,31,32,33,34],largest:[4,8,11],lasso:[0,7,21,28],lasso_sk:6,last:[0,1,2,3,4,5,6,7,8,10,12,13,14,17,18,22,23,25,26,28,30,31,33],latent:4,latent_dim:4,latent_point:4,latent_space_value_rang:4,later:[0,1,4,7,8,12,13,14,15,21,23,28,32,33,34],latest:[4,21],latest_checkpoint:4,latex:28,latter:[0,3,6,7,8,11,13,16,22,23,25,28,29,30,31,32,33,34],lattic:[12,34],law:0,lax_numpi:34,layer:[0,4,13,28,33,34],lbfg:[7,9,10,11,32],lcc:[5,6,30,31],lda:11,ldot:[0,6,11,19,23,28,31,32],le:[5,7,10,13,17,25,29,30,32,33,34],lead:[0,1,3,5,6,7,8,9,10,11,12,13,16,17,22,25,28,29,30,31,32,33,34],leaf:9,leaki:1,leakyrelu:4,lear:[13,32,33],learn:[3,4,5,6,7,8,9,10,12,18,22,24,26,27],learnabl:3,learner:10,learnig:28,learning_r:[8,10,34],learning_rate_init:[0,1,28],learning_schedul:[13,33,34],learnt:23,least:[0,7,8,10,11,15,16,17,19,21,22,25,31,32],leat:[13,33,34],leav:[0,1,3,5,6,9,11,28,30,31,32],lectur:[0,1,5,10,11,12,13,15,17,21,22,23,24,26,27],lecturenot:[0,17,19,21,23,27,28],left:[0,1,2,3,5,6,7,8,9,10,11,12,13,14,16,17,19,22,23,25,28,29,30,31,32,33,34],leftarrow:[8,12],legend:[0,2,3,4,5,6,7,8,9,10,13,28,29,30,31,32,33,34],len:[0,1,2,3,4,5,6,8,9,10,11,12,22,28,29,30,31,33,34],length:[0,1,2,3,4,8,9,13,16,21,28,29,32,33,34],length_of_sequ:4,leq:[0,5,7,8,13,14,25,28,29,30,32,33],less:[0,1,3,4,5,6,8,9,13,21,25,28,29,30,31,32,33,34],lessen:1,let:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,22,25,28,29,30,31,32,33,34],letter:[0,16,22,25,28,29],level:[0,1,5,6,9,21,22,23,24,26,28,31],li:[8,11],lib:[0,2,3,4,6,7,8,9,11,14,28,30,32,34],liblinear:[8,10],libmetal_plugin:[3,4,14],librari:[0,1,2,3,4,5,6,7,9,10,11,14,15,22,23,25,27,29,30,32],library_loc:[3,4,14],licens:[0,1,15,21,23,28],lie:[0,6,11,25,28,29,31],life:[0,1,8,12,28,34],lifetim:[13,33,34],like:[0,1,2,3,4,5,6,7,9,10,11,12,13,15,16,21,22,23,25,28,29,30,31,32,33,34],likelihood:[0,1,5,9,28,29,33,34],lim_:25,lima:26,limit:[0,5,6,8,9,11,12,22,23,28,29],lin_clf:8,lin_model:0,lin_reg:9,linalg:[0,2,5,6,8,11,13,22,25,28,29,30,32,33,34],line1:8,line2:8,line2d:[33,34],line3:8,line:[0,1,2,3,4,6,7,8,10,11,13,14,23,28,29,30,31,32,33,34],linear:[1,3,5,6,7,9,10,11,12,17,18,21,23,25,31,33,34],linear_model:[0,5,6,7,8,9,10,11,13,28,29,30,31,32,33,34],linear_regress:[6,31],linearli:[5,29],linearloc:[6,13,23,32,33],linearregress:[0,6,7,9,28,29,30,31,32],linearsvc:8,lineat:30,liner:[1,3],linerar:10,linewidth:[0,2,4,6,8,9,10,23,31],link:[0,4,9,12,21,23,26,28],linlag:[5,30],linpack:[22,28],linreg:[0,28],linspac:[0,2,3,4,6,8,9,10,13,15,16,22,25,28,29,30,31,33,34],linu:4,linux:[0,1,15,21,23,28],liquid:[0,28],list:[0,1,2,3,4,7,9,21,23,28,29,32,33,34],listcomp:[],listedcolormap:[9,10],literatur:[1,7,14,27,31,32],littl:[1,3,9,12],live:8,ll:[0,25,28,29],lle:[0,29],lloyd:[4,14],lmb:[0,2,5,6,30,31,32],lmbd:[0,1,3,28],lmbd_val:[0,1,3,28],lmbda:[13,32,33],ln:[1,13,32,33],load:[0,1,3,4,6,7,9,10,14,23,32],load_boston:0,load_breast_canc:[1,7,9,10,11,32],load_data:[3,4],load_digit:[1,3],load_iri:[8,9],load_librari:[3,4,14],load_pluggable_device_librari:[3,4,14],loc:[0,3,6,7,8,9,10,28,31,32],local:[0,1,2,3,7,12,13,29,32,33,34],locat:[2,3,8],log10:[0,5,6,30,31,32],log:[0,1,2,4,5,6,7,9,10,11,13,22,23,28,29,30,31,32,33,34],log_:[0,28],log_clf:10,logaddexp2:[],logaddexp:[],logarithm:[0,5,7,22,28,30,31,32],logbook:23,logic:[0,1,9,28],logist:[0,1,2,8,9,10,11,12,13,21,29],logistic_predict:[33,34],logisticregress:[7,9,10,11,32,34],logit:[7,32],logreg:[7,9,10,11,32,34],logspac:[0,1,3,5,6,28,30,31,32],longer:[2,3,8,10,14,22,25,28],loocv:[6,31,32],look:[0,1,2,3,4,5,6,7,8,9,10,11,13,16,18,22,23,25,28,29,30,31,32,33,34],loop:[1,4,6,10,12,14,21,22,28,31],lose:1,loss:[0,1,3,4,5,6,7,8,10,11,13,22,23,28,30,31,34],loss_fil:4,lossfil:4,lost:4,lot:[0,1,4,6,31,33,34],low:[0,6,9,10,11,23,28,29,31],lower:[0,1,3,6,9,10,16,22,29],lowercas:[22,28],lowest:[9,13,25,33,34],lr:[1,3,4,10],lstat:0,lstm:4,lstm_2layer:4,lstsq:[0,28,29],lt:[6,31],lu:[0,5,28,29],lubksb:22,luckili:2,ludcmp:22,lux:22,lvert:1,lw:[0,28],m:[0,1,2,3,5,6,8,9,10,11,12,13,22,24,25,26,27,28,29,30,31,32,33,34],m_1:14,m_:[9,12],m_h:[0,28],m_k:14,m_l:12,m_n:[0,28],m_p:[0,28],m_t:[13,33,34],ma:11,machin:[1,3,4,5,6,7,9,10,11,12,15,22,24,27,29,30,31,34],machinelearn:[0,6,16,17,19,20,21,23,24,26,27,28,32,33,34],mackai:27,made:[0,1,3,4,5,6,7,9,11,12,18,23,28,29,32,34],mae:[0,28],magic:4,magnitud:[1,6,7,13,29,30,32,33,34],mai:[0,1,2,3,5,6,7,8,9,11,12,13,18,21,22,23,25,28,29,30,31,32,33,34],mail:[24,26],main:[0,1,3,4,5,6,7,9,22,23,27,29,32],mainli:[0,5,6,7,9,28,29,30,31,32],maintain:[6,31],major:[1,6,9,10,13,22,28,31,32,33,34],make:[1,2,3,4,5,6,7,8,11,12,13,21,22,23,25,27,30,31,32,33,34],make_axes_locat:6,make_classif:34,make_moon:[8,9,10],make_pipelin:[0,6,10,29,31],make_vjp:2,makedir:[0,6,7,9,28,29,31,32],makeplot:[0,28],malcondit:22,malign:[1,7,9,32],mammographi:[5,30,31],manag:[0,2,3,15,21,23,28],mandatori:[26,28],mani:[0,1,3,4,5,6,7,8,9,11,13,14,21,22,23,25,27,28,29,30,31,32,33,34],manifold:11,manner:3,manual:[6,29,30,32],map:[0,1,2,6,7,8,11,12,14,23,25,28,32,34],marc:29,margin:[0,5,8],marit:[0,28],mark:28,marker:[0,7,22,28,32,34],markov:[21,28],marsaglia:25,mass:[0,1,5,13,29,33,34],massag:[0,28],masses2016:[0,28],masses2016ol:[0,28],masses2016tre:0,masseval2016:[0,28],master:[6,16,20,23,24,26,32,33,34],mat1100:[21,28],mat1110:[21,28],mat1120:[21,28],mat:[21,28],match:[1,4,5,13,14,29,32,33,34],match_complex:[],materi:[4,5,7,13,17,22,26,33,34],math:[3,7,12,13,22,25,27,28,32,33,34],mathbb:[0,4,5,6,7,8,11,12,13,14,17,18,19,22,23,25,28,29,30,31,32,33,34],mathbf:[0,5,6,7,8,13,18,19,22,23,28,29,30,31,32,33,34],mathcal:[1,5,6,7,13,19,23,30,31,32,33],matheemat:3,mathemat:[0,6,11,12,13,17,21,22,25,27,28,30,32],mathemati:28,mathmlbook:16,mathrm:[0,1,3,4,5,6,7,8,9,10,11,12,13,14,17,18,19,23,25,28,29,30,31,32,33,34],matmul:[1,2,5,30],matnat:27,matplotlib:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,21,22,23,25,28,29,30,31,32,33,34],matric:[0,1,3,4,6,7,8,11,13,16,17,21,29,32,33],matrix:[0,2,3,4,6,7,8,10,13,15,16,17,18,19,23,25,31],matshow:1,matter:[2,3,13,29,32,33,34],max:[0,1,2,3,4,9,10,12,13,26,28,32,33,34],max_depth:[0,9,10],max_diff1:2,max_diff2:2,max_diff:2,max_it:[0,1,8,9,11,13,28,32,33,34],max_iter:14,max_leaf_nod:10,max_sampl:10,maxdegre:[0,6,10,29,31],maxdepth:10,maxim:[1,4,5,7,8,11,30,31,32],maximum:[0,2,3,5,7,8,9,10,13,14,28,29,33,34],maxpolydegre:[5,6,30,31,32],maxpooling2d:3,mbox:[5,6,18,23,29,30,31],mcculloch:[12,34],md:[11,20,23,33,34],mdoel:4,mean:[1,2,3,4,5,6,7,9,10,11,12,13,14,15,16,17,18,19,21,22,23,25,28,31,33,34],mean_absolute_error:[0,28],mean_divisor:14,mean_i:25,mean_matrix:14,mean_squared_error:[0,4,6,7,10,28,29,31,32],mean_squared_log_error:[0,28],mean_vector:14,mean_x:25,meaning:[0,4,7,28,32],meansquarederror:[0,28],meant:[2,3,7,10,13,32,33,34],measur:[0,1,2,5,6,9,11,12,14,19,23,25,28,29,30,31],mechan:[0,4,25,28],median:[0,28,29],medicin:[12,34],medium:[4,8,13,33,34],medv:0,meet:[0,26],mehta:[0,28,29,30],memori:[3,4,11,12,13,22,33,34],mention:[0,12,13,23,25,28,32,33,34],mere:[0,15,28],meshgrid:[2,5,6,8,9,10,11,23,29],messag:[5,13,33,34],messi:2,met:[0,3,8,29],metadata:2,meteorolog:9,meter:[6,29,30],method:[0,1,2,3,4,5,7,8,11,12,14,16,17,18,19,21,22,25,27,29,30],metion:[6,23],metric:[0,1,3,6,7,9,10,14,15,16,28,29,31,32],metropoli:[21,28],mev:[0,25,28],mgd:[13,33,34],mglearn:[21,28],mgrid:[13,33],mhjensen:[2,3,4,6,8,9,11,14,34],mi:10,mia:[26,28],michigan:[28,30,32,33,34],microsoft:27,mid:1,midel:4,midnight:[16,17,18,19,20],midpoint:9,might:[0,1,2,4,6,9,13,29,30,32,33,34],mild:9,millimet:[6,29,30],million:[0,28,29,33,34],mimic:[12,34],min:[0,2,5,8,9],min_:[0,2,5,14,17,28,29,30],min_samples_leaf:9,mind:[0,6,13,23,28,29,30,31,32,33],mindboard:4,mine:[21,28],mini:[1,11,12,13,32],minibatch:[1,11,13],minibathc:[13,33,34],miniforge3:[0,2,3,4,6,7,8,9,11,14,28,30,32,34],minim:[0,1,2,3,5,6,7,8,9,10,11,12,13,14,17,18,23,29,30,31,33,34],minima:[0,1,7,13,28,32,33,34],minimum:[0,1,2,6,8,9,11,13,29,31,32,33,34],minmaxscal:[0,29],minor:25,minst:1,minu:[7,32],mirjalili:28,mirror:9,misc:[6,23],misclassif:[8,9,10],misclassifi:[8,10],miser:0,mismatch:1,miss:[0,7,10],mistak:4,mit:27,mix:[1,2,28],mixtur:[13,33,34],mk:[9,22],mkdir:[0,6,7,9,28,29,31,32],ml:[0,1,10,13,22,23,29,32,33,34],mlab:25,mlbook:28,mle:[5,7,32],mlp:[1,34],mlpclassifi:[1,34],mlpregressor:[0,28],mm:22,mml:29,mn:[12,25,34],mnist:[1,11],mod:25,mode:[24,26,28],model:[2,3,5,7,8,9,10,11,13,14,15,16,18,19,21,23,25,27,29,30,31,32,33],model_select:[0,1,3,5,6,7,9,10,11,28,29,30,31,32],moder:10,modern:[0,6,7,21,28,31,32],modif:[2,12,13,33,34],modifi:[0,1,3,5,7,8,10,12,13,28,29,30,32,33,34],modul:[0,9,11,22,28,30],modular:25,modulo:25,moe:[11,29],moment:[5,6,13,25,30,31],mondai:28,monitor:[13,33,34],monoton:[5,12,25,30,31,34],mont:[0,6,21,25,27,28,31],moor:[5,6,30],more:[0,1,2,4,5,7,8,9,10,11,12,13,14,18,21,25],moreov:[0,3],morten:[26,28,29,30,31,32,33,34],most:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,21,23,25,28,29,30,31,32,33,34],mostli:[1,11],motion:[0,13,33,34],motiv:[1,4],move:[0,4,5,6,7,9,12,13,14,23,25,29,30,31,32,33,34],mpl:[0,7,28,32],mpl_toolkit:[2,6,13,23,32,33],mplot3d:[2,6,13,23,32,33],mplregressor:1,mse:[0,4,5,6,9,10,15,16,17,19,23,28,29,30,31,32],mse_simpletre:10,mselassopredict:[5,30],mselassotrain:[5,30],mseownridgepredict:[6,30],msepredict:[5,30],mseridgepredict:[0,5,6,30,32],msetrain:[5,30],msle:[0,28],mt:[7,12,32,34],mu0:25,mu1:25,mu2:25,mu:[0,6,11,13,25,28,31,33,34],mu_1:29,mu_:[6,25,29,30,31],mu_i:[6,29,30],mu_n:11,mu_x:25,much:[0,1,2,3,4,5,6,8,9,10,11,12,13,22,23,25,28,29,30,31,33,34],multi:[0,1,3,7,21,28,32],multiclass:[1,7,32],multidimension:[11,12,28,34],multilay:1,multinomi:[7,32],multipl:[2,4,5,6,7,12,13,25,29,31,32,33,34],multipli:[3,5,6,11,13,22,25,29,30,33],multiplum:8,multivari:[0,2,10,11,21,25,28],multivariate_norm:[11,14],murphi:[11,27,28],must:[1,2,5,6,8,10,12,13,14,25,29,31,32,33,34],mutat:[7,32],mutual:[1,3,6,13,31,32,33],mx_:25,myenv:[0,2,3,4,6,7,8,9,11,14,28,30,32,34],myriad:[0,15,21,28],mz1:25,mz2:25,n1:22,n2:22,n:[0,1,2,3,4,5,6,7,8,10,11,12,13,14,15,16,17,18,19,22,23,25,28,29,30,31,32,33,34],n_0:[12,25,34],n_:[1,2,3,8,12,25,34],n_boostrap:[6,10,31],n_bootstrap:[6,31],n_categori:[1,3],n_cluster:14,n_compon:11,n_data:34,n_epoch:[13,33,34],n_estim:10,n_examples_to_gener:4,n_featur:1,n_filter:3,n_hidden:2,n_hidden_neuron:[0,1,28],n_i:25,n_input:[0,1,3,29],n_instanc:9,n_iter:[32,33],n_iter_i:[9,11],n_job:10,n_k:14,n_l:[12,25,34],n_layer:1,n_m:9,n_neuron:1,n_neurons_connect:3,n_neurons_layer1:1,n_neurons_layer2:1,n_point:14,n_sampl:[6,8,9,10,14,31,34],n_split:[6,31,32],n_step:4,n_t:2,n_x:2,nabla:[1,13,32,33],nabla_:[2,13,32,33,34],nabla_w:[13,33,34],nag:[13,33,34],naimi:[0,28],naiv:[7,32],naive_kmean:14,najafi:[26,28],name:[0,1,3,4,5,6,7,8,9,10,12,13,14,15,21,22,23,25,26,28,29,30,31,32,33,34],nameerror:[10,23],namespac:[3,4,14],narrow:[13,33,34],nary_f:2,nary_op_arg:2,nary_op_kwarg:2,nary_oper:2,nation:[1,5,30,31],nativ:[21,28],natur:[0,1,4,8,9,12,13,23,25,27,28,32,33,34],navier:[12,34],nb:25,nb_:22,nbconvert:28,nbviewer:9,nd:14,ndarrai:[2,6],ndim:[],ne:[9,10,22,25,29],nearest:[1,3,6,11],nearli:[13,32,33],neat:28,neatli:[],neccesari:[6,31],necess:2,necessari:[0,1,3,4,8,14,28],necessarili:[0,4,11,25,28],necesserali:[5,30,31],neck:[7,32],need:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,17,22,25,29,30,31,32,33,34],neg:[0,1,3,5,6,7,10,13,22,25,28,30,31,32,33,34],neg_mean_squared_error:[6,31,32],neglect:25,neglig:25,neighbor:[3,6,11],neither:[4,13,33,34],neq:[13,14,25,32,33],nervou:[12,34],nest:[2,9,12,34],nesterov:[13,33,34],net:[2,4,12,34],netlib:[22,28],network:[0,9,13,21,27,29,33],neural:[0,13,21,27,29,32,33],neural_network:[0,1,2,28,34],neuralnetwork:1,neuron:[1,2,3,4,12],neutral:[0,28],neutron:[0,28],never:[1,4,6,9,25,31],new_box:2,new_chang:[13,33,34],new_hobbit:28,new_root:[],new_trac:[],newaxi:[0,3,6,9,31,32],newli:[0,28],newton:[1,7,8,13,25],next:[0,1,2,3,4,5,6,7,8,9,13,14,28,29,30,32,33,34],next_guess:[13,33],next_input:4,ng:1,ngini:9,ni:14,nice:[0,1,5,11,28,29,30,31],niter:[13,32,33,34],nitric:0,nlambda:[0,5,6,30,31,32],nlp:27,nm:25,nm_n:[0,28],nmse:[6,31],nn:[2,5,6,12,22,30,31,34],nn_model:1,nnmin:2,node:[1,2,3,9,10,12,34],node_constructor:[],nois:[0,4,5,6,8,9,10,13,15,16,19,23,28,29,30,31,32,33],noise_dimens:4,noisi:[1,6,19,23,31],non:[0,1,3,5,6,7,9,10,11,12,13,14,22,25,28,29,30,31,32,33,34],none:[0,1,2,4,5,9,10,13,25,28,29,30,31,32],nonlinear:[3,6,8,9,11,12,31,34],nonneg:[6,9,13,31,32,33],nonparametr:6,nonsens:25,nonsingular:22,nonumb:[3,7,8,13,22,32,33,34],nor:[1,4,13,33,34],norm:[0,1,5,6,8,11,13,17,28,29,30,31,32,33,34],normal:[3,4,5,6,7,8,9,10,11,12,13,15,16,18,19,21,22,23,25,28,29,30,32,33,34],normali:[22,28],norwai:[6,23,28,31,34],notat:[0,2,5,6,13,14,25,28,29,30,31,33],note:[0,1,2,3,4,5,6,7,8,11,12,13,14,15,16,21,22,25,27,28,31,32,33],notebook:[0,1,3,9,15,21,23,28],notesseptember16:32,notesseptember30:34,notfounderror:[3,4,14],noth:[1,2,5,8,12,14,25,29,30,34],notic:[4,5,12,13,22,25,28,30,33,34],notimplementederror:2,notion:3,novel:[3,6,10,32],novemb:[1,24,26,28],now:[0,2,4,5,6,7,8,10,11,12,14,15,16,17,21,22,23,25,28,29,32],nowadai:[0,1,3,9,21,28],nox:0,np:[0,1,2,3,4,5,6,7,8,9,10,11,13,14,15,16,22,23,25,28,29,30,31,32,33,34],npr:2,nsampl:[6,9,31,32],nt:2,ntrained_model:[6,30],nu:25,nuclear:[5,29],nuclei:[0,25,28],nucleon:[0,28],nucleu:[0,28],num:4,num_coordin:2,num_featur:34,num_hidden_neuron:2,num_it:2,num_iter:34,num_neuron:2,num_neurons_hidden:2,num_point:2,num_tre:10,num_valu:2,number:[1,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,19,22,23,24,26,28,30,31,32],numberid:[7,32],numberparamet:3,numer:[0,5,6,9,10,11,12,13,17,21,22,27,28,29,30,31,32,33,34],numpi:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,21,23,25,29,30,31,32],numpy_box:[],numpy_vjp:2,numpy_wrapp:[],nunmpi:[5,29],nvalu:9,nx:2,nx_test:[6,30],nx_train:[6,30],nx_train_mean:[6,30],ny:25,ny_pr:[6,30],ny_train:[6,30],ny_train_mean:[6,30],o:[0,6,7,8,9,11,15,22,26,27,28,32,34],obei:[6,11,13,29,30,33],obj:2,object:[0,1,2,4,6,8,10,22,28,33],obliqu:[5,29],observ:[0,1,3,5,6,7,8,9,10,11,12,13,14,25,30,31,32,33,34],obtain:[0,1,5,6,7,8,9,10,12,13,14,17,22,23,25,28,29,30,31,32,33,34],obviou:[5,6,11,25,29],obviouli:28,obvious:[0,4,5,6,22,28,30,31],oc:29,occupi:0,occur:[0,6,8,9,22,25,28],octob:[24,26,28,34],od:0,odd:[0,3,7,28,29,32],odenum:2,odesi:2,odin:28,oen:0,off:[1,3,4,5,9,13,19,25,30,31,33,34],offer:[6,11,21,22,24,26,28,31],offic:[26,28],offici:[24,28],often:[0,1,3,4,5,6,7,8,9,10,11,12,13,14,16,21,22,23,25,28,29,31,32,33,34],ofter:[22,28],ol:[0,13,15,16,17,18,28,29],old:[1,5,10,13,30,31,32,33],ols_sk:6,ols_svd:6,olsbeta:[0,5,30],omega:[2,3,6],omega_0:3,omit:[0,5,28,29,30,31],omlmp_kkie0:32,onc:[1,6,9,11,13,31,32,33,34],one:[0,1,3,4,5,6,7,8,9,10,11,13,14,19,21,22,23,25,26,28,29,30,31,34],onehot:1,onehot_vector:1,onehotencod:9,ones:[0,2,5,6,8,9,10,11,13,22,23,28,29,30,31,32,33],ones_lik:4,ong:29,onl:3,onli:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,17,19,22,23,25,28,29,30,31,32,33,34],onlin:[11,24],onto:[5,11,29],open:[0,1,4,6,7,9,15,21,23,24,26,28,31,32],oper:[0,1,3,5,6,10,11,12,13,15,21,25,28,29,30,31,33,34],operation:25,oplu:25,opmiz:[13,33,34],opportun:0,oppos:[6,13,33,34],opposit:[1,5,8,29],opt:[1,5,28,30],optim:[0,2,3,4,5,6,7,9,10,11,14,15,16,17,18,19,23,30,31],optimis:[1,3],option:[0,1,3,5,6,8,9,11,22,23,29,30,31,34],optmiz:[1,8,13,29,33,34],oral:28,orang:0,order:[0,1,2,3,5,6,7,8,9,10,11,12,15,16,22,23,25,28,29,30,31,32],ordinari:[0,2,3,7,11,13,15,16,17,19,21,31,32,33,34],oreilli:[27,28],org:[0,3,4,9,11,21,22,23,27,28,30,33,34],organ:[6,7,10,22,31,32],orient:[1,5,25,29,30],origin:[0,3,5,6,8,11,12,13,22,28,29,31,33,34],orthogn:[5,29],orthogon:[0,5,6,8,11,13,17,22,28,29,30,33],orthonorm:[5,29,30],os:[0,1,4,5,6,7,8,9,26,28,29,30,31,32],oscar:1,oscil:[3,13,33,34],oserror:[0,3,4,7,14,32],oslo:[0,15,21,23,24,26,28,29,30,31,32,33,34],osx:[0,15,21,23,28],other:[0,1,2,3,5,6,7,8,10,13,14,15,19,21,24,25,26,27,30,31,33],otherwis:[0,1,4,7,13,22,28,32,33,34],ouput:[5,7,12,30,31,32],our:[1,2,3,6,7,8,9,10,12,14,15,16,17,18,19,21,22,23,25,30,31,34],ourmodel:0,ourselv:[0,5,6,8,11,13,28,29,30,31,32,33],out1:[],out2:[],out:[0,1,2,4,5,6,7,8,9,10,11,12,13,16,21,22,23,25,28,29,30,31,32,33,34],out_fil:9,outcom:[0,7,9,10,12,25,29,32],outdoor:9,outer:[6,12,13],outfil:4,outgrad:2,outlier:[0,8,28,29],outlin:[6,10,11,31],outlook:9,outperform:10,output:[0,1,3,4,5,6,7,8,9,10,12,13,16,22,23,25,28,29,30,31,32,33,34],output_bia:1,output_bias_gradi:1,output_shap:4,output_weight:1,output_weights_gradi:1,outputlayer1:[12,34],outputlayer2:[12,34],outsid:4,over1:[13,33,34],over:[0,1,3,4,5,6,9,10,12,13,22,23,28,29,30,31,32,33,34],overal:[1,10],overcast:9,overcom:[12,13,33,34],overdetermin:[0,28],overfit:[0,1,3,6,9,10,13,31,33,34],overflow:[1,5,30,31],overhead:12,overlap:[3,7,8,9,32],overlin:[0,5,6,9,10,11,14,22,28,29,30],overst:0,overtrain:4,overview:[3,32],own:[4,5,6,8,12,13,21,22,23,30,33,34],owner:0,ownmsepredict:0,ownmsetrain:0,ownridgebeta:[0,6,30],ownypredictridg:0,ownytilderidg:0,oxid:0,p0:2,p1:2,p:[0,1,2,3,4,5,6,7,8,9,10,11,13,14,17,22,25,28,29,30,31,32,33],p_:[2,4,8,9],p_hidden:2,p_i:[5,25,30,31],p_j:25,p_n:25,p_output:2,p_x:25,pack:[0,28],packag:[0,1,2,3,4,5,6,7,8,9,11,13,14,15,21,23,25,29,30,32,33,34],packtpub:28,packtpublish:28,pad:[3,4],page:[0,9,21,28,30,31,32,33],pai:[0,1,9,13,33,34],pair:[0,2,3,9,21,25,28],panda:[0,4,5,6,7,9,11,15,21,23,30,31,32],panel:28,paper:1,paradigm:[0,28],parallel:[10,13,21,22,28,33,34],param:2,param_distribut:32,param_grid:32,paramat:2,paramet:[0,1,2,3,4,5,6,7,8,9,10,12,13,16,17,18,19,23,25,30,31],parameter:[0,6,10,23,28,29],parametr:[0,6,15,16,28,29,31],paramt:[3,5,30,31],parent:2,parent_argnum:[],part:[0,1,3,5,6,10,17,18,22,24,25,26,28,30,31,34],partial:[0,1,5,6,7,8,10,11,12,13,16,25,28,29,30,32,33],particip:[21,24,26,28],particl:[0,4,13,25,28,33,34],particular:[0,1,2,3,5,6,9,10,11,12,13,16,23,25,27,28,29,30,31,32,33,34],particularli:[5,6,8,11,13,25,29,31,32,33,34],partit:[1,4,9],partli:[6,28,31],pass:[2,3,12,14,32],passkwarg:2,password:23,past:[10,25],patch:[6,25,31],path:[0,3,4,6,7,9,14,15,21,28,29,31,32],pathcollect:34,patient:[7,32],patter:4,pattern:[0,3,4,12,24,27,28,34],pauli:[0,28],pc:[11,21],pca:[0,7,21,28,29,32],pd:[0,4,5,6,7,9,11,28,29,30,31,32],pde:2,pdf:[0,3,4,5,6,9,16,20,23,27,28,30,31,32,34],pedagog:[0,28,29],penal:[6,29,30],penalti:[6,13,23,29,30,32,33],penros:[5,6,30],pentagon:[13,32,33],peopl:[0,1,9,13,21,33,34],per:[0,1,6,24,26,28,31],percentag:[0,10,11,26],perceptron:[0,1,7,28,32],peregrin:28,perfect:[0,1,13,28,33,34],perfectli:[4,6,31],perform:[0,2,3,4,5,6,8,10,11,12,13,14,15,16,17,19,21,22,23,25,28,29,30,31,32,33,34],performac:4,perhap:[0,5,13,28,29,30,32,33],perimet:[1,9],period:[1,4,25],permut:11,persist:[13,33,34],person:[5,6,7,24,26,28,29,30,31,32],perspect:27,pertin:[12,28],petal:[8,9],peter:[27,29],phantom:25,phase:[6,12,34],phenomena:25,phi:8,phi_k:8,philosophi:[13,33],phone:[26,28],photo:4,phrase:[0,28],physic:[0,1,4,7,12,13,25,26,27,28,29,30,31,32,33,34],pi:[2,3,5,6,7,9,12,13,25,30,31,32,33,34],pick:[1,9,10,11,13,14,33,34],pickl:1,pictur:[0,28],pie:[21,28],piec:[11,14],pillow:[0,15,21,23,28],pinv:[5,6,13,29,30,33,34],pip3:[0,1,15,23,28],pip:[0,1,15,21,23,28],pipelin:[0,6,8,10,29,31],pippin:28,pit:4,pitfal:[6,29,30],pitt:[12,34],pixel:[1,3,4],pixel_height:[1,3],pixel_width:[1,3],place:[0,4,6,8,13,22,23,28,31,32,33],plai:[0,3,4,5,6,8,11,21,28,29,30,31,32],plain:[8,10,12,13,14,32,33],plan:[6,9,26,27,28],plane:[8,9],plateau:[5,30],platform:[21,28],plausibl:[12,34],pleas:[9,11,13,23,26,28,33,34],plenti:1,plethora:[3,12,34],pliahhy2ibx9hdharr6b7xevztgzra1p:34,plot:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,21,22,23,25,28,29,30,33,34],plot_all_sc:[23,30],plot_confusion_matrix:[7,10,32],plot_count:6,plot_cumulative_gain:[7,10,32],plot_data:1,plot_dataset:8,plot_decision_boundari:[9,10],plot_import:10,plot_max:4,plot_min:4,plot_model:4,plot_numb:4,plot_predict:8,plot_regression_predict:9,plot_result:4,plot_roc:[7,10,32],plot_surfac:[2,6,13,23,33],plot_train:9,plot_tre:[9,10],plqvvvaa0qudcjd5baw2dxe6of2tius3v3:34,plt:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,22,23,25,28,29,30,31,32,33,34],plu:[0,3,5,7,28,29,30,32],pluggabl:[3,4,14],plugin:[3,4,14],pm:[8,31],pmatrix:2,pml:27,pn:3,png:[0,4,6,7,9,28,29,31,32],point:[0,1,2,3,5,6,7,8,9,10,11,13,14,15,16,17,19,22,23,25,26,28,29,31,32,33,34],point_1:4,point_2:4,poisson:[21,25,28],poli:[6,8,31,32],poly100_kernel_svm_clf:8,poly3:0,poly3_plot:0,poly3dcollect:33,poly_featur:[8,9],poly_features10:9,poly_fit10:9,poly_fit:9,poly_kernel_svm_clf:8,polydegre:[0,5,6,10,29,30,31],polygon:[13,32,33],polym:[12,34],polymi:23,polynomi:[0,5,6,7,8,9,10,11,15,16,17,19,23,28,29,31,32,34],polynomial_featur:[6,31],polynomial_svm_clf:8,polynomialfeatur:[0,6,8,9,29,31,32],polytrop:[0,6,28,31],pool:3,pool_siz:3,poor:[1,13,32,33,34],poorli:[0,29],pop:2,popul:[0,5,28,29,30,31],popular:[0,1,3,6,7,8,9,11,12,15,21,22,23,25,29,32,34],popularli:[0,28],portabl:10,portion:[11,13,33,34],pose:[0,4,5,6,11,25,28,31],posit:[0,1,2,3,5,7,8,10,11,13,14,22,25,28,29,30,31,32,33,34],possibl:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,15,19,21,22,23,25,26,28,29,30,31,32,33,34],posterior:[5,30,31],postpon:[0,28,29],postscript:23,postul:[5,30,31],potenti:[0,3,5,6,12,13,28,29,30,31,33,34],pott:[12,34],power:[0,1,5,6,8,9,12,13,28,29,31,33,34],pp:[5,6,18,30,31,32],practic:[0,5,6,7,8,23,25,29,30,31,32],practition:[0,1,3,28],pre:28,preced:[1,11,12,25,34],preceed:4,preceq:8,precis:[0,2,5,11,13,22,23,25,28,29,30,31,33,34],pred:[6,31,33,34],predicit:0,predict:[0,1,5,6,7,8,9,10,15,16,21,23,27,28,29,30,31,32,34],predict_prob:1,predict_proba:[7,10,32,34],predictor:[0,5,6,7,9,10,11,28,29,30],prefer:[0,1,6,8,9,11,13,15,21,23,28],prepar:[0,6,22,23,28,29],preprocess:[0,4,6,7,8,9,10,11,23,30,31,32],prerequisit:0,prescript:23,presenc:[13,33,34],present:[0,5,6,7,9,12,13,22,23,25,28,29,30,33,34],preserv:[3,11,22],press:[13,27,32,33],pretrain:[1,4],pretti:[0,4,8,9,15,21,23,28],prev_centroid:14,prevent:[13,25,33,34],previou:[0,1,2,3,4,5,6,8,10,11,12,13,22,23,25,29,32,33,34],previous:[2,3,9,10,25],price:[0,4,9,13,33,34],primal:8,primari:[0,7,28,32],prime:25,primit:2,princip:[0,5,7,21,28,29,32],principl:[0,6,7,8,14,28,31,32],print:[0,1,2,3,4,5,6,7,8,9,10,11,13,14,22,25,28,29,30,31,32,33,34],print_funct:[8,9],printout:[0,28],prior:[0,5,6,28,30,31],privat:0,prob:[1,25],probabilist:[0,27,28,29],probabl:[0,1,3,4,6,7,10,13,21,28,29,32,33,34],problem:[0,3,4,5,6,7,8,9,10,11,12,16,17,21,22,23,25,31],probml:27,proce:[0,5,6,7,8,9,10,11,13,22,28,29,30,31,33],procedur:[2,4,5,6,8,10,11,13,23,29,30,31,32,33,34],proceed:22,process:[0,2,4,6,9,10,12,13,15,21,22,23,25,27,28,31,32,33,34],prod:27,prod_:[1,5,7,30,31,32],produc:[0,3,4,5,6,9,10,11,12,13,21,22,23,25,28,29,30,31,33,34],product:[0,1,3,5,6,7,8,12,13,16,21,22,28,29,30,31,32,34],profess:[0,28],program:[0,1,4,5,6,8,12,14,15,16,21,22,24,25,26,28,29,34],programm:22,progress:[1,4,14,33],prohibit:[6,31],project1:[6,23],project:[0,1,2,3,5,11,13,17,18,19,20,21,24,26,29,30,31,33,34],project_root_dir:[0,6,7,9,28,29,31,32],projectwrit:23,promin:[12,34],promis:8,promot:[26,28],prone:9,pronounc:[13,21,28,33,34],proof:[0,11,12,13,28,31,32,33],propag:[2,3,13,33,34],proper:[0,2,6,7,23,31],properli:[1,6,8,10,13,23,33,34],properti:[0,1,3,12,13,16,17,22,28,31,33,34],proport:[0,1,5,9,11,13,16,25,28,29,33,34],propos:[1,4,6,10,23,28],propto:[5,13,30,31,32,33,34],proton:[0,28],prove:[3,13,32,33,34],provid:[0,1,3,4,5,6,8,9,10,12,13,15,21,22,23,25,28,29,30,31,32,33,34],proxi:[1,13,33,34],prune:9,pseudo:[22,25,33],pseudocod:23,pseudoinv:[5,30],pseudoinvers:[5,6,30],pseudorandom:[6,25,31],psycholog:[0,28],pt:[13,33],punish:[0,1,28],pure:[3,9,25],purest:9,puriti:9,purpos:[0,3,10,12,14,28,34],put:1,py:[0,1,2,3,4,5,6,7,8,9,11,14,28,30,31,32,34],py_tf:[3,4,14],pycod:28,pydata:21,pydot:9,pyhton2:28,pylab:[0,7,28,32],pypi:21,pyplot:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,22,23,25,28,29,30,31,32,33,34],pythagora:[5,30,31],python2:[0,15,23,28],python3:[0,2,3,4,6,7,8,9,11,14,15,21,23,28,30,32,34],python:[1,2,3,4,5,6,8,11,12,13,14,16,23,25,29,30,33,34],pytorch:[0,21,23,28],q:[5,6,8,11,25,29,31],qp:8,qquad:[2,11,13,22,33,34],qr:[5,6,22,29],quad:[1,13,22,33],quadrat:[0,8,9,13,15,16,28,33],qualit:[4,9,23,25],qualiti:[0,9,15,16,21,28,29],quantifi:1,quantil:10,quantit:[0,6,9,23,28,31],quantiti:[0,2,5,6,7,9,10,11,12,14,16,22,25,28,29,30,31,32],quantum:[4,12,27,28,34],quartil:[0,29],quench:5,queri:9,question:[0,5,6,9,11,12,13,23,26,28,29,30,31,33,34],qugan:4,quick:[4,25],quickli:[1,3,9,11,13,32,33],quit:[1,5,6,9,10,12,29,31,34],quot:4,r2:[0,5,6,28,29,30,32],r2_score:[0,28],r2score:[0,28],r:[0,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,21,22,23,25,29,30,31,32,33,34],r_1:9,r_2:9,r_j:9,r_m:9,rad:0,radial:[0,8,12,34],radioact:25,radiu:[0,1,9,29],rag:2,rain:9,rais:[0,2,3,4,7,14,30,32],ramp:1,ran0:25,ran1:25,ran2:25,ran3:25,rand:[0,4,5,6,9,10,13,15,16,22,28,29,30,31,32,33,34],randint:[6,9,13,31,33,34],randn:[0,1,2,5,6,9,11,13,15,16,28,29,30,31,32,33,34],random:[0,1,2,3,4,5,6,8,9,13,14,15,16,21,22,23,28,29,30,31,33,34],random_forest_model:10,random_index:[13,33,34],random_indic:[1,3],random_st:[0,7,8,9,10,11,32,34],randomforestclassifi:10,randomizedsearchcv:32,randomli:[1,6,9,13,14,31,32,33,34],randuniform:32,rang:[0,1,2,3,4,5,6,7,9,10,11,12,13,14,22,25,28,29,30,31,32,33,34],rangl:[0,6,11,25,28,29],rangle_x:25,rank:[5,29],rankdir:4,raphson:[1,8,13],rapidli:0,rare:[1,13,28,32,33,34],raschka:[28,29,30,31,32,33,34],rasckha:28,rate:[0,1,2,3,4,8,9,10,12,13,32],rather:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,22,25,28,29,30,31,32,33,34],ratio:[4,7,9,10,11,32],rational:[0,28],ravel:[5,6,7,8,9,10,11,13,22,29,31,32,33],raw:3,rbf:[8,11,12,34],rbf_kernel_svm_clf:8,rbf_pca:11,rc:[0,25],rc_temp:[0,7,32],rcond:[0,28,29],rcparam:[0,1,3,7,8,9,10,25,28,32],re:[2,4,13,32,33],reach:[1,4,5,6,9,10,11,12,13,14,30,31,32,33,34],read:[0,2,3,4,5,6,7,8,11,12,16,22,23,24,25,27,30,33],read_csv:[0,6,7,9,28,31,32],read_fwf:[0,28],reader:[0,6,22,25,28,29,30],readi:[0,1,5,6,8,10,11,12,22,23,28,30,31],readili:1,readthedoc:21,real:[0,1,2,4,7,10,11,12,22,29,31,32,34],real_loss:4,real_output:4,realist:8,realiti:25,realiz:[1,12,34],realli:[0,1,28],rearrang:[13,33,34],reason:[0,1,3,4,10,13,27,28,32,33,34],reassign:1,recal:[5,6,9,10,11,12,22,25,28,29,30,31,32,33],recast:3,receiv:[1,3,10,12,25,34],recent:[0,1,2,3,4,6,7,10,13,14,23,27,28,30,31,32,33,34],recept:[3,12,34],receptive_field:3,recip:[0,6,7,22,23,28,29,32],reciproc:[5,30],recogn:[0,4,5,10,28,30,31],recognit:[0,1,3,12,24,27,28,34],recommen:28,recommend:[0,2,3,4,5,6,8,13,15,18,21,22,23,27,30,31,33,34],reconsid:9,reconstruct:11,record:[10,23,24,26,28,33,34],rectangl:[9,13,32,33],rectangular:[5,29],rectifi:[1,3,12,34],recur:[0,21,28],recurr:[0,1,21,28],recurs:[9,21,22,28],red:[0,3,4,6,8,9,31,33,34],redefin:[0,10,28,29],redefinit:30,reduc:[1,2,3,5,6,9,10,11,13,28,30,31,32,33,34],reduct:[0,2,10,11,21,25,28,29],refer:[0,1,2,3,5,6,9,11,12,13,14,20,22,27,28,29,31,32,33,34],referenc:2,refin:[12,34],refit:[6,31],reflect:[0,1,4,5,23,25,28],refresh:[21,28],refreshprogrammingskil:28,reg:[10,11],regard:[1,9,13,33],regardless:[12,34],region:[3,4,6,9,12,23,34],regist:[6,23,25],reglasso:[5,30],regr_1:[0,9],regr_2:[0,9],regr_3:[0,9],regress:[1,8,11,12,15,16,21,22],regressor:[0,7,10,28,32],regridg:[0,5,6,30,32],regular:[0,3,4,5,6,7,9,13,17,26,28,29,30,31,33,34],regularis:6,reilli:[0,15,27,28],reinforc:[0,8,21,28],reiter:1,reject:7,rel:[0,4,6,7,9,12,13,25,28,29,31,32,33,34],relat:[0,1,3,4,5,11,13,14,22,25,28,30,31,33,34],relationship:[0,4,9,28],relativeerror:[0,28,29],releas:[1,21,28],relev:[0,1,5,7,11,15,21,23,25,28,30],reli:[0,6,8],reliabilti:23,reliabl:[7,25,32],relu:[3,4,28],remain:[1,2,4,6,12,22,25,29,30,31,32,34],remaind:25,reman:2,remark:1,rememb:[0,8,13,22,23,28,33,34],remind:[0,5,11,13,22,25,29,30,31],remov:[0,4,5,6,29,30],render:[0,9,28,29],reorder:[5,7,29,30,32],reorgan:[0,28],repeat:[0,1,3,4,5,6,9,10,11,13,14,22,23,25,28,30,31,32,33,34],repeated:28,repeatedli:[0,6,10,13,31,33,34],repet:3,repetit:[6,28,29,31,32,33],rephras:[13,32,33],replac:[0,1,3,4,5,6,10,12,14,15,16,21,23,28,29,30,31,32],replica:[6,31],repo:23,report:[20,28,33,34],reportexampl:[20,23],reportsampl:20,repositori:[0,4,23,28],repres:[0,1,2,3,4,5,6,7,8,9,10,12,13,25,28,29,30,31,32,33,34],represent:[0,1,3,6,9,25,28,31,32],representd:3,reproduc:[0,5,6,9,12,15,16,21,23,25,28,29],repuls:[0,28],request:[0,13,33,34],requir:[0,1,3,4,5,6,8,9,11,12,13,17,22,28,29,30,31,32,33,34],rerun:9,res1:2,res2:2,res3:2,res_analyt:2,res_analytical1:2,res_analytical2:2,res_analytical3:2,resaml:[6,23],resampl:[0,7,10,19,21,28,29,32,33],rescal:[0,11,12,29,34],rescu:[5,30,31],reseach:[6,23],research:[0,4,13,21,27,28,33,34],resembl:[6,25,31],reserv:[1,5,6,25,30,31],reshap:[0,1,2,3,4,6,8,9,10,15,16,22,28,29,31],residenti:0,residu:[0,5,13,28,33],resiz:[5,29],resourc:28,respect:[0,1,2,3,5,6,7,8,10,11,12,13,14,16,17,23,25,28,29,30,31,32,33,34],respond:[12,34],respons:[0,7,9,12,28,29,32,34],rest:[0,5,29],restat:[0,12,28],restor:4,restored_discrimin:4,restored_gener:4,restrict:[0,3,9,12,28,34],result:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,21,22,23,25,28,31,32,33,34],retail:0,retain:[5,6,29,31,32],rethink:31,retriev:28,return_data:14,return_sequ:4,return_x_i:9,reus:[1,3,6,18,19,20,23],reveal:[0,12,28,34],revers:[1,22],review:[21,22],revisit:14,revolut:28,reward:[0,4,28],rewrit:[0,3,5,6,7,8,10,11,12,13,19,22,23,25,30,32,33,34],rewritten:[2,6,8,10,25,31],rewrot:[13,32,33],rf:10,rgb:3,rgoj5yh7evk:21,rh:[6,31],rho:[0,10,13,28,33,34],rho_1:10,rho_2:10,rho_m:10,rich:[0,28],ride:9,rideclass:9,ridedata:9,ridg:[7,11,13,21,28],ridge_sk:6,ridgebeta:[5,30],ridgecv:32,right:[0,1,2,3,5,6,7,8,9,10,12,13,14,16,17,19,22,23,25,28,29,30,31,32,33,34],right_sid:2,rightarrow:[0,1,5,6,8,11,12,13,25,28,29,31,32,33,34],rigor:[0,28],ring:6,rise:[0,28],risk:[0,13,15,16,28,32,33,34],rival:4,river:0,rlm:28,rm:[0,25],rmse:0,rmsporp:[13,33,34],rmsprop:[1,3,4,13],rnd_clf:10,rng:25,rnn1:4,rnn2:4,rnn:[4,12,34],rnn_2layer:4,rnn_input:4,rnn_output:4,rnn_train:4,rntrick1:25,rntrick2:25,rntrick3:25,rntrick4:25,ro:[0,13,28,32,33,34],robert:[18,23,27],robust:[0,28],robustscal:[0,29],roc:[7,10],role:[0,2,5,6,8,21,28,29,30,31,32],roll:6,room:[0,26,28],root:[0,5,9,13,25,29,30,32,33,34],rot:28,rotat:[1,8,9,10],rotation_matrix:9,roughli:[1,3],round:[0,7,9,13,32,33,34],routin:[13,22,28,32,33],row:[0,1,2,5,6,9,11,22,28,29,30,31],row_stack:[],rr:[5,29],rrr:[5,29],rug:[13,32,33,34],rule:[0,1,5,6,13,23,28,29,30,31,33,34],run:[0,1,2,4,5,6,8,9,11,13,15,21,23,28,29,30,31,32,33,34],runtim:[1,6,14],runtimewarn:[1,6,31],rust:[0,15,21,22,28],rvert:1,rvert_2:1,s:[0,1,2,3,4,5,6,7,9,11,12,13,16,17,18,21,22,23,25,28,29,30],s_1:6,s_:[3,6],s_i:[6,7,32],s_j:6,s_k:6,saddl:[13,32,33,34],sai:[0,1,2,3,4,5,6,7,8,9,10,11,12,22,23,25,28,29,30,31,32],said:[6,9,13,32,33],sake:[0,5,7,11,28,29,30,32],sale:[0,28],sam:28,same:[0,1,2,3,4,5,6,8,9,11,12,14,17,22,23,25,28,29,30,32],samm:10,sampl:[0,1,2,3,4,5,6,7,8,9,10,13,14,15,16,19,21,22,23,25,28,29,30,31,32,33,34],sample_vari:14,sampleexptvari:25,samwis:28,sastri:11,satisfactori:[0,28],satisfi:[1,2,3,6,8,13,22,25,31,32,33],satur:[1,6,31],save:[0,4,6,7,9,13,28,29,31,32,33,34],save_fig:[0,6,7,9,10,28,29,31,32],savefig:[0,4,6,7,9,25,28,29,31,32],savetxt:4,saw:[5,29],scalabl:10,scalar:[2,5,6,10,29,30,31],scale:[0,1,3,5,6,7,8,9,10,11,12,13,15,16,17,21,22,23,26,28,30,32,33,34],scale_mean:4,scale_std:4,scaler:[0,7,8,9,10,11,23,29,30],scan:[5,7,30,31,32],scari:[5,30,31],scatter:[0,1,6,7,8,9,14,28,29,30,31,32,34],scenario:[6,13,32,33,34],schedul:[13,26,33,34],scheme:[1,13,32,33,34],schrage:25,scienc:[0,1,10,12,13,21,24,25,26,27,32,33,34],scientif:[0,15,21,23,28,33,34],scientist:[0,28],scikit:[3,5,6,8,9,10,13,21,22,23,24,27,34],scikit_learn:[0,16],scikitlearn:28,scikitplot:[7,10,32],scipi:[0,3,5,6,13,15,21,22,23,28,29,30,31,32,33],scl:6,score:[0,1,3,6,7,9,10,11,15,16,23,26,28,29,31,32,33,34],scores_kfold:[6,31,32],scratch:[1,13,34],sdg:[13,33,34],sdv4f4s2sb8:34,seaborn:[0,1,3,6,7,28,32],seamless:[0,15,21,23,28],search:[0,1,3,5,9,13,28,30,33,34],sebastian:28,sebastianraschka:28,sec:6,second:[0,2,3,4,5,6,7,8,9,11,12,14,15,16,21,22,23,25,26,28,29,31,32],second_mo:[33,34],second_term:[33,34],secondeigvector:11,secondli:12,section:[4,11,16,17,22,23,25,29,30,32,33,34],sector:0,see:[0,1,2,3,4,5,6,7,8,10,11,12,13,15,16,17,18,21,22,23,25,28,29,30,31,32,33,34],seed:[0,1,2,3,4,5,6,8,9,11,13,14,15,16,23,25,28,29,30,31,32,33,34],seed_imag:4,seek:[1,2,8],seem:[1,3,4,33,34],seemingli:[0,28],seen:[0,1,3,5,10,12,17,25,28],segment:[13,32,33],seismic:6,seldomli:[0,28],select:[1,5,6,8,9,10,11,17,23,24,25,26,27,28,29,30,31],self:[0,1,5,7,28,29,30,32,34],sell:4,semest:[7,24,32],semi:[8,13,32,33],semilogx:6,send:[5,12,13,26,28,33,34],senior:[24,26],sens:[0,4,6,8,23,28,31],sensibl:3,sensit:[0,5,6,9,13,28,29,30,31,34],sent:2,sentdex:34,sentenc:[4,12,34],separ:[0,1,2,4,6,8,9,12,14,15,21,23,25,28,31,34],septemb:[17,18,19,20,23,28],sequenc:[2,3,4,7,9,10,12,13,21,22,25,28,32,33,34],sequenti:[1,3,4,10,12,25,34],seri:[0,1,2,3,4,5,6,10,11,12,13,22,28,29,30,31,32,33,34],serif:[0,7,25,28,32],serv:[0,1,2,3,5,7,13,23,27,28,29,30,31,32,33,34],servic:23,session:[1,20,23,24,26,28],set:[1,4,5,6,7,8,10,11,13,14,16,17,21,22,23,25,26,30,31,33,34],set_major_formatt:[6,23],set_major_loc:[6,23],set_tick:[1,6,8],set_ticklabel:[1,6],set_titl:[0,1,2,3,7,12,14,28,32,34],set_xlabel:[0,1,2,3,7,12,28,32,34],set_xlim:[7,12,32,34],set_xticklabel:1,set_ylabel:[0,1,2,3,7,28,32],set_ylim:[7,12,32,34],set_ytick:[7,32],set_yticklabel:[1,6],set_zlim:[6,23],seth:4,setminu:[6,32],setosa:[8,9],setosa_or_versicolor:8,setp:[6,31],setup:[1,4,6,8,21,28,29],sever:[0,3,5,6,7,8,9,11,12,13,21,22,25,28,29,30,31,32,33,34],sgd:[1,3,32],sgd_clf:8,sgdclassifi:8,sgdreg:[13,32,33],sgdregressor:[13,32,33],sgn:[5,29,30],shallow:[13,33,34],shape:[0,1,2,3,4,5,6,7,8,9,10,11,13,14,15,16,22,28,29,30,31,32,33,34],shape_bas:[],share:[1,3,28],she:[7,32],shell:34,shift:[1,6,12,25,30,34],ship:3,shire:28,shortcom:[13,32,33,34],shorten:4,shorter:25,shorthand:[28,31],shortli:[22,28],should:[0,2,3,5,6,8,9,11,12,15,16,22,23,25,28,29,30,31],show:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,16,17,18,19,22,23,25,28,29,30,31,32,33,34],show_shap:4,shown:[0,4,5,8,9,11,12,13,22,29,32,33,34],shrink:[3,5,6,8,11,23,29,30],shrinkag:[5,6,29,30],shrunk:11,shuffl:[0,1,4,6,13,29,31,32,33,34],side:[0,2,5,8,12,13,22,28,30,31,32,33,34],sigh:[21,28],sigma0:25,sigma1:25,sigma2:25,sigma:[0,1,5,6,7,10,11,12,13,17,18,19,22,23,25,28,29,30,31,32,33,34],sigma_0:[5,29,30],sigma_1:[5,29,30],sigma_2:[5,29,30],sigma_:[5,22,28,29,30,31],sigma_fn:[7,12,32,34],sigma_i:[0,5,28,29,30],sigma_j:[5,17,29,30],sigma_m:[6,25,31],sigma_n:[11,25],sigma_t:[13,33,34],sigma_x:25,sigmoid:[1,2,4,7,8,10,12,32,33,34],sigmundson:[6,29,30],sign:[1,2,7,8,10,25,26,32,34],signal:[1,3,10,12,34],signifi:4,signific:1,significantli:[1,13,25,32,33,34],sigurd:28,sim:[4,5,6,13,18,23,25,30,31,33,34],similar:[0,1,2,3,4,5,6,7,8,9,10,11,14,17,21,22,23,28,30,31,32],similarli:[0,1,3,5,8,10,13,20,25,28,29,30],simpl:[1,2,3,5,6,7,8,10,11,12,14,15,16,17,19,21,22,23,25,31],simplepredict:10,simpler:[0,1,5,6,7,13,16,19,21,23,28,30,33,34],simplernn:4,simplest:[0,1,3,4,9,10,12,14,28,34],simpletre:10,simpli:[0,1,2,4,5,6,8,9,10,11,12,15,21,22,23,25,28,29,30,31,34],simplic:[2,5,6,7,8,9,10,11,12,14,29,30,32,34],simplicti:[5,29],simplifi:[0,6,9,15,21,23,28,29,30,31],simplist:[3,6,25,31],simul:[6,31],simultan:[6,31],sin:[0,1,2,3,4,9,12,13,22,28,33,34],sinc:[0,1,2,3,5,6,7,8,9,10,11,13,22,25,27,28,29,30,31,32,33,34],sine:[3,12,34],singl:[0,1,2,3,5,6,7,8,9,12,13,22,25,28,29,30,31,32,33],singular:[0,6,13,22,23,28,30,31,32,33],sinusoid:3,site:[0,2,3,4,6,7,8,9,11,14,23,24,28,30,32,34],situat:[0,4,5,7,13,25,28,29,32,33,34],six:[3,25],size:[0,1,2,3,4,5,6,8,9,10,11,13,22,23,25,28,30,31,32,33,34],sketch:10,ski:9,skill:0,skip:11,skl:[0,6,28,29,30],sklearn:[0,1,3,5,6,7,8,9,10,11,13,14,28,29,30,31,32,33,34],skplt:[7,10,32],sl:[6,30,32],slack:8,slice:[2,22,28],slide:[0,3,15,16,23,25,28,29,31,33],slight:[6,13,31,33,34],slightli:[1,2,3,5,6,7,10,25,29,30,31,32],slope:[8,11,12,34],slow:[0,2,8,13,29,32,33,34],slower:[5,22,28,29,30],slowest:22,slowli:12,slp:1,small:[0,1,2,3,5,6,8,9,10,11,12,13,21,22,23,25,28,29,30,31,32,33,34],smaller:[0,1,2,5,6,8,9,11,13,25,28,29,30,31,32,33,34],smallest:[0,4,14,15,16,28,32],smallest_row_index:14,smooth:[0,3,6,9,13,23,28,32,33],sn:[0,1,3,6,7,28,32],sne:11,sneak:28,so:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,16,18,19,21,22,23,25,26,28,29,30,31,32,33,34],soar:6,social:0,soft:[1,7,10,12,32,34],soften:8,softmax:[3,7,32],softwar:[0,8,15,21,22],sol:8,sole:[0,6,28],solid:[0,7,32],solut:[0,1,2,3,5,6,8,10,11,13,17,18,22,23,25,28,29,30,31,32,33,34],solution_ev:33,soluton:2,solv:[0,1,3,5,6,8,10,11,12,13,22,23,28,29,34],solve_expdec:2,solve_ode_deep_neural_network:2,solve_ode_neural_network:2,solve_pde_deep_neural_network:2,solveod:2,solveode_popul:2,solver:[2,7,8,9,10,11,22,28,32,34],some:[0,1,2,3,4,5,6,7,8,9,10,11,12,14,23,25,28,30,31,34],some_model:[6,29,30],somehow:4,someth:[0,1,3,4,7,9,11,23,25,28,29,32],sometim:[0,1,11,12,13,14,28,29,33,34],somewhat:34,soon:[22,26,29],sophist:[0,28],sopt:[13,33],sort:[5,6,9,11,25,29,31],sound:[3,5,30,31],sourc:[0,1,3,6,15,21,22,23,25,28,31],space:[0,1,4,5,8,9,11,12,13,14,25,29,30,31,32,33,34],span:[0,3,5,9,11,22,28,29],spare:1,spars:[3,6,22,28],sparse_mtx:[22,28],sparsecategoricalcrossentropi:3,sparsiti:10,spatial:[1,2,3,12,34],speak:25,special:[6,7,10,12,13,22,25,28,29,30,32,33],specif:[0,1,2,3,4,5,6,7,8,9,11,12,16,21,22,23,25,27,28,29,30,31,32,34],specifi:[0,3,5,6,7,9,11,13,14,23,25,28,30,31,32,33,34],specifici:[0,10,28],spectacular:3,spectral:1,speech:[0,1,3,4,12,34],speed:[1,2,4,13,33,34],spend:25,spent:23,sphere:[0,29],spin:6,spite:0,spline:8,split:[1,3,4,5,6,8,9,10,11,14,17,23,25,30,31,32],splite:0,splitter:[1,10],spontan:25,spot:3,spread:[0,11,25,28,29],springer:[18,23,27,28,31],spuriou:[13,33,34],sqquar:30,sqrsignal:3,sqrt:[0,3,4,5,6,8,10,11,13,17,25,29,30,31,33,34],squar:[1,2,3,4,7,8,9,11,13,14,15,16,17,19,21,22,25,31,32,33,34],squarederror:10,squaredeuclidean:14,squash:[12,34],srtm:[6,23],srtm_data_norway_1:[6,23],stabil:[5,23],stabl:[0,4,5,6,9,11,21,23,28,29,30],stack:[3,4],stage:[5,13,23,33,34],stai:[0,2,4,5,11,17,28,29],stand:[0,5,9,12,28,29,30,34],standadscal:29,standard:[0,1,4,5,6,7,8,10,12,15,16,17,19,22,23,25,28,30,32,34],standard_basi:[],standardscal:[0,6,7,8,9,10,11,29,30],stanford:[13,32],start:[0,1,2,3,4,5,6,8,9,10,11,12,13,14,20,22,25,26,28,29,31,32,33],start_box:[],start_nod:[],start_tim:14,starting_point:34,stat:[6,31,32],state:[1,2,4,5,6,7,8,10,11,12,13,21,25,29,30,31,32,33,34],statement:[0,7,22,28,32],stationari:[32,33],statist:[0,1,3,4,7,9,10,11,12,13,14,18,22,23,24,27,29,32,33,34],statu:[0,7,9,11,28,32],stavang:[6,23],std:[0,4,6,28,29,31],steep:[13,32,33,34],steepest:34,step:[0,1,2,4,6,7,9,10,11,12,13,14,22,23,28],step_fn:[7,12,32,34],step_length:[13,33,34],step_siz:33,steps_list:9,stereo:3,still:[0,2,3,5,6,11,13,17,25,31,32,33,34],stimuli:[12,34],stk2100:[27,28],stk3155:[15,23,24,26],stk4021:[27,28],stk4051:[27,28],stk4155:[24,26],stk5000:27,stk:[27,28],stochast:[0,1,5,6,8,11,12,15,16,23,28,30,31,32],stock:4,stoke:[12,34],stone:[0,7,23,32],stop:[1,4,9,11,13,14,32],stopiter:[0,7,32],storag:[5,29],store:[0,1,2,3,6,11,13,23,25,28,33,34],storehaug:[26,28],str:[1,3,4],straight:[0,6,8,13,28,31,32,33],straightforward:[0,2,3,5,6,8,9,10,13,22,28,29,30,31,32,33],strategi:[0,1,9,28],stratifi:[6,31],strength:[0,5,14,29],stretch:11,strict:[8,13,32,33],strictli:[8,13,32,33],stride:[4,22],strike:6,string:1,stroke:[7,32],strong:[3,6,9,10,12,22,25,31,34],strongli:[0,8,21,22],stronli:0,structur:[0,1,2,3,6,9,10,12,21,28,31,32,33,34],stuck:[1,13,32,33,34],student:[0,23,24,26,27,28],studi:[0,3,4,5,6,7,8,11,12,13,17,19,21,23,27,28,29,30,33,34],studier:27,style:[0,7,9,22,28,32],sub:[9,12,34],subarg:[],subdivid:[0,22,28],subfield:0,subject:[6,8,25],submit:28,subplot:[0,1,3,4,6,7,8,9,10,14,28,31,32],subplots_adjust:[8,25],subprogram:[22,28],subract:[0,29],subroutin:[0,28],subscript:1,subsequ:[1,4,5,6,12,22,25,29,31,34],subset:[1,6,9,12,13,21,28,31,32,33,34],subspac:[0,8,11,29],substanti:[9,10],substep:11,substitut:[3,6,12,22,31,34],subsubset:9,subtask:6,subtl:1,subtract:[0,4,5,6,11,13,17,22,23,25,30,31,33,34],subtre:9,subval:[],succeed:[0,4,28],success:[3,7,9,13,25,32,33],successfulli:[4,9],sudo:[0,15,21,23,28],suffer:[0,1,2,5,10,28,29,30],suffici:[1,6,8,11,13,31,32,33],suggest:[1,13,23,27,33],suit:[8,12,34],suitabl:[0,25,29],sum:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,22,23,25,28,29,30,32,33,34],sum_:[0,1,2,3,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,22,23,25,28,29,30,31,32,33,34],sum_i:[0,2,5,6,8,13,17,19,23,29,30,31,33,34],sum_j:6,sum_ja_:0,sum_k:[6,8,12,22],sum_logist:[13,33],sum_m:3,sum_n:3,sum_nx_:3,summar:[5,6,9,30,31,32,34],summari:[1,3,4,10,24,30],summat:[0,3,16,29],sunni:9,superconduct:30,superfici:3,superscript:[1,12,34],supervis:[0,5,6,7,9,12,21,28,29,31,32,34],supplement:[7,23,32],support:[0,1,9,10,11,13,21,28,29,33],suppos:[0,5,6,7,8,10,11,12,13,22,28,29,30,31,32,33,34],suppress:[5,8,13,30,33,34],sure:[0,1,4,6,23],surf:[6,23],surfac:[0,6,23,28],surpass:6,surpris:[0,28],surround:[3,21],survei:[0,5,6,28,29,30,31],svc:[8,9,10],svd:[0,6,11,17,28,31],svdinv:[5,30],svm:[8,9,10,11],svm_clf:[8,10],swath:[5,29],sy:[13,32,33],symbol:[1,3,4,5,11,13,14,21,25,28,29,30,33,34],symmeteri:1,symmetr:[0,5,8,11,12,13,22,28,29,33,34],symmetri:[6,9],sympi:[0,15,21,23,28],synonim:25,syntax:13,syntaxerror:8,system:[0,1,3,4,6,7,9,10,12,13,15,21,22,23,28,32,33,34],systemat:[4,6,31],t0:[3,6,13,33,34],t1:[2,13,33,34],t2:2,t3:2,t:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,21,22,23,25,26,28,31,32,33,34],t_0:[2,9,13,33,34],t_1:[13,33,34],t_:2,t_b:10,t_i:[1,2,5,12,29],t_j:12,t_k:9,tabl:[9,23,25,26,28,34],tabul:[0,28],tabular:28,tackl:4,tag:[2,3,4,5,6,7,12,13,14,22,25,29,32,33,34],taht:[0,28],tail:25,tailor:[2,8,11,28],taiwan:[0,28],take:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,16,21,22,25,28,29,30,31,32,33,34],taken:[0,1,3,6,10,13,22,28,31,33],tan:3,tangent:[1,4,12,13,32,33,34],tanh:[1,4,7,8,12,32,33,34],target:[0,1,2,3,4,5,6,7,8,9,10,11,12,28,29,30,31,32,33,34],target_iscomplex:2,target_meta:2,target_nam:9,target_ndim:[],target_shap:2,task:[0,1,3,6,9,11,12,14,20,23,28,31,34],tau:[3,5,25,30,31],taught:28,tax:0,taylor:[2,13,32,33],taylornr:[13,32,33],tba:[],tc:8,td:[1,6,28,31],teach:28,team:1,teaser:0,technic:[0,5,6,13,15,23,28,29,33,34],techniqu:[0,1,8,10,13,21,25,27,28,29,31,32,33,34],technolog:[0,1],tell:[0,4,6,10,11,13,25,31,33,34],temp1:1,temp2:1,temp:1,temperatur:[0,9,28],temporarili:1,ten:[3,17,28],tend:[3,5,6,8,9,10,12,13,14,29,30,31,33,34],tendenc:[0,28],tension:[6,31],tensor:3,tensordot:[],tensordot_adjoint_0:[],tensordot_adjoint_1:[],tensorflow:[0,2,4,8,14,15,21,22,23,24,27,28,29],term1:[5,6,11,23,29],term2:[5,6,11,23,29],term3:[5,6,11,23,29],term4:[5,6,11,23,29],term:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,19,23,25,28,29,30,32,33,34],termin:[0,4,5,9,10,13,15,28,29,33,34],terrain1:[6,23],terrain:[6,23],test:[3,4,5,6,7,8,9,10,13,17,19,22,23,25,31,32,33,34],test_acc:3,test_accuraci:[1,3],test_error:6,test_imag:[3,4],test_ind:[6,31,32],test_input:4,test_label:[3,4],test_loss:3,test_pr:1,test_predict:1,test_rnn:4,test_scor:[7,10,32],test_siz:[0,1,3,5,6,10,28,29,30,31,32],test_split:9,tester:30,testerror:[0,6,29,31],testi:4,testpredict:4,testx:4,text:[0,1,2,4,5,8,9,11,13,15,22,25,27,29,31,32,33,34],textbook:[16,17,23,29,31],textual:9,textur:[1,9],tf:[1,3,4,13,14,32,33],tf_loadlibrari:[3,4,14],th:[0,1,2,5,6,7,9,12,13,14,15,16,22,23,25,28,29,30,31,32,33,34],than:[0,1,2,3,4,5,6,7,9,10,11,12,13,17,21,25,28,29,30,31,34],thank:[4,6,29,30],theano:[1,21,28],thei:[0,1,2,3,4,5,6,7,8,9,11,12,13,22,23,25,28,29,30,31,32,33,34],them:[0,1,3,4,6,8,9,10,11,12,13,22,23,28,29,30,33,34],theme:[0,28,33],themselv:[0,25,28],thenc:[6,31],theorem:[2,6,7,29,32,34],theoret:[0,4,10,28],theori:[0,1,3,8,9,12,13,18,21,23,27,28,30,33,34],thereaft:[0,5,6,11,12,15,16,17,22,23,28,31],therebi:[0,5,7,11,28,29,30,32],therefor:[0,1,2,3,4,6,7,8,11,13,25,28,29,31,32,33,34],therein:11,thereof:[0,6,13,28,31,33,34],theta:[1,4,13,25,33,34],theta_:[1,13,33,34],theta_i:1,theta_linreg:[13,33,34],theta_t:[13,33,34],thetaand:34,thetaor:34,thetaxor:34,thi:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,21,22,23,24,25,27,29,30,31,32,33,34],thing:[0,1,2,4,5,7,9,25,28,30,31,32],think:[0,1,3,4,6,9,12,13,14,25,28,31,32,33,34],third:[0,3,6,13,26,28,32,33,34],thirti:[7,32],thorughout:28,those:[0,3,5,6,8,9,10,11,22,23,24,28,29,31],though:[1,2,3,4,13,22,25,33,34],thought:[6,14,23,25,31],thousand:[0,1,23,29,33,34],three:[0,1,3,5,6,8,9,12,15,22,23,24,25,26,28,29,30,31,32,34],threshold:[1,3,9,10,11,12,13,33,34],through:[0,1,2,3,4,5,6,8,11,12,13,14,21,22,25,28,29,30,31,32,33,34],throughout:[0,4,5,14,21,22,25,28],thu:[0,1,2,5,6,7,8,10,11,12,13,23,26,28,29,30,31,32,33,34],thumb:[0,6,23,28,29],thursdai:[26,29],tibshirani:[6,18,23,24,27,28,31],tick:6,tick_param:6,ticker:[6,13,23,25,32,33],tif:[6,23],tight_layout:[1,7,32],tightli:11,tild:[0,5,6,7,11,15,16,17,18,19,23,25,28,29,30,31],till:[0,4,7,8,9,10,12,22,28,29,30,32],time:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,16,17,21,22,23,25,28,29,30,31,32],timeit:4,timer:4,tini:1,tip:3,titl:[0,1,2,3,4,6,7,8,9,10,13,23,25,28,31,32,33,34],tmp:[13,33,34],tn:[2,3,7],to_categor:[1,3,4],to_categorical_numpi:1,to_numer:[0,6,28,31],todai:3,togeth:[0,3,6,8,11,13,21,28,33,34],toi:[14,33,34],told:[13,33],toler:[2,6,14],tolist:4,tomographi:[12,34],too:[0,2,4,5,6,9,11,13,15,25,27,28,29,31,32,33,34],took:[8,28],tool:[0,1,3,6,13,21,29,31,33,34],toolbox:8,top:[0,3,5,6,9,10,18,21,28,30,31],topic:[0,5,6,7,8,21,23,29,30,32],topograph:23,topolog:[1,3,12,34],toposort:2,torkjellsdatt:[26,28],toss:[10,25],total:[0,1,2,3,4,6,7,8,9,10,11,12,13,14,15,16,22,25,26,28,29,31,32,33],total_loss:4,totalclustervari:14,totalscatt:14,toward:[1,2,7,12,13,23,32,33],towardsdatasci:[33,34],town:0,tp:[4,7],tpng:9,tpu:[13,21,28,33,34],tqdm:6,tr:29,trace:2,trace_stack:[],traceback:[0,1,2,3,4,6,7,10,13,14,23,28,30,32],tracer:2,track:[3,13,14,22,29,32,33,34],tract:0,tractabl:[0,28,29],trade:[5,9,19,30,31],tradeoff:[0,5,19,23,28,29,30,32],tradit:[0,1,4,6,28,31],train:[2,3,5,6,8,9,10,11,12,13,17,19,23,30,31,32,33,34],train_accuraci:[0,1,3,28],train_dataset:4,train_end:[0,1,29],train_error:6,train_imag:[3,4],train_ind:[6,31,32],train_label:[3,4],train_pr:1,train_siz:[0,1,3,29],train_step:4,train_test_split:[0,1,3,5,6,7,9,10,11,28,29,30,31,32],train_test_split_numpi:[0,1,29],trainable_vari:4,trained_model:[6,29,30],trainerror:[0,29],traini:4,training_checkpoint:4,training_dataset:4,training_gradi:[13,33,34],training_gradient_fun:[33,34],training_loss:[33,34],trainingerror:[6,31],trainpredict:4,trainscor:4,trainx:4,trait:[0,28],trajectori:4,trajectory_i:34,trajectory_x:34,transfer:9,transform:[0,5,6,7,8,9,10,11,12,13,21,22,28,29,30,31,32,33,34],transit:[6,12,34],translat:[1,4,6,10,28,29,30],transpos:[1,5,11,22,29,30],travers:[0,5],treat:[0,1,3,6,12,13,25,28,29,30,31,32,33,34],tree:[0,1,6,21,23,28],tree_clf:[9,10],tree_clf_:9,tree_clf_sr:9,tree_reg1:9,tree_reg2:9,tree_reg:9,trend:25,treue:7,trevor:[18,23,27],tri:[2,3,4,9,13,32,33],triain:0,trial:[0,2,4,6,13,25,28,31,32,33],triangl:[13,32,33],triangular:22,trick:[3,4,8,11,13,25,33,34],trickier:25,tridiagon:22,trigger:[0,7,32],trillion:21,trivial:[0,1,5,11,25,28,30],troubl:[0,8,12,29],truck:3,true_beta:[6,29,30],true_divid:1,true_fun:[6,31],truncat:34,trust:9,tucker:8,tuesdai:[26,28,31,32,33],tumor:[7,9,32],tumour:[7,32],tunabl:1,tune:[4,9,13,22,28,32,33,34],tup:[],tupl:2,turn:[0,1,5,6,7,8,9,10,11,12,13,19,22,23,25,28,29,31,32,33,34],tutori:[1,4],tv:2,tveito:2,tvw1zdmznwm:34,tweak:[1,4,10,25],twice:[13,32,33],twist:11,two:[0,1,2,4,5,6,7,9,10,11,12,13,15,16,22,24,25,27,28,30,31,33,34],tx:[13,32,33,34],tx_1:[13,32,33],txt:4,ty:[13,32,33],type:[0,1,3,6,8,10,13,16,22,23,25,29,30,31,32,33],typeerror:[2,6,13],typic:[0,1,2,3,4,5,7,9,10,12,13,25,28,29,30,31,32,33,34],typo:23,u:[0,2,5,6,8,10,11,12,17,22,28,29,30,34],u_:22,u_i:[12,34],u_m:10,ua:[0,28],ubuntu:[0,15,21,23,28],uci:0,ufunc:2,uio:[23,26,27],un:14,unabl:9,unari:[22,28],unary_f:2,unary_oper:2,unary_to_nari:2,unbalanc:[6,9,31,32],unbias:[0,5,6,28,30,31],unbroadcast:2,unbroadcast_f:2,uncent:[6,30],uncertainti:[0,5,28,30,31],uncertitud:25,unchang:[1,3],uncorrel:[10,25],undefin:[5,29],under:[0,1,5,6,10,13,15,16,21,23,28,29,30,31,32,33],underdetermin:[0,28],underfit:[1,6,31],underflowproblem:[5,30,31],undergo:[5,30,31],undergradu:[24,26],underli:[0,1,9,13,25,28,33,34],underset:[4,14],understand:[0,1,3,5,6,10,13,14,21,28,29,30,32,33,34],understood:[8,13,33,34],undesir:8,undetermin:[5,8,30,31],undo:4,unexpect:[6,13,31],unexpected:25,unfair:[6,29,30],unfortun:[1,8,9,10],unicode_liter:[8,9],uniform:[0,1,5,6,11,13,15,16,23,25,28,29,32,33],uniformli:[13,25,32,33,34],unifrompdf:25,unimport:[13,32,33],union:[5,6,30,31,32],uniqu:[0,2,6,13,14,22,28,31,32,33],unique_cluster_label:14,unit:[0,1,3,4,5,10,12,25,28,29,30,34],unitari:[5,6,22,29],unitarili:[22,28],uniti:25,univari:25,univers:[0,1,2,13,15,21,23,24,26,28,29,30,31,32,33,34],unix:1,unknow:[0,22,28],unknown:[0,1,3,4,5,6,8,10,13,16,22,28,29,30,31,33,34],unknowwn:12,unlabel:1,unless:[0,3,6,11,13,23,28,31,32,33],unlik:[1,3,8,13,32,33,34],unnecessarili:9,unord:3,unravel:1,unrol:[3,11],unseen:[0,7,9,32],unstabl:1,unsupervis:[0,1,4,12,21,28,34],unsymmetr:[22,28],until:[1,2,4,9,12,13,14,32,33,34],untouch:0,unusu:[12,34],up:[1,3,4,5,6,8,10,11,13,14,16,18,21,22,23,25,26,30,33],updat:[1,2,10,12,13,14,33,34],uploa:28,upload:[21,23,27],upon:[0,1,6,7,11,22,23],upper:[0,8,9,16,22,29],uppercas:[22,28],upsampl:4,upscal:4,url:[0,7,28,29,32,34],us:[4,5,6,8,9,10,11,12,14,15,16,17,18,19,22,24,25,27,30,31],usa:[28,34],usag:[0,8,21,28,29,34],usd10000:0,usd:0,use_bia:4,usecol:[0,28],useless:1,user:[0,1,2,3,4,6,7,8,9,11,14,15,21,22,23,28,29,30,32,34],usernam:23,userwarn:[6,34],usetex:25,usg:[6,23],usr:25,usual:[0,3,4,7,12,13,14,28,32,33,34],ut:[5,30],utf:[0,7,32],util:[1,3,4,6,7,10,14,28,31,32],ux:22,v0:25,v1:25,v2:25,v8xr:34,v:[2,4,5,6,11,13,17,21,29,30,33,34],v_0:11,va:1,vahid:28,val:[13,33,34],val_accuraci:3,val_loss:4,vale:2,valid:[0,1,4,7,9,10,13,21,25,28,29,33,34],validation_data:3,validation_split:4,valu:[0,1,2,3,4,6,7,8,9,10,12,13,14,15,16,19,21,22,23,28,33,34],valuat:9,valueerror:[],valy:4,van:[0,18,23,28,29,30,31],vandenbergh:[8,13,32,33],vandermond:[0,28],vanilla:[0,6,11,14,29,30],vanish:[1,4,13,25,32,33],var_x:25,varabl:8,varepsilon:[5,6,18,23,30,31],varepsilon_:[5,6,30,31],varepsilon_i:[5,6,30,31],vari:[0,1,3,5,6,10,15,16,28,31],variabl:[0,1,2,5,6,7,8,10,11,12,13,14,22,28,29,30,31,34],varianc:[0,1,5,7,9,10,11,13,14,18,19,21,22,25,28,29,32,33,34],variance_i:[5,11,29],variance_x:[5,11,29],variant:[0,1,6,8,12,13,28,29,32,33,34],variat:[3,4,11,28],varieti:[0,3,12,15,21,23,28,34],variou:[1,3,5,6,7,8,9,11,12,13,16,18,21,22,23,25,29,30,33,34],varydimens:4,vastli:3,vaue:1,vault:0,vdot:[2,13,32,33],ve:23,vec:[6,31],vector:[0,1,2,3,4,5,6,7,9,10,11,13,14,16,17,21,30,31,32,33],vector_mean:14,ventur:[0,8,15,21,28],verbos:[1,3,4],veri:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,23,25,27,28,29,30,31,32,33,34],verifi:[3,11,22,28],versatil:[8,28],versicolor:[8,9],version:[0,3,10,13,14,15,21,22,23,25,28,33],versu:1,vert:[0,1,5,6,7,8,9,11,13,17,28,29,30,31,32,33],vert_1:[5,6,29,30,31],vert_2:[5,6,11,17,29,30,31],via:[0,5,6,7,8,9,10,11,12,15,19,21,22,23,24,25,26,28,29,30,31,32,34],vidal:11,video:[0,1,12,21,24,26,28,29,30,31],view:[1,3,5,6,12,13,25,27,28,30,31,33,34],violat:8,virginica:9,viridi:[0,1,2,3,28],virtual:1,viscos:[13,33,34],viscou:[13,33,34],visibledeprecationwarn:2,vision:[0,3],visual:[0,3,11,12,15,21,28,29,34],visualis:1,viz:[6,8,25],vjp:2,vjp_argnum:2,vjpfun:2,vjpmaker:[],vjpnode:[],vmap:[13,33],vmax:[1,6],vmh0zpt0tli:34,vmin:[1,6],voic:3,volum:[0,3,28],vote:10,voting_clf:10,votingclassifi:10,votingsimpl:10,vs:[0,4,6,33],vspace:2,vstack:[5,11,22,25,28,29],vt:[5,29,30],w1:8,w2:[8,11],w3:8,w:[0,1,2,3,4,5,6,7,8,10,11,12,13,14,22,25,28,29,31,32,33,34],w_1:[8,22],w_1x_1:8,w_1x_:8,w_2:[8,22],w_2x_2:8,w_2x_:8,w_3:22,w_4:22,w_:[1,12,34],w_hidden:2,w_i:[1,2,10],w_ix_i:[12,34],w_j:22,w_m:22,w_output:2,w_px_:8,w_px_p:8,wa:[0,1,3,4,5,6,7,10,11,12,14,17,22,23,28,29,30,31,32,34],wai:[0,1,2,3,4,5,6,7,8,10,11,12,13,14,17,22,25,28,29,30,32,33],walk:9,walker:25,wang:[0,28],want:[0,1,2,3,4,5,6,8,9,10,11,12,13,14,15,16,17,21,23,25,28,29,30,31,32,33,34],warn:[4,8],warrant:[6,31,32],wast:[3,33,34],watch:[21,34],wave:3,wavelet:8,we:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,21,22,23,24,25,26,27,29,30,31,32],weak:[9,10,14],weather:[1,12,34],web:[21,24,26,28],webpag:28,websit:[6,22,23,24,28],wedg:[8,25],wednesdai:[26,28,31,32,33],wee:11,week:[0,5,6,7,23,24,26],weekli:[16,21,23,26,27,28,34],weight:[0,1,2,3,6,7,9,10,12,13,23,25,32,33,34],weigth:2,welchlab:34,welcom:[8,21],well:[0,1,2,3,4,5,6,7,8,9,10,12,13,15,16,19,20,21,22,23,25,27,28,29,30,31,32,33,34],went:8,were:[0,1,3,4,5,6,7,8,10,11,12,14,25,28,29,31,32,34],wessel:[0,18,23,28,29,30,31],what:[1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,19,21,22,23,25,32,33,34],whatev:3,when:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,16,17,18,22,23,25,28,29,30,31,32],whenev:[13,25,33,34],where:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,21,22,23,25,26,28,29,30,31,32,33,34],wherea:[6,25,31],wherefrom:23,wherein:[1,12,34],whether:[0,3,5,7,9,23,25,28,30,32],which:[0,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,21,22,23,24,25,26,28,29,30,31,32],whichev:[1,3],white:9,whiteboard:[30,31,32,33,34],who:[0,24],whole:[1,3,4,5,9,11,13,30,31,33,34],whose:[0,6,10,25,29,31],whow:[11,29],why:[0,1,3,6,13,23,30,32,33],wide:[0,1,3,6,7,12,15,21,22,23,28,31,32,34],widehat:[6,31],width:[0,3,8,9,28],wieringen:[0,18,23,28,29,30,31],win:10,wind:9,wing:[26,28],winther:2,wiothout:[6,29],wiscons:[7,32],wisconsin:10,wisdom:[6,30],wise:[0,1,5,12,13,29,33,34],wish:[0,2,5,7,8,11,13,14,22,23,28,29,32,33],with_std:[0,29],wither:6,within:[0,2,3,4,7,9,12,13,14,25,27,28,32,33],withinclust:14,without:[0,1,5,6,8,9,11,12,13,28,29,30,31,33,34],wo5dmep_bbi:34,won:[0,28],wonder:8,word:[0,1,3,4,5,6,7,14,25,28,29,30,31],work:[0,1,4,6,7,8,9,13,15,21,23,24,25,26,28,29,31,32,33,34],workshop:28,world:[0,8,29],worldwid:[0,28],wors:[0,1,3,4,6,28,31],worst:9,worth:9,worthi:23,would:[0,1,3,5,6,7,8,9,10,11,12,13,22,23,25,28,29,30,31,32,33,34],wrap:[6,22,28],wrap_util:2,write:[0,1,2,3,5,6,7,8,12,13,15,16,17,20,22,28,29,31,32,33,34],written:[0,2,3,5,11,12,13,16,21,22,23,25,28,29,30,31,32,33,34],wrong:[1,8],wrongli:10,wrote:[5,11,29],wrt:[2,10,13,33,34],wth:[10,13,33,34],www:[21,22,23,27,28,30,34],wx_1:8,x0:8,x1:[4,8,9,10,13,33,34],x1_exampl:8,x1d:8,x2:[8,9,10,13,33,34],x2d:[8,11],x2d_train:11,x2dsl:11,x3:[8,9],x4:9,x:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,22,23,25,28,31,32,33,34],x_0:[0,5,11,22,28,29,30,31],x_1:[0,2,5,6,7,8,9,10,11,13,22,25,28,29,30,31,32,33,34],x_2:[0,2,5,6,7,8,9,10,11,13,22,25,28,29,31,32,33,34],x_3:[8,22,25],x_4:22,x_:[0,2,3,5,6,8,10,11,13,14,18,22,23,25,28,29,30,31,32,33],x_center:11,x_data:1,x_data_ful:1,x_hidden:2,x_i:[0,1,2,5,6,7,8,9,10,11,12,13,14,17,22,25,28,29,30,31,32,33,34],x_input:2,x_ix_:[0,28],x_iy_i:8,x_j:[0,2,8,9,12,16,25,29,34],x_jy_j:8,x_k:[12,14,22,25,29,34],x_l:25,x_m:[6,12,22,25,31,34],x_n:[0,2,3,6,8,11,12,13,22,25,28,31,32,33,34],x_new:[9,10],x_offset:[6,29,30],x_output:2,x_p:[3,7,9,32],x_poli:9,x_poly10:9,x_pred:4,x_prev:2,x_reduc:11,x_scale:8,x_small:[13,33],x_test:[0,1,3,5,6,7,9,10,11,28,29,30,31,32],x_test_own:6,x_test_scal:[0,6,7,9,10,11,29,30],x_tot:4,x_train:[0,1,3,4,5,6,7,9,10,11,28,29,30,31,32],x_train_mean:[6,29,30],x_train_own:6,x_train_scal:[0,6,7,9,10,11,29,30],x_val:1,xarrai:[21,28],xavier:1,xbkjd4ccgq:28,xbnew:[13,32,33],xcode:[0,15,21,23,28],xdclassiffierconfus:10,xdclassiffierroc:10,xg_clf:10,xgb:10,xgbclassifi:10,xgboost:9,xgboot:10,xgbregressor:10,xgparam:10,xgtree:10,xi:[8,13,33,34],xi_1:8,xi_:8,xi_i:8,xinv:[30,34],xk:8,xla:[13,21,28,33,34],xlabel:[0,1,2,3,4,5,6,7,8,9,10,13,23,25,28,30,31,32,33,34],xlim:[6,10,31],xm:9,xmesh:[13,33],xnew:[0,13,28,32,33,34],xp:25,xpanda:[0,29],xpd:[5,11,29],xplot:0,xs:9,xscale:[0,29],xsr:9,xt_x:[13,32,33,34],xtest:[6,31,32],xtick:[3,6,8,9,31],xtrain:[6,31,32],xu:[0,28],xx:[0,22,28],xy:[0,6,8,22,23,28],xytext:8,xz:[22,28],y1:4,y2:4,y3:4,y:[0,1,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,22,23,25,28,29,30,31,32,33,34],y_0:[0,5,11,22,28,29,30,31],y_1:[0,5,8,9,11,13,22,28,29,30,31,32,33],y_1y_1:8,y_1y_1k:8,y_1y_2:8,y_1y_2k:8,y_1y_n:8,y_1y_nk:8,y_2:[0,5,8,9,11,22,28,29],y_2y_1:8,y_2y_1k:8,y_2y_2:8,y_2y_2k:8,y_3:[0,9,22],y_4:22,y_:[0,1,5,6,10,11,22,28,29,30,31],y_data:[0,1,5,6,28,29,30,32],y_data_ful:1,y_decis:8,y_fit:[0,29],y_i:[0,1,5,6,7,8,9,10,11,12,13,15,16,17,18,19,22,23,28,29,30,31,32,33,34],y_if_:10,y_ix_:[0,28],y_ix_i:[7,8,13,29,32,33],y_iy_jk:8,y_j:[6,8,12,19,23,31,34],y_k:[12,34],y_m:22,y_model:[0,4,5,6,28,29,30,32],y_n:[8,13,32,33],y_ny_1:8,y_ny_1k:8,y_ny_2:8,y_ny_2k:8,y_ny_n:8,y_ny_nk:8,y_offset:[6,29,30],y_plot:9,y_pred1:9,y_pred2:9,y_pred:[0,1,4,6,7,8,9,10,29,30,31,32],y_pred_rf:10,y_pred_tre:10,y_predict:34,y_proba:[7,10,32],y_scaler:[6,30],y_test:[0,1,3,4,5,6,7,9,10,11,28,29,30,31,32],y_test_onehot:1,y_test_predict:0,y_tot:4,y_train:[0,1,3,4,5,6,7,9,10,11,28,29,30,31,32],y_train_mean:[6,29,30],y_train_onehot:1,y_train_predict:0,y_train_scal:[6,30],y_val:1,yand:34,ye:[3,6,7,31,32],year:[0,21,28],yet:[0,1,6,8,11,13,28,32,33],yi:[13,33,34],yield:[0,2,5,6,7,8,10,12,13,14,22,25,28,30,31,32,33,34],yk:8,ylabel:[0,1,2,3,4,5,6,7,8,9,10,13,23,25,28,30,31,32,33,34],ylim:[3,6,31],ym:9,ymesh:[13,33],yn:0,yo:[8,9,10],yor:34,yoshua:[1,27],you:[0,1,2,3,4,5,6,8,9,10,11,13,15,16,17,19,20,21,22,23,25,26,27,28,29,30,31,32,33,34],young:0,your:[1,2,4,5,6,8,11,13,17,19,20,21,22,23,30,31,32,33,34],yourself:[11,13,28,33],youtu:[32,34],youtub:[21,34],ypred:[6,31,32],ypredict2:[13,32,33,34],ypredict:[0,13,28,29,32,33,34],ypredictlasso:[5,30],ypredictol:[0,5,30],ypredictown:[6,29,30],ypredictownridg:[6,30],ypredictridg:[0,5,6,30,32],ypredictskl:[6,29,30],yridg:28,ys:9,ytest:[6,31,32],ytick:[3,6,8,9,31],ytild:[0,6,28,29,31],ytildelasso:[5,30],ytildenp:[0,28,29],ytildeol:[0,5,30],ytildeownridg:[6,30],ytilderidg:[5,6,30],ytrain:[6,31,32],yuxi:28,yx:[22,28],yxor:34,yy:[22,28],yz:[22,28],z:[0,1,2,3,4,5,6,7,8,9,11,12,13,22,23,25,28,29,31,32,33,34],z_0:[22,28],z_1:[22,28],z_2:[22,28],z_:[1,2,12,22,28],z_c:1,z_h:1,z_hidden:2,z_i:[1,12,34],z_j:[1,12],z_k:[12,29],z_m:1,z_mod:9,z_o:1,z_output:2,zaman:25,zaxi:[6,23],zero:[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,17,18,19,22,23,25,28,29,30,31,32,33,34],zeros_lik:4,zeroth:29,zfill:4,zip:[2,4,6],zm_h:[0,28],zn:0,zone:0,zoom:28,zx:[22,28],zy:[22,28],zz:[22,28]},titles:["3. Linear Regression","14. Building a Feed Forward Neural Network","15. Solving Differential Equations with Deep Learning","16. Convolutional Neural Networks","17. Recurrent neural networks: Overarching view","4. Ridge and Lasso Regression","5. Resampling Methods","6. Logistic Regression","8. Support Vector Machines, overarching aims","9. Decision trees, overarching aims","10. Ensemble Methods: From a Single Tree to Many Trees and Extreme Boosting, Meet the Jungle of Methods","11. Basic ideas of the Principal Component Analysis (PCA)","13. Neural networks","7. Optimization, the central part of any Machine Learning algortithm","12. Clustering and Unsupervised Learning","Exercises week 34","Exercises week 35","Exercises week 36","Exercises week 37","Exercises week 38","Exercises week 39","Applied Data Analysis and Machine Learning","2. Linear Algebra, Handling of Arrays and more Python Features","Project 1 on Machine Learning, deadline October 7 (midnight), 2024","Teaching schedule with links to material","1. Elements of Probability Theory and Statistical Data Analysis","Teachers and Grading","Textbooks","Week 34: Introduction to the course, Logistics and Practicalities","Week 35: From Ordinary Linear Regression to Ridge and Lasso Regression","Week 36: Linear Regression and Statistical interpretations","Week 37: Statistical interpretations and Resampling Methods","Week 38: Logistic Regression and Optimization","Week 39: Optimization and Gradient Methods","Week 40: Gradient descent methods (continued) and start Neural networks"],titleterms:{"1":[0,15,16,17,18,23,28,29],"16":32,"2":[0,15,16,17,18,28,29,30],"2023":26,"2024":[23,33,34],"21":[],"23":33,"26":29,"27":33,"3":[0,15,16,28,29],"30":34,"34":[15,28],"35":[16,29],"36":[17,30],"37":[18,31],"38":[19,32],"39":[20,33],"4":[0,29],"40":34,"5":0,"7":23,"9":31,"case":[8,10,25,29,30,32,33],"class":32,"do":[1,30,31,33,34],"final":[12,29,30,33,34],"function":[0,1,6,7,8,10,11,12,13,23,25,28,29,30,31,32,33,34],"import":[5,22,28,29,30,34],"new":[4,30,31],A:[0,1,4,8,9,28,30,31,32,34],AND:34,And:[28,29,30,32,33,34],But:[33,34],For:29,In:26,Ising:6,OR:34,The:[0,1,2,3,5,6,7,8,9,11,12,17,21,28,29,30,31,32,33,34],To:[28,29],With:[4,30],about:[28,29],abov:30,activ:[1,12,30,34],ad:[0,6,17,23,28,29,34],adaboost:10,adagrad:[13,33,34],adam:[13,33,34],adapt:[10,33,34],adjust:1,advanc:34,adversari:4,again:[3,9,32],ai:[23,28],aim:[8,9,17,18,19,20,28],aka:[28,29],al:34,algebra:[22,28],algorithm:[9,10,11,12,29,33,34],algortithm:[13,32,33],all:8,an:[0,4,10,28],analys:[5,29],analysi:[0,5,6,11,21,23,25,28,29,30,31],analyt:[0,16,17],ani:[13,32,33],anoth:[9,30,31],appli:21,approach:[0,8,14,28,31,33,34],approxim:12,architectur:1,argument:[33,34],arrai:[22,28],artifici:34,assist:26,assumpt:[30,31],august:29,autocorrel:25,autograd:[2,13,33,34],automat:[13,33,34],avoid:[],b:[17,23,33],back:[1,11,12],background:[21,23,31],bag:10,base:[13,31,33,34],basic:[0,5,7,9,10,11,22,29,30,31,32],batch:[1,33,34],bay:[5,30,31],befor:11,beta:[30,31],better:[8,34],bia:[6,23,31],binari:1,bind:28,bird:10,boldsymbol:[29,30,31],boost:10,bootstrap:[6,10,31],boston:0,breast:1,brief:[28,31,32,33],bring:12,build:[1,3,9],c:[23,28],calcul:29,can:[28,31,33,34],cancer:[1,7,9,11,32],cart:9,center:29,central:[13,21,25,31,32,33],chain:12,challeng:32,chang:10,channel:28,chi:[0,28],choos:1,cifar01:3,classic:11,classif:[1,9,10,32],classifi:[8,32],clip:1,cluster:14,cnn:3,code:[0,1,2,5,9,11,12,13,14,28,29,30,31,32,33,34],collect:[1,3],come:32,commun:28,compact:32,compar:[2,10],comparison:30,compet:[33,34],complet:29,complex:[0,6,23,29],complic:[6,33,34],compon:11,comput:[9,33,34],computation:31,computerlab:28,con:9,concept:25,condit:[30,31,32,33],confid:31,conjug:[13,33],continu:34,contn:28,convex:[8,13,32,33],convolut:[3,12,34],correctli:[30,31],correl:[11,29,32],correspond:[32,33],cost:[1,10,29,30,31,32,33],cours:[21,27,28],covari:[5,11,25,29],cover:28,cross:[6,23,31,32],cython:28,d:23,data:[0,1,3,6,7,9,11,15,16,21,23,25,28,29,30,32],dataset:[1,3],deadlin:[23,28],decai:[2,33,34],decis:[9,10],decomposit:[5,11,17,22,29],deep:[1,2,28,32],defin:[1,28],degre:[0,29],deliveri:23,delta:31,dens:[0,28],deriv:[5,12,29,30,31,32,33],descent:[2,10,13,32,33,34],descript:23,design:29,detail:[3,28],develop:1,diagon:11,differ:[8,33,34],differenti:[2,13,33,34],diffus:2,dimension:[2,3,8,23,29],directli:[33,34],disadvantag:9,discret:25,discuss:32,distribut:[5,25,30,31],distrubut:31,doe:[29,30,34],domain:25,dot:33,down:1,dropout:1,e:23,each:32,economi:29,electron:23,element:[0,25,28,33,34],elimin:22,energi:28,ensembl:10,entropi:[9,32],environ:[0,15,28],equat:[0,2,12,28,29,30,32,33],error:[0,10,28,29,31],essenti:28,estim:[30,31],et:34,etc:28,euler:2,evalu:1,exampl:[0,1,2,3,4,6,7,8,9,10,28,29,30,31,32,33,34],exercis:[0,6,15,16,17,18,19,20,28,29],expect:[18,25,30,31],expens:31,experi:25,explor:[0,15,16,28],exponenti:2,express:[17,18,29,32,33],extend:[32,33],extrapol:4,extrem:[10,28],ey:10,f:23,fall:26,famili:[1,28,29],famou:22,fantast:29,featur:[9,22,29],feed:[1,12,34],find:[31,33],fine:1,first:[4,12,28,29,30,32,33],fit:[0,10,28,30],fix:29,fold:[31,32],forc:3,forest:10,format:[23,28],forward:[1,2,12,34],fourier:3,frank:[6,23,29],freedom:[0,29],frequent:29,frequentist:[0,28],fridai:[],from:[5,10,12,29,30,31,32,33,34],full:2,further:[3,5,29],g:23,gan:4,gate:34,gaussian:22,gd:[13,33,34],gener:[4,9,28],geometr:[11,32,33],get:34,gini:9,good:[0,28],goodfellow:34,grade:[26,28],gradient:[1,2,10,13,32,33,34],grid:32,group:32,growth:2,ha:21,handl:[22,28,29],happen:[30,31],hessian:[29,32,33],hidden:2,histogram:31,homework:[32,33],hous:0,how:32,hyperbol:34,hyperparamet:1,hyperplan:8,i:1,id3:9,idea:11,ideal:[32,33],ident:[30,31],identifi:31,ii:28,iid:[30,31],illustr:[30,34],implement:[1,34],implic:[5,29],improv:[1,33],includ:[13,32,33,34],increment:11,independ:[30,31],index:9,inform:26,input:2,instal:[21,23,28],instructor:26,intercept:29,interpret:[5,11,28,29,30,31,32,33],interv:31,introduc:[11,13,29,33,34],introduct:[0,6,21,22,23,28,34],invers:[5,22,30],invert:29,iter:[10,33],its:29,jacobian:29,jax:[13,33,34],job:34,julia:28,jungl:10,k:[31,32],kera:[1,3],kernel:[8,11],lab:[31,32,33,34],lagrangian:8,lambda:32,lasso:[5,6,23,29,30,31,32,34],last:[29,32,34],later:[5,29],layer:[1,2,3,12],learn:[0,1,2,11,13,14,15,16,21,23,28,29,30,31,32,33,34],least:[5,6,18,23,28,29,30],lectur:[28,29,30,31,32,33,34],level:10,librari:[21,28],likelihood:[7,30,31,32],limit:[1,13,25,31,32,33,34],linear:[0,8,13,22,28,29,30,32],link:[5,11,24,27,29,30,31],literatur:23,logist:[7,28,32,33,34],loop:[33,34],loss:[29,32,33],lu:22,machin:[0,8,13,21,23,28,32,33],made:[30,31],main:[25,28],make:[0,9,10,15,16,28,29],mani:[10,12],manipul:29,margin:[30,31],mass:28,materi:[23,24,28,29,30,31,32],math:[5,29],mathemat:[3,5,8,29,33,34],matric:[5,22,28,30],matrix:[1,5,11,12,22,28,29,30,32,33,34],matter:[0,28],max:29,maximum:[30,31,32],mean:[0,29,30,32],measur:32,meet:[5,10,25,28,29],mercer:8,method:[6,9,10,13,23,28,31,32,33,34],midnight:23,min:29,mini:[33,34],minibatch:[33,34],minim:[28,32],ml:28,mle:[30,31],mlp:12,mnist:[3,4],model:[0,1,4,6,12,28,34],moment:[33,34],momentum:[13,33,34],mondai:[29,30,31,32,33,34],moon:[8,9],more:[3,6,22,23,28,29,30,31,32,33,34],multi:34,multilay:[12,34],multipl:[1,3],multipli:8,need:[23,28],network:[1,2,3,4,7,12,28,32,34],neural:[1,2,3,4,7,12,28,34],neuron:34,newton:[32,33,34],noen:[],non:8,none:[33,34],normal:[0,1,31],notat:[12,34],note:[23,29,30,34],now:[1,9,13,30,31,33,34],nuclear:[0,28],nueral:32,numba:28,number:[0,2,25,29,33,34],numer:[2,23,25],numpi:[22,28,33,34],object:3,obtain:11,octob:23,od:2,off:[6,23],ol:[5,6,23,30,31,33,34],one:[2,12,32,33],ones:34,oper:22,optim:[1,8,13,21,28,29,32,33,34],order:[13,33,34],ordinari:[5,6,18,23,28,29,30],organ:[0,28],oslo:27,other:[4,9,11,12,22,23,28,29,32,34],our:[0,4,5,11,13,28,29,32,33],outcom:[21,28],output:2,overarch:[0,4,8,9,17,18,19,20,28,29],overview:[10,28,33,34],own:[0,10,11,15,16,28,29],packag:[22,28],panda:[28,29],paper:23,paramet:[28,29,32,33,34],part:[13,21,23,29,32,33],partial:2,pass:1,pca:11,pdf:25,pencil:23,perceptron:[12,34],perform:[1,9],period:3,perspect:1,plan:[29,30,31,32,33,34],plot:[31,32],point:4,poisson:2,polynomi:[3,30],popul:2,popular:28,practic:[13,26,28,33,34],pre:[1,3],preambl:23,predict:4,predictor:32,preprocess:29,prerequisit:[3,21,28],princip:11,principl:3,pro:9,probabl:[5,25,30,31],problem:[1,2,13,28,29,30,32,33,34],procedur:[9,28],process:[1,3],product:33,program:[2,13,23,32,33],project:[6,23,28,32],prop:[13,33,34],propag:[1,12],properti:[5,25,29,32],python:[0,9,15,21,22,28],quick:8,r:28,random:[10,11,25,32],raphson:[32,33],rate:[33,34],read:[9,28,29,31,32,34],real:[6,23,28],recommend:[28,29],rectangular:30,recurr:[4,12,34],recurs:[33,34],reduc:[0,29],reduct:3,refer:23,reformul:2,regress:[0,5,6,7,9,10,13,17,18,23,28,29,30,31,32,33,34],regular:[1,32],relat:29,relev:[27,29,32,34],relu:1,remark:3,remind:[6,8,28,32,33],repeat:29,replac:[13,33,34],report:23,repositori:31,requir:[2,21],resampl:[6,23,31],rescal:[6,30],residu:29,resourc:2,result:[29,30],revisit:[13,32,33],rewrit:[28,29,31],rewritten:32,ridg:[0,5,6,17,18,23,29,30,31,32,33,34],rm:[13,33,34],rmsprop:[33,34],rule:12,s:[8,10,31,32,33,34],same:[13,31,33,34],sampl:11,scale:29,schedul:[24,28],schemat:9,scheme:2,scienc:28,scikit:[0,1,11,15,16,28,29,30,31,32,33],search:32,second:[13,33,34],select:32,semest:26,sensit:[32,33],septemb:[30,31,32,33,34],session:[29,30,31,32,33,34],set:[0,2,3,9,12,15,28,29,32],sgd:[13,33,34],should:1,similar:[13,33,34],simpl:[0,4,9,13,28,29,30,32,33,34],singl:[10,34],singular:[5,11,17,29],size:29,slightli:[33,34],soft:8,softmax:1,softwar:[23,28],solv:[2,30,32,33],solver:13,some:[13,22,29,32,33],specifi:2,split:[0,15,16,28,29],squar:[0,5,6,10,18,23,28,29,30],standard:[13,29,31,33],start:34,state:[0,28],statist:[5,6,21,25,28,30,31],steepest:[10,13,32,33],step:[31,32,33,34],still:29,stochast:[13,25,33,34],stop:[33,34],strongli:28,studi:32,subtract:29,suggest:[28,32,34],sum:31,summari:[26,28,34],superposit:3,supervis:1,support:8,svd:[5,29,30],syntax:33,systemat:3,t:[29,30],taken:34,teach:[24,26],teacher:[26,28],technic:30,techniqu:[6,11,23],technolog:21,tensorflow:[1,3],tent:28,term:31,test:[0,1,15,16,28,29,30],text:28,textbook:[27,28],than:[32,33],theorem:[5,8,11,12,25,30,31],theori:25,thi:[17,18,19,20,28],think:29,thursdai:[],time:[33,34],tip:[13,33,34],togeth:12,tool:[23,28],top:1,topic:28,toward:11,trade:[6,23],tradeoff:[6,31],train:[0,1,4,15,16,28,29],transform:3,tree:[9,10],tuesdai:[30,34],tune:1,two:[3,8,21,23,29,32],type:[2,4,12,28,34],uio:28,understand:31,univers:[12,27],unsupervis:14,unsupport:33,up:[0,2,9,12,15,28,29,31,32,34],us:[0,1,2,3,7,13,21,23,28,29,32,33,34],usag:[30,31],valid:[6,23,31,32],valu:[5,11,17,18,25,29,30,31,32],vari:[33,34],variabl:[25,32,33],varianc:[6,23,30,31],variou:[0,15,28,31,32],vector:[8,12,22,28,29,34],video:[32,33,34],view:[0,4,10,29],visual:[1,9],vs:3,wai:[9,31,34],warm:34,wave:2,we:[28,33,34],wednesdai:[30,34],week:[15,16,17,18,19,20,28,29,30,31,32,33,34],weekend:32,weekli:24,what:[0,28,29,30,31],when:[33,34],which:[1,33,34],why:[28,29,31,34],wisconsin:[7,32],wrap:[29,31],write:[4,11,23,30],x:[29,30],xgboost:10,xor:34,yet:30,your:[0,10,15,16,28,29],yourself:32}}) \ No newline at end of file diff --git a/doc/LectureNotes/_build/html/week40.html b/doc/LectureNotes/_build/html/week40.html index 5387fc4e3..46b7cf5fc 100644 --- a/doc/LectureNotes/_build/html/week40.html +++ b/doc/LectureNotes/_build/html/week40.html @@ -1197,9 +1197,10 @@ doconce format html week40.do.txt --no_mako -->
  1. Stochastic Gradient descent with examples and automatic differentiation

  2. If we get time, we start with the basics of Neural Networks, setting up the basic steps, from the simple perceptron model to the multi-layer perceptron model

  3. +
  4. Video of lecture

  5. +
  6. Whiteboard notes at https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2024/NotesSeptember30.pdf

- - +

Suggested readings and videos¶

Readings and Videos:

@@ -1288,17 +1289,17 @@ We summarize some of these here for the methods we hvae studied in project one,
Parameters for OLS using gradient descent
-[[3.870337  ]
- [3.34871778]
- [4.83363025]]
+[[3.53732988]
+ [4.06277313]
+ [4.51728978]]
 Parameters for Ridge using gradient descent
-[[3.66951679]
- [3.76942272]
- [4.63546236]]
+[[3.62671667]
+ [3.79849321]
+ [4.63207408]]
 Parameters for Lasso using gradient descent
-[[3.65759901]
- [3.87732748]
- [4.58735893]]
+[[4.1547556 ]
+ [2.58013829]
+ [5.20288581]]
 
@@ -1350,11 +1351,11 @@ Parameters for Lasso using gradient descent [[4.] [3.] [5.]] -0 [-23.78254537] [-30.51512235] -1 [1.30917499e-14] [-1.01327148e-14] -2 [9.76996262e-16] [1.28164443e-15] -3 [-7.28306304e-16] [-8.17359583e-16] -4 [-7.63833441e-16] [-1.32422234e-15] +0 [-27.10587277] [-37.81035098] +1 [1.16209264e-13] [2.08824304e-13] +2 [8.8817842e-17] [2.62242138e-16] +3 [-1.77635684e-17] [-1.50600514e-16] +4 [-3.37507799e-16] [-2.280464e-16] beta from own Newton code [[4.] [3.] @@ -1696,15 +1697,15 @@ function.

Own inversion
-[[4.12220276]
- [2.95115528]]
-Eigenvalues of Hessian Matrix:[0.31601423 3.93074023]
+[[4.30637636]
+ [2.56947078]]
+Eigenvalues of Hessian Matrix:[0.30000613 4.12600095]
 theta from own gd
-[[4.12220276]
- [2.95115528]]
+[[4.30637636]
+ [2.56947078]]
 theta from own sdg
-[[4.12206013]
- [2.92370959]]
+[[4.34759233]
+ [2.63142731]]
 
_images/week40_34_1.png @@ -2418,12 +2419,12 @@ first example shows results with ordinary leats squares.

Own inversion
-[[3.62286539]
- [3.36754671]]
-Eigenvalues of Hessian Matrix:[0.30134885 4.08702578]
+[[3.88064505]
+ [2.99072374]]
+Eigenvalues of Hessian Matrix:[0.30141906 4.73853838]
 theta from own gd
-[[3.62286539]
- [3.36754671]]
+[[3.88064505]
+ [2.99072374]]
 
_images/week40_100_1.png @@ -2494,73 +2495,73 @@ theta from own gd
Own inversion
 [[4.]
  [3.]]
-Eigenvalues of Hessian Matrix:[0.27124938 4.56804783]
-0 [-8.64009263] [-10.94092702]
-1 [0.18925625] [-0.15527976]
-2 [0.17801827] [-0.14605929]
-3 [0.16744759] [-0.13738633]
-4 [0.1575046] [-0.12922837]
-5 [0.14815202] [-0.12155483]
-6 [0.1393548] [-0.11433693]
-7 [0.13107995] [-0.10754764]
-8 [0.12329646] [-0.10116149]
-9 [0.11597515] [-0.09515455]
-10 [0.10908858] [-0.0895043]
-11 [0.10261093] [-0.08418956]
-12 [0.09651792] [-0.07919041]
-13 [0.09078672] [-0.0744881]
-14 [0.08539583] [-0.07006502]
-15 [0.08032505] [-0.06590458]
-16 [0.07555537] [-0.06199119]
-17 [0.07106891] [-0.05831017]
-18 [0.06684886] [-0.05484773]
-19 [0.06287939] [-0.05159088]
-20 [0.05914563] [-0.04852743]
-21 [0.05563358] [-0.04564589]
-22 [0.05233008] [-0.04293545]
-23 [0.04922273] [-0.04038595]
-24 [0.0462999] [-0.03798785]
-25 [0.04355062] [-0.03573214]
-26 [0.0409646] [-0.03361037]
-27 [0.03853213] [-0.0316146]
-28 [0.03624411] [-0.02973733]
-29 [0.03409194] [-0.02797154]
+Eigenvalues of Hessian Matrix:[0.31702609 3.84351715]
+0 [-13.26083712] [-12.67834752]
+1 [-0.55020405] [0.5257011]
+2 [-0.50482139] [0.48233952]
+3 [-0.46318204] [0.44255455]
+4 [-0.42497724] [0.40605118]
+5 [-0.38992371] [0.37255873]
+6 [-0.3577615] [0.34182884]
+7 [-0.32825214] [0.31363366]
+8 [-0.30117681] [0.28776411]
+9 [-0.27633474] [0.26402837]
+10 [-0.25354173] [0.24225043]
+11 [-0.23262877] [0.22226881]
+12 [-0.21344077] [0.20393534]
+13 [-0.19583547] [0.18711407]
+14 [-0.17968231] [0.17168028]
+15 [-0.16486151] [0.15751952]
+16 [-0.15126318] [0.14452678]
+17 [-0.13878649] [0.13260573]
+18 [-0.12733892] [0.12166797]
+19 [-0.11683558] [0.11163239]
+20 [-0.10719859] [0.10242458]
+21 [-0.0983565] [0.09397626]
+22 [-0.09024373] [0.08622478]
+23 [-0.08280012] [0.07911268]
+24 [-0.07597049] [0.0725872]
+25 [-0.06970419] [0.06659997]
+26 [-0.06395476] [0.06110658]
+27 [-0.05867956] [0.0560663]
+28 [-0.05383947] [0.05144177]
+29 [-0.04939861] [0.04719868]
 theta from own gd
-[[4.11822173]
- [2.90300219]]
-0 [0.03206757] [-0.0263106]
-1 [0.03016341] [-0.02474828]
-2 [0.02780107] [-0.02281004]
-3 [0.02544154] [-0.02087411]
-4 [0.02322297] [-0.01905384]
-5 [0.02117843] [-0.01737634]
-6 [0.0193075] [-0.01584129]
-7 [0.01759974] [-0.01444013]
-8 [0.01604235] [-0.01316233]
-9 [0.01462254] [-0.01199741]
-10 [0.01332832] [-0.01093553]
-11 [0.01214862] [-0.00996762]
-12 [0.01107333] [-0.00908537]
-13 [0.01009321] [-0.00828121]
-14 [0.00919984] [-0.00754823]
-15 [0.00838555] [-0.00688012]
-16 [0.00764333] [-0.00627115]
-17 [0.0069668] [-0.00571608]
-18 [0.00635016] [-0.00521014]
-19 [0.00578809] [-0.00474898]
-20 [0.00527578] [-0.00432864]
-21 [0.00480881] [-0.0039455]
-22 [0.00438318] [-0.00359628]
-23 [0.00399521] [-0.00327797]
-24 [0.00364159] [-0.00298783]
-25 [0.00331927] [-0.00272337]
-26 [0.00302547] [-0.00248232]
-27 [0.00275768] [-0.0022626]
-28 [0.00251359] [-0.00206234]
-29 [0.00229111] [-0.0018798]
+[[3.85703369]
+ [3.13659941]]
+0 [-0.04532405] [0.04330558]
+1 [-0.04158557] [0.03973359]
+2 [-0.03703391] [0.03538463]
+3 [-0.03261373] [0.0311613]
+4 [-0.02859759] [0.02732402]
+5 [-0.02503392] [0.02391906]
+6 [-0.02189994] [0.02092464]
+7 [-0.01915337] [0.01830039]
+8 [-0.01674956] [0.01600363]
+9 [-0.01464686] [0.01399457]
+10 [-0.01280793] [0.01223754]
+11 [-0.01119981] [0.01070103]
+12 [-0.00979357] [0.00935742]
+13 [-0.0085639] [0.00818251]
+14 [-0.00748862] [0.00715512]
+15 [-0.00654835] [0.00625672]
+16 [-0.00572613] [0.00547113]
+17 [-0.00500716] [0.00478417]
+18 [-0.00437846] [0.00418347]
+19 [-0.0038287] [0.00365819]
+20 [-0.00334797] [0.00319887]
+21 [-0.0029276] [0.00279722]
+22 [-0.00256001] [0.002446]
+23 [-0.00223857] [0.00213888]
+24 [-0.0019575] [0.00187032]
+25 [-0.00171171] [0.00163548]
+26 [-0.00149679] [0.00143013]
+27 [-0.00130885] [0.00125057]
+28 [-0.00114451] [0.00109354]
+29 [-0.00100081] [0.00095624]
 theta from own gd wth momentum
-[[4.0076989 ]
- [2.99368326]]
+[[3.99723951]
+ [3.00263755]]
 
@@ -2649,18 +2650,18 @@ theta from own gd wth momentum
Own inversion
-[[3.4870934 ]
- [3.55042779]]
-Eigenvalues of Hessian Matrix:[0.28793787 4.56453869]
+[[3.95935439]
+ [3.09360113]]
+Eigenvalues of Hessian Matrix:[0.32606139 4.1033455 ]
 theta from own gd
-[[3.4870934 ]
- [3.55042779]]
+[[3.95935439]
+ [3.09360113]]
 
_images/week40_104_1.png
theta from own sdg
-[[3.48900413]
- [3.56763673]]
+[[3.96916206]
+ [3.10276112]]
 
@@ -2742,15 +2743,15 @@ theta from own gd
Own inversion
-[[4.11571507]
- [2.86067818]]
-Eigenvalues of Hessian Matrix:[0.25849623 4.84605507]
+[[4.16532977]
+ [2.86943859]]
+Eigenvalues of Hessian Matrix:[0.29633608 4.22128142]
 theta from own gd
-[[4.10888197]
- [2.86602331]]
+[[4.16445858]
+ [2.87020155]]
 theta from own sdg with momentum
-[[4.15361856]
- [2.92376655]]
+[[4.149433  ]
+ [2.89654756]]
 
@@ -2819,9 +2820,9 @@ theta from own sdg with momentum
theta from own AdaGrad
-[[1.99968451]
- [3.001795  ]
- [3.99848215]]
+[[1.99415296]
+ [3.03274273]
+ [3.96850191]]
 
@@ -2897,9 +2898,9 @@ theta from own sdg with momentum
theta from own RMSprop
-[[1.99887767]
- [3.01261048]
- [3.99294056]]
+[[2.00022969]
+ [2.99954278]
+ [4.00046631]]
 
@@ -2979,9 +2980,9 @@ theta from own sdg with momentum
theta from own ADAM
-[[1.99996755]
- [3.00016535]
- [3.99977375]]
+[[1.99991245]
+ [3.00042721]
+ [3.99954434]]
 
@@ -3102,7 +3103,7 @@ It provides composable transformations of Python+NumPy programs: differentiate, return asarray(x, dtype=self.dtype) -
[<matplotlib.lines.Line2D at 0x117c17be0>]
+
[<matplotlib.lines.Line2D at 0x11975e550>]
 
_images/week40_120_2.png @@ -3137,7 +3138,7 @@ It provides composable transformations of Python+NumPy programs: differentiate,
-
<matplotlib.collections.PathCollection at 0x117893340>
+
<matplotlib.collections.PathCollection at 0x11b160a60>
 
_images/week40_122_1.png diff --git a/doc/LectureNotes/_build/jupyter_execute/week40.ipynb b/doc/LectureNotes/_build/jupyter_execute/week40.ipynb index da3495a20..12f7f93f4 100644 --- a/doc/LectureNotes/_build/jupyter_execute/week40.ipynb +++ b/doc/LectureNotes/_build/jupyter_execute/week40.ipynb @@ -2,8 +2,10 @@ "cells": [ { "cell_type": "markdown", - "id": "54c44098", - "metadata": {}, + "id": "71c0e62a", + "metadata": { + "editable": true + }, "source": [ "\n", @@ -12,8 +14,10 @@ }, { "cell_type": "markdown", - "id": "f64073c9", - "metadata": {}, + "id": "4e0afae4", + "metadata": { + "editable": true + }, "source": [ "# Week 40: Gradient descent methods (continued) and start Neural networks\n", "**Morten Hjorth-Jensen**, Department of Physics, University of Oslo, Norway and Department of Physics and Astronomy and Facility for Rare Ion Beams, Michigan State University, USA\n", @@ -23,29 +27,37 @@ }, { "cell_type": "markdown", - "id": "d2d0f844", - "metadata": {}, + "id": "e6b378ac", + "metadata": { + "editable": true + }, "source": [ "## Plans for week 40" ] }, { "cell_type": "markdown", - "id": "c9630d37", - "metadata": {}, + "id": "1ba91689", + "metadata": { + "editable": true + }, "source": [ "## Lecture Monday September 30, 2024\n", "1. Stochastic Gradient descent with examples and automatic differentiation\n", "\n", "2. If we get time, we start with the basics of Neural Networks, setting up the basic steps, from the simple perceptron model to the multi-layer perceptron model\n", - "\n", - "" + "\n", + "3. [Video of lecture](https://youtu.be/jdJoOrCIdII)\n", + "\n", + "4. Whiteboard notes at " ] }, { "cell_type": "markdown", - "id": "4b447216", - "metadata": {}, + "id": "fb1da492", + "metadata": { + "editable": true + }, "source": [ "## Suggested readings and videos\n", "**Readings and Videos:**\n", @@ -67,8 +79,10 @@ }, { "cell_type": "markdown", - "id": "8fb799c1", - "metadata": {}, + "id": "5e18b164", + "metadata": { + "editable": true + }, "source": [ "## Lab sessions Tuesday and Wednesday\n", "**Material for the active learning sessions on Tuesday and Wednesday.**\n", @@ -84,8 +98,10 @@ }, { "cell_type": "markdown", - "id": "3a202eb3", - "metadata": {}, + "id": "ca1eb3e1", + "metadata": { + "editable": true + }, "source": [ "## Summary from last week, using gradient descent methods, limitations\n", "\n", @@ -104,8 +120,10 @@ }, { "cell_type": "markdown", - "id": "f0b36267", - "metadata": {}, + "id": "d1832283", + "metadata": { + "editable": true + }, "source": [ "## Simple implementation of GD for OLS, Ridge and Lasso\n", "\n", @@ -116,25 +134,28 @@ { "cell_type": "code", "execution_count": 1, - "id": "2d9d73e5", - "metadata": {}, + "id": "0dee3b51", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Parameters for OLS using gradient descent\n", - "[[3.870337 ]\n", - " [3.34871778]\n", - " [4.83363025]]\n", + "[[3.53732988]\n", + " [4.06277313]\n", + " [4.51728978]]\n", "Parameters for Ridge using gradient descent\n", - "[[3.66951679]\n", - " [3.76942272]\n", - " [4.63546236]]\n", + "[[3.62671667]\n", + " [3.79849321]\n", + " [4.63207408]]\n", "Parameters for Lasso using gradient descent\n", - "[[3.65759901]\n", - " [3.87732748]\n", - " [4.58735893]]\n" + "[[4.1547556 ]\n", + " [2.58013829]\n", + " [5.20288581]]\n" ] } ], @@ -186,8 +207,10 @@ }, { "cell_type": "markdown", - "id": "fcf0f686", - "metadata": {}, + "id": "cda18663", + "metadata": { + "editable": true + }, "source": [ "## But none of these can compete with Newton's method\n", "\n", @@ -197,8 +220,11 @@ { "cell_type": "code", "execution_count": 2, - "id": "1550b223", - "metadata": {}, + "id": "e1e51c75", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "name": "stdout", @@ -208,11 +234,11 @@ "[[4.]\n", " [3.]\n", " [5.]]\n", - "0 [-23.78254537] [-30.51512235]\n", - "1 [1.30917499e-14] [-1.01327148e-14]\n", - "2 [9.76996262e-16] [1.28164443e-15]\n", - "3 [-7.28306304e-16] [-8.17359583e-16]\n", - "4 [-7.63833441e-16] [-1.32422234e-15]\n", + "0 [-27.10587277] [-37.81035098]\n", + "1 [1.16209264e-13] [2.08824304e-13]\n", + "2 [8.8817842e-17] [2.62242138e-16]\n", + "3 [-1.77635684e-17] [-1.50600514e-16]\n", + "4 [-3.37507799e-16] [-2.280464e-16]\n", "beta from own Newton code\n", "[[4.]\n", " [3.]\n", @@ -258,8 +284,10 @@ }, { "cell_type": "markdown", - "id": "1777d437", - "metadata": {}, + "id": "8de3d7c1", + "metadata": { + "editable": true + }, "source": [ "## Gradient descent and Logistic regression\n", "\n", @@ -271,8 +299,11 @@ { "cell_type": "code", "execution_count": 3, - "id": "94a3c22b", - "metadata": {}, + "id": "4f87ae26", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "name": "stdout", @@ -318,8 +349,10 @@ }, { "cell_type": "markdown", - "id": "5d9bd47b", - "metadata": {}, + "id": "c2781943", + "metadata": { + "editable": true + }, "source": [ "## Overview video on Stochastic Gradient Descent\n", "\n", @@ -335,8 +368,10 @@ }, { "cell_type": "markdown", - "id": "0107149a", - "metadata": {}, + "id": "1e37491a", + "metadata": { + "editable": true + }, "source": [ "## Batches and mini-batches\n", "\n", @@ -354,8 +389,10 @@ }, { "cell_type": "markdown", - "id": "acb322f8", - "metadata": {}, + "id": "6feab258", + "metadata": { + "editable": true + }, "source": [ "## Stochastic Gradient Descent (SGD)\n", "\n", @@ -384,8 +421,10 @@ }, { "cell_type": "markdown", - "id": "9073ab44", - "metadata": {}, + "id": "204c15af", + "metadata": { + "editable": true + }, "source": [ "## Stochastic Gradient Descent\n", "\n", @@ -399,8 +438,10 @@ }, { "cell_type": "markdown", - "id": "0a457a90", - "metadata": {}, + "id": "c9453416", + "metadata": { + "editable": true + }, "source": [ "$$\n", "C(\\mathbf{\\beta}) = \\sum_{i=1}^n c_i(\\mathbf{x}_i,\n", @@ -410,8 +451,10 @@ }, { "cell_type": "markdown", - "id": "be758e1d", - "metadata": {}, + "id": "19b0403c", + "metadata": { + "editable": true + }, "source": [ "## Computation of gradients\n", "\n", @@ -421,8 +464,10 @@ }, { "cell_type": "markdown", - "id": "411db876", - "metadata": {}, + "id": "37025507", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\nabla_\\beta C(\\mathbf{\\beta}) = \\sum_i^n \\nabla_\\beta c_i(\\mathbf{x}_i,\n", @@ -432,8 +477,10 @@ }, { "cell_type": "markdown", - "id": "c23bb658", - "metadata": {}, + "id": "cc7aaec1", + "metadata": { + "editable": true + }, "source": [ "Stochasticity/randomness is introduced by only taking the\n", "gradient on a subset of the data called minibatches. If there are $n$\n", @@ -444,8 +491,10 @@ }, { "cell_type": "markdown", - "id": "adea87fe", - "metadata": {}, + "id": "3a3a0d11", + "metadata": { + "editable": true + }, "source": [ "## SGD example\n", "As an example, suppose we have $10$ data points $(\\mathbf{x}_1,\\cdots, \\mathbf{x}_{10})$ \n", @@ -464,8 +513,10 @@ }, { "cell_type": "markdown", - "id": "5e5dee91", - "metadata": {}, + "id": "0acfc986", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\nabla_{\\beta}\n", @@ -477,8 +528,10 @@ }, { "cell_type": "markdown", - "id": "97047a5f", - "metadata": {}, + "id": "8d3f995d", + "metadata": { + "editable": true + }, "source": [ "## The gradient step\n", "\n", @@ -487,8 +540,10 @@ }, { "cell_type": "markdown", - "id": "d9a59d5c", - "metadata": {}, + "id": "8c73ac82", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\beta_{j+1} = \\beta_j - \\gamma_j \\sum_{i \\in B_k}^n \\nabla_\\beta c_i(\\mathbf{x}_i,\n", @@ -498,8 +553,10 @@ }, { "cell_type": "markdown", - "id": "a9b20c1c", - "metadata": {}, + "id": "f88656c1", + "metadata": { + "editable": true + }, "source": [ "where $k$ is picked at random with equal\n", "probability from $[1,n/M]$. An iteration over the number of\n", @@ -510,8 +567,10 @@ }, { "cell_type": "markdown", - "id": "3867a529", - "metadata": {}, + "id": "e80a498f", + "metadata": { + "editable": true + }, "source": [ "## Simple example code" ] @@ -519,8 +578,11 @@ { "cell_type": "code", "execution_count": 4, - "id": "e5f4f9a8", - "metadata": {}, + "id": "626ac884", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "import numpy as np \n", @@ -541,8 +603,10 @@ }, { "cell_type": "markdown", - "id": "786c5900", - "metadata": {}, + "id": "3c9a754d", + "metadata": { + "editable": true + }, "source": [ "Taking the gradient only on a subset of the data has two important\n", "benefits. First, it introduces randomness which decreases the chance\n", @@ -555,8 +619,10 @@ }, { "cell_type": "markdown", - "id": "5f510fcf", - "metadata": {}, + "id": "2790ab60", + "metadata": { + "editable": true + }, "source": [ "## When do we stop?\n", "\n", @@ -574,8 +640,10 @@ }, { "cell_type": "markdown", - "id": "1f0043c6", - "metadata": {}, + "id": "3ea3ee12", + "metadata": { + "editable": true + }, "source": [ "## Slightly different approach\n", "\n", @@ -592,8 +660,10 @@ }, { "cell_type": "markdown", - "id": "fbc5d941", - "metadata": {}, + "id": "3c39cc08", + "metadata": { + "editable": true + }, "source": [ "## Time decay rate\n", "\n", @@ -609,8 +679,11 @@ { "cell_type": "code", "execution_count": 5, - "id": "f96c423d", - "metadata": {}, + "id": "294edbef", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "name": "stdout", @@ -649,8 +722,10 @@ }, { "cell_type": "markdown", - "id": "cdf1efeb", - "metadata": {}, + "id": "f60f930b", + "metadata": { + "editable": true + }, "source": [ "## Code with a Number of Minibatches which varies\n", "\n", @@ -660,28 +735,31 @@ { "cell_type": "code", "execution_count": 6, - "id": "e221b4f3", - "metadata": {}, + "id": "41a929b5", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Own inversion\n", - "[[4.12220276]\n", - " [2.95115528]]\n", - "Eigenvalues of Hessian Matrix:[0.31601423 3.93074023]\n", + "[[4.30637636]\n", + " [2.56947078]]\n", + "Eigenvalues of Hessian Matrix:[0.30000613 4.12600095]\n", "theta from own gd\n", - "[[4.12220276]\n", - " [2.95115528]]\n", + "[[4.30637636]\n", + " [2.56947078]]\n", "theta from own sdg\n", - "[[4.12206013]\n", - " [2.92370959]]\n" + "[[4.34759233]\n", + " [2.63142731]]\n" ] }, { "data": { - "image/png": "iVBORw0KGgoAAAANSUhEUgAAAkMAAAHFCAYAAADxOP3DAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjguMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy81sbWrAAAACXBIWXMAAA9hAAAPYQGoP6dpAABUm0lEQVR4nO3deXgT1foH8O+0pSlroYVCVyjIVio7CrLLIhAQrIiCIm73qoBQcQNXcOPKTwUUl4vXCy63iEpZLkEEoQUU5IKAyipggQKtZW1LoaVNzu+PkNC0STNJs8xkvp/nyVMyc2ZyJmmYt+e85xxJCCFAREREpFFB/q4AERERkT8xGCIiIiJNYzBEREREmsZgiIiIiDSNwRARERFpGoMhIiIi0jQGQ0RERKRpDIaIiIhI0xgMERERkaYxGCJSoMWLF0OSJOsjJCQE0dHRuOeee3D48GG/1WvmzJmQJMlvr68Gx44dgyRJePvtt/1dFSKSKcTfFSAixxYtWoQ2bdqguLgYP/30E9544w1kZGTg4MGDaNCggb+rR0QUEBgMESlYcnIyunbtCgDo168fjEYjXnnlFaxYsQIPPvign2tH/lRaWmptNSSi6mE3GZGKWAKjv/76y7qtuLgYTz31FDp27Ijw8HBERESgR48eWLlyZaXjJUnC5MmT8cUXX6Bt27aoVasWOnTogNWrV1cqazAY0LFjR+h0OiQmJjrs9ikuLsaMGTOQmJiI0NBQxMbGYtKkSbh48aJNuWbNmmH48OFYvXo1OnXqhJo1a6Jt27bW1168eDHatm2L2rVr46abbsLOnTudvh+W7sSMjAw8/vjjaNiwISIjI5GSkoLTp09XuvaZM2dWOkezZs3wwAMPVDrnxo0b8be//Q2RkZGoV68e7r//fhQVFSE3NxdjxoxB/fr1ER0djaeffhqlpaWVzmsymfDGG28gISEBYWFh6Nq1KzZs2FCp3OHDhzFu3DhERUVBp9Ohbdu2+OCDD2zKZGZmQpIkfPHFF3jqqacQGxsLnU6HI0eO4PLly3j66aeRmJiIsLAwREREoGvXrliyZInT94+IzPgnBZGKZGVlAQBatWpl3VZSUoLz58/j6aefRmxsLK5evYoffvgBKSkpWLRoEe6//36bcxgMBuzYsQOvvvoq6tSpgzlz5uCOO+7AoUOH0Lx5cwDAhg0bMHLkSPTo0QNfffUVjEYj5syZYxOEAYAQAqNGjcKGDRswY8YM9O7dG7/99hteeeUVbNu2Ddu2bYNOp7OW//XXXzFjxgy88MILCA8Px6xZs5CSkoIZM2Zgw4YNePPNNyFJEp577jkMHz4cWVlZqFmzptP35ZFHHoFer0daWhqys7PxzDPP4L777sPGjRvdfq8feeQRpKSk4KuvvsLu3bvx/PPPo6ysDIcOHUJKSgr+/ve/44cffsBbb72FmJgYTJs2zeb4BQsWoGnTppg3bx5MJhPmzJmDoUOHYtOmTejRowcAYP/+/bjllluQkJCAd955B02aNMH333+PKVOm4OzZs3jllVdszjljxgz06NEDH3/8MYKCghAVFYVp06bhiy++wOuvv45OnTqhqKgIe/fuxblz59y+diLNEUSkOIsWLRIAxM8//yxKS0tFYWGhWLt2rWjSpIno06ePKC0tdXhsWVmZKC0tFQ8//LDo1KmTzT4AonHjxqKgoMC6LTc3VwQFBYnZs2dbt918880iJiZGXLlyxbqtoKBAREREiPL/baxdu1YAEHPmzLF5naVLlwoAYuHChdZtTZs2FTVr1hQnT560btuzZ48AIKKjo0VRUZF1+4oVKwQAsWrVKlnv08SJE222z5kzRwAQOTk5Ntf+yiuvVDpH06ZNxYQJEyqd84knnrApN2rUKAFAvPvuuzbbO3bsKDp37mx9npWVJQA4fP8GDhxo3XbbbbeJuLg4kZ+fb3POyZMni7CwMHH+/HkhhBAZGRkCgOjTp0+l+icnJ4tRo0ZV2k5E8rGbjEjBunfvjho1aqBu3boYMmQIGjRogJUrV1bKE/nmm2/Qs2dP1KlTByEhIahRowY+/fRTHDhwoNI5+/fvj7p161qfN27cGFFRUTh+/DgAoKioCDt27EBKSgrCwsKs5erWrYsRI0bYnMvS8lK+mwkA7rrrLtSuXbtSt1DHjh0RGxtrfd62bVsA5nyoWrVqVdpuqZMzt99+u83z9u3bu3S8PcOHD7d5bqmTXq+vtN3e6zh6/zZv3gyj0Yji4mJs2LABd9xxB2rVqoWysjLrY9iwYSguLsbPP/9sc84777yz0uvcdNNN+O677zB9+nRkZmbiypUrbl8zkVYxGCJSsM8//xw7duzAxo0b8eijj+LAgQMYO3asTZn09HSMGTMGsbGx+PLLL7Ft2zbs2LEDDz30EIqLiyudMzIystI2nU5nvYleuHABJpMJTZo0qVSu4rZz584hJCQEjRo1stkuSRKaNGlSqasmIiLC5nloaGiV2+3V356K12TpmqtOYOBKXe3V09H7d/XqVVy6dAnnzp1DWVkZ3n//fdSoUcPmMWzYMADA2bNnbY6Pjo6udM733nsPzz33HFasWIH+/fsjIiICo0aN8usUDERqw5whIgVr27atNWm6f//+MBqN+Ne//oVvv/0Wo0ePBgB8+eWXSExMxNKlS23mACopKXHrNRs0aABJkpCbm1tpX8VtkZGRKCsrw5kzZ2wCIiEEcnNz0a1bN7fq4A06nc7ue+Kt3BpH719oaCjq1KmDGjVqIDg4GOPHj8ekSZPsniMxMdHmub05nmrXro1Zs2Zh1qxZ+Ouvv6ytRCNGjMDBgwc9czFEAY4tQ0QqMmfOHDRo0AAvv/wyTCYTAPMNMjQ01OZGmZuba3c0mRyW0Vzp6ek2LR6FhYX473//a1N2wIABAMwBWXnLli1DUVGRdb8SNGvWDL/99pvNto0bN+LSpUteeT1H71/v3r0RHByMWrVqoX///ti9ezfat2+Prl27VnrYa8WrSuPGjfHAAw9g7NixOHToEC5fvuzpyyIKSGwZIlKRBg0aYMaMGXj22WeRlpaG++67D8OHD0d6ejomTpyI0aNHIzs7G6+99hqio6Pd7ip57bXXMGTIEAwaNAhPPfUUjEYj3nrrLdSuXRvnz5+3lhs0aBBuu+02PPfccygoKEDPnj2to8k6deqE8ePHe+rSq238+PF46aWX8PLLL6Nv377Yv38/FixYgPDwcK+8XnBwMAYNGoRp06bBZDLhrbfeQkFBAWbNmmUtM3/+fPTq1Qu9e/fG448/jmbNmqGwsBBHjhzBf//7X1mj4W6++WYMHz4c7du3R4MGDXDgwAF88cUX6NGjh00eFhE5xmCISGWeeOIJLFiwAK+++irGjh2LBx98EHl5efj444/x73//G82bN8f06dNx8uRJmxuvKwYNGoQVK1bgxRdfxN13340mTZpg4sSJuHLlis05JUnCihUrMHPmTCxatAhvvPEGGjZsiPHjx+PNN9+0GVbvb8888wwKCgqwePFivP3227jpppvw9ddfY+TIkV55vcmTJ6O4uBhTpkxBXl4e2rVrB4PBgJ49e1rLJCUlYdeuXXjttdfw4osvIi8vD/Xr10fLli2teUPO3HrrrVi1ahXmzp2Ly5cvIzY2Fvfffz9eeOEFr1wXUSCShBDC35UgIiIi8hfmDBEREZGmMRgiIiIiTWMwRERERJrGYIiIiIg0jcEQERERaRqDISIiItI0TcwzZDKZcPr0adStW9fudPZERESkPEIIFBYWIiYmBkFB3mu/0UQwdPr0acTHx/u7GkREROSG7OxsxMXFee38mgiG6tatC8D8ZtarV8/PtSEiIiI5CgoKEB8fb72Pe4smgiFL11i9evUYDBEREamMt1NcmEBNREREmsZgiIiIiDSNwRARERFpGoMhIiIi0jQGQ0RERKRpDIaIiIhI0xgMERERkaYxGCIiIiJNYzBEREREmsZgiIiIiDSNwRARERFpGoMhIiIi0jQGQ0RERKRpDIaIiIhI0xgMERERkaYxGCIiIiJNYzBEREREmub3YGjz5s0YMWIEYmJiIEkSVqxY4bDso48+CkmSMG/ePJ/Vj4iIiAKb34OhoqIidOjQAQsWLKiy3IoVK7B9+3bExMT4qGZERESkBSH+rsDQoUMxdOjQKsucOnUKkydPxvfffw+9Xu+jmhEREZEW+L1lyBmTyYTx48fjmWeeQbt27fxdHSIiIgowfm8Zcuatt95CSEgIpkyZIvuYkpISlJSUWJ8XFBR4o2pEREQUABTdMvTLL79g/vz5WLx4MSRJkn3c7NmzER4ebn3Ex8d7sZZERESkZooOhrZs2YK8vDwkJCQgJCQEISEhOH78OJ566ik0a9bM4XEzZsxAfn6+9ZGdne27ShMREZGqKLqbbPz48Rg4cKDNtttuuw3jx4/Hgw8+6PA4nU4HnU7n7eoRERFRAPB7MHTp0iUcOXLE+jwrKwt79uxBREQEEhISEBkZaVO+Ro0aaNKkCVq3bu3rqhIREVEA8nswtHPnTvTv39/6fNq0aQCACRMmYPHixX6qFREREWmF34Ohfv36QQghu/yxY8e8VxkiIiLSHEUnUBMRERF5G4MhIiIi0jQGQ0RERKRpDIaIiIhI0xgMERERkaYxGCIiIiJNYzBEREREmsZgiIiIiDSNwRARERFpGoMhIiIi0jQGQ0RERKRpDIaIiIhI0xgMERERkaYxGCIiIiJNYzBEREREmsZgiIiIiDSNwRARERFpGoMhIiIi0jQGQ0RERKRpDIaIiIhI0xgMERERkaYxGCIiIiJNYzBEREREmsZgiIiIiDSNwRARERFpGoMhIiIi0jQGQ0RERKRpDIaIiIhI0xgMERERkaYxGCIiIiJNYzBEREREmsZgiIiIiDSNwRARERFpGoMhIiIi0jQGQ0RERKRpDIaIiIhI0xgMERERkaYxGCIiIiJNYzBEREREmub3YGjz5s0YMWIEYmJiIEkSVqxYYd1XWlqK5557DjfeeCNq166NmJgY3H///Th9+rT/KkxEREQBxe/BUFFRETp06IAFCxZU2nf58mXs2rULL730Enbt2oX09HT88ccfuP322/1QUyIiIgpEkhBC+LsSFpIkYfny5Rg1apTDMjt27MBNN92E48ePIyEhQdZ5CwoKEB4ejvz8fNSrV89DtSUiIiJv8tX9O8RrZ/aS/Px8SJKE+vXrOyxTUlKCkpIS6/OCggIf1IyIiIjUyO/dZK4oLi7G9OnTMW7cuCojxNmzZyM8PNz6iI+P92EtiYiISE1UEwyVlpbinnvugclkwocfflhl2RkzZiA/P9/6yM7O9lEtiYiISG1U0U1WWlqKMWPGICsrCxs3bnTab6jT6aDT6XxUOyIiIlIzxQdDlkDo8OHDyMjIQGRkpL+rRERERAHE78HQpUuXcOTIEevzrKws7NmzBxEREYiJicHo0aOxa9curF69GkajEbm5uQCAiIgIhIaG+qvaREREFCD8PrQ+MzMT/fv3r7R9woQJmDlzJhITE+0el5GRgX79+sl6DQ6tJyIiUh/NDK3v168fqorHFDQNEhEREQUg1YwmIyIiIvIGBkNERESkaQyGiIiISNMYDBEREZGmMRgiIiIiTWMwRERERJrGYIiIiIg0jcEQERERaRqDISIiItI0BkNERESkaQyGiIiISNMYDBEREZGmMRgiIiIiTWMwRERERJrGYIiIiIg0jcEQERERaVqIvytARERECmQ0Alu2ADk5QHQ00Ls3EBzs71p5BYMhIiIispWeDkydCpw8eX1bXBwwfz6QkuK/enkJu8mIiIjouvR0YPRo20AIAE6dMm9PT/dPvbyIwRARERGZGY3mFiEhKu+zbEtNNZcLIAyGiIiIyGzLlsotQuUJAWRnm8sFEAZDREREZJaT49lyKsFgiIiIiMyioz1bTiUYDBEREZFZ797mUWOSZH+/JAHx8eZyAYTBEBEREZkFB5uHzwOVAyLL83nzAm6+IQZDREREdF1KCvDtt0BsrO32uDjz9gCcZ4iTLhIREZGtlBRg5EjOQE1EREQaFhwM9Ovn71r4BLvJiIiISNMYDBEREZGmMRgiIiIiTWMwRERERJrGYIiIiIg0jcEQERERaRqH1hMREamN0ejdOYC8fX6FYTBERESkJunpwNSpwMmT17fFxZmX0fDE7NDePr8CsZuMiIhILdLTgdGjbQMVADh1yrw9PV3Z51coSQgh/F0JbysoKEB4eDjy8/NRr149f1eHiIjIdUYj0KxZ5UDFQpLMLThZWe51abl7fi92qfnq/u33lqHNmzdjxIgRiImJgSRJWLFihc1+IQRmzpyJmJgY1KxZE/369cO+ffv8U1kiIqoeoxHIzASWLDH/NBr9XSP12LLFcaACAEIA2dnmcr46f3q6OYDq3x8YN878s1kz1bUg+T0YKioqQocOHbBgwQK7++fMmYN3330XCxYswI4dO9CkSRMMGjQIhYWFPq4pERFVS4DcOP0mJ8ez5ap7/gDqUvN7AvXQoUMxdOhQu/uEEJg3bx5eeOEFpFxL2vrss8/QuHFjpKWl4dFHH/VlVYmIyF2WG2fFzAzLjfPbbzW1SrpboqM9W6465zcazUnW9jJthDB3qaWmmj9TNz9DU5kJOz/f79axrvJ7y1BVsrKykJubi8GDB1u36XQ69O3bF1u3bnV4XElJCQoKCmweRERUga+6rJzdOAHg739nq5EzvXubc3Ykyf5+SQLi483lvH1+L3XZXTyej6+f3IoJLX5Ek9BzGPBEkkvHu0vRwVBubi4AoHHjxjbbGzdubN1nz+zZsxEeHm59xMfHe7WeRESq48suKzk3znPnAqK7xauCg83D24HKAYvl+bx57remuXJ+D3XZCZPA/lVH8H/6TPSrvwcNm9XG3fNuwed/9sIZ0Qh1ke/aNbhJ0cGQhVThQxFCVNpW3owZM5Cfn299ZGdne7uKRETq4etcD3dzWCytRqmpTLS2SEkxdynGxtpuj4szb6/uPEByz1+NLrsr56/gu1d3YHL7TWiuO4l2I2/As2v6YVN+RxgRgjahR/FUl0xkzN2DrJxa1bsemfyeM1SVJk2aADC3EEWXe0Pz8vIqtRaVp9PpoNPpvF4/IiLV8UGuRyXu5rBY6mTpbunXzzP1UYLqDEdPSfFufpWc81u61E6dsv+7ZBmGf63LLnv7aRjmH4FhQxg25CXjCrpZi+pQjH6Re6HvVwT95EQ079cCQAsA8Fmai6KDocTERDRp0gTr169Hp06dAABXr17Fpk2b8NZbb/m5dkREKuRKroengg9nN0453G1dUiJPzPAcHOzd4NDZ+S1daqNHmwOf8p+rJEEAODgkFZ/32gLDnhj8XtwKQIy1SGxQDvStDkOfosOAqcmoHdXVW1cii9+DoUuXLuHIkSPW51lZWdizZw8iIiKQkJCA1NRUvPnmm2jZsiVatmyJN998E7Vq1cK4ceP8WGsiIpXy9vBse6q6ccpVndYlJZEzqk4tS15YutQqBHZngxrhKeMcfP7JBOu2IBjRve4+6Lufh/6RaLQf3QpSkHI+U78HQzt37kT//v2tz6dNmwYAmDBhAhYvXoxnn30WV65cwcSJE3HhwgXcfPPNWLduHerWreuvKhMRqZe3h2c74uDGibg44MoV4Px5Wd0tquaPLkovEiaB303JWNN2MU6dO4bzV8JwCrHYYuwNE4LRQLqAIQn7oR8GDHmyLSJbtvd3lR3ichxERFpiWXLBWa6Hu0s6yHn9irkoK1eaW0WASt0tANTVWlKVzEzzqD1nMjJ8nx8lM4fp8tnL2DB/LwzLirHmjxbINtomWifrDmN4p1PQj49A94eSEBJWvTYXX92//d4yREREPuQk1wNA9YZny3n9ijf6qlqN5s0LjEAI8E8XpRxOcpiyNmfD8P6fMGTWQsbZG1GCm6zFauIybo3aC/2txdBPaYGEHi0BtPRt/T2ALUNERFpk7wYYH+/f4MOLC34qghJbhhzkMAlIAASmhnyA98sm2uxrGnwS+rZHoR9dC/2fSEbNiJpeq56v7t8MhoiItCrQgw+l8XcXpaP6OBhdaIKEk4jDDTiMHuEHoL/lIvSPxiFpRAtIQY7n+vMkdpMREZF3eXt4tjsCOUDzdxdlOcIkcPjlL9GqimkWgiCQgGycS1uPumOHe71O/qSKGaiJiEgDtLCqvbdnkK5C4elCLH/uZzzSegtia/yFV94MlXVcXRR6rU5KwZYhIiLyrapGlAXC/DvOeHsG6XKObDiO1QuOwbC5DjafT8ZVdLfuu4j68k4SKHM8VYE5Q0RE5DuORi5duWJerNUeX+fSqNjVS1ex5aO9MHxVAMPvTfFHaaLN/hYhx6Fvdwz6u+ug72NtoWvfWjk5THYwZ4iIiAKLo9mXq1oeBAjc9ck8JPe3PKyZewiGdTWw/nQSCtHZui8EpejT4HfoexdA/1gCWt2WCCmo6fWDFZLD5G8MhoiIyPuqmn1ZrkBan6waTGUm7PziAAyLz8CwMwq/XE4CEGXdHyWdwbAWB6G/PQSDpiYhPKGz45P5c44nBSXLMxgiIiLvc7ZArBwayF1xJP9EPtbN2w/DKiO++7M18kQ7m/1da+2Hvlse9A9Gocu9bRAU4sLyJT7MYbLyxGK1HsRgiIiIvK86rTqBtD6ZTMIkcHDNnzB8nA3DT+H48WIyytDDur8uCjA4dh/0g8swNLU1mrRPApDk/gv6cpoFBS5Wy2CIiIi8z91WHQ3lrhRfLMamD/bC8HURDPub4c+yFgBaWPe3Dv0T+htPQD82HL0ebYfQOj0cn0ypFLpYLYMhIiLyvt69za07VY1ciogAwsLMZSwCbX2yCk7uyMGa+Ydh2KDDD7nJuIyu1n2hKEG/yN+h71sE/aRmaHFrcwDNPVsBX+ftOOsu9VOyPIMhIiLyPjmzLy9c6PvcFR8zXjVi+6L9MHx+DoZd0fi1uDWA661mMUE5GNbyMIan6DBgSjvUadLV8cmqyx95OwpdrJbBEBER+YbckUsBNnz+/NELWPfuXhxdtgfH/9LhD7TCFvSGCcGQYMLNdfZBf/M56B9ugo53t4YU5INEcVfydjzZeiS3u9THyfKcdJGIiHzLEzdXBQ3LrkiYBPatPALDwlNYvbUBGhccxlw8iXhcDwDPBTfC77dORbv5j6JR24a+raCTBVptJltcudKzrUdyFquNjQUWLwby8lBQrx7Chw/nqvWewGCIiCiAKGxYNgBcPnsZGQv2wfDtFRgONscJYxwA4A6k41uMBiBsFwO1dA36Y5mRzEzzum/OzJoFzJxZOWipbt0trVJA5e5SIYDISOts5AUAwgEGQ57AYIiIKEA46t7xQ3Bx/KeTMLx/FIaNtbDxTDKKUdO6LwxXMLDhr1hSdDtqXzkDyd4J/LXcxZIl5oVwnYmIAM6ft7+vunW3F9CWC4IsGAx5EIMhIqIA4Er3jheCi7LiMmz9ZB8MX16A4ddY7CtpabM/PvgU9K2PQn9nGG6dkoxae/8nrwUmI8O3eVJyW4bkqE7dy3d1RkUBEybYjiSE74IhJlATEZE6+GFY9tlD5/Dd3AMwrAnC9yeTcFF0sO4LghG31NsLfY8L0P8tBsl3tIQUFHv9YIWOnJI9zYGjhXPLq07dy0/0mJlZKRDyJQZDRESkDj4ILoRJ4Ndv/sDqT3Jg2B6J7ZfaQaCXdX+EdB5Dmx6AfriE21LbIqJFB8cnU+jIKVnTHEyZArzyivNzearufl53jsEQEQUGBY8uIg/xUnBxKfcSNry3D4blJVjzR0ucMrUG0Nq6v0PYIeg750B/fyRufjAJwaE95Z1YTguMv5YZcTbNwciRwCef+K7ufl53jjlDRKR+ChxdRF4gZ1i2zJyhoxuPw/DBMRg21UbmuRtxFTrrvloowsAme6EfUIJhU1sirlu5G7WrQXdVI6cA/4wmK6+q6/Fl3R18tr7KGYLQgPz8fAFA5Ofn+7sqRORpy5YJIUlCmP8Lvf6QJPNj2TJ/15A8yfJ5V/zMnXzeJYUlYsPbu8S0LhmidejRSr8uiSHHxeQbM8V3r+0QVy5ccfzacXG2B8bFOf8ds3dcfLw6fjd9WXc7n20+4JP7N1uGiEi9/Dy6iPzEXktgfHylNcz+2nsGa949CMO6EKw71Q6FuP7/fwhK0av+Xuh75kP/WDzaDGsOKcjuAPjrr1mdIf1q7sb1Vt3tnbfCJI8cWu9BDIaIApTcIcK+HrpM7pN747VTziQk7Eo7CMOiPBh2NMKOonY2hzSSzmBY80PQ3x6MwalJCE8Il18nBt2eVVXXdrn16Xw1AzUTqIlIvZQ6dJnc40ru17Vh2QUnC7B+/j4Y/r4Va462xl+mJABJ1mJdau2Hvmse9A80QtfxbREU0gsuU+hK66rlyrpoBQU+qRKDISJSL6UOXSbXybxBCpPAH99nwfDxCRi21MOWC8koRQ9r8TooxKDofRh+WymGTm2F6I62wZFbGHR7jtFoDnjtdUoJYW5lS001tw75sJWNwRARqZeShy6TfE5ukEKSUPzQRMyYVR+r97fA0bLmAJpbi7SskQV98gno76mL3o+1g65ed8/Wj0G35yi0lY3BEBGpl5zJ4+bNYx6H0jm5QUpCoGb+X9jzWxCOoilq4Cr6RvwOfZ9L0E9sipaDEgEkeq9+DLo9R6GtbAyGiEjdnE0e52weFDWP8gkUMm9845pkYOr9YRg4tR3qxnTxcqXKCcSg21+/9wptZeNoMiIKDO78587JGv3q4vF8fP/uPhz95hc8nzPF+QH+HhUoc0i/4vnz997FiTN9df9mMERE2lTdeWPIZcIksP+/R2H450kYttbHT/nJMCIEQTDiGJohFqcQBJkzS/urZUPtLYlK+L13YWZrBkMexGCIiGx4ct6YasyLo6qbqJuunL+CjPf3wvDtZRgOtMBxY5zN/rahR6Fvn40JN/6CdoufgQQ4X/qBLXruUdJ8STJb2Xx2//bq/NYKweU4iMhGRkbl5TvsPTIyqj6P3OUZ3F3GQaWObz0pPhq7SeijtouaKLK5bB2uiCEN/yfeH50p/tx0wvZAOUs/cPkV93nq995TysrMr5WWZv5ZVlapiK/u30ygJiLt8cSIFrkTx7kywZwveKGFqqy4DD//ez8MX5yHYU8Mfi9uBSDWuj8u+DT0rY5Af2cYbn2iHWpHdbN/opQUm9mHK9VPoXPUqIbSRnJdmzhTCRgMEZH2VHdEi9yb8vDhyrp5e7B76dzh81g79wAMa4C1J5JwQbS37guCET3q7oO+x3no/xaDG1NaQgqKkXfiqm6QCp2jRjUUOpJLCRgMEZH2VHfeGLk35Q8/VM7Nu5otVMIk8Nu3f8DwrxwYfo7Az4XtYEJP6/4G0gUMSdgP/TBgyJNtEdmyvcNzuc1bLRtayefifEkOBfm7As6UlZXhxRdfRGJiImrWrInmzZvj1Vdfhclk8nfViJTDaDQvWrpkifmn0ejvGimbZd4Y4HqCroWceWPk3myPHpVXztvdEs5asgBzC1WF35uivCKsemE7Hm27GQmhOeh4d2u8sL4ftha2hwnBuDHsD0zvnoktH/yGvMt1kXasJ+79sCciW0Z45zq80bKRnm5OKu7fHxg3zvyzWTPz9kBT3d/7QObVjCQPeP3110VkZKRYvXq1yMrKEt98842oU6eOmDdvnuxzMIGaAprGknM9Sk7Crj1yE1HnzlVGwqoLibN/bjoh3h+dKYY0/J/Q4YrN7pooEsOjtouPxm4Sx7eetH0NGcmw1VZWZv687CVQW5Ko4+Plv7ZWk7Hd/b33A1/dvxU/tH748OFo3LgxPv30U+u2O++8E7Vq1cIXX3wh6xwcWk8BSwlzhiiNq10e7nSRyJ047sgRoEUL2RPMec2SJeZWDyeeDp6Ld4ypNtuahWRD3/ZP6EfXQr/JyagZUbPygb4c6u7CHDVVUtIwc39QSdcgh9ZfM3v2bNG0aVNx6NAhIYQQe/bsEVFRUSItLU32OdgyRAHJ8leyo7/yXf0rORDY+4u3YUMhUlM931phaVWo2LJQsVVBbjlvktky1BcZIhilok/4bvHW0Ayxb+VhYTKaqj63P1pXPNGyobRh5mSXr+7fig+GTCaTmD59upAkSYSEhAhJksSbb75Z5THFxcUiPz/f+sjOzmYwRIGH/5nbcnRT9mb3odybsp+7JYzFV0VJRGNhcvC+GCGJs8FRYunkzeL8nxfkn9ifAXl1u+XS0uR9f1z4w5s8j/MMXbN06VJ8+eWXSEtLQ7t27bBnzx6kpqYiJiYGEyZMsHvM7NmzMWvWLB/XlMjHlDZniD9VlSBcnqfn9nE2L46r5Tyo8HQh1s/bB8OKUqw52go9TB/iW4yGAGyWvBCQIElA5NcfYUyKi6OI/DnUvbpz1HCYOZWj+Jyh+Ph4TJ8+HZMmTbJue/311/Hll1/i4MGDdo8pKSlBSUmJ9XlBQQHi4+OZM0SBJTPTPPLFGX8vbukLct8LQF25IC7mdRxefwyGD4/DsLkONp2/EaUIte6rjUt4qf4CTLr6LupcPnP9oOosNCozFwlpacDYsa6f35tcXDCU/MNXOUOKbxm6fPkygoJsZwAIDg6ucmi9TqeDTqfzdtWI/ItzhlznSuuXN1srPElGUvLVS1ex+cO9MHxVCMPeBBwuTQTQzFr8hhrHoG93HPq766DPxGTo6k0HjM94roVKza0rlmHmo0ebvyv2krG1OsxcgxQfDI0YMQJvvPEGEhIS0K5dO+zevRvvvvsuHnroIX9Xjci/vPmfuUpGmli5c7NVcvdhFRMkitGjsaHvq/jw0ECsz2mHS+hs3R2CUvRp8DuG9ymA/vGmaHWbbXAEwLNLIKg9IE9JMXeZ2gs63W0tI1VSfDdZYWEhXnrpJSxfvhx5eXmIiYnB2LFj8fLLLyM0NNT5CcCh9RTgZK7+XK3zKX1FcGddHvYotfvQyZBvEyScRBwSkQUTgtE4KA/DWhyCfmQIBk1th3pxPv4/zlND3f1JbcG/hvjq/q34YMgTGAxRwPPUf+ZqnrfIUd0rqioXxPI+njoFnDkDNGoExMb69uYoM/9pcYe5SJ42GJ3HtUFQiJ8XE/B0QE50DYMhD2IwRCRDIExCZ++mXF5VQV1Vx3q5ZUyYBA6u+ROGj7NxJWMbXrr8vPODlJaUzNYV8gIGQx7EYIhIhkAZnWa5Ka9cCfznP+YWHgtHrRVyWpUkyaMtY8UXi5G5YC8MXxfBcCARWWUJAIC+yEQmAuBzIPIARY4my87ORnx8vLfqQkT+FCjzFlkShPv1A95+23lrhdw5ioQwL2Y6cqT5HG60hJzckQPDvMMwbNBhw1/JuIyu1n2hKEG/yN8xvI8JZT9GI+RsrjqTkolUyKVgqE2bNpg2bRqmT5+O2rVre6tOROQPah4m7YickVPOJg4szzIk//x5WUnmxqtGbF+0H6s/OwfD7mj8VtwawPX3LyYoB/pWh6G/Q4cBU9qhTpNrwVH6Ag75JvIhl7rJtm7diieffBLZ2dl444038OCDD3qzbh7DbjIiGbQ6CZ3ciQMtUlPNQY+DJPPCBYux+sANMKwWWHu8Dc6JyOtFYEL3Ovug734O+kei0eGuVpCCJPuv8+yzwLvvmj8Xi+BgYNo0YM4c+fUlUjFF5wx9/vnneOGFF9CwYUPMnTsX/RTeb81giEimQBgm7SpXZq8GzCPMyuchlWMe9h6LRByDCeaAsb50EUPi90M/TGBIahs0bB1p91gbVeUweTh3yaeYZE0uUnQwBABXrlzB7Nmz8c4772Dw4MH4v//7P9xwww2erp9HMBgicoHWhkm7MkdRFYFQeQ/W+AKNO8dh2L0NcMvf2iEkzIWMhEAY1WePGuevIr/z1f3b7ckphBAYPHgw/v73v2PVqlVITk7GU089hcLCQk/Wj4h8LSUFOHbMPFopLc38MysrcG9Ylpm8nRCQsKd+X1mnXPRZMP7xcz/0eaKDa4EQ4Nrip2phaemqeF2WhXPT0/1TL6JrXAqGPv74Yzz88MNo3749wsPDMXDgQPz000+YNGkSPvzwQ+zZswdJSUnYuXOnt+pLRL5gSTweO9b8U00tEO6wLMsQF2d3dw6icSe+RerhSXb3V1KdJPNAGdVnUdVoPcu21FTb3CgiH3Opmyw+Ph7du3e3Prp27VppQdQ333wTaWlp2Lt3r8cr6y52kxF5WIDmfpzZ+xd2P/81Dv10FqfPh+E4EnAasdiC3pAg0Kvub1h1dQjqlpyFBC8lmQfKfE8WgXY95FOKnWfImYcffhgvvfSS2xUi8okAvZn7RADlfgiTwJ6lh2D4NBeG7ZHYfqkdBJ6w7o+UzmFoswP4z/DtuO3JJDRI7Aykf3wtydxLw97VvvhpRYHW0kUByeOr1kdFRWHjxo2ePi2R5wTQzdznqlhNHaNHq2KU06XcS/hh/j4YlpdgzeGWOG1qA6CNdX+HsEPQd87B8AmRuOmBJASH9rI9gbdXOrfkMAXKPEOBOH8VBRwux0HaouaFSP1NxaOcjmw4DsMHx2DYVAebzifjKq5379dCEQY22Qv9gBIMm9oScd1k3pS93bro7VF9vmod1er8VeQRih9aryYMhlwQyN1HKr6ZK4KKcj+uXrqKH/+5D4Yl+TD8noBDV5vb7G8echz6pGPQj6mNvpOSEVY/zE81dcJb30dft45qcf4q8ghF5gxRgAv07iNXhiwzkbOy6uR++CDIzv0tD9/NOwTDuhCsO9UOhehk3ReCUvSuvxf6XvnQP56A1kMSIQU19ejre4Wc5URc5Y+uTm93LRJVE4MhMguAXBCnmMhZPe7mfngpyDaVmfDLfw7CsCgPhh1R2Hk5CUCUdX+UdAbDWhyE/vYQDJqahPCETo5PphXOhrlLku1itJ6UkmI+b6C2PJOqsZuMtNN9pKJuHkVyJ/fDwzlaBScLsG7uPhhWleG7P1vjL1OUzf4utfZD3zUP+gcaoev4tggKcXte2cDE7wCpDLvJyHe00n0UaEOWfc3VUU4eaIUQJoFDa7Ng+OgEDD+GY8vFZJShBwAgCEYMwRoMrr8TrW+uj05vjEZ0lyQASR67ZMWpbncjW0eJ7GIwRNr5DzLQhiz7gyu5H24G2SUFJdj0wV6s/uoSDPub4c+y5gCuJ0C3qpGF6XFfYOz5DxCWnwdcBPA9gH3/Fzj5bfZ4oruRw9yJ7GIwRNr6D5KJnNUnN/fDhSD71M4crHnvMAzrdfghtx2K0MW6OxQl6BuxF/q+l6Cf1Aw35O8GRs8M7Py2ijyV08fWUSK7mDNE2pwHxNdTCATylAWOyMxPeST0M3x69X6bbdFBudC3/AP6O3QYOLUd6jSpY96hlfy28jx9zRzmTirCeYY8iMGQDPwP0nsCfcoCR5wE2SZIOIk4JCILAhJuqr0f+pvPQv9QY3Qa2wZSkFT5nL5KAFZS8OqNa/b2hI5EHsIEavItdh95h9zuDSXdfD1ESEHIvnc64t+aDAEJQeUWNjXBHOh8E/kYFqVsw9An26BR22TnJ/VFfpvSgldvXDOHuRPZYDBE1/E/SM+SO5rKaASmTVPOzbcarpy/goz392LNN4U4e+AcJFMEbsAs/B0LEY9T1nJX60ch5MP38NTYMa69gLfz25Q435a3rtkbEzoSqRS7yYi8RW73hj0q6p48se0UDO8dhWFjGDbmJWMI1mI+piIe14O7SzUbofSe8WgwqGv1gmxv5rcpNR9Jizl9RNf46v7NGcmIvKU6XTVCmB9/+xuwYYP5hqgQZcVl2LLgV0zvnokbww6j6S2xmPhVHxjybsIQrMW3GI042AYUdYrPosHiuYBOZ26NcPembZkeAbgeMFpUd3oEV6YC8CVvXjMRAWAwROQ9npiK4Px5YOBAc8tAenr1z+cqoxHIzETBOwux/vb3MS5hC6JqFaLPEx3w1vZ+2FvSEkEwomfd3zB70AZ8FTkJEgQqpT5bWjQs3YLVYclvi4213d6wIbB0qfstaUqeb8vRNcfFqaL1kEjpmDNE5C3O5nRxhS9zVoxGiE2bceadz1B7/QrULs1HPQCDALRBHIoxH5ukfhiScAB6PXBbaltEtmx/rVsw1/F5PTmTeUoKYDIBEycCZ86Yt505Y869Cg527z1S+nxbzOkj8hrmDBF5U1VTFrj61ZObG+LmyLSivCLsf/x9tFj1LiLKztgtY6mx6T9fIXjc3bY7lywBxo1zfh1pacDYsc7LVcXDa54BYG4OkQIxZ4goEFTVvfHNN+afFfNAHJGTs5Kebr6h9+9vDkz696+yi+3PzBN4f/QmDGm4Ew81/i+6pD+P+g4CIQCQrj2C77/XfF3lyW0xOXxYXjlHnI3SA9zrjmNuDpFmsWWIyBcctdY4ajmqiqOWFRmtJaVDRuDHj/fCkJYPw+/xOHi1BQDzoqfH0AyxOOnaX0jLll1vgXE2GssiLg44dsz9oMLbEy9yQkIixeCki0S+5s2JDx3N6eJossuq2GuBcdJaIgCcG/M4Whr74SI6Xa8WytArfC8ea5OJ+O0yX7+88qvOBwebR7+98krVx5w8Wb28IW8nOjM3h0hzGAwRAfZbAxo1Au6913xj9ObN0HLzzcwExowxjyCzp6pFNJ0MC5cANDTmoQN+w36pHYYmHoL+9iAMTm2H+k07AksOADLSfSqpmBDdsqW846ozIssXic6ckJBIU5gzRGTpXqoYTJw5Y+4acZJ34xHBwcCAAcAnn5iDHhdzVq7s/1PWy/zrb/9D7tVIfHa0F8bMvQX1m4abd1QncCgf2PgiULGM0nOUayVJ5m4trrxORDIxGPKWa/OzYMkS808FTZpH5VTVvVTeyZPmgMnbc/24MJ/MH99nYe6oTAyM2IW3Jh2XdfobkkIR9M3Syr+TzgKMqpQPbHr3BiIjHZf1RKDCRGci8jAmUHuD0hZ6JMdcWTLDy0PbnZ2jpKgMmz/cC8PSSzDsa4ojpc0AXE9+jsPJypMdlhcUZJ6bx6Li76Srydz23o/0dODOO6s+rnzSdXUw0Zko4Pnq/s1gyNO8Mf8JeY/cuXHKq2qUkocD4Zw9f2HNvD+wel0N/JDTDpdQ17qvBq6iT4O9eDRpM+766UmXz233d9Je/eUeK2c0WWQk8Ndfnmu18WbSOxH5HYMhD/JZMKTUhR7JMXcWU63G0HZnAZGpzIQdn+2H4bOzMOxsjF1X2trsbxL0F4a1+AP6UTUwcEoS6sXVcy+gK1+3ir+TFQOMs2eBJ5903gLj7SHvRKQ5HFqvRq4s9MibgTK4s2SGG0PbIUm2w9DLuXg8H+vm7YNhlQnfZbXGGZFs3SfBhG6190N/01noH2qMTve0RlBIY+f1kcve76S9kVR33OG8BUbJa3sREVVBFcHQqVOn8Nxzz+G7777DlStX0KpVK3z66afo0qWLv6tmizcD9bEk444eLW+JDEfJvy4EwqJPXxxYfRSGf56E4af6+DE/GUbcYi1aD/kYHLsf+iFGDE1tjcbJyY7PC3hmDTRnv5NyhporfW0vIiIHFB8MXbhwAT179kT//v3x3XffISoqCkePHkX9+vX9XbXKeDNQJ1cmPrznHvtdnDID3EX3b8SrOS1wrOwGADdYt7cJPQr9jdnQjwtHr8eSUaNWD/n1dzWgs8cTv5POgrKq5klyBfOEiMjDFJ8zNH36dPz000/YUtV6TE74PGeICz2q09Wr5iHtZ886LhMfb//zk5kv0w8Z2IR+0KEY/SL3Qt+vCPrJiWjeL6F6dQccJ29fuWKeyNEXv5NVLUwLVH8AAUdqEmkKF2q9ZtWqVejatSvuuusuREVFoVOnTvjkk0+qPKakpAQFBQU2D5/g/CfqtnVr1YEQ4Hih1N69IWLjIBwMbjdBwinEoE1rgZXPb8e5v4xYe7Yrnvi2r2cCIcAcDBw7Zk5QTksz/zx2DFi40LzfF7+TLsyT5DJHk2OeOuWbOaCIKHAJhdPpdEKn04kZM2aIXbt2iY8//liEhYWJzz77zOExr7zyigBQ6ZGfn++bSi9bJkRcnBDmv43Nj/h483ZSrrQ028/M0SMtzXrIuSPnxX8m/ijGNf1R3I/FwghJGCHZlDcBwgRJmL751jfXUVYmREaGuZ4ZGebnvv6dtFeH6p6vYv3LPyTJfD3VfR0iUpT8/Hyf3L8V300WGhqKrl27YuvWrdZtU6ZMwY4dO7Bt2za7x5SUlKCkpMT6vKCgAPHx8b5dtZ55Deojs6vr6MzP8fXWeBi2RWBbYTuYcP1zvQ9fYF7wU4g0nrl+gC8nAqyqG0nNi49y2D6RJnFo/TXR0dFISkqy2da2bVssW7bM4TE6nQ46nc7bVasaF3pUD0vgeuoU0LChw64yAeA0YtBq5jibAChZdxj6jqegv68BejwyFiE1xskLOuQGzHLLOZrnyNKNpOYJPzlSk4i8SPHBUM+ePXHo0CGbbX/88QeaNm3qpxpRQHEw47IAbLJ/TNeePYH3EYqrGBD1O/S3FmPY5OZo2rMlgAqrtTsLhOUmAsstV415jlSBIzWJyJu82gnnAf/73/9ESEiIeOONN8Thw4fFf/7zH1GrVi3x5Zdfyj6Hr/ocSWWWLTPnmlTIPzFde5Tfdgox4p/xrwrDzP+Jy+cue+V1hSSZH5Y8HrnlhDDn5cjJd8rIuH6Mp/N6vMmSM2Tv/WDOEFHA8tX9W/HBkBBC/Pe//xXJyclCp9OJNm3aiIULF7p0vKqCITXdoNSsrEyUNY6pFPRYHkZI4rzUQKxq/7z487UvhelqqcdeV1YicEmJawnDriZ/20uojotTdpK/JTisGBDZCw6JKCAwgdqDfL5qvbs4h4pXCZPA7iUHYfj3X8jZmoUPix9yfpCnE3LlJgLPnWteD8wZS/1cSTA+f169iwlzpXoiTWECtRJ5c4SYWpNfFT5qrvB0IX6Yvw+GFaVYc6QlckxtAbTFPfBTQq7c8x096tr55M7+fMstQIsW6s0tSklR96g4IlIkBkNyebPVxlnyKwA89hgwfDgQGlq91/IkhbZkHdlwHKsXHINhcx1sPp+Mq+hu3VcblzCwyT7ce2MesF7GyTydkCv3fC1auHa+qpbkKD+54tat6l9MmCM1icjTvNoJpxDV7nN0JZHVHXKTXxs2VE5ehLffExeUFJaIH+b8Ip7snCFa1fizUpWahxwTUzpkiu/f3CmK84uvHVQiRHBw1e93cLC5nCfJTQS25Ay5mjDsbHJFNyaWJCLyF+YMeVC1+hwt6405+mvaE2s7LVkCjBsnr6wk+b/LzBfviRO5v+VhzdxDMKyrgfWnk1CI659rCErRu/5e6HvlQ/94AloPSYQUVGEpCn9O4id3/S531/mqquuSkxcSkYowZ0gptmzxfreCq10x/s7pcPU98UBekanMhJ1fHIBh8RkYdkbhl8tJAKKs+6OkMxjW4iD0t4dg0NQkhCd0qvqE/pzEz7J+l70uxvKJwHLLVVRVN5KvVpYnIlIRBkPO+OKm6ewGVZ4ScjpceU+qkVeUfyIf6+bth2GVEd/92Rp5op3N/q619kPfLQ/6B6PQ5d42CApx4QZ++LC8ct6axE9uIrCnE4bl5hYxIZmINITBkDO+mPm2/A1KLn8uOyD3Wg8fBmbOlD1CTpgEDq3NguGjEzD8GI4tF5NRhh7W/XVRgMGx+6AfXIahqa3RpH0SANulWmQxGq+v5F4Vb7eQyE0E9nTCsLstTkREAYo5Q85Y8mOcdSt4Ij8mPd08auzMGedl/ZnTIec9adgQKCsDLlywf45r71vx7gPY9PEBGL4ugmF/M/xZ1tSmWOvQP6G/8QT0Y8PR69F2CK3jgdF0cvNmZs0CXn65+q+nVAqfFoGIiDlDSuHLboWUFPPw+dhYh4uF2uR0+OtmVtV7ApifOwvornX3jWq4Gd9jqHVzKErQN2Iv9H0vQT+pGW4Y0BxAc8/WX26rWsuWzsuoUcXfmzFjGAQRkaYF+bsCqmDpVoiNtd0eF+f5kV2hocA//2kOMizBVnlCAO+8A6xcaW6d6d/fPBKtf3/z8/R0z9WlKo7eExc1wEXEBOXgkdabsXz6dpzLKcW6c10wNb0vbhjQ1PkJ3KHlRT/T0/37e0NEpEDsJnOFL1tiHKymDgCIjATOnau83R/LKVjek1OnzKPcHLVoOXD4xc9ww6zxlYe+e5Mvuz6VxNEs52pYhoOINMlX3WQMhpTs22+Bu+5y7Rg/3cjFxgxIA26Vf4C/Aw535/BRKwXMDUVE5Cpf3b/ZTeZtRqM5YXfJEvNPo1H+cXIW6qyo/NB7L7t89jIMM3dgYvJmTBm4T/6BShjC7cuuTyVwZW4oIiKNYQK1N1Vn7S5nNy9nvDH03mhE7ofp+C3td2w8EIP38+/DZXQDAPSFSf55lDKEW0uLfvpzkkkiIoVjMOQt1V2Fvro3JQ8l/5YVl2HrJ/tw7L2VGHzkIzRBLpoAGAxgEt7Aa0EvI7hNa+jv0MG0KBZBOacdTxwZEQF8/bV5SgClBBxaWfRTy0njREROMGfIGzyRnyF3Lhx3zu3E2UPnsHbeQaw2SPj+ZBL6i434FqMBCJt+VQEJkACpumtpuctfUwuocX4erSaNE5Gq+ez+7dVlYBXCV6veWsldhT4jw/E5nK1u7mglczdWjDcZTWL3VwfF6wMzRI86vwkJRuspg1AmTiJGmKp6zfKrpztbNd1T7L1OXJznX0cpr+sJy5Zd/x3xwO8NEZG3+er+zQRqb/BEfoZlYkOg8nxDlueRkbbbXUj+vZR7CSuf346/t92M+Bq56HRPa7z4Qz9su3QjBILQIewQnr8lE78++RlicRoOB75XTLxNSQGOHTPPkJ2WZv6ZleXZFiFLC1TFljdLF6S35szx1+t6itaSxomIZGI3mSvkdo/I7eKSs6SGvSTs+HhzArKLyb9HNx6H4YNjMGyqjcxzN+IqdNZ9tVCEAY33Qj+gBMOm3ID4m2PMO5YsMU/O50xaGjB2rPNy1eWvIeKBNDRdjd18RKRJXI5DaVwZGeZsFfryS2o442zEUxXBVOnlUvz48V6sTsuH4fcEHLraHMD1WZ0TQ05A3zYL+jG10W9yMsLq31z5JEpLvHVliLgnE6P99breoJWkcSIimRgMyeHqyDBPr2fmws3rr71n8N28QzCsDca6U0koQCfrvhCUolf9vdD3zIf+sXi0GdYcUlBC1Sf0ZGDnCf4aIs6h6UREAYvBkDNGo7lFyF4gIIQ5GEhNNbfelA9uLPkZ9lqTPDjHjqnMhF1pB2FYlAfDjkbYUdQOQCPr/kbSGQxrfgj624MxODUJ4QmdHJ/MHl8uVCuHt1uqHHUhKa2FjIiIPIY5Q85UN//HC/kZBScLsH7+PhhWluG7o62Qa2pss79zzQPQd/0L+gkN0W1CEoJCPJAnX1Xuki8Tb705RLyqrtCRIzk0nYjIx5gzpBTV7R7xUH7GH99nYfWHx2HYUg9bLiSjFD2s++qgEIOi90E/uBTDUlshumNbAG2r/Zo2lDJbs7daquR0hSqphYyIiDyGwZAznu4ekdlSVFJQgk0f7IVh6SWs2d8UR0oTASRa97eskQV98gno76mL3o+1g65ed3mvXx1KSbz1dBek3K7QrCyfdH0SEZFvsZvMGU92yzgZkXZ6Vy7WzD8Mw/oaWJ+TjCLUsRargavoG/E79H0uQT+xKVoOaubadTijxuHWnqqzq12hcl9Xje8pEZGCsJtMKTzVLeOgG0acPAXceSeeCZ2Pd65OAdDEui86KBfDbjgM/agaGDi1HerGdPHMNdmrm7sLyvqTp1qqXO0KlfO6an1PiYg0SLstQ67+1V6dBGInE/aZIOEk4tAcR9Gl9iEMv/ks9A81Rse7W3sm+bkqjnJlvLWemBJ5cpJMgO8pEZGH+KplSJvBkLt/tbvR7SFMAsfeTEPiS/c5reeFfy9HgwdHybwqDwikWZWrw5NdoXxPiYg8xlfBkPbWJqvO+lKW7pGxY80/HdzMrpy/gu9e3YHJ7Tehue4knn9J3tvcIOyKvGvwFFdmVQ5kctaBkztSjO8pEZHqaCtnyN0JFGXI3n4ahvlHYNgQhg15ybiCbtZ9LRFZxZHl+HrCvupMGxBoycGeGqHGmaqJiFRHW8HQ1q0eW1+qrLgMP/97PwxfnIdhTwx+L24FIMa6Py74NPStjkB/ZxhundgduElBS1pYuDttQKAmB3tiLiXOVE1EpDraCoZyc+WVc/BX+7nD57F27gEY1gBrTyThgmhv3RcEI7rX3Qd99/PQPxKN9qNbQQq6HhwpcsI+d9Ydc3WdNrWp7gg1pa3lRkRETmkrGGrSxHkZwPpXuzAJ/J5+GIZPTmP1tgj8XNgOJvS0FmsgXcCQhP3QDwOGPNkWkS3bOzqjz9Yqc4mr0wZ4sZsxYChtLTciInJKW6PJzp9Hvfbtq/yr3RQdC8MDX8OwvBSGP27ASWOMTZEbw/6AvuNp6MdHoPtDSQgJczGeVGKujdxpAzw9BD2QKWUtNyIiFePQeg+yeTN/+MH8VztgExBZ/jUW/0EuYhCNHOQgGjvRBf2jDkA/oBjDnmiBhB6xvr8AX5ATpC1ZAowb5/xcaWnmEXdap8TAl4hIRTgDtbekpKDsP1+h7PEpCMv/y7o5G/FYgnvwf3gO8bj+17wpJhZB778X+H/Ny8mVYXKwa5SylhsREVVJUy1DH92/Fhs31sO6k0koRB30xhZEIwd5iELPmrsw68qzAACbmWY4a/B1npyc0N3XZ0sLEZFmcNJFB2bPng1JkpCamurysY9/3gPfnOyBfIQjQrqAhOYhGDWlKb493BGvRr4HCRUCIeD6TT811Xwz1jJPTk7oqvR0cyDWv7+5q65/f/PzqibJJCIikkFVwdCOHTuwcOFCtG9fxaitKrQPO4QXe2Vi2yd7kVvcAJ8f7YW759+CBid/56zBcllGxcVWyJ2Ki/Ne61l1Zg0nIiJyQjU5Q5cuXcK9996LTz75BK+//rpb59jyV2v7zWycNdg1npicUC4O5yciIi9TTcvQpEmToNfrMXDgQKdlS0pKUFBQYPOoEhODXSdznbZq41pfRETkZaoIhr766ivs2rULs2fPllV+9uzZCA8Ptz7i4+OrPsAya3DFPBgLSTLPEcNZg32PrXZERORlig+GsrOzMXXqVHz55ZcICwuTdcyMGTOQn59vfWRnZ1d9gD8Tg6lqbLUjIiIvU/zQ+hUrVuCOO+5AcLlAxGg0QpIkBAUFoaSkxGafPbKH5nHWYOXx93B+IiLyG85AfU1hYSGOHz9us+3BBx9EmzZt8NxzzyE5OdnpOVx6M92dy4Zz4HiPZTQZYH+tL84BRUQUkDgD9TV169atFPDUrl0bkZGRsgIhl7kza7C9FqW4OHPXG2/S1afERW6JiChgKD4YUjxLq0XFBjbLHDhstfAMXw7nJyIiTVF8N5kneLyZzdIlduoU8OSTwJkz9ssxn4WIiMht7CZTKntdYo6UnwOHC3YSEREpEoMhVzjqEnOGc+AQEREpluLnGVKMqpaFcIZz4BARESkWW4bkcrYshD2WnCHOXE1ERKRYbBmSy9WuLs5cTUREpAoMhuRytasrLo7D6omIiFSA3WRyWRZzdbQsBAA0agTMnQvExnIOHCIiIpVgy5BczhZzlSTg44+Be+81D6NnIERERKQKDIZckZICPP00EFThbQsKMm9nlxgREZHqMBhyRXo68Pbb5mH25RmN5u3p6f6pFxEREbmNwZBccuYZSk2tHCgRERGRojEYksvZPEPll94gIiIi1WAwJJfceYa49AYREZGqMBiSS+48Q1x6g4iISFUYDMllmWeo4rB6C0kC4uO59AYREZHKMBiSy9k8Q4DzpTeMRiAzE1iyxPyTydZERER+x2DIFSkp5iU2YmNtt8tZeiM9HWjWDOjfHxg3zvyzWTMOxyciIvIzSYiqxooHhoKCAoSHhyM/Px/16tWr/gmNRvOosZwcc46Qs6U30tOB0aMrD8u3tChxDTMiIqJKPH7/doDBkLcZjeYWIEfD8iXJ3LKUlcUlPIiIiMrx1f2b3WTexvmJiIiIFI3BkLdxfiIiIiJFYzDkbZyfiIiISNEYDHkb5yciIiJSNAZD3uaJ+YmIiIjIaxgM+UJ15iciIiIirwrxdwU0IyUFGDnStfmJiIiIyOsYDPlScDDQr5+/a0FERETlsJuMiIiINE3bLUOuLqtBREREAUe7wVB6OjB1qu3s0HFx5pFfTGgmIiLSDG12k1kWTq24TMapU+btXEmeiIhIM7QXDBmN5hYhe+vTWralpprLERERUcDTXjDEhVOJiIioHO0FQ1w4lYiIiMrRXjDEhVOJiIioHO0FQ1w4lYiIiMrRXjDEhVOJiIioHO0FQwAXTiUiIiIrxQdDs2fPRrdu3VC3bl1ERUVh1KhROHToUPVPnJICHDsGZGQAaWnmn1lZDISIiIg0RvEzUG/atAmTJk1Ct27dUFZWhhdeeAGDBw/G/v37Ubt27eqdnAunEhERaZ4khL3ZB5XrzJkziIqKwqZNm9CnTx9ZxxQUFCA8PBz5+fmoV6+el2tIREREnuCr+7fiW4Yqys/PBwBEREQ4LFNSUoKSkhLr84KCAq/Xi4iIiNRJ8TlD5QkhMG3aNPTq1QvJyckOy82ePRvh4eHWR3x8vA9rSURERGqiqm6ySZMmwWAw4Mcff0RcXJzDcvZahuLj49lNRkREpCLsJqvgiSeewKpVq7B58+YqAyEA0Ol00Ol0PqoZERERqZnigyEhBJ544gksX74cmZmZSExM9HeViIiIKIAoPhiaNGkS0tLSsHLlStStWxe5ubkAgPDwcNSsWdPPtSMiIiK1U3zOkORgDbFFixbhgQcekHUODq0nIiJSH+YMXaPwWI2IiIhUTlVD64mIiIg8jcEQERERaRqDISIiItI0BkNERESkaQyGiIiISNMYDBEREZGmMRgiIiIiTWMwRERERJrGYIiIiIg0jcEQERERaRqDISIiItI0BkNERESkaQyGiIiISNMYDBEREZGmMRgiIiIiTWMwRERERJrGYIiIiIg0jcEQERERaRqDISIiItI0BkNERESkaQyGiIiISNMYDBEREZGmMRgiIiIiTWMwRERERJrGYIiIiIg0jcEQERERaRqDISIiItI0BkNERESkaQyGiIiISNMYDBEREZGmMRgiIiIiTWMwRERERJrGYIiIiIg0jcEQERERaRqDISIiItI0BkNERESkaQyGiIiISNMYDBEREZGmqSYY+vDDD5GYmIiwsDB06dIFW7Zs8XeViIiIKACoIhhaunQpUlNT8cILL2D37t3o3bs3hg4dihMnTvi7akRERKRykhBC+LsSztx8883o3LkzPvroI+u2tm3bYtSoUZg9e7bT4wsKChAeHo78/HzUq1fPm1UlIiIiD/HV/VvxLUNXr17FL7/8gsGDB9tsHzx4MLZu3eqnWhEREVGgCPF3BZw5e/YsjEYjGjdubLO9cePGyM3NtXtMSUkJSkpKrM/z8/MBmCNMIiIiUgfLfdvbnViKD4YsJEmyeS6EqLTNYvbs2Zg1a1al7fHx8V6pGxEREXnPuXPnEB4e7rXzKz4YatiwIYKDgyu1AuXl5VVqLbKYMWMGpk2bZn1+8eJFNG3aFCdOnPDqm6k0BQUFiI+PR3Z2tqZypXjdvG4t4HXzurUgPz8fCQkJiIiI8OrrKD4YCg0NRZcuXbB+/Xrccccd1u3r16/HyJEj7R6j0+mg0+kqbQ8PD9fUL5FFvXr1eN0awuvWFl63tmj1uoOCvJvirPhgCACmTZuG8ePHo2vXrujRowcWLlyIEydO4LHHHvN31YiIiEjlVBEM3X333Th37hxeffVV5OTkIDk5GWvWrEHTpk39XTUiIiJSOVUEQwAwceJETJw40a1jdTodXnnlFbtdZ4GM183r1gJeN69bC3jd3r1uVUy6SEREROQtip90kYiIiMibGAwRERGRpjEYIiIiIk1jMERERESapspg6MMPP0RiYiLCwsLQpUsXbNmypcrymzZtQpcuXRAWFobmzZvj448/rlRm2bJlSEpKgk6nQ1JSEpYvX+6t6rvNletOT0/HoEGD0KhRI9SrVw89evTA999/b1Nm8eLFkCSp0qO4uNjbl+ISV647MzPT7jUdPHjQplygfd4PPPCA3etu166dtYwaPu/NmzdjxIgRiImJgSRJWLFihdNjAuH77ep1B8r329XrDpTvt6vXHSjf79mzZ6Nbt26oW7cuoqKiMGrUKBw6dMjpcb74jqsuGFq6dClSU1PxwgsvYPfu3ejduzeGDh2KEydO2C2flZWFYcOGoXfv3ti9ezeef/55TJkyBcuWLbOW2bZtG+6++26MHz8ev/76K8aPH48xY8Zg+/btvrosp1y97s2bN2PQoEFYs2YNfvnlF/Tv3x8jRozA7t27bcrVq1cPOTk5No+wsDBfXJIsrl63xaFDh2yuqWXLltZ9gfh5z58/3+Z6s7OzERERgbvuusumnNI/76KiInTo0AELFiyQVT5Qvt+uXnegfL9dvW4LtX+/Xb3uQPl+b9q0CZMmTcLPP/+M9evXo6ysDIMHD0ZRUZHDY3z2HRcqc9NNN4nHHnvMZlubNm3E9OnT7ZZ/9tlnRZs2bWy2Pfroo6J79+7W52PGjBFDhgyxKXPbbbeJe+65x0O1rj5Xr9uepKQkMWvWLOvzRYsWifDwcE9V0Stcve6MjAwBQFy4cMHhObXweS9fvlxIkiSOHTtm3aaGz7s8AGL58uVVlgmU73d5cq7bHjV+v8uTc92B8v0uz53POxC+30IIkZeXJwCITZs2OSzjq++4qlqGrl69il9++QWDBw+22T548GBs3brV7jHbtm2rVP62227Dzp07UVpaWmUZR+f0NXeuuyKTyYTCwsJKi91dunQJTZs2RVxcHIYPH17pL0t/qs51d+rUCdHR0RgwYAAyMjJs9mnh8/70008xcODASrO0K/nzdkcgfL89QY3f7+pQ8/fbEwLl+52fnw8AVS7C6qvvuKqCobNnz8JoNFZarb5x48aVVrW3yM3NtVu+rKwMZ8+erbKMo3P6mjvXXdE777yDoqIijBkzxrqtTZs2WLx4MVatWoUlS5YgLCwMPXv2xOHDhz1af3e5c93R0dFYuHAhli1bhvT0dLRu3RoDBgzA5s2brWUC/fPOycnBd999h0ceecRmu9I/b3cEwvfbE9T4/XZHIHy/qytQvt9CCEybNg29evVCcnKyw3K++o6rZjmO8iRJsnkuhKi0zVn5ittdPac/uFvHJUuWYObMmVi5ciWioqKs27t3747u3btbn/fs2ROdO3fG+++/j/fee89zFa8mV667devWaN26tfV5jx49kJ2djbfffht9+vRx65z+4m4dFy9ejPr162PUqFE229XyebsqUL7f7lL799sVgfT9dlegfL8nT56M3377DT/++KPTsr74jquqZahhw4YIDg6uFO3l5eVVigotmjRpYrd8SEgIIiMjqyzj6Jy+5s51WyxduhQPP/wwvv76awwcOLDKskFBQejWrZti/pKoznWX1717d5trCuTPWwiBf//73xg/fjxCQ0OrLKu0z9sdgfD9rg41f789RW3f7+oIlO/3E088gVWrViEjIwNxcXFVlvXVd1xVwVBoaCi6dOmC9evX22xfv349brnlFrvH9OjRo1L5devWoWvXrqhRo0aVZRyd09fcuW7A/BfjAw88gLS0NOj1eqevI4TAnj17EB0dXe06e4K7113R7t27ba4pUD9vwDxa48iRI3j44Yedvo7SPm93BML3211q/357itq+39Wh9u+3EAKTJ09Geno6Nm7ciMTERKfH+Ow7LjvVWiG++uorUaNGDfHpp5+K/fv3i9TUVFG7dm1rVv306dPF+PHjreX//PNPUatWLfHkk0+K/fv3i08//VTUqFFDfPvtt9YyP/30kwgODhb/+Mc/xIEDB8Q//vEPERISIn7++WefX58jrl53WlqaCAkJER988IHIycmxPi5evGgtM3PmTLF27Vpx9OhRsXv3bvHggw+KkJAQsX37dp9fnyOuXvfcuXPF8uXLxR9//CH27t0rpk+fLgCIZcuWWcsE4udtcd9994mbb77Z7jnV8HkXFhaK3bt3i927dwsA4t133xW7d+8Wx48fF0IE7vfb1esOlO+3q9cdKN9vV6/bQu3f78cff1yEh4eLzMxMm9/by5cvW8v46zuuumBICCE++OAD0bRpUxEaGio6d+5sMyxvwoQJom/fvjblMzMzRadOnURoaKho1qyZ+Oijjyqd85tvvhGtW7cWNWrUEG3atLH5cimFK9fdt29fAaDSY8KECdYyqampIiEhQYSGhopGjRqJwYMHi61bt/rwiuRx5brfeust0aJFCxEWFiYaNGggevXqJQwGQ6VzBtrnLYQQFy9eFDVr1hQLFy60ez41fN6WodOOfm8D9fvt6nUHyvfb1esOlO+3O7/ngfD9tnfNAMSiRYusZfz1HZeuVZCIiIhIk1SVM0RERETkaQyGiIiISNMYDBEREZGmMRgiIiIiTWMwRERERJrGYIiIiIg0jcEQERERaRqDISIiItI0BkNERESkaQyGiIiISNMYDBGRKi1ZsgRhYWE4deqUddsjjzyC9u3bIz8/3481IyK14dpkRKRKQgh07NgRvXv3xoIFCzBr1iz861//ws8//4zY2Fh/V4+IVCTE3xUgInKHJEl44403MHr0aMTExGD+/PnYsmULAyEichlbhohI1Tp37ox9+/Zh3bp16Nu3r7+rQ0QqxJwhIlKt77//HgcPHoTRaETjxo39XR0iUim2DBGRKu3atQv9+vXDBx98gK+++gq1atXCN9984+9qEZEKMWeIiFTn2LFj0Ov1mD59OsaPH4+kpCR069YNv/zyC7p06eLv6hGRyrBliIhU5fz58+jZsyf69OmDf/7zn9btI0eORElJCdauXevH2hGRGjEYIiIiIk1jAjURERFpGoMhIiIi0jQGQ0RERKRpDIaIiIhI0xgMERERkaYxGCIiIiJNYzBEREREmsZgiIiIiDSNwRARERFpGoMhIiIi0jQGQ0RERKRpDIaIiIhI0/4fE5P3OBtWpyMAAAAASUVORK5CYII=", + "image/png": "iVBORw0KGgoAAAANSUhEUgAAAkMAAAHFCAYAAADxOP3DAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjguMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy81sbWrAAAACXBIWXMAAA9hAAAPYQGoP6dpAABQe0lEQVR4nO3deXwTZf4H8M+0pSlgW2ih9Aq0KlKO5ZBDEApN5VABwYoorBVYcV0BsYvrAouu4Ios/FxFF10XRVhlAY8W0HU9gKaAAsopq9xaoBRq5Wqh0NKmz++PkNCQpDk6SWYyn/frlRdk8mTyTJLJfPtcX0kIIUBERESkUSGBrgARERFRIDEYIiIiIk1jMERERESaxmCIiIiINI3BEBEREWkagyEiIiLSNAZDREREpGkMhoiIiEjTGAwRERGRpjEYIlKgZcuWQZIk6y0sLAwJCQl48MEHcfjw4YDVa/bs2ZAkKWCvrwZHjx6FJEl46aWXAl0VInJTWKArQETOLV26FGlpaaisrMTXX3+NuXPnwmg04sCBA2jevHmgq0dEFBQYDBEpWKdOndCjRw8AQEZGBkwmE5577jmsWbMGEyZMCHDtKJCqq6utrYZE1DDsJiNSEUtg9PPPP1u3VVZW4qmnnkLXrl0RHR2NmJgY9OnTB2vXrrV7viRJmDJlCt577z20b98eTZo0QZcuXfCf//zHruynn36Krl27QqfTITU11Wm3T2VlJWbOnInU1FSEh4cjKSkJkydPxvnz523KpaSkYNiwYfjPf/6Dbt26oXHjxmjfvr31tZctW4b27dujadOm6NWrF3bs2OHy/bB0JxqNRjz++ONo0aIFYmNjkZWVhZMnT9od++zZs+32kZKSgvHjx9vtMz8/H48++ihiY2MRFRWFhx9+GBUVFSgpKcHo0aPRrFkzJCQk4A9/+AOqq6vt9ltbW4u5c+eidevWiIiIQI8ePbBhwwa7cocPH8bYsWMRFxcHnU6H9u3b4/XXX7cpU1BQAEmS8N577+Gpp55CUlISdDodjhw5gkuXLuEPf/gDUlNTERERgZiYGPTo0QMrV650+f4RkRn/pCBSkcLCQgDALbfcYt1WVVWFs2fP4g9/+AOSkpJw5coVrF+/HllZWVi6dCkefvhhm318+umn2L59O55//nnccMMNWLBgAe69914cPHgQN954IwBgw4YNGDFiBPr06YNVq1bBZDJhwYIFNkEYAAghMHLkSGzYsAEzZ85Eeno69u7di+eeew5bt27F1q1bodPprOW/++47zJw5E7NmzUJ0dDTmzJmDrKwszJw5Exs2bMCLL74ISZIwffp0DBs2DIWFhWjcuLHL92XixIkYOnQoVqxYgaKiIjz99NN46KGHkJ+f7/V7PXHiRGRlZWHVqlXYvXs3/vSnP6GmpgYHDx5EVlYWfvvb32L9+vWYP38+EhMTMW3aNJvnL1q0CG3atMHChQtRW1uLBQsW4K677sLGjRvRp08fAMC+fftw++23o3Xr1vjb3/6G+Ph4fPHFF5g6dSpOnz6N5557zmafM2fORJ8+ffDmm28iJCQEcXFxmDZtGt577z288MIL6NatGyoqKvD999/jzJkzXh87keYIIlKcpUuXCgBi27Ztorq6Wly4cEF8/vnnIj4+XvTv319UV1c7fW5NTY2orq4WjzzyiOjWrZvNYwBEq1atRHl5uXVbSUmJCAkJEfPmzbNuu+2220RiYqK4fPmydVt5ebmIiYkRdX82Pv/8cwFALFiwwOZ13n//fQFALF682LqtTZs2onHjxuLEiRPWbXv27BEAREJCgqioqLBuX7NmjQAgPv74Y7fep0mTJtlsX7BggQAgTp06ZXPszz33nN0+2rRpI8aNG2e3zyeeeMKm3MiRIwUA8fLLL9ts79q1q7j11lut9wsLCwUAp+/fwIEDrduGDBkikpOTRVlZmc0+p0yZIiIiIsTZs2eFEEIYjUYBQPTv39+u/p06dRIjR460205E7mM3GZGC9e7dG40aNUJkZCTuvPNONG/eHGvXrrUbJ/Lhhx+ib9++uOGGGxAWFoZGjRphyZIl2L9/v90+DQYDIiMjrfdbtWqFuLg4HDt2DABQUVGB7du3IysrCxEREdZykZGRGD58uM2+LC0vdbuZAOD+++9H06ZN7bqFunbtiqSkJOv99u3bAzCPh2rSpInddkudXLnnnnts7nfu3Nmj5zsybNgwm/uWOg0dOtRuu6PXcfb+bdq0CSaTCZWVldiwYQPuvfdeNGnSBDU1Ndbb3XffjcrKSmzbts1mn/fdd5/d6/Tq1QufffYZZsyYgYKCAly+fNnrYybSKgZDRAr27rvvYvv27cjPz8djjz2G/fv3Y8yYMTZl8vLyMHr0aCQlJWH58uXYunUrtm/fjt/85jeorKy022dsbKzdNp1OZ72Injt3DrW1tYiPj7crd/22M2fOICwsDC1btrTZLkkS4uPj7bpqYmJibO6Hh4fXu91R/R25/pgsXXMNCQw8qaujejp7/65cuYKLFy/izJkzqKmpwd///nc0atTI5nb33XcDAE6fPm3z/ISEBLt9vvbaa5g+fTrWrFkDg8GAmJgYjBw5MqBLMBCpDccMESlY+/btrYOmDQYDTCYT3n77bXz00UcYNWoUAGD58uVITU3F+++/b7MGUFVVlVev2bx5c0iShJKSErvHrt8WGxuLmpoa/PLLLzYBkRACJSUl6Nmzp1d18AWdTufwPfHV2Bpn7194eDhuuOEGNGrUCKGhocjOzsbkyZMd7iM1NdXmvqM1npo2bYo5c+Zgzpw5+Pnnn62tRMOHD8eBAwfkORiiIMeWISIVWbBgAZo3b44///nPqK2tBWC+QIaHh9tcKEtKShzOJnOHZTZXXl6eTYvHhQsX8Mknn9iUveOOOwCYA7K6cnNzUVFRYX1cCVJSUrB3716bbfn5+bh48aJPXs/Z+5eeno7Q0FA0adIEBoMBu3fvRufOndGjRw+7m6NWvPq0atUK48ePx5gxY3Dw4EFcunRJ7sMiCkpsGSJSkebNm2PmzJn44x//iBUrVuChhx7CsGHDkJeXh0mTJmHUqFEoKirCX/7yFyQkJHjdVfKXv/wFd955JwYNGoSnnnoKJpMJ8+fPR9OmTXH27FlruUGDBmHIkCGYPn06ysvL0bdvX+tssm7duiE7O1uuQ2+w7OxsPPvss/jzn/+MAQMGYN++fVi0aBGio6N98nqhoaEYNGgQpk2bhtraWsyfPx/l5eWYM2eOtcyrr76Kfv36IT09HY8//jhSUlJw4cIFHDlyBJ988olbs+Fuu+02DBs2DJ07d0bz5s2xf/9+vPfee+jTp4/NOCwico7BEJHKPPHEE1i0aBGef/55jBkzBhMmTEBpaSnefPNNvPPOO7jxxhsxY8YMnDhxwubC64lBgwZhzZo1eOaZZ/DAAw8gPj4ekyZNwuXLl232KUkS1qxZg9mzZ2Pp0qWYO3cuWrRogezsbLz44os20+oD7emnn0Z5eTmWLVuGl156Cb169cIHH3yAESNG+OT1pkyZgsrKSkydOhWlpaXo2LEjPv30U/Tt29dapkOHDti1axf+8pe/4JlnnkFpaSmaNWuGtm3bWscNuZKZmYmPP/4Yr7zyCi5duoSkpCQ8/PDDmDVrlk+OiygYSUIIEehKEBEREQUKxwwRERGRpjEYIiIiIk1jMERERESaxmCIiIiINI3BEBEREWkagyEiIiLSNE2sM1RbW4uTJ08iMjLS4XL2REREpDxCCFy4cAGJiYkICfFd+40mgqGTJ09Cr9cHuhpERETkhaKiIiQnJ/ts/5oIhiIjIwGY38yoqKgA14aIiIjcUV5eDr1eb72O+4omgiFL11hUVBSDISIiIpXx9RAXDqAmIiIiTWMwRERERJrGYIiIiIg0jcEQERERaRqDISIiItI0BkNERESkaQyGiIiISNMYDBEREZGmMRgiIiIiTWMwRERERJrGYIiIiIg0jcEQERERaRqDISIiItI0BkNERESkaQyGiIiISNMYDBEREZGmMRgiIiIiTQt4MLRp0yYMHz4ciYmJkCQJa9ascVr2sccegyRJWLhwod/qR0RERMEt4MFQRUUFunTpgkWLFtVbbs2aNfjmm2+QmJjop5oRERGRFoQFugJ33XUX7rrrrnrLFBcXY8qUKfjiiy8wdOhQP9WMiIiItCDgLUOu1NbWIjs7G08//TQ6duwY6OoQERFRkAl4y5Ar8+fPR1hYGKZOner2c6qqqlBVVWW9X15e7ouqERERURBQdMvQzp078eqrr2LZsmWQJMnt582bNw/R0dHWm16v92EtiYiISM0UHQxt3rwZpaWlaN26NcLCwhAWFoZjx47hqaeeQkpKitPnzZw5E2VlZdZbUVGR/ypNREREqqLobrLs7GwMHDjQZtuQIUOQnZ2NCRMmOH2eTqeDTqfzdfWIiIgoCAQ8GLp48SKOHDlivV9YWIg9e/YgJiYGrVu3RmxsrE35Ro0aIT4+Hu3atfN3VYmIiCgIBTwY2rFjBwwGg/X+tGnTAADjxo3DsmXLAlQrIiIi0oqAB0MZGRkQQrhd/ujRo76rDBEREWmOogdQExEREfkagyEiIiLSNAZDREREpGkMhoiIiEjTGAwRERGRpjEYIiIiIk1jMERERESaxmCIiIiINI3BEBEREWkagyEiIiLSNAZDREREpGkMhoiIiEjTGAwRERGRpjEYIiIiIk1jMERERESaxmCIiIiINI3BEBEREWkagyEiIiLSNAZDREREpGkMhoiIiEjTGAwRERGRpjEYIiIiIk1jMERERESaxmCIiIiINI3BEBEREWkagyEiIiLSNAZDREREpGkMhoiIiEjTGAwRERGRpjEYIiIiIk1jMERERESaxmCIiIiINI3BEBEREWkagyEiIiLSNAZDREREpGkMhoiIiEjTGAwRERGRpjEYIiIiIk1jMERERESaFvBgaNOmTRg+fDgSExMhSRLWrFljfay6uhrTp0/Hr371KzRt2hSJiYl4+OGHcfLkycBVmIiIiIJKwIOhiooKdOnSBYsWLbJ77NKlS9i1axeeffZZ7Nq1C3l5eTh06BDuueeeANSUiIiIgpEkhBCBroSFJElYvXo1Ro4c6bTM9u3b0atXLxw7dgytW7d2a7/l5eWIjo5GWVkZoqKiZKotERER+ZK/rt9hPtuzj5SVlUGSJDRr1sxpmaqqKlRVVVnvl5eX+6FmREREpEYB7ybzRGVlJWbMmIGxY8fWGyHOmzcP0dHR1pter/djLYmIiEhNVBMMVVdX48EHH0RtbS3eeOONesvOnDkTZWVl1ltRUZGfaklERERqo4pusurqaowePRqFhYXIz8932W+o0+mg0+n8VDsiIiJSM8UHQ5ZA6PDhwzAajYiNjQ10lYiIiCiIBDwYunjxIo4cOWK9X1hYiD179iAmJgaJiYkYNWoUdu3ahf/85z8wmUwoKSkBAMTExCA8PDxQ1SYiIqIgEfCp9QUFBTAYDHbbx40bh9mzZyM1NdXh84xGIzIyMtx6DU6tJyIiUh/NTK3PyMhAffGYgpZBIiIioiCkmtlkRERERL4Q8JYhIiIizTGZgM2bgVOngIQEID0dCA0NdK00i8EQERGRP+XlAU8+CZw4cW1bcjLw6qtAVlbg6qVh7CYjIiLyl7w8YNQo20AIAIqLzdvz8gJTL41jMEREROQPJpO5RcjRxCDLtpwccznyKwZDRERE/rB5s32LUF1CAEVF5nLkVwyGiIiI/OHUKXnLkWwYDBEREflDQoK85Ug2DIaIiIj8IT3dPGtMkhw/LkmAXm8uR37FYIiIiMgfQkPN0+cB+4DIcn/hQq43FAAMhoiIiPwlKwv46CMgKcl2e3KyeTvXGQoILrpIRETkT1lZwIgRXIFaQRgMERER+VtoKJCREeha0FXsJiMiIiJNYzBEREREmsZgiIiIiDSNwRARERFpGgdQExGRLZOJM51IUxgMERHRNXl55szqdROKJiebFwvkGjgUpNhNRkREZnl5wKhR9pnVi4vN2/PyAlMvIh9jMEREROausSefBISwf8yyLSfHXI4oyDAYIiIi8xih61uE6hICKCoylyMKMgyGiIjIPFhaznJEKsJgiIiIzLPG5CxHpCIMhoiIyDx9PjkZkCTHj0sSoNebyxEFGQZDRERkXkfo1VfN/78+ILLcX7iQ6w1RUGIwREREZllZwEcfAUlJttuTk83buc4QBSkuukhERNdkZQEjRnAFatIUBkNERGQrNBTIyAh0LYj8ht1kREREpGkMhoiIiEjTGAwRERGRpjEYIiIiIk1jMERERESaxmCIiIiINI3BEBEREWkagyEiIiLSNAZDREREpGkBD4Y2bdqE4cOHIzExEZIkYc2aNTaPCyEwe/ZsJCYmonHjxsjIyMAPP/wQmMoSERFR0Al4MFRRUYEuXbpg0aJFDh9fsGABXn75ZSxatAjbt29HfHw8Bg0ahAsXLvi5pkRERBSMAp6b7K677sJdd93l8DEhBBYuXIhZs2Yh62q25H/9619o1aoVVqxYgccee8yfVSUiIqIgFPCWofoUFhaipKQEgwcPtm7T6XQYMGAAtmzZ4vR5VVVVKC8vt7kREREpgskEFBQAK1ea/zWZAl0j/1PYe6DoYKikpAQA0KpVK5vtrVq1sj7myLx58xAdHW296fV6n9aTiIjILXl5QEoKYDAAY8ea/01JMW/XCgW+B4oOhiwkSbK5L4Sw21bXzJkzUVZWZr0VFRX5uopERBSM5GzByMsDRo0CTpyw3V5cbN6uhYBIoe+BooOh+Ph4ALBrBSotLbVrLapLp9MhKirK5kZEROQROVswTCbgyScBIewfs2zLyQl4d5FPKfg9UHQwlJqaivj4eKxbt8667cqVK9i4cSNuv/32ANaMiIiCmtwtGJs32++rLiGAoiJzuWCl4Pcg4LPJLl68iCNHjljvFxYWYs+ePYiJiUHr1q2Rk5ODF198EW3btkXbtm3x4osvokmTJhg7dmwAa01EREHLVQuGJJlbMEaMAEJD3dvnqVPylrueyWQOIk6dAhISgPR09+vmL75+Dxog4MHQjh07YDAYrPenTZsGABg3bhyWLVuGP/7xj7h8+TImTZqEc+fO4bbbbsOXX36JyMjIQFWZiIiCmSctGBkZ7u0zIUHecnXl5ZmDt7p1Tk4GXn0VuLosjSL48j1oIEkIR6FvcCkvL0d0dDTKyso4foiIiOq3cqV5jJArK1YAY8a4t0+TyTzeqLjYcYuTJJkDmMJCz1p0LN151+/TMsnoo4+UExB58R746/qt6DFDREREfueLFozQUHNLDXAtULGw3F+40LNASMEDkh3yxXsgEwZDREREdaWnm1sonC3hIkmAXm8u54msLHNLTVKS7fbkZO9acBQ8INkpud8DmQR8zBAREZGiWFowRo0yBz51W14a2oKRlWUeeC3HYGcFD0iul5zvgUwYDBGR/6lh5gtpm6UFw9HA5IULG9aCERrq/sBrwPn5ouAByS55+h74GAdQE5F/qWXmCxEQ+MC9vvNlxAjfDMpWEH9dvxkMEZH/qGnmC1GguXO+AOYygOPuPJWfU2dLzyK2VSyDITkwGCJSAMu0WmcDPoPgr1gi2Xhyvqxda996pNc3vDsvAGprarE39zDyV5yCcVsTbCxNwAW09vn1m2OGiMg/fLGQHVGw8uR8UeCAZHeJWoF9n/yIgveOo8R4ACVnG+Ew2mIz0lGLUADlfqkHgyEi8g+1znwhCgRPzxeFDUh2RtQKHNlwDPnLjsO4OQwFxTfj9tq9eBVPQo9rwd8vIXHY0nUymv3uLmT81vf1YjBERP6h5pkvRP4WROfL0a9OwPhOIfILJBiP3YTi2hQAKQCAe5GHjzAKEmxH7LQUv2DE7tkob3yjX+rIMUNE5B++SkdAFIxUfL4U7zgF45KfYNxQi/zCFByt0ds8Ho4q9Inej8yuZzD9u18j/PzPcLi8pSShPDER0cXFHDNEREHClwvZEQUbFZ0vpT/8goK3DyP/ixoYj+hxqDoVwLUWqzBUo1fkfhg6n4VhRBRuf6Q9Gsd0BQoKAMPPzncshDkY9AMGQ0TkP75cyI7IlUCvGeQphZ4vZ388h42LD8L4eRXyDybih6q2AFpaHw+BCbc2OYjMTqUwDL8B/Sam4Yb4zvY7UtD4QHaTEZH/qe2i5I5gPKZgoubFPgP83So/UY5Niw/A+N9LMO5rhT2X20Fcl9q0S8RBGNqXIHNoY6RPbIdmbaJd77igADAY6n9tANEA1xmSA4MhIvIpNV9otaChi31qLNCtKK3A10sOIH/tBRi/b4GdFWkwXdeR1D78R2S2OwHDkHAMmHgLWrSL9fyF3BgX5a8xQwyGiIgagqtqK1tDF/vUQKBbeb4SW9/ZD+OaMuTvicG3F9JQjXCbMjc3OgrDTceROSgMGRNvRnznOHle3HL+AA7HRZW/+y6is7MZDMmBwRAR+QRX1Q4MT1pq3OiKAQAYjfbr9ARpoHvl4hVsf+8A8j86C+OuaGw53x5ViLAp0zr0BDJTC2EwSDA8ciP0tyX6rkKOAs6rK2iXDxzol+s3B1ATEXmLq2r7vwvJ05Yabxf7NJnMr+OovUAIc0CUk2Ne+VnhgW5NZQ12rTwI4we/IH/7DfjqTHtcgu2A5oSQEmS2/hGGAbUwjG+D1P56SCHJ/qlgfStol3MFaiIiZdP6qtr+7kJy1lJTXGze7qilxtvFC1Uc6NbW1OK7Dw/BuKoExm1NsKm0HcrR0aZMC+k0DEmHYehXjcyHk3HLkFRIIfEBqjFsV9CuG2D7qTeHwRARkbeCaJVgj3kTmDSEty016enmAM3V4oXp6bbbfRHo+qgVzZLfK/+9Yhi36LCx5BacFWkA0qxlmknnkRF/AIY+VTCMTUDHETcjJKxPg19bdo4CbD9gMERE5C1vL7RqF4guJG9barxdvFDuQFfGVjRRK3B43VEY3y2CcXMYjCfaolTcDOBma5kbcAH9Wx5A5m0VMDzYCl3uvwWh4b09eh2/cxZg+wGDISIib6lolWBZBaILqSEtNd4sXihnoCtDK9rRr04gf0khjBst+b1SAaRaH2+MS+gXsx+GHheQOboFuv86DWERPV3XTSnqC7D9gMEQEVFDKHSVYJ8KxFiphrbU1DdI1xG5Al0vW9Es+b3yN9TCaM3vdW1AszW/163nYchqjl4Pp0EX1b3+uiiZqwDbxxgMERE1lKcXWrULxFgpOVpq6g7SdYccgW5BgVutaGff/QTr9sTBuK4G+Uf0OFxPfq/Me6PRZ0KaOb9XsAjwJAOuM0RERJ4JVEZ1Fwv0+WzdH28HPuflAY8+Cpw967LoGKzAKoyx3g+BCd2bHoCh4y918nvd0JCjUDYn60ExHYeMGAwRUdBQSmqIQAUm9SzQp6guSQ8HA2fAiPMRCZ7n9woWTgJsBkMyYjBEQUspF0byD6WlhghUYKL0773JhFp9G0iniiG5KCoAXI6Mw6Vt/0OLDi5SXCj9uBvKQYDNYEhGDIYoKCntwki+lZcH3Hef88dzcwPzuQf7BdpNdfN7ndvxI/5+eaJ7T5Qk91rRtHK+X3ecDIZkxGCIgk6Q5kwiJ0wmoFUr4MwZ52ViY4Gff9ZkIBIIVy5ewbfvHoAx1z6/14NYiZUY63onMTHAW2+5Fwhp6XyvE2CXR0UhetgwBkNyYDBEQYXJQbVnwwZg4EDX5davB+64w/f10SBLfq/893+BcYclv1dTmzKW/F5j2u3E0C+edL1Tdz4vjZ/v/rp+c2o9kdqoOGcSeamgwP1yDIZk4U5+r5bSL8hIOoLM9GoYsuvk9zL1BlL+z/VsO3fOT57vfsFgiEhttJ4clMgH3Mnv1Vw6hwHxB2HoU4XMhxLRccTNkEJa2u9MzpXJeb77BYMhIrXRcnJQrcrIAF54wb1ywcLHA7Pr5vfK3xyGAgf5vSJRjoyWP+DXN32DXrfWoPXIbgjNzHCvHnKtTM7z3S84ZohIbQK14B0FjtYGUPto5lTd/F75x27CyVrbAOL6/F49mu5H6NPTGlaPhgZ1Gj/f/XX9ZjBEpEaBWvCOAkepU+vlJuPMKcf5va4JRxVub7YPhm5ldfJ76WSvR4Np+HxnMCQjBkMUlNSyEi/JJy8PmDrV3EpgEUxrzTRw5tTP3/+CgrcOX5ff6xpLfq/MLmdhGGnJ79VY9nr4hEbPdwZDMmIwREGLC94FD3c/y2D+zJ3kp7JjNAIZGThz+Cw2vnUIxs+rYDyUiB+q2toUq5vfK/OeG9D3ETfze3lYD78J5s/eCU6tJyLXPM3CTcrkyRiZYP7M3ZwR9d6EDXj553h8d/kWCPS2eaxLxEFkdjgFw91N0P/Rdohu3dHJXhpeD7/P4Armzz7AQgJdAVdqamrwzDPPIDU1FY0bN8aNN96I559/HrW1tYGuGhFRw1nGg1zfJVNcbN6elxeYegWCmzOilhy9A3sup0EgBB10RzD5VxuR+/Q2nD50Fnsut8PLOzMw/C+9EN3ay0SnnMGlOYpvGZo/fz7efPNN/Otf/0LHjh2xY8cOTJgwAdHR0XjySTdW+CQiUiqTydwi5Gi0ghDmsSk5OcCIEUHfHQIAlb/qCUTHQVdW6jDBaS0klCAeae0Efjd4CzIm3oz4zrbT4WWRnm5umXM1gys9Xd7XpYBRfDC0detWjBgxAkOHDgUApKSkYOXKldixY0eAa0ZE1EAaX124bn6v/F3R2Hq+Pe7GP/ARRkEACMG1QEQAkAAk5i7Cm1lujOdpCDkXTSRVUHw3Wb9+/bBhwwYcOnQIAPDdd9/hq6++wt133x3gmhERNZBSx6Y4YzKZBxevXGn+12Ty6Ok1lTX4Zsn3+OudBRjSYgeaR1YjfXJn/Dk/AwXnu6EKEfgmpA9ea/kCLjVpYfNcSa+HlOvHKeSWRROTkmy3JycH9VR2rVJ8y9D06dNRVlaGtLQ0hIaGwmQyYe7cuRgzZozT51RVVaGqqsp6v7y83B9VJSLyjJrGpnixEGLd/F7525pgU2kaLqCTTZmW0i8wJB+GoV9NnfxefwJM0wM/cyory9xFGeh6kM8pfmr9qlWr8PTTT+P//u//0LFjR+zZswc5OTl4+eWXMW7cOIfPmT17NubMmWO3nVPriUhR1LK6sJsLEIpagR/WHoHx3ydh3KJDQUk7nBPNbZ5iye+VeXsVDL+25PdyNEKIiOsMWen1esyYMQOTJ0+2bnvhhRewfPlyHDhwwOFzHLUM6fV6BkNEpDxKX13YRSoQAQkXm7TEozEfwVichlJhm7g0EuXoH3cAhl6XkDk2Hp3va4vQcB8Edr5eg0eDa/woAdcZuurSpUsICbEd2hQaGlrv1HqdTgedTufrqhERNZxcCT0dkeMCPnduvTnRJAhEXipFySUTStHSmt8rs+cFGO5vge6/TkNYRC/vj8EdPspl5rf9U8ApvmVo/PjxWL9+Pf75z3+iY8eO2L17N37729/iN7/5DebPn+/WPrgCNREpntwtD3JcwE0mmGJaILT8vMuiuR2eQavJ96PXw2kIvyHcuzp7w9c5xJSUo0yD2E121YULF/Dss89i9erVKC0tRWJiIsaMGYM///nPCA9374RjMEREmtKAC7glv1f+lzWoOFyM5aax7r2mv1NTAL7PIabEHGUaw2BIRgyGiEgzPLyA183vlX8oCfuqri1g+CBWYiXcCIZiY4Gff/Z/QODrHGJKzVGmIRwzREREnnNzIcfX2/8db5+402F+r66ND8DQvgT3dzwPvOfGa06dGpiWEV+v06S2daDIawyGiIiUpKFjh9y8MH91uBX2IA0A0EF3BJm3FMNwpw4DHr0FsW3TAKQBpnTA+KLzqf+AuVVo1iz36ycnX6/TpKZ1oKhBPAqGioqKoNfrfVUXIiLvBMu0ZxkGPVc1jYE7c2l76Esx8t4tyHi0LVp1cpLfq760FBaLFwfuvfZ1DjHmKNMMj9JxpKWl4dlnn0VFRYWv6kNE5Jm8PPMYGYMBGDvW/G9KivqyvXuZvf7KxSv46o29eD6zAIbmu9F8RD8UIRm1DlOdmtcFgl6Ppwqn4IFXb0erTi0dlrNylpZCrwdycwM7k8oSrAHXBodbyJFDzNf7J+UQHvj6669Fr169REJCgnjnnXc8eWpAlZWVCQCirKws0FUhUp+aGiGMRiFWrDD/W1MT6Bpdk5srhCQJYf67/dpNksy33NxA19A9NTVCJCfbH0fd49HrhaipEdWXq8W2t/8n5g0xikExO0QTXLQr/oj0tqgFRK2c74vSvwfXv396vXyfv6/3T0756/rt1Wyyd999F7NmzUKLFi3wyiuvIEPho+g5m4zIS0pebC6Ypj27OWtpZrM38Pr5X+MCbH/H6ub3yhynR9tBKZDWrLb/7PT6hi/kKCdvuzcdPQ/gCtRByG/Xb2+jqEuXLolnn31WNGnSRIwcOVIcPnxYvhBNZopsGVLyX1lEQii/1cVodN6SUvdmNAa2nu5YscKtY3kQKwQgRHPprLg3Yat47b4C8b+8Q6LWVOt4v0r+nXHU2pKc7Pp75cnzlHz85BZ/Xb+9DoYqKirE5s2bRU5OjggJCRE6nU5MmzZNlJeXy1k/WSguGPL2R4DIXzzotgkYNwMIsWJF4OrohlpTrTj213+7dSzv3/6K2LViv6ipUvlF3Z1A21Eg40mAzt/ZoKDIbrI333wT27dvx/bt27F//36Ehoaic+fO6N27N7p27Yp///vfOHToEFavXo0ePXr4qjHLY4rqJuPS7mSh5GZ3NSw25686+uBzKtxUhPx3jsK4MQTG4zeipDYOR5GCJBQjBPY/yUKSIKmly88Vd7o3Y2KAxo1tyyQlAZWVzvOk1e0WXbuWv7NBQpHdZMnJyWLUqFHipZdeEl999ZWorKy0KzN37lzRsWNHmWI1eSimZUgNf22Tfyj9r1Y1tLpYzidHLQVynU8yfU5F354U7z62WYy/eZNoE1pkV1UdLotnm/zf1UHPkv1xKKFbUi7udm96e1u/nr+zQUTx3WTOlJSUiJCQELl32yCKCYaCaYwDeU/pY3GE8N93taFjOizv5fXvpxzvZQM+p5L/lYqVT3wtfpu2UdzcqNBuF2G4IvpGfiee6WcU+X/bJS6duXTtNYN91pK7gba3t2ee4e9sEPHX9Vv2Fajj4uKQn58v926DA5d2J5PJPMNHCPvHhDA34+fkACNGBLY7xB+Lzbk7U62+birLGjiO9tOQWVMefk6W/F75n1fBaM3vdW39nhCY0KPpfhg6nYZh+A3o+0gabojvbL/vrCzzPuXollNqN6xSVmvm7yzV5dNQSyHYMkSKoabvgBJaXdztppJ71pCbn9Oitq+ILhEHhAST7WHAJLo23i+mdTeKT579Rpw/dr5h9fGUkrthXXVvenuzdH+tX6+ec4xcUm03mRIpJhjyxxgHUjY1jMWpyxfdNu6OnfvgA8+6qeQMiDyc6g4I0VF3SEz5VYHIfXqrOH3ojPev3VBq6IbNzZU/EKo7C42/s0HDX9dvj9JxUANxaXfyNvGjyWSePbVypflfk0numjmWlQUcPWqekbVihfnfwsKGzcRxM6s6Jk0y/9/R44C5m8ryPsickqOqaYxb5Xq2LsWqqVtQ8r9f8H1lW/x97wBkLeiN2LbuPV92rrr3ANv3LZBiYx1vi421/320kCTz48nJttuTk6/NEOPvLHnDp6GWQiimZchCC4MkyTFv/mpVcpeHN+QcQGs0Nqwl5GprUvU774rvpr4lns9YLzKa7RKNcVEcR7IwXT+z6+qtFgptXVBDN6yzz8vymT39tOvu2Zoac3fYM8+Yb+vX238W/J0NCuwmk5HigiEhuDKqlnkyFkcNXR6eknNq9fLlXk2jrr5cLQ4+/ooo07W0KX8cyeJe5ArAR/m9fE3p3bCedJHWF8gEaiwZ+R2DIRkpMhgibXPnr9ZgXZfKndaxli2dH3fd2yuvuFWu5sv1YufyfeKlYUZxd8tvxVi8J0yQhOm6cqarwU/xM2+YU1yorXVB6S1DntTPWSATjH8gkFOKXIFarRS1AjWRhaupz2pYBdpblpXYAfOlzMIypuODD4Df/9711P5584CHHnL5chPxFpZgIgDzNHfzas8n4HDQ5PUJXpU6Rd0Ry+rOrt63QK1kvXKleUyXKytWAGPGXLtv+QyKi81jnk6fdvy8QB8fyc5f12/Z1xkiIjeFhtYfxDRkXSqlX8DdWR8oJMQcMEmS44Bp4UJz2gY3HMHNiEQ5+scdwMM3b4F+ixsDuDdvNn8+rj4nJbEMHnb1vgXqu+DNBAJH61E5c/1nR+QmziaTW6Bm/VDw8Xbmmcwzq3zCZDIHMn/9K/DKK8Dy5fYz1SwBU1KS7XOvzhwqbNET77wDnAltiVo4nn1UC6A8oiUWvB2Ds5eb4D8/98LoKa3cq6NaF+Vz8b4FNCeXZTHP+maL6fXXFvO0tCC6EwjVVVzcsHqS9vi0E04h/DZmKNhm/VBgeTvzTOnjKTw9T66OHTn9l9fFF8NfExNuMtrk97oXuVfH/9ged62zY1b6uBq5KHXwsLsTCFyNmavv1qKFMr7r1GAcQC0jv7yZargIkfp4MvNMDQOuPThP3M3v9Wy6Uewd93+iNjHJvYHOXJQv8NwZmN7QWYf83Q0KHEAtI58PwLIMWnTWlMtBfcqi9PE013M0ZkKvt8+95Y8B1w1571ycJ0KScPmGlpjeZiXyD7e+mt/rGsf5vW7wrm6uBnAHujtJC1x9Xu4OtnaGv7tBgQOo1cTdFXU5qC/w3E0OqiTuJu+UMxGwowvV2rUNe+9cnCeSEGhyoRT/+z4E+3AzJNSiS+NDyOxQAsPdTZA+sR2iW3dyvn9HA52dXXB9leDVGbUF4P7gamB6QxO68neXPMBgSA7MRq8OltaA6xtDi4vN25XcGuDOjCZvB1xfz1HAGBsLnDljX9aD965yfyEi3KjeeH0+nhwTgQG/bYeYm9IApLnxLAdcBb7+yhCvxgBcCSyDrZ0tE+Au/u6SG9hNJodgXg8mWGihK1OONWacBYz1cbLfy2cvY+vSA8hfXQbj3hhEXCjFBgxyvT85zhNnx+GLbrD6gh3Af/UIRs66Mz3B311V81c3GYMhOSh9oTNPBGtzvlYC1oaMhXEVMLpQ/d8vse3HOBjzziF/VzNsLWuPK9BZHw+BCUXQIx6n3Fvs0Fv+DHzrC7qEcN6iJnc9gtmHHwITJwLl5bbbY2LM7+HZs+r/3SWn/BUMcZ0hOQRLlmQ1rE/jLa10ZTZkjRlXY99cmHh3Mfo/0QXPGTOwsawrrkCHpJBTeCj1KywZvxlHNp5EYu4ihEiSb88TT8bwNYQ7GeKdBUJy1iOY5eUBjz9uHwgBwLlz5vdXCHX/7pIicMyQXPw9IFNu7oynkWt8RSDINZ5GDbwdC9PAQPAYUhAn/QJD8mEY0mtgeFiPtoNSIIXUfU/1vj9P/BX4NjB4lK0ewcpVl60lCIqJARo3VufvLikGu8nkpsZuJne6FZz94KhlEGgwdWX6irtdidepBVDROA7Hl29Ch5G3QAq5+ld5feeCL88Tf3WJNnTqt1z1CEaedtmuX2/+/qjpd5fcwqn1aqWmPEYW7nQrNHAmUcApPWeTAoi+/VDTIh5hp0scJrewvGN1HxOShBAAkcv/gY5Z7a494GoGlS/PE1ezkCyBryXlg7ca2oooVz2CkaetbqWltoldiTzEMUPkfTO95UKTk6OOHGxKztkUAKJW4KeC41gyfjN+nfI1kiJO44HTr0NAssv1ZQ0pYmJttkuO3jtn+aQswbOvx6D5awyfO3m2YmOdPyZXPYKRp79JwdC9TQHFbjLyunvEhpqa+tXYlSmTom9OwrjkJxiNAvmFqThuSrZ5XIdKTG+yCNNMCxBd9cu1BywrXrsai6SkJQzcXbm7oa/hbPZefbPJ5K5HsPHkN0mv13b3dpDj1HoZBU0w5KuLuKvxNO5YsYLN1ApUsrcUBW8fgfHLKlw88jNqTQKnkIDNSEctQhGGavSO2gdDl3MwjIxGn9+0R0SzCO+/a0pbwsAfga8ni1RafPABcP/98tYjmHjym5Sby6AyiHHMENny5Sq29Y2ncRebqRXhzOGzKFh8EMYvriD/YDL2X7kJ9+IrvIonoce178758JY4OupptH1lEprGdbHfkbdjepS2hIE/xvBdP3svLg4YN855eUkCnnrq2tgpsufOb1JsLLB4MQMhkgVbhtTAX6vpOgu4Ll/mwmYKdf5YGTYtPgDjZ5Uw7o/Hd5XtbB7Pwkf4EKMhQdiOAvLVCshKaxkKBL4H8nHW6jZ1KjBrFn9zNIDdZDJSdTDk7zEYzhJ0MsO3IlwsuYiv3j4A4ycXkf99HHZdaoda2H7uHXWHkdnuJAyDw3DP8tEILTnpeGe+CGS5hIH7U+7ZteweDY/xI3aTkYUnq+nK8Vemo24FtS8oqWKXz17GliX7YVxbDuPeGHx7oT1q0MOmzC2NCmG4uQiZQ8KQMbEt4jq2BdDW3ELxkpNACPBNVm8uYaCtBT79QY3LlZDqqCIYKi4uxvTp0/HZZ5/h8uXLuOWWW7BkyRJ079490FXzPaWMwZAzwzc5deXiFXyzbD/yc8/BuNuS3+tWmzKpYcdhSD0Gwx0hMDxyI5J6pAJItd9ZoL47Wg+e/bXOERHJRvHB0Llz59C3b18YDAZ89tlniIuLw48//ohmzZoFumr+oaS/MvkXmuxqKmuwY/kBGD88jfwdkfj6bHtchu2A5qSQUzC0+RGZGQKG36QipV9rAK1d79zd78S+feZWJDmDWy0Hz2wdI1IdxY8ZmjFjBr7++mtsbkAyw6AYM6TlMRhq5GScg+mKCd99eAj5K3+G8dum2PRLGi4i0uapdfN7ZY5vjZvvaHMtxYWndfBkyQQ1pVdRA3+sc0QU5DiA+qoOHTpgyJAhOHHiBDZu3IikpCRMmjQJjz76qNPnVFVVoaqqynq/vLwcer1encEQUP/CbgAHMCuNg4vghcYt8bpuGuaX/Q7nRTOb4jHSWWQkHILh9ioYHkpCh+E3eRf8OKuLo++OI/w+yY+Df4kahMHQVREREQCAadOm4f7778e3336LnJwc/POf/8TDDz/s8DmzZ8/GnDlz7LarNhgC+FemMwq72IiPcq8upmc7ld2S3mIUPsIG3IH+cQeR2ecSDGMS0Pm+tggJc5IZR47jc/TdcUbNLY0K+y4QUcMxGLoqPDwcPXr0wJYtW6zbpk6diu3bt2Pr1q0OnxN0LUMW/LG35cuFKN0kagUKNxUhf+kxFBQILDj+IOJxymHSPwHgSkw8Qo8fRVhTneudy3l8lu/Ohg3ACy+4Lq+2NXAU8F0gIvlxav1VCQkJ6NChg8229u3bIzc31+lzdDoddDo3LjZqwwHM1zhbiNKSDNSHXT2W/F75+YDxaAqOm8wDmgegAIlwPjNLAqA7WwJs32oOZOsLbOU+Pst3RymzE+UUwO8CEQUHxQdDffv2xcGDB222HTp0CG3atAlQjSjgTCZzK4CjRk0hzF09OTnm2UwNaTm72ppy/psD2LmtBh/s74j8n1JxpDoFQKK1WCNcQZ/I7zG72RKgyI39rl0LZGc7b8VwdXwA8OijQHS0OcDx5BiVNDtRDv76LhBRcBMK9+2334qwsDAxd+5ccfjwYfHvf/9bNGnSRCxfvtztfZSVlQkAoqyszIc1JauaGiGMRiFWrDD/W1Mj7/6NRiHMl7r6b0ajV7v/5cBpseWeF8XZsJY2+zuOZHEvckUIasRtTf8nZvQ2ii9e3CEuv/NvIZKT3auTs5skmW+5ue4fH2B+3dxc9w+upsb8HElyXg+9Xv7PzFd8/F0gosDy1/Vb8cGQEEJ88sknolOnTkKn04m0tDSxePFij57PYMiPcnPtAwNPL9iurFjh3gVwxQq3dnfu6Hmx9k/bRE63AtE54oC4F7nCBEmYrttf7dVbxeL3bI/XWWDh6BYaWn9ApNcLsXy5d0GUuyx1vr7e3uwr0GT+LhCRsvjr+q34AdRyUPU6Q2rir4SyDUyEebHkIjYv3g/jfypg/ME2v1cITDiKFCThhMNB0DazrYD688Zd/zx3T7VXXgF+/3v3yl5fJ3e7goJldiKTohIFNc4mkxGDIT/wZ0JZDxeirJvfK/+7WGy/mIYaNLJ5yi2NCpHZtgij2++FIfcJ13UwGs3/unMhBsyBxn33mYMNV5YvB2bMcH+xxLp18uSCHwyzE7koKVFQ42wyUhd/JpR1ke5AANg3OAcfDdzsMr9X5sAQZPymTn6vlcWA84mK13gy2+qZZ4DZs83H7k4wlJTk/PjkqhOgrtmJzgI3pr4gIhkwGCJ5+HvKtpNkoKWIw5PiFaxaMsameFLIKWSm/AjDABf5vXwx2+qOO8wXY08SeIaGOk52Kled5ObLViZXawhpPTEsETUYu8lIHn4cu2G6YsKeDw7BuOpnFHwTAdPps2iGMpxCAjYjHbUIteb3yuxfA8M4D/J7edLtAnjeReNpahWTyfzejh4NnD3ruM6B7gry5YKHnoxDC4ZuPyKywTFDMmIw5Ac+HLtRW1OLH9YeQf6/T8G4NQIbf25Xb36vzOwktB/WgPxengQs3uSN82bwslLz0/ly0Lwn49AABkJEQchv12+fzlVTCE6t9xOZpmzXmmrF/k9/FG88uFGMStoiWki/2M2UjsJ5MbzVNvHyCKPYveqAMFWb5D+W65cI0OsdH4MnZS28WYvJm9fxJcuaRa6WCvB2zSJ31xCaM8f3yzkQUUBwar2M2DLkR160eohagZ8KjsP4r+MwbgyBsegmnKqNtynTFBfRL/YADD0vIvPBOHR74BaERfh4yJsn3S7+6qJRUleQr7tGV64Exo71/HlA4FvMiEgWnE1G6pSVZU594OKCXfTNSeS//ROMRkt+rzYA2lgf16ESfZvvg+HWchjui0HP7DSE39DDv8fiyWwrf83MUtIMMF8Pmm/IgHAhmIqDiNzGYEhNlNQqUB8HF+ySvaUwvnUExvU1yD/SBj/WtMH1+b1ui9qPzK7nYLi3GXqPT0NEM9vp8Iqnls9HLr7Oc+Zq9p0rci7nQERBjcGQWvhyxo4PnD54BgWLD8H45RUYDyVj/5WbAMRZHw9FDXo0PQDDr07DcE8k+j6ShqZxXQJX4YZS2ecjC0+WCvCGqzWEfLX+EhFpDscMyc0XrQP+SnPRAOePlWHT4gPI/28ljAfisbeync3jEmrRtfFBZHb4GYZhTZE+sR2ikoNk/JYKPh+f8ccsN2fj0CZOBJ57zvXzmYqDSLU4tV5GfguGfNE64M80Fx64cPICvnr7gMP8XhaddIdhaHcSmXdHoP/EWxBzU3O/1c9vFPr5+JU/8pw5+iMDYCoOoiDHYEhGfnkzfdU6sGEDMHCg63I+/uvXkt8rf005jHsd5/dqF/4TDDefgGFwGDImtkVcx5Y+q49iMFGoWaDGSyl1/SUikgVnk6mJyWT+y9hRXNmQWS15ecCjj7pXVuZxEVXlVfjmXwdgzDuH/N3NsM2t/F43ArhR1nooflCyv9OQKFWgZrkxFQcRyYDBkBx8kaTUWUuTMw3MS1V9qRo7VxxE/genYdwZia/Ptsdl2A5oTg49CUObn1zn95KLGgYl+3pGldyUHlx6w83lHIiInGEwZOFsTII7P7Bytw7U19J0PS9n7NTN75X/bVNs/iUNF9HJpkyc9Asy9YdhSK+b3yvRyR5l5iwYLC42b1dK94evZ1TJSQ3BpbeUtP4SEakOgyHA8UUiNtb875kz17Y5u3DI3TrgqqXpegsXuvwruLamFt+vOQLjirr5vdoDaG8tY8nvldm3CoaHLPm9AjDux1fdjr7gavo34Nbn43NqCS6JiAKAA6g96Y6qL7O4nLNa3E1DEBMDvPWWw4uYqBU4+Hkh8t8tgvGrcBScbIvTooVNmSiUYUCrAzD0vgzDmAR0vq8tQsJCXL+ur6lxULI/ZlR5izPeiEilOIDaHzzpjgKct0rI3TrgbgvSBx8Ad9xhrlqd/F75G0NgLLoZJbW2A5ot+b0ye12E4QFLfq/b3Hstf1LjoGQlj1vxxZg2IqIgou1gyNPuKMD5hUPOWS1ujkM5rmsL46NfOc3vFYHLuL35fhhuLUfm/bHomZ2GRk38nN/LG2oblGyh1HEragwuiYj8SNvBUEN+/B09V67WgXpamgQACIHJxbPwj3Tb2VyNcAW9o/bDoOb8XoC6BiWrgVqDSyIiP9F2MNSQH39nz5WrdSArC+WvLkXYn/6IJhdLrZtL0RKT8QZya0fZ5PfKHBGJ23+j8vxeFmoZlKwWDC6JiOql7QHUrgY+O6PX+2SwqaP8XvfhQ7yBSYjD6WvlGrXEj/f+AW3/9rvgye/liJIHJasNV2omIhViOg4ZuTWbDHA/IHr6aWDBggbXq25+r/wf4rD7kjm5aTo2IwGncDMOYw6egwRAqvtELV3AgnGRwEBhcElEKsNgSEYu30xHF4n6eNkydOn0JWx55wCMa835vb692B6mOj2V9yIPr2MyElDiemecDk3eYHBJRCrCYEhGbr2ZlovEhg3ACy+43qkba9xY8nvl556DcY8lv5fOpkxq2HFk3ngMD6duRvoXz0CChx+HktbaISIikhHXGfI3y8DnBkxDrr5UjR3LD8D40Rnk74jClnNpTvN7ZRoAw4QUtOnbGjAlASljAU8DISf1UCW2WBARUYAwGLqeB9OQLfm98lf+DON2S36vX9kUaxVSCkPyERjSa5A5oQ1uMrS2z+9VUOD5ekee1lfJgjlnFhERKR67ya7nYoaZgISLjVvi4ajVKCjtgPOimc3jMdJZGBIPwnD7lTr5vSS7/Vjl5QGPPgqcPevZQQXLmCFn6VC0NEiciIgc4pghGXn8Zl69QAsAUp23p/bqnK5R+AirYb5AW/J7ZfaphGFMPH6V5UF+L0/yotUVLIECc2YREVE9OGYoACz5vfLXtMDFFi/ggV8WIRHXxuScQDJmYB4ut9Bjfs+ChuX38jQvWl3epPhQIubMIiIiBdB8MHR8azGM7xTCaATyj6aiyJrfqz/+gOm4A+vRv+lOtGnXBDdNzMC/xnVEoyaNGv7CnuRFkyRg9mygbdvgGlzMnFlERKQAmguGTu35Gca3jsC4wQTjj21QWJOMdBxGAk7hRtSgFDHoFXUIhq7nkJnVDLeNG4CIZkN8UBE3L/CxscDixepvBXKEObOIiEgBNBUM9WjxEw5XdwXQCoB5kUMj+kGPay00tYlJCPn7a74PPty9wL//PnDHHb6tS6AwZxYRESmAmyN9g8Ph6hshoRa3Nt6PpTc+j1zch2TYdlWFnDppHtScl+fbylgCAcnJTDNJMq90HcxjZSwJWQH794EJWYmIyE80FQz9+/c7cOancuy8cAvGX3nLPucXcK2FIifHPMjZlx591HmLCKCNQCAryzwrLinJdntysvpnyxERkSpoc2p9QQFgMLh+oq9SXbjKhabF5JlcgZqIiK7DqfW+FMhZTK7WFpozB5g1S3uBgCUdChERkZ+prpts3rx5kCQJOTk53u8kULOYXK0tJEnA22/L+5reMpnMLWgrV5r/9XWXIRERUYCoKhjavn07Fi9ejM6dOzdsR+4OXpZ7FpMniwwGUl6eeWVogwEYO9b8b0qK7weVExERBYBqgqGLFy/i17/+Nd566y00b968YTsL1CwmNSwyaOnGuz5oKy72zyw7IiIiP1NNMDR58mQMHToUAwcOdFm2qqoK5eXlNjc7gZjFpPRFBuvrxvPnLDsiIiI/UsUA6lWrVmHXrl3Yvn27W+XnzZuHOXPmuC6YlQWMGOG/WUxKX2SQucKIiEiDFN8yVFRUhCeffBLLly9HRESEW8+ZOXMmysrKrLeioiLnhS2zmMaMMf/ry1lcSl9kUA3deERERDJTfDC0c+dOlJaWonv37ggLC0NYWBg2btyI1157DWFhYTA56LLR6XSIioqyuSmGkhcZVHo3HhERkQ8oftHFCxcu4NixYzbbJkyYgLS0NEyfPh2dOnVyuQ+bRZuaNlXG4n5KXGTQZDLPGnPVjVdYGPi6EhFR0OOii1dFRkbaBTxNmzZFbGysW4GQjY8/BmbOtB0Xk5xs7rryd4uMEhcZtHTjjRplDnzqBkRK6MYjIiLyAcV3k8kqO1ubU8Y9WUBRyd14REREPqD4bjI5WJvZADhsZAvm7h9HedDcaQ1TYjceERFpir+6yRgM1eWrxKyB4iwPmqXLiy09RESkYP4KhrTVTeZKME0Z5wKKREREbmEwVFcwTRlXSx40IiKiAFP8bDK/CPTKz77ABRSJiIjcor2WISWu/OwLXECRiIjILdoKht57TztTxi150K4P/iwkCdDrg6s1jIiIyAva6ia75x5zDjItTBnnAopERERu0VYwBChz5WdfsSyg6GidoYULg681jIiIyAvaC4a0JisLGDFCG61hREREXmAwpAVaag0jIiLyEIMhuTGNBRERkaowGJKTt3nAiIiIKGC0NbXelyx5wK5f9bm42Lw9Ly8w9SIiIqJ6MRiSA/OAERERqRaDITkwDxgREZFqMRiSA/OAERERqRaDITkwDxgREZFqMRiSA/OAERERqRaDITlY8oAB9gER84AREREpGoMhuVjygCUl2W5PTjZv5zpDREREisRFF+XEPGBERESqw2BIbswDRkREpCrsJiMiIiJNY8uQt5iQlYiIKCgwGPIGE7ISEREFDXaTeYoJWYmIiIIKgyFPMCErERFR0GEw5AkmZCUiIgo6DIY8wYSsREREQYfBkCeYkJWIiCjoMBjyBBOyEhERBR0GQ55gQlYiIqKgw2DIU0zISkREFFS46KI3mJCViIgoaDAY8pZaE7IyjQgREZENBkNawjQiREREdjhmSCuYRoSIiMghBkNawDQiRERETik+GJo3bx569uyJyMhIxMXFYeTIkTh48GCgq6UuTCNCRETklOKDoY0bN2Ly5MnYtm0b1q1bh5qaGgwePBgVFRWBrpp6MI0IERGRU4ofQP3555/b3F+6dCni4uKwc+dO9O/fP0C1UhmmESEiInJK8cHQ9crKygAAMTExTstUVVWhqqrKer+8vNzn9VI0SxqR4mLH44Ykyfw404gQEZEGKb6brC4hBKZNm4Z+/fqhU6dOTsvNmzcP0dHR1pter/djLRWIaUSIiIicUlUwNGXKFOzduxcrV66st9zMmTNRVlZmvRUVFfmphgrGNCJEREQOqaab7IknnsDHH3+MTZs2ITk5ud6yOp0OOp3OTzVTEaYRISIisqP4YEgIgSeeeAKrV69GQUEBUlNTA10ldVNrGhEiIiIfUXwwNHnyZKxYsQJr165FZGQkSkpKAADR0dFo3LhxgGtHREREaicJ4Wh6kXJI1w/4vWrp0qUYP368W/soLy9HdHQ0ysrKEBUVJWPtiIiIyFf8df1WfMuQwmM1IiIiUjlVzSYjIiIikhuDISIiItI0BkNERESkaQyGiIiISNMYDBEREZGmMRgiIiIiTWMwRERERJrGYIiIiIg0jcEQERERaRqDISIiItI0BkNERESkaQyGiIiISNMYDBEREZGmMRgiIiIiTWMwRERERJrGYIiIiIg0jcEQERERaRqDISIiItI0BkNERESkaQyGiIiISNMYDBEREZGmMRgiIiIiTWMwRERERJrGYIiIiIg0jcEQERERaRqDISIiItI0BkNERESkaQyGiIiISNMYDBEREZGmMRgiIiIiTWMwRERERJrGYIiIiIg0jcEQERERaRqDISIiItI0BkNERESkaQyGiIiISNMYDBEREZGmMRgiIiIiTVNNMPTGG28gNTUVERER6N69OzZv3hzoKhEREVEQUEUw9P777yMnJwezZs3C7t27kZ6ejrvuugvHjx8PdNWIiIhI5SQhhAh0JVy57bbbcOutt+If//iHdVv79u0xcuRIzJs3z+Xzy8vLER0djbKyMkRFRfmyqkRERCQTf12/Fd8ydOXKFezcuRODBw+22T548GBs2bIlQLUiIiKiYBEW6Aq4cvr0aZhMJrRq1cpme6tWrVBSUuLwOVVVVaiqqrLeLysrA2COMImIiEgdLNdtX3diKT4YspAkyea+EMJum8W8efMwZ84cu+16vd4ndSMiIiLfOXPmDKKjo322f8UHQy1atEBoaKhdK1Bpaalda5HFzJkzMW3aNOv98+fPo02bNjh+/LhP30ylKS8vh16vR1FRkabGSvG4edxawOPmcWtBWVkZWrdujZiYGJ++juKDofDwcHTv3h3r1q3Dvffea92+bt06jBgxwuFzdDoddDqd3fbo6GhNfYksoqKieNwawuPWFh63tmj1uENCfDvEWfHBEABMmzYN2dnZ6NGjB/r06YPFixfj+PHj+N3vfhfoqhEREZHKqSIYeuCBB3DmzBk8//zzOHXqFDp16oT//ve/aNOmTaCrRkRERCqnimAIACZNmoRJkyZ59VydTofnnnvOYddZMONx87i1gMfN49YCHrdvj1sViy4SERER+YriF10kIiIi8iUGQ0RERKRpDIaIiIhI0xgMERERkaapMhh64403kJqaioiICHTv3h2bN2+ut/zGjRvRvXt3RERE4MYbb8Sbb75pVyY3NxcdOnSATqdDhw4dsHr1al9V32ueHHdeXh4GDRqEli1bIioqCn369MEXX3xhU2bZsmWQJMnuVllZ6etD8Ygnx11QUODwmA4cOGBTLtg+7/Hjxzs87o4dO1rLqOHz3rRpE4YPH47ExERIkoQ1a9a4fE4wnN+eHnewnN+eHnewnN+eHnewnN/z5s1Dz549ERkZibi4OIwcORIHDx50+Tx/nOOqC4bef/995OTkYNasWdi9ezfS09Nx11134fjx4w7LFxYW4u6770Z6ejp2796NP/3pT5g6dSpyc3OtZbZu3YoHHngA2dnZ+O6775CdnY3Ro0fjm2++8ddhueTpcW/atAmDBg3Cf//7X+zcuRMGgwHDhw/H7t27bcpFRUXh1KlTNreIiAh/HJJbPD1ui4MHD9ocU9u2ba2PBePn/eqrr9ocb1FREWJiYnD//ffblFP6511RUYEuXbpg0aJFbpUPlvPb0+MOlvPb0+O2UPv57elxB8v5vXHjRkyePBnbtm3DunXrUFNTg8GDB6OiosLpc/x2jguV6dWrl/jd735nsy0tLU3MmDHDYfk//vGPIi0tzWbbY489Jnr37m29P3r0aHHnnXfalBkyZIh48MEHZap1w3l63I506NBBzJkzx3p/6dKlIjo6Wq4q+oSnx200GgUAce7cOaf71MLnvXr1aiFJkjh69Kh1mxo+77oAiNWrV9dbJljO77rcOW5H1Hh+1+XOcQfL+V2XN593MJzfQghRWloqAIiNGzc6LeOvc1xVLUNXrlzBzp07MXjwYJvtgwcPxpYtWxw+Z+vWrXblhwwZgh07dqC6urreMs726W/eHPf1amtrceHCBbtkdxcvXkSbNm2QnJyMYcOG2f1lGUgNOe5u3bohISEBd9xxB4xGo81jWvi8lyxZgoEDB9qt0q7kz9sbwXB+y0GN53dDqPn8lkOwnN9lZWUAUG8SVn+d46oKhk6fPg2TyWSXrb5Vq1Z2We0tSkpKHJavqanB6dOn6y3jbJ/+5s1xX+9vf/sbKioqMHr0aOu2tLQ0LFu2DB9//DFWrlyJiIgI9O3bF4cPH5a1/t7y5rgTEhKwePFi5ObmIi8vD+3atcMdd9yBTZs2WcsE++d96tQpfPbZZ5g4caLNdqV/3t4IhvNbDmo8v70RDOd3QwXL+S2EwLRp09CvXz906tTJaTl/neOqScdRlyRJNveFEHbbXJW/frun+wwEb+u4cuVKzJ49G2vXrkVcXJx1e+/evdG7d2/r/b59++LWW2/F3//+d7z22mvyVbyBPDnudu3aoV27dtb7ffr0QVFREV566SX079/fq30Gird1XLZsGZo1a4aRI0fabFfL5+2pYDm/vaX289sTwXR+eytYzu8pU6Zg7969+Oqrr1yW9cc5rqqWoRYtWiA0NNQu2istLbWLCi3i4+Mdlg8LC0NsbGy9ZZzt09+8OW6L999/H4888gg++OADDBw4sN6yISEh6Nmzp2L+kmjIcdfVu3dvm2MK5s9bCIF33nkH2dnZCA8Pr7es0j5vbwTD+d0Qaj6/5aK287shguX8fuKJJ/Dxxx/DaDQiOTm53rL+OsdVFQyFh4eje/fuWLdunc32devW4fbbb3f4nD59+tiV//LLL9GjRw80atSo3jLO9ulv3hw3YP6Lcfz48VixYgWGDh3q8nWEENizZw8SEhIaXGc5eHvc19u9e7fNMQXr5w2YZ2scOXIEjzzyiMvXUdrn7Y1gOL+9pfbzWy5qO78bQu3ntxACU6ZMQV5eHvLz85GamuryOX47x90eaq0Qq1atEo0aNRJLliwR+/btEzk5OaJp06bWUfUzZswQ2dnZ1vI//fSTaNKkifj9738v9u3bJ5YsWSIaNWokPvroI2uZr7/+WoSGhoq//vWvYv/+/eKvf/2rCAsLE9u2bfP78Tnj6XGvWLFChIWFiddff12cOnXKejt//ry1zOzZs8Xnn38ufvzxR7F7924xYcIEERYWJr755hu/H58znh73K6+8IlavXi0OHTokvv/+ezFjxgwBQOTm5lrLBOPnbfHQQw+J2267zeE+1fB5X7hwQezevVvs3r1bABAvv/yy2L17tzh27JgQInjPb0+PO1jOb0+PO1jOb0+P20Lt5/fjjz8uoqOjRUFBgc339tKlS9YygTrHVRcMCSHE66+/Ltq0aSPCw8PFrbfeajMtb9y4cWLAgAE25QsKCkS3bt1EeHi4SElJEf/4xz/s9vnhhx+Kdu3aiUaNGom0tDSbk0spPDnuAQMGCAB2t3HjxlnL5OTkiNatW4vw8HDRsmVLMXjwYLFlyxY/HpF7PDnu+fPni5tuuklERESI5s2bi379+olPP/3Ubp/B9nkLIcT58+dF48aNxeLFix3uTw2ft2XqtLPvbbCe354ed7Cc354ed7Cc3958z4Ph/HZ0zADE0qVLrWUCdY5LVytIREREpEmqGjNEREREJDcGQ0RERKRpDIaIiIhI0xgMERERkaYxGCIiIiJNYzBEREREmsZgiIiIiDSNwRARERFpGoMhIiIi0jQGQ0RERKRpDIaISJVWrlyJiIgIFBcXW7dNnDgRnTt3RllZWQBrRkRqw9xkRKRKQgh07doV6enpWLRoEebMmYO3334b27ZtQ1JSUqCrR0QqEhboChAReUOSJMydOxejRo1CYmIiXn31VWzevJmBEBF5jC1DRKRqt956K3744Qd8+eWXGDBgQKCrQ0QqxDFDRKRaX3zxBQ4cOACTyYRWrVoFujpEpFJsGSIiVdq1axcyMjLw+uuvY9WqVWjSpAk+/PDDQFeLiFSIY4aISHWOHj2KoUOHYsaMGcjOzkaHDh3Qs2dP7Ny5E927dw909YhIZdgyRESqcvbsWfTt2xf9+/fHP//5T+v2ESNGoKqqCp9//nkAa0dEasRgiIiIiDSNA6iJiIhI0xgMERERkaYxGCIiIiJNYzBEREREmsZgiIiIiDSNwRARERFpGoMhIiIi0jQGQ0RERKRpDIaIiIhI0xgMERERkaYxGCIiIiJNYzBEREREmvb/XfCzMyH0rGwAAAAASUVORK5CYII=", "text/plain": [ "
" ] @@ -767,8 +845,10 @@ }, { "cell_type": "markdown", - "id": "7e858f37", - "metadata": {}, + "id": "af8f3db9", + "metadata": { + "editable": true + }, "source": [ "## Replace or not\n", "\n", @@ -780,8 +860,10 @@ }, { "cell_type": "markdown", - "id": "7dace8c0", - "metadata": {}, + "id": "ce1d1147", + "metadata": { + "editable": true + }, "source": [ "## Momentum based GD\n", "\n", @@ -793,8 +875,10 @@ }, { "cell_type": "markdown", - "id": "3cd079d0", - "metadata": {}, + "id": "b8750f09", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\mathbf{v}_{t}=\\gamma \\mathbf{v}_{t-1}+\\eta_{t}\\nabla_\\theta E(\\boldsymbol{\\theta}_t) \\nonumber\n", @@ -803,8 +887,10 @@ }, { "cell_type": "markdown", - "id": "305a75c3", - "metadata": {}, + "id": "6b18d51a", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -819,8 +905,10 @@ }, { "cell_type": "markdown", - "id": "026d8598", - "metadata": {}, + "id": "efa3113f", + "metadata": { + "editable": true + }, "source": [ "where we have introduced a momentum parameter $\\gamma$, with\n", "$0\\le\\gamma\\le 1$, and for brevity we dropped the explicit notation to\n", @@ -836,8 +924,10 @@ }, { "cell_type": "markdown", - "id": "80e73593", - "metadata": {}, + "id": "2007f72c", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\Delta \\boldsymbol{\\theta}_{t+1} = \\gamma \\Delta \\boldsymbol{\\theta}_t -\\ \\eta_{t}\\nabla_\\theta E(\\boldsymbol{\\theta}_t),\n", @@ -846,16 +936,20 @@ }, { "cell_type": "markdown", - "id": "4a5b87d4", - "metadata": {}, + "id": "149a0faa", + "metadata": { + "editable": true + }, "source": [ "where we have defined $\\Delta \\boldsymbol{\\theta}_{t}= \\boldsymbol{\\theta}_t-\\boldsymbol{\\theta}_{t-1}$." ] }, { "cell_type": "markdown", - "id": "f9bbf0cd", - "metadata": {}, + "id": "3930d988", + "metadata": { + "editable": true + }, "source": [ "## More on momentum based approaches\n", "\n", @@ -868,8 +962,10 @@ }, { "cell_type": "markdown", - "id": "9e7986cc", - "metadata": {}, + "id": "8560c22c", + "metadata": { + "editable": true + }, "source": [ "$$\n", "m {d^2 \\mathbf{w} \\over dt^2} + \\mu {d \\mathbf{w} \\over dt }= -\\nabla_w E(\\mathbf{w}).\n", @@ -878,16 +974,20 @@ }, { "cell_type": "markdown", - "id": "50d69000", - "metadata": {}, + "id": "6f4563fe", + "metadata": { + "editable": true + }, "source": [ "We can discretize this equation in the usual way to get" ] }, { "cell_type": "markdown", - "id": "e7d9df0a", - "metadata": {}, + "id": "8fe2b7ac", + "metadata": { + "editable": true + }, "source": [ "$$\n", "m { \\mathbf{w}_{t+\\Delta t}-2 \\mathbf{w}_{t} +\\mathbf{w}_{t-\\Delta t} \\over (\\Delta t)^2}+\\mu {\\mathbf{w}_{t+\\Delta t}- \\mathbf{w}_{t} \\over \\Delta t} = -\\nabla_w E(\\mathbf{w}).\n", @@ -896,16 +996,20 @@ }, { "cell_type": "markdown", - "id": "e6f67ad8", - "metadata": {}, + "id": "207eae67", + "metadata": { + "editable": true + }, "source": [ "Rearranging this equation, we can rewrite this as" ] }, { "cell_type": "markdown", - "id": "443f0b02", - "metadata": {}, + "id": "9770730e", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\Delta \\mathbf{w}_{t +\\Delta t}= - { (\\Delta t)^2 \\over m +\\mu \\Delta t} \\nabla_w E(\\mathbf{w})+ {m \\over m +\\mu \\Delta t} \\Delta \\mathbf{w}_t.\n", @@ -914,8 +1018,10 @@ }, { "cell_type": "markdown", - "id": "d89ab74d", - "metadata": {}, + "id": "c233679d", + "metadata": { + "editable": true + }, "source": [ "## Momentum parameter\n", "\n", @@ -928,8 +1034,10 @@ }, { "cell_type": "markdown", - "id": "3401047f", - "metadata": {}, + "id": "cf54be10", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\gamma= {m \\over m +\\mu \\Delta t }, \\qquad \\eta = {(\\Delta t)^2 \\over m +\\mu \\Delta t}.\n", @@ -938,8 +1046,10 @@ }, { "cell_type": "markdown", - "id": "c7c24040", - "metadata": {}, + "id": "35f187e7", + "metadata": { + "editable": true + }, "source": [ "Thus, as the name suggests, the momentum parameter is proportional to\n", "the mass of the particle and effectively provides inertia.\n", @@ -969,8 +1079,10 @@ }, { "cell_type": "markdown", - "id": "22e04f6c", - "metadata": {}, + "id": "476338d5", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\mathbf{v}_{t}=\\gamma \\mathbf{v}_{t-1}+\\eta_{t}\\nabla_\\theta E(\\boldsymbol{\\theta}_t +\\gamma \\mathbf{v}_{t-1}) \\nonumber\n", @@ -979,8 +1091,10 @@ }, { "cell_type": "markdown", - "id": "65b1fa09", - "metadata": {}, + "id": "c23f6df7", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -995,16 +1109,20 @@ }, { "cell_type": "markdown", - "id": "7acccb8b", - "metadata": {}, + "id": "e36c0680", + "metadata": { + "editable": true + }, "source": [ "One of the major advantages of NAG is that it allows for the use of a larger learning rate than GDM for the same choice of $\\gamma$." ] }, { "cell_type": "markdown", - "id": "795e6ab5", - "metadata": {}, + "id": "484048bb", + "metadata": { + "editable": true + }, "source": [ "## Second moment of the gradient\n", "\n", @@ -1032,8 +1150,10 @@ }, { "cell_type": "markdown", - "id": "dec5061d", - "metadata": {}, + "id": "ed915ab1", + "metadata": { + "editable": true + }, "source": [ "## RMS prop\n", "\n", @@ -1045,8 +1165,10 @@ }, { "cell_type": "markdown", - "id": "3dfb0934", - "metadata": {}, + "id": "c4d8b1a8", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -1061,8 +1183,10 @@ }, { "cell_type": "markdown", - "id": "bf4b7a89", - "metadata": {}, + "id": "6819d54f", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\mathbf{s}_t =\\beta \\mathbf{s}_{t-1} +(1-\\beta)\\mathbf{g}_t^2 \\nonumber\n", @@ -1071,8 +1195,10 @@ }, { "cell_type": "markdown", - "id": "510c8591", - "metadata": {}, + "id": "c38fa00d", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\boldsymbol{\\theta}_{t+1}=\\boldsymbol{\\theta}_t - \\eta_t { \\mathbf{g}_t \\over \\sqrt{\\mathbf{s}_t +\\epsilon}}, \\nonumber\n", @@ -1081,8 +1207,10 @@ }, { "cell_type": "markdown", - "id": "1a0e569f", - "metadata": {}, + "id": "7ff83ef0", + "metadata": { + "editable": true + }, "source": [ "where $\\beta$ controls the averaging time of the second moment and is\n", "typically taken to be about $\\beta=0.9$, $\\eta_t$ is a learning rate\n", @@ -1097,8 +1225,10 @@ }, { "cell_type": "markdown", - "id": "977c9c79", - "metadata": {}, + "id": "ba98f789", + "metadata": { + "editable": true + }, "source": [ "## [ADAM optimizer](https://arxiv.org/abs/1412.6980)\n", "\n", @@ -1124,8 +1254,10 @@ }, { "cell_type": "markdown", - "id": "d188330b", - "metadata": {}, + "id": "03428756", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -1140,8 +1272,10 @@ }, { "cell_type": "markdown", - "id": "776b649a", - "metadata": {}, + "id": "ef5b461b", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\mathbf{m}_t = \\beta_1 \\mathbf{m}_{t-1} + (1-\\beta_1) \\mathbf{g}_t \\nonumber\n", @@ -1150,8 +1284,10 @@ }, { "cell_type": "markdown", - "id": "6f8a0d72", - "metadata": {}, + "id": "0149850a", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\mathbf{s}_t =\\beta_2 \\mathbf{s}_{t-1} +(1-\\beta_2)\\mathbf{g}_t^2 \\nonumber\n", @@ -1160,8 +1296,10 @@ }, { "cell_type": "markdown", - "id": "53f1a2ce", - "metadata": {}, + "id": "4ae41be8", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\boldsymbol{\\mathbf{m}}_t={\\mathbf{m}_t \\over 1-\\beta_1^t} \\nonumber\n", @@ -1170,8 +1308,10 @@ }, { "cell_type": "markdown", - "id": "cc7cd55a", - "metadata": {}, + "id": "5d36d54a", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\boldsymbol{\\mathbf{s}}_t ={\\mathbf{s}_t \\over1-\\beta_2^t} \\nonumber\n", @@ -1180,8 +1320,10 @@ }, { "cell_type": "markdown", - "id": "6bd6e651", - "metadata": {}, + "id": "08eb5528", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\boldsymbol{\\theta}_{t+1}=\\boldsymbol{\\theta}_t - \\eta_t { \\boldsymbol{\\mathbf{m}}_t \\over \\sqrt{\\boldsymbol{\\mathbf{s}}_t} +\\epsilon}, \\nonumber\n", @@ -1190,8 +1332,10 @@ }, { "cell_type": "markdown", - "id": "677f1aef", - "metadata": {}, + "id": "4a5e4b7b", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -1205,8 +1349,10 @@ }, { "cell_type": "markdown", - "id": "4bb1d86d", - "metadata": {}, + "id": "b71679d3", + "metadata": { + "editable": true + }, "source": [ "where $\\beta_1$ and $\\beta_2$ set the memory lifetime of the first and\n", "second moment and are typically taken to be $0.9$ and $0.99$\n", @@ -1222,8 +1368,10 @@ }, { "cell_type": "markdown", - "id": "812cca90", - "metadata": {}, + "id": "a9910c4b", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\Delta \\theta_{t+1}= -\\eta_t { \\boldsymbol{m}_t \\over \\sqrt{\\sigma_t^2 + m_t^2 }+\\epsilon}.\n", @@ -1232,8 +1380,10 @@ }, { "cell_type": "markdown", - "id": "51ddf251", - "metadata": {}, + "id": "85d963d2", + "metadata": { + "editable": true + }, "source": [ "## Algorithms and codes for Adagrad, RMSprop and Adam\n", "\n", @@ -1244,8 +1394,10 @@ }, { "cell_type": "markdown", - "id": "676bc1af", - "metadata": {}, + "id": "bc9de56d", + "metadata": { + "editable": true + }, "source": [ "## AdaGrad algorithm, taken from [Goodfellow et al](https://www.deeplearningbook.org/contents/optimization.html)\n", "\n", @@ -1258,8 +1410,10 @@ }, { "cell_type": "markdown", - "id": "5e0a4bd5", - "metadata": {}, + "id": "e6293208", + "metadata": { + "editable": true + }, "source": [ "## RMSProp algorithm, taken from [Goodfellow et al](https://www.deeplearningbook.org/contents/optimization.html)\n", "\n", @@ -1272,8 +1426,10 @@ }, { "cell_type": "markdown", - "id": "d9eccc07", - "metadata": {}, + "id": "40fde17d", + "metadata": { + "editable": true + }, "source": [ "## ADAM algorithm, taken from [Goodfellow et al](https://www.deeplearningbook.org/contents/optimization.html)\n", "\n", @@ -1286,8 +1442,10 @@ }, { "cell_type": "markdown", - "id": "b81a38cf", - "metadata": {}, + "id": "f9066e5f", + "metadata": { + "editable": true + }, "source": [ "## Practical tips\n", "\n", @@ -1304,8 +1462,10 @@ }, { "cell_type": "markdown", - "id": "2be4b8ad", - "metadata": {}, + "id": "cfac43d8", + "metadata": { + "editable": true + }, "source": [ "## Automatic differentiation\n", "\n", @@ -1340,8 +1500,10 @@ }, { "cell_type": "markdown", - "id": "78ce59cc", - "metadata": {}, + "id": "6c1afa20", + "metadata": { + "editable": true + }, "source": [ "$$\n", "f(x) = \\sin\\left(2\\pi x + x^2\\right)\n", @@ -1350,16 +1512,20 @@ }, { "cell_type": "markdown", - "id": "a1de3aaf", - "metadata": {}, + "id": "4c038cf3", + "metadata": { + "editable": true + }, "source": [ "which has the following derivative" ] }, { "cell_type": "markdown", - "id": "99aa41ec", - "metadata": {}, + "id": "eed0ca87", + "metadata": { + "editable": true + }, "source": [ "$$\n", "f'(x) = \\cos\\left(2\\pi x + x^2\\right)\\left(2\\pi + 2x\\right)\n", @@ -1368,8 +1534,10 @@ }, { "cell_type": "markdown", - "id": "76989f22", - "metadata": {}, + "id": "3f493ed1", + "metadata": { + "editable": true + }, "source": [ "Using **autograd** we have" ] @@ -1377,8 +1545,11 @@ { "cell_type": "code", "execution_count": 7, - "id": "b9cd37f2", - "metadata": {}, + "id": "f42e9964", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "data": { @@ -1441,8 +1612,10 @@ }, { "cell_type": "markdown", - "id": "7f495197", - "metadata": {}, + "id": "9a9dd7cb", + "metadata": { + "editable": true + }, "source": [ "## Using autograd\n", "\n", @@ -1456,8 +1629,11 @@ { "cell_type": "code", "execution_count": 8, - "id": "3e79535c", - "metadata": {}, + "id": "f5d99737", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "name": "stdout", @@ -1490,8 +1666,10 @@ }, { "cell_type": "markdown", - "id": "9d764d7c", - "metadata": {}, + "id": "1a033f2a", + "metadata": { + "editable": true + }, "source": [ "## Autograd with more complicated functions\n", "\n", @@ -1503,8 +1681,11 @@ { "cell_type": "code", "execution_count": 9, - "id": "b171c0bc", - "metadata": {}, + "id": "36ba3883", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "name": "stdout", @@ -1558,16 +1739,20 @@ }, { "cell_type": "markdown", - "id": "65098808", - "metadata": {}, + "id": "98a7ad40", + "metadata": { + "editable": true + }, "source": [ "Note that the grad function will not produce the true gradient of the function. The true gradient of a function with two or more variables will produce a vector, where each element is the function differentiated w.r.t a variable." ] }, { "cell_type": "markdown", - "id": "5d60df18", - "metadata": {}, + "id": "a840a46c", + "metadata": { + "editable": true + }, "source": [ "## More complicated functions using the elements of their arguments directly" ] @@ -1575,8 +1760,11 @@ { "cell_type": "code", "execution_count": 10, - "id": "cc4cc7eb", - "metadata": {}, + "id": "0ce16fc4", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "name": "stdout", @@ -1609,8 +1797,10 @@ }, { "cell_type": "markdown", - "id": "d71a9a54", - "metadata": {}, + "id": "470f7e16", + "metadata": { + "editable": true + }, "source": [ "Note that in this case, when sending an array as input argument, the\n", "output from Autograd is another array. This is the true gradient of\n", @@ -1622,8 +1812,10 @@ }, { "cell_type": "markdown", - "id": "290988a2", - "metadata": {}, + "id": "4d7c7e61", + "metadata": { + "editable": true + }, "source": [ "## Functions using mathematical functions from Numpy" ] @@ -1631,8 +1823,11 @@ { "cell_type": "code", "execution_count": 11, - "id": "4afa9fe3", - "metadata": {}, + "id": "69eceec6", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "name": "stdout", @@ -1665,8 +1860,10 @@ }, { "cell_type": "markdown", - "id": "ec23dce0", - "metadata": {}, + "id": "02192e06", + "metadata": { + "editable": true + }, "source": [ "## More autograd" ] @@ -1674,8 +1871,11 @@ { "cell_type": "code", "execution_count": 12, - "id": "be794060", - "metadata": {}, + "id": "6f5d7fa7", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "name": "stdout", @@ -1704,8 +1904,10 @@ }, { "cell_type": "markdown", - "id": "1d8e15c2", - "metadata": {}, + "id": "25b7c609", + "metadata": { + "editable": true + }, "source": [ "## And with loops" ] @@ -1713,8 +1915,11 @@ { "cell_type": "code", "execution_count": 13, - "id": "d696c96c", - "metadata": {}, + "id": "043eb7de", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "name": "stdout", @@ -1755,8 +1960,11 @@ { "cell_type": "code", "execution_count": 14, - "id": "5cdbff7d", - "metadata": {}, + "id": "880bc7f0", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "name": "stdout", @@ -1780,8 +1988,10 @@ }, { "cell_type": "markdown", - "id": "ec95c41c", - "metadata": {}, + "id": "322163dd", + "metadata": { + "editable": true + }, "source": [ "## Using recursion" ] @@ -1789,8 +1999,11 @@ { "cell_type": "code", "execution_count": 15, - "id": "06c8423e", - "metadata": {}, + "id": "09f1a79b", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "name": "stdout", @@ -1833,16 +2046,20 @@ }, { "cell_type": "markdown", - "id": "4675445a", - "metadata": {}, + "id": "33d9596d", + "metadata": { + "editable": true + }, "source": [ "Note that if n is equal to zero or one, Autograd will give an error message. This message appears when the output is independent on input." ] }, { "cell_type": "markdown", - "id": "3ea2267f", - "metadata": {}, + "id": "2b87a3af", + "metadata": { + "editable": true + }, "source": [ "## Using Autograd with OLS\n", "\n", @@ -1854,25 +2071,28 @@ { "cell_type": "code", "execution_count": 16, - "id": "49c5a124", - "metadata": {}, + "id": "4674f449", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Own inversion\n", - "[[3.62286539]\n", - " [3.36754671]]\n", - "Eigenvalues of Hessian Matrix:[0.30134885 4.08702578]\n", + "[[3.88064505]\n", + " [2.99072374]]\n", + "Eigenvalues of Hessian Matrix:[0.30141906 4.73853838]\n", "theta from own gd\n", - "[[3.62286539]\n", - " [3.36754671]]\n" + "[[3.88064505]\n", + " [2.99072374]]\n" ] }, { "data": { - "image/png": "iVBORw0KGgoAAAANSUhEUgAAAkMAAAHFCAYAAADxOP3DAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjguMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy81sbWrAAAACXBIWXMAAA9hAAAPYQGoP6dpAABV2UlEQVR4nO3deVxU5eIG8OcAMogLCoqyqeh133dNcbmpZWoaApVly213KbJFze5VS/Nm3bKyrtd7S383wwQFLG0zBdGsrrnvS6HigriCoCAM7++P44wMzDALZ2bOzHm+nw8fnDNnzrxnFs/Du0pCCAEiIiIijfJxdwGIiIiI3IlhiIiIiDSNYYiIiIg0jWGIiIiINI1hiIiIiDSNYYiIiIg0jWGIiIiINI1hiIiIiDSNYYiIiIg0jWGISIWWL18OSZKMP35+fggLC8MDDzyAY8eOua1cc+bMgSRJbnt+T3DixAlIkoR3333X3UUhIhv5ubsARGTZsmXL0K5dOxQXF+Onn37C/PnzkZGRgcOHD6Nhw4buLh4RkVdgGCJSsU6dOqFXr14AgCFDhkCv12P27NlIT0/H448/7ubSkTuVlpYaaw2JqGbYTEbkQQzB6Pz588ZtxcXFeOmll9CtWzcEBQUhODgY/fv3x9q1a6s8XpIkTJkyBZ9//jnat2+PwMBAdO3aFevWrauy7/r169GtWzfodDpER0dbbPYpLi7GzJkzER0dDX9/f0RERGDy5Mm4evWqyX4tWrTA6NGjsW7dOnTv3h21a9dG+/btjc+9fPlytG/fHnXq1EGfPn3w22+/WX09DM2JGRkZeO6559CoUSOEhIQgNjYWZ8+erXLuc+bMqXKMFi1a4LHHHqtyzE2bNuGpp55CSEgI6tevj0ceeQRFRUXIzc1FQkICGjRogLCwMLz88ssoLS2tctzy8nLMnz8fzZo1Q0BAAHr16oWNGzdW2e/YsWOYMGECQkNDodPp0L59e3z88ccm+2RmZkKSJHz++ed46aWXEBERAZ1Oh+PHj+P69et4+eWXER0djYCAAAQHB6NXr15YuXKl1dePiGT8k4LIg2RnZwMA2rRpY9xWUlKCy5cv4+WXX0ZERARu3ryJH3/8EbGxsVi2bBkeeeQRk2OsX78e27dvxxtvvIG6deti4cKFuO+++3DkyBG0bNkSALBx40aMHTsW/fv3x5dffgm9Xo+FCxeahDAAEEJg3Lhx2LhxI2bOnImYmBjs3bsXs2fPxs8//4yff/4ZOp3OuP+ePXswc+ZMzJo1C0FBQZg7dy5iY2Mxc+ZMbNy4EW+99RYkScL06dMxevRoZGdno3bt2lZflyeffBKjRo1CUlIScnJy8Morr+Dhhx/Gpk2bHH6tn3zyScTGxuLLL7/Erl278Nprr6GsrAxHjhxBbGwsnn76afz44494++23ER4ejmnTppk8fvHixWjevDkWLVqE8vJyLFy4ECNHjsTmzZvRv39/AMDBgwdxxx13oFmzZvjHP/6Bpk2b4vvvv8fzzz+PixcvYvbs2SbHnDlzJvr3748lS5bAx8cHoaGhmDZtGj7//HPMmzcP3bt3R1FREfbv349Lly45fO5EmiOISHWWLVsmAIhffvlFlJaWimvXronvvvtONG3aVAwaNEiUlpZafGxZWZkoLS0VTzzxhOjevbvJfQBEkyZNREFBgXFbbm6u8PHxEQsWLDBu69u3rwgPDxc3btwwbisoKBDBwcGi4n8b3333nQAgFi5caPI8q1atEgDE0qVLjduaN28uateuLU6fPm3ctnv3bgFAhIWFiaKiIuP29PR0AUB89dVXNr1OkyZNMtm+cOFCAUCcO3fO5Nxnz55d5RjNmzcXjz76aJVjTp061WS/cePGCQDivffeM9nerVs30aNHD+Pt7OxsAcDi6zds2DDjtrvuuktERkaK/Px8k2NOmTJFBAQEiMuXLwshhMjIyBAAxKBBg6qUv1OnTmLcuHFVthOR7dhMRqRi/fr1Q61atVCvXj3cfffdaNiwIdauXVuln0hKSgoGDBiAunXrws/PD7Vq1cKnn36KQ4cOVTnm0KFDUa9ePePtJk2aIDQ0FCdPngQAFBUVYfv27YiNjUVAQIBxv3r16mHMmDEmxzLUvFRsZgKA+Ph41KlTp0qzULdu3RAREWG83b59ewByf6jAwMAq2w1lsubee+81ud2lSxe7Hm/O6NGjTW4byjRq1Kgq2809j6XXLysrC3q9HsXFxdi4cSPuu+8+BAYGoqyszPhzzz33oLi4GL/88ovJMcePH1/lefr06YNvv/0WM2bMQGZmJm7cuOHwORNpFcMQkYr997//xfbt27Fp0yY888wzOHToEB588EGTfVJTU5GQkICIiAisWLECP//8M7Zv346//OUvKC4urnLMkJCQKtt0Op3xInrlyhWUl5ejadOmVfarvO3SpUvw8/ND48aNTbZLkoSmTZtWaaoJDg42ue3v71/tdnPlN6fyORma5moSDOwpq7lyWnr9bt68icLCQly6dAllZWX46KOPUKtWLZOfe+65BwBw8eJFk8eHhYVVOeaHH36I6dOnIz09HUOHDkVwcDDGjRvn1ikYiDwN+wwRqVj79u2NnaaHDh0KvV6P//znP1i9ejXi4uIAACtWrEB0dDRWrVplMgdQSUmJQ8/ZsGFDSJKE3NzcKvdV3hYSEoKysjJcuHDBJBAJIZCbm4vevXs7VAZn0Ol0Zl8TZ/WtsfT6+fv7o27duqhVqxZ8fX0xceJETJ482ewxoqOjTW6bm+OpTp06mDt3LubOnYvz588ba4nGjBmDw4cPK3MyRF6ONUNEHmThwoVo2LAh/va3v6G8vByAfIH09/c3uVDm5uaaHU1mC8NortTUVJMaj2vXruHrr7822ffOO+8EIAeyitasWYOioiLj/WrQokUL7N2712Tbpk2bUFhY6JTns/T6xcTEwNfXF4GBgRg6dCh27dqFLl26oFevXlV+zNXiVadJkyZ47LHH8OCDD+LIkSO4fv260qdF5JVYM0TkQRo2bIiZM2fi1VdfRVJSEh5++GGMHj0aqampmDRpEuLi4pCTk4M333wTYWFhDjeVvPnmm7j77rsxfPhwvPTSS9Dr9Xj77bdRp04dXL582bjf8OHDcdddd2H69OkoKCjAgAEDjKPJunfvjokTJyp16jU2ceJE/PWvf8Xf/vY3DB48GAcPHsTixYsRFBTklOfz9fXF8OHDMW3aNJSXl+Ptt99GQUEB5s6da9zngw8+wMCBAxETE4PnnnsOLVq0wLVr13D8+HF8/fXXNo2G69u3L0aPHo0uXbqgYcOGOHToED7//HP079/fpB8WEVnGMETkYaZOnYrFixfjjTfewIMPPojHH38ceXl5WLJkCT777DO0bNkSM2bMwOnTp00uvPYYPnw40tPT8frrr+P+++9H06ZNMWnSJNy4ccPkmJIkIT09HXPmzMGyZcswf/58NGrUCBMnTsRbb71lMqze3V555RUUFBRg+fLlePfdd9GnTx8kJydj7NixTnm+KVOmoLi4GM8//zzy8vLQsWNHrF+/HgMGDDDu06FDB+zcuRNvvvkmXn/9deTl5aFBgwZo3bq1sd+QNX/+85/x1Vdf4f3338f169cRERGBRx55BLNmzXLKeRF5I0kIIdxdCCIiIiJ3YZ8hIiIi0jSGISIiItI0hiEiIiLSNIYhIiIi0jSGISIiItI0hiEiIiLSNE3MM1ReXo6zZ8+iXr16ZqezJyIiIvURQuDatWsIDw+Hj4/z6m80EYbOnj2LqKgodxeDiIiIHJCTk4PIyEinHV8TYahevXoA5Bezfv36bi4NERER2aKgoABRUVHG67izaCIMGZrG6tevzzBERETkYZzdxYUdqImIiEjTGIaIiIhI0xiGiIiISNMYhoiIiEjTGIaIiIhI0xiGiIiISNMYhoiIiEjTGIaIiIhI0xiGiIiISNMYhoiIiEjTGIaIiIhI0xiGiIiISNMYhoiIiEjTGIaIiIhI0xiGiIiISNMYhoiIiEjTGIaIiIhI09wehrKysjBmzBiEh4dDkiSkp6db3PeZZ56BJElYtGiRy8pHRERE3s3tYaioqAhdu3bF4sWLq90vPT0dv/76K8LDw11UMiIiItICP3cXYOTIkRg5cmS1+5w5cwZTpkzB999/j1GjRrmoZERERKQFbq8Zsqa8vBwTJ07EK6+8go4dO7q7OERERORl3F4zZM3bb78NPz8/PP/88zY/pqSkBCUlJcbbBQUFzigaEREReQFV1wzt2LEDH3zwAZYvXw5Jkmx+3IIFCxAUFGT8iYqKcmIpiYiIyJOpOgxt2bIFeXl5aNasGfz8/ODn54eTJ0/ipZdeQosWLSw+bubMmcjPzzf+5OTkuK7QRERE5FFU3Uw2ceJEDBs2zGTbXXfdhYkTJ+Lxxx+3+DidTgedTufs4hEREZEXcHsYKiwsxPHjx423s7OzsXv3bgQHB6NZs2YICQkx2b9WrVpo2rQp2rZt6+qiEhERkRdyexj67bffMHToUOPtadOmAQAeffRRLF++3E2lIiIiIq1wexgaMmQIhBA273/ixAnnFYaIiIg0R9UdqImIiIicjWGIiIiINI1hiIiIiDSNYYiIiIg0jWGIiIiINI1hiIiIiDSNYYiIiIg0jWGIiIiINI1hiIiIiDSNYYiIiIg0jWGIiIiINI1hiIiIiDSNYYiIiIg0jWGIiIiINI1hiIiIiDSNYYiIiIg0jWGIiIiINI1hiIiIiDSNYYiIiIg0jWGIiIiINI1hiIiIiDSNYYiIiIg0jWGIiIiINI1hiIiIiDSNYYiIiIg0jWGIiIiINI1hiIiIiDSNYYiIiIg0jWGIiIiINI1hiIiIiDSNYYiIiIg0jWGIiIiINI1hiIiIiDSNYYiIiIg0jWGIiIiINI1hiIiIiDSNYYiIiIg0jWGIiIiINI1hiIiIiDTN7WEoKysLY8aMQXh4OCRJQnp6uvG+0tJSTJ8+HZ07d0adOnUQHh6ORx55BGfPnnVfgYmIiMiruD0MFRUVoWvXrli8eHGV+65fv46dO3fir3/9K3bu3InU1FQcPXoU9957rxtKSkRERN5IEkIIdxfCQJIkpKWlYdy4cRb32b59O/r06YOTJ0+iWbNmNh23oKAAQUFByM/PR/369RUqLRERETmTq67ffk47spPk5+dDkiQ0aNDA4j4lJSUoKSkx3i4oKHBByYiIiMgTub2ZzB7FxcWYMWMGJkyYUG1CXLBgAYKCgow/UVFRLiwlEREReRKPCUOlpaV44IEHUF5ejk8++aTafWfOnIn8/HzjT05OjotKSURERJ7GI5rJSktLkZCQgOzsbGzatMlqu6FOp4NOp3NR6YiIiMiTqT4MGYLQsWPHkJGRgZCQEHcXiYiIiLyI28NQYWEhjh8/brydnZ2N3bt3Izg4GOHh4YiLi8POnTuxbt066PV65ObmAgCCg4Ph7+/vrmITERGRl3D70PrMzEwMHTq0yvZHH30Uc+bMQXR0tNnHZWRkYMiQITY9B4fWExEReR7NDK0fMmQIqstjKpoGiYiIiLyQx4wmIyIiInIGhiEiIiLSNIYhIiIi0jSGISIiItI0t3egJiIiIpXS64EtW4Bz54CwMCAmBvD1dXepFMcwRERERFWlpgIvvACcPn17W2Qk8MEHQGys+8rlBGwmIyIiIlOpqUBcnGkQAoAzZ+TtqanuKZeTMAwRERHRbXq9XCNkbp4/w7bERHk/L8EwRERERLdt2VK1RqgiIYCcHHk/L8EwRERERLedO6fsfh6AYYiIiIhuCwtTdj8PwDBEREREt8XEyKPGJMn8/ZIEREXJ+3kJhiEiIiK6zddXHj4PVA1EhtuLFnnVfEMMQ0RERGQqNhZYvRqIiDDdHhkpb/eyeYY46SIRERFVFRsLjB3LGaiJiIhIw3x9gSFDlD+uypb5YBgiIiIi11HhMh/sM0RERESuodJlPhiGiIiIyPlUvMwHwxAREXkXvR7IzARWrpR/e9EaWh5Nxct8sM8QERF5DxX2R6FbVLzMB2uGiIjIO6i0PwrdouJlPhiGiIjI86m4PwrdouJlPhiGiIjI86m4P4pXUKIfloqX+WAYIiIiz6fi/igeLzUVaNECGDoUmDBB/t2ihWPNjipd5oMdqImIyPOpuD+KRzP0w6rc/Gjoh+VIgFHhMh+SEOYaWL1LQUEBgoKCkJ+fj/r167u7OEREpDS9Xq6tOHPGfL8hSZJrH7KzvXJtLacwvKaWmh9d8Jq66vrNZjIiIvJ8Ku6P4rE01A+LYYiIiLyDSvujeCwN9cNinyEiIvIeKuyP4rE01A+LYYiIiLyLry8wZIi7S+H5DPMCWeuH5YZ5gZTGZjIiIiKqSkP9sBiGiIiIyDw39sM6t/s8/vXIVqcdvyIOrSciIqLq6fUu6YeVuzcPa+YdQvIPQdiS3wUChQCcf/1mnyEiIiKqnhP7YeXuzUPqW4eQ/F0QsvK7QGCw8b5edQ7gtyKnPK0JhiEiIiJyqfP7LyB1/iEkf1cPWVe7oLxCAOpXdx/i/3wJcTNao0HHjggKcn55GIaIiIjI6fIO3ApA39bD5qtdUI5Bxvv61tmPhDsvIm5GazTr39m4vaCgwCVlYxgiIiIip7hw6CJS5x1E8rd1kXmlq0kA6lNnPxKGXkTcjD+h+YBObiylCkaTZWVlYcyYMQgPD4ckSUhPTze5XwiBOXPmIDw8HLVr18aQIUNw4MAB9xSWiIjcQ68HMjOBlSvl33q9u0tEFlw4dBFLH87CsOCdaNqhIZ5NGoRNV3qgHL7oXecA3hmViewtp/FrYSe89PUQNB8Q6e4iu79mqKioCF27dsXjjz+O8ePHV7l/4cKFeO+997B8+XK0adMG8+bNw/Dhw3HkyBHUq1fPDSUmIiKXSk0FXnjBdJ2syEh5DhwusaEKF49cQtr8A0heXwcZl7tCX6EGqFfgQSQMyUPc9FaIHtTRjaW0TFVD6yVJQlpaGsaNGwdArhUKDw9HYmIipk+fDgAoKSlBkyZN8Pbbb+OZZ56x6bgcWk9E5KFSU4G4uKozIBsm/eOaY25z6dhlpM07gOR1gdh0uSv0FepXegYeRMLgPMS92hIthzRz+Dlcdf12e81QdbKzs5Gbm4sRI0YYt+l0OgwePBjbtm2zGIZKSkpQUlJivO2qDlhERKQgvV6uETL3N7sQciBKTJTXIrM0542L5sfRikvHLiN9/gEkr6uNjZe6QY/bS3H0qH0ICYPPI+6VaLT6cwcAHdxXUDupOgzl5uYCAJo0aWKyvUmTJjh58qTFxy1YsABz5851atmIiMjJtmwxbRqrTAggJ0fez9wcOGxeU8Tl368gfd5+JH9dGxsvdUVZhQDUvfYhJAySA9Cf7mwPoL37CloDqg5DBlKlNVGEEFW2VTRz5kxMmzbNeLugoABRUVFOKx8RETnBuXOO72epee3MGXk7m9eqdSX7KtLf3IfkrwPw48VuJgGoW+3DSIjJRfyrnh2AKlJ1GGratCkAuYYoLCzMuD0vL69KbVFFOp0OOp3O6eUjIiInqvD/vl37KdG8pkFXsq9i7fz9SP5Khw0XTANQ14AjSIg5h/hXWqD18HYA2rmvoE6g6jAUHR2Npk2bYsOGDejevTsA4ObNm9i8eTPefvttN5eOiIicKiZGbtY6c8Z8sJEk+f6YGNPtNW1e0xBDAEr5SocNF7qiFAON93UJOIKEgecQ/3JztLmrLYC27iuok7k9DBUWFuL48ePG29nZ2di9ezeCg4PRrFkzJCYm4q233kLr1q3RunVrvPXWWwgMDMSECRPcWGoiInI6X1+5f09cnBx8KgYiQ1eJRYuq1u7UpHmtpjygw/bVk/lYO28fUr7yxw953UwCUOeAo0gYcBbxLzVD25HeHYAqcnsY+u233zB06FDjbUNfn0cffRTLly/Hq6++ihs3bmDSpEm4cuUK+vbtix9++IFzDBGR+njAhdDjxMbK/XvMdYRetMh8vx9Hm9dqSsUdtvNP3QpAa/3xfaUA1El3DAkDziD+pWZod08bAG3cV1A3UdU8Q87CeYaIyOlUfCH0CvYETb0eaNHCevNadrZyYVWF8yHln8rHV2/tQ0p6LXx/vhtu4nZf2o66Y0i44wzip0Wh/ehWLi2XPVx1/WYYIiKqKRVeCDXP8J4A5pvXlHxPDOHLUj8lZ4QvCwpOF+Cr+fuQku6H73JNA1AH3XEk9D+N+Bcj0eHePzm1HEphGFIQwxAROY2KLoRUibnauqgoy81rjsrMBCp097AoI8MpHbYLThfg67f2ISXND9/ldkUJAoz3tff/HQn9cxD/YiQ6jvWMAFQRZ6AmIvIEHLmkXrGx8vB5Z/fjckOH7Wtnr+Hr+XuRkuaLb891QwkGGO9r5/87EvrlID4xAh3H/gmSj3qbwdSCYYiIqCbcOXKJrPP1dX4IdVGH7Wtnr2Hdgn1IWeODbyoFoLb+fyCh7ykkvMgA5AiGISKimnDXyCVSD2vzIQFy81zl+ZBsUJhbiHVv7UXyah98e64rinGH8b42tbKR0PckEhLD0em+1pB8Wjp6BprHMEREVBOOTgxI3qPifEiWPPCAzc1zhbmFWL9ADkDfnDUNQK1rZSOhjxyAOse2huQTXdPSE9iBmoio5lw5conU69VXgXfeMX+fJFX7OSjKK8L6BXuQnCLhmzNdcQOBxvv+VOsEEnqfQMILYegS1waST6W1Ob14fiuOJlMQwxAROZ2rRi6RuhiCyJkzwIsvAhcumN/PzKjCorwifPP3vUhOBtZXCkCt/E4ioXc2El4IQ9d4MwHIwMvnt2IYUhDDEBG5hBf/hU5mmAsiVhSnf4t1WUFyADrdBddRx3hfS7+TSOiVjYTnm6Lb/W0tB6CKz+/l81sxDCmIYYiIFMPAQ4DlIGLFY/gM/4fHjbdb+p1EfM9sJExuhO4RFyCdz7Xtc6WR+a04zxARkdp4eZME2Uivlz8HDtQlnEA0ov1OIb7HH0iY2gQ9JrSDlL4DeGGifZ8rzm+lKIYhIiJbWKoJOHNG3u4FTRJkI2tBxIxySMj3b4R3/xWCno9EQfJpJt/h6OeK81spysfdBSAiUr3qagIM2xIT5f3UTK+Xl45YuVL+7a7yqqUcjrIzYAhIkCSg4col6PVY59t9gWryueL8VopiGCIissaeJgm1Sk2V+5gMHQpMmCD/btFC3q6GcrzxhseEo5v1QuzaX4qKhGSuhqcmnyvD/FaShU7WkuTwRI9axGYyIvI8ru7E7OlNEmpp4rNUjtOngdmzb99WYT+s4qvF+OGdPUhOKgNO5OLzW9stjvdq3Bh4/30gIsLy57Mmn6uKEz1Kkvn5rRYt8ujO067EMEREnsUdnZg9uUnCWlOMJMlNMWPHOvfCaU+n44ohzRULrVpQUlAiB6AvbmJtdhdcQ1/4QI8TeAACVppWPvmk+hmpAds/L8eOmd8eGyu/Rua+D5zfyi4cWk9EnsNd86oYhjFbW3JDjcOYMzPlpihrMjKcO+rI1nIYSBIQHAzUru3S4FtSUIIN794KQH90RgGCbj+171lMj07GlOMvWj+QLa+nXg80by5/rqoTGQmcOGH5s+XF0z246vrNPkNE5Bnc2YnZ0CQBVO2jofYmCbU08dl7fCGAS5eq9qkx1Bop2NfpZuFNrJ+zHY+22oomQcUY82YffP7HQBQgCBE+55DYfTN+WrIPJ4ubYsobTWw7qC3n6+sLPP209f1On66+P5qvrxy8HnxQ/q3Gz6HKsZmMiDyDu+dV8dQmCbU08Sl1fIWa9m4W3sSP/9iD5M9LkP57Z+Sjt/G+cJ9ziO9yFPFPN0T/pzrBx69C2ZV+PVu3tm0/tfZH8xIMQ0TkGdRQwxEb69Y+LA4xjDqy1sTn7FFH1sphDweDryEApawoRvrvnXFV3A5AYT65iO98BPFPN8QdT1cKQPach72vp1rCqsYxDBGRZ1DLRcPQJOEp1DLqqLpyOMqG4Huz8CY2vicHoLTjVQNQXKcjiH+qAQY82xk+fk2tP6fSr6dawqrGsc8QEXkGzqtSla2TFxqa+CIiTLdHRrp25mxL5XCUheBber0U3837DU+02YKm9Ytwz+zeWHYsBldFAzT1OY8pnTdj84d7kHOjMT7cMxgxU7rCx8+Oy6GSr6cn90dTigom4eRoMiLyHIbRZID5v8i1tCSGI1MMqGXUUcVyHDsGLF1qOqIqMhK4cQO4fNnm0Xul10ux6f09SPnvDaQd64jLIti4exOfPMR1PIT4J4Iw8LnO8PVX6JyVfD3NvZ9RUeruj6YEK59jrlqvIIYhIi+i1YtGRe6aYsCSmoYCc49fu9Zq8C29ewwyPtiLlP8rQurRTiYBKFS6gLiOBxH/RBBiJikYgJxJLWHVVWz4HBcMG8YwpBSGISIvo5WLhrnzBOQ5jyyNrHP1nEfOnATTzLFFZCT2Dn4eH+/oi9QjHXFJ3F4aI1S6gPEdDiH+L/UwaEoXdQQgrXxW7WWYu8vK57hgzx4EBQczDCmBYYiI3K7iRTE0VN6Wl2f5AmkpZDz1lOnSFZY4exJFwDU1VHo99BszcXD5r/hhax0szHkAebg9109j6QLGtz+EhCdUFIAM3DFbuqewcRLOgnXrEDR6tNOv3xxNRkTkbOYuihVVvkBWt5aYLUEIcP68NLYu8zF6NLBtm901I2XFZdj80V6kLCvEmsNdcVHcabyvkXQR49sdRMLjgRjcNR++l26FShXlINWsB6dWtn4+c3OdW45bGIaIiJzJ0kWxosprcVmbadsWzp5iwNZJMCMjgQsXbm+vpmakrLgMWR/vQ8pn17DmUHtcED2M94VIlzC+7QEk/KUuBk/tAr9vLqq31kUt68Gpma2fz6Y2THegADaTERE5i7V+ERUZ+vosWwYMG+b4c7qqz9DKlcCECfY/rlITmv6mHlmL9yL502tIPdQeeaKxcdcQ6RJi2x5AwuN1MeT5LvALuPX3u9o6kFemlvXg1MzG9f5c1WeINUNERM5irfakIkNNSmam7cd35ySKjtY8CQEhSSh5YhJe+mtDrDncEefLuxvvDpYuI7bNfiQ8VgdDnu+CWoGDTB/vCbUuapgtXe3UMhnoLZx0kYjIWZx5sZs7172TKFqbBLMakhAIuHoeBw5KOF8eiobSFTzRZgu+f2sHcgvr4d+HB2H4jJ6oFVir6oPtWaPOEmdN8mc47sGDtu2v9SU21DIZKFgzRETkPIZRY/YYMgRYvtz68gyzZsk/7hq2rcDyGg82zcDMKXXx5xe7olagjTOH17TWxVkjvKx1kq+IS2zcppL1/hiGiIicwXBxtJXhAjlkiH3NB+7sc2L4y75SCLhZpyH8i65YffgzK4cCQ3rZ95w1WaPOWSO8bOkkb6CVJTbsoYL1/thMRkSkNMPF0db+QoB8ITVcIFXUfGBVbCzKj/+BfS/8B8uj/oo4aTXqFOUiB5EohxPWkbOlea5xYzngVGwCs9bXCJD7GtnbZFbdcc1R43tIrBkiIlKUvRdHS1TSfGBJeVk5fv73fiT/6wpW72uDs+VPGO8LQj7SmzyLKedfh5AkSEp2jrWlee7CBeDhh+V/G5rAgoNt72tkTy2FrZ3kX38duPNOVb2HdBtrhoiIlGTPCLKKDKOgKtZMGJoPHnxQ/u3mi2h5WTm2/WsfErtvRjPdeQyc1AUf7hmMs+VhCEI+Hmm5Fetmb8f5/ABMzZ0Fac0aSM6o3bJUc2aOoQls7Vrbjm1vp3db9+/QQRXvIZnHmiEiIiU5OoLM0ZoJJysvK8evnx1A8pLLSNnTBmfKOxvvq498jG25DwkP+WP4y12hqz/Q9MHOrN2qeOycHGDqVCA/v+p+huH2X3xh23HtHeFVkz5MpBoMQ0RESqrpRU8Fc8+IciEHoH9eRMqeNjitvx2A6qEAY6P3IuEhf4x4xUwAqsyZnWN9fYHLl4Fp08wHIQMh5Kazxo2BixerH6Vnbz8mQx8ma6P/OHJM1VTfTFZWVobXX38d0dHRqF27Nlq2bIk33ngD5eXl7i4aEZEpvR4oLXVo7h0jN9UgiHKBXz/dj5d6ZaK5/1n0f6oT3t85BKf14aiHAjzU4iesfe1X5F3xx+d/DMSYN/tAV1/nlrIaGTqqX7xo2/4PPST/rvz+GPoejR8v1zTZ04na0IfJ0nEBjhzzBELl5s2bJ0JCQsS6detEdna2SElJEXXr1hWLFi2y+Rj5+fkCgMjPz3diSYlI09asESIyUgj5smr/jyQJERUlRFmZy4pcri8Xv362X7zUM0M0880xKU5dFIgJzbeK9Jm/iBtXbrisTDYrK7P/9c7IMP8++fqa3o6MlPezh7njRkXZfxwy4arrt+rXJhs9ejSaNGmCTz/91Lht/PjxCAwMxOeff27TMbg2GRE5lT3zzJjjwjW1RLnAb58fQvLiPKTs+hNO6iON99XFNdzbfC/iH/TDXa90Qe3g2k4tS43Yuv4XUHW9Nr1ergFau1autTG3P2D/+2E4rgpH/3kqV12/Vd9naODAgViyZAmOHj2KNm3aYM+ePdi6dSsWmfsAExG5mhJD6Rs1Aj75xGlBSJQL7FhhCECtcKKsA4AOAIA6KMS9zfcg/n5f3D29K2oHD3BKGRRnb9+qik1Vvr5yUJk40fy+jq5xpoLJA8kxqg9D06dPR35+Ptq1awdfX1/o9XrMnz8fDz74oMXHlJSUoKSkxHi7oKDAFUUlIi2ydyi9JAENGwI+Prf7uly4ALz4orxNoUBkCEApH+chZWdLZFcKQGOa7UX8/T4YOcODAlBFtvatatwYWLKk6utqzxpnDDheT/VhaNWqVVixYgWSkpLQsWNH7N69G4mJiQgPD8ejjz5q9jELFizA3LlzXVxSInI6NTZD2FNDYeioe/ly1ftquiQE5AC0M+kwUhafR/IO0wAUiCKMidqD+PsljJzeFYGN7nDoOVTD2iguQA5Cp08D/v5V7+PK8lSB6vsMRUVFYcaMGZg8ebJx27x587BixQocPnzY7GPM1QxFRUWxzxCRJ3PWAps1ZU/flchI4MYN4NIl8/dX7ttiA1EusGulHIBWb2+GCP0phOEcziEMO9AD90TtR3y8hHtmdkVgo0DbyukpDH21APNruFUXLG193zIyWDPkRuwzdMv169fh42M6A4Cvr2+1Q+t1Oh10OjcP+SQi5ThrgU0l2FJDERICrFol/3vYMMvHsrFpRpQL7F51BCkf5SJ5ezR+L2uP+3AImzARUbgdFsvDIuCz6EPvXQfLwkKxiIyU+whVd96cH4gqUP08Q2PGjMH8+fOxfv16nDhxAmlpaXjvvfdw3333ubtoROQKzlpgUynW5pmRJGDpUnldqrw8245ppmnGEIBmDchEm4CT6DGhHRb8PAS/lzXHA1iJNRiPSJj2gfHJPSuHxdRUR87MM8TGAidOyDU4SUny7+xs6wGQ8wNRRU4duK+AgoIC8cILL4hmzZqJgIAA0bJlSzFr1ixRUlJi8zE4zxCRB8vIsH0OGXeyZZ4ZO8+lXF8udq86LGYNyBCta/1hsksArovxEdvEqilZQh8Woar5izwK5wdSNc4zpCDOM0TkwVauBCZMsL5fUpK8oKk7WevgrdcDLVpU2zQjIiOx753v5U7QvzbH0dJo490BuIF7wvcgIa4co2Z2Qd2mddn3RQlq7JhPANhniIhI5kkLYVqbZ8bQNBMXd3tk2S0C8u3nz83E4gfaA2gPANChGPeE7ZYD0IzOqBfez/SYHBVVc5wfSPMYhojUSGt/qVZ3vq7u6Ors1/5Wp1/xwguQKnT6zUEkErEIaWWx0KEYI8N2I2F8OUbPNBOAKvKksEikUnaFoZycHERFRTmrLESup8bQodYh5M5i7XyrqU2xqaOrPe+xC177A2uPI+XDYKw+vxGNcNY4DP5X9MFdTffhi9ifMHpmZ9SPrCYAVcRRUUQ1Z08Ho8DAQPH666+LwsJC5/RgchJ2oCazzHWcdGSBRqXLJEnmO8FKkvd16rTnfB3p6GrPe+zE1/7A2mNizpAM0UF3zOTQ/igW9zb9Rax4bqvIz6nB/0+Gslcuv7d+bkgzXHX9tisM/fTTT6JPnz4iLCxMfPbZZ84qk+IYhqgKNYYOa6twe9uoIEfOt6xMHmmVlCT/ru61sOc9dsJrf/Dr42Lu0AzRUXe0SgAa0+QX8fmzW8XVk1ftftmqPV+OiiIvo+rRZP/9738xa9YsNGrUCO+//z6GqLzjGUeTkQnDiB5L6xI5MAuwIrQ2KmjjxuonIDRw5HztfY8Veu0Pf/MHUv5xCsk/RWB/SWvj9lq4ibtCdyPhvpu497XOCGoWZNfp2EyNzb6egq+dKql6NNkjjzyC+Ph4LFiwAKNGjcKIESPwzjvv4E9/+pPS5SNSnloXaNTSqKDUVOCpp2zb15Hztfc9rsFrf+RbQwAKx77iNgBaApAD0IjQ3UgYexP3zuqMBs372H8e9uKoKMdorZ8eVeHwaDIhBEaMGIFr167hww8/xLfffovJkydjzpw5qFevnpJlJFKWWkOHVkYFWVpawxJHztfe99jO1/7o99lIefckkreGYW9xW1QMQMMb70HC2BKMfd1FAYhqRs1LvZDL2BWGlixZgu3bt2P79u04dOgQfH190aVLF0yePBndunXDF198gQ4dOiAtLQ29evVyVpnJ3Ty9OlmtoUMLo4KqW1qjspqcr73vsQ2vfWmjpnhnnh7JI49gT3FbAPJkiH4oxfDGu5FwbwnGzuqEhtG97S8vuYe1pV4kSV7qZexYz/o/juxnTwejyMhIERcXJ959912xdetWUVxcXGWf+fPni44dOyrTo0kh7ECtIDWOwLKXobOsuc617u6o7O2jgmxdjsJwzo6eryPvsYXXvhwQekjiPqwxbvbDTXF3o/+Jzx7PEpeOX1bkpSE38JSlXjRMlaPJbJGbmyt8fHyUPmyNMAwpRI0jsByl5tDhzaOCkpJsu/iEhNT8fB15j9esETcbhZnsfxJR4j6sEX64Ke4K2S4+fYwByGvY+nlMSnJ3STXLVddvxWegDg0NxaZNm5Q+LLmbt1Un35oF2GynyUWL3NtHIDZWfh09uSnSElubr1atkld5rwk73uPfN51EysJspGS1x+4bOYjBFoThHPIQCv/guogbcxP/nnUNIa2d3Pzv6U3QnkatTebkclyolWzjrcO+efFxLRsWKlV8WgML7/EfmaeQ8vYfSMkKxY7rHYy7+6IMfw7eg4TR1zHutQ5o1DZEmXJYwxFNrueOzyPZRdVD60mD1DoCq6Y4FNm1qltaA5BvP/mk8s956z3OzspBypgtSNkcit+udwDQTN4FZRgavAcJo4pw36yOaNS2p7JlsIYjmtyjpku9kNfwcXcByEOwOpmUYmi+iogwf//s2fJf66mpijzdia2n8c6oTPSpewAtB0dh+rdD8Nv1DvCBHsOCd+BfD2Xh3MGr2HCpJ5767yDX1QQZWGuCBuQmaL3epcXSDEufx8hIhlANYTMZ2YbVyaQ0vR6YP18OP5UZ/ip38GJ08qfTSFlwHCmZjfC/ok7G7T7QY2jDPYgfWYj7XmuP0I6NHS29cry1CdrTsMlcldhMRurC6mRyhn//2/x2Bzrln/zpNFb//TiSMwwBKBKAHICGNNyD+LsLETurPUI79lCu/Erw1iZoT8Mmc01jGCLbqXkEFnkeBZZFOfXzGaz++zEkb2yEXysFoMEN9iL+7muIndUeTTqpLABVxCZoIrdjGCL7ePOwb3ItB2tEcn49i9ULjiJ5Ywh+KewMQO7rIaEcgxvsQfxdBYh9rT2adumucIGdRAszjxOpHMMQ2Y/VyaQEO2pETm8/h9VvHUXyj8H4ubAzgHAAcgAaFLQX8SPyMf51DwpAFbEJmsjtGIaIyD2s1IgISCis3Rj3jAnC1sIwAHJ4klCOmKC9iB+ej/Gz2iGsWzfXltsZ2ARN5FYcTUZEzmdppI5hfh3AJBCVQ64RicNqpCEWEsoxsP4+xA+/ivGvtUV4j6buOAvn44gmIhMcTUZE3sHKzMqXF/4btf42E/VuXDDefRqRSMQiXKjfCh8O33wrAHV1Q+FdjE3QRG7BMESkBt5aI2BhZmVx5gwwfjz+WvsfeOtGIiQ8ZlwPrFHt62hzdzQ+eq09InpxBBUROR+byYgqc3Uw8dY1qQwTdVoYPl8OCacRiWhko1+9A0gYdgXjZ7ZBZG8GICKSsZmMyB1cHUy8eU0qK/MI+UCgGXJw7uM0hE6Kc2HBiIhMcW0yIgNDMKl8ATcEE4XWyjLy0jWpzu+/gH8+mIU3R/1s0/6hDUudXCIiouoxDBEB7gkm9szArHJ5By5gyYQs/LnhLoR3DsakLwdh4/X+tj342DHnFo6IyAqGISLAPcHEw9ekunDoIv71UBbuDN6JsE7BeG7lIGRc7Y5y+KJPnf24d5QeZY3Dbk8caMns2crXuhER2YF9hogA9wQTD1yT6sKhi0ibfxDJ39RFxpWuKMcg43296xxAwpALiJvxJ7QY2AlAJyB18e15hCyxc0FWIiKlMQwRAe4JJh6yJtXFI5eQNv8AktfXQcblrtBXCEC9Ag8iYUge4qa3QvSgjlUfHBsLzJkj1/5YYsOCrF7JW6dTIPJADENEgHuCiYrXpDIEoJT1dbCpUgDqGXgQCYPzEPdqS7Qc0gFAh+oP1rq1bU+q0uZAp/DW6RSIPBTDEBHgvmCi1JpUCtQyXDp2GWnzDiBlfW1svNTNJAD1qH0ICYPPI366jQGoIg9sDnQqb55OgchDcdJFoorM/cUeFeX8xTJrEmZqUMtw6dhlpM8/gJR1tfHjpW7QV/j7qHvtQ0gYdB7xr0aj1Z+bO15ew+SL1mrdsrO9v5nIykSUmnotiGzgqus3wxBRZZ7Ul8NSLYOhNstMLcPl368gfd5+pKwLwI8Xu6EMtYz3dat9GAkxuYh/NRp/urNSAKr4nPaGLwsLslZXTq+UmQkMHWp9v4wMbfWfIrKAYUhBDEPkleyoZbhy6hrS39yHlHUB2HDBNAB1DTiChJhziH+lBVoPb1H9czoQvkwe645aNzVZuRKYMMH6fklJwIMPOr88RCrH5TiIqHo2zo00I+TfeC//LyjF7c7fXQKOIGHgOcS/3Bxt7moLoK3157M2MaW1IfKxsfJ9nlLr5gzsP0WkSgxD5D6e1BylRjaOvjqZH4RS+KNLwBHEDziH+Jeaoe1IGwNQRfZMTGmpicfX1/x9WvkseMh0CkRawzBE7sGhxTVnY+3ByO7nMXveH2h3jwMBqCJnTUyppc+CiqdTIDJLI3+oeMRyHGfOnMHDDz+MkJAQBAYGolu3btixY4f9B0pJkTswetjCl17H1QuieqH8U/lYkSThgk8oymF+uQsBCYiKwiPbp6LdPS1r/qTOaOKpyWdBr5e/zytXetb32jCdQkSE6fbISO10JCfPkJoq90scOlTu6zZ0qHzbC/+PVn0H6itXrqB79+4YOnQonnvuOYSGhuL3339HixYt0KpVK5uOYeyABaA+4L1/dXoCDi02ZcdfXQWnC/DV/H1ITvPD9+e74SZ0uA+pWA15lJYPnDxKS+kh8jX5LHhDbZJG/uImD1WTwRIKctkAKKFy06dPFwMHDqzRMfLz8wUAkS+/rUJIkvyzZo1CpSSbZWTI74G1n4wMd5fU+dasESIy0vS8IyNNPpf5OflixXNbxb1NfxE63DDZtb3/cTF7cIY4OX1x1eNERdn2+S4rk1/rpCT5d1mZ9TIbvj8Vn8+R75SjnwVDGSrvx+81kTLKyqr+n1L5uxYVZf3/CwUYr9/5+U59HtWHofbt24vExEQRFxcnGjduLLp16yaWLl1a7WOKi4tFfn6+8ScnJ8c0DLn4zaQKkpJsuwAmJbm7pM5VzQW9XJLE5rvmi7FmAlA7/+Pib4MyxP70Y6bHszfUGMpgJYzZ/Dhbw1dFjnwWVPSfNJHXUtEfrQxDt+h0OqHT6cTMmTPFzp07xZIlS0RAQID4v//7P4uPmT17tgBQ5SffTW8mVaCiL5lblJUJ8eOPQgQHWzx3PSRxElHCB2UCEKKt/+/irzEZYl/qUVGuL1emHDWtXXEkfFXmyGdB658fIldQ0R+trgpDqu8z5O/vj169emHbtm3Gbc8//zy2b9+On3/+2exjSkpKUFJSYrxdUFCAqKio232GKuLkZq6l5aUZzPVzqcannd5Hnzn3oNN9rSH5mO8k7RAl+23VpN+LI58FTlpI5HwqmindVX2GVD+aLCwsDB06mC4K2b59e5w6dcriY3Q6HerXr2/yU80TKFVUsoVhaDFwuyOegTcPLb7VGVHYGIQA4InXmqDz+DbKBiHAvvmCqlPTkSaOfBY4aSGR8xnmw6r8vTSQ5JGq3jQflurD0IABA3DkyBGTbUePHkXz5s1rdmAvfDM9hsaGFhedK8D1R5+FEMLCIHgLnHVBV2K+IKWmR7D3s6DB/6SJXE6Lf7Q6tRFOAf/73/+En5+fmD9/vjh27Jj44osvRGBgoFixYoXNx+BoMpVSot+JShWeLxTJL24TcRHbxAh8a1v7u6s6Ade0340zOjHb81lQckQbEVmm1GCJGmAH6gq+/vpr0alTJ6HT6US7du2sjiarrEoYcvGbSdpQdKFIpEzbJuIjt4lAFBr/73gANnZGdNUF3RBmzHWgtiXMqKETswr+kybSBDf/0eqqMOQRy3GMHj0ao0ePrvmB/vMfoFUrTm5GNVOh03BxYEOsz6qL5BQfrMvpiuvoDwDwgR4P+nyJMdEHMLBfKfCFjceOjHT+Ku41XRLCWcty2IOLvhK5hqX1BL2MR4QhxcTHA86cwZK8X2oqyqc+D5+zZwAAAQD6IBJf4ANcxx2I9juFOS2W44HLn8D/8nngd8g/vr7VLxcRHAwkJ8v/6bjigm7oq2NuFmdrYUwtnZg18p80ETmf6ofWK8Fl03mT17px+Qb2PvEB+qTPhIDpyINySJAg8PvURWg1KBJSQrz5oeLmuHhq+yocGRqv5ekRiMilXHX91lbNEJEdiq8W47u39yB5ZRnWn+yI/fi4ShACbq0JJkn4U9q7QBqqD0KVa4hc0SxWHUdqV7jyOhF5GYYhogqKrxbj+4V7kJxUhq9OdkEh+gIABiMTUbAyN48tcwjp9cD77wNNmnh2P5eaNLMREakMwxApz8NW4zYEoJSVZfjqRGdcuxWAACDK9wwSuh3Dsz3+B/xboSds0sQ7ZkdmJ2Yi8hIMQ6Qsc0tOREbKzSoqqi0oKSjB92/vRsrKUqzN7lIlAMV3O4b4Zxuh7186QvKJADKhXBjyptmR2YmZiLwAO1CTTInaHMOsxJU/Uu7uJHxLSUEJfnhnD1KSbmLtH51RgCDjfZG+ZxHf9SjinwlB3790hI9fpZ5BtnQaNsyizI7FRESKcNX1m2GIlKnNUXLxTwWVFJRgw7t7kPLFTaRXCkARPuduBaBg9HvCTACqzBD2APOdhlevln9b20dFNWRERGrGMKQghqFqKFWbo6JVjm8W3pQD0IoSpP/eGfkVAlC4zznEdzmK+Kcbov9TnawHoMrMBceoKNNOw7bs42we1m+LiMgchiEFMQxZoGRtzsqV8srl1iQlOaXz8M3Cm/jxH3uQsqIY6b93xlXRwHhfmE8u4jsfQfzTDXHH0w4EoMpsCRruDCOu7rfF4EVETsJ5hsj5tmypfji4EEBOjryftdocN8xKfLPwJja+JwegtOOdcVX0vv00PrmI63QECc8YAlBTxZ7Xpk7D7upYbKmmz7CavNLNdB7SYZ6IqDoMQ1qm5BpTMTHyRdBa5+GYGPvKWEnp9VI5AP33BtKOd8KVCgGoqc95xHU8jISnG2DAs52VDUC2cHcNiV4vBxNzr7+QJ4ZEYqI8HF6Jcrk6eBEROQnDkJYpWZvjxFmJS6+XYtP7e5D8fzeQfrwjLotexvua+OQhruMhJDzVAAOe6QRf/8F2H18RaqghUbKmzxpXBy8iIidiGNIypWtzFJyVuPR6KTI+2Ivk5deRdsw0AIVKFxDX8SASngzCwOc6mw9ArqylUUsNiStXk3dl8CIicjKGIS1zRm1ODWYlLisuQ8aiPUheXoS0ox1xSfQ03hcqXcD4DoeQ8GR9xEyyEIAMXFVLo9fLo+ieekodNSSu7Ldla6Bau5ZhiIhUj6PJyK1DwcuKy5D54V4kLytE2pEOuCgaGe9rLF3A+PaHkPBEPQya0gW+/jaECVdN/GjuNauOC6YUcOlq8rZOpdC4sRyc2FRGRA7g0HoFMQzZwIXNSmXFZdj80V4kf1aIVDMBKLbdrQA0uTP8AuyovHTVxI+WAld1kpKAhATnv8a2TAypRBjU6+VzuHDB+r6uCIJE5JU4tN6TuHsUkRKcPBS8rLgMWR/vQ/Kn15B6uD0uiB7G+xpJFxHb9iAS/lIXg6d2gV/AIMeexBX9WKrrOFydY8eqBjVnNN25ajV5X1/goYfkY1qjRB8lIiInYhiqKTWMIlIp/U09shbvlQPQofbIE92N94VIlxDb9gASHq+LIc/XIABV5IoOxNYCV2WSBAQHA7NnV73PWR2sXbWa/NixtoUhb1qYloi8EsNQTahlFJGjnFCjpb+px5ZP9iH5PwVIPdQO58tNA9B9bQ4g4bE6GPJ8F9QKVCAAVaRUB+LqXhd7gpShacoSZ3awdsWkj4bRiNaaJWs4txQRkdMJDcjPzxcARH5+vnIHLSsTIjJSCPmSVvVHkoSIipL3U6M1a6qWPzJS3m6nspIykblol5jUKVM08Tlvcshg6ZJ4ok2W+P6t38TNoptOOJGKBbn1nkiS4++JtdclI8Pye175JypKiLlzbds3I8O5r42zrFkjv66VX3PDNgc+T0REBk65fpvBMOQoWy+Krr7IlZXJz5mUJP82d+E3XMDMhQUbL2BlJWVi84e7xeTOmaKpT67JYRpKl8VfWmeJ7+Ztd34AqqwmF2dbXhdrgQsQIjhYiB9/lPdNSrLtc5KU5LrXSGnmAmRUFIMQEdUYw5CCnPJiqvEiZ0ttTw1qtPSlepH10W4xxUIAerx1lvj2TTcEoMocuTjb87rYE7jUGpqVZksIJyKyk6vCEIfWO8rWeVZcNazY1vl17Cx3eVk5ti3dj+R/XcHq/W1xrvz2el8NpKsY12ofEiYG4M5pXeFf11+586kpe/tD2ft+2jo3kyvn/iEi8jIcWq92zliY1NEOzfasE2VjB+Aj//0VnyRKWL2vDc6Wd4EP9IjBFozEerQOL0KXJ/tg2Cs94F9XpZ1j7e1AbO9INFtHbDlxzTYiIlIGw5CjlL7I1WSIvj3z6xw7ZlNxnlnWF5sxGADwMD7HB74vIVh/a4K9swA+iwS6etH0AY6MRLM1cLlq7h8iInIIm8lqSomlLGq6hMTKlcCECdafJzFRDlfVvOXlkHAakeiK3bi35UFM7fETeq6ZCcnRsnkKVzRnecPknERELsTlOBTk9BfTnotc5X3vuANo1apmS0jY2t+lUSOIixdhafYbwwfht7i/o8unidDV8XPN8hZq4aqlLIiIyCYMQwpSzdpk5mqRGjeu+fpOVmo1hCShrG5D1Lp22frzzJ0L/O1v8r+V6CTuabUhbly0loiITLnq+u3jtCOTKUOtQ+VaFluCEFB9B19D/yWgyqzHAnI++ujaI7Y9T+vWtj2nLWVLTZVD2tChcjPe0KHy7dRU247rDrGxwIkTcsBLSpJ/Z2czCBEReTGGIVdwdHHPiqx18I2NhUhOQUmDUJPNOYhCHFZjA4bb/zw1Wd7CUvgzLFWi5kBk6Bj94IPybzXXZBERUY2xmcwVbG1uMsdKvxxRLvDb54eQ8nEeUna1wqmycMRgC8JwDlfRAMHN6iDuAX/c/XIn1O7R3r4Owo52KjY8Tit9jYiIyCk4z5A3cXSVdAtD9EW5wI4VcgBK3tkKJ8o6AOgAAKiDQoQ180f8/dEYOaMragfXvn08e6cCcHT6AHuG+rtiQkoiIqJqsJnMFWxtbmrUyPR2ZKRxBJMhAM3ol4lWuhz0frQDFv5vCE6URSEQRbg/ahvWvPIL8i74YOXJOxC7sJ9pEAJuz3cTEWHxeapw5DE17WtERETkQmwmcwVrzU2AHC5+/x3Yts048koMGIhdyceQsvg8kn+Lxh9lzY27B6IIo6P2IOF+CSOnd0Vgo0D7ymPvCC97HqO2pUqIiMgjcWi9gpz6YtoaEizNYWMQEgIsXQox7j7sXnUEyR/mIuW3aPxeIQDVxnWMjtyDhARg5PQuqBNaR9lzUQrX4yIiIgUwDCnIaS+mvUtopKYCTz8NXLpU5S4BCYDAFN9/Yon+KWMn6MtoiAbhdRF3vy/umaHiAFQZJzAkIqIaYhhSkFNeTEeW0NDrgebN5RoTM8oh4RKCUYIARKLCPrauUaY2nMCQiIhqgJMuWrBgwQJIkoTExET3FcLaKvGAvA6YXm961+Ysi0EIAHwg0BiXEIFK+3jC3DzmcAJDIiLyAB41tH779u1YunQpunTp4t6C2DF0XAwajP1px5C86Cyu/7wH/7Dh8FXWDhNCrnFKTATGjvWsfja2ruxORETkJh5TM1RYWIiHHnoI//73v9GwYUP3FsbGIeEpz25Eh9p/oEtcG8zbOgQ79N0cf86Kc/MQERGRYjwmDE2ePBmjRo3CsGHDrO5bUlKCgoICkx9F2Thv0MdH7sThm62gQzHGNv0Vzzzrg/Kw8Crrh9mFc/MQEREpyiOayb788kvs3LkT27dvt2n/BQsWYO7cuc4rUEyM3KnZwtDxckg4gwg0bOKPFbE/YcxrnVE/sq985/CPzM/obCtbJ3AkIiIim6i+ZignJwcvvPACVqxYgYCAAJseM3PmTOTn5xt/cnJyFC3ToW9PYFXQUygXcvCpqByABIHgJW8hLfcOPPTJANSPrNAD3tKMztZIkjwSKyam5idARERERqqvGdqxYwfy8vLQs2dP4za9Xo+srCwsXrwYJSUl8K3UoVin00Gn0ylajsPf/IHkd08hZVsE9pe0BvA3rEInfIDnEVVh9JfPraHjdaobMRUbCwQFATY0+RkJATzwgGd1niYiIvIAqg9Dd955J/bt22ey7fHHH0e7du0wffr0KkFISUe+NQSgcOwrbgOgJQCgFm5iROhujBsbinoz9gKn9tq3tAUA5OXZX6B33wX69ePQdCIiIgWpPgzVq1cPnTp1MtlWp04dhISEVNmuhKPfZyP5nZNI+SkMe4vbomIAGt54DxLGlmDs653RoHmf2w9qOcT+J3K0748nDq8nIiJSMdWHIVc4+n02Ut49iZStYdhT3BZANADAD6UY3ng3Eu4twdhZndAwurdyT2qlE7ZZFYfXc+4eIiIiRXhkGMrMzKzxMY5tOIGUd04gZWtT7L7RDpUDUPzoYoyd1QnBrRQMQBX5+spLbDgysozD64mIiBTjkWHIUb9nnsJ3H19E8hZDAGoBQA5AwxrJAWjc604MQJUZRpZVXr/LGg6vJyIiUoymFmodgHWIQgHOIQzb0B9/DtmH+NE3MG5WR4S0DrZ+IL1ebqKyt7O0rcc9cwZ48UXg4kXzNUWSJDetZWezzxAREXk9Vy3UqqmaoW8wGoaXUt80HL4ff2T7yCxzK7ArtZp8xfW7atc233RmmLV60SIGISIiIgWpftJFZ/E9f872leBTU+V9KzdlOWM1eUuTMkZGyts5rJ6IiEhRmmomywdQpZItKqr6Zie9HmjRwnKfHmc1XTmrSY6IiMhDsJnMVawNVd+ypfrOzc4a7l6x6cxTMdAREZEH0GwzmYm1ay3fZ+swdg53N5WaKteoDR0KTJgg/27RQtkmRSIiIgUwDAHAF1/ItRjm2DqMncPdb3NlHysiIqIaYhgCgAsX5OYccwwzRUuS+fu5mrwpvV4edWeuK5phW2Ki5fBJRETkYgxDBpaauQwzRQNVAxGHu1dlTx8rIiIiFWAYMqiumYvD3W3naB8rvR7IzARWrpR/s+aIiIhchKPJDEPjrTVzxcbKq8VzdFT1HOlj5cwJLYmIiKzQ9jxDhmYu1u4oxzAv05kzti0pYuhsXXlfvjdERJrnqnmGtNVMFh5uepvNXMqzp4+VI52t2ZxGREQK01YY2r8fyMgAkpLk39nZDELOYGsfK3s7W3PuIiIicgJtNZM5uZqNKrE2A/XKlXKosSYpCdDp2JxGRKQxXI6DPJ+1JUVs7WwdGgo89pjl5jRJkpvTxo5lh3YiIrKbtprJSF1sndAS4NxFRETkNAxD5D62drbOy7PteFwfjoiIHMAwRO5lS2drrg9HREROxA7UpA7Vdba2d+4iIiLyCuxATdpSXWdrQ3NaXJwcfCoGIq4PR0RENcRmMvIMXB+OiIichDVD5Dm4PhwRETkBwxB5FmtzFxEREdmJzWRERESkaQxDREREpGkMQ0RERKRpDENERESkaQxDREREpGkMQ0RERKRpDENERESkaQxDREREpGkMQ0RERKRpnIFajapbwZ2IiIgUxTCkNqmpwAsvAKdP394WGSmv2s7FSImIiBTHZjI1SU0F4uJMgxAAnDkjb09NdU+5iIiIvBjDkFro9XKNkBBV7zNsS0yU9yMiIiLFqD4MLViwAL1790a9evUQGhqKcePG4ciRI+4ulvK2bKlaI1SREEBOjrwfERERKUb1YWjz5s2YPHkyfvnlF2zYsAFlZWUYMWIEioqK3F00ZZ07p+x+REREZBPVd6D+7rvvTG4vW7YMoaGh2LFjBwYNGuSeQjljtFdYmLL7ERERkU1UH4Yqy8/PBwAEBwdb3KekpAQlJSXG2wUFBcoVwFmjvWJi5OOcOWO+35AkyffHxDj+HERERFSF6pvJKhJCYNq0aRg4cCA6depkcb8FCxYgKCjI+BMVFaVMAZw52svXVw5UgBx8KjLcXrSI8w0REREpTBLCXDWEOk2ePBnr16/H1q1bERkZaXE/czVDUVFRyM/PR/369R17cr0eaNHCcidnQ81NdnbNAou5mqeoKDkIcZ4hIiLSkIKCAgQFBdXs+m0Dj2kmmzp1Kr766itkZWVVG4QAQKfTQafTKVsAe0Z7DRni+PPExgJjx3IGaiIiIhdRfRgSQmDq1KlIS0tDZmYmoqOj3VMQV4728vWtWaAiIiIim6k+DE2ePBlJSUlYu3Yt6tWrh9zcXABAUFAQateu7bqCcLQXERGRV1J9nyGpcmfiW5YtW4bHHnvMpmMo0uZo6DNkbbRXTfsMEREREQD2GTJSTVYzjPaKi5ODT8VycbQXERGRx/KoofVuFxsLrF4NRESYbo+MlLdztBcREZHHUX3NkOpwtBcREZFXYRhyBEd7EREReQ02kxEREZGmMQwRERGRpjEMERERkaYxDBEREZGmMQwRERGRpjEMERERkaYxDBEREZGmMQwRERGRpjEMERERkaYxDBEREZGmMQwRERGRpjEMERERkaYxDBEREZGmMQwRERGRpjEMERERkaYxDBEREZGmMQwRERGRpjEMERERkaYxDBEREZGmMQwRERGRpjEMERERkaYxDBEREZGmMQwRERGRpjEMERERkaYxDBEREZGmMQwRERGRpjEMERERkaYxDBEREZGmMQwRERGRpjEMERERkaYxDBEREZGmMQwRERGRpjEMERERkaYxDBEREZGmMQwRERGRpnlMGPrkk08QHR2NgIAA9OzZE1u2bHF3kYiIiMgLeEQYWrVqFRITEzFr1izs2rULMTExGDlyJE6dOuXuohEREZGHk4QQwt2FsKZv377o0aMH/vnPfxq3tW/fHuPGjcOCBQusPr6goABBQUHIz89H/fr1nVlUIiIiUoirrt+qrxm6efMmduzYgREjRphsHzFiBLZt2+amUhEREZG38HN3Aay5ePEi9Ho9mjRpYrK9SZMmyM3NNfuYkpISlJSUGG/n5+cDkBMmEREReQbDddvZjViqD0MGkiSZ3BZCVNlmsGDBAsydO7fK9qioKKeUjYiIiJzn0qVLCAoKctrxVR+GGjVqBF9f3yq1QHl5eVVqiwxmzpyJadOmGW9fvXoVzZs3x6lTp5z6YqpNQUEBoqKikJOTo6m+UjxvnrcW8Lx53lqQn5+PZs2aITg42KnPo/ow5O/vj549e2LDhg247777jNs3bNiAsWPHmn2MTqeDTqersj0oKEhTHyKD+vXr87w1hOetLTxvbdHqefv4OLeLs+rDEABMmzYNEydORK9evdC/f38sXboUp06dwrPPPuvuohEREZGH84gwdP/99+PSpUt44403cO7cOXTq1AnffPMNmjdv7u6iERERkYfziDAEAJMmTcKkSZMceqxOp8Ps2bPNNp15M543z1sLeN48by3geTv3vD1i0kUiIiIiZ1H9pItEREREzsQwRERERJrGMERERESaxjBEREREmuaRYeiTTz5BdHQ0AgIC0LNnT2zZsqXa/Tdv3oyePXsiICAALVu2xJIlS6rss2bNGnTo0AE6nQ4dOnRAWlqas4rvMHvOOzU1FcOHD0fjxo1Rv3599O/fH99//73JPsuXL4ckSVV+iouLnX0qdrHnvDMzM82e0+HDh03287b3+7HHHjN73h07djTu4wnvd1ZWFsaMGYPw8HBIkoT09HSrj/GG77e95+0t3297z9tbvt/2nre3fL8XLFiA3r17o169eggNDcW4ceNw5MgRq49zxXfc48LQqlWrkJiYiFmzZmHXrl2IiYnByJEjcerUKbP7Z2dn45577kFMTAx27dqF1157Dc8//zzWrFlj3Ofnn3/G/fffj4kTJ2LPnj2YOHEiEhIS8Ouvv7rqtKyy97yzsrIwfPhwfPPNN9ixYweGDh2KMWPGYNeuXSb71a9fH+fOnTP5CQgIcMUp2cTe8zY4cuSIyTm1bt3aeJ83vt8ffPCByfnm5OQgODgY8fHxJvup/f0uKipC165dsXjxYpv295bvt73n7S3fb3vP28DTv9/2nre3fL83b96MyZMn45dffsGGDRtQVlaGESNGoKioyOJjXPYdFx6mT58+4tlnnzXZ1q5dOzFjxgyz+7/66quiXbt2JtueeeYZ0a9fP+PthIQEcffdd5vsc9ddd4kHHnhAoVLXnL3nbU6HDh3E3LlzjbeXLVsmgoKClCqiU9h73hkZGQKAuHLlisVjauH9TktLE5IkiRMnThi3ecL7XREAkZaWVu0+3vL9rsiW8zbHE7/fFdly3t7y/a7IkffbG77fQgiRl5cnAIjNmzdb3MdV33GPqhm6efMmduzYgREjRphsHzFiBLZt22b2MT///HOV/e+66y789ttvKC0trXYfS8d0NUfOu7Ly8nJcu3atymJ3hYWFaN68OSIjIzF69Ogqf1m6U03Ou3v37ggLC8Odd96JjIwMk/u08H5/+umnGDZsWJVZ2tX8fjvCG77fSvDE73dNePL3Wwne8v3Oz88HgGoXYXXVd9yjwtDFixeh1+urrFbfpEmTKqvaG+Tm5prdv6ysDBcvXqx2H0vHdDVHzruyf/zjHygqKkJCQoJxW7t27bB8+XJ89dVXWLlyJQICAjBgwAAcO3ZM0fI7ypHzDgsLw9KlS7FmzRqkpqaibdu2uPPOO5GVlWXcx9vf73PnzuHbb7/Fk08+abJd7e+3I7zh+60ET/x+O8Ibvt815S3fbyEEpk2bhoEDB6JTp04W93PVd9xjluOoSJIkk9tCiCrbrO1febu9x3QHR8u4cuVKzJkzB2vXrkVoaKhxe79+/dCvXz/j7QEDBqBHjx746KOP8OGHHypX8Bqy57zbtm2Ltm3bGm/3798fOTk5ePfddzFo0CCHjukujpZx+fLlaNCgAcaNG2ey3VPeb3t5y/fbUZ7+/baHN32/HeUt3+8pU6Zg79692Lp1q9V9XfEd96iaoUaNGsHX17dK2svLy6uSCg2aNm1qdn8/Pz+EhIRUu4+lY7qaI+dtsGrVKjzxxBNITk7GsGHDqt3Xx8cHvXv3Vs1fEjU574r69etnck7e/H4LIfDZZ59h4sSJ8Pf3r3Zftb3fjvCG73dNePL3Wyme9v2uCW/5fk+dOhVfffUVMjIyEBkZWe2+rvqOe1QY8vf3R8+ePbFhwwaT7Rs2bMAdd9xh9jH9+/evsv8PP/yAXr16oVatWtXuY+mYrubIeQPyX4yPPfYYkpKSMGrUKKvPI4TA7t27ERYWVuMyK8HR865s165dJufkre83II/WOH78OJ544gmrz6O299sR3vD9dpSnf7+V4mnf75rw9O+3EAJTpkxBamoqNm3ahOjoaKuPcdl33Oau1irx5Zdfilq1aolPP/1UHDx4UCQmJoo6deoYe9XPmDFDTJw40bj/H3/8IQIDA8WLL74oDh48KD799FNRq1YtsXr1auM+P/30k/D19RV///vfxaFDh8Tf//534efnJ3755ReXn58l9p53UlKS8PPzEx9//LE4d+6c8efq1avGfebMmSO+++478fvvv4tdu3aJxx9/XPj5+Ylff/3V5ednib3n/f7774u0tDRx9OhRsX//fjFjxgwBQKxZs8a4jze+3wYPP/yw6Nu3r9ljesL7fe3aNbFr1y6xa9cuAUC89957YteuXeLkyZNCCO/9ftt73t7y/bb3vL3l+23veRt4+vf7ueeeE0FBQSIzM9Pkc3v9+nXjPu76jntcGBJCiI8//lg0b95c+Pv7ix49epgMy3v00UfF4MGDTfbPzMwU3bt3F/7+/qJFixbin//8Z5VjpqSkiLZt24patWqJdu3amXy51MKe8x48eLAAUOXn0UcfNe6TmJgomjVrJvz9/UXjxo3FiBEjxLZt21x4Rrax57zffvtt0apVKxEQECAaNmwoBg4cKNavX1/lmN72fgshxNWrV0Xt2rXF0qVLzR7PE95vw9BpS59bb/1+23ve3vL9tve8veX77cjn3Bu+3+bOGYBYtmyZcR93fcelWwUkIiIi0iSP6jNEREREpDSGISIiItI0hiEiIiLSNIYhIiIi0jSGISIiItI0hiEiIiLSNIYhIiIi0jSGISIiItI0hiEiIiLSNIYhIiIi0jSGISLySCtXrkRAQADOnDlj3Pbkk0+iS5cuyM/Pd2PJiMjTcG0yIvJIQgh069YNMTExWLx4MebOnYv//Oc/+OWXXxAREeHu4hGRB/FzdwGIiBwhSRLmz5+PuLg4hIeH44MPPsCWLVsYhIjIbqwZIiKP1qNHDxw4cAA//PADBg8e7O7iEJEHYp8hIvJY33//PQ4fPgy9Xo8mTZq4uzhE5KFYM0REHmnnzp0YMmQIPv74Y3z55ZcIDAxESkqKu4tFRB6IfYaIyOOcOHECo0aNwowZMzBx4kR06NABvXv3xo4dO9CzZ093F4+IPAxrhojIo1y+fBkDBgzAoEGD8K9//cu4fezYsSgpKcF3333nxtIRkSdiGCIiIiJNYwdqIiIi0jSGISIiItI0hiEiIiLSNIYhIiIi0jSGISIiItI0hiEiIiLSNIYhIiIi0jSGISIiItI0hiEiIiLSNIYhIiIi0jSGISIiItI0hiEiIiLStP8HNykkL3zarXkAAAAASUVORK5CYII=", + "image/png": "iVBORw0KGgoAAAANSUhEUgAAAkMAAAHFCAYAAADxOP3DAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjguMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy81sbWrAAAACXBIWXMAAA9hAAAPYQGoP6dpAABV2ElEQVR4nO3deXxTVfo/8E+6s7SFFihdaUG2UhbZZKeMrJIO2EFUFBEHRwdQKjojfBkHcFQGf6OAosM4KrhMKyoFNYiC0LIIaFlU9s0CpVBKWVoodEvO74+Y0LRJm6Q3yb25n/fr1Rfm3pubc28a8/Sc5zxHI4QQICIiIlIpH083gIiIiMiTGAwRERGRqjEYIiIiIlVjMERERESqxmCIiIiIVI3BEBEREakagyEiIiJSNQZDREREpGoMhoiIiEjVGAwRydCqVaug0WjMP35+foiMjMQDDzyAEydOeKxdCxYsgEaj8djrK8Hp06eh0Wjwr3/9y9NNISI7+Xm6AURk28qVK9GpUyeUlZXh+++/x8svv4ysrCwcPXoUzZs393TziIi8AoMhIhlLSkpC7969AQDJycnQ6/WYP38+1q1bh6lTp3q4deRJlZWV5l5DImoYDpMRKYgpMLp48aJ5W1lZGZ599ln06NEDoaGhCAsLQ//+/fHFF1/Uer5Go8HMmTPx0UcfoXPnzmjcuDG6d+8OnU5X69j169ejR48eCAwMREJCgs1hn7KyMsydOxcJCQkICAhAdHQ0ZsyYgWvXrlkcFx8fD61WC51OhzvvvBONGjVC586dza+9atUqdO7cGU2aNEHfvn2xZ8+eeu+HaTgxKysLf/7zn9GiRQuEh4cjNTUV58+fr3XtCxYsqHWO+Ph4PProo7XOuWXLFjz++OMIDw9HSEgIHnnkEZSWlqKgoAATJ05Es2bNEBkZieeeew6VlZW1zmswGPDyyy8jLi4OQUFB6N27NzZv3lzruBMnTmDSpElo1aoVAgMD0blzZ7z11lsWx2RnZ0Oj0eCjjz7Cs88+i+joaAQGBuLkyZO4efMmnnvuOSQkJCAoKAhhYWHo3bs3MjIy6r1/RGTEPymIFCQ3NxcA0KFDB/O28vJyXLlyBc899xyio6NRUVGB7777DqmpqVi5ciUeeeQRi3OsX78eOTk5ePHFF9G0aVO8+uqruPfee3Hs2DG0bdsWALB582aMGzcO/fv3xyeffAK9Xo9XX33VIggDACEExo8fj82bN2Pu3LkYPHgwfvnlF8yfPx+7du3Crl27EBgYaD7+559/xty5czFv3jyEhoZi4cKFSE1Nxdy5c7F582a88sor0Gg0eP7556HVapGbm4tGjRrVe1+mTZuGsWPHIj09HXl5efjLX/6Chx9+GFu2bHH6Xk+bNg2pqan45JNPsH//fvzf//0fqqqqcOzYMaSmpuJPf/oTvvvuOyxevBhRUVGYPXu2xfOXL1+ONm3aYOnSpTAYDHj11VcxZswYbN26Ff379wcAHD58GAMGDEBcXBxee+01tG7dGt9++y2efvppFBUVYf78+RbnnDt3Lvr3748VK1bAx8cHrVq1wuzZs/HRRx/hpZdewp133onS0lIcPHgQly9fdvraiVRHEJHsrFy5UgAQu3fvFpWVleL69evim2++Ea1btxZDhgwRlZWVNp9bVVUlKisrxR//+Edx5513WuwDICIiIkRJSYl5W0FBgfDx8RGLFi0yb7vrrrtEVFSUuHXrlnlbSUmJCAsLE9X/t/HNN98IAOLVV1+1eJ3Vq1cLAOKdd94xb2vTpo1o1KiROHfunHnbTz/9JACIyMhIUVpaat6+bt06AUB8+eWXdt2n6dOnW2x/9dVXBQBx4cIFi2ufP39+rXO0adNGTJkypdY5n3rqKYvjxo8fLwCI119/3WJ7jx49RM+ePc2Pc3NzBQCb92/48OHmbaNGjRIxMTGiuLjY4pwzZ84UQUFB4sqVK0IIIbKysgQAMWTIkFrtT0pKEuPHj6+1nYjsx2EyIhnr168f/P39ERwcjNGjR6N58+b44osvauWJfPbZZxg4cCCaNm0KPz8/+Pv747333sORI0dqnXPYsGEIDg42P46IiECrVq1w5swZAEBpaSlycnKQmpqKoKAg83HBwcFISUmxOJep56X6MBMA3HfffWjSpEmtYaEePXogOjra/Lhz584AjPlQjRs3rrXd1Kb6/P73v7d43K1bN4eeb41Wq7V4bGrT2LFja2239jq27t+2bdug1+tRVlaGzZs3495770Xjxo1RVVVl/rnnnntQVlaG3bt3W5zzD3/4Q63X6du3LzZs2IA5c+YgOzsbt27dcvqaidSKwRCRjH344YfIycnBli1b8MQTT+DIkSN48MEHLY7JzMzExIkTER0djY8//hi7du1CTk4OHnvsMZSVldU6Z3h4eK1tgYGB5i/Rq1evwmAwoHXr1rWOq7nt8uXL8PPzQ8uWLS22azQatG7dutZQTVhYmMXjgICAOrdba781Na/JNDTXkMDAkbZaa6et+1dRUYEbN27g8uXLqKqqwptvvgl/f3+Ln3vuuQcAUFRUZPH8yMjIWud844038Pzzz2PdunUYNmwYwsLCMH78eI+WYCBSGuYMEclY586dzUnTw4YNg16vx7vvvovPP/8cEyZMAAB8/PHHSEhIwOrVqy1qAJWXlzv1ms2bN4dGo0FBQUGtfTW3hYeHo6qqCpcuXbIIiIQQKCgoQJ8+fZxqgysEBgZavSeuyq2xdf8CAgLQtGlT+Pv7w9fXF5MnT8aMGTOsniMhIcHisbUaT02aNMHChQuxcOFCXLx40dxLlJKSgqNHj0pzMURejj1DRAry6quvonnz5vj73/8Og8EAwPgFGRAQYPFFWVBQYHU2mT1Ms7kyMzMtejyuX7+Or776yuLYu+++G4AxIKtuzZo1KC0tNe+Xg/j4ePzyyy8W27Zs2YIbN2645PVs3b/BgwfD19cXjRs3xrBhw7B//35069YNvXv3rvVjrRevLhEREXj00Ufx4IMP4tixY7h586bUl0XkldgzRKQgzZs3x9y5c/HXv/4V6enpePjhh6HVapGZmYnp06djwoQJyMvLwz/+8Q9ERkY6PVTyj3/8A6NHj8aIESPw7LPPQq/XY/HixWjSpAmuXLliPm7EiBEYNWoUnn/+eZSUlGDgwIHm2WR33nknJk+eLNWlN9jkyZPxwgsv4O9//zuGDh2Kw4cPY/ny5QgNDXXJ6/n6+mLEiBGYPXs2DAYDFi9ejJKSEixcuNB8zLJlyzBo0CAMHjwYf/7znxEfH4/r16/j5MmT+Oqrr+yaDXfXXXdBq9WiW7duaN68OY4cOYKPPvoI/fv3t8jDIiLbGAwRKcxTTz2F5cuX48UXX8SDDz6IqVOnorCwECtWrMD777+Ptm3bYs6cOTh37pzFF68jRowYgXXr1uFvf/sb7r//frRu3RrTp0/HrVu3LM6p0Wiwbt06LFiwACtXrsTLL7+MFi1aYPLkyXjllVcsptV72l/+8heUlJRg1apV+Ne//oW+ffvi008/xbhx41zyejNnzkRZWRmefvppFBYWokuXLli/fj0GDhxoPiYxMRH79u3DP/7xD/ztb39DYWEhmjVrhvbt25vzhurzu9/9Dl9++SWWLFmCmzdvIjo6Go888gjmzZvnkusi8kYaIYTwdCOIiIiIPIU5Q0RERKRqDIaIiIhI1RgMERERkaoxGCIiIiJVYzBEREREqsZgiIiIiFRNFXWGDAYDzp8/j+DgYKvl7ImIiEh+hBC4fv06oqKi4OPjuv4bVQRD58+fR2xsrKebQURERE7Iy8tDTEyMy86vimAoODgYgPFmhoSEeLg1REREZI+SkhLExsaav8ddRRXBkGloLCQkhMEQERGRwrg6xYUJ1ERERKRqDIaIiIhI1RgMERERkaoxGCIiIiJVYzBEREREqsZgiIiIiFSNwRARERGpGoMhIiIiUjUGQ0RERKRqDIaIiIhI1RgMERERkaoxGCIiIiJVYzBEREREqsZgiIiIiFSNwRARERGpGoMhIiIiUjUGQ0RERKRqHg+Gtm3bhpSUFERFRUGj0WDdunU2j33iiSeg0WiwdOlSt7WPiIiIvJvHg6HS0lJ0794dy5cvr/O4devW4YcffkBUVJSbWkZERERq4OfpBowZMwZjxoyp85j8/HzMnDkT3377LcaOHeumlhEREZEaeLxnqD4GgwGTJ0/GX/7yF3Tp0sXTzSEiIiIv4/GeofosXrwYfn5+ePrpp+1+Tnl5OcrLy82PS0pKXNE0IiIi8gKy7hnau3cvli1bhlWrVkGj0dj9vEWLFiE0NNT8Exsb68JWEhERkZLJOhjavn07CgsLERcXBz8/P/j5+eHMmTN49tlnER8fb/N5c+fORXFxsfknLy/PfY0mIiIiRZH1MNnkyZMxfPhwi22jRo3C5MmTMXXqVJvPCwwMRGBgoKubR0RERF7A48HQjRs3cPLkSfPj3Nxc/PTTTwgLC0NcXBzCw8Mtjvf390fr1q3RsWNHdzeViIiIvJDHg6E9e/Zg2LBh5sezZ88GAEyZMgWrVq3yUKuIiIhILTweDCUnJ0MIYffxp0+fdl1jiIiISHVknUBNRERE5GoMhoiIiEjVGAwRERGRqjEYIiIiIlVjMERERESqxmCIiIiIVI3BEBEREakagyEiIiJSNQZDREREpGoMhoiIiEjVGAwRERGRqjEYIiIiIlVjMERERESqxmCIiIiIVI3BEBEREakagyEiIiJSNQZDREREpGoMhoiIiEjVGAwRERGRqjEYIiIiIlVjMERERESqxmCIiIiIVI3BEBEREakagyEiIiJSNQZDREREpGoMhoiIiEjVGAwRERGRqjEYIiIiIlVjMERERESqxmCIiIiIVI3BEBEREakagyEiIiJSNQZDREREpGoMhoiIiEjVGAwRERGRqjEYIiIiIlVjMERERESqxmCIiIiIVI3BEBEREamax4Ohbdu2ISUlBVFRUdBoNFi3bp15X2VlJZ5//nl07doVTZo0QVRUFB555BGcP3/ecw0mIiIir+LxYKi0tBTdu3fH8uXLa+27efMm9u3bhxdeeAH79u1DZmYmjh8/jt///vceaCkRERF5I40QQni6ESYajQZr167F+PHjbR6Tk5ODvn374syZM4iLi7PrvCUlJQgNDUVxcTFCQkIkai0RERG5kru+v/1cdmYXKS4uhkajQbNmzWweU15ejvLycvPjkpISN7SMiIiIlMjjw2SOKCsrw5w5czBp0qQ6I8RFixYhNDTU/BMbG+vGVhIREZGSKCYYqqysxAMPPACDwYC33367zmPnzp2L4uJi809eXp6bWklERERKo4hhssrKSkycOBG5ubnYsmVLveOGgYGBCAwMdFPriIiISMlkHwyZAqETJ04gKysL4eHhnm4SEREReRGPB0M3btzAyZMnzY9zc3Px008/ISwsDFFRUZgwYQL27dsHnU4HvV6PgoICAEBYWBgCAgI81WwiIiLyEh6fWp+dnY1hw4bV2j5lyhQsWLAACQkJVp+XlZWF5ORku16DU+uJiIiURzVT65OTk1FXPCajMkhERETkhRQzm4yIiIjIFRgMERERkaoxGCIiIiJVYzBEREREqsZgiIiIiFTN47PJiIiIiCzo9cD27cCpU255OQZDREREJB+ZmcCsWcC5c257SQZDREREJA+ZmcCECYCbawwyZ4iIiIg8T6839gh5oNgygyEiIiLyvO3b3To0Vh2DISIiIvK8Cxc89tLMGSIiIiLXMc0Mu3ABiIwEBg8GfH1rHxcZ6f62/YY9Q0REROQamZlAfDwwbBgwaZLx3/h44/aaBg8GYmIAjcbdrWQwRERERC5gmhlWMw8oP9+4vWZA5OsLLFtm/G83B0QMhoiIiEhadc0MM21LSzMeV11qKvD550B0tMubWB2DISIiIpJWfTPDhADy8ozH1ZSaCpw+DWRlAe++67ImVsdgiIiIiKRl78wwW8f5+gLJycB990nWpLowGCIiIiJp2TszzIMzyKpjMERERETSqm9mmEYDxMYaj5MBBkNEREQkrbpmhpkeL11qvd6QBzAYIiIiIunZmhkWE2Pcnppq+7l6PZCdDXz2mUubaKIRwgMrorlZSUkJQkNDUVxcjJCQEE83h4iISD3srUBtkplpnJZ/7hxKAIQCLv/+5nIcRERE5DqmmWH2MBVqdHM/DYfJiIiIyPPqKtToYgyGiIiIyPPqK9ToQgyGiIiIyPPsLdToAgyGiIiIyPM8WICRwRARERF5Xn2FGl2IwRAREXmGqZZMRobx35ormJO61FWo0cUYDBERkftlZgLx8cCwYcCkScZ/4+ON28m15ByE2irU6GIMhoiIyL1MtWRqzhzKzzduZ0DkOkoIQlNTgdOngaws4N133fKSrEBNRETuo9cbv3xtTaHWaIx5I7m5slm3ymvYKmhoGpKqb4kMD3DX9zd7hoiIyH3qqyUjBJCXZzyOpFNXQUPTtrQ0eQ2ZuRGDISIicp8vvrDvOA/WnJEdKXJ8GITWiWuTERGRe2RmAkuX2nesB2vOyEq1RUvNYmKMs64cGdKyN7hUaRDKniEiInI90zBNfTQaIDbWWHNG7aRMNLc3uHRXECqzGW0MhoiIyPXsXXdKCGPvkdqTp6XO8amvoKE7g1AZzmhjMERERK5n7/BLWprsZjR5hNQ5PnUVNDQ9dkcQKtOyCh4PhrZt24aUlBRERUVBo9Fg3bp1FvuFEFiwYAGioqLQqFEjJCcn49ChQ55pLBEROcfe4Zdx41zbDqVwRY6PrYKGMTHST6s3DYP973/GIOujj4DXXgOmTZPljDaPJ1CXlpaie/fumDp1Kv7whz/U2v/qq6/i9ddfx6pVq9ChQwe89NJLGDFiBI4dO4bg4GAPtJiIiBxmGqbJz7f+ZWiqL8RcISNX5fikphoDzu3bjYFUZKTxnkvZI2Qt6dse1Xu7kpOla48dPB4MjRkzBmPGjLG6TwiBpUuXYt68eUj9LWL94IMPEBERgfT0dDzxxBPubCoRETnLNEwzYYIx8KkeELlzmEYpXBk8+vq6LtiwVdjRERcuGHuHtm8HTp2Srm118PgwWV1yc3NRUFCAkSNHmrcFBgZi6NCh2Llzp83nlZeXo6SkxOKHiIg8zJ3DNEonlxwfR9SV9O2IEyduJ1hPmyZJ0+oj62CooKAAABAREWGxPSIiwrzPmkWLFiE0NNT8Exsb69J2EhGRnaqvO5Webvw3N5eBkDVKCx7tnTFoi0YDhIcD8+c37DxO8PgwmT00NaJiIUStbdXNnTsXs2fPNj8uKSlhQEREJBeuHKbxNu7I8ZGKggs2yjoYat26NQBjD1FktSSxwsLCWr1F1QUGBiIwMNDl7SMiInI5pQSPDS3YOHEisHq1NG1xkKyHyRISEtC6dWts2rTJvK2iogJbt27FgAEDPNgyIiIismBK+nbWd99J1xYHebxn6MaNGzh58qT5cW5uLn766SeEhYUhLi4OaWlpeOWVV9C+fXu0b98er7zyCho3boxJkyZ5sNVEREQyZpqN5c6hteozBp1Jor58Wfo22cnjwdCePXswbNgw82NTrs+UKVOwatUq/PWvf8WtW7cwffp0XL16FXfddRc2btzIGkNERETWSLW4qzNMSd/O1BkCcBlhaI6r8EEDZ6Q5SCNEQ+fAyV9JSQlCQ0NRXFyMkJAQTzeHiIjINWzV+TFNOnLXLDRTz1R+PnDpEm4eO4PGK5bW+7RLD6ehxf+WQQMAQqAEQCjg8u9vWecMERERkZ2kXty1AYTGB0duxOLV/0VjyPxhmLKiP6pQxzDdbwvFtlz1L2islRNwMQZDRERE3kDqxV0dVF5Sjk3/3ItZPbbijsCzSExph+c3JKNFySmsxgPwRT1BmKmIZPVaVO++65K21uTxnCEiIiKSgCsWd63HxYOX8PXrR6H71h8bz3fBDfQy7wtAOe4O+wkf3HoSmlsCNqsD+voCGRmWw3emcgI9e7qlCjWDISIiIm/QqpW0x1khDAI/rT4G3bsF0P3QAj+WJgFoad7f2ucixt5xHNrUAAyf1QVNj94Chl2q+6R6PdCyZd3HuBiDISIiIms8MT3dWXo98PPPLjn1zaKb2LzsIHSfl2H98fbIN3QC0Mm8v1fjw9D2KYT2sVboOakTfPyqFUXOcn9vlTMYDBEREdXkyenpjrLW1roUFtZ7SN4P57F+2UnoNgdhc2FXlKGveV9jlGJE64PQjqzAPbPaI6pnIoBE6yeytyp1Q6tXNxCDISIioupsTU/Pzzdul9MiqbbaWhcrgYe+Qo+cD49At6oIur2R+LmsI4Ao8/4433NISTwF7cQmSJ6ZhKBmd9n3Wqaq1Pn51tuo0Rj3Dx5sf/tdgHWGiIhIvtw9VKXXA/HxtntZTF/eubmeHzKrr6011Wh7ybkSbFxyCLov9Pj61464JG7n7WhgQP/gg9D2v4KUJ6PRZdwd0PjYXiC9TqaADbAMiOyofeSu72/2DBERkTxJNVTlSEDlyPR0Ty+eWl9bq/st8Ljw2DysnrADuq3B2HY1CZXobz4kBMUYHXsI2nsMGPNMZ7To2E2adtqqSh0TY5xOL4NeNgZDREQkP1INVTkaUHlgerrTHGjDVb8W+LtYiOULn7DY3sE/F9puZ6CdFIpBTybBv7GLFkFPTQXGjZNtQjqDISIiqp87h6vqq6Ss0RgrKY8bV3cbnAmoFJLw60gb0rAEb1Y+BQN84YdKDGl+ANohJRj75zboMCoBQIJr22liqh0kQ8wZIiKiurl7ZlV2NlBtAW+bsrJsf7k6m/tjel59Cb8yyhkS+fnQWGmrARqcQwx6Yw9Gtz2OlHG+GJmWiNC4UA801jnu+v7mchxERGSbqXelZlBh6l3JzJT+NaUYqnJ2aQpfX2OQB9xO8DUxPTYtG+FB5SXl+Paf+/Guz58ghDHwqc4ADTQQuPnEM7hQHo4PTw3Cfa/3V1Qg5E4MhoiIyDpPLfwpxVBVQwIqU8JvzcVCY2I8Oq2+4JdCvPfodtwbtRvhoZUY/bfeePzsC5iAz3G+2jR4APCJjYFmzRp0WvEMfAPkkZcjZ8wZIiIi6zw1s0qK2jQNDajclfBbRy6WMAjszzgK3XsXofuxJXJKuwC4vZRGpE8BtB2OQ5sajeYzDwPH9skyOVkJGAwREZF1nppZZRqqmjDBGPhYq01T31CVFAGVqxN+reRiGSKjsbf/TPz38ACsP94e5w2dAXQ27+/d+DC0fQuRMi0CPe7vCB+/1rfPF+nCtno5DpMREZF1npxZ1dChKrnn/tjKxbpwHr0y/w9FR4tw3hCJJriB8ZG78e6U7Ti//yJyShMxPysZPR/qDB8/foVLhbPJiIjIOjnMrGrolH5rM+FiYz1a7E9/qwJVUXEIuHYR1mo6G6BBsX9L/PjClxj6VHcENQtyexvlwl3f3wyGiIjItgYspeAW9gRLMlh9vvhsMTYuPQzdF3pc+/UyvsD4+p+0ZAkQEXG7zYDHr8PdGAxJiMEQEVEDyLB3BYDsV5Y/sek0dG+dhm5bCLZd7Yoq+AMAHkAGMjDJsZOFhxv/vXz59jYZXaurMBiSEIMhIqIGkkHvigVb1aU92GNVebMSO1YchC69GLpf2uB4pWVl544Bv0Lb9Swe7ncSPd56vOEvKJfeORdiMCQhBkNERF5ERivLFx27jA1LjkD3tQ++yeuCEtwuauiHSgxtfgDaodcxdnobtB8Rb9l+W7lYjpBTRWwX4Kr1RERE1nhwZXlhEDj0xUno/pOPr3aGYff1LjBgkHl/C00RxrY9Cu04X4yYlYjQuJ61T1JX6QCHG+S6a1UTBkNERK4it6ElJbJ2D91c/6jsWhmylx+E7tNS6A63wxl9ewDtzfu7Bx2DttcFaB9tgT6PdIZvwCDbJzMxlQ6omfPkLKlrPakMgyEiIleQeXKvIli7h2FhxsrQ9mhA/aPz+wrw9bIT0G0MwKaCJNxEb/O+QJTh7pYHoL37FsY+3Q5x/TsC6Oj4i9Sscn3xIvDMM8412BW1nlSEOUNERFKTYXKv4ti6hyY+PoDBYH2fE3k0hioD9qUfhe79QuhyWmHvzUSL/VE+F6DtcALaCUH43VNd0KRVE0euxj7O5BIxZ0gSDIaIiKQko+RexarvHtbFgYDzRsENfLfsEHSZFVh/sgMKDBEW+/s2OQjtXUXQTmuNHvd3hMbHWolEidmq62SNCoJrJlATESmRB5N7vUZ997A6X19j8GQSE1Nn/aPTO85h/RunoMtqjKyirijHXeZ9TXEdI6MOQTuqEmPSOqJ1t6QGXISTbOUS2aoz5OlaT16CwRBRXZgAS47y1OKm3sSRe6PX167UXO0zqq/QY/d7h6D78Ap0+6NxsLw9gBjz/gS/s9Am5iLlwaYYMj0JgSH9JLwQJ9XMJVJxBWp3YTBEZAsTYMlRer0xCdYeTHi1zdF7ExEBPPig+eG1M8X49vVD0H1lwIbTnXFZdDPv84EeA0MOQjvwKrRPxqCzth00PnFStVw6vr7Wew7Zm+gSzBkisoYJsOQoa8GzNcwZqp+jOUNZWTh2Kw66t89CtyMU2691hb7a3/rNNNcwJu4QtGOB0bMTEdauuWvaTZJjzhCRp+j1xi81a38nCGH8MktLM3Zj88uMgPpnPpmYgumlS/m7UxdfX+Dxx4H58+s99LpvKPqMiMGxqrYA2pq3dw44BW33PGgnN8eAx7vAL2igCxtMSsdgiKgmJsCSI+oKnmtiwqttNfPz2rWz62n/1U/FMdwBf1QgOewAtMk3MHZGPNr9rh0A+85BxGCIqCYmwNrGhPLa7J35tGQJ8NRTvF/WWBtibNnSrqdWRCXg80m7MPKZJARH9XJRA8nbMRgiqsne5E21JcAyodw6e4PiiAjvDIQaGiDbGGIUly4Z/wXgY+VpAsbcqzmnZ3jnfSW3svY7RqRugwcbv+Q1NgqsaTRAbOztqa5qYPrCqtkDkp9v3J6Z6Zl2yYGag+fMTGOi87BhwKRJxn/j4+3/ffhtiNHaPB4NjIGQBkCtOtMaDTQaQLNsKQMhkgSDIaKaTCtKA7UDIjUkwOr1QHY2kJFh/Leiou6EcsCYUF698J2aqDV4bkCAbKgyIOeDw1jZ803g3DnYquvsA2Mw5NOiheWOmBjO6CRJcWo9kS3WhoViY707AdZW7sZvQxZ1yspSb0K5rSUUvLUUgxNLjlw/f9249MXaSqw/1REXDa3wADKQgUn1v97HHwPR0cxVUyFOrf9NVVUVFixYgP/9738oKChAZGQkHn30Ufztb3+Djw87tsiFbFWB9db/CduaHm5PIASoM6HcxNYSCt46e8zOGZcXlq/B59sjoMtuguzLXVGB29Wdm+I6OrS4AhTZ8XrR0eoNtMktZB8MLV68GCtWrMAHH3yALl26YM+ePZg6dSpCQ0Mxa9YsTzePvJ2tKrDexpHp4bZ4Y06MI9QUPNsZ+M5O0+MTDDU/but3BilJp6F9MBhDpichoNGTQPw/ba/SbuphGjyYMxnJpWQfDO3atQvjxo3D2LFjAQDx8fHIyMjAnj17PNwyIi/iyMKYNVX/wlI7tQTPdga+hWiFoaE/QTvoGrTT49BxdAI0Pm0sD1q2zNgjqdFYH2JcuhT44gvOZCSXkv0406BBg7B582YcP34cAPDzzz9jx44duOeeezzcMiIv4uwQlxoSysmCMAgcvR6N60EtYbCR+mwAUNq0FT4/0QPZ13rgOV0yOt3TFhofK8ebhhijoy23m5KkAfnOZKw52UBtkwi86Ppl3zP0/PPPo7i4GJ06dYKvry/0ej1efvllPFhtUb6aysvLUV5ebn5cUlLijqYSKZe9Q1wtWgBF1ZI8vDUnhixU3KjAtrcPQpdxHbqD8ThV1R73YgU+xwQYoIEPbvfoCI0GPgCafPBvNLkj3L4XqGuV9vh4eS6No/a6W952/ULmMjIyRExMjMjIyBC//PKL+PDDD0VYWJhYtWqVzefMnz9fwFiiwuKnuLjYjS0nUpCqKiFiYoTQaIQwfs1Y/mg0QsTGClFeLkRWlhDp6cZ/q6o83XJykYsHC8XKP24Xf4jeKYJRbPHrEIAyMTI8R6zv96KobBlp+bsSGyvEmjXSNCIry/rvY82frCxpXs9ea9ZY/6xoNMYfqa5frtx4/cXFxW75/pb91PrY2FjMmTMHM2bMMG976aWX8PHHH+Po0aNWn2OtZyg2NpZT64nqorbp4WRBGAR++fw4dP+9AN3ucPxwowtEtUyKCJ9CjG13DNp7/TF8VhcERwUbd7gysTkjw1jMsT7p6UAdowWScqKsgKw09P1y8/Vzav1vbt68WWsKva+vLwyGWjVJzQIDAxEYGOjqphF5F7VNDyfcunILW944CN1nt6A7dgfO6TsC6Gje37PREWj7XIT2sVbo9VAn+Pi1qn0SVyaNy7G6t5IXcpZiaEvJ118H2QdDKSkpePnllxEXF4cuXbpg//79eP311/HYY495umlE3sfT08OVPn1aAe0/l3MB65eegO67IGwuTMIt9DHva4SbGB5xANrh5Rib1h7Rd3YAtl8E8vcDyzcaC3BGR7vvukzVve2Zei+V+t5DpS7kbKuOmCkR3d6eX6Vef31cOggngZKSEjFr1iwRFxcngoKCRNu2bcW8efNEeXm53edw15gjETXAmjXGvKXqOQgxMcrJv5Bp+/WVerH73QPib4OyRI9GR2qlecT6nhN/7rJVrF/wo7h5+ebtJ1q7Hk9clyk/pWaOiivyc+x5D+Wax1QXU06grbaacgLtyQF08/W76/tb9sGQFBgMEcmc0hNSZdb+kvwSseYvu8Sjd2wTrTSFlk2CXvRv+ot4eUSW+PmzY8KgN9h/PTWvzZ0BUc0vcykTtU2vYc97aO9kAzlNLpAygHHz9TOBWkJcm4xIxrwhIVUG7f81+yx0b+ZCl90U2Ve6ohIB5n3BKMHomEPQjtFjzDOd0LJzC9snqu96TNz9vrhyCNLR91Bpkw2kTkR34/UzgZqI1EGqhExP5et4KKG0qqwKO/97CLqPrkL3cyyOVLQDEGfe387vDFK6nkbKQyEY9EQXBDTtb9+J7a1G7u5EWVcmajv6HiptsoHUiehKu347OBQM5eXlITY21lVtISI1kiIh05MF4NyYUHrl1FV88/ph6NYDG852wTXR3bzPF1UY3OwAtIOKoZ0ehw6jrCx94Yp2Ki1R1hpn3kNPTzZwhCsS0ZV0/XZwKBjq1KkTZs+ejTlz5qBJkyauahMReYKnelYa+lerVLNknOXC6d/CIHD061/x1dt50H3fHN+XJMGAgeb9YZoruCf+MLQpPhg1uwuatbnT4ddocDu9YYFeZ99DpaxF5+tr3xpwjn7elXL99nAkwej7778Xffv2FZGRkeL99993TRaTCzCBWuaqqljV2NM8OROqIQmZUs6S8UT7rSgrLhMbF+0RT3fPFm39Ttc6XVLgcTGnX5bY8fbPoqrcBddV3z2Vc6Kws5SYFO0MdySiS0zWs8k++OADERMTI3r06CGy5DR90AYGQzIm0+nIqiKHmVDOTp+WyzTnBk7/LjhQKN6fuk2kRu0STVFicYoAlIlR4Tli+X3ZInd7nmuvo+b1yGU2mTu4cwq/Jynsj09ZB0NCCHHz5k3xwgsviMaNG4vx48eLEydOSNkuSTEYkik5fAmrnRx6Vkyc+as1Pd2+YCg9XVbtN+gNYl/6EfHi77JE3yYHajW3tU+B+GOHbWLtnN3i+oXrrm+7NXXVGWpIb4Kcv4wV2HPi7WQ/tf7mzZvYt28f1qxZgzfeeAP+/v6YMWMGFixYgODgYOnG8STAqfUyJJPpyKqXnQ0MG1b/cVlZ9ecGSJFz5Og5pGy/FOpo/82im9i87CB0n5dh/fH2yDdY5p/0anwY2j6F0D7WCj0ndYKPn4+1V3Av0/Xk5wOXLjW8ArW1RPewMOO2efPk8VlXQBVxNXHX97dDwdCKFSuQk5ODnJwcHDlyBL6+vujWrRv69euHHj164H//+x+OHz+OtWvXonfv3i5rtKMYDMmQ3L7E1Eqq+iOems1lCqrrmiUTHQ2sWgUUFrr9yy3vh/NYv+wkdJuDsLmwK8rQyLyvMUoxovVBaEdW4J5Z7RHVs7Vb2uQxthLdTcLDgXfeMf6+MCCh38gyGIqNjUW/fv3MP7179661IOorr7yC9PR0HDx4UPLGOovBkAzJcTVqNZIiKLX1JeeuAnR1FYATwvgle/ny7e0uDNL0FXrkfHgEulVF0O2NxM9lHS32x/meQ0riKWgnNkHyzCQENQuS4EUVEDg4UsjxueeM/39wRWCthHtFFtz2/S31uFtBQYHw8fGR+rQNwpwhGZJL4qvaNXQWjVxyjqzleoSH226ThDlpxXnF4rPZO8WUdttFSytLXwwI/lm8MjJLHMg8bn3pi4ZQygQEez/vdf0eNfQ9U8q9IguyT6C2xWAwiOzsbKlP2yAMhmRILVNZlaAhs2jkFNRWT8z97juXBmknvjstlozPFnc33yv8UW5x6hBcExNjvxcfPrFdXDpaJO01VqekCQj2JrrXFxA5+54p6V6RBcUGQ3LEYMjN7J0topaprErg7CwaOc3mqk7iIK2itEJkL90vnu2VJToGnKp1mg7+v4rZvbLEltf2iYrSCpdemhBCPj1y9mpoz1BDAmul3Suy4K7vb65NRtJyJJHWC9e3USxnS+u7sPpyg0iwRMblE1fwzZIj0K3X4Ju8RFwTPcz7/FCJIc0PQDukBGP/3AYdRiUASGhYmx3hofXQnGZaDsKeNc/q4+jyH0q7V+QRDIZIOs4si+Bl69somjOl9V2x5pEUnAjShEHg8FenoFtxDrqdzbGzxtIX4ZrLuCfhCFLG+WJkWiJC43pK3Wr7uXE9NEmYloP4wx8afi5HA2ul3SvyCAZDJA293tjDY+0LUQjjl2JamjHwqRnoeNP6NmrjqjWPGsrOIK28e19kv7wHutWl0B1pi9NVdwC4w3xY16Dj0N55Htop4bhraiJ8Awa57xrqItceubqkpgJr1gB/+pPl7D6Tmr8/1vY7E1gr8V6R28mgqhd5BUe6osm7mIY7o6Mtt8fEuH5avS2mIA24HZT9Rmg0EEJg8fXpCA8zYPTfemP5gaE4XRWLQJRhTMscvHX/VpzecQ6/3OqAV3YmY8ATXeEbIKPeSlOwV+PazDQaIDbW/T1y9UlNBS5eBBYuNBZbrC4mBvjLX4xtr3ldDQmslXqvyK3YM0TSYFe0uslxuPO3IE3MmgVNtUA9T8QgDUux9poxSIv0KYC2w3FoUwNx96wkNGnVx1Mttp9ce+Ts4esL/P3vxorT1n5f+vWTNo9QyfeK3Mbp5TiUhEUX3YAVpUlGSgtLjUtfZJZjw7G2aCdOIhIXcAGR2I7B6Nn4GLR9C5EyLQI97u8oj6UvnGFtwkJsrPInILiiOKK33CuVFY6UZQVqpWIw5Ab2LIvAtcbIhc58fw7r3zwF3ZbG2HKpK8pxu7pzE9zAiMiD0I6sxD1pHRDZI8KDLZWYyr4cG0Tp98pTy954EIMhCTEYcpO6lkUAPJc/Ql5JX6HHDysPQ/fBZej2R+FAWQeL/W1MS1/c3wRDZ0i09AWRp3h62RsPYTAkIQZDbuQtXdEkS8Vni7Fx6WHovtDj69xOKBItzPt8oMeAkIPQDrgK7ZMxSExpB42PjaRZIiWpb203L+55ZzAkIQZDbqb0rmg54D00O7HpNHRvnYZuWwi2Xe2KKvib94WiGGPiDkE7VmD0M50R3j6sjjMRKZSKczLd9f3N2WQkPW+sG+TO4ETqvACFBVaVNyuxY8VB6NKLofulDY5XJgCIN+/vGPArtF3PImVyMwx4vAv8Gw/wWFuJ3IKzdV2OwRBRfdyZtOhMFe/6zqeAhMuiY5exYckR6L72wTd5XVCCO837/FCJoc0PQDv0OsZOb4P2I9oCaOu5xhK5GwtHuhyHyYjq4s6kRanzAmSccCkMAoe+OAndf/Lx1c4w7L7eBQbcvqYWmiKMbXsU2nG+GDErEaFxoR5pJ5EsqHi2LnOGJMRgiJzi7qRFKfMCZJhwWXatDNnLD0L3aSm+PhSPOEOuRe2frkEnoe11AdpHW6DPI53lVfFZThQ27EkSUelsXeYMEXmau1e7ljIvQCYrdZ/fV4Cvl52AbmMANhUk4SZ6415kYiseRixut6+qVST8/r3cK/9nLimFDHuSC5iWvZGyOjeZMRgissVdSYumv/QPH7bveHvyAjyUcGmoMmBf+lHo3i+ELqcV9t5MBNDavP+PmvfwXzGt1vP8LhU4lxOlJlLnk5HyyHHZGy/BYIjIFnckLVr7S98WR1btdmPC5Y2CG/hu2SHoMiuw/mQHFBgSASSa9/dtchDau4qgfawlesxZAI21SxXCeH1pacb/2fN/7pb0euPvibWsBt47dfHG2boywGCIvFtD8itMq13Xl7To7GrXtv7St0UI4LXX7Gu/i9t+esc5rH/jFHRZjZFV1BXluMu8rymuY2TUIWhHVWJMWke07pZk3JGdLYuhO0WSybAnkbdiMETey5n8iprB0+uvA/ffL/1q13X9pV+X2bONr1ffcIjEK3XrK/TY/d4h6D68At3+aBwsbw8gxrw/we8stIm5SHmwKYZMT0JgSL/aJ2GtFOfx3hG5FIMh8k7O5FfYCp6eew7IyJA2abG+v/RtcSQ/pIEJl9fOFOPb1w9B95UBG053xmXRzbzPB3oMDDkI7UDj0hedte2g8Ymruz2sleI83jsil+LUevI+zkwrr68mz6efAi1aOJ+0WLPHKT8fePhhhy/NZvsdee062n5sw6/QvX0Wuh2h2H6tK/TV/l5qprn229IXwOjZiQhr19yxdqu4VkqD8d6RSrHOkIQYDKmMo/V6XF2Tx1qPU8uWwKVLjp+rOgnWIaq4UYEd/zlkXPriQBucqEyw2N854BS03fOgndwcAx7vAr+gBnYmq7RWigVn89h470iFWGeIyFmO5le4MjnVVo9TUZFj57HGyfyQS0eKsGHJUeg2+OLbc4kWS1/4owLJYQegTb6BsTPi0e537QC0a3hbTdReK6UhdYLUfu/qwkKU1EAMhsj7OJpf4ark1PqmQzeUndcpDAIHMk9A98556HaFY/eNLhAYZN7fUnMJY9sdhXa8H0Y+k4TgqF4Nb1td1ForRYo6QWq9d3VhIUqSAIfJyHNc9deco/kVUi6DUZ29523RwrKnKCYGuHULuHLF6fyQW1duIevNg9B9dgu6o+2Qp4+22N+j0VFoexUYl76YkggfPx/7r4scJ8PlUbyCjNffI2lwmIy8myv/mnN0WrmravLY25O0dCkQHW0ZFH7xhcPT4vP3XMDXb5zAVxsD8d3FrriFPuZ9QbiF4a0OQDu8DGPT2iOmTycAnRy7HnIe6wRJj4UoSUpCAc6dOyceeughERYWJho1aiS6d+8u9uzZY/fzi4uLBQBRXFzswlaS3dasEUKjEcL4v6zbPxqN8WfNGuleJybG8jViY62f39Smmu1qSJuysmpfo7WfrCyn2q+v1IsfVx0Sfx+SJXo2OlzrtDG++eLJxK1CN/9HUXqp1PH2k3TS0+37XUhP93RLlaOhny9SBHd9f8u+Z+jq1asYOHAghg0bhg0bNqBVq1Y4deoUmjVr5ummkTPc+decI/kVDUlOtTXc19AeJyvtv96uB75bfhS6Odux/lRHXKy29IUGBvRtchjafkVI+VMkuk3oAI1PlN23i1yIdYKkx0KUJCHZB0OLFy9GbGwsVq5cad4WHx/vuQZRw7h7uMCRdXycSU6tb7ivoVWgfX2R69MOujUa6LKbIPtyI1TgdnXnpriOUdEHoR2tx5i0johISrLvWsm9XL20ixoxwCQJyT4Y+vLLLzFq1Cjcd9992Lp1K6KjozF9+nQ8/vjjNp9TXl6O8vJy8+OSkhJ3NJXsIfe/5hwJnuydHeRgj1NVWRV2vXsIuo+uQvdzDA6X3wEg1ry/rd8ZpCSdhvbBYAyZnoSApv0dvkxyM4mXRyEwwCRpuXQQTgKBgYEiMDBQzJ07V+zbt0+sWLFCBAUFiQ8++MDmc+bPny8A1PphzpAMeMs4f1VV7XyemrlGsbHG40zHZ2UZc0Kysm5v/82VX6+KjKe+Fw/F7xBhmssWp/JFpRgaul/8v7FZ4sj6U8KgN7j9ckkijuSxUf1cketHsuKunCHZT60PCAhA7969sXPnTvO2p59+Gjk5Odi1a5fV51jrGYqNjeXUejnwlmUFGjgdXxgEjn2T+9vSF82wozjJYumL5pqrGBN3GCm/12DUM4lontBMsqbbjYXsXIP3VVrWhqpjY1mI0ktwav1vIiMjkZiYaLGtc+fOWLNmjc3nBAYGIjAw0NVNI2d4y3CBE8N9FTcqsO3tg9BlXIfuYDxOVbUF0Na8PzHwJLTdz0E7uTn6T+sCv6CBEjfaASxk5zqODMVS/ViIkiQg+2Bo4MCBOHbsmMW248ePo02bNh5qETWYNywrYGdS5tWyRvhi2g7ovvHFxvwuuI6e5n0BKEdy+AFok0sxdmYC2ibfAeAOFzXYAVJUSiZyJwaY1ECyHybLycnBgAEDsHDhQkycOBE//vgjHn/8cbzzzjt46KGH7DoHK1DLlJKHC+oZ7hMALmpaI0achR7+5u0RPoUY2+4YtPf6Y/isLgiOCnZfm+3BSslEJCNctb4anU6HuXPn4sSJE0hISMDs2bPrnE1WE4MhconfelAEAE21j5EBxuG+Cfgca5GKno2OQNvnIrSPtUKvhzrJe+kLVy1NQt5PyX/ckGwxZ6garVYLrVbr6WYQmZ3LuYD1a1rgcvAiPFLyJmKQb96Xj2h8HDoDo7Ut8GbaBUT37gygs+ca6wi5lz4geWKOGSmcIoIhr8C/mhTNUGVAzgeHoVtVBN3e1vjpVicAkQCG4AU8hz/4ZGJ01AEk3h2F7v/vYcxt2dTTTXYOC9mRo5hjRl5AEcNkDeXxYTL+1eQeEgec189fx6alh/DV2kp8faoTCkVL8z4NDOjX9BC0/S9D+6codE1tD42PRoqr8CxvKX1A7sEcM3IxDpN5C/7V5B4SBZy/Zp+F7s1c6LKbIvtKV1RWW/oiGCUYHXMI2jF6jHmmE1p27irlFciDt5Q+IPdw9/I6RC7CYMiV3LkoqZo1IOCsKqvCzv+alr6IxZGKdgDiAAA+0GOSzycYFXsYSWNikfTPhxEQqoKlL+oqffDaa0BYGJCRweFeYo4ZeQ0OkznC0WEYe2fmLFkCPPUUv1Sc4UQ3/ZVTV/HN64ehWw9sONsF10Qz8+G+qMLgZgeQ1u4r3HPm3/AvKrh9rvp6mrwtL6zm9RQVAc88w+Feuo2zD8nF3Jbm4tLFPmRCkrVNrK0pFBNT99o36en2rcNlz7nIOjvXOjv9ysdi8ZgsMTjkJ+GDKovdYZrL4uGE7eKTp78XV09fu73ekbX1xmytd+TM74ez6lnnzCWcuSfk/Uxr9Fn73bC2Rh+Rg9y1NhmDIXs4+0Vg76Kk/FJxnp0B5wNIt9iUFHhczOmXJXa8/bOoKq/2P2pHF2AVwr2BgiNBl1RBkzP3hNSDi6WSCzEYklCDbmZDvgjq+6uJXyoNZ2fAORzfilHhOWL5fdkid3teg88nsrKMx7szULAVdJl+qn/pSNlT5eg9IfWx9vsWG8tAiBrMXcGQjEvhyoQjsyVqMs3MAW7PxKlLXeeiWoRBYH9+SxQHtjRXfa7JAOBmcATWnrsL3xT1xoxPhyJ+UIztkzqaENqQ3w9H1JWMb/KnPxmPMyWU12yXKaE8M9Ox12aSLNUnNRU4fdqYG5Sebvw3N5e5ZKQYDIbq09AvAtPMnOho6V9TifR6Y9JlRobxX73eoaffLLqJr174EU903oZY/wL0fLgLppavAIBaAZHQaOCj0aDxc9PRdNvX9r2eo0UH3RUo1Bd0AcDly8A//lH3DEbAOIPRkfvOQoxkD9NiqQ8+aPxXyZMHSHUYDNVHii8C019NS5ZI85oNDCg8JjPTOPNr2DBg0iTjv/Hx9fZU5P1wHismbYM24keEt9Tg9y/1xTtHhyDfEInGKIWhdTS2DH0RolVri+dpwsKM08Dnz7f/9QYPNs6QstWTp9EAsbHG4wD3BQr2BlNLlkjfU+XoPSEiUhqXDsLJhCQ5Q1LMlpDiXO6ctSQlB5KMq8qrxK7/HhDzBmaJ7kFHaz0lzjdPzOiaLTb8I0fcunrr9mtUTxheuND5RHVHEkLdNZvGkWR8e37S0x17fSbJEpEHMIFaQpLNJpPii6Ah51Lq9GY7koz1UdHis7TtYkq77aKlptByN/RiQPDP4pWRWeJA5nFh0Bsa/HpOBZ22EkLdEShUVQkRFiZdMORMsjOTZInIzRgMSchldYac/SJw5lxKnt5sZ6/GUGSZH4bgmpgY+7348Int4tLRIpe8Xr0BgSNT090RKNjq7ar506KF63qqPFHjiIhUy13BECtQO0LKCsOuqmYtx0qvGRnGnJ16zPZdCk2P7tBOCsWgJ5Pg39jfpa+H9HRjsqdUXF2BWq8HIiKMidLWmKptv/YacP/9xm3VP96mnB+uh0dECsGFWuXINFvCE+dS6PTmyyeuYN8nRRhhx7Gvf9ddmvvrqdlPUv5+2Dr/O+9YX4et+iKqqanGY62tLWbaT0REZpxNphQKmd4sDAKHvjiJxWOyMTj0Z7TqEIrRX05HHmJs1gICYJz1pddLMzPOm2c/mUo1xNSolRQWBixYYFz013Qc674QEdmFw2RKYVqQND+/dq8AYHVBUncpLylH9psHoFtdCt2RtjhdFWuxv2vQcTwf9wkmHV8AaABNXb9yUi38aSo8CHjnUJFeD7z8svFeXblye7u1++dtC8gSkWpwoVYJuSsBy+VkNL35ws8XxbtTtonxkbtEE1y3aE4gbokxLX8Ub92fLU7vqLb0hbUkY1fOjPPm2U/2zixUaikGIiLBBGpJeUXPkElmZu1ckNhYl+eCCIPA/oyj0L13EbofWyKntIvF/kifAmg7HIc2NRB3z0pCk1ZNrJ/IVDBy4kTLHo3qpOzl8sZeEVMvoa3iijUTqW3lFym9d4yIvJ67vr8ZDCmRm77gSwtLsXnZQegyy7H+eHucN1jmI/VufBjavoVImRaBHvd3hI+fnSloSp4ZJwf23r8WLYCiIuv7PDisSkRkL84mI9tcOGvpzPfnsP7NU9BtaYwtl7qiHHeZ9zXBDYyIPAjtyErck9YBkT0SASQ6/iIKnRknG/beF1uBEGDsLTIty8GAk4hUjsGQmun10G/JxqnVe7B1VyDeOjUKP5d3BnB7plIb33NISTwF7f1NMHRGEoKa9Wv46ypkZpxsSXlfGHASETEYUqPis8U4NONtdNywBOH6S+gAoAOA0YjBM1iCiyHtoR1wFdonY5CY0g4an5j6TukY09T3+mbGKXHquzvYc/9atAAuXar/XAw4iYhYZ0gtTmw6jSXjs3F32D5Ma/Mt+unmobne8ssyBufwmWYitq88hec3JKPLuDug8amjNpCzfH2N07+B2rWAqhcPZC6Ldfbcv7ff9t5aS0REEmMw5KUqb1Yi6/X9eLZ3NjoG5KLDyHjM/iIZ2Ve743U8C0DUevM1v/0gLU2a4od1MRUPjI623B4TI89ZTqZZcBkZxn9dfX/qU9/9mzCBAScRkZ04m8yLFB27jA1LjkD3tQ++yeuCEoSa9/mhEkObH8CTidsw4ftn6j+Zu2ZyKWHqu7VyBlIVh2yo+u6fh0oxyIISfreIqE6cWi8hbw2GTEtf6P6Tj692hmH39S4w4Pb/7FtoijC27VFox/lixKxEhMaFem4RU6UyVbJWcq0eNQYFcg5gichuDIYk5E3BUNm1MmQvPwjdp6XQHW6HM3rL5ObuQceg7XUB2kdboM8jneEbUONLjzV+7GdvcUPW6pEXbwhgiQgAgyFJKT0YOr+vAF8vOwHdxgBsKkjCTdyu7hyIMtzd8gC0d9/C2KfbIa5/dB1ngqzXOJMdBo7KwwCWyKuw6KKKGaoM2Jd+FLr3C6HLaYW9NxMBtDbvj/K5AG2HE9BOCMLvnuqCJq361H/S6kMljz8OzJ9v/GKwtogpE2uNWBxSebZvtx0IASw2SURWMRiSiRsFN/DdskPQZVZg/ckOKDBYVnfu2+QgtHcVQTutNXrc3xEaHwfqw1jLnwgPN/57+fLtbTEx6kistReLQyoPA1gicgKDIQ86veMc1r9xCrqsxsgqslz6oimuY2TUIWhHVWJMWke07pbk3IvYyp8wLZK6cCHQvr16EmsdweKQysMAloicwJwhN9JX6LH7vUPQfXgFuv3ROFje3mJ/gt9ZaBNzkfJgUwyZnoTAkMAGvmAD8yfUOAupJlMwCVgfUmQyrrwwJ47IqzBnyEtcO1OMb18/BN1XBmw43RmXRTfzPh/oMTDkILQDjUtfdNa2g8YnTroXb0j+BKcmG5mKG1q7FxxSlB9Tde4JE5gTR0R2YzDkAsc2/Ard22eh2xGK7de6Qo8B5n3NNNcwJu4QtGOB0bMTEdauu+sa4mz+hK2htfx843a19YakpgLjxrGXTCkYwBKRgzhMJoGKGxXY8Z9D0KUXQ3egDU5UJljs7xxwCtruedBObo4Bj3eBX5CbYlBnpoZzajJ5Cw7zEikeh8lk7tKRImxYchS6Db749lwiSnCneZ8/KpAcdgDa5BsYOyMe7X7XDkA79zfSmQRgTk0mb+Hry99RIrKL4hZqXbRoETQaDdLS0tz6usIg8Mvnx/HKyGwMCD6AiMQwTPnvIHx2rj9KEIqWmkt49I7t+Py5XbicX46Nl3vh6TVD0e53bdzaTgvOrA7PqclERKQyiuoZysnJwTvvvINu3brVf7AEbl25haw3D0L32S3ojrZDnr4DgA7m/T0aHYW2V4Fx6YspifDxk+EUa0fzJzg1mYiIVEYxwdCNGzfw0EMP4b///S9eeukll71O/p4L+PqNE/hqYyC+u9gVt3C7unMQbmF4qwPQDi/D2LT2iOnTCUAnl7VFMo4kALO2DhERqYxigqEZM2Zg7NixGD58eL3BUHl5OcrLy82PS0pKbB5rqDJg7/9MS19EYN+tzgBu93rE+J6HtuNJaO9rhGEzu6Bxi74NvhaPsDd/glOTiYhIZRQRDH3yySfYt28fcnJy7Dp+0aJFWLhwoc39189fNy59sbYS6091xMVqS19oYEDfJoeh7VeElD9FotuEDtD4RElxGcrBqclERKQisp9an5eXh969e2Pjxo3o3t1Ykyc5ORk9evTA0qVLrT7HWs9QbGwsFv9+PTZ/3wrZl7uiArerOzfFdYyKPgjtaD3GpHVERFJLl16TYnBqMhEReZC7ptbLPhhat24d7r33XvhW+xLW6/XQaDTw8fFBeXm5xT5rTDcTKAZgvJlt/c4gJek0tA8GY8j0JAQ0DXDhVRAREZGjWGfoN3fffTcOHDhgsW3q1Kno1KkTnn/++XoDoeoGhvyC8YOroJ0eh46jE6Dx8eC0dyIiIpIF2QdDwcHBSEqyXLG9SZMmCA8Pr7W9Pl/ndWt4ZMmhIyIiIq8i+2BIVrh4KRERkdeRfc6QFOwec6yr18fW4qWm6eZqW7yUiIjIxdyVM6S45ThcJjPTuEDpsGHApEnGf+Pjjdv1emOPkLW40bQtLc14HBERESkKgyHgdq9PzQVK8/ON219+2f7FS4mIiEhRGAzZ0+tjWuy0Ply8lIiISHEYDG3fXn+vz5Ur9p2Li5cSEREpDmeT2dubExYGXL3KxUttYckBIiJSKPYM2dubM2uW8V/T7DETLl5ad/I5ERGRzDEYGjzY2KtTM8gx0WiA2Fhg3jzj9PnoaMv9MTHqnlZfX/I5AyIiIpI51hkCbn+hA5bDYNZqCHE46Da93tgDZCvnyjR8mJur3ntEREROY50hd0pNtb/Xx9cXSE4GHnzQ+K+av+TtST5nyQEiIpI5JlCbpKYC48ax18cR9iafs+QAERHJGIOh6ky9PmQfe5PPWXKAiIhkjMNk5Dx7k8/VXHKAiIhkT13B0GefAdnZXENMKr6+t6tzs+QAEREplLqCoWnTWANHao4knxMREcmQuqbWAwgBrE+Zp4ZhyQEiIpKYu6bWqzMYApRdA4eBBxERqQDrDLmaUmvgcOkLIiIiSak3GDJRUg0cLn1BREQkOQZDSqmBo9cbF4u1Nqpp2paWxplyREREDlJvMKS0Gjhc+oKIiMgl1BkMKbEGDpe+ICIicgl1BkNKrIHDpS+IiIhcQl1rk737LtCunTKnopuWvsjPt543ZCoVoJRhPyIiIplQV8/QffcZF2JVWiAEcOkLIiIiF1FXMKR0XPqCiIhIcuoaJmsIuVR9Tk0Fxo2TR1uIiIi8AIMhe2RmGmv8VJ/aHhNjHLbyRG+Mr69xuI+IiIgajMNk9WHVZyIiIq/GYKgurPpMRETk9RgM1YVVn4mIiLweg6G6sOozERGR12MwVBdWfSYiIvJ6DIbqYqr6XLPIoYnSFnslIiKiWhgM1YVVn4mIiLweg6H6sOozERGRV2PRRXuw6jMREZHXYjBkL1Z9JiIi8kocJiMiIiJVk30wtGjRIvTp0wfBwcFo1aoVxo8fj2PHjnm6WUREROQlZB8Mbd26FTNmzMDu3buxadMmVFVVYeTIkSgtLfV004iIiMgLaISwtvCWfF26dAmtWrXC1q1bMWTIELueU1JSgtDQUBQXFyMkJMTFLSQiIiIpuOv7W3EJ1MXFxQCAsLAwm8eUl5ejvLzc/LikpMTl7SIiIiJlkv0wWXVCCMyePRuDBg1CUlKSzeMWLVqE0NBQ809sbKxrG6bXA9nZQEaG8V+uYk9ERKQYihommzFjBtavX48dO3YgJibG5nHWeoZiY2Nd082WmQnMmmW5un1MjLFyNQsyEhEROY3DZDU89dRT+PLLL7Ft27Y6AyEACAwMRGBgoOsblZkJTJgA1Iwn8/ON21mhmoiISPZkP0wmhMDMmTORmZmJLVu2ICEhwdNNMtLrjT1C1jrWTNvS0jhkRkREJHOyD4ZmzJiBjz/+GOnp6QgODkZBQQEKCgpw69YtzzZs+3bLobGahADy8ozHERERkWzJPhj697//jeLiYiQnJyMyMtL8s3r1as827MIFaY8jIiIij5B9zpBs87sjI6U9joiIiDxC9j1DsjV4sHHWmEZjfb9GA8TGGo8jIiIi2WIw5CxfX+P0eaB2QGR6vHSp8TgiIiKSLQZDDZGaapw+Hx1tuT0mhtPqiYiIFEL2OUOyl5oKjBtnnDV24YIxR2jwYPYIERERKQSDISn4+gLJyZ5uBRERETmBw2RERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkaooJht5++20kJCQgKCgIvXr1wvbt2z3dJCIiIvICigiGVq9ejbS0NMybNw/79+/H4MGDMWbMGJw9e9bTTSMiIiKF0wghhKcbUZ+77roLPXv2xL///W/zts6dO2P8+PFYtGhRvc8vKSlBaGgoiouLERIS4sqmEhERkUTc9f0t+56hiooK7N27FyNHjrTYPnLkSOzcudNDrSIiIiJv4efpBtSnqKgIer0eERERFtsjIiJQUFBg9Tnl5eUoLy83Py4uLgZgjDCJiIhIGUzf264exJJ9MGSi0WgsHgsham0zWbRoERYuXFhre2xsrEvaRkRERK5z+fJlhIaGuuz8sg+GWrRoAV9f31q9QIWFhbV6i0zmzp2L2bNnmx9fu3YNbdq0wdmzZ116M+WmpKQEsbGxyMvLU1WuFK+b160GvG5etxoUFxcjLi4OYWFhLn0d2QdDAQEB6NWrFzZt2oR7773XvH3Tpk0YN26c1ecEBgYiMDCw1vbQ0FBV/RKZhISE8LpVhNetLrxudVHrdfv4uDbFWfbBEADMnj0bkydPRu/evdG/f3+88847OHv2LJ588klPN42IiIgUThHB0P3334/Lly/jxRdfxIULF5CUlISvv/4abdq08XTTiIiISOEUEQwBwPTp0zF9+nSnnhsYGIj58+dbHTrzZrxuXrca8Lp53WrA63btdSui6CIRERGRq8i+6CIRERGRKzEYIiIiIlVjMERERESqxmCIiIiIVE2RwdDbb7+NhIQEBAUFoVevXti+fXudx2/duhW9evVCUFAQ2rZtixUrVtQ6Zs2aNUhMTERgYCASExOxdu1aVzXfaY5cd2ZmJkaMGIGWLVsiJCQE/fv3x7fffmtxzKpVq6DRaGr9lJWVufpSHOLIdWdnZ1u9pqNHj1oc523v96OPPmr1urt06WI+Rgnv97Zt25CSkoKoqChoNBqsW7eu3ud4w+fb0ev2ls+3o9ftLZ9vR6/bWz7fixYtQp8+fRAcHIxWrVph/PjxOHbsWL3Pc8dnXHHB0OrVq5GWloZ58+Zh//79GDx4MMaMGYOzZ89aPT43Nxf33HMPBg8ejP379+P//u//8PTTT2PNmjXmY3bt2oX7778fkydPxs8//4zJkydj4sSJ+OGHH9x1WfVy9Lq3bduGESNG4Ouvv8bevXsxbNgwpKSkYP/+/RbHhYSE4MKFCxY/QUFB7rgkuzh63SbHjh2zuKb27dub93nj+71s2TKL683Ly0NYWBjuu+8+i+Pk/n6Xlpaie/fuWL58uV3He8vn29Hr9pbPt6PXbaL0z7ej1+0tn++tW7dixowZ2L17NzZt2oSqqiqMHDkSpaWlNp/jts+4UJi+ffuKJ5980mJbp06dxJw5c6we/9e//lV06tTJYtsTTzwh+vXrZ348ceJEMXr0aItjRo0aJR544AGJWt1wjl63NYmJiWLhwoXmxytXrhShoaFSNdElHL3urKwsAUBcvXrV5jnV8H6vXbtWaDQacfr0afM2Jbzf1QEQa9eurfMYb/l8V2fPdVujxM93dfZct7d8vqtz5v32hs+3EEIUFhYKAGLr1q02j3HXZ1xRPUMVFRXYu3cvRo4cabF95MiR2Llzp9Xn7Nq1q9bxo0aNwp49e1BZWVnnMbbO6W7OXHdNBoMB169fr7XY3Y0bN9CmTRvExMRAq9XW+svSkxpy3XfeeSciIyNx9913Iysry2KfGt7v9957D8OHD69VpV3O77czvOHzLQUlfr4bQsmfbyl4y+e7uLgYAOpchNVdn3FFBUNFRUXQ6/W1VquPiIiotaq9SUFBgdXjq6qqUFRUVOcxts7pbs5cd02vvfYaSktLMXHiRPO2Tp06YdWqVfjyyy+RkZGBoKAgDBw4ECdOnJC0/c5y5rojIyPxzjvvYM2aNcjMzETHjh1x9913Y9u2beZjvP39vnDhAjZs2IBp06ZZbJf7++0Mb/h8S0GJn29neMPnu6G85fMthMDs2bMxaNAgJCUl2TzOXZ9xxSzHUZ1Go7F4LISota2+42tud/ScnuBsGzMyMrBgwQJ88cUXaNWqlXl7v3790K9fP/PjgQMHomfPnnjzzTfxxhtvSNfwBnLkujt27IiOHTuaH/fv3x95eXn417/+hSFDhjh1Tk9xto2rVq1Cs2bNMH78eIvtSnm/HeUtn29nKf3z7Qhv+nw7y1s+3zNnzsQvv/yCHTt21HusOz7jiuoZatGiBXx9fWtFe4WFhbWiQpPWrVtbPd7Pzw/h4eF1HmPrnO7mzHWbrF69Gn/84x/x6aefYvjw4XUe6+Pjgz59+sjmL4mGXHd1/fr1s7gmb36/hRB4//33MXnyZAQEBNR5rNzeb2d4w+e7IZT8+ZaK0j7fDeEtn++nnnoKX375JbKyshATE1Pnse76jCsqGAoICECvXr2wadMmi+2bNm3CgAEDrD6nf//+tY7fuHEjevfuDX9//zqPsXVOd3PmugHjX4yPPvoo0tPTMXbs2HpfRwiBn376CZGRkQ1usxScve6a9u/fb3FN3vp+A8bZGidPnsQf//jHel9Hbu+3M7zh8+0spX++paK0z3dDKP3zLYTAzJkzkZmZiS1btiAhIaHe57jtM253qrVMfPLJJ8Lf31+899574vDhwyItLU00adLEnFU/Z84cMXnyZPPxv/76q2jcuLF45plnxOHDh8V7770n/P39xeeff24+5vvvvxe+vr7in//8pzhy5Ij45z//Kfz8/MTu3bvdfn22OHrd6enpws/PT7z11lviwoUL5p9r166Zj1mwYIH45ptvxKlTp8T+/fvF1KlThZ+fn/jhhx/cfn22OHrdS5YsEWvXrhXHjx8XBw8eFHPmzBEAxJo1a8zHeOP7bfLwww+Lu+66y+o5lfB+X79+Xezfv1/s379fABCvv/662L9/vzhz5owQwns/345et7d8vh29bm/5fDt63SZK/3z/+c9/FqGhoSI7O9vi9/bmzZvmYzz1GVdcMCSEEG+99ZZo06aNCAgIED179rSYljdlyhQxdOhQi+Ozs7PFnXfeKQICAkR8fLz497//Xeucn332mejYsaPw9/cXnTp1svhwyYUj1z106FABoNbPlClTzMekpaWJuLg4ERAQIFq2bClGjhwpdu7c6cYrso8j17148WLRrl07ERQUJJo3by4GDRok1q9fX+uc3vZ+CyHEtWvXRKNGjcQ777xj9XxKeL9NU6dt/d566+fb0ev2ls+3o9ftLZ9vZ37PveHzbe2aAYiVK1eaj/HUZ1zzWwOJiIiIVElROUNEREREUmMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIFCkjIwNBQUHIz883b5s2bRq6deuG4uJiD7aMiJSGa5MRkSIJIdCjRw8MHjwYy5cvx8KFC/Huu+9i9+7diI6O9nTziEhB/DzdACIiZ2g0Grz88suYMGECoqKisGzZMmzfvp2BEBE5jD1DRKRoPXv2xKFDh7Bx40YMHTrU080hIgVizhARKda3336Lo0ePQq/XIyIiwtPNISKFYs8QESnSvn37kJycjLfeeguffPIJGjdujM8++8zTzSIiBWLOEBEpzunTpzF27FjMmTMHkydPRmJiIvr06YO9e/eiV69enm4eESkMe4aISFGuXLmCgQMHYsiQIfjPf/5j3j5u3DiUl5fjm2++8WDriEiJGAwRERGRqjGBmoiIiFSNwRARERGpGoMhIiIiUjUGQ0RERKRqDIaIiIhI1RgMERERkaoxGCIiIiJVYzBEREREqsZgiIiIiFSNwRARERGpGoMhIiIiUjUGQ0RERKRq/x+dR/VtpIBPvgAAAABJRU5ErkJggg==", "text/plain": [ "
" ] @@ -1939,8 +2159,10 @@ }, { "cell_type": "markdown", - "id": "f952160a", - "metadata": {}, + "id": "7c4e2d90", + "metadata": { + "editable": true + }, "source": [ "## Same code but now with momentum gradient descent" ] @@ -1948,8 +2170,11 @@ { "cell_type": "code", "execution_count": 17, - "id": "b0595e43", - "metadata": {}, + "id": "be5e6b23", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "name": "stdout", @@ -1958,73 +2183,73 @@ "Own inversion\n", "[[4.]\n", " [3.]]\n", - "Eigenvalues of Hessian Matrix:[0.27124938 4.56804783]\n", - "0 [-8.64009263] [-10.94092702]\n", - "1 [0.18925625] [-0.15527976]\n", - "2 [0.17801827] [-0.14605929]\n", - "3 [0.16744759] [-0.13738633]\n", - "4 [0.1575046] [-0.12922837]\n", - "5 [0.14815202] [-0.12155483]\n", - "6 [0.1393548] [-0.11433693]\n", - "7 [0.13107995] [-0.10754764]\n", - "8 [0.12329646] [-0.10116149]\n", - "9 [0.11597515] [-0.09515455]\n", - "10 [0.10908858] [-0.0895043]\n", - "11 [0.10261093] [-0.08418956]\n", - "12 [0.09651792] [-0.07919041]\n", - "13 [0.09078672] [-0.0744881]\n", - "14 [0.08539583] [-0.07006502]\n", - "15 [0.08032505] [-0.06590458]\n", - "16 [0.07555537] [-0.06199119]\n", - "17 [0.07106891] [-0.05831017]\n", - "18 [0.06684886] [-0.05484773]\n", - "19 [0.06287939] [-0.05159088]\n", - "20 [0.05914563] [-0.04852743]\n", - "21 [0.05563358] [-0.04564589]\n", - "22 [0.05233008] [-0.04293545]\n", - "23 [0.04922273] [-0.04038595]\n", - "24 [0.0462999] [-0.03798785]\n", - "25 [0.04355062] [-0.03573214]\n", - "26 [0.0409646] [-0.03361037]\n", - "27 [0.03853213] [-0.0316146]\n", - "28 [0.03624411] [-0.02973733]\n", - "29 [0.03409194] [-0.02797154]\n", + "Eigenvalues of Hessian Matrix:[0.31702609 3.84351715]\n", + "0 [-13.26083712] [-12.67834752]\n", + "1 [-0.55020405] [0.5257011]\n", + "2 [-0.50482139] [0.48233952]\n", + "3 [-0.46318204] [0.44255455]\n", + "4 [-0.42497724] [0.40605118]\n", + "5 [-0.38992371] [0.37255873]\n", + "6 [-0.3577615] [0.34182884]\n", + "7 [-0.32825214] [0.31363366]\n", + "8 [-0.30117681] [0.28776411]\n", + "9 [-0.27633474] [0.26402837]\n", + "10 [-0.25354173] [0.24225043]\n", + "11 [-0.23262877] [0.22226881]\n", + "12 [-0.21344077] [0.20393534]\n", + "13 [-0.19583547] [0.18711407]\n", + "14 [-0.17968231] [0.17168028]\n", + "15 [-0.16486151] [0.15751952]\n", + "16 [-0.15126318] [0.14452678]\n", + "17 [-0.13878649] [0.13260573]\n", + "18 [-0.12733892] [0.12166797]\n", + "19 [-0.11683558] [0.11163239]\n", + "20 [-0.10719859] [0.10242458]\n", + "21 [-0.0983565] [0.09397626]\n", + "22 [-0.09024373] [0.08622478]\n", + "23 [-0.08280012] [0.07911268]\n", + "24 [-0.07597049] [0.0725872]\n", + "25 [-0.06970419] [0.06659997]\n", + "26 [-0.06395476] [0.06110658]\n", + "27 [-0.05867956] [0.0560663]\n", + "28 [-0.05383947] [0.05144177]\n", + "29 [-0.04939861] [0.04719868]\n", "theta from own gd\n", - "[[4.11822173]\n", - " [2.90300219]]\n", - "0 [0.03206757] [-0.0263106]\n", - "1 [0.03016341] [-0.02474828]\n", - "2 [0.02780107] [-0.02281004]\n", - "3 [0.02544154] [-0.02087411]\n", - "4 [0.02322297] [-0.01905384]\n", - "5 [0.02117843] [-0.01737634]\n", - "6 [0.0193075] [-0.01584129]\n", - "7 [0.01759974] [-0.01444013]\n", - "8 [0.01604235] [-0.01316233]\n", - "9 [0.01462254] [-0.01199741]\n", - "10 [0.01332832] [-0.01093553]\n", - "11 [0.01214862] [-0.00996762]\n", - "12 [0.01107333] [-0.00908537]\n", - "13 [0.01009321] [-0.00828121]\n", - "14 [0.00919984] [-0.00754823]\n", - "15 [0.00838555] [-0.00688012]\n", - "16 [0.00764333] [-0.00627115]\n", - "17 [0.0069668] [-0.00571608]\n", - "18 [0.00635016] [-0.00521014]\n", - "19 [0.00578809] [-0.00474898]\n", - "20 [0.00527578] [-0.00432864]\n", - "21 [0.00480881] [-0.0039455]\n", - "22 [0.00438318] [-0.00359628]\n", - "23 [0.00399521] [-0.00327797]\n", - "24 [0.00364159] [-0.00298783]\n", - "25 [0.00331927] [-0.00272337]\n", - "26 [0.00302547] [-0.00248232]\n", - "27 [0.00275768] [-0.0022626]\n", - "28 [0.00251359] [-0.00206234]\n", - "29 [0.00229111] [-0.0018798]\n", + "[[3.85703369]\n", + " [3.13659941]]\n", + "0 [-0.04532405] [0.04330558]\n", + "1 [-0.04158557] [0.03973359]\n", + "2 [-0.03703391] [0.03538463]\n", + "3 [-0.03261373] [0.0311613]\n", + "4 [-0.02859759] [0.02732402]\n", + "5 [-0.02503392] [0.02391906]\n", + "6 [-0.02189994] [0.02092464]\n", + "7 [-0.01915337] [0.01830039]\n", + "8 [-0.01674956] [0.01600363]\n", + "9 [-0.01464686] [0.01399457]\n", + "10 [-0.01280793] [0.01223754]\n", + "11 [-0.01119981] [0.01070103]\n", + "12 [-0.00979357] [0.00935742]\n", + "13 [-0.0085639] [0.00818251]\n", + "14 [-0.00748862] [0.00715512]\n", + "15 [-0.00654835] [0.00625672]\n", + "16 [-0.00572613] [0.00547113]\n", + "17 [-0.00500716] [0.00478417]\n", + "18 [-0.00437846] [0.00418347]\n", + "19 [-0.0038287] [0.00365819]\n", + "20 [-0.00334797] [0.00319887]\n", + "21 [-0.0029276] [0.00279722]\n", + "22 [-0.00256001] [0.002446]\n", + "23 [-0.00223857] [0.00213888]\n", + "24 [-0.0019575] [0.00187032]\n", + "25 [-0.00171171] [0.00163548]\n", + "26 [-0.00149679] [0.00143013]\n", + "27 [-0.00130885] [0.00125057]\n", + "28 [-0.00114451] [0.00109354]\n", + "29 [-0.00100081] [0.00095624]\n", "theta from own gd wth momentum\n", - "[[4.0076989 ]\n", - " [2.99368326]]\n" + "[[3.99723951]\n", + " [3.00263755]]\n" ] } ], @@ -2086,8 +2311,10 @@ }, { "cell_type": "markdown", - "id": "43200e36", - "metadata": {}, + "id": "0002f816", + "metadata": { + "editable": true + }, "source": [ "## Including Stochastic Gradient Descent with Autograd\n", "In this code we include the stochastic gradient descent approach discussed above. Note here that we specify which argument we are taking the derivative with respect to when using **autograd**." @@ -2096,25 +2323,28 @@ { "cell_type": "code", "execution_count": 18, - "id": "b369d846", - "metadata": {}, + "id": "ccb60a39", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Own inversion\n", - "[[3.4870934 ]\n", - " [3.55042779]]\n", - "Eigenvalues of Hessian Matrix:[0.28793787 4.56453869]\n", + "[[3.95935439]\n", + " [3.09360113]]\n", + "Eigenvalues of Hessian Matrix:[0.32606139 4.1033455 ]\n", "theta from own gd\n", - "[[3.4870934 ]\n", - " [3.55042779]]\n" + "[[3.95935439]\n", + " [3.09360113]]\n" ] }, { "data": { - "image/png": "iVBORw0KGgoAAAANSUhEUgAAAkMAAAHFCAYAAADxOP3DAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjguMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy81sbWrAAAACXBIWXMAAA9hAAAPYQGoP6dpAABYS0lEQVR4nO3deXxM5/4H8M/JTkhIEFkG0aq1xFZrkBZtLUWoElVdb3tRV3XBbSuixa3bRVttXbf9cW9rQtsEvXTTStCiVYJqrRVEiFgTQiKZPL8/pjMyyeyZ5Zw5n/frlVc6Z86cec6M0/PN83y/zyMJIQSIiIiIVMrP2w0gIiIi8iYGQ0RERKRqDIaIiIhI1RgMERERkaoxGCIiIiJVYzBEREREqsZgiIiIiFSNwRARERGpGoMhIiIiUjUGQ0QytGLFCkiSZPwJCAhAdHQ0xo0bhyNHjnitXXPnzoUkSV57fyU4fvw4JEnC66+/7u2mEJGdArzdACKybPny5WjTpg1KS0vx448/Yv78+cjKysLBgwfRsGFDbzePiMgnMBgikrEOHTqgW7duAIABAwZAp9MhNTUVa9euxSOPPOLl1pE3lZeXG3sNiah2OExGpCCGwOjs2bPGbaWlpXj22WeRkJCA8PBwREREoFevXli3bl2N10uShKlTp+Ljjz9G27ZtUbduXXTq1Anr16+vse+GDRuQkJCA4OBgxMfHWxz2KS0txezZsxEfH4+goCDExsZiypQpuHz5ssl+LVq0wLBhw7B+/Xp07twZderUQdu2bY3vvWLFCrRt2xahoaG444478Msvv9j8PAzDiVlZWfjrX/+KRo0aITIyEsnJyTh9+nSNc587d26NY7Ro0QIPP/xwjWNu2rQJTzzxBCIjIxEWFoaHHnoIJSUlKCgowNixY9GgQQNER0fjueeeQ3l5eY3jVlZWYv78+WjWrBlCQkLQrVs3fP/99zX2O3LkCFJSUtCkSRMEBwejbdu2eO+990z2yc7OhiRJ+Pjjj/Hss88iNjYWwcHBOHr0KK5du4bnnnsO8fHxCAkJQUREBLp164b09HSbnx8R6fFPCiIFyc3NBQDcdtttxm1lZWW4ePEinnvuOcTGxuLGjRv47rvvkJycjOXLl+Ohhx4yOcaGDRuwc+dOzJs3D/Xq1cOiRYswatQoHDp0CC1btgQAfP/99xgxYgR69eqFVatWQafTYdGiRSZBGAAIITBy5Eh8//33mD17NhITE7Fv3z6kpqZi+/bt2L59O4KDg4377927F7Nnz8aLL76I8PBwpKWlITk5GbNnz8b333+PBQsWQJIkzJw5E8OGDUNubi7q1Klj83N5/PHHMXToUGi1WuTl5eH555/Hgw8+iE2bNjn9WT/++ONITk7GqlWrkJOTg7///e+oqKjAoUOHkJycjL/85S/47rvv8NprryEmJgYzZswwef2SJUvQvHlzLF68GJWVlVi0aBHuvfdebN68Gb169QIA/P777+jduzeaNWuGN954A02bNsU333yDadOm4fz580hNTTU55uzZs9GrVy8sXboUfn5+aNKkCWbMmIGPP/4Yr776Kjp37oySkhLs378fFy5ccPrciVRHEJHsLF++XAAQO3bsEOXl5eLKlSvi66+/Fk2bNhX9+vUT5eXlFl9bUVEhysvLxWOPPSY6d+5s8hwAERUVJYqLi43bCgoKhJ+fn1i4cKFxW48ePURMTIy4fv26cVtxcbGIiIgQVf+38fXXXwsAYtGiRSbvs3r1agFALFu2zLitefPmok6dOuLUqVPGbXv27BEARHR0tCgpKTFuX7t2rQAgvvjiC7s+p8mTJ5tsX7RokQAgzpw5Y3LuqampNY7RvHlzMWnSpBrHfPrpp032GzlypAAg3nzzTZPtCQkJokuXLsbHubm5AoDFz2/gwIHGbXfffbeIi4sTRUVFJsecOnWqCAkJERcvXhRCCJGVlSUAiH79+tVof4cOHcTIkSNrbCci+3GYjEjGevbsicDAQNSvXx/33HMPGjZsiHXr1tXIE/nss8/Qp08f1KtXDwEBAQgMDMRHH32EAwcO1DhmUlIS6tevb3wcFRWFJk2a4MSJEwCAkpIS7Ny5E8nJyQgJCTHuV79+fQwfPtzkWIael6rDTABw//33IzQ0tMawUEJCAmJjY42P27ZtC0CfD1W3bt0a2w1tsuW+++4zedyxY0eHXm/OsGHDTB4b2jR06NAa2829j6XPb8uWLdDpdCgtLcX333+PUaNGoW7duqioqDD+DBkyBKWlpdixY4fJMUePHl3jfe644w589dVXmDVrFrKzs3H9+nWnz5lIrRgMEcnYf//7X+zcuRObNm3Ck08+iQMHDmD8+PEm+2RmZmLs2LGIjY3FJ598gu3bt2Pnzp149NFHUVpaWuOYkZGRNbYFBwcbb6KXLl1CZWUlmjZtWmO/6tsuXLiAgIAANG7c2GS7JElo2rRpjaGaiIgIk8dBQUFWt5trvznVz8kwNFebwMCRtpprp6XP78aNG7h69SouXLiAiooKvPvuuwgMDDT5GTJkCADg/PnzJq+Pjo6uccx33nkHM2fOxNq1a5GUlISIiAiMHDnSq1MwECkNc4aIZKxt27bGpOmkpCTodDp8+OGH+PzzzzFmzBgAwCeffIL4+HisXr3aZA6gsrIyp96zYcOGkCQJBQUFNZ6rvi0yMhIVFRU4d+6cSUAkhEBBQQG6d+/uVBvcITg42Oxn4q7cGkufX1BQEOrVq4fAwED4+/tj4sSJmDJlitljxMfHmzw2N8dTaGgo0tLSkJaWhrNnzxp7iYYPH46DBw+65mSIfBx7hogUZNGiRWjYsCHmzJmDyspKAPobZFBQkMmNsqCgwGw1mT0M1VyZmZkmPR5XrlzB//73P5N977rrLgD6gKyqjIwMlJSUGJ+XgxYtWmDfvn0m2zZt2oSrV6+65f0sfX6JiYnw9/dH3bp1kZSUhJycHHTs2BHdunWr8WOuF8+aqKgoPPzwwxg/fjwOHTqEa9euufq0iHwSe4aIFKRhw4aYPXs2XnjhBWi1Wjz44IMYNmwYMjMzMXnyZIwZMwZ5eXl45ZVXEB0d7fRQySuvvIJ77rkHgwYNwrPPPgudTofXXnsNoaGhuHjxonG/QYMG4e6778bMmTNRXFyMPn36GKvJOnfujIkTJ7rq1Gtt4sSJePnllzFnzhz0798fv//+O5YsWYLw8HC3vJ+/vz8GDRqEGTNmoLKyEq+99hqKi4uRlpZm3Oftt99G3759kZiYiL/+9a9o0aIFrly5gqNHj+J///ufXdVwPXr0wLBhw9CxY0c0bNgQBw4cwMcff4xevXqZ5GERkWUMhogU5umnn8aSJUswb948jB8/Ho888ggKCwuxdOlS/N///R9atmyJWbNm4dSpUyY3XkcMGjQIa9euxUsvvYQHHngATZs2xeTJk3H9+nWTY0qShLVr12Lu3LlYvnw55s+fj0aNGmHixIlYsGCBSVm9tz3//PMoLi7GihUr8Prrr+OOO+7Ap59+ihEjRrjl/aZOnYrS0lJMmzYNhYWFaN++PTZs2IA+ffoY92nXrh12796NV155BS+99BIKCwvRoEEDtGrVypg3ZMudd96JL774Am+99RauXbuG2NhYPPTQQ3jxxRfdcl5EvkgSQghvN4KIiIjIW5gzRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNVUMc9QZWUlTp8+jfr165udzp6IiIjkRwiBK1euICYmBn5+7uu/UUUwdPr0aWg0Gm83g4iIiJyQl5eHuLg4tx1fFcFQ/fr1Aeg/zLCwMC+3hoiIiOxRXFwMjUZjvI+7iyqCIcPQWFhYGIMhIiIihXF3igsTqImIiEjVGAwRERGRqjEYIiIiIlVjMERERESqxmCIiIiIVI3BEBEREakagyEiIiJSNQZDREREpGoMhoiIiEjVGAwRERGRqjEYIiIiIlVjMERERESqxmCIiIiIVI3BEBEREakagyEiIiJSNQZDREREpGoMhoiIiEjVvB4MbdmyBcOHD0dMTAwkScLatWst7vvkk09CkiQsXrzYY+0jIiIi3+b1YKikpASdOnXCkiVLrO63du1a/PTTT4iJifFQy4iIiEgNArzdgHvvvRf33nuv1X3y8/MxdepUfPPNNxg6dKiHWkZERERq4PWeIVsqKysxceJEPP/882jfvr23m0NEREQ+xus9Q7a89tprCAgIwLRp0+x+TVlZGcrKyoyPi4uL3dE0IiIi8gGy7hnatWsX3n77baxYsQKSJNn9uoULFyI8PNz4o9Fo3NhKIiIiUjJZB0Nbt25FYWEhmjVrhoCAAAQEBODEiRN49tln0aJFC4uvmz17NoqKiow/eXl5nms0ERERKYqsh8kmTpyIgQMHmmy7++67MXHiRDzyyCMWXxccHIzg4GB3N4+IiIh8gNeDoatXr+Lo0aPGx7m5udizZw8iIiLQrFkzREZGmuwfGBiIpk2bonXr1p5uKhEREfkgrwdDv/zyC5KSkoyPZ8yYAQCYNGkSVqxY4aVWERERkVp4PRgaMGAAhBB273/8+HH3NYaIiIhUR9YJ1ERERETuxmCIiIiIVI3BEBEREakagyEiIiJSNQZDREREpGoMhoiIiEjVGAwRERGRqjEYIiIiIlVjMERERESqxmCIiIiIVI3BEBEREakagyEiIiJSNQZDREREpGoMhoiIiEjVGAwRERGRqjEYIiIiIlVjMERERESqxmCIiIiIVI3BEBEREakagyEiIiJSNQZDREREpGoMhoiIiEjVGAwRERGRqjEYIiIiIlVjMERERESqxmCIiIiIVI3BEBEREakagyEiIiJSNQZDREREpGoMhoiIiEjVGAwRERGRqjEYIiIiIlVjMERERESqxmCIiIiIVI3BEBEREakagyEiIiJSNQZDREREpGoMhoiIiEjVGAwRERGRqnk9GNqyZQuGDx+OmJgYSJKEtWvXGp8rLy/HzJkzcfvttyM0NBQxMTF46KGHcPr0ae81mIiIiHyK14OhkpISdOrUCUuWLKnx3LVr17B79268/PLL2L17NzIzM3H48GHcd999XmgpERGRwuh0QHY2kJ6u/63TebtFsiQJIYS3G2EgSRLWrFmDkSNHWtxn586duOOOO3DixAk0a9bMruMWFxcjPDwcRUVFCAsLc1FriYiIZCwzE/jb34BTp25ui4sD3n4bSE72Xrsc4Kn7t9d7hhxVVFQESZLQoEEDi/uUlZWhuLjY5IeIiEg1MjOBMWNMAyEAyM/Xb8/M9E67ZEpRwVBpaSlmzZqFlJQUqxHiwoULER4ebvzRaDQebCUREZEX6XT6HiFzAz+GbdOnc8isCsUEQ+Xl5Rg3bhwqKyvx/vvvW9139uzZKCoqMv7k5eV5qJVERERetnVrzR6hqoQA8vL0+xEAIMDbDbBHeXk5xo4di9zcXGzatMnmuGFwcDCCg4M91DoiIiIZOXPGtfupgOyDIUMgdOTIEWRlZSEyMtLbTSIiIpKv6GjX7qcCXg+Grl69iqNHjxof5+bmYs+ePYiIiEBMTAzGjBmD3bt3Y/369dDpdCgoKAAAREREICgoyFvNJiIikqfERH3VWH6++bwhSdI/n5jo+bbJlNdL67Ozs5GUlFRj+6RJkzB37lzEx8ebfV1WVhYGDBhg13uwtJ6IiFTFUE0GmAZEkqT//fnniiiv99T92+vBkCcwGCIiItUxN8+QRgMsXqyIQAjw3P3b68NkRERE5AbJycCIEfqqsTNn9DlCiYmAv7+3WyY7DIaIiIh8lb8/YGdKiZoxGCIiIvJVOh17huzAYIiIiMgX+cDaZJ6imBmoiYiIyE5cm8whDIaIiIh8CdcmcxiDISIiIl/CtckcxmCIiIjIl3BtMocxGCIiIvIlXJvMYawmIyIicpScS9a5NpnD2DNERETkiMxMoEULICkJSEnR/27RQj4VWv7++vJ54OZaZAaGx4sXyyd4kwEGQ0RERPZSSsl6crJ+MdbYWNPtcXGKWaTVk7hQKxERkT10On0PkKVKLcPwU26ufHpd5DycZwcu1EpERCQnjpSsy2U9MK5NZhcOkxEREdmDJes+iz1DRERE9mDJumvIcOiOwRAREZE9lFayLsOgQ66Lx3KYjIiIyB5KKlmXY/m/jCvxGAwRERHZSwkl63IMOmS+eCxL64mIiBwlxyEoQ7vkWP6fna3vnbIlK8uk+o2l9URERHIl15J1T5b/OxIQyrwSj8EQERGRr/BU0OFoIrTMK/GYM0REROQrPBF0OJOTZKjEq554biBJgEbjtUo8BkNERES+wlbQAQCNGwO9ezt3fFuJ0EIATz0F3Lhh+pzMK/EYDBEREfkKa0GHwblzwC23OFdVZisnyXD8uLiax5dxJR6DISIiIl9iKeioytkye3tzjc6dM3/85GTg+HF91ZhWq/+dm+v1KQlYWk9EROSLbtzQB0Tnz5t/3pkye3tL5J09fjWHfziK1omt3H7/Zs8QERGRK+h0+mAhPV3/20sTCBpt22Y5EAJMy+ztZU9OUm2OD6DoZBGWP7oVgyJ3oU1ipEOvdRZL64mIiGpLjmtuuaPM3pCTNGaMS9tRerkUXy7YA61WYH1+Z5TBUFVWbP/71AJ7hoiIiGpDjstfAO4rszfkJDVqVKvj627o8P0/d+PR27YiqmEZRv+zJzLye6EMIWgXfBTzB2Vj75c2krVdhDlDREREzrJn+YvYWGDFCqCw0LNLdxjalp9vvhS+tjk9N27oX3/unPnnzRxfVArs+uQAVi4+h1V726CgMsq4u8Y/H+O7HkHKs9HoOOY2SH4Sl+MgIiKSPXuWvzh1Chg48OY2Tw2fVR3SkiTTgMgVc/sEBQFLl94cMrNy/MPf5EK78AS025rjSHk7424R0kXc32Y/JkwOR5+nbodfgJUKODfiMBkREZGznFnWwpPDZ+6e28fK8S/980O89d8IdA/9Ha3viUfa5gE4Uh6POriGcc224X8v/4wzxfWw9Pd+SJzaCX4B3gtJOExGRETkLEdKzavy9OrxjiyqWovjl+z7A5u/LMHin3rhu8tdIf7sc/FHBQY3zsGEMTcwYk4n1Gtaz67Deur+zWCIiIjIWbbycmzJyqr96vFeVnq5FBvm50CrlbDhdALKEGJ8rk/9fUgZcgn3p7ZH47Z2JlxXwZwhIiIiubOWl2OP2q4e7yW6GzpkLd4L7YclyDjSEcXoZXyuffARTOifj3Ev3oL4fh292Er7MRgiIpIDdw9jkPsY8maqzzNkj9qsHu9holLgl48PQPu2oRKsi/E5jX8+UrodQcpzMbg9uRUkv1ZebKnjOExGRORtcpywjxxXNaBt0gSYNAk4fdo9Ze0edOirY9D+4yS021vgaHkL4/YI6SLGtt2PlL8aKsFcnwDtqfu316vJtmzZguHDhyMmJgaSJGHt2rUmzwshMHfuXMTExKBOnToYMGAAfvvtN+80lojI1eQ6YR85zt9fn/8zfjxw113AO+/ot1dfusIVZe1udnp3Ad4ckY1uob+jzZCWmLdlAI6Wt0BdlGB88x+xPnUnzhTXwwe/eb8SzBW83vqSkhJ06tQJS5YsMfv8okWL8Oabb2LJkiXYuXMnmjZtikGDBuHKlSsebikRkYvpdPoeIXM9B4Zt06d7f40rco67y9pd7PKJInz08FbcFbEbcV2b4NkvBmDXtXbwRwWGNN6JlZN/xNkzAtrjfTB0bncE1QvydpNdRlbDZJIkYc2aNRg5ciQAfa9QTEwMpk+fjpkzZwIAysrKEBUVhddeew1PPvmkXcflMBkRyZK9Zdk+UHGkat7MB7Px3tcvXseG+XugTZew4Uxn3ECw8bk+9fdhwtDLGDOnnVOVYK7AajIAubm5KCgowODBg43bgoOD0b9/f2zbts1iMFRWVoaysjLj4+Jizyz0RkTkEHcspEnyYxg+8zQLuWi6N97CpmPx0H50DZlHTSvBOgQfwYQB+Rj30q1o0VcZlWCuIOtgqKCgAAAQFRVlsj0qKgonTpyw+LqFCxciLS3NrW0jIqo1dy2kSWTIRas2+CNOnYL0wFh8gM+xBvphumb+p5DS/ai+Emz0bQAsVIL5cMWjrIMhA6la8pkQosa2qmbPno0ZM2YYHxcXF0Oj0bitfURETklM1OeP2FpIMzHRc23y4RuealjJRZMACADvYBqi2zXE+CmR6P2XDvALiLN+TB+vePR6ArU1TZs2BXCzh8igsLCwRm9RVcHBwQgLCzP5ISKSHcOEfYA8Ko4yM/WzKSclASkp+t8tWrCiTWHOfbjW6nxHfhCIQz7ee2Iv+j7Z3nYlmAoqHmUdDMXHx6Np06bYuHGjcduNGzewefNm9O7d24stIyJyEblUHKnghufLLuVexoeTtuLOhjn421Ol9r3omWdsB7sqqXj0+jDZ1atXcfToUePj3Nxc7NmzBxEREWjWrBmmT5+OBQsWoFWrVmjVqhUWLFiAunXrIiUlxYutJiJyoeRkYMQI71YcWbvhSZL+hjdiBIfM5EKnQ9mG75CzdAfW/9QYb1x8GKXQD6f2R5H9xzEEu5YC761brc+qLQSQl6ffT8EVj14Phn755RckVSktNeT6TJo0CStWrMALL7yA69evY/Lkybh06RJ69OiBb7/9FvXr1/dWk4mIXM9bFUeAam54vqCitAL7H3sLzVb/ExG6c+gJoCeAJ7EQbwbORNSdHTD+7/HABCu5aFXZCnZdWfEo43w0rwdDAwYMgLWpjiRJwty5czF37lzPNYqISE1Y4l97brzRi0qBn5f/Bu27F3Bl3zF8KGZCnwZ9Uxzy8VbFNOAvnwP9Bji2eKy1YNdVFY8yT8CWdc4QERF5AEv8a8dNiecHvzyGOf2y0Sr4JHo+3gFL9vZFmpgDQNS4eUuolr9jKRfNGnPBrqHi0VIFtyQBGo31ikcF5KMxGCIiUjvDDc8aWzc8tXLxjT7/lzN4Y3g2utQ9gLZDW+KVrQPwR0VzhOIq5kW9Dw1OWb5xV+3hAfQB0fHjwFtv2ffm5oLd2lY8KiQBm8EQEZHa+fvrFxe1Ztw42eR3yIaLbvSGSrCkhjnQdI/Cc+sHIOd6WwSgHMOa/Azt1G04e1bCi2/ZuSRG1R4ef3/g6aft793R6fTLxKSn639b62Wyp+LRkXw0L/J6zhARkSrIOHkUOp3+5mfNqlXAwoXyabMc1CLx/PrF61j/6h6sTPfDlwWdUY6bvW6JYXuRMrQI96d1QGSrO26+yNnhTEPvjrkcoqq9O+vWWc/rcabiUSH5aAyGiIjcTebJozZv6gCrycxx8EZfUVqBTW/txcoPr2PNsY64UmVNsI4hh5Ay4AzGz2mFZr06mT9ObWYsN/TumPt3uHix/r/NLN9Ro/Te0e9fIfloDIaIiNzJwhpRNud38SSF/PUuO3bewH/fXYql/9iM1b+2Q6Hoatze3P8UUu44ipTnY9FhVGsAra0fyN4eHku9NZZ6dwB9wrcj80zZ29MpxyVnzBEqUFRUJACIoqIibzeFiNSkokKIuDgh9LeBmj+SJIRGo9/Pm7KyLLex6k9WlnfbKTeffSaEv7/Fz6sSEPmIFn6oMG5uJJ0TU27PFj8u3ScqdZXOvW9GRs1/VxqNfrszHP3+zb1/XJzl98/I0P9bl6Sa//4lyWq7PXX/loSwNQGB8hUXFyM8PBxFRUVcp4yIPCc7W19mbUtWlvuHn6z9Ja/T6XsGbP31npvLnCEDSz1+f6oEAEgYg8/xLQZjVPwepDwcjIHPJSCwbmDt39+VOWjp6fopAWzRaoHgYPPnbeiZstTTaW6oWKPR92RZ6Rn11P2bw2RERO4il+EnWzlLtR1+URtrVWR/qoQ/Xg+bh7GTmuLjlySENunr2ja4csZye/N1mjQBHn7YuWVbvL3kjA0srScichc5JI/aOw+OXBaMVYDS9RttJpwHQIdZ63pj3Du9Edok1EMtc5K9EysCtSuTNwRw48frf8skEAIYDBERuY8rZu+tDUfnwTFM0peVpR8SycrSD40pKRAyN0+OC1SUVuCb+b/goVt+wF9HnrbvRUpJOLd3YsXCQvuOp5TzroLBEBGRu9R29t7acmbCOxn/9W6Ti5fFEJUCOz7cj6c7bkZs3Uu456Vu+PhYX+SipX0HUNLyJfb0DMqhp9NNGAwREbmTN4ef5JKz5AkuXBbj9y+O4qW+2bglOA+9nuiAJb/2R6FojEbSeUy5fTMWftAAwps9fu5iq2fQ2z2dbsQEaiIid/NW8qiS/pJ3pDqq+r69e1sfDrSW2PunvJ9OY9W8w9BmNcWe620A3AoACMVVjIrfgwmPhuCuGZ0QWLe//gVNfDTh3Fpiti8n2ru1cF8mOM8QEamSYZ6j6vO7eHOeo4oK/Xw1Wq3+d0WFY/PWmNs3LMypeZIuHL0o/jVhs+gfniMk6Iy7BaJM3Nd0h1g17UdRcq7E8rm4er4fpfDgeXOeIRfiPENEpFqG4SPA/F/ynqwUM1fiHxkJXLhQc19z7bMxt49NWi2uDRqB/72yB9pP/fFVQWeUI8j4dP/wPUgZVozRqR0Q2SrCvmPKec05d/LQeXvq/s1giIjI1zk54Z3L2+BoIFN1skdAnwxtaw01KxZEv4OFZx7GVdQ3bkuocxApSQUYN+c2aHrEOH1scg8GQy7EYIiIVM+bPRiGGa6dDWSysvS/7ZnN24xKAKegQTxyUQl/xAecREqPY0h5IQ7t7rvVuTaRR3AGaiIich1XzljsKFsl/rbUstpNApCKNEy+/QdMmBaJHo+2h+TXrFbHJN/CYIiIiNyrtqX7tax2O3rnk/j3hokICOEtj8zjvwwiInIvZ4MZQ86QYd6auDjLi8maIQBIcXFo9e176khqdhcVJIkzGCIioprsvQHas59hsj4HAhlz89aUvbIIQY+kQMB0xmDDEU2mApQk/eO335bHjVupAYWtRX59BGegJiJyBTetieUV9i5rYe9+9ixLEhlpuv3PGbrL7xmOr+btxMSWPyDykeEYjQzkI85k18rwhpAsvF4WN2wXLxPiMS6c1VvuWE1GRFRbvvTXs6US+Krz/owYAcyfD6Sm1ny9tfmLrJX4V5mhW0Q1xfZDDaH9oAif7m+Hc6KxcfeWAScwocdRPHpvAVq09LvZywLIs+fFns9Tjv9GbFUAVp32wI2fM0vrXYjBEBG5jVJvdubYcwOMiACCg4HTVlZut3ajtDJc9Nu6o1j52imk77wFxys0xpc0kc7hgdt/R8rThkowC2tjyY1MAgqnZGfbN5VBVpZbqxRZWk9EJHc6Xa3XxJIVe1a5NzdbtLn98vL0x6t+o6xW4n9yez7S5x2BNjsa+0pbw7AmWD1cQXLLvUh5NAR3PZuAgJD+Dp+O19nzeVr6nLxNTYv8gsEQEfkaTyaqKvlmZ46rb2wWjnfhyEV8lrof2g3h2FrcCUAsACAQNzCkaQ5Sxukw/OXOqBPR17Xt8TQlBxRKWuTXBRgMEZHv8HTujpJvdua4+sZW5XglhSX44pW90H4agK8LO6MC/QAAEirRv8FeTLjvKkbPvR0N43u4tg3epOSAwlYFYPVpDxSOwRAR+QZLuTuGyhd35O4o+WZnjjMl8Ob8eaMs79oTG9N2QrviBtYe74QS9Dbu0rnOAUy46ywemNMacd07u6DxMqTkgMJQAThmjL6d5hb5rTLtgdIxgZqIlM9biaqG97V1s3NHgqy7hgMtrXJvJ/0rJPxbk4YXT/0V50Uj43MtA05gQq9cjH9Bg7bDbrn5IqXOwWMPS5+nUhLsvbzIr8fu30IFioqKBABRVFTk7aYQkTtkZQmhv9VY/8nKcv17Z2QIIUn6n6rvZdiWkeGe94yLM32/uDjXvZel40dG1jzPaj/5iBajkGHc1EQqFNM6ZYsdH/4qKnWVnj8XOTB3jhqNcs6xokJ/7Wi1+t8VFR57a0/dv9kzRETmKemv9fR0/WR2tmi1wPjxrn9/T/717KlSfnPf/7p1Zns5Kv/8nYo0LMCLCEUJkm/Zh5TH6uDOZzpZXhPMl6YlsEVJ15OMcJ4hF2IwROQgpU0iKIc5UTxxs5PBvDXF7/4HfjOfR73r54zbTkKD5/BPlEc3R8o4gWEvJaBORB3rB7J1LoD+XI4fZ9CgYgyGXIjBEJEDlPjXujdzdzzJS0GfoRJs5acB+KawMyrhh0RsRQzyERV6DR1GtULyvAQ0jG9g/0HtPZe0NGDOHGebTgrHSReJyPOUOomgWipfPFjKX36tHN8u2qOvBDuRgGtVKsG61DmA4XcB41LvRGw3Jyvl7G1jairQoYP8AnDyKVyolYhucmQSQblJTtb3WsXGmm6X04KdteXmUv7Kikr88P4+TO6wBdH1ijEsrTu0J/rgGkJxS8AJzOmXjQMbjmHXtbZ49n8DnA+EHG3j9OnKXviWZI89Q0R0k9InEUxONlnw0+cSVXv3Bho3Bs6dM/+8k/PW/JpxGNrXTyN95604oeto3B7lV4hxHQ8gZVojdJ/UDpJf89q03pRhDh5rwbeBkmbxJkViMEREN/nCJILV1r7yGYakdmuBEGD3cOCJH08h/ZWj0G6Owa+ltwG4DQBQH8UYfetepDxWF0nTO7lvTTDD0Obo0fbtL9cA3N1YheYRsh8mq6iowEsvvYT4+HjUqVMHLVu2xLx581BZWWn7xUTkGMNf64Yba3WSpC8Zl+OMub7MkNRuq/LKxnDg+UMX8MH4Legbtg8t+sZh9jcD8GvpbQhCGUZF78BnM7bj7IVALD+SiEGzulouiXeV5GR9grQ95ByAu0tmpr4wIClJP3VEUpL+cWamt1vme9w6i5ELvPrqqyIyMlKsX79e5Obmis8++0zUq1dPLF682O5jcNJFIgd4YxJBsqyiouaEfdV/GjcWoqzM7MuvnLkiVk7+QQxp/LMIwI2bXyd04s6Gu8SHk7aIS8cvu77N9k7SV1EhRGys5XOTJP0EhR6c6E8WDNehuc9DRdehp+7fsg+Ghg4dKh599FGTbcnJyeLBBx+0+xgMhogcpPQZc32JE7Nr3yi5Idan/izGN/9B1MVVk9261v1NvHFflsjfdcY97XVmRmkG4KZsBcAqChA9df+Wfc5Q3759sXTpUhw+fBi33XYb9u7dix9++AGLFy/2dtOIfJevJyLLlbn8EDtzZSpP5ePHJXuh/aAInx1ojwuiu/G5WwOPI6XXcaTMaobW97YD0M497Xd2sVxDJaC5iT49tAaWR9ib/+NIVacv5sd5geyDoZkzZ6KoqAht2rSBv78/dDod5s+fj/FWptQvKytDWVmZ8XFxcbEnmkrkW3w1EVmuLM36/cQTdr18/KQgfFrZyfjYUAk2YXpjdJvYFpJfCxc3uBpbc1QBwFNPAdev66c/qB4I+HoA7sis7kqv6lQit/Y7uUB6erqIi4sT6enpYt++feK///2viIiIECtWrLD4mtTUVAH94skmPxwmIyJZspUfYmWBVB0kcQIa4YcKEYbL4pFWW8TG13aJijIPD6HYO5znq4uxWuNo/o83Fx6WGS7U+ieNRoNZs2ZhypQpxm2vvvoqPvnkExw8eNDsa8z1DGk0Gi7HQUTyY896YxEREBcu6B9Wearyz0evN1yAWx7rjyGz7VgTzF3sXSzXQM7Lu7iSM+vJqWV5GTt4ajkO2ZfWX7t2DX5+ps309/e3WlofHByMsLAwkx8iIlmyJz/kwgXMRSpOIc7kqWt1G+P60v/ghYuzMPqfvbwXCAGOl74bbvK+Pru0M7O6G+ZgAmpOc+FLy8vIiOxzhoYPH4758+ejWbNmaN++PXJycvDmm2/i0Ucf9XbTiMgV1D6pnJ15H4fRGmPqfInnunyPgUOC0bB3W9ST02dlmKPKUm+GOWpIBHY2/0ctSeUyIftg6N1338XLL7+MyZMno7CwEDExMXjyyScxh6sYEymfI0mlvsrOHpVFrwGaF24HcLt72+Msa4vl2uLLicC1mdXd15PKZUT2OUOu4KkxRyJygKUybJXkkohKgV8zj0C7KA/Tdk5EUxTADzX/dywkCZKS8kPMBbi2ZGX5bs+QrfwfQL/e3Ftvma+yUzlP3b8ZDBGR5zmTVKokVob+crfkIf3VP6DdEovfyloBAEYhE59jDABhmsjpjcDQFcOWhmPk5wPPPAOcP6/uRGBD4A/Y7jFTW8+oDR67f7u1Vk0mOAM1kcz4cumwmRmYK6JixJe95one9feanF4wrovRsdtExvPbRdl/070/67czs0fbc0zOLm3+s7U0u7SaPhcbZFlan5eXB41G477IzE3YM0QkM/aWYWu1gJUJVmXHwtCfoQR+DD7HWozEnQ33YMLIEoxK7YgGzcNv7ujNZHJ3DluaGzrTaNSXCFy9x+zcOfP7qaXHzA6yHCYLDQ3FjBkzMGvWLISGhrqtUa7GYIhcRu2VT66Sna1fgdsWJeWS6HQQzZsD+fmQzDxdCQkldRrj6tYcRHeN8XjzrPLEsCWvnZt88d+/m8hynqGNGzfi22+/RatWrbB8+XJ3tYlInjIz9TeMpCR9r0ZSkv5xZqa3W6Y8hjLs6nOoGEiSvucgMdGz7XJCZUUltry7F2/EL4FkIRACAD8I1L9eiOgrhz3aPrs4MxeOowzLu4wfr/+t1kAI4HIbMuRQMNS7d2/89NNP+Mc//oE5c+agc+fOyM7OdlPTiGTEMIRQ/YZhWICSAZFjFD6pnKgU2PvpIbxwRzaahxSg/7RO+CWviX0vluMNjjdnz6pNuT25hVMzUD/00EM4fPgwhg8fjqFDh2LUqFE4evSoq9tGJA/2LEDp67PouoNhUrnYWNPtcXGyLavP3ZKH+YOy0aHuH0h4oDX+uXMATuliEI4idI61kP9RnRxvcLw5e5YP9Yz6CqdL669du4bdu3cjIyMD77zzDgIDAzFlyhTMnTsX9evXd3U7a4U5Q1QrHN93L5nnkhT+dg6fzv0d2q8jsP3qzQkPg1GKYbE5mDBBwr2zExBSP1C560lxLSzPs1Rur5J5tuzlqfu3QzNQL126FDt37sTOnTtx4MAB+Pv7o2PHjpgyZQoSEhKwcuVKtGvXDmvWrEG3bt3c1WYiz+IQgnsZcklk5MrpK1g7by+0GcHYeL4zdOgPAPCDDndG7MGEUdcxas7tCG/Wy/SFlmZglvvQn7XZo+XedqXichuy4lDPkEajQc+ePY0/3bp1Q3BwsMk+CxYsgFarxf79+13eWGexZ4hqhT1DrifD3qAbV2/g64U50H6swxd5CbiOusbnuof+hgmDz2PsnDaIToiyfiAll5Erue1KJcNrQU5kWVpvj7NnzyImJgY6GeVPMBiiWuEQgmvJaD2yyopKbH1vH7RLi/HZodtxSTQ0PndbYC4m9D2B8bNboNWgFo4dWMk3OCW3nXyOYoMhIQS2bNmC/v37u/KwtcJgiGrNl8f3PXnzk8F6ZKJSYO9nh7Hy9TNYlXMbTuluzvkT7VeA8Z0PImV6FLqktIHkZ6lQnog8QbHBkBwxGCKX8MUhBE/20nh5PbJj2SehffUYtFs1OHDjFuP2cBRhzG37kPKXeuj/dEf4B7EXhEguGAy5EIMhchlfGkLwdC+NF3KvCn87h9Wpv0P7TQR2VKsEGx6bg5QJEoa82BnBYcFWjqJAvvTvlFRNltVkRIrj6puCDCufnGJr7iRJ0s+dNGKE626iHqrKu3L6CtbM3QttZgi+u5BgUgl2V8QepFiqBPMVMsrJIlIKBkPku3hTsMyR5RdcFfy5cWK/G1dv4KsFOdB+osMXeZ1Rir7G5+4I3Y8Jd1/A2NS2aNqxq8PH9hpnAnlLvX2GmdKVnNtG5EYMhsg38aZgnTfmTjLMumurKs/OWXcrKyqxZck+aP9VjM8P3Y5LoofxudZBxzCh70mM/3s8br2rg6vOwHOcCeS90dtH5COcWo6DSNa4fIZt3lh+wQXrkYlKgZz0g3i+ezaaBZ9F0jMJ+PfBfrgkGiLG7wye7ZqNXZ8cwIHr8Xj5+wG49a7mrmu/pzi7Dp4nFlsl8lHsGSJlMzeU4I0hIKVxcS+N3ZycdfePTSeQviAXK7dqcPBGGwBtAAANpMt/VoLVR7+pHeEfpPC1s2rTu8OZ0omcxmCIlMvSUIJhPiBb1HxT8ObyC8nJ+pu5jXyYs/v1a4Kt/DoSP5V0AKDv5QnBdQyP24OUB/1w7+wEBIf1c30bvaU2gTwXWyVyGoMhUiZrOUGLF9t3DLXfFLy5NpKFqrziU8VYO28fVmaG4LsLnVFZpRJsYGQOUkaVYlRqR4TF+WglWG16d7zV20fkAxgMkfLYkxPk7w9UVvKmYIudvTQmXDxdQVlxGb5auAfaTyrxv1MJJpVgPUL3I+XuC3ggrR2iOqhg8efa9O5wsVUipzEYIuWxNZQA3EyO5k3BNkfmTnLRdAW6Gzp9JdiyK/j8cEdcrlIJ1iboD0xIzMP4v8fjljsVWAlWG7Xt3eFK6EROYTBEymPvUML06fobA28KrlHL6QoMlWDat85iVU5r5Fd2Nj4X63cG47scQsqMpkh4oDUkv1ssHsenuaJ3x5nePiKV43IcpDyOLOtgqC7jTaF2arGu2NHv9ZVg2h80OFhlTbAG0mXc33ofUp4MQ+Lk27kmWFW+uA4ekRO4NpkLMRjyMYYbs62hBDct+KlKDq4rVrCvEJ+mHcDKbyLxc8nNoa4QXMd9mhykPOiPe2Yl+N6aYK7E9cWIuDYZkUVMFPU8O4cmt8zLxquj6+P7iwkmlWCDInOQklyKkXM6Iiyutztb6jt8ZR08IgXgDNSkTIZE0dhY0+1xcVxqwx3srHKakzUAGy92RSX80bPer3hn9Gac/vUivj7fDQ8t64uwOPbMEpH8cJiMlI1DCZa58rOxMTRZCQmnEId7A7/D+H6n/6wEU+BSGEQkKxwmI3mTSxDCoQTzXFQCbyAkPxxLfh4t3/kbBCT44WZAVAkJEgR0M57H/n+2guR3myvOgIjIYzhMRo7LzNT3EiQlASkp+t8tWlheQNLbdDp9AnB6uv63ry/Q6uxCn2Yc/f4E5t2ZjbZ1cnHrO9MwGhnIh+nQpBQXBykjA/FvPA3JT7JwJCIi+eIwGdlPpwPmzwdSU2s+Z0hcllu+jot7SGSvFiXwBgX7CrF67gFov61ZCTZCk4OUCcA9fa8iqPgChyaJyK1YWu9CDIZcwFxQUZ3cStotTRIo18DNFRwsgTcoOlmENfN+hXZNnT8rwfTfnz8qMKhRDlJGl2HknE6oH1PfPe0mIjKDOUMkH5aCiuqsrajtabbWL5Mk/QzVI0bII3BzFQcW+iy9XIqvFu7BypUC6/M7o6zKmmC96v2KlHsu4v7Udojq0N1NjSUikgcGQ2SdtaDCEntvyO5ka/2y6oGbXBLCa8vOEvhFz5/DgpQyFKGncVvboD8woV8exr/YEi0H3F67dvjK50l6/D7JxzEYIuvsWRS1OntX3nYnB3pIfCqvyMZCn4YS+Nn5U1AJf8T5n8b4Locx4blodBxzm2vWBPOlz5P4fZIqsJqMrHOkl0eS9OsnWVpR25PsDciOHHFZ5ZUsGGbnBiBgWtlV+efjl/AqHm/zIza/sxcnSpti0c8D0Glsa9dUgrmwko1kgN8nqQQTqMk6exNyAX0wJJekZHvWLzPMXl2Lyiu5ObPnLFanHcTpr3LwdNkb0ODmuZ33b4LcUTPQafkzCKoX5Po3d6aSjcMv8uWCykSi2vLU/Zs9Q2SdYdhFstFrILdlMKr0kNRou+HxE0/Yn1ckY0Uni7D80a0YFLkLcZ0b4Zm1/fHPsum4BUfxQtgH+OGuVFz7bAMalZ1G989muicQAhzL0wKUN1+V2jj6fRIpmCKCofz8fDz44IOIjIxE3bp1kZCQgF27dnm7WepgLagwSEsDjh+XTyBkMGIEMHcu0LCh6XZD4NaqlX3HkUNCeDWll0uR+cIOjInbjqjmwXh0eSK++3NNsN7192HJ/Ztxan8xFhU9hb7fzUXdMUPc/9e7o3laHH6RN0e+TyKFk30C9aVLl9CnTx8kJSXhq6++QpMmTfDHH3+gQYMG3m6aehgWRa2eRKnR6FeHl1sQBJhP+oyI0G978UV9YJCdbd+xXJUQXsshId0NHbLf3ouV/y5BxpGOKK5SCdYu+Cgm9DuF8S/dgvh+HV3TXkfZ+zk1aQI8/LD6pj1QGnu/TzkUTBDVkuxzhmbNmoUff/wRW2vRFcucIRdRSn6HvZMt2pNXVJuciKqf15EjwL//7XBFjqgU2PXJAaxcfA6r9rZBQWWU8TmNfz7Gdz2ClGcNlWBuXArDnu/e3s9z+XJg4EDb71ltYkjyMHdfH0R28Nj9W8hc27ZtxfTp08WYMWNE48aNRUJCgli2bJnV15SWloqioiLjT15engAgioqKPNRq8pqKCiHi4oTQ/++75o8kCaHR6PcTQoiMDP02Saq5nyTpn3dGRob1dth4j0NfHxOp/bNEq8BjJi+JkC6IJ9tuFlve3SN05bpafFC1PJe4OPOfjT2fp1Zr/XMx/Gi1njk/ssxd1weRnYqKijxy/5Z9MBQcHCyCg4PF7Nmzxe7du8XSpUtFSEiI+M9//mPxNampqQJAjR8GQyqQlWXfjTYr6+ZrzN3sNZraBULVbx52BGencwrEmyOyRLe6v5nsUgclYlyzH8UXL/0kyq6UueJTqv25WLsZ2vo8nfmOyHtcfX0QOcBTwZDsh8mCgoLQrVs3bNu2zbht2rRp2LlzJ7Zv3272NWVlZSgrKzM+Li4uhkaj4TCZGqSn6yuTbNFqgfHjbz521RCgrXJkC56t9y+8dfVxiD9rGvxRgcGNczBhzA2MmNMJ9ZrWc7wttVWb0mprnyeHX5RHKUPk5HO4NtmfoqOj0a5dO5Ntbdu2RUZGhsXXBAcHIzg42N1NIzlyNunT3981+SnOzNgN4PTV+hDwQ+/6+zBhyCXcn9oejdt6eU0wR5c0qcra52moUBwzRh/4VA2IDHldixfzZisnrro+iGRK9qX1ffr0waFDh0y2HT58GM2bN/dSi0jWbM2L5O5Zsp0sMx7W7SyObc7Dj8UdMXlVfzRu28jFDXOCO0urDRWKhokvDeQ2XxURqYLse4aeeeYZ9O7dGwsWLMDYsWPx888/Y9myZVi2bJm3m0Zy5O1eBwfLjAUkQBOHCTuell9PiLtLq5OT9eXzHH4hIi+Tfc4QAKxfvx6zZ8/GkSNHEB8fjxkzZuCJJ56w+/UsrVchc/MMeWJeJJ0O5U3jEHC+ADYL3auX+ssNc3uIyMs8df9WRDBUWwyGVMqDSZ+ndxdg9byDWLmxCZpdO4jPMQYA4Iebl5cATAMkOU9aaWCYswkw38sm10COiHwCgyEXYjAkYwquUrl8oggZqfug/SIUWZcSTCrB0sLexHTd6wgtOXfzBXFx+vXQWrVS1rm6s5dNwd8/EbkfgyEXYjDkQY7c3MzdZO2Yldmbrl+8jg3z90CbLmHDmc64gZtVi33q78OEoZcxZk47fQK0L93o3XEuCvz+icizGAy5EIMhD3Hk5mbvkhkyoLuhw6Y390D70TVkHu2IYoQbn+sQfAQTBuRj3Eu3okXfOC+2UmEU9P0TkfcwGHIhBkMe4MjNrTaT+XmIqBTY+Z/foX3nPFbta4uzlU2MzzXzP4WU7keR8lwMbh99m1fap2gK+P6JSB446SIph06n7xGydxXy2kzm52aHvjoG7T9OQru9BY6Wtzduj5QuYGy735AyuQF6/6UD/ALYC+Q0GX//RKRODIao9hy9ublzMj8n5P9yBqtfOYSVG6Ow+3pbAC0BAHVRgpHN9yDl4SAMfiEBgXX7eaQ9biWHPCaZff9ERAyGqPYcvbm5ezI/O1zKvYzMtF+xcl09ZF/uBAH9ewWgHHc3yUHKmHKMSE1AaJM+bmuDx8klYVkG3z8RUVUMhqj2HL25GZbMsDWZn4uXzLh+8TrWv7oH2lUSvjzTGTdw8/h9w/YiZUgR7p/bHo1a3+HS95UFSzld+fn67Z5MWPbS909EZAkTqKn2nJmp2EOT+VWUVmDTW3uh/eg6Mv/oiCu4+f3fHnIYKf1PY/zLt6J5Hx/OAZJjwjIncyQiO3jq/i37hVpJAQzrgQE1F0i1tB6YGxfqFJUCP320H39L2Iy40Iu4++9d8Z8/+uIKwtDc/xRm98rGvs8PY9/12zDr6wGeD4R0OiA7G0hP1//W6dz7fo7kdHkKF2olIhnhMBm5huHmZi4nxdJMxS5eqPPgl4ZKsHj8UdHBuD1SuoAH2u9HyuSG6PWElyvBvJG3I9eEZS7USkQywWEyci0PVyvl/3IGq9IOYeX3Uci53ta4PRRXMbLFXqQ8HIRBzycgsG6g29pgN29NNJidDSQl2d4vK4ul7EQkK5x00YUYDLmBF0u0L+VeRsbcX7Hyi3rYfLmTcU2wAJTjniY5SBlbgfte7oTQJqEeaY9dvJm3w9XniUihOOkiyZcXhnoMlWAr0/3wZUFnlFepBEsM24uUoUW4P60DIlvJtBLMmxMNGnK6xozRBz7mEpar53QREakIgyEyZavHx4Ml2oZKsJUfXseaYx1xBb2Mz3UMOYSUAWcwfk4rNOvVySXv51bezttxJqeLiEglGAzRTbZ6fBxddqM6O4bWRKXAT//3G7TvXsDqX9uhUHQ1Ptfc/xRS7jiKlOdj0WFUawCtXXPeniCHiQaZsExEZBZzhpTMlXk79iT3RkQ4n4hrI9A6sP4PaF/Lg3ZHPI5VNDfu0kg6jwc6/IaUKRHo9UQHSH7VSveVgnk7REQOY84QWefKvB17e3wWLrTveNWHeiwEWuJUPjB6NJ4Pehtv3JgG4BYANyvBJjwShIHPJSCwbn/HzkeOmLdDRCRbnHRR7sxN0GcILqon5BrydjIzHXsPe5N7z52z73hVh3qsBFoSBAQkTLvxOoJQiuFRPyH96W04e1bCJ7l9cO+c7vIoiXcVTjRIRCRL7BmSM3O9P7GxQGmp83k75tibtNu4seNrStkItPwg0Ax5KPz4W4Q/eJ997bBFDiuzW6KUvB05f4ZERC7GYEiurFVtWeNMiba9SbuxsXYP9VSUVuD7N/bgj3eyMdmOQ4dLV/Q9X7W9+cplZXZr/P3lObmhIQBatw745BPg/Pmbz8ntMyQiciEmUMuRrQn67KHVAuPHO/Z+9ib3mgs4NBqIN9/CT5dbY+U7F/Dp/nYoFI3RH9nIhh1J140bmw7DOXPz9dYMz77A3HdaFT9DIvICzkDtQooLhuxdPsEaR5dWcHQV8SrDKMePVeKjL5ti5c+tkFvRzLhLI+k8xrXfh9fzUxB0uRCSI//UHL35ynFldqWwFERWx8+QiDyMq9arWW0m3pMkQKMxzduxh73JvX8mdF9Y+C+smrUHXR/tiPiXJuDVbXcht6IZQnEVD8b/gK9e+QWnr4bj3V/vRPCH70MytM1ehhvz9On2reoux5XZlcBaJWF1/AyJyEcxZ8jdnElEdXbivdqWaNtI7r3y/n8hPf8c6l07h0gA4wD0QRxm4A2URTXHhAd0GP5yAuo26lvzuOZmP64+NFadI/lP3p7hWalsBZHm8DMkIh/DYMidnE3mTUzU72dtyCciAqhTx/VLK1RL7r12/hr+98oeHPvvFsy8/HcApj0IcTiFT6VxkN63MZxlLtDKzwcefNB2m+y5+Xpqhmdfq7JyJrBx5yzZRERewGDIXWqzhte6dcD16+afM/T+LFvmthLtitIKfPf6HmiXl2LNsU64hh44jgcA4/rwVZpj+I+//Q0IDwcKCy23pXoVVXa2fQ2y5+ZrCCAdKft3lBIq1RzlSGDjis+QiEiGmEDtDrVJ5rWVzBoZqQ+EXHzzFZUCOz7cj5VLLuLT/e1wTjQ2PjfObzXSK8c5dkB7ggSdDoiKAi5csLxPZCRw9qx9QZ6jSeCOsKdSTQnzB1Vnq5KwKkliNRkReZTH7t9CBYqKigQAUVRU5Jk3zMoSQn9rsf6TlWX6uooKIeLirL8mLk6/n4v8tu6I+HvvLBEfcMLkbRpLhWLq7dli27/2icpPVtp3PlV/JEn/k5Fh+c0rKoSIjLR+nMhIx843I6PmZ6jRWG+HLba+F0nSt7P6PnFxtXtfT8nIuPl9WTrH2n6GRERO8NT9m8Nk7uBsMq89yaynTjk2oaIZeT+dRnraYWizorG3tDWAWwEA9XAFo1ruRcojIRj4XAICQv5cEyzbSs+NJfbMhr11q/VeIUD/vCPn6+oZnnU64N13bVeqmTsPe4ZE5cBagvuECfrPUwm9XERETmIw5A7OJvO6sSLq4h+X8NmcX6HdEIYtRQkAYgAAgbiBe5vmYMI4HYa9aKYSDLCdj2OJrWowd52vq2Z4tjURoS3OLo/iDUpZJoSIyA0YDLmDs8m8Lq6Iunb+Gr6YtwfaT/3x9dnOKEc//dujEv0b7EXK8CsYnXo7Im7pYf1A1lZct4elYMZTFWDOsHciQlucWR7FW+S6TAgRkZsxGHIHa8GDtbmAXFARVX6tXF8JtqIMa3ITUILexucS6hzEhDsL8MDLt0HTo7Nj52RpKMUeloIZT1SAOcORiQjtxbl5iIhkizNQu4u9MzpXZQiigJqzNVsJokSlwLZ//YqpHTcjtt5lDEntjk9y+6IE9dAy4ARe6puN39YdRc61Nnhu/QBoesQ4f07Hj+uX+tBqge++05+fpZmlbc2G7eT5up0zExHawrl5iIhki6X17ubMJH0WFkKtPqHib+uOQrvoFLQ/34LjFRrj9ibSOTxw++9IeToSPR5tD8nPgWUwHOWKcnY7z9dj0tOBlBT79o2L088JdfGifYvcEhGR3bhQqwspbqFWwGIQdXJ7Pla9cgQrs6Kxr7S1cfd6uILklnuR8mgI7no2AQEhATaP5TKuCGbkNLOzvQvlvvUW8PTT+kky3TW/ERGRijEYciFFBkNVXDhyEZ+l7od2Qzi2Fncybg/EDQxpmoMUYyVY3ZovNheoRETot734ousCDjkFM7VlayJCc709cuvdIiLyAQyGXEiJwVBJYQm+eGUvtJ8G4OvCzqhAIICblWAT7ruK0XNvR8P4BpYP4qXZrH2CM8N/vhQQEhHJgKfu34pLoF64cCEkScL06dO93RSXK79Wji/TduLB+B8RFSWQsqQ31hfegQoEonOdA3h9WDZO/nwWWZc64/H/JFoPhOypiLpwQX/Dz8x0+bkonrMJ8AMGAOPH638zECIiUgRFldbv3LkTy5YtQ8eOHb3dFJeprKjE9n/vh/b9S/j0t/Y4L7obn2sZcAITeuVi/AsatB3WFkBb+w9sb0WUEMqYFNAbOBEhEZEqKCYYunr1KiZMmIB///vfePXVV73dnFrbv+YItP/Mh/bnW3FCdzO4ayKdw7iO+kqwOx5pD8mvuXNv4Mi8NkqZFNAbOBEhEZHPU0wwNGXKFAwdOhQDBw60GQyVlZWhrKzM+Li4uNjdzbPLiR9PYdWrR7EyOwa/lt4GoBUAoD6KkXzLPqQ8Vgd3PtPp5ppgteHovDacFJCIiFRKEcHQqlWrsHv3buzcudOu/RcuXIi0tDTbO3og4fX8oQv4PO03rNwQjh+KOwGIAwAEoQxDonOQMk5g2EsJqBNhZk2w2jDM7mzv5IGcFJCIiFRK9sFQXl4e/va3v+Hbb79FSEiIXa+ZPXs2ZsyYYXxcXFwMjUZjupO5Uui4OP2MyLWsrjJUgq38NADfFHZGRZU1wQY02IsUYyVYz1q9j1WG2Z1Hj7a+n7eWvCAiIpIJ2ZfWr127FqNGjYJ/lR4bnU4HSZLg5+eHsrIyk+fMqVGaZ6nkvBaT5JVfK8e3i/ZAu+IG1p5IwDWEGp/rUucAUu46i3GprRHbzcM9MJmZwF/+oq8cq46TAhIRkYxxnqE/XblyBSdOnDDZ9sgjj6BNmzaYOXMmOnToYPMYJh9maKh+Qj1Lw0cOLJ9QWVGJbcv2Q/v+ZXz6e3tcEJHG524JOIEJvXMxfmYztBnS0mYb3UqnA+bP1/cUXbx4czsnBSQiIhnzVDAk+2Gy+vXr1wh4QkNDERkZaVcgVIOtknMhbFZX/ZpxGNrXTyN9p2klWJRfIcZ1PICUaY3QfVI75yvBXM3fH5gzRz/jNMvEiYiITMg+GHI5e6umqu134sdTSH/lKLSbDZVgtwHQV4KNvnUvUh6ri6TpLqoEcxeWiRMREdWgyGAoOzvb+RfbWzUVHY3zhy7gs7m/YeWGBvjxSkdUrQQbGp2DlPECQ19MQJ0IJh8TEREplSKDoVoxlJxbWIRTSBKuhTbG+LHB+OpcmEklWFLDPUi5rwSj0zqiQfMqlWBck4qIiEix1BcMGUrOx4zRJ0tXCYgqAUAAE69+gP9d7QUA6Fr3d6QMLMS41DaI6dKl5vHcWKJPRERE7qe4hVpdIjkZlas/RVl4E5PNp6DBGHyOXwO7YE6/bBz88hh+KWmHGesGIKZL05rHMZToV0/Izs/nAqhEREQKIfvSeleoWpp3/NsCfSXYL7filC4aidiKaJxBmRSC5h3DkfJMU3Sb2BaSn2T9oDqdy0r0ibyGQ7xEJGMsrXeDno3/wIEbnVG1Eiz+Vn9MeKI1kqZ3gn9QlZuArZuEC0r0ibyKQ7xERABUFgwduHELglCGYTE5SEkRGDLbQiWYPTcJJ0v0iWTB0izshiFezkpORCqiqpyhJSnbcPZ4KTLye2L0P3uhTkSdmjvZmwfkQIk+kazodPpg39wIuWHb9On6/YiIVEB1OUNWxxwdyQMC9PtaKNFnzhDJVnY2kJRke7+sLA7xEpFXeSpnSFU9QzY5kgdkKNEHbi54amB4vHgxAyGSHw7xEhGZYDBUlaM3ieRkfW5FbKzp83FxzLkg+eIQLxGRCVUlUNvkzE0iORkYMYLlyaQcNmZhNw7xJnKZGSJSBwZDVTl7k+ACqKQkVmZh5xAvEakRh8mqYh4QqQWHeImIjFhNZo65eYY0Gn0gxJsE+RLOQE1EMuapajIGQ5bwJkFERORVXI7D25gHREREpArMGSIiIiJVYzBEREREqsZgiIiIiFSNwRARERGpGoMhIiIiUjUGQ0RERKRqDIaIiIhI1RgMERERkaoxGCIiIiJVYzBEREREqsZgiIiIiFSNwRARERGpGoMhIiIiUjUGQ0RERKRqDIaIiIhI1RgMERERkaoxGCIiIiJVYzBEREREqsZgiIiIiFSNwRARERGpGoMhIiIiUjUGQ0RERKRqsg+GFi5ciO7du6N+/fpo0qQJRo4ciUOHDnm7WUREROQjZB8Mbd68GVOmTMGOHTuwceNGVFRUYPDgwSgpKfF204iIiMgHSEII4e1GOOLcuXNo0qQJNm/ejH79+tn1muLiYoSHh6OoqAhhYWFubiERERG5gqfu3wFuO7KbFBUVAQAiIiIs7lNWVoaysjLj4+LiYre3y210OmDrVuDMGSA6GkhMBPz9vd0qIiIinyH7YbKqhBCYMWMG+vbtiw4dOljcb+HChQgPDzf+aDQaD7bShTIzgRYtgKQkICVF/7tFC/12IiIicglFDZNNmTIFGzZswA8//IC4uDiL+5nrGdJoNMoaJsvMBMaMAap/PZKk//3550BysufbRURE5CGeGiZTTDD09NNPY+3atdiyZQvi4+Mdeq3icoZ0On0P0KlT5p+XJCAuDsjN5ZAZERH5LE/dv2U/TCaEwNSpU5GZmYlNmzY5HAgp0tatlgMhQN9blJen34+IiIhqRfYJ1FOmTIFWq8W6detQv359FBQUAADCw8NRp04dL7fOTc6cce1+REREZJHse4Y++OADFBUVYcCAAYiOjjb+rF692ttNc5/oaNfuR0RERBbJvmdIISlNrpWYqM8Jys+vmUAN3MwZSkz0fNuIiIh8jOx7hlTJ3x94+239fxuqxwwMjxcvZvI0ERGRCzAYkqvkZH35fGys6fa4OJbVExERuZDsh8lULTkZGDGCM1ATERG5EYMhufP3BwYM8HYriIiIfBaHyYiIiEjVGAwRERGRqnGYjMheOh3zt4iIfBCDISJ7ZGYCf/ub6TIpcXH6KRBY2UdEpGgcJiOyJTMTGDOm5npx+fn67ZmZ3mkXERG5BIMhImt0On2PkLmZwA3bpk/X70dERIrEYIjImq1ba/YIVSUEkJen34+IiBSJwRCRNWfOuHY/IiKSHQZDRNZER7t2PyIikh0GQ0TWJCbqq8aqL5hrIEmARqPfj4iIFInBEJE1/v768nmgZkBkeLx4MecbIiJSMAZDRLYkJwOffw7Exppuj4vTb+c8Q0REisZJF4nskZwMjBjBGaiJiHwQgyEie/n7AwMGeLsVRETkYhwmIyIiIlVjMERERESqxmCIiIiIVI3BEBEREakagyEiIiJSNQZDREREpGoMhoiIiEjVGAwRERGRqjEYIiIiIlVjMERERESqxmCIiIiIVI3BEBEREakagyEiIiJSNQZDREREpGoMhoiIiEjVGAwRERGRqjEYIiIiIlVjMERERESqxmCIiIiIVI3BEBEREamaYoKh999/H/Hx8QgJCUHXrl2xdetWbzeJiIiIfIAigqHVq1dj+vTpePHFF5GTk4PExETce++9OHnypLebRkRERAonCSGEtxthS48ePdClSxd88MEHxm1t27bFyJEjsXDhQpuvLy4uRnh4OIqKihAWFubOphIREZGLeOr+LfueoRs3bmDXrl0YPHiwyfbBgwdj27ZtXmoVERER+YoAbzfAlvPnz0On0yEqKspke1RUFAoKCsy+pqysDGVlZcbHRUVFAPQRJhERESmD4b7t7kEs2QdDBpIkmTwWQtTYZrBw4UKkpaXV2K7RaNzSNiIiInKfCxcuIDw83G3Hl30w1KhRI/j7+9foBSosLKzRW2Qwe/ZszJgxw/j48uXLaN68OU6ePOnWD1NuiouLodFokJeXp6pcKZ43z1sNeN48bzUoKipCs2bNEBER4db3kX0wFBQUhK5du2Ljxo0YNWqUcfvGjRsxYsQIs68JDg5GcHBwje3h4eGq+kdkEBYWxvNWEZ63uvC81UWt5+3n594UZ9kHQwAwY8YMTJw4Ed26dUOvXr2wbNkynDx5Ek899ZS3m0ZEREQKp4hg6IEHHsCFCxcwb948nDlzBh06dMCXX36J5s2be7tpREREpHCKCIYAYPLkyZg8ebJTrw0ODkZqaqrZoTNfxvPmeasBz5vnrQY8b/eetyImXSQiIiJyF9lPukhERETkTgyGiIiISNUYDBEREZGqMRgiIiIiVVNkMPT+++8jPj4eISEh6Nq1K7Zu3Wp1/82bN6Nr164ICQlBy5YtsXTp0hr7ZGRkoF27dggODka7du2wZs0adzXfaY6cd2ZmJgYNGoTGjRsjLCwMvXr1wjfffGOyz4oVKyBJUo2f0tJSd5+KQxw57+zsbLPndPDgQZP9fO37fvjhh82ed/v27Y37KOH73rJlC4YPH46YmBhIkoS1a9fafI0vXN+OnrevXN+OnrevXN+OnrevXN8LFy5E9+7dUb9+fTRp0gQjR47EoUOHbL7OE9e44oKh1atXY/r06XjxxReRk5ODxMRE3HvvvTh58qTZ/XNzczFkyBAkJiYiJycHf//73zFt2jRkZGQY99m+fTseeOABTJw4EXv37sXEiRMxduxY/PTTT546LZscPe8tW7Zg0KBB+PLLL7Fr1y4kJSVh+PDhyMnJMdkvLCwMZ86cMfkJCQnxxCnZxdHzNjh06JDJObVq1cr4nC9+32+//bbJ+ebl5SEiIgL333+/yX5y/75LSkrQqVMnLFmyxK79feX6dvS8feX6dvS8DZR+fTt63r5yfW/evBlTpkzBjh07sHHjRlRUVGDw4MEoKSmx+BqPXeNCYe644w7x1FNPmWxr06aNmDVrltn9X3jhBdGmTRuTbU8++aTo2bOn8fHYsWPFPffcY7LP3XffLcaNG+eiVteeo+dtTrt27URaWprx8fLly0V4eLirmugWjp53VlaWACAuXbpk8Zhq+L7XrFkjJEkSx48fN25TwvddFQCxZs0aq/v4yvVdlT3nbY4Sr++q7DlvX7m+q3Lm+/aF61sIIQoLCwUAsXnzZov7eOoaV1TP0I0bN7Br1y4MHjzYZPvgwYOxbds2s6/Zvn17jf3vvvtu/PLLLygvL7e6j6Vjepoz511dZWUlrly5UmOxu6tXr6J58+aIi4vDsGHDavxl6U21Oe/OnTsjOjoad911F7KyskyeU8P3/dFHH2HgwIE1ZmmX8/ftDF+4vl1Bidd3bSj5+nYFX7m+i4qKAMDqIqyeusYVFQydP38eOp2uxmr1UVFRNVa1NygoKDC7f0VFBc6fP291H0vH9DRnzru6N954AyUlJRg7dqxxW5s2bbBixQp88cUXSE9PR0hICPr06YMjR464tP3Ocua8o6OjsWzZMmRkZCAzMxOtW7fGXXfdhS1bthj38fXv+8yZM/jqq6/w+OOPm2yX+/ftDF+4vl1Bide3M3zh+q4tX7m+hRCYMWMG+vbtiw4dOljcz1PXuGKW46hKkiSTx0KIGtts7V99u6PH9AZn25ieno65c+di3bp1aNKkiXF7z5490bNnT+PjPn36oEuXLnj33XfxzjvvuK7hteTIebdu3RqtW7c2Pu7Vqxfy8vLw+uuvo1+/fk4d01ucbeOKFSvQoEEDjBw50mS7Ur5vR/nK9e0spV/fjvCl69tZvnJ9T506Ffv27cMPP/xgc19PXOOK6hlq1KgR/P39a0R7hYWFNaJCg6ZNm5rdPyAgAJGRkVb3sXRMT3PmvA1Wr16Nxx57DJ9++ikGDhxodV8/Pz90795dNn9J1Oa8q+rZs6fJOfny9y2EwP/93/9h4sSJCAoKsrqv3L5vZ/jC9V0bSr6+XUVp13dt+Mr1/fTTT+OLL75AVlYW4uLirO7rqWtcUcFQUFAQunbtio0bN5ps37hxI3r37m32Nb169aqx/7fffotu3bohMDDQ6j6Wjulpzpw3oP+L8eGHH4ZWq8XQoUNtvo8QAnv27EF0dHSt2+wKzp53dTk5OSbn5KvfN6Cv1jh69Cgee+wxm+8jt+/bGb5wfTtL6de3qyjt+q4NpV/fQghMnToVmZmZ2LRpE+Lj422+xmPXuN2p1jKxatUqERgYKD766CPx+++/i+nTp4vQ0FBjVv2sWbPExIkTjfsfO3ZM1K1bVzzzzDPi999/Fx999JEIDAwUn3/+uXGfH3/8Ufj7+4t//OMf4sCBA+If//iHCAgIEDt27PD4+Vni6HlrtVoREBAg3nvvPXHmzBnjz+XLl437zJ07V3z99dfijz/+EDk5OeKRRx4RAQEB4qeffvL4+Vni6Hm/9dZbYs2aNeLw4cNi//79YtasWQKAyMjIMO7ji9+3wYMPPih69Ohh9phK+L6vXLkicnJyRE5OjgAg3nzzTZGTkyNOnDghhPDd69vR8/aV69vR8/aV69vR8zZQ+vX917/+VYSHh4vs7GyTf7fXrl0z7uOta1xxwZAQQrz33nuiefPmIigoSHTp0sWkLG/SpEmif//+JvtnZ2eLzp07i6CgINGiRQvxwQcf1DjmZ599Jlq3bi0CAwNFmzZtTC4uuXDkvPv37y8A1PiZNGmScZ/p06eLZs2aiaCgING4cWMxePBgsW3bNg+ekX0cOe/XXntN3HLLLSIkJEQ0bNhQ9O3bV2zYsKHGMX3t+xZCiMuXL4s6deqIZcuWmT2eEr5vQ+m0pX+3vnp9O3revnJ9O3revnJ9O/Pv3Beub3PnDEAsX77cuI+3rnHpzwYSERERqZKicoaIiIiIXI3BEBEREakagyEiIiJSNQZDREREpGoMhoiIiEjVGAwRERGRqjEYIiIiIlVjMERERESqxmCIiIiIVI3BEBEREakagyEiUqT09HSEhIQgPz/fuO3xxx9Hx44dUVRU5MWWEZHScG0yIlIkIQQSEhKQmJiIJUuWIC0tDR9++CF27NiB2NhYbzePiBQkwNsNICJyhiRJmD9/PsaMGYOYmBi8/fbb2Lp1KwMhInIYe4aISNG6dOmC3377Dd9++y369+/v7eYQkQIxZ4iIFOubb77BwYMHodPpEBUV5e3mEJFCsWeIiBRp9+7dGDBgAN577z2sWrUKdevWxWeffebtZhGRAjFniIgU5/jx4xg6dChmzZqFiRMnol27dujevTt27dqFrl27ert5RKQw7BkiIkW5ePEi+vTpg379+uFf//qXcfuIESNQVlaGr7/+2outIyIlYjBEREREqsYEaiIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGq/T+0/mouDyXVewAAAABJRU5ErkJggg==", + "image/png": "iVBORw0KGgoAAAANSUhEUgAAAkMAAAHFCAYAAADxOP3DAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjguMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy81sbWrAAAACXBIWXMAAA9hAAAPYQGoP6dpAABWOUlEQVR4nO3deVxU5f4H8M8AMrgACoqsCpULiPu+63XLVMa8ZunNpb3UzLR71WulVuZPr5WVdctbabcuZiU6mFmZgktqmUvua6i4IK4gKAgzz++PcUYGZpiFWc6Z83m/Xrx4zTlnzjznzAzny3m+z/dRCSEEiIiIiBTKz9sNICIiIvImBkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUjcEQERERKRqDISIiIlI0BkNEErRs2TKoVCrTT0BAAKKiovDII4/g+PHjXmvX7NmzoVKpvPb6cnDq1CmoVCosXLjQ200hIjsFeLsBRGTd0qVL0bRpUxQVFeGXX37B3LlzkZGRgSNHjqBOnTrebh4RkU9gMEQkYcnJyWjXrh0AoFevXtDpdJg1axZWr16Nxx57zMutI28qKSkx3TUkoqphNxmRjBgDo4sXL5qWFRUVYerUqWjVqhVCQ0MRFhaGzp07Q6vVVni+SqXCxIkT8cUXXyAxMRE1atRAy5Yt8d1331XYdu3atWjVqhXUajUSEhKsdvsUFRVhxowZSEhIQGBgIGJiYjBhwgRcv37dbLv4+HgMHjwY3333HVq3bo3q1asjMTHR9NrLli1DYmIiatasiQ4dOuD333+3eT6M3YkZGRl47rnnULduXYSHh2PYsGE4f/58hWOfPXt2hX3Ex8dj3LhxFfa5ceNGPPXUUwgPD0dISAjGjBmDwsJC5OTkYMSIEahduzaioqLw0ksvoaSkpMJ+9Xo95s6diwYNGiAoKAjt2rXDhg0bKmx3/PhxjBo1ChEREVCr1UhMTMQHH3xgtk1mZiZUKhW++OILTJ06FTExMVCr1Thx4gRu3ryJl156CQkJCQgKCkJYWBjatWuH5cuX2zx/RGTAfymIZCQrKwsA0LhxY9Oy4uJiXL16FS+99BJiYmJw+/Zt/Pzzzxg2bBiWLl2KMWPGmO1j7dq12LlzJ1577TXUqlULCxYswIMPPoijR4/innvuAQBs2LABGo0GnTt3xldffQWdTocFCxaYBWEAIITA0KFDsWHDBsyYMQPdu3fHvn37MGvWLGzfvh3bt2+HWq02bf/HH39gxowZmDlzJkJDQzFnzhwMGzYMM2bMwIYNG/Dmm29CpVJh2rRpGDx4MLKyslC9enWb5+XJJ5/EoEGDkJqaiuzsbPz973/Ho48+io0bNzp9rp988kkMGzYMX331Ffbs2YN//vOfKC0txdGjRzFs2DA8/fTT+PnnnzF//nxER0djypQpZs9fvHgxGjZsiEWLFkGv12PBggUYOHAgNm3ahM6dOwMADh06hC5duqBBgwZ46623EBkZiR9//BGTJk3C5cuXMWvWLLN9zpgxA507d8ZHH30EPz8/REREYMqUKfjiiy/wxhtvoHXr1igsLMSBAwdw5coVp4+dSHEEEUnO0qVLBQCxY8cOUVJSIm7cuCF++OEHERkZKXr06CFKSkqsPre0tFSUlJSIJ554QrRu3dpsHQBRv359kZ+fb1qWk5Mj/Pz8xLx580zLOnbsKKKjo8WtW7dMy/Lz80VYWJgo+2fjhx9+EADEggULzF5nxYoVAoBYsmSJaVnDhg1F9erVxdmzZ03L9u7dKwCIqKgoUVhYaFq+evVqAUCkp6fbdZ7Gjx9vtnzBggUCgLhw4YLZsc+aNavCPho2bCjGjh1bYZ/PP/+82XZDhw4VAMTbb79ttrxVq1aiTZs2psdZWVkCgNXz17dvX9OyAQMGiNjYWJGXl2e2z4kTJ4qgoCBx9epVIYQQGRkZAoDo0aNHhfYnJyeLoUOHVlhORPZjNxmRhHXq1AnVqlVDcHAw7r//ftSpUwdarbZCnsg333yDrl27olatWggICEC1atXw6aef4vDhwxX22bt3bwQHB5se169fHxERETh9+jQAoLCwEDt37sSwYcMQFBRk2i44OBhDhgwx25fxzkvZbiYAeOihh1CzZs0K3UKtWrVCTEyM6XFiYiIAQz5UjRo1Kiw3tsmWlJQUs8ctWrRw6PmWDB482OyxsU2DBg2qsNzS61g7f5s3b4ZOp0NRURE2bNiABx98EDVq1EBpaanp54EHHkBRURF27Nhhts+//vWvFV6nQ4cOWLduHaZPn47MzEzcunXL6WMmUioGQ0QS9t///hc7d+7Exo0b8cwzz+Dw4cMYOXKk2TZpaWkYMWIEYmJi8OWXX2L79u3YuXMnHn/8cRQVFVXYZ3h4eIVlarXadBG9du0a9Ho9IiMjK2xXftmVK1cQEBCAevXqmS1XqVSIjIys0FUTFhZm9jgwMLDS5Zbab0n5YzJ2zVUlMHCkrZbaae383b59GwUFBbhy5QpKS0vx/vvvo1q1amY/DzzwAADg8uXLZs+PioqqsM/33nsP06ZNw+rVq9G7d2+EhYVh6NChXi3BQCQ3zBkikrDExERT0nTv3r2h0+nwySef4Ntvv8Xw4cMBAF9++SUSEhKwYsUKsxpAxcXFTr1mnTp1oFKpkJOTU2Fd+WXh4eEoLS3FpUuXzAIiIQRycnLQvn17p9rgDmq12uI5cVdujbXzFxgYiFq1aqFatWrw9/fH6NGjMWHCBIv7SEhIMHtsqcZTzZo1MWfOHMyZMwcXL1403SUaMmQIjhw54pqDIfJxvDNEJCMLFixAnTp18Oqrr0Kv1wMwXCADAwPNLpQ5OTkWR5PZwziaKy0tzeyOx40bN7BmzRqzbfv06QPAEJCVtXLlShQWFprWS0F8fDz27dtntmzjxo0oKChwy+tZO3/du3eHv78/atSogd69e2PPnj1o0aIF2rVrV+HH0l28ytSvXx/jxo3DyJEjcfToUdy8edPVh0Xkk3hniEhG6tSpgxkzZuAf//gHUlNT8eijj2Lw4MFIS0vD+PHjMXz4cGRnZ+P1119HVFSU010lr7/+Ou6//37069cPU6dOhU6nw/z581GzZk1cvXrVtF2/fv0wYMAATJs2Dfn5+ejatatpNFnr1q0xevRoVx16lY0ePRqvvPIKXn31VfTs2ROHDh3C4sWLERoa6pbX8/f3R79+/TBlyhTo9XrMnz8f+fn5mDNnjmmbd999F926dUP37t3x3HPPIT4+Hjdu3MCJEyewZs0au0bDdezYEYMHD0aLFi1Qp04dHD58GF988QU6d+5slodFRNYxGCKSmeeffx6LFy/Ga6+9hpEjR+Kxxx5Dbm4uPvroI3z22We45557MH36dJw9e9bswuuIfv36YfXq1Xj55Zfx8MMPIzIyEuPHj8etW7fM9qlSqbB69WrMnj0bS5cuxdy5c1G3bl2MHj0ab775ptmwem/7+9//jvz8fCxbtgwLFy5Ehw4d8PXXX0Oj0bjl9SZOnIiioiJMmjQJubm5aNasGdauXYuuXbuatklKSsLu3bvx+uuv4+WXX0Zubi5q166NRo0amfKGbPnLX/6C9PR0vPPOO7h58yZiYmIwZswYzJw50y3HReSLVEII4e1GEBEREXkLc4aIiIhI0RgMERERkaIxGCIiIiJFYzBEREREisZgiIiIiBSNwRAREREpmiLqDOn1epw/fx7BwcEWy9kTERGR9AghcOPGDURHR8PPz333bxQRDJ0/fx5xcXHebgYRERE5ITs7G7GxsW7bvyKCoeDgYACGkxkSEuLl1hAREZE98vPzERcXZ7qOu4sigiFj11hISAiDISIiIplxd4oLE6iJiIhI0RgMERERkaIxGCIiIiJFYzBEREREisZgiIiIiBSNwRAREREpGoMhIiIiUjQGQ0RERKRoDIaIiIhI0RgMERERkaIxGCIiIiJFYzBEREREisZgiIiIiBSNwRAREREpGoMhIiIiUjQGQ0RERKRoDIaIiIhI0bweDG3evBlDhgxBdHQ0VCoVVq9ebXXbZ555BiqVCosWLfJY+4iIiMi3eT0YKiwsRMuWLbF48eJKt1u9ejV+/fVXREdHe6hlREREpAQB3m7AwIEDMXDgwEq3OXfuHCZOnIgff/wRgwYN8lDLiIiISAm8fmfIFr1ej9GjR+Pvf/87mjVr5u3mEBERkY/x+p0hW+bPn4+AgABMmjTJ7ucUFxejuLjY9Dg/P98dTSMiIiIfIOk7Q7t27cK7776LZcuWQaVS2f28efPmITQ01PQTFxfnxlYSERGRnEk6GNqyZQtyc3PRoEEDBAQEICAgAKdPn8bUqVMRHx9v9XkzZsxAXl6e6Sc7O9tzjSYiIiJZkXQ32ejRo9G3b1+zZQMGDMDo0aPx2GOPWX2eWq2GWq12d/OIiIjIB3g9GCooKMCJEydMj7OysrB3716EhYWhQYMGCA8PN9u+WrVqiIyMRJMmTTzdVCIiIvJBXg+Gfv/9d/Tu3dv0eMqUKQCAsWPHYtmyZV5qFRERESmF14OhXr16QQhh9/anTp1yX2OIiIhIcSSdQE1ERETkbgyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUjcEQERERKRqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUjcEQERERKRqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUjcEQERERKRqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUjcEQERERKRqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUjcEQERERKZrXg6HNmzdjyJAhiI6OhkqlwurVq03rSkpKMG3aNDRv3hw1a9ZEdHQ0xowZg/Pnz3uvwURERORTvB4MFRYWomXLlli8eHGFdTdv3sTu3bvxyiuvYPfu3UhLS8OxY8eQkpLihZYSERGRL1IJIYS3G2GkUqmwatUqDB061Oo2O3fuRIcOHXD69Gk0aNDArv3m5+cjNDQUeXl5CAkJcVFriYiIyJ08df0OcNue3SQvLw8qlQq1a9e2uk1xcTGKi4tNj/Pz8z3QMiIiIpIjr3eTOaKoqAjTp0/HqFGjKo0Q582bh9DQUNNPXFycB1tJREREciKbYKikpASPPPII9Ho9Pvzww0q3nTFjBvLy8kw/2dnZHmolERERyY0suslKSkowYsQIZGVlYePGjTb7DdVqNdRqtYdaR0RERHIm+WDIGAgdP34cGRkZCA8P93aTiIiIyId4PRgqKCjAiRMnTI+zsrKwd+9ehIWFITo6GsOHD8fu3bvx3XffQafTIScnBwAQFhaGwMBAbzWbiIiIfITXh9ZnZmaid+/eFZaPHTsWs2fPRkJCgsXnZWRkoFevXna9BofWExERyY9ihtb36tULlcVjEiqDRERERD5INqPJiIiIiNyBwRAREREpGoMhIiIiUjQGQ0RERKRoDIaIiIhI0RgMERERkaIxGCIiIiJFYzBEREREisZgiIiIiBSNwRAREREpGoMhIiIiUjQGQ0RERKRoDIaIiIhI0RgMERERkaIxGCIiIiJFYzBEREREihbg7QYQERGRBOl0wJYtwIULQFQU0L074O/v7Va5BYMhIiIiMpeWBrzwAnD27N1lsbHAu+8Cw4Z5r11uwm4yIiIiuistDRg+3DwQAoBz5wzL09K80y43YjBEREREBjqd4Y6QEBXXGZdNnmzYzocwGCIiIiKDLVsq3hEqSwggO9uwnQ9hMERERESGuz0bNti37YUL7m2LhzGBmoiISOksJUxXJirKve3xMAZDRERESmZMmLaUJ1SeSmUYVda9u/vb5UHsJiMiIlKqyhKmy1OpDL8XLfK5ekO8M0RERKRUthKmy6pbF/jb34CwMEMQ5UMBEe8MERERKZW9idDBwcClS4a7Qr17A/HxPlVviMEQERGRUtmbCH3jhvljHyvAyGCIiIhIqbp3NyREG/OB7OVjBRgZDBERESmVv79hvjHAuYDIRwowMhgiIiLyNJ0OyMwEli83/Pbm3ZVhw4BvvwViYsyXh4XZ93wfKMDI0WRERETuptMZ7qBcuAAcPw785z/SmhF+2DBAo7nbxqgoQ5v79rX9XB8owKgSwp7iAvKWn5+P0NBQ5OXlISQkxNvNISIiJbGnurOxi+rbb70XEJWn0xlGjZ07Z7kOkbEAY1aW24bZe+r6zW4yIiIidzFWd7ZVy0eKCcmV5RP5WAFGBkNERESOsDffx5HqzoA0E5Kt5RPFxkrrLlYVMWeIiIjIXpa6vKzl+zhS3bksqSUkW8on6t7dJ+4IGTEYIiIisoe1CU2NBQjL3ylxNqiRYkKyvz/Qq5e3W+E27CYjIiKypbIuL2v5Po4GNSoVEBfnczPCO0tfqsfOzw955LW8Hgxt3rwZQ4YMQXR0NFQqFVavXm22XgiB2bNnIzo6GtWrV0evXr1w8OBB7zSWiIiUyVaXl6V8H0eqO/tYQrKzbl29hTWv/Ianmm5GtPoy+k5K8sjrej0YKiwsRMuWLbF48WKL6xcsWIC3334bixcvxs6dOxEZGYl+/frhRvl5UoiIiAD3FDS0t8ur7HaOVHf2sYRkR1w6fBnLntyKB6N3oG64HilvdMAnR3vgoj4CwcjzSBu8njM0cOBADBw40OI6IQQWLVqEmTNnYtidD8jnn3+O+vXrIzU1Fc8884wnm0pERFLnSIKzI+zt8iq/nXE0lqU2PfUU0KiRTyYk23Lsxyykv38a2i11sC0/GXp0M62L8z8HTdIJpIyqhdZjGqJeTCU7chGvB0OVycrKQk5ODvr3729aplar0bNnT2zbts1qMFRcXIzi4mLT4/z8fLe3lYiIvMzRBGdHGLu8bBUgtJTvo4DRWLbobuvw69JDSF96Bdo9cThy+14ACab1rasfhqbjRaQ8HYlWDzeBys8QAXnq+i3pYCgnJwcAUL9+fbPl9evXx+nTp60+b968eZgzZ45b20ZERBJiK8FZpTIkOGs0zgUhxi6v4cMN+yr7Ovbk+/j4aCxLbl6+iZ/f2Y/0b29jzfGmyBXNTesCUILeYfug6VOAIS/ehwadEwEkeq2tkg6GjFTl+lqFEBWWlTVjxgxMmTLF9Dg/Px9xcXFuax8REXmZIwnOzgYllXV5LVrk2XyfsnOdWbvTZM82LpZ78BK+W3gE6T8E4qec5riFjqZ1ocjDAw0PICVFhYEvNUNog7ZubYsjJB0MRUZGAjDcIYoq0w+bm5tb4W5RWWq1Gmq12u3tIyIiiXAmwdkZUujysicvyl25UxYcXfcntO+fQfrWMGy7kQyBu12FDfzPQtPsJFL+Fowe45MRWKurS1/bVSQdDCUkJCAyMhLr169H69atAQC3b9/Gpk2bMH/+fC+3johIBrxwd8ArnE1wtqay8+bNLi978qIA9+VOwZD/s+PTg9AuvYr0Pxrg6O17ANxjWt+m+mFoOl1EyjNRaPlQY6j8Yp1+LU/xejBUUFCAEydOmB5nZWVh7969CAsLQ4MGDTB58mS8+eabaNSoERo1aoQ333wTNWrUwKhRo7zYaiIiGfDg3QGvq0qCc3lSPW/25EUZ17s4d+rm5ZtY//Z+aL+9je9ONMUl0cK0rhpuo3f4Pmj6FmLIi40Q19G7+T9OEV6WkZEhAFT4GTt2rBBCCL1eL2bNmiUiIyOFWq0WPXr0EPv373foNfLy8gQAkZeX54YjICKSoJUrhVCpjJfFuz8qleFn5Upvt9D1jMdc/rgdOWYpn7eMjIrtcvYnI8Pmy108kCs+GbtZpETuENVRaPb0UFwXoxpuFV9N+kVcP33dbYfsqeu3Sgh7p9OVr/z8fISGhiIvLw8hISHebg4RkXvpdEB8vPWEYuNdkqws3+sys3RXJy7OvgRnqZ+35csBV/WKpKYCI0dWWHzk+zv5P7+EYfuNZIgytZkb+p+FJvlO/s+E5qhWo5pr2lIJT12/vd5NRkRELuaJkVVSVZUEZ6mfN1dO4HpnX7rbOmz/xJj/0xDHSszzf9rWOARNp1ykPBOFFsPlkf/jDAZDRES+xlMjq6TK2QRnqZ83e/KiYmIM686ft7qNPioG6esCkf70Fnx3oimuiGboji1ogx2IwwkEhoVgSP9iDJnSCLHtkwB4Zn4wb2IwRETka1w9skoppH7e7Cn8aJwLzcI2AgCEwKjzC7BiQRcAwINIw/t4HjE4f3dfNWKBh94F2vdw7/FIiNcnaiUiIhezNVu6SmXIo7FnZJWSyOG8GQs/xpSbsKvsRK/DhkF8/Q1Kwszr8WUjDn/FSqzASMQHZOPT+NexEsMRXTYQAu4OwU9Lc/PBSAcTqImIfJGxHg1g+Q6CN2dIl3LtIymft7IsnEOdDti25AC0y64hfV9DnCxpgO7YgihcwAVE4Vb1cAzpcgUpz0ajueYeqO5JkG6y+B2eun4zGCIi8lVVGVnlyTbZW8PHU0GUFM+bFYW5hfjprf3QrizFd38m4ooIN60LRDH+UncfNP1uYciURohpV6Z7LzMT6N3b9gtkZHg1yZ6jyYiIqGqkMHVEWVWZVd6ThRCldt7KydmXizULj0D7YxB+zm2BYnQyraujuoZB8QehedAfA6YmIzi6veWdSD1Z3MN4Z4iIiNyvKjV8rAVRUuu6chOhFzj83UloPzgL7S918Wthstn6hIAz0DTPgmZMKLo+3cy++j+8M2SGwRAREbmfsxdfqRdCdJPSolJs+89BaD+/hvR98ThREm+2vn3Ng9B0vgTN+Bg009wHlZ+VpG9rjOfV1vQlCskZYjcZERG5n7PdMlIvhOhCBTkF+OntA9CuLMXarERcES1N6wJRjD717uT/TG2M6DbNqvZi9gzTX7TIpwLMyjAYIiIi9zEmPR86ZN/25Wv4+Hhuy4W9F7Fm4VFof6qODZeam+X/hKmuYlDCIWiG+aP/i5Xk/zjLOEzfUi6WBJPF3YnBEBGRnEh5WHr5tl26BEyZUvmdHSNrs8pLvRCig4Re4NCaO/k/2+rit8JkAHfrAd0TcBqaFlnQjKmNrs8kIyCom3sbJPFkcU9hMEREJBeeHFHlKEtts1dl3TL2TkGh0xkmMpXgxby0qBS/fHwA2v9eR/q+BJwsvQ/Afab1HWoegKbLZWgmxCJpyL1Q+TX0bAOdnb7EhzCBmohIDqQ8ospa2+xlq4ZPZYUQhQDCw4ErV+4ul0CAeOP8Dfz0zgFo03RYm5WEqyLMtE6NIvSptx+a/rcweEpjRLeJNH+ylO/+eRhHk7kQgyEikjUpj6iy1bbKvPwy0KePfRd7S3eeygdBRl4KEM/vzsGat45Bu746NlxqgdtQm9aFqa5icMIhaP4agP5TklErspblnUj57p8XcDQZEREZSHlEla22VSYpqfL2lr9DcvIksG2b4XFEBDB2rOXnCWEIiCZPNuTDuClAFHqBg9oT0H54Dtrt9bCzsBmAu3d57g04DU3LLGjG1kGXp5rZzv+pSlFKqhIGQ0REUiflEVVVec3Kkp4ru0MycqShbtG5c9af76YAsbSoFFs/OgDtf/OQvj8ef5Y2AtDItL5jzQPQdDXk/yQOdiD/R6czHK+lzhoPBXdKxmCIiEjqpDyiypnXtDZyzMieOyTFxfa9lgsCxBvnb+DHtw5Au0qHtaea4ZpoZVqnRhH6RuyDZkARhrzUFJEtkq3vqDJSvvunAAyGiIikzp4RVZUFF95sW3m2CvrZe4dk6VL72udkgHh+dw7SFxryfzZeboHb6GxaF666gsH3HDbk/0xtjpoRHZx6DTNSvvunAAyGiIikTsrVgitrmyW2CvrZe4fEuC8XBYhCL3Bg1XFo/30e2u0R+P1mEsrm/9xX7RQ0LU5BM64OujyRCP9fS4EL2cChIiDcBaO9pHz3TwEYDBERyYGUqwVba1tcHPD220DduvYPE7f3zkdubpUDxJKbJYb8ny/ykX4gAVmljQE0NuwCenSsdRCarlegmRiHpg/cA5VfvKELr/Fg14/2kvLdPwXg0HoiIk9wVe0YKdegcUXbHJ3Q1VKidfm6RWXaVRgQgu9/CYVWq8L3p5NwTdQxPS0It9A3Yj809xdj8NQmiGwRYf6a7q71VFk9JVfsX4ZYZ8iFGAwRkVf5cu0YVwdnzsymXlkb0tJQ+txEBOTeveOUjVi8gHexCsNQV3UZg+89DM3wQPR7MRk1I2pW3i5313qyJ7hTEAZDLsRgiIi8RsqVo6vKXUGevXdIrARBQi+w79tjOPb6Cvz1wGwAAn5ldq+HCioIHHnqLTRe/AL8A+0IXhy9Y1UVUr7752EMhlyIwRAReYWUK0c7ytIkrA8/7N4uo8rukFhYXxQagf/Vnog3zo3DmdJonEI8YnDWLBAya6cj5375cmDUKNvbpaYa6iCRS7ACNRGR3PlK7RhLgYm/v3sLBFY2m/qdO0dCCKjKPCUw7xIey5uFtWiGRqiJOLjw3HO0l09jMERE5C6+UDvGWjefTmf9Oa4K8izMpp69LRt1Hn0WNcsFQgDgBwE9gC+Dx8N/wZvAc3a8hr3nnqO9fJrFu4dEROQCcr+bUFkBRHu4IMgTeoG9K47itb9kom2Nwxjd9SRq3bpUIRAy8gNQ48ZFqIvy7XsBe8+9sZ4ScLcr0MjbtZ6oyhgMERG5i/FuQvmLp5FKZciDkerdhKpMwgo4HeSV3CzBzwt2Y1LLTUgIPIfWjzTBrIxe2H0rEdGoZD6ysurVc/25N9ZTiokxXx4bK+9EeGI3GRGR20i5crQ9nL2z40SXUd6ZPKxbeBDp6QLfn05GHtqY1lXHTfSL3A/N/bfxYI+awON27DAmxj3nvrJcJiXw0ZFuDIaIiNxJypWjbV3YnJ2EFbAr0Diz/RzWvHMC2g21kHm1OUrQxbSunuoShtx3BJqHAtH3xeaoUbfj3Ta/amfujr+/e869hVwmRfDhelkcWk9E5AlS+4/angubrQKIgOEYyiZTV1Ig0Jj/k74kB9pf62PPrUSz9U0DTyKlVTY0j4ej42NJ1uv/OFqpWWrnXo68VC+LdYZciMEQEVEZjlzYbAUeX39d6dxjtwtuY9Pi/UhPLUD6oXtxRhd7dxfQo2vIfqR0uwbNpIZoPCDBsWNgpWbP8GK9LAZDLsRgiIjoDmcubA4GHtdPG/N/gO/PNEM+Qk3rquMmBkTtQ8r9JRj890TUS6xbtWPhHR/382T17XJYdJGIiFzPmUKQdiQNn9l+Dulvn4B2Yy1kXm2B0jL5P/X9cjGk0RGkPBSEvi82R/WwTq45FqXm7niaL9TLsoHBEBGRO0nt7oWzF7ZygYfQC+z532Gk/+citL9FYu+tpgDuDjlPDDwJTZtspDwWjo6PN4NfQI+qt528Q+71suzAYIiIyF2kOPqmChe22wW3kfn+fqQvL0D6ofuQrUsEYEiC9oMOXUMOQNPjGlImxaNRv3sB3Gvfa0ktYCRzCqi+zZwhIiJ3kOps9bZGiJXLGbp+Og/fLziA9DUqrMs2z/+pgUIMiNoPzaBSPDClqXP5P1IMGKkiR0fwuQgTqO8oLS3F7Nmz8b///Q85OTmIiorCuHHj8PLLL8PPz74C2gyGiMijpD5bvY0LW+4bH+OrXY2RnhGMTdeaoxTVTJvU98tFSmND/k+fyc1RPax61dshtYCRLPPCCD4GQ3fMnTsX77zzDj7//HM0a9YMv//+Ox577DG88cYbeOGFF+zaB4MhIvIoL46+sZuFC9t1dT28pn8F75Q8b7ZpkvoENG3OIuXxuugwLgl+AS6YyUnqASNZ5uEuTY4mu2P79u3QaDQYNGgQACA+Ph7Lly/H77//7uWWERFZIYPRN8V9ByHz6Rgc+mwHTpyuhoMiCVuKu0MPf/hBh26h+6HpeR0pkxJwX5/7ANzn2gY4M6qNvM9HR/BJPhjq1q0bPvroIxw7dgyNGzfGH3/8ga1bt2LRokXebhoRkWUSHX1zLes6vv/XQWjX+OGHs81wAx0BGKa5qIkCDI3eacj/mZqIuk1aubcxMggYSTkkHwxNmzYNeXl5aNq0Kfz9/aHT6TB37lyMHDnS6nOKi4tRXFxsepyfn++JphKRklTWXSCh0Tentp6F9u2TSM8MxqZrLaBDV9O6SL+LSGl8FCkPV0efyc0RVNtF9X/s4a6AkSPTyBlC4pYvXy5iY2PF8uXLxb59+8R///tfERYWJpYtW2b1ObNmzRIAKvzk5eV5sOVE5LNWrhQiNlYIQ6hj+ImNNSwvu41KZfgpu51xWdltHVVaKkRGhhCpqYbfpaWmVXqdXuz8/KB4uVuGaBF0xOylASGaqY+Jf3bJEDs+2S90JTrn21BVpaWGc1b+/JQ9T3FxZsdmkz3vC8lKXl6eR67fkg+GYmNjxeLFi82Wvf7666JJkyZWn1NUVCTy8vJMP9nZ2QyGiMg1jEGOpYt3+SDH0sU5Lq5qF2cL+9RHx4jdj8wXzyZtEjF+581ezg+lomfoHvG2JkOc2HCq6sfvSq4MGB15X0g2PBUMSb6b7ObNmxWG0Pv7+0Ov11t9jlqthlqtdnfTiEhpdDrDCCxLXV9CGLq/Jk82TF3h72/XNBYOsTIUXZw/j5ZfTcdFfItz6IGaKMD9MfuhGazDA1OTEN6olXOv527DhhmGz1uqM+TIcG173pcXXgBCQ4HcXHafUQWSH1o/btw4/Pzzz/j444/RrFkz7NmzB08//TQef/xxzJ8/3659cGg9EbmEN4fM63QojYqD/6ULUFlYrYcK1wPq4deZWvSe3ApBtYPs3q/Xc2x0OsO5zcw0PO7Vy/BjbzvsfV/KYmFHWeDQ+jvef/99vPLKKxg/fjxyc3MRHR2NZ555Bq+++qq3m0ZESuPhEVD6Uj12/e8ItP/JxfnfsvFZifX9+kEgrDQXA3sVAfYGQu6u/mxvoKXVmrfjjTcca4cz5/vcOcNdNhZ2JED6CdSu4Kk+RyLycRkZlpN9y/9kZDj9EkV5ReL7Ob+JZxI3iegy+T+PINW+105Nte+F3J1jY28ysyvaYe/74ookbfIoT12/Jd9N5grsJiMil3BwXi97XT15DWv/dRDa7/zx47lkFCDYtK4WbuD+mAN4us3v6Ldmku2d2dNF5+7qz/ZOs+Gqdth6X2zxZiVwqpSnrt8uqKlOROQEY57I8uWG3zqdt1tkm7+/oesGuHthNzI+XrTIrgDiz8wzeGdoJnrV3ouI+4Ix5uNuWHmuMwoQjGi/C3g2aTPWvf47LucF4puzndFv1XhDYFD+dcu+flycfbWLHKn+7ChbycyAIcnc2IXminZU9r7Ywx2FHeX4+VYwh3KGsrOzERcX5662ECmTFBJYPU3OM5U7OQJKX6rH718chvaTS0jfFYMDxY0ANDCtbx50DJp256F5KgJtRjWFX0C5YoPGC/7w4YYLvqWZw+0MxNya++RIgFPVdpT/7qxYAUyZUvnrW+LqSuBy/nwrlSN9ajVq1BAvv/yyKCgocE+nnZswZ4gkS4lF4nylHoylwofllt26XCDWzv5NPN10k4jyu2B2uP4oEb1r7xaLHswUf246Y//ruqJ2kTtzn1IdyG2qSjusfXe++ebue/Dzz64v7GiLr3y+JUKSRRd/+eUX0aFDBxEVFSU+++wzd7XJ5RgMkSQp8Y+mseqwLya0Wrg4ZyNGPIiVpkW1kC8eit0mvnxuq7j65zXnX6uSCtR2P99dQYIjAY6z7XC08KW7KoGX58ufby+RZDBk9Pnnn4vY2FjRqlUrkVGFUROewmCIJEepfzQ9MBrLGy7M/kjoAaErdxw6qIQOKvFx3Ovihzd2iqK8Im839S53BQmOBjiOtsOZ7447KoFb4qOfb2/y1PXbqQTqMWPG4NixYxgyZAgGDRqEBx98ECdOnHBd3x2RlLkiMdKdCaxS5iMzletL9fj10wP4Z5dMNFcfRcnsNyBQcUSKHwRUKuBpLMGA6a2hDpFQZXxj7lNMjPny2Niq1d5xNMnc0XY4890ZNgw4dcowaiw11fA7K8v1+Ts+8vlWIqeLLgoh0L9/f9y4cQPvvfce1q1bhwkTJmD27NkIDg62vQMiOXJVYqRS/2i6a6ZyD7h19RY2vncA2hW3sOZYE+TokwEAPZGJOFi/OKvKXpylNnzb1dOFlN2vI0nmjrTD2e+Ov7/7z7+MP99K51Aw9NFHH2Hnzp3YuXMnDh8+DH9/f7Ro0QITJkxAq1at8L///Q9JSUlYtWoV2rVr5642E3mHtdopzlSyddUfTbmNROve3XBBtFWnx57h4R5w+egVrF14GNq1AfjxQnPcRHvTumDkY2DcAUxqmgmst2NnUg1s3RUkOBpo2dsOKQccMvt8UxmO9KnFxsaK4cOHi4ULF4qtW7eKoqKK/d9z584VzZo1c1U3nkswZ4iqzNU5Pq5IYJXrSDRPJrQ64fjPp8TCwRmie8he4YdS89Prf06MT84UP775+938H+aJeJY7k79dQeKfb7mRdAJ1ZXJycoSfn5+rd1slkg6GqjoqhDzDHRe8qvzRlPtINE8ltNpBV6IT2/+zX0zvlCESA09UOKUtg46IV3tkiF1fHhJ6nb7iDqR+cS7bTl/5WyP1gENCn2+5k20wpNfrRWZmpqt3WyWSDYbk+p+9EjlSO8URzvzR9NRINHdfPL14cb555aZY88qv4skmm0R9v4tmpy8At0WfOrvEe3/NFKe2Ztu3QzlenOX+t0bqAYcvBZ9exLnJXEiSc5PZO3cPSUNmJtC7t+3tnJnjyFbeT/n1Oh3Qt6972mLkgxV0Lx+9gu/+dRja7wPw04XmuImapnUhyMPAuIPQaICBLzVD7Yahjr+ApXMWF1dpVWqP8OW/NXLLmSOHeer6zWDIG9w9SSK5npsm6LTJ0gU2LAy4etX2c1NTgZEjnXtNH7l4Hl9/Ctp3T0G7pQ625SdDj7vvTZz/OaQknYBmVC30nNgcgbUCq/6CUrs4828NyZynrt9OD62nKnCkTobUhuIqlSvnhbKXtaDEnkAIcG40ja1JNlUqwySbGo0kL576Uj1+/ewgtJ9dgXZPHI7cvhdAvGl96+qHkdLhIjTPRKLVw02g8ouxui+neGL4tiP4t4bILgyGvEGpNWbkzskJOp1SWVBiS1WG78rw4nnr6i38/M5+aL8uxprjTZErmpvWBaAEvcL2QfOXAqRMuQ8NOicCSPReYz2Nf2uI7MJgyBukXCeDKueuInXl2QpKrLHnLlVlXTmuuHh6oKso9+AlrH3rCLTrAvFTTnPcQgfTuhDk4YEGd/N/Qhu0delrywr/1hDZhcGQN7Awl7x5oivE3qCkfP6QrbtUthKjq3rxdGPi9dF1fyJ98Rlot4Rh241kCNz9fjTwP4uUpJPQPBqMHuOTEVirS5VeyyKp5QPZg39riOzCYMgbvJF/IjdyvPC4kr1ByddfG86LPefJngraOp3h+dbmW6vs4unKCt0AdLd12PHpQaQvuwrt3gY4evseAPeY1repfhgpHS9C82wUWj7UGCq/2Ep2VsXPk7uCPHd/zpXwt0bpfyvINdw6cF8iZFVnSEp1MrzFF2uiOMrVhfzsqU0UHm67jpK1mjkuqn1UeKlQaP+5QzzeaLOop8o120U1FIv+4TvF4ocyxZkd5+w/lytXChETY96emBj7P0/uKnDpyc+5s/WspF4nh38rfJ5siy5KkWSDISHk8QfHk+ReWdmVXFnIz94K2pX9+PsL8c03Vdu/hQrdFw/kik/HbRZD6/8i+mOdeASpoicyhB9KRSiui1ENt4qvJv0irp++7tw5rKw9ts6huwpceuNz7sjfGjkEGfxboQgMhlxI0sEQ3eWpyspy4qq7h/ZW0HYimHFo/3cqdB9ee1LMH5ghugT/IVTQiQexUpyB+XHeCo0QJakrnD93paW273aFh1f+eXLHNCxS/5zLIciQ+jkkl/HU9dvPm110RGYcGdatFMOGAadOGapJp6YafmdlOZ6n4qrRQtYSu+3c/0dzLqJJYBYSB92Daet6YduNFhiK1fgWwxEL8/c+KP8SAv72iCFfxxmZmcCVK5Vvc+WKYTtr3DE03Vufc53OcKzLlxt+W8oLs1VnCjDUmbKWU+Yp/FtBLsZgiKSDNVEsM45eGznS8NuZ5FDjqCJj0qyzrAU9NvavhwpnEIcJR5/HsZIEVMNtDAj/HR8+tBFfR0yEHwQqPLOqF9/Kghx7t3PH0HRvfM7T0gyVqHv3BkaNMvyOj68YaMolyODfCnIxBkMkHayJ4j7GUUVAxYBFpTL8hIdbD5ZUKsM8W9aGYN/ZvwBQ/p6C/s7vmZiLRxruwIrJ23A5uwg/XG6H58b7ISC3kguWty++toJIW+fFEk9/zo2j/MoHOcZRfmUDIrkEGfxbQS7GYIikwx0XHrmyp0vDUcYK2jHlpqCIjTUsX7LE8NhSsARYHIIt9AKHvzuJ+QMz0WVsI/xLTIUO5e9c+SG712h8VvgI/neqK0a80wUhsXfmGHLnxdfeWlCVbWcriAQcH5ruyc+5o91ecgky+LeCXM2tGUkSwQRqGXHlCCq5cvdInspGFdmRsF1aXCo2v79XvNQuQzSq9qdpswexUuigEjpHEm/dkaBc9jirmkDtwHlxiKc+546eX1eXdHAn/q1QBI4mcyEGQzKj5PpLUhjJYyFYKrhYINL+sV2Mu2+zqKu6ZNa0QBSJB8K3ixvV6wm9o6N73H3xrerQehvnpUo88Tl3cJSfqV1yCTKU/LdCITx1/VYJYen+qW/Jz89HaGgo8vLyEBIS4u3mkD2UWFVWpzMktVpLYDVWf87K8si5yNmXizULjyD9xyD8nNscRahuWldHdQ2D4g8iZag/BkxphpATuw1JubZkZFTsljLmtADm3TnGLhAHK1dX4MYpQqrM3Z/zzEzn3hdL5ywuzvUTEruCEv9WKIinrt8MhoikwtkLl4sY83/SPzwL7S/h+LWgGUSZtMKEgDPQNM9CyqMh6PZsMqrVqHb3ycuXG0Yp2ZKaahgVV567L75KvWAaA2xbc5NZCrCVes5IUjx1/ebcZERS4YWRPKVFpdj2n4NI//watPvicaLkPgD3mda3r3kQms6XkPJsNJIfbASVXwPLO6pq4u2wYYBG476Lrycm15WiqsxNptRzRorEYIhIKjw0kqcgpwA/vX0A6Wml+O7PRFwRLU3rAlGMPvX2QdPvFga/2Agx7ZrZt1NXzI7Oi697GEcRWuoqlGK3F5EXsJuMSCqq0qVhw4W9F7Fm4VGkrw/Cz7ktUIwg07ow1VUMSjgEzTB/9H8xGcHRwc613925P1Q17PYiGWI3GZHSVKVLoxyhFzi05iS0H5xF+ra6+LUwGUB90/p7Ak5D0yILKaNro9uzyQgI6lb19vMOhLTxzhuRVbwzRGQPT/5X7WQycWlRKX75+AC0/72O9H0JOFna0Gx9h5oHoOlyGSnPxaCZ5j6o/Ko4NYc1vANBRC7C0WQuxGCIqsQbQ7PtDCgKcgrw41v7oU3TYW1WEq6KMNM6NYrQp95+aPrfwuApjRHdJtI9bSUichMGQy4k62CI/2V7lzEPpvzXxIt5MBf2XkT6v44ifX11bLjUvEL+z+CEQ0gZ5o8BU5ujVmQtj7aNiMiVGAy5kGyDISkXi1MCiRRBFHqBg9oT0H54Dunb6+K3wmSz9fcGnIampSH/p+szyQgIYiogEfkGJlArnbU7EsaZpjkyx/22bLEeCAHmM6q7ODG1tKgUWz86AO1/85C+Px5/ljYC0Mi0vmPNA9B0vYyU8bFIGnIvVH4Nre+MiIgqJYtg6Ny5c5g2bRrWrVuHW7duoXHjxvj000/Rtm1bbzfNPWzNNK1SGWaa1mjYZeZOHi6CeOP8Dfz41gGkrzbm/7QyrVOjCH0j9kEzoAiDpzRBVKtk6zsiIiKHSD4YunbtGrp27YrevXtj3bp1iIiIwMmTJ1G7dm1vN819vHhHQjY8kUvlgSKI53fnIH3hMaT/XB0bLrXAbXQ2rQtXXcHgew5D89cA9HsxGbUiOzj9OkREZJ3kg6H58+cjLi4OS5cuNS2Lj4/3XoM8wQvTMsiKp3KpXFFVuRyhFziw6ji0/z6P9B31sLOwGYC7o7zuq3YKmhanoBlXB52fbOaa+j9ERFQpyQdD6enpGDBgAB566CFs2rQJMTExGD9+PJ566imrzykuLkZxcbHpcX5+viea6joempZBljyZS+WiIoilRaXY8uF+aL/IR/qBBGSVNgbQ2LAb6NGx1kFoul5ByvhYJA6+Fyq/eNe0n4iI7CL50WRBQYZhw1OmTMFDDz2E3377DZMnT8bHH3+MMWPGWHzO7NmzMWfOnArLZTOazJ5pGerWBd55B4iJUc5we2+N7nKiCOKN8zfww8ID0K7S4/vTSbgm6pjWBeEW+kbsh+b+Ygye2gSRLSJc11YiIh/CofV3BAYGol27dti2bZtp2aRJk7Bz505s377d4nMs3RmKi4uTTzAEWL8DYolShttnZgK9e9veLiPD9blUduQonfv9AtLfOg7t+hrIuNIct6E2rauruozB9x6GZngg+r2YjJoRNV3bPiIiH8Sh9XdERUUhKSnJbFliYiJWrlxp9TlqtRpqtdrqeqd4o/hhWBhw5Yrt7ZQy3N6buVQW5nUSeoH9aYb8H+2OCOy6mQTgbtdlo2pZ0LQ8Dc1jYej8ZDP4B9qfW0RERJ4j+WCoa9euOHr0qNmyY8eOoWFDD9ZV8XTxQ0fuCgHKGW7vjVyqckFwSdtO2LLksCH/5+A9OFUu/6dTrYPQdLsCzfMN0OT+BKj8ElzXFnItVncnojsk3022c+dOdOnSBXPmzMGIESPw22+/4amnnsKSJUvwt7/9za59VOk2m6enY7CVF2OLO7qIpMKeXCpX5gxZCILPIRovYBEuox6icAFXEIYaEcEYMlCHwS81Rf3kelV/XXI/VncnkgWPzSAhZGDNmjUiOTlZqNVq0bRpU7FkyRKHnp+XlycAiLy8PMdeuLRUiNhYIQyX3oo/KpUQcXGG7VwlI8P669nzk5rqurZI0cqVhvOuUlV8L1Qqw3oXuDT/E6EHhL7c+dVZWCZiY132uuQBxs+Qpe+zCz9DRFR1Tl+/HST5O0Ou4HRk6Y2E3eXLgVGjnH++L98ZMnJidJctQi+w79tj0H50AWu210Va0UDE4Cz8LG0LQFV2gb13Cdkt430SmW+OiOzDBGop8EbCrrP5Lk4UAJStYcMMuVFVDCxKbpZg8wf7of3yBtIP3ovTuiYAmqAnMhEH692UqvIL7MnZYreMNLC6OxFZwGCoMt5I2LVV9bgydhQA9BkWRnfZI+9MHn546yC0WoHvTycjD21M66rjJvpF7seLjTOAzQ7uuLKLKCfdlQ5WdyciCyz1ApCRMTBRVbgXYKBSGbpnXHk3xlj12BGxsbygViL71/P4YMQm9A/fhXoNq+OR97pg+emuyEMo6qku4fFGW6D956+4fAnQXuiIXnPs6Bq1pvxF1Naku4DhjpJO5/xrkv1Y3Z2ILOCdocryOFw0HYPDhg0zBDflu1UsmTMHmDlTOXeE7CD0An98Y8j/0f5aH3tuJQKINq1vEvgnNK3OQPN4ODo+llSx/k9V7s6Vv4iyW0Za3DDfHBH5ALemZ0uE1Wz0lSsrjhazNDLI0nZxce4fdVJaahhdNnmyEPXqef71ZeR24W2xfv4uMbF5pmjgn20+SAg60TX4D7HggQxx5PuT9u3Q2qg1R0cWpqZyFKDUeGhEIhFVHUeTuZDFbHRH6wd5eySQt19fgvLO5GHdwoPQaoF1Z5ohD6GmddVxE/0j90Mz8DYG/z0R9RLrOv4ClpKeLalsNJk3pxBxF1/4LLphRCIRuR7nJnOhCieTw2tl68z2c0h/+wS0G2sh82oLlKKaaV2E6hKGNDoCzQg1+r7YHNXDqlvfkb0X9PLbXb4MvPii/RdRTxeKdDdfGhXnC0EdkY9jMORCFU6mL/637qOEXmDviqPQfpwD7W+R2Hurqdn6xMCTSGmdbcj/ebwZ/ALsGBNQ1Qu6oxdR411IwHLemVyS3z1djZ2IFI/BkAtVOJn2FjZMTQVGjnR/A8nM7YLb2LR4P7SpBUg/dB+ydTGmdX7QoWvIAaR0vwbNC/Fo1C/esZ1764Iu924Z3k0lIi9g0UV34vDaynmh++D66TL5P9nNkI+2pnU1UIj+UfuheaAUg6Y2Rb3Els69iK1h7u6c7NZFhSK9hqPiiMiHKTMY4vBa6zyYE3L6l7NIf+cktBuDselac5Sii2ldfb/cO/k/QegzuTmqh3Wq+gt6+4LuZKFISWCxQiLyYcoMhrxVP0jq3FwpWegFdqceQfp/LkL7WxT+KGoCINa0Pkl9Aimtz0LzRF10GJcEv4AeTr+WRbygO493U4nIhykzZ8hI7nkcruSmnJDbBbeR+f6d/J/DjXBWd7f4oR906Ba6HyndryNlkhP5P45i4rzzfG1UHBHJAnOGPEGjAUJDDRdJwHAB7NVLmX/MXdiFdC3ruiH/Z40K67KTcaNM/k9NFGBA9AGkPFCKQS8lom6TVq5pvz3YPeo83k0lIh+m3GDI0l2hZcvkWS/FFarYhXRq6538n4xgbL7WHKXoaloX6XcRKY2PIuXh6ugzuTmCarsg/8cZvKBXjbVpYmJjgbfeAsLCDCM15ZYcTkSKp8xgiLOIV2RvrkdEBABD/s+uLw8j/ZNcaHdGYV+5/J9m6uNIaXMOmifqov3YJPgF1HdDo51Q2QVdid2jjrI0Ks5SIUq5FmIkIkVSXs5QzZq+Xy/FmaHxtnJC7rgVXA9f1J6E1849gXP6uwGUH3ToHrofKT2vQ/NCAu79S0MXHYybsPqwa7AQIxG5EYsuupDZydy927eTaKsyNN5apeQy9DBc5IbjW/yE/hgQfQCaQaUY9PckhDcKc8URkFywECMRuZmngiE75i7wMb48vNoYzJS/OBm7/9LSKn/+nS6k0rrWu7T8IKCCwP9CxuPyZRVWnuuEMUu6MRBSIkeS7omIJEx5wZCv1kuxVV1ZCMN6na7Can2pHjs/P4RXumeixd+S0f/Sl5W+lApA9fyLCNq/s+ptzsw0JN1mZlpsG0mYL/9jQUSKorwEal8dXm3rv3TAsH7uXODVV1GcX4yNi/YhfcUtpB9phPP6JABJAIBR+M2+16zKRc6XZj9XKl/9x4KIFEd5wZCvDq+2MzARs2Zh4bvV8NrViShAe9PyWriB+2MOIGWwDindQoDRduzM2YscR/P5Bl/9x4KIFEd53WTA3eHVMTHmy2Nj5XshtjMwEQAevvpv3EQNRPtdwLNJm/H9nJ24dK0avjnbGaM/6obQkYMM58IYHJanUhkqdTtzkbPVnQcYJktll5n0Gf+xACp+VuT8jwURKY7yRpOVzUb3peHVd0b2iLNnYSWEMXNk2lI0fmMM/AKsxMPWRpZVdcg0p8TwPZzWhojchNNxeIKcZxEvo+h6ETa+ux9nxDN4Gq/YFQw1bakGrAVCgPuKEzLp1vdYKsQo538siEhxlBUMGUcv+cAf7CvHr2Ltvw4h/Xt//HCuOQrRHkB7nIMer2OW7R3Y063mjoucVJNufekuoTf4yD8WRKRMyuomi45GyPnzd1fIbPTSyY2noX03C+mbamNrXjJ0ZWLZGL8LSEk8jpQRagz4+K9QnT9neSfeLoQnxdnPObKNiEiSWIHahUwnE4DZqTSOJpszB2jUSHJ3BIz1f7SfXkb67hgcLG5ktr5F0FFo2l9AypMRaPtoIlR+dzrI3JXv4ypSal9aGvDXv1ZcLpVzRUSkYAyGXMhqMGSJl+8IFF0vwoZF+6FdcQtrjjVBjv5uNWh/lKJnnX3Q9L6BIS/cg4QecdZ3JPWkVim0T6cD6tcHrlyxvN7bd9GIiBSOwZALORQMeeGOwOWjV7B24WFo1wbgpwvJKEQt07pg5GNg3AFohggMfKkZ6iTUtn/HUs+D8Xb7XnsNmGVHfhVHthEReQWDIRdyKBgC7LsjUMUL+YkNp6FdlIX0LbWxNa859Lj73Fj/84b8n0dqotfzzaEOUdu9X7KTTgdERABXr9reNjUVGDnSta8t5SCViEgiOLTem8pOMGnpjoATCbf6Uj1+W3Yn/2dPLA4V3wegoWl9y6Cj0HS4gJSn6qPNqKZQ+UW79pjI3JYt9gVCgGtHtjFZm4hIchgMVcZSrRsHppK4dfUWNizaj/Rviu7k/ySbNg9ACXrW2Q/NX25gyOR7Ed+tCYAmbjwYF/GVuxr21jEKC3PddBKchoSISJIYDFWm/B0BW1NJqFTQTZiEL78Lh/YHNX680Bw30cG0SQjyMDDuIDQaYOBLzVC7YRs3H4CL+dJdDXvv9rzwgmuCPTs+O5g82VDXSY7BJRGRjCkrZ6h8nSFrrOUM2TmVRC9kYBN6AQDi/M8hJekENKNqoefE5gisFejcQXibtbsach2CbqveEQCEhwMXL7omOOE0JEREDmPOkDscOAD88Yehi+T4cWD2bMNye2eut7NrpXO1XejVBdA8E4lWDzeByi/G9pOkzBfvahgnGR0+/G69qbJUKmDJEtcdD6chISKSLGUFQ+WnDEhOtnvurVtXb2HP99fRxY6XmfdTW9/6737LFvNzVJ6thHOpsjb/mjvqHUl1GhIiIlJYN5ml22yVJARfOnwZ3/3rMLTrAvFTTnMUQ41TiEcMzsEPEplKwhOWLwdGjbK9nauHoHuKJ5LCpTgNCRGRxHmqm6ySaculad68eVCpVJg8ebJrdmi8WzRyJNCrF479fAb/GpSJbiH7UD8pDI8v7Q5tTkfcQg3E+OfgxwZPQwUBYexOM6qse03ufP2uRrnPgFveP2O3HHD3s2Lky58dIiIZkFUwtHPnTixZsgQtWrRw2T51t3XY9vF+TOuYiabqP9Hk/gT84/te+OVGCwj4oXX1w5jdKxN7vjqK07ej8eTpV6BauRKqmHJ5QLGx8kgi1ukMybzLlxt+63S2n9O9u+H4yl/EjYx3NXQ6x/arNMZuObl+doiIfJRsuskKCgrQpk0bfPjhh3jjjTfQqlUrLFq0yK7nlr/NdvPyTfz8zn5ov7mN7040Ra6oZ9q2Gm6jV9h+aPoUIGVqI8R1tFL8UI71diwNjQ8LMyybObPy9lc2uaoQhpFXZef4kuuQe0+Q42eHiMgLOB1HOWPHjkVYWBjeeecd9OrVq9JgqLi4GMXFxabH+fn5iIuLw+JR6/DTxjpYn9Mct1DDtD4UeXig4QFoNCrcP7UZQhuEuvtwPM/a0Hij8HDD6KnKghdLwVT5IMhIrkPuiYhIMhgMlfHVV19h7ty52LlzJ4KCgmwGQ7Nnz8acOXMsrLk7O1kD/7PQNDsJzaPB6DGhOarVqOa29nudMXm3shFhRitXVh68lL2rEREBjB1rSAq2hEnBRERUBQyG7sjOzka7du3w008/oWXLlgDg9J2hlkG/YVjnQmiejUKL4Y2h8rOSA+Nr7C34BxiGldsbvLCQIBERuRGLLt6xa9cu5Obmom3btqZlOp0OmzdvxuLFi1FcXAz/chdutVoNtbriTO+bLzZx68mUBEv5KI4U8nOkXhALCRIRkQ+QfDDUp08f7N+/32zZY489hqZNm2LatGkVAiFFszZ32FNPObYfe4MXXx9yT0REiiD5YCg4OBjJyclmy2rWrInw8PAKyxWtshnRZ8+2nuhsib3Bi3HIva1Cgq6a9Z2IiMgNZFVniKywNXeYvVQqQ86QvcELCwkSEZEPkGUwlJmZaXeNIUWwZ+6wK1eAOXMMd4gscTZ4YSFBIiKSOVkGQ1SOvTk+jRoBFy8agqKwMPN1VQlehg0DTp0yjBpLTTX8zspiIERERLIg+ZwhsoMjicz+/sCrrxoqTruyCrJxfi8iIiKZYTAEyH96BGcSmRm8EBERAWA3mWEUVny8oXjgqFGG3/HxhuVyIbVEZmcmgyUiIvISZQdDxuHo5ZOPz50zLJdTQORsIrOrAxdfCC6JiEhRJD8dhytYLOdta74uuc6r5UiXn7Uijc7ONm+t1hEnbSUiIidwbjIXsngylT6vlqsDF18NLomIyGs8FQwpt5tMyfNq2VOkcfJkx7rM7Kl1ZJz3jIiISEKUGwwpeV4tdwQuSg4uiYhI1pQbDBmHo5cffWXk6NQUcuKOwEXJwSUREcmacoMhqQ1H9yR3BC5KDi6JiEjWlBsMAcqdV8sdgYuSg0siIpI1ZQdDgDLn1XJX4KLU4JKIiGRNuUPryXKdobg4QyBUlcBF7tObEBGRJLDOkAuZTuYnnyDk3ns9d3GWQ1AghzYSEZEiMRhyIdPJBBACVK3Ksr1cXd2ZiIhIYVh00Z3cPfeYL815RkRE5OOUeWcIcN/0EJyWgoiIyCV4Z8jd3DU9BKelICIikhXlBkNGrp4egtNSEBERyQqDIVdPD8FpKYiIiGRFucGQu6aH4LQUREREsqLMYMid00NwWgoiIiJZUWYw5O7pITgtBRERkWwoa2g9K1ATERHJhqeG1ge4bc9S9NBDgCfnJvP3B3r18tzrERERkcOU2U1GREREdAeDISIiIlI0BkNERESkaMrKGXIHJkkTERHJGoOhqkhLA154wXwusthYQ50hDp8nIiKSBXaTOSstDRg+vOKkrOfOGZanpXmnXUREROQQBkPO0OkMd4QslWgyLps82bAdERERSRqDIWds2VLxjlBZQgDZ2YbtiIiISNIYDDnjwgXXbkdERERew2DIGVFRrt2OiIiIvIbBkDO6dzeMGis/K72RSgXExRm2IyIiIkljMOQMf3/D8HmgYkBkfLxoEesNERERyYDkg6F58+ahffv2CA4ORkREBIYOHYqjR496u1mGOkLffgvExJgvj401LGedISIiIllQCWFpfLh03H///XjkkUfQvn17lJaWYubMmdi/fz8OHTqEmjVr2rWP/Px8hIaGIi8vDyGunrWeFaiJiIjcwq3X7zIkHwyVd+nSJURERGDTpk3o0aOHXc/x1MkkIiIi1/HU9Vt203Hk5eUBAMLCwqxuU1xcjOLiYtPj/Px8t7eLiIiI5EnyOUNlCSEwZcoUdOvWDcnJyVa3mzdvHkJDQ00/cXFxHmwlERERyYmsuskmTJiAtWvXYuvWrYiNjbW6naU7Q3FxcewmIyIikhF2k5Xz/PPPIz09HZs3b640EAIAtVoNtVrtoZYRERGRnEk+GBJC4Pnnn8eqVauQmZmJhIQEbzeJiIiIfIjkg6EJEyYgNTUVWq0WwcHByMnJAQCEhoaievXqXm4dERERyZ3kc4ZUVqa8WLp0KcaNG2fXPji0noiISH6YM3SHxGM1IiIikjlZDa0nIiIicjUGQ0RERKRoDIaIiIhI0RgMERERkaIxGCIiIiJFYzBEREREisZgiIiIiBSNwRAREREpGoMhIiIiUjQGQ0RERKRoDIaIiIhI0RgMERERkaIxGCIiIiJFYzBEREREisZgiIiIiBSNwRAREREpGoMhIiIiUjQGQ0RERKRoDIaIiIhI0RgMERERkaIxGCIiIiJFYzBEREREisZgiIiIiBSNwRAREREpGoMhIiIiUjQGQ0RERKRoDIaIiIhI0RgMERERkaIxGCIiIiJFYzBEREREisZgiIiIiBSNwRAREREpGoMhIiIiUjQGQ0RERKRoDIaIiIhI0RgMERERkaIxGCIiIiJFYzBEREREiiabYOjDDz9EQkICgoKC0LZtW2zZssXbTSIiIiIfIItgaMWKFZg8eTJmzpyJPXv2oHv37hg4cCDOnDnj7aYRERGRzKmEEMLbjbClY8eOaNOmDf7973+bliUmJmLo0KGYN2+ezefn5+cjNDQUeXl5CAkJcWdTiYiIyEU8df2W/J2h27dvY9euXejfv7/Z8v79+2Pbtm1eahURERH5igBvN8CWy5cvQ6fToX79+mbL69evj5ycHIvPKS4uRnFxselxXl4eAEOESURERPJgvG67uxNL8sGQkUqlMnsshKiwzGjevHmYM2dOheVxcXFuaRsRERG5z5UrVxAaGuq2/Us+GKpbty78/f0r3AXKzc2tcLfIaMaMGZgyZYrp8fXr19GwYUOcOXPGrSdTavLz8xEXF4fs7GxF5UrxuHncSsDj5nErQV5eHho0aICwsDC3vo7kg6HAwEC0bdsW69evx4MPPmhavn79emg0GovPUavVUKvVFZaHhoYq6kNkFBISwuNWEB63svC4lUWpx+3n594UZ8kHQwAwZcoUjB49Gu3atUPnzp2xZMkSnDlzBs8++6y3m0ZEREQyJ4tg6OGHH8aVK1fw2muv4cKFC0hOTsb333+Phg0bertpREREJHOyCIYAYPz48Rg/frxTz1Wr1Zg1a5bFrjNfxuPmcSsBj5vHrQQ8bvcetyyKLhIRERG5i+SLLhIRERG5E4MhIiIiUjQGQ0RERKRoDIaIiIhI0WQZDH344YdISEhAUFAQ2rZtiy1btlS6/aZNm9C2bVsEBQXhnnvuwUcffVRhm5UrVyIpKQlqtRpJSUlYtWqVu5rvNEeOOy0tDf369UO9evUQEhKCzp0748cffzTbZtmyZVCpVBV+ioqK3H0oDnHkuDMzMy0e05EjR8y287X3e9y4cRaPu1mzZqZt5PB+b968GUOGDEF0dDRUKhVWr15t8zm+8P129Lh95fvt6HH7yvfb0eP2le/3vHnz0L59ewQHByMiIgJDhw7F0aNHbT7PE99x2QVDK1aswOTJkzFz5kzs2bMH3bt3x8CBA3HmzBmL22dlZeGBBx5A9+7dsWfPHvzzn//EpEmTsHLlStM227dvx8MPP4zRo0fjjz/+wOjRozFixAj8+uuvnjosmxw97s2bN6Nfv374/vvvsWvXLvTu3RtDhgzBnj17zLYLCQnBhQsXzH6CgoI8cUh2cfS4jY4ePWp2TI0aNTKt88X3+9133zU73uzsbISFheGhhx4y207q73dhYSFatmyJxYsX27W9r3y/HT1uX/l+O3rcRnL/fjt63L7y/d60aRMmTJiAHTt2YP369SgtLUX//v1RWFho9Tke+44LmenQoYN49tlnzZY1bdpUTJ8+3eL2//jHP0TTpk3Nlj3zzDOiU6dOpscjRowQ999/v9k2AwYMEI888oiLWl11jh63JUlJSWLOnDmmx0uXLhWhoaGuaqJbOHrcGRkZAoC4du2a1X0q4f1etWqVUKlU4tSpU6Zlcni/ywIgVq1aVek2vvL9Lsue47ZEjt/vsuw5bl/5fpflzPvtC99vIYTIzc0VAMSmTZusbuOp77is7gzdvn0bu3btQv/+/c2W9+/fH9u2bbP4nO3bt1fYfsCAAfj9999RUlJS6TbW9ulpzhx3eXq9Hjdu3Kgw2V1BQQEaNmyI2NhYDB48uMJ/lt5UleNu3bo1oqKi0KdPH2RkZJitU8L7/emnn6Jv374VqrRL+f12hi98v11Bjt/vqpDz99sVfOX7nZeXBwCVTsLqqe+4rIKhy5cvQ6fTVZitvn79+hVmtTfKycmxuH1paSkuX75c6TbW9ulpzhx3eW+99RYKCwsxYsQI07KmTZti2bJlSE9Px/LlyxEUFISuXbvi+PHjLm2/s5w57qioKCxZsgQrV65EWloamjRpgj59+mDz5s2mbXz9/b5w4QLWrVuHJ5980my51N9vZ/jC99sV5Pj9doYvfL+ryle+30IITJkyBd26dUNycrLV7Tz1HZfNdBxlqVQqs8dCiArLbG1ffrmj+/QGZ9u4fPlyzJ49G1qtFhEREablnTp1QqdOnUyPu3btijZt2uD999/He++957qGV5Ejx92kSRM0adLE9Lhz587Izs7GwoUL0aNHD6f26S3OtnHZsmWoXbs2hg4darZcLu+3o3zl++0suX+/HeFL329n+cr3e+LEidi3bx+2bt1qc1tPfMdldWeobt268Pf3rxDt5ebmVogKjSIjIy1uHxAQgPDw8Eq3sbZPT3PmuI1WrFiBJ554Al9//TX69u1b6bZ+fn5o3769ZP6TqMpxl9WpUyezY/Ll91sIgc8++wyjR49GYGBgpdtK7f12hi98v6tCzt9vV5Hb97sqfOX7/fzzzyM9PR0ZGRmIjY2tdFtPfcdlFQwFBgaibdu2WL9+vdny9evXo0uXLhaf07lz5wrb//TTT2jXrh2qVatW6TbW9ulpzhw3YPiPcdy4cUhNTcWgQYNsvo4QAnv37kVUVFSV2+wKzh53eXv27DE7Jl99vwHDaI0TJ07giSeesPk6Unu/neEL329nyf377Spy+35Xhdy/30IITJw4EWlpadi4cSMSEhJsPsdj33G7U60l4quvvhLVqlUTn376qTh06JCYPHmyqFmzpimrfvr06WL06NGm7f/8809Ro0YN8eKLL4pDhw6JTz/9VFSrVk18++23pm1++eUX4e/vL/7v//5PHD58WPzf//2fCAgIEDt27PD48Vnj6HGnpqaKgIAA8cEHH4gLFy6Yfq5fv27aZvbs2eKHH34QJ0+eFHv27BGPPfaYCAgIEL/++qvHj88aR4/7nXfeEatWrRLHjh0TBw4cENOnTxcAxMqVK03b+OL7bfToo4+Kjh07WtynHN7vGzduiD179og9e/YIAOLtt98We/bsEadPnxZC+O7329Hj9pXvt6PH7Svfb0eP20ju3+/nnntOhIaGiszMTLPP7c2bN03beOs7LrtgSAghPvjgA9GwYUMRGBgo2rRpYzYsb+zYsaJnz55m22dmZorWrVuLwMBAER8fL/79739X2Oc333wjmjRpIqpVqyaaNm1q9uWSCkeOu2fPngJAhZ+xY8eatpk8ebJo0KCBCAwMFPXq1RP9+/cX27Zt8+AR2ceR454/f7649957RVBQkKhTp47o1q2bWLt2bYV9+tr7LYQQ169fF9WrVxdLliyxuD85vN/GodPWPre++v129Lh95fvt6HH7yvfbmc+5L3y/LR0zALF06VLTNt76jqvuNJCIiIhIkWSVM0RERETkagyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUjcEQERERKRqDISIiIlI0BkNERESkaAyGiIiISNEYDBGRLC1fvhxBQUE4d+6cadmTTz6JFi1aIC8vz4stIyK54dxkRCRLQgi0atUK3bt3x+LFizFnzhx88skn2LFjB2JiYrzdPCKSkQBvN4CIyBkqlQpz587F8OHDER0djXfffRdbtmxhIEREDuOdISKStTZt2uDgwYP46aef0LNnT283h4hkiDlDRCRbP/74I44cOQKdTof69et7uzlEJFO8M0REsrR792706tULH3zwAb766ivUqFED33zzjbebRUQyxJwhIpKdU6dOYdCgQZg+fTpGjx6NpKQktG/fHrt27ULbtm293TwikhneGSIiWbl69Sq6du2KHj164OOPPzYt12g0KC4uxg8//ODF1hGRHDEYIiIiIkVjAjUREREpGoMhIiIiUjQGQ0RERKRoDIaIiIhI0RgMERERkaIxGCIiIiJFYzBEREREisZgiIiIiBSNwRAREREpGoMhIiIiUjQGQ0RERKRoDIaIiIhI0f4fAFlCtwL/Po0AAAAASUVORK5CYII=", "text/plain": [ "
" ] @@ -2131,8 +2361,8 @@ "output_type": "stream", "text": [ "theta from own sdg\n", - "[[3.48900413]\n", - " [3.56763673]]\n" + "[[3.96916206]\n", + " [3.10276112]]\n" ] } ], @@ -2214,8 +2444,10 @@ }, { "cell_type": "markdown", - "id": "1caa8279", - "metadata": {}, + "id": "502d537b", + "metadata": { + "editable": true + }, "source": [ "## Same code but now with momentum gradient descent" ] @@ -2223,23 +2455,26 @@ { "cell_type": "code", "execution_count": 19, - "id": "a9695688", - "metadata": {}, + "id": "d62b1fd8", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Own inversion\n", - "[[4.11571507]\n", - " [2.86067818]]\n", - "Eigenvalues of Hessian Matrix:[0.25849623 4.84605507]\n", + "[[4.16532977]\n", + " [2.86943859]]\n", + "Eigenvalues of Hessian Matrix:[0.29633608 4.22128142]\n", "theta from own gd\n", - "[[4.10888197]\n", - " [2.86602331]]\n", + "[[4.16445858]\n", + " [2.87020155]]\n", "theta from own sdg with momentum\n", - "[[4.15361856]\n", - " [2.92376655]]\n" + "[[4.149433 ]\n", + " [2.89654756]]\n" ] } ], @@ -2315,8 +2550,10 @@ }, { "cell_type": "markdown", - "id": "7e8ab93f", - "metadata": {}, + "id": "ab2dfdcf", + "metadata": { + "editable": true + }, "source": [ "## Similar (second order function now) problem but now with AdaGrad" ] @@ -2324,8 +2561,11 @@ { "cell_type": "code", "execution_count": 20, - "id": "be9894c6", - "metadata": {}, + "id": "24784ec8", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "name": "stdout", @@ -2342,9 +2582,9 @@ "output_type": "stream", "text": [ "theta from own AdaGrad\n", - "[[1.99968451]\n", - " [3.001795 ]\n", - " [3.99848215]]\n" + "[[1.99415296]\n", + " [3.03274273]\n", + " [3.96850191]]\n" ] } ], @@ -2401,16 +2641,20 @@ }, { "cell_type": "markdown", - "id": "f9c181ef", - "metadata": {}, + "id": "b525a878", + "metadata": { + "editable": true + }, "source": [ "Running this code we note an almost perfect agreement with the results from matrix inversion." ] }, { "cell_type": "markdown", - "id": "3f40101d", - "metadata": {}, + "id": "f3de5529", + "metadata": { + "editable": true + }, "source": [ "## RMSprop for adaptive learning rate with Stochastic Gradient Descent" ] @@ -2418,8 +2662,11 @@ { "cell_type": "code", "execution_count": 21, - "id": "da9f2895", - "metadata": {}, + "id": "770a0f44", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "name": "stdout", @@ -2436,9 +2683,9 @@ "output_type": "stream", "text": [ "theta from own RMSprop\n", - "[[1.99887767]\n", - " [3.01261048]\n", - " [3.99294056]]\n" + "[[2.00022969]\n", + " [2.99954278]\n", + " [4.00046631]]\n" ] } ], @@ -2501,8 +2748,10 @@ }, { "cell_type": "markdown", - "id": "2075df0a", - "metadata": {}, + "id": "2cf458d4", + "metadata": { + "editable": true + }, "source": [ "## And finally [ADAM](https://arxiv.org/pdf/1412.6980.pdf)" ] @@ -2510,8 +2759,11 @@ { "cell_type": "code", "execution_count": 22, - "id": "b9e0fd59", - "metadata": {}, + "id": "ebe031fe", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "name": "stdout", @@ -2528,9 +2780,9 @@ "output_type": "stream", "text": [ "theta from own ADAM\n", - "[[1.99996755]\n", - " [3.00016535]\n", - " [3.99977375]]\n" + "[[1.99991245]\n", + " [3.00042721]\n", + " [3.99954434]]\n" ] } ], @@ -2598,8 +2850,10 @@ }, { "cell_type": "markdown", - "id": "3186664b", - "metadata": {}, + "id": "df82f58c", + "metadata": { + "editable": true + }, "source": [ "## And Logistic Regression" ] @@ -2607,8 +2861,11 @@ { "cell_type": "code", "execution_count": 23, - "id": "c4119a68", - "metadata": {}, + "id": "23a3aae7", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "name": "stdout", @@ -2657,8 +2914,10 @@ }, { "cell_type": "markdown", - "id": "55e182eb", - "metadata": {}, + "id": "04692c2e", + "metadata": { + "editable": true + }, "source": [ "## Introducing [JAX](https://jax.readthedocs.io/en/latest/)\n", "\n", @@ -2671,8 +2930,10 @@ }, { "cell_type": "markdown", - "id": "ae059fd0", - "metadata": {}, + "id": "c9531ff9", + "metadata": { + "editable": true + }, "source": [ "### Getting started with Jax, note the way we import numpy" ] @@ -2680,8 +2941,11 @@ { "cell_type": "code", "execution_count": 24, - "id": "1ad5b0d3", - "metadata": {}, + "id": "1082677a", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "import jax\n", @@ -2694,8 +2958,10 @@ }, { "cell_type": "markdown", - "id": "bc8fd16c", - "metadata": {}, + "id": "ddab1050", + "metadata": { + "editable": true + }, "source": [ "### A warm-up example" ] @@ -2703,8 +2969,11 @@ { "cell_type": "code", "execution_count": 25, - "id": "443386ca", - "metadata": {}, + "id": "9a64315e", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "name": "stderr", @@ -2717,7 +2986,7 @@ { "data": { "text/plain": [ - "[]" + "[]" ] }, "execution_count": 25, @@ -2778,8 +3047,10 @@ }, { "cell_type": "markdown", - "id": "b313e4d6", - "metadata": {}, + "id": "fbaa615b", + "metadata": { + "editable": true + }, "source": [ "### A more advanced example" ] @@ -2787,13 +3058,16 @@ { "cell_type": "code", "execution_count": 26, - "id": "7ff7b64d", - "metadata": {}, + "id": "6400dac8", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "data": { "text/plain": [ - "" + "" ] }, "execution_count": 26, @@ -2840,8 +3114,10 @@ }, { "cell_type": "markdown", - "id": "b913d744", - "metadata": {}, + "id": "b7cd2078", + "metadata": { + "editable": true + }, "source": [ "## Introduction to Neural networks\n", "\n", @@ -2856,8 +3132,10 @@ }, { "cell_type": "markdown", - "id": "04b70882", - "metadata": {}, + "id": "4b41d4a3", + "metadata": { + "editable": true + }, "source": [ "## Artificial neurons\n", "\n", @@ -2878,8 +3156,10 @@ }, { "cell_type": "markdown", - "id": "44405ff2", - "metadata": {}, + "id": "05bbca92", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -2894,8 +3174,10 @@ }, { "cell_type": "markdown", - "id": "b39653f7", - "metadata": {}, + "id": "63e4ecd2", + "metadata": { + "editable": true + }, "source": [ "Here, the output $y$ of the neuron is the value of its activation function, which have as input\n", "a weighted sum of signals $x_i, \\dots ,x_n$ received by $n$ other neurons.\n", @@ -2932,8 +3214,10 @@ }, { "cell_type": "markdown", - "id": "4db5fb89", - "metadata": {}, + "id": "16405c0c", + "metadata": { + "editable": true + }, "source": [ "## Neural network types\n", "\n", @@ -2959,8 +3243,10 @@ }, { "cell_type": "markdown", - "id": "400c590f", - "metadata": {}, + "id": "49a77aeb", + "metadata": { + "editable": true + }, "source": [ "## Feed-forward neural networks\n", "\n", @@ -2978,8 +3264,10 @@ }, { "cell_type": "markdown", - "id": "1536d443", - "metadata": {}, + "id": "4408658f", + "metadata": { + "editable": true + }, "source": [ "## Convolutional Neural Network\n", "\n", @@ -3005,8 +3293,10 @@ }, { "cell_type": "markdown", - "id": "0ce4aacc", - "metadata": {}, + "id": "cf8d97ad", + "metadata": { + "editable": true + }, "source": [ "## Recurrent neural networks\n", "\n", @@ -3024,8 +3314,10 @@ }, { "cell_type": "markdown", - "id": "c187a3e9", - "metadata": {}, + "id": "3cc3819b", + "metadata": { + "editable": true + }, "source": [ "## Other types of networks\n", "\n", @@ -3043,8 +3335,10 @@ }, { "cell_type": "markdown", - "id": "7a5d9c4f", - "metadata": {}, + "id": "920fd548", + "metadata": { + "editable": true + }, "source": [ "## Multilayer perceptrons\n", "\n", @@ -3058,8 +3352,10 @@ }, { "cell_type": "markdown", - "id": "2abe1a3e", - "metadata": {}, + "id": "d08f461e", + "metadata": { + "editable": true + }, "source": [ "## Why multilayer perceptrons?\n", "\n", @@ -3077,8 +3373,10 @@ }, { "cell_type": "markdown", - "id": "187cb30d", - "metadata": {}, + "id": "dc59c40b", + "metadata": { + "editable": true + }, "source": [ "## Illustration of a single perceptron model and a multi-perceptron model\n", "\n", @@ -3091,8 +3389,10 @@ }, { "cell_type": "markdown", - "id": "6269f804", - "metadata": {}, + "id": "89c1b368", + "metadata": { + "editable": true + }, "source": [ "## Examples of XOR, OR and AND gates\n", "\n", @@ -3106,8 +3406,11 @@ { "cell_type": "code", "execution_count": 27, - "id": "1ad6269c", - "metadata": {}, + "id": "f2a213fe", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "name": "stdout", @@ -3163,16 +3466,20 @@ }, { "cell_type": "markdown", - "id": "a4ac557d", - "metadata": {}, + "id": "046c878f", + "metadata": { + "editable": true + }, "source": [ "What is happening here?" ] }, { "cell_type": "markdown", - "id": "6c5b5b78", - "metadata": {}, + "id": "8dbddf81", + "metadata": { + "editable": true + }, "source": [ "## Does Logistic Regression do a better Job?" ] @@ -3180,8 +3487,11 @@ { "cell_type": "code", "execution_count": 28, - "id": "78d9fe1b", - "metadata": {}, + "id": "3032a2c1", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "name": "stdout", @@ -3259,16 +3569,20 @@ }, { "cell_type": "markdown", - "id": "522ea0b9", - "metadata": {}, + "id": "ea8b4e4b", + "metadata": { + "editable": true + }, "source": [ "Not exactly impressive, but somewhat better." ] }, { "cell_type": "markdown", - "id": "633277bf", - "metadata": {}, + "id": "ef2b283b", + "metadata": { + "editable": true + }, "source": [ "## Adding Neural Networks" ] @@ -3276,8 +3590,11 @@ { "cell_type": "code", "execution_count": 29, - "id": "55106a0e", - "metadata": {}, + "id": "7415b824", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "name": "stdout", @@ -3301,8 +3618,10 @@ }, { "cell_type": "markdown", - "id": "6933a546", - "metadata": {}, + "id": "bbfc7004", + "metadata": { + "editable": true + }, "source": [ "## Mathematical model\n", "\n", @@ -3311,8 +3630,10 @@ }, { "cell_type": "markdown", - "id": "a392cc52", - "metadata": {}, + "id": "973905d4", + "metadata": { + "editable": true + }, "source": [ "$$\n", "y = f\\left(\\sum_{i=1}^n w_ix_i + b_i\\right) = f(z),\n", @@ -3321,8 +3642,10 @@ }, { "cell_type": "markdown", - "id": "bc1e3563", - "metadata": {}, + "id": "9343ae60", + "metadata": { + "editable": true + }, "source": [ "This function receives $x_i$ as inputs.\n", "Here the activation $z=(\\sum_{i=1}^n w_ix_i+b_i)$. \n", @@ -3334,8 +3657,10 @@ }, { "cell_type": "markdown", - "id": "947e6060", - "metadata": {}, + "id": "0fcd0bdf", + "metadata": { + "editable": true + }, "source": [ "## Mathematical model\n", "\n", @@ -3344,8 +3669,10 @@ }, { "cell_type": "markdown", - "id": "190e7764", - "metadata": {}, + "id": "98e91440", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3359,8 +3686,10 @@ }, { "cell_type": "markdown", - "id": "9d4df41f", - "metadata": {}, + "id": "944ccc68", + "metadata": { + "editable": true + }, "source": [ "Here $b_i$ is the so-called bias which is normally needed in\n", "case of zero activation weights or inputs. How to fix the biases and\n", @@ -3372,8 +3701,10 @@ }, { "cell_type": "markdown", - "id": "e8c69c2e", - "metadata": {}, + "id": "17edaee3", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3388,8 +3719,10 @@ }, { "cell_type": "markdown", - "id": "80a632b1", - "metadata": {}, + "id": "dbe292f0", + "metadata": { + "editable": true + }, "source": [ "where we assume that all nodes in the same layer have identical\n", "activation functions, hence the notation $f$. In general, we could assume in the more general case that different layers have different activation functions.\n", @@ -3398,8 +3731,10 @@ }, { "cell_type": "markdown", - "id": "20de39bb", - "metadata": {}, + "id": "ab06ec71", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3414,8 +3749,10 @@ }, { "cell_type": "markdown", - "id": "01031b37", - "metadata": {}, + "id": "0f069e07", + "metadata": { + "editable": true + }, "source": [ "where $N_l$ is the number of nodes in layer $l$. When the output of\n", "all the nodes in the first hidden layer are computed, the values of\n", @@ -3425,8 +3762,10 @@ }, { "cell_type": "markdown", - "id": "9560b5e1", - "metadata": {}, + "id": "3ee71e06", + "metadata": { + "editable": true + }, "source": [ "## Mathematical model\n", "\n", @@ -3435,8 +3774,10 @@ }, { "cell_type": "markdown", - "id": "baaac514", - "metadata": {}, + "id": "cecfe50e", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3451,8 +3792,10 @@ }, { "cell_type": "markdown", - "id": "f2a439d9", - "metadata": {}, + "id": "dc2a6523", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3467,16 +3810,20 @@ }, { "cell_type": "markdown", - "id": "9ba7b5ad", - "metadata": {}, + "id": "3f73c82a", + "metadata": { + "editable": true + }, "source": [ "where we have substituted $y_k^1$ with the inputs $x_k$. Finally, the ANN output reads" ] }, { "cell_type": "markdown", - "id": "bed342fd", - "metadata": {}, + "id": "8b1a1945", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3491,8 +3838,10 @@ }, { "cell_type": "markdown", - "id": "d1beb8c9", - "metadata": {}, + "id": "ecd88770", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3508,8 +3857,10 @@ }, { "cell_type": "markdown", - "id": "a71895ad", - "metadata": {}, + "id": "6b6ce470", + "metadata": { + "editable": true + }, "source": [ "## Mathematical model\n", "\n", @@ -3519,8 +3870,10 @@ }, { "cell_type": "markdown", - "id": "d9bd25ff", - "metadata": {}, + "id": "6e018962", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3535,8 +3888,10 @@ }, { "cell_type": "markdown", - "id": "e7737a5b", - "metadata": {}, + "id": "bf0b66e0", + "metadata": { + "editable": true + }, "source": [ "which illustrates a basic property of MLPs: The only independent\n", "variables are the input values $x_n$." @@ -3544,8 +3899,10 @@ }, { "cell_type": "markdown", - "id": "384040ce", - "metadata": {}, + "id": "4827bb05", + "metadata": { + "editable": true + }, "source": [ "## Mathematical model\n", "\n", @@ -3561,8 +3918,10 @@ }, { "cell_type": "markdown", - "id": "4a27ed92", - "metadata": {}, + "id": "6fc6eadd", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3577,8 +3936,10 @@ }, { "cell_type": "markdown", - "id": "c71650e0", - "metadata": {}, + "id": "f7c37a39", + "metadata": { + "editable": true + }, "source": [ "where the parameters $c_i$ are weights and biases. By adjusting these\n", "parameters, the activation functions can be shifted up and down or\n", @@ -3588,8 +3949,10 @@ }, { "cell_type": "markdown", - "id": "b6291c8a", - "metadata": {}, + "id": "09472aa3", + "metadata": { + "editable": true + }, "source": [ "### Matrix-vector notation\n", "\n", @@ -3606,8 +3969,10 @@ }, { "cell_type": "markdown", - "id": "da4b43f7", - "metadata": {}, + "id": "1824564d", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3637,8 +4002,10 @@ }, { "cell_type": "markdown", - "id": "7fe1f511", - "metadata": {}, + "id": "eafbe02e", + "metadata": { + "editable": true + }, "source": [ "### Matrix-vector notation and activation\n", "\n", @@ -3647,8 +4014,10 @@ }, { "cell_type": "markdown", - "id": "d53241ba", - "metadata": {}, + "id": "f52242e3", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3664,8 +4033,10 @@ }, { "cell_type": "markdown", - "id": "962e06e9", - "metadata": {}, + "id": "72371715", + "metadata": { + "editable": true + }, "source": [ "This is not just a convenient and compact notation, but also a useful\n", "and intuitive way to think about MLPs: The output is calculated by a\n", @@ -3676,8 +4047,10 @@ }, { "cell_type": "markdown", - "id": "6446fdc6", - "metadata": {}, + "id": "b455d9ae", + "metadata": { + "editable": true + }, "source": [ "### Activation functions\n", "\n", @@ -3697,8 +4070,10 @@ }, { "cell_type": "markdown", - "id": "69aff123", - "metadata": {}, + "id": "7de531f8", + "metadata": { + "editable": true + }, "source": [ "### Activation functions, Logistic and Hyperbolic ones\n", "\n", @@ -3714,8 +4089,10 @@ }, { "cell_type": "markdown", - "id": "dbb74732", - "metadata": {}, + "id": "dedb08ff", + "metadata": { + "editable": true + }, "source": [ "$$\n", "f(x) = \\frac{1}{1 + e^{-x}},\n", @@ -3724,16 +4101,20 @@ }, { "cell_type": "markdown", - "id": "216973d6", - "metadata": {}, + "id": "ed7c69c9", + "metadata": { + "editable": true + }, "source": [ "and the *hyperbolic tangent* function" ] }, { "cell_type": "markdown", - "id": "a8643aed", - "metadata": {}, + "id": "37be8225", + "metadata": { + "editable": true + }, "source": [ "$$\n", "f(x) = \\tanh(x)\n", @@ -3742,8 +4123,10 @@ }, { "cell_type": "markdown", - "id": "b6450655", - "metadata": {}, + "id": "a8176533", + "metadata": { + "editable": true + }, "source": [ "### Relevance\n", "\n", @@ -3757,8 +4140,11 @@ { "cell_type": "code", "execution_count": 30, - "id": "0565ead1", - "metadata": {}, + "id": "1b3252bc", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [ { "data": { @@ -3893,11 +4279,6 @@ } ], "metadata": { - "kernelspec": { - "display_name": "Python 3 (ipykernel)", - "language": "python", - "name": "python3" - }, "language_info": { "codemirror_mode": { "name": "ipython", diff --git a/doc/LectureNotes/_build/jupyter_execute/week40.py b/doc/LectureNotes/_build/jupyter_execute/week40.py index 9563fbb25..92a2065bd 100644 --- a/doc/LectureNotes/_build/jupyter_execute/week40.py +++ b/doc/LectureNotes/_build/jupyter_execute/week40.py @@ -16,8 +16,10 @@ # 1. Stochastic Gradient descent with examples and automatic differentiation # # 2. If we get time, we start with the basics of Neural Networks, setting up the basic steps, from the simple perceptron model to the multi-layer perceptron model -# -# +# +# 3. [Video of lecture](https://youtu.be/jdJoOrCIdII) +# +# 4. Whiteboard notes at # ## Suggested readings and videos # **Readings and Videos:** diff --git a/doc/LectureNotes/_build/jupyter_execute/week40_100_1.png b/doc/LectureNotes/_build/jupyter_execute/week40_100_1.png index 64652a3ae..34e6443ac 100644 Binary files a/doc/LectureNotes/_build/jupyter_execute/week40_100_1.png and b/doc/LectureNotes/_build/jupyter_execute/week40_100_1.png differ diff --git a/doc/LectureNotes/_build/jupyter_execute/week40_104_1.png b/doc/LectureNotes/_build/jupyter_execute/week40_104_1.png index 2bc10a52c..0fdc89348 100644 Binary files a/doc/LectureNotes/_build/jupyter_execute/week40_104_1.png and b/doc/LectureNotes/_build/jupyter_execute/week40_104_1.png differ diff --git a/doc/LectureNotes/_build/jupyter_execute/week40_34_1.png b/doc/LectureNotes/_build/jupyter_execute/week40_34_1.png index ba29393bc..b736cd3d6 100644 Binary files a/doc/LectureNotes/_build/jupyter_execute/week40_34_1.png and b/doc/LectureNotes/_build/jupyter_execute/week40_34_1.png differ diff --git a/doc/LectureNotes/week40.ipynb b/doc/LectureNotes/week40.ipynb index cfe6bdd0b..c316b1d31 100644 --- a/doc/LectureNotes/week40.ipynb +++ b/doc/LectureNotes/week40.ipynb @@ -2,8 +2,10 @@ "cells": [ { "cell_type": "markdown", - "id": "54c44098", - "metadata": {}, + "id": "71c0e62a", + "metadata": { + "editable": true + }, "source": [ "\n", @@ -12,8 +14,10 @@ }, { "cell_type": "markdown", - "id": "f64073c9", - "metadata": {}, + "id": "4e0afae4", + "metadata": { + "editable": true + }, "source": [ "# Week 40: Gradient descent methods (continued) and start Neural networks\n", "**Morten Hjorth-Jensen**, Department of Physics, University of Oslo, Norway and Department of Physics and Astronomy and Facility for Rare Ion Beams, Michigan State University, USA\n", @@ -23,29 +27,37 @@ }, { "cell_type": "markdown", - "id": "d2d0f844", - "metadata": {}, + "id": "e6b378ac", + "metadata": { + "editable": true + }, "source": [ "## Plans for week 40" ] }, { "cell_type": "markdown", - "id": "c9630d37", - "metadata": {}, + "id": "1ba91689", + "metadata": { + "editable": true + }, "source": [ "## Lecture Monday September 30, 2024\n", "1. Stochastic Gradient descent with examples and automatic differentiation\n", "\n", "2. If we get time, we start with the basics of Neural Networks, setting up the basic steps, from the simple perceptron model to the multi-layer perceptron model\n", - "\n", - "" + "\n", + "3. [Video of lecture](https://youtu.be/jdJoOrCIdII)\n", + "\n", + "4. Whiteboard notes at " ] }, { "cell_type": "markdown", - "id": "4b447216", - "metadata": {}, + "id": "fb1da492", + "metadata": { + "editable": true + }, "source": [ "## Suggested readings and videos\n", "**Readings and Videos:**\n", @@ -67,8 +79,10 @@ }, { "cell_type": "markdown", - "id": "8fb799c1", - "metadata": {}, + "id": "5e18b164", + "metadata": { + "editable": true + }, "source": [ "## Lab sessions Tuesday and Wednesday\n", "**Material for the active learning sessions on Tuesday and Wednesday.**\n", @@ -84,8 +98,10 @@ }, { "cell_type": "markdown", - "id": "3a202eb3", - "metadata": {}, + "id": "ca1eb3e1", + "metadata": { + "editable": true + }, "source": [ "## Summary from last week, using gradient descent methods, limitations\n", "\n", @@ -104,8 +120,10 @@ }, { "cell_type": "markdown", - "id": "f0b36267", - "metadata": {}, + "id": "d1832283", + "metadata": { + "editable": true + }, "source": [ "## Simple implementation of GD for OLS, Ridge and Lasso\n", "\n", @@ -115,29 +133,13 @@ }, { "cell_type": "code", - "execution_count": 42, - "id": "2d9d73e5", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Parameters for OLS using gradient descent\n", - "[[4.04553909]\n", - " [2.85718534]\n", - " [5.07124072]]\n", - "Parameters for Ridge using gradient descent\n", - "[[3.8048267 ]\n", - " [3.33344121]\n", - " [4.85905287]]\n", - "Parameters for Lasso using gradient descent\n", - "[[3.87867385]\n", - " [3.192587 ]\n", - " [4.93045409]]\n" - ] - } - ], + "execution_count": 1, + "id": "0dee3b51", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "from random import random, seed\n", "import numpy as np\n", @@ -186,8 +188,10 @@ }, { "cell_type": "markdown", - "id": "fcf0f686", - "metadata": {}, + "id": "cda18663", + "metadata": { + "editable": true + }, "source": [ "## But none of these can compete with Newton's method\n", "\n", @@ -196,30 +200,13 @@ }, { "cell_type": "code", - "execution_count": 43, - "id": "1550b223", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Own inversion\n", - "[[4.]\n", - " [3.]\n", - " [5.]]\n", - "0 [-26.91927647] [-35.76071889]\n", - "1 [-6.07158768e-14] [-1.55935271e-13]\n", - "2 [-6.03961325e-16] [-9.79527859e-16]\n", - "3 [-1.54543045e-15] [-2.38042396e-15]\n", - "4 [1.27897692e-15] [1.94409177e-15]\n", - "beta from own Newton code\n", - "[[4.]\n", - " [3.]\n", - " [5.]]\n" - ] - } - ], + "execution_count": 2, + "id": "e1e51c75", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "# Using Newton's method\n", "from random import random, seed\n", @@ -258,8 +245,10 @@ }, { "cell_type": "markdown", - "id": "1777d437", - "metadata": {}, + "id": "8de3d7c1", + "metadata": { + "editable": true + }, "source": [ "## Gradient descent and Logistic regression\n", "\n", @@ -270,18 +259,13 @@ }, { "cell_type": "code", - "execution_count": 44, - "id": "94a3c22b", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Predictions: [1, 1, 1, 1]\n" - ] - } - ], + "execution_count": 3, + "id": "4f87ae26", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "import numpy as np\n", "class LogisticRegression:\n", @@ -318,8 +302,10 @@ }, { "cell_type": "markdown", - "id": "5d9bd47b", - "metadata": {}, + "id": "c2781943", + "metadata": { + "editable": true + }, "source": [ "## Overview video on Stochastic Gradient Descent\n", "\n", @@ -335,8 +321,10 @@ }, { "cell_type": "markdown", - "id": "0107149a", - "metadata": {}, + "id": "1e37491a", + "metadata": { + "editable": true + }, "source": [ "## Batches and mini-batches\n", "\n", @@ -354,8 +342,10 @@ }, { "cell_type": "markdown", - "id": "acb322f8", - "metadata": {}, + "id": "6feab258", + "metadata": { + "editable": true + }, "source": [ "## Stochastic Gradient Descent (SGD)\n", "\n", @@ -384,8 +374,10 @@ }, { "cell_type": "markdown", - "id": "9073ab44", - "metadata": {}, + "id": "204c15af", + "metadata": { + "editable": true + }, "source": [ "## Stochastic Gradient Descent\n", "\n", @@ -399,8 +391,10 @@ }, { "cell_type": "markdown", - "id": "0a457a90", - "metadata": {}, + "id": "c9453416", + "metadata": { + "editable": true + }, "source": [ "$$\n", "C(\\mathbf{\\beta}) = \\sum_{i=1}^n c_i(\\mathbf{x}_i,\n", @@ -410,8 +404,10 @@ }, { "cell_type": "markdown", - "id": "be758e1d", - "metadata": {}, + "id": "19b0403c", + "metadata": { + "editable": true + }, "source": [ "## Computation of gradients\n", "\n", @@ -421,8 +417,10 @@ }, { "cell_type": "markdown", - "id": "411db876", - "metadata": {}, + "id": "37025507", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\nabla_\\beta C(\\mathbf{\\beta}) = \\sum_i^n \\nabla_\\beta c_i(\\mathbf{x}_i,\n", @@ -432,8 +430,10 @@ }, { "cell_type": "markdown", - "id": "c23bb658", - "metadata": {}, + "id": "cc7aaec1", + "metadata": { + "editable": true + }, "source": [ "Stochasticity/randomness is introduced by only taking the\n", "gradient on a subset of the data called minibatches. If there are $n$\n", @@ -444,8 +444,10 @@ }, { "cell_type": "markdown", - "id": "adea87fe", - "metadata": {}, + "id": "3a3a0d11", + "metadata": { + "editable": true + }, "source": [ "## SGD example\n", "As an example, suppose we have $10$ data points $(\\mathbf{x}_1,\\cdots, \\mathbf{x}_{10})$ \n", @@ -464,8 +466,10 @@ }, { "cell_type": "markdown", - "id": "5e5dee91", - "metadata": {}, + "id": "0acfc986", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\nabla_{\\beta}\n", @@ -477,8 +481,10 @@ }, { "cell_type": "markdown", - "id": "97047a5f", - "metadata": {}, + "id": "8d3f995d", + "metadata": { + "editable": true + }, "source": [ "## The gradient step\n", "\n", @@ -487,8 +493,10 @@ }, { "cell_type": "markdown", - "id": "d9a59d5c", - "metadata": {}, + "id": "8c73ac82", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\beta_{j+1} = \\beta_j - \\gamma_j \\sum_{i \\in B_k}^n \\nabla_\\beta c_i(\\mathbf{x}_i,\n", @@ -498,8 +506,10 @@ }, { "cell_type": "markdown", - "id": "a9b20c1c", - "metadata": {}, + "id": "f88656c1", + "metadata": { + "editable": true + }, "source": [ "where $k$ is picked at random with equal\n", "probability from $[1,n/M]$. An iteration over the number of\n", @@ -510,17 +520,22 @@ }, { "cell_type": "markdown", - "id": "3867a529", - "metadata": {}, + "id": "e80a498f", + "metadata": { + "editable": true + }, "source": [ "## Simple example code" ] }, { "cell_type": "code", - "execution_count": 45, - "id": "e5f4f9a8", - "metadata": {}, + "execution_count": 4, + "id": "626ac884", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "import numpy as np \n", @@ -541,8 +556,10 @@ }, { "cell_type": "markdown", - "id": "786c5900", - "metadata": {}, + "id": "3c9a754d", + "metadata": { + "editable": true + }, "source": [ "Taking the gradient only on a subset of the data has two important\n", "benefits. First, it introduces randomness which decreases the chance\n", @@ -555,8 +572,10 @@ }, { "cell_type": "markdown", - "id": "5f510fcf", - "metadata": {}, + "id": "2790ab60", + "metadata": { + "editable": true + }, "source": [ "## When do we stop?\n", "\n", @@ -574,8 +593,10 @@ }, { "cell_type": "markdown", - "id": "1f0043c6", - "metadata": {}, + "id": "3ea3ee12", + "metadata": { + "editable": true + }, "source": [ "## Slightly different approach\n", "\n", @@ -592,8 +613,10 @@ }, { "cell_type": "markdown", - "id": "fbc5d941", - "metadata": {}, + "id": "3c39cc08", + "metadata": { + "editable": true + }, "source": [ "## Time decay rate\n", "\n", @@ -608,18 +631,13 @@ }, { "cell_type": "code", - "execution_count": 46, - "id": "f96c423d", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "gamma_j after 500 epochs: 9.97108e-05\n" - ] - } - ], + "execution_count": 5, + "id": "294edbef", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "import numpy as np \n", "\n", @@ -649,8 +667,10 @@ }, { "cell_type": "markdown", - "id": "cdf1efeb", - "metadata": {}, + "id": "f60f930b", + "metadata": { + "editable": true + }, "source": [ "## Code with a Number of Minibatches which varies\n", "\n", @@ -659,37 +679,13 @@ }, { "cell_type": "code", - "execution_count": 47, - "id": "e221b4f3", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Own inversion\n", - "[[3.8913351 ]\n", - " [2.83275949]]\n", - "Eigenvalues of Hessian Matrix:[0.33918672 3.94965845]\n", - "theta from own gd\n", - "[[3.8913351 ]\n", - " [2.83275949]]\n", - "theta from own sdg\n", - "[[3.9644494 ]\n", - " [2.80907715]]\n" - ] - }, - { - "data": { - "image/png": "iVBORw0KGgoAAAANSUhEUgAAAkMAAAHFCAYAAADxOP3DAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjguMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy81sbWrAAAACXBIWXMAAA9hAAAPYQGoP6dpAABTP0lEQVR4nO3dd3wUZf4H8M+kbWgJBEgPJCCQgnSlRoi0RUAwhwj8jmY5leLlsADqnXDKcXh2UTlOhLOAjYB9ASEBlCJVj14MEAIh1AQCCcnu8/tj2SVLdrMlW2Z2Pu/XK6+8dmZ29pmZncw3T/k+khBCgIiIiEilAnxdACIiIiJfYjBEREREqsZgiIiIiFSNwRARERGpGoMhIiIiUjUGQ0RERKRqDIaIiIhI1RgMERERkaoxGCIiIiJVYzBEJENLliyBJEnmn6CgIMTExGDUqFE4fPiwz8o1a9YsSJLks89XgmPHjkGSJLzyyiu+LgoROSjI1wUgItsWL16M5ORklJWV4eeff8acOXOQk5ODAwcOoFGjRr4uHhGRX2AwRCRjbdu2RZcuXQAAffr0gV6vxwsvvICVK1di4sSJPi4d+VJFRYW51pCIaofNZEQKYgqMzpw5Y15WVlaGJ598Eh06dEB4eDgiIiLQvXt3fPXVV9XeL0kSpkyZgo8++ggpKSmoW7cu2rdvj2+//bbatt999x06dOgAjUaDpKQkm80+ZWVlmDlzJpKSkhASEoK4uDhMnjwZly5dstguMTERQ4YMwbfffouOHTuiTp06SElJMX/2kiVLkJKSgnr16uHOO+/E9u3b7Z4PU3NiTk4OHn/8cTRp0gSNGzdGZmYmTp06Ve3YZ82aVW0fiYmJmDBhQrV9rlu3Do888ggaN26MsLAwjBs3DqWlpSgsLMTIkSPRsGFDxMTE4KmnnkJFRUW1/RoMBsyZMwfNmjVDaGgounTpgrVr11bb7vDhwxgzZgwiIyOh0WiQkpKCd955x2Kb3NxcSJKEjz76CE8++STi4uKg0Whw5MgRXL16FU899RSSkpIQGhqKiIgIdOnSBcuWLbN7/ojIiP9SEClIXl4eAKB169bmZeXl5bhw4QKeeuopxMXF4fr16/jxxx+RmZmJxYsXY9y4cRb7+O6777Bt2zb8/e9/R/369fHyyy/jvvvuw8GDB9GiRQsAwNq1azFs2DB0794dn376KfR6PV5++WWLIAwAhBAYPnw41q5di5kzZyI9PR2//fYbXnjhBWzevBmbN2+GRqMxb//rr79i5syZeO655xAeHo7Zs2cjMzMTM2fOxNq1a/GPf/wDkiRh+vTpGDJkCPLy8lCnTh275+Xhhx/G4MGDsXTpUuTn5+Ppp5/GH//4R6xbt87lc/3www8jMzMTn376KXbt2oVnn30WlZWVOHjwIDIzM/GnP/0JP/74I+bNm4fY2FhMmzbN4v3z589H8+bN8cYbb8BgMODll1/GoEGDsH79enTv3h0AsG/fPvTo0QPNmjXDq6++iujoaKxatQpPPPEEzp07hxdeeMFinzNnzkT37t2xYMECBAQEIDIyEtOmTcNHH32El156CR07dkRpaSn27NmD8+fPu3zsRKojiEh2Fi9eLACILVu2iIqKCnH58mWh0+lEdHS0uOuuu0RFRYXN91ZWVoqKigrx0EMPiY4dO1qsAyCioqJESUmJeVlhYaEICAgQc+fONS/r2rWriI2NFdeuXTMvKykpEREREaLqnw2dTicAiJdfftnicz777DMBQCxcuNC8rHnz5qJOnTri5MmT5mW7d+8WAERMTIwoLS01L1+5cqUAIL7++muHztOkSZMslr/88ssCgDh9+rTFsb/wwgvV9tG8eXMxfvz4avucOnWqxXbDhw8XAMRrr71msbxDhw6iU6dO5td5eXkCgM3z169fP/OygQMHivj4eFFcXGyxzylTpojQ0FBx4cIFIYQQOTk5AoC46667qpW/bdu2Yvjw4dWWE5Hj2ExGJGPdunVDcHAwGjRoAK1Wi0aNGuGrr76q1k/kiy++QM+ePVG/fn0EBQUhODgYixYtwv79+6vtMyMjAw0aNDC/joqKQmRkJI4fPw4AKC0txbZt25CZmYnQ0FDzdg0aNMDQoUMt9mWqeanazAQA999/P+rVq1etWahDhw6Ii4szv05JSQFg7A9Vt27dastNZbLn3nvvtXjdrl07p95vzZAhQyxem8o0ePDgasutfY6t87dhwwbo9XqUlZVh7dq1uO+++1C3bl1UVlaaf+655x6UlZVhy5YtFvv8wx/+UO1z7rzzTvzwww+YMWMGcnNzce3aNZePmUitGAwRydiHH36Ibdu2Yd26dXj00Uexf/9+jB492mKb7OxsjBw5EnFxcfj444+xefNmbNu2DQ8++CDKysqq7bNx48bVlmk0GvND9OLFizAYDIiOjq623a3Lzp8/j6CgIDRt2tRiuSRJiI6OrtZUExERYfE6JCSkxuXWym/NrcdkapqrTWDgTFmtldPW+bt+/TquXLmC8+fPo7KyEm+//TaCg4Mtfu655x4AwLlz5yzeHxMTU22fb731FqZPn46VK1ciIyMDERERGD58uE9TMBApDfsMEclYSkqKudN0RkYG9Ho93n//fXz55ZcYMWIEAODjjz9GUlISPvvsM4scQOXl5S59ZqNGjSBJEgoLC6utu3VZ48aNUVlZibNnz1oEREIIFBYW4o477nCpDJ6g0WisnhNP9a2xdf5CQkJQv359BAcHIzAwEGPHjsXkyZOt7iMpKcnitbUcT/Xq1cPs2bMxe/ZsnDlzxlxLNHToUBw4cMA9B0Pk51gzRKQgL7/8Mho1aoS//e1vMBgMAIwPyJCQEIsHZWFhodXRZI4wjebKzs62qPG4fPkyvvnmG4tt+/btC8AYkFW1fPlylJaWmtfLQWJiIn777TeLZevWrcOVK1c88nm2zl96ejoCAwNRt25dZGRkYNeuXWjXrh26dOlS7cdaLV5NoqKiMGHCBIwePRoHDx7E1atX3X1YRH6JNUNECtKoUSPMnDkTzzzzDJYuXYo//vGPGDJkCLKzszFp0iSMGDEC+fn5ePHFFxETE+NyU8mLL74IrVaL/v3748knn4Rer8e8efNQr149XLhwwbxd//79MXDgQEyfPh0lJSXo2bOneTRZx44dMXbsWHcdeq2NHTsWf/3rX/G3v/0NvXv3xr59+zB//nyEh4d75PMCAwPRv39/TJs2DQaDAfPmzUNJSQlmz55t3ubNN99Er169kJ6ejscffxyJiYm4fPkyjhw5gm+++cah0XBdu3bFkCFD0K5dOzRq1Aj79+/HRx99hO7du1v0wyIi2xgMESnM1KlTMX/+fPz973/H6NGjMXHiRBQVFWHBggX44IMP0KJFC8yYMQMnT560ePA6o3///li5ciWef/55PPDAA4iOjsakSZNw7do1i31KkoSVK1di1qxZWLx4MebMmYMmTZpg7Nix+Mc//mExrN7Xnn76aZSUlGDJkiV45ZVXcOedd+Lzzz/HsGHDPPJ5U6ZMQVlZGZ544gkUFRUhLS0N3333HXr27GneJjU1FTt37sSLL76I559/HkVFRWjYsCFatWpl7jdkz913342vv/4ar7/+Oq5evYq4uDiMGzcOzz33nEeOi8gfSUII4etCEBEREfkK+wwRERGRqjEYIiIiIlVjMERERESqxmCIiIiIVI3BEBEREakagyEiIiJSNVXkGTIYDDh16hQaNGhgNZ09ERERyY8QApcvX0ZsbCwCAjxXf6OKYOjUqVNISEjwdTGIiIjIBfn5+YiPj/fY/lURDDVo0ACA8WSGhYX5uDRERETkiJKSEiQkJJif456iimDI1DQWFhbGYIiIiEhhPN3FhR2oiYiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNV8Hgxt2LABQ4cORWxsLCRJwsqVK21u++ijj0KSJLzxxhteKx8RERH5N58HQ6WlpWjfvj3mz59f43YrV67E1q1bERsb66WSERERkRoE+boAgwYNwqBBg2rcpqCgAFOmTMGqVaswePBgL5WMiIiI1MDnNUP2GAwGjB07Fk8//TTS0tJ8XRwiIiLyMz6vGbJn3rx5CAoKwhNPPOHwe8rLy1FeXm5+XVJS4omiERERkR+Qdc3Qjh078Oabb2LJkiWQJMnh982dOxfh4eHmn4SEBA+WkoiIiJRM1sHQxo0bUVRUhGbNmiEoKAhBQUE4fvw4nnzySSQmJtp838yZM1FcXGz+yc/P916hiYiISFFk3Uw2duxY9OvXz2LZwIEDMXbsWEycONHm+zQaDTQajaeLR0RERH7A58HQlStXcOTIEfPrvLw87N69GxEREWjWrBkaN25ssX1wcDCio6PRpk0bbxeViIiI/JDPg6Ht27cjIyPD/HratGkAgPHjx2PJkiU+KhURERGphc+DoT59+kAI4fD2x44d81xhiIiISHVk3YGaiIiIyNMYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1nwdDGzZswNChQxEbGwtJkrBy5UrzuoqKCkyfPh2333476tWrh9jYWIwbNw6nTp3yXYGJiIjIr/g8GCotLUX79u0xf/78auuuXr2KnTt34q9//St27tyJ7OxsHDp0CPfee68PSkpERET+SBJCCF8XwkSSJKxYsQLDhw+3uc22bdtw55134vjx42jWrJlD+y0pKUF4eDiKi4sRFhbmptISERGRJ3nr+R3ksT17SHFxMSRJQsOGDW1uU15ejvLycvPrkpISL5SMiIiIlMjnzWTOKCsrw4wZMzBmzJgaI8S5c+ciPDzc/JOQkODFUhIREZGSKCYYqqiowKhRo2AwGPDuu+/WuO3MmTNRXFxs/snPz/dSKYmIiEhpFNFMVlFRgZEjRyIvLw/r1q2z226o0Wig0Wi8VDoiIiJSMtkHQ6ZA6PDhw8jJyUHjxo19XSQiIiLyIz4Phq5cuYIjR46YX+fl5WH37t2IiIhAbGwsRowYgZ07d+Lbb7+FXq9HYWEhACAiIgIhISG+KjYRERH5CZ8Prc/NzUVGRka15ePHj8esWbOQlJRk9X05OTno06ePQ5/BofVERETKo5qh9X369EFN8ZiM0iARERGRH1LMaDIiIiIiT2AwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkakG+LgAREZFX6fXAxo3A6dNATAyQng4EBvq6VORDDIaIiEg9srOBP/8ZOHny5rL4eODNN4HMTN+Vi3yKzWRERKQO2dnAiBGWgRAAFBQYl2dn+6Zc5HMMhoiIyP/p9cYaISGqrzMty8oybkeqw2CIiIj838aN1WuEqhICyM83bkeqw2CIiIj83+nT7t2O/AqDISIi8n8xMe7djvwKgyEiIvJ/6enGUWOSZH29JAEJCcbtSHV8Hgxt2LABQ4cORWxsLCRJwsqVKy3WCyEwa9YsxMbGok6dOujTpw/27t3rm8ISEZEyBQYah88D1QMi0+s33mC+IZXyeTBUWlqK9u3bY/78+VbXv/zyy3jttdcwf/58bNu2DdHR0ejfvz8uX77s5ZISEZGiZWYCX34JxMVZLo+PNy5nniHVkoSwNs7QNyRJwooVKzB8+HAAxlqh2NhYZGVlYfr06QCA8vJyREVFYd68eXj00Ucd2m9JSQnCw8NRXFyMsLAwTxWfiIiUwN0ZqJnR2mO89fyWdQbqvLw8FBYWYsCAAeZlGo0GvXv3xqZNm2wGQ+Xl5SgvLze/Likp8XhZiYhIIQIDgT593LMvZrT2Cz5vJqtJYWEhACAqKspieVRUlHmdNXPnzkV4eLj5JyEhwaPlJCIiFfKHjNZ6PZCbCyxbZvztiaST3viMWpJ1MGQi3dLZTQhRbVlVM2fORHFxsfknPz/f00UkIiI18YeM1tnZQGIikJEBjBlj/J2Y6N4gzhuf4QayDoaio6MBoFotUFFRUbXaoqo0Gg3CwsIsfoiIiNxG6RmtvVGrpaCaM1kHQ0lJSYiOjsaaNWvMy65fv47169ejR48ePiwZERGpmpIzWnujVkthNWc+D4auXLmC3bt3Y/fu3QCMnaZ3796NEydOQJIkZGVl4R//+AdWrFiBPXv2YMKECahbty7GjBnj24ITEZF6KTmjtTdqtRRWc+bz0WTbt29HRkaG+fW0adMAAOPHj8eSJUvwzDPP4Nq1a5g0aRIuXryIrl27YvXq1WjQoIGvikxERGpnymhdUGC99kOSjOvlmNHaG7VaCqs583kw1KdPH9SU6kiSJMyaNQuzZs3yXqGIiMh3lJC3x5TResQIY+BT9Tkm94zW3qjVUljNmc+byYiIiMwUMvoIgHIzWntjnjaFzQXHYIiIiORBQaOPzDIzgWPHgJwcYOlS4++8PPkGQoB35mlT2FxwspqOw1M4HQcRkczp9cYaIFudbk19cPLy7D9AldDMJgfWsmcnJBiDFHcFc7X8DG89vxkMERGRkS+DiNxcY5OYPTk5NU+lwekxjBy9lt645i58xu+5J7Dq38fwzbpK/FDUV91zkxERkZf4Oohwx+gjUzPbrf/jm5rZ5NyPx52cuZbunKfNFgc+4+q5q1j/7l7osq9Ct68ZDlUkAWgGwDtzi7JmiIhI7WwFEaa+Hd4IImpbM+TOZjYlk8O1dIAwCBz4/nfo3s+H7qf6WH++LcoRal4fhAr0CN+LPp0L8Pd1Q9hM5g4MhoiIbJBLEGEqh728PbbK4a5mNiWTy7W0oeRkCda+vQ+6r69Dd7gFTujjLdY3CzwJbavfob03BHdPTkF4s3CvPb/ZTEZEpGbOZAr2ZBBR27w9ck/y542+OXK5ljcYKg349YtD0C0phG5rQ2wqTkMlupnXa1CG3o33QNvrCrQPJyD5nhaQAuJr2KPnMBgiIlIzOQURprw91vq7WBt9VDXAOHPGsc/wRZI/b/XHksG1PHfwPNbMPwjd9wasOtYaZwzJAJLN61sH50GbegLazLroPSkNdZt08VhZnMFgiIhIzeSWKTgzExg2zH4tirUAIzDQ/sSf5865v8w18WanbleuZS1rrPTX9dj24X788NE56HY0wbbSVAjcnEi9Hq6gb/ReaPuUY+CjiWjRJwlAksP79xb2GSIiUrPa9tXxBVsBhiMSErx3LN7uw+PstXSxxur07jNYNf8wdKsDsPpkCi6KRhbr24UehLbdaWgfCEePh1OhCdO4fEjsM0RERJ6ntDm29HrjA9zV/+O92GfG6314nLmWTtRYXb9yHZve3wfdp5eg+zUGv5a1ARBlfktD6RIGxO+Dtp8eAybdhrgubQC0qf3xeBGDISIitXO2r44v2QswHOGtTtS+6MPjyLWsKaAUApAkVD4+FYs+b4Qf1tfF2sJUXEEH8yYSDOhSbz+0nc5C+3+Ncef4FASF9qi+LwVhMERERI731fE1dwQO3ur/5Kv+WPaupQM1VkFFp7DsMwnr0RUAECmdxcCkg9BqJfSf0gZNU9LcW2YfYzBERERG3shGXFu1CRxMfWa8NVO6aeZ2e314PFGemq6lgwFlRp0tGNAL0I6PQocH2iAgqJf7yiczDIaIiHyFE4o6z16AYSKH/k8y6491+dRlrJu/D0c/KcI0B7Z/4ftu8g+O3STA1wUgIlKl7GzjyJ+MDGDMGOPvxETjcrLNFGAANwMKE0ky/jz9NBAXZ7kuPt43U1FkZgKffw40aeL18giDwK+fH8S8QbnIaLQLEXGhGD63K54+MQX5iIcBkvU3SpJx1J23atBkgEPriYi8TSHzR8matWHhCQmWnYRdrXVzZ42dtXI2aQK8+y5w//2u7bMGF45exJq39kP3vR6631uj0BBlsf624GPQJh/HhJSt6PTFDGM4ZK3GSibfQW89vxkMERF5k8znj1IUTzQzujNbtBeCXv11PbZ/tB+6j89Bt70xfrmSCgNunoO6KMXdkXuh7X0NAx9NxG19m1uWr6aA0hduuaYl7dsjPCKCwZA7MBgiItnghKLy5c7gxYNBb+FvRVj19iFj0sP8ZFwQERbr22oOQ3t7AbQjw9Dr0bSakx7Kqd+aleCsJDYW4adOMekiEZFfkcH8UWSFA7l3kJVlHLLuSLDgxoSLFVcrsOk/e28kPYzG7mvJACLN68NRjP5x+6DtV4mBk29D/B2tALSyX0bAPSMI3RFQ2QpET52qXdkcxGCIiMib5DYXGBm5O1t0LYPe4z+fxKr3foduXQh+PJ2Ky1WSHgJAl7r7oO1UBO2YCHSdmIqg0O6OfZ67uaNZsbZZxd2AwRARkTf5MvcM2ebuGjsng96yS2XY8N5e6L68DN2eBOy/3hJAvHmzJtI5DGx+EFotMGBKa0SmpQJIdewzPMVdk9C6I6t4LTEYIiLyJpnlnqEb3F1jZyfoFZKEyibRWPCWAT+M3Ibcs2m4hs7m9QHQo3uDvdDeeQHacZHoNCYZAUE9Hftsb3Bns6IMmoQZDBEReZuS5gJTC3fX2AUGAq+/bnX4vIDxIx44Ox8rVtxtXh4XcBra245AOyQIfaekoFFSOxcPxgtyc93XrCiDJmEGQ0REvqCUucDUwt01dtnZEH/5i9W0hvlIQBbewHcYjL6NdkLbowTah+KQNuw2SAG+Dwzsys4GHnnEsW0dqfVxNKu4BzEYIiLyFSXMBaYmbqixu5h3CfufeA/dv30WArAIhgw3fq9OeAgPTojHh5MqUD+6kxsPwAts9ROyxZFan5oCUS9hniEiUh855VbxJ/5yXp04DkOlATs+OQDdh0XQbYvAL5eT8TtaIg4nrc93peSkmvZyJ1XlynFayzMUF4fwggImXXQHBkNEZObODMN0kzvPq8yDqjN7zmL1/IPQ6SSsPtEG58TNecd6Ixe58NOkmo4mDAWMwZArGbZ9lIGazWREpB7uGgpMltx5Xp0JqrwUNFVcrcCWD/ZBt+widLuisPNaCoCm5vVhKEa/2P3Q9r2O+1ruBWY5sFMZjKBymqNlbtwYWLjQtXvp1qbjkhLn9+EC1gwRkTpwTjDPcOd5dWY6DA/X8OVvPQXdO0egWxuCH0+loAThFus71dkPbccz0I5uhG4PpiK4brBxhT9Pt+Losf34I9C3r1s+khO1uhGDISLy64eUL7nrvDoTVH31ldsnQC27VIaNC0xJD+Oxr/w2i/WNpfMY2OwAtFqBAVPaIKptU+s7Mh2HvSH6Sgy6fXBs3np+s5mMiNSBc4J5hrvOq6PTYeTmui3Z35G1x6FbcAw/rK+LHCtJD7s12AvtHTeSHo5ug8AQB5Ie+nNSTT8+NgZDRKQOnBPMM9x1Xh0NqubPdznZ35XCK8h9dx90K69Btz8RRyubA2h+s4gBhdC2PIxBQ4LQb2qVpIe2+ibZWu7PSTX99NjYTEZE6uDPzRe+5K7z6sxIJUcsXQrxwCjs/eoIdIsKoNsUho0X03AdGvMmwbiOXg33Qtu9GNoHY3F7ZitIAbekSbTVN2n0aGDZspr7LMl8VFyteOnY2GfIjRgMERGAmx10AetV/K6OJvPnh54j3HFe7QVVTvpX/Jt489T9KDBY1kglBuVjUJs8aIdpkDE5FQ1iG9jeibMJBmv7PaJqGAy5EYMhIjKz9p9+QoLrVfzMW2TkjvNqK6hyggESTiIeSciDAYEIxTVkNN0DbfpVaP/UDK36J1av/bHGmQSDVbGG0a0YDLkRgyEisuCumhxnhoKrgTvOq7WgykGGG5NfZAXNR1C7VGhHNED6o6moE1HH6X3VutmOoxLdgsHQDZWVlZg1axY++eQTFBYWIiYmBhMmTMDzzz+PgACryc6rYTBERG7HvEWeYwqqli83dph20JW6kbj63EuIfNbBSURrsmwZMGaM6+9futTYr4hqhUPrb5g3bx4WLFiA//73v0hLS8P27dsxceJEhIeH489//rOvi0dEniL3fjiODgW3MqqJ7AgMxMl6bfDr4VYY7MDm+mdmInDQANRPT0d9d31HajuqkKMSFUX2wdDmzZsxbNgwDB5svCUSExOxbNkybN++3cclIyKPUUI/HOYtcqvyknL89O+90H1eAt3/4rCnvBUCMBnH8C/EoQABsD1SLfAfL7o/UE5PN37nnO3QbaoRTE93b3nIoxxrZ/KhXr16Ye3atTh06BAA4Ndff8VPP/2Ee+65x8clIyKPMPXDubXWxTTPVXa2b8p1K+YtqrWj647jnZHrMTTqF0SEV6LfM53wyvY+2FPeChIMuLP+PmxKewQSACHd0unZ00n+TAkGq36WPQpPPKhmsu8zJITAs88+i3nz5iEwMBB6vR5z5szBzJkzbb6nvLwc5eXl5tclJSVISEhgnyEiuVNSPxzmLXJaaVGpMelh9lXoDjTHkYpEi/XRAWegbXEI2nsC0W9KMhq3ijCucPcIQGfY+uxRo6rnGfJWmVSEHahv+PTTT/H000/jX//6F9LS0rB7925kZWXhtddew/jx462+Z9asWZg9e3a15QyGiGROafOHeSpvkZ8QBoH93x6FbtFJ6H5qgA0X0lCOUPP6IFSgV8M90HYrhnZiDNqNaG172Lsv+5A5m4Ga3IbB0A0JCQmYMWMGJk+ebF720ksv4eOPP8aBAwesvoc1Q0QK5egIHjmN1PFlrYW3OfDwLz5RjLXz90P3zXXoDrdEvj7OYn3zwJMY1OZ3Y9LDSSkIi+ffZLKNo8luuHr1arUh9IGBgTAYDDbfo9FooNFobK4nIplSYj+czEzjpKD+XkNgo1O74bXXsft6GnT/PQPd1kbYVJIGPbqZN9GgDH0a74E2vRTaRxLQRpsEKSDeBwdAZJvsg6GhQ4dizpw5aNasGdLS0rBr1y689tprePDBB31dNCJyN3sjeOQ6UicwUB7Ndp5iI7mk4eRJYORIvIQvsQI3a8HahPwObWo+tH+oh7seS0XdJl28XWIip8i+mezy5cv461//ihUrVqCoqAixsbEYPXo0/va3vyEkJMShfTDpIpGCsB+OvOj1EM0TgYKTsNabxwAJBYjFn6M+x4C7KzHwsSQk3ZXg7VL6D/ZDssA+Q27EYIhIYdTUD0emCrafxqp3juDEt79h1rkp9t8gl07tSqaE/Fpexj5DRKReaumHIyPXr1zHzwv3QvdZMX74LRb/K2sNIAaj4OAcYUwuWTu25rkz5ddijahHMRgiInnyRT8clTVR5G3Ih+69POhyNVhbmIZSdDSvk2DAHfX2YUDLM8BvDuxMTp3alUavN9YIWWuoEcLYRJyVZfwHwfR9VNl31dOcCoby8/ORkMC2YCLyQypoorh67irWv7vXmPRwXzMcqkgCcPNvelRAEQYmHoL2ngD0n9IGTdq0BfQpQOKryuvUriTOznOngu+qtzkVDCUnJ2PatGmYMWMG6tWr56kyERF5l582UQiDwIHvf4fu/XzofqqP9efbohx3mNcHoQI9wvdC2/UStBOi0f7+1ggIirTciWlaihEjjIGPtU7tnH6idpyZ585Pv6u+5lQH6k2bNuEvf/kL8vPzMWfOHEycONGTZXMbdqAmIpuUNAWIA0pOlmDt2/ug+/o6dIdb4ITeMqdPQmABBrU6Cu29Ibh7cgrCm4U7tmN2avccRzOv//gjMGGC33xXHSHr0WQffvghnnvuOTRp0gSvv/46+sh8BAGDISKySWlTgNxCGAR+/eIQfvjgNHRbG2JTcRoqEWxer0EZejfeA22vK9A+nIDke1rYnvLCHjn0U3FnGeRwPKZyODLP3eLFQL9+9vcn0++qK2Q9mmzcuHG4//77MXfuXAwePBgDBgzAv/71L9x2223uLh8ROUouf9iVxpkmCpk4f/gC1rx9ALrvDViV1wqFhjYA2pjXtwrOw6DUE9Bm1kXvSWnuS3ro6+SS7uwrI6d+N442RRYVObY/GX1XFUO4qLS0VGzcuFFkZWWJgIAAodFoxLRp00RJSYmru/SY4uJiAUAUFxf7uihEnrF8uRDx8UIY/4waf+LjjcupZjk5lufN1k9Ojs+KWFleKTb/53/ihd45omu9/wkJeoui1cNlMTRqi3jngVxxZO0xn5XTo5YvF0KSql8XSTL+OPNdd+e+3MnafZyQcLM8Cviuupu3nt9ONZMtWLAA27Ztw7Zt27B//34EBgaiXbt26NatGzp06IBPPvkEhw4dwooVK9Cli3zSr7OZjPyarQ6VzNjsGEebKLzcD+P07jNYNf8wdKsDsPpkCi6KRhbrbw89BO3tp6B9IBw9H0mFJkzjv7WD7uzXJfc+YjVdQ5l+Vz3Ja89vZyKn+Ph4MWLECPHKK6+In376SZSVlVXbZs6cOSItLc1NsZp7sGaI/FZlZfX/JG/9Tzchwbgd2WaqKbi1tsCLNQXll8tFzuu7xPSuOaJ96IFql7KhdFHcH79JLJqwQZzcdsr6Mfhr7aA7a0SUXrsig++qN3nr+e10niF7HnroIfz1r391MTQjIqc4m5/EWf5a03CrzExjDZq1PiTuHi1V5ZwWngvCVz83wQ/r62JtYSquoIN5MwkGdKm3H9pOZ6H9v8a4c3wKgkK7W9+nvw+3dme/LgX2EbPgze+qirg9A3VkZCTWrVvn7t0SkTWe/MMupw6m3uCFKUDK/7sM4okshJYYO8JGA7gH8ViFN3EFXdFUOgtt0kFotRL6T2mDpilp9nfqSvZipXE0u7Uj27lzX77C6WrcjhO1EimZp4aFsx+SWwiDwKFVedD9Jx8lP27Fc5dnABAIqLKNARIkCOT9+U0kvjIFAUEBtnZnncJTAzjEnX1lVNjvRsm89fx28q4jIllJTzf+4ZZs5I2RJGNiPGemSrBX0wAYaxr0eqeLqwaXT13GV89uxeNpG9BCcxLJ97TAtBW9MOHy27g1EAKAAAhIkoQW2a8gQHLhf1OlN/s4wjT0HKj+XXc2C7Y790V+g8EQkZJ54g+7M/2Q1ESvN9bCLFtm/H0jGBQGgV8/P4h5g3KR0WgXIuJCMXxuVyzYdxeOVSYgBOXIavA+EnDS9h/c2pxTf2j2cYSpr0xcnOXy+HjnayrduS/yC5y1nkjp3N2hUg01Dc6y0n/qav2m+KD+E/hH0cM4fUvSw9uCj0GbfBzazLroMykV9daGAWMc+BxXzqmpdlANE6m6s68M+91QFQyGiPyBO/+wq6WmwVHZ2RA3+k9VrXsLvXIOk678DeuQilUYiLsj90Lb+xoGPpqI2/omAki8ubEnz6naJlJ1ZxZsX2fUJtlgB2oissQOpgCAwt+KsOat/bhnyf1opD9rtYlLACgPj4KU9zs0jera3pk3zqlSJ1JVS/oGcgk7UBORb6i0g2nF1QpsePtXPNsjF53q7kdM+0gsWiTQ2EYgBAASgNDiM9D8+kvNO/fGOc3MBI4dM44aW7rU+DsvT96BUHa2MUjMyADGjDH+Tkw0LifyIjaTEVF1KknsdmJzAXTvHIVuXQh+PJ2Ky2hvsb5nyDbgugM7cqSvjzfOqZKaffw9USQpCpvJiMg2P2vCKLtUhg3v7YXuy8vQ7UnA/ustLdY3kc5hYPOD0GqBAVNaI/LsXvfn8PGzc+oSuc8PRrLhrec3gyEi8lvCIHB4zTHoFp6AbmNd5J5NwzXc7NsTAD26N9gL7Z0XoB0XiU5jki2THrL/lGeoIVEkuYW3nt9sJiMiv3Kl8Apy3tmHH1aUQXcwEXmVSQCSzOvjAk5De9sRaIcEoe+UFDRKamd7Z2obqeUtTN9AMsNgiIgUTRgE9qw4DN0Hp6DbHIaNF9uiAnea1wfjOtIb7cGgHiXQPhSHtGG3QQpwYgi7SvpPeRXTN5DMsJmMvIv9JfyDj6/jxbxL+PHt/dB9Wwnd0dtwymD50EwKOoFByXnQDq+DjMmpqB9dv/Yfyu+u+7D5kRzEZjLyP2qbBd1f+eA6GioN2PHJAeg+LIJuWwS2XE6DAd3N6+vgKjKa7oX2rqvQPtoct/VtDimgmXsLoaSRWnLH5keSGdYMkXdwFnT/4MXreGbPWayefxA6nYTVJ9rgnGhisT5VcwTatiehHdEA6Y+lIbRhqFs+l7xIqYkiyWs4msyNGAz5GIfR+gcPX8fKskps+WAfdEsvQLcrEjuuplqsD0Mx+sXuh7bvdQx8vCWadY+zsScfY3Oac3i+qAZsJiP/4cws6GyGkC8PXMf8raew6t2j0K0Nwo8FqSiG5ciuTnX2Q9vxDLSjG6Hbg6kIrtutFgfgBWwKdh6bH0kGGAz5Ozn818VhtM6Tw3W7lRuuY3lJOTYu2Avd5yXQ7YnD3vJWAGLN6xtL5zGw2QFotQIDprRBVNsUACm1K7e32Muo/PnnQJMm8rqmRASAwZB/k8t/qYcPO7Ydh9EayeW63crF4dBH1h6HbsEx6DbUQU5RGq6ik3ldAPToWn8ftHech3ZsU3T+v2QEhvR0rlxyCBz1euM1s9brwLRs1CjjdiZyuKZEBIB9hvyXXDos2yrHrWVinyEjuVw3axwcDl26dQ9y3jsA3cpr0O1PxNHK5habxQQUQtvyMLSDA9FvSgoiWja6uX9ngxq5BI6OZlSuSg7XlEjm2IHajVQXDMmlw7K9clS1fDkfCHK5bjUxBWuARUAkIAEQWB4yCpuvd0IhYlGAOGxEOgKhR6+Ge6HtXgztg7G4PbMVpACp+n6dDWrkFDguW2acdd1ZcrimRDLmtee3UIHi4mIBQBQXF/u6KN6RkyOE8RFR809OjjzKMXu2Z8uhFHK5bvYsXy70MbEWZapAoNWyXm0QKa7+52O7+xOSVP39kmT8Wb68+nsqK4WIj7d9jiRJiIQE43be4Oi1k+s1JZIpbz2/A+wFS6RAcumw7Oj+W7XybDmUQi7XzQpDpQE7Pt6POf1zkT6xJUJP/44+yMFryIIBxr4/1tS5XIQ6fxprrMWxxpG+NllZln1tAOdGtnlDerqxhkeS7G9rDQcPEPkUO1D7I7nM+yOXciiFzM7X2f3nsPrtg9DpBFYda4OzwnJk19ngWEzEJ5AqALshQFYWMGxY9aYgV4fryy1wrCmjsiN4DxD5FIMhf2T6L9XevD/p6eooh1L4+HxVllVi6+IbSQ93RmLH1WQI3BzZVR+X0S9mL7QZ1zHw8RZIrDwFZJy1v+Oa8g+5GtTILHAEYHtC18DA6jVbJrwHiGSBwZA/ksu8P3Iph1L44Hyd3HYaq945At2PQVhjJelhhzoHoG1fCO2ohuj+UCpC6ldJeviXV537MGuBj6tBjVwD7cxMYw1Y1VFxZ88CDzxgXM97gEiePNojSSZU14HaZPny6p1MExKsd0hVQzmUwoPnq6y4TKx9Zad4qkuOaKs5VK0fb4R0Xoxq9rNY8vBGcWpXYc1ldEcnYVNHaGsdqO11hDZ1vL71vTV1vPYV3gNELvHW81sRQ+sLCgowffp0/PDDD7h27Rpat26NRYsWoXPnzg69X3VD66uSQ0I6OZVDKdx4vn7PPQHdgjzockOx7kwaSlHfvE6CAV3r74W2y3lo/9gEXcamIDDEzuc4kzIBsD983MZwfYeGyCthok/TtSwoMNYSNW0KxMXxHiByAPMM3XDx4kV07NgRGRkZePzxxxEZGYmjR48iMTERLVu2dGgf1U4mH8zycOt16NED2LRJPtdFod+Tq+euIvedvdBlX4VufzMcrkiyWB8VUARt0iEMGhyAflOS0bhVhHMf4GyCQUmyn/OnNkGNnK+TXJJCEikU8wzdMH36dNGrV69a7cOims1adXV8PKurvc3adQgMlM91UdD3xKA3iL1fHRav3psj+kdsFxpcsyh2EK6L3uG7xNyBOWLXpweEvkJfuw9cutTxpjFnmoIqK41NaUuXGn97K0eQp7iSP4mILLCZ7IbU1FQMHDgQJ0+exPr16xEXF4dJkybhkUcesfme8vJylJeXm1+XlJQgISEBxR99hLBx46p3uGRafO9yZIoOwHfXRU6ZjW0oPlGMtfP3Q/fNdegOt0S+Ps5ifbPAkxjU+ndoh2lw9+QUhMW78T8qR2uGXn8dmDpVPrU03qSEbOJECsBmshtCQ0MBANOmTcP999+PX375BVlZWfj3v/+NcePGWX3PrFmzMHv27GrLi2NjEXbqlPUP4h8n73B3fxN7n+Vs84lMH2KGSgN2f3YQuv+egW5rI2wqSYO+ymBQDcrQp/EeaNNLoX0kAW20SdWnvHAXB+coU/W95GjAmJNTPd0AEZmxmeyG4OBg0b17d4tlU6dOFd26dbP5nrKyMlFcXGz+yc/PN1azMS2+77k6bYGz18XVZi4ZTYlx9sA5sXTKz2Jci40iKuBMtSK0CTkq/twhV/zw4jZRerbU4+WxoKSRXL7gaFPi0qW+LimRrHmrmUz2eYZiYmKQmppqsSwlJQXLly+3+R6NRgONRuPaBzItvmeYamlquG41cua62GrmKigwLq+pmcuHmY0ryyqx7cP90H1yHrodTbCtNBUCPczr6+My+kbvgzajHAMfS0LSXS0AtKh5p57qXGwrwWB8vLxGcvmKHJNCEpFNsg+GevbsiYMHD1osO3ToEJo3b+6ZD1TqHyeljahxlqPXxd5cV5Jke2oIZz7HTd+TUzsLsWr+Yeh+DMSakym4KG63WN8u9CC07U5j0OiG6PFwKkLqd3V8554eyWQtwaCcvne+JNekkERknUfrndzgl19+EUFBQWLOnDni8OHD4pNPPhF169YVH39sZybsKszVbLGxriV3kzs5j3yyNaLG0R9nr0ttm7lqkwTQAeWXy8W6V3eKZ+7MEe1CD1TbfUPpohiZ8LP4YOIGUbDjtEufIYTgSCY5YFMiUa15q5lM9sGQEEJ88803om3btkKj0Yjk5GSxcOFCp95vPpkffeR/f5zk/NAzBRa1CYScPQZ39NVw80Ps9/UnxLuj1ot7o7eI+iix3CX04s56/xN/uytHbPr3b6LiWoVT+7bK3nlXcuAvF46mAWDmaaJaYTDkRnbzDCn1j5PcH3rOdpa+Nc+QK9fFXR2ga/E9KT1bKr6f/Yt4on2uaB38e7WPjpSKxLgWG8XSKT+LswfOOXd8jpBRJ3C/5GxNrL/lTyLyInag9hR/6uewcWPN/XCEsD1buDc408l49mxgxgzHMlDX1D/KXX01nPieCIPAQV0edP/Jh25jPaw/n4Yy3GFeH4hK9AzfA23XS9BOiEb7+1sjIKiX4+fGWT7sBO73XOmcHxjI4fNEMqe+YAjwnz9Ocn/oOdPJ+P33geees39d7HUKNs38/oc/WH+/EI7PEl7D96TkZAnWvbMfuq/KoTvUAsf1liO7EgILMKjVUWjvDcHdk1MQ3qyD/c9zF45k8ozads4nItlSZzDkL+T+0DPV0jgyisyRGqzaDJmvJWEQ+PWLQ9AtPg3dlob4uTgNlbg5sisE5egdsQfaXpehfSgeKUNaQgqIq2GPHuRI7ViTJsb1ubnKrRn1NrnXxBKRy2Sfgdod/HbWeiVkAs7Otl1Lc6ulS4HRo62vczQz9JEjQMuWzmeQttL0dv73Yqx5+wB03xuwKq8VCg1RFrtqFZwHbcoJaDProvfjqagXWc+x4/QGWzPBW8OJQx2zbBkwZoz97Wr6HhORU7z1/GbNkJKZmoRGjDA+5Ks+9EzzaDnaJOQpmZnG/kAvvGB/25pqsBz9r/zdd53/791K09sZKQqTxHxkY4R5WT1cwd1Re6HtU4aBf0pEy7uTAFjOCC8bw4YBs2YZvx8XLtS8rRdq1vyC3GtiichlDIaUzt2ZgD2RvPG554D//Md+bU1NnZod7fd09Khj293Y38VXP0DDpx4yFqPK6qaiCF9gJJ4MfgvBHdpC+0A4ej6SCk2YE0kPfcVav6pGjYzXtqSk+vae6u8i50SgrmAiRSL/5dGxajLhraF5PuWO4bueTN5Y29w9jg4Xf/11h7b7d8rrolPoHnEC8UJvYxsDHEhNILdh07VNcumu4fZyTgRaG0ykSORVzDPkRqoIhpx160P8iy88n7yxNjmeHM0MXV5e43Z6SOI4EkQAKkVv5NQuQJDbA7+2SS4B90wcKudEoO7gT7nKiGTOW89vdqBWI2vNKIGBxmYNa2rbEbtqc0lkpHFZUZHzTSe2OgWb+kfd6PNS/t9lCJlg7OhatenLcOPVQ1iEyqRWeLTlj+j142z7n2utQ6ytkW23lMWrcnOBjIza7SMnp3YjoRzt6O7LTv3u4G9NgEQy5bXnt0dDLZlgzVAVtWlGcaUJxd21J1b2Z0hIECefe1e8cV+u0Db5RYTiqrgPy8UJWG53SdNUHHniTaGv0Bv35WqmZrlm/nZ0KhJPlpnZr4nIjZiBmtyvpqRxjnA2eaMn8gLdyAx9dcUq7PtoBzb8GoZ3Tg7D73MSLTbbFtgNL7b8EP/XYR+69AxFvXYtEZ6ejvCq/7272iFWrvlmXB3F5M6Rh3JPBEpEZAWDIXv8qTrc3kPcHmcetm7O1isMAv/LPgzdB6eg2xyOny71QwXuMa8PQTnuitgDbY/L0D4cj9ShLSEFxAKoodnI1dQEcn3gOxLcRUQAdeq4Z+ShNRx+TkQKxGCoJvamflAaVx/OrgwZdkPtyYWjF/Hj/P3QfaeH7mgrnDa0BtDavL5l0HEMSjkGbWZd9JmUinqRna1/Vk0BrSupCeT6wHckuFu40LNz83H4OREpkUcb4WTCpTZHfxwR4+ws8rU5Xkf7r1QZvVRZXim2frBHzM7IEd3r/yYCUGmxaV1cEYMjt4q3R+SKwz8ec6wcjvZZcmaIvKMj23w1zN7Xo504/JyI3ISjydzI6d7ochkR4+4mOnvTdwDVR5UlJLjWhOLgyKYL72fj261NoVstYfWJZJwXjS3Wp2kOQ9u2ANqRYej1p1SENgx1vAyeHPHl4Mg2n/F18661WlVXv0tEpFreGk3GYMgaR4co13YYck081URn7yH+2WdA06a1f4jaCbwEgDOIRhxOwoCb+2+IC3iiyTL0TilC21G3I/LR+2r3+Z4MaPnAr5mvAzIiUjwGQ27k9Ml0dELG5583zv/k7j/wns5h48pD3JUH243jEAKQcPNYTPl+RuBLrEAmOtfdB23HIvxf6k4kf/8apIKCm/twNQD0VkDLBz4RkccwGHIjj9UMAe7vUO2tJjpnHuJO1lKVXSrDxgV7ofvyMip/3YunKv+JBNx870nE4cumk9DkD73Rf3JrRLVt6v4AkDOMExEpHoMhN3K5z1BNfWtM3N1HRA5NdFU5EKSI4ffhyNrj0P37OHQb6iLnbBquoa550yBcx2N1PsLdLY4hdWhLtJr1fwjQBN/clycCQLmdRyIT1iYSOcxbwRCH1ltT0xDlW7mQM6dGcsphYydXkABwcdTj6GrogCP6FgASzatjA05D2/IItEOC0G9qCholPWT7czyRxJBDvEmO/C1dB5GfCPB1AWTLlH8mLs7+tlUf1rUlpxw2doIUCUBERRHi9CcQjOu4u9FOvHxPLn778hBOVkRj0aF03P9adzRKaljz53giADQFtMDNWixzwd2YcZnIUaZa1lvvKVNG9uxs35SLiBgM1SgzEzh2zNhR2hHuqK0x1Wjc+gCvyks1Gld+PeLQdq8O34gLp69j7YVOePq7Prj9D60hBdRQ/lt5KgC0FdDGx/t+6Dupi72M7ICxdtnWZMlE5FEMhuwJDAT69nVsW3fU1tRUo2Fy7Rrw1Ve1/6xbGCoN2P7hPrzULxc9w37DvVlJDr2v85/TUT+6vusfbC8AlCTjcP+CAmNfIGceGKaANifH2Fk6J8fY98gfAiG93ng+li1z/ryQdznTFExEXscO1I6w16HaE0kYs7OBP/0JOH/e+ucBbqndKNp7FqvnH4JOB6w63gbnRBPzugDoUYB4RKEQVsMUdx63rfxH1rCPBfueKA1HNxK5xFsdqFkz5AhTbY2th7QQ7u9/MmwYEGoj23ItqtUryyrx07u/4fleuehSbx+i2jbF2AU98cmxnjgnmqABSnBfzBYsHLsBeZsKEb38HUiS5Pl+N8700VJ7Hwt39T1hzZL3yKkvIBFV59HJPmTCLXObLF9e8xxb7p5vydF5xHJy7O7qxJYC8Z9xG8Qf4jaJcFyqtouOdfaJmd1zxPq3dovrpdetH7u35royzRH28cdCNGlS85xpvpz/y1dM86LV9rw4OmcbuYfc57MjkinOTeZGbmsm8+ZcZbWoVi8vKTcmPfy8BLo9cdhb3spifWPpPAY0OwDtAIEBU1ojul2k/c/xdm4U5gmyzh3nxdMZzsk6uc9nRyRDzDMkJ57Ig2OPk9XqR9cdxw/vHYNuQx3kFKXhKjqZNwmAHl3r74P2jvPQjm2Kzv+XjMCQns6VJzDQu0GHnPItyUltz4u9UU3uzJlFlkxNwdb6enE+OyKfYjDkCF88mO0kDRSShLIGkZg+1YAfDh7DkYpEAM3N62MCCqFteRjawYHoNyUFES1vd1/ZvIF9LKyr7XnxRWBPN2VmGgNNZqAmkhUGQ45w5gHkruakqlmwrRECb5WMw9t77gYABOM6ejXcC233YmgfjMXtma0gBUQ7/7lywQzS1tX2vLDGzfe8XctKRHYxGHIkeLH3AAKM7/n2W2DsWMv/vCMijNXizz3ndFB0qXNfnOk8Gq23L602tF0AeBqvoGF8GKLH9sfdU1LRILajU/uXtZqmRFFzBunanhfWuBERVaPuDtTO5Gqx1enUUY0bAwsX1tgvwFBpwK5PD0L33zPQ/dIIW0uScRS3IQ4nreZAEJIEyd0dt+3xdkdqa9coIYF9LFw9L77ImUVE5CLOWu9GVk+mKyNqvvwSGDWqdvlYli+32O/Z/eew+u2D0OkEVh1rg7OiqXldb+QiFzIaUeWrRH+c5ds6V88LRzURkUIwGHKjaifT1aHyjg5rroGIj8fmZ7+Bbtkl6HY2xfbSFIgq9T71cRn9YvZCm3Edma1+Q9PZU+3v1BtZazkcuzolB2mscSMiBeDQek9ydUSNGzqVSidP4tlJl7AeN/fboc4BaNsXQjuqIbo/lIqQ+t2MK3INwGwHdurp/h1KH47tiaBF6dNhcFQTEZGZOoMhV0fUuCnoaIXDiGkWAu0AAwZMboWYDskAkqtvKJcRVUoeju2JoMVWLZlpOgyl1JJxVBMREQC1zk3m6ogaO7OrO9reuGB1Cyw73gPj/9MLMR2ibG9Y0wz23hxRpdTh2O6aw6sqe7VkgEtzxhERke+oMxiyE9RAkoz9J26tcakSnIhb3mu48bvGgOjGfgPv7uN4WW1NYBof770aCCUOx/ZU0OJMLRkRESmC4oKhuXPnQpIkZGVlub4TF2pchEFg39dH8Np/IzC73jwUiFiLtxUgHp+GjMe1YBsdvGpTk5OZCRw7Zhw1tnSp8XdenveaYlwNHn3JU0GLUmvJiIjIJkX1Gdq2bRsWLlyIdu3a1X5nDswTVHKyBGvf3gfd19ehO9wCJ/S3AbgNQB/8HdMwIiAb/aP/h+Te0Wg3dzRGN28E6BcBc+YYg60LF6zu1yW+7N+hxASIngpalFhLRkRENVLM0PorV66gU6dOePfdd/HSSy+hQ4cOeOONNxx6b41D86qMNDJERuHXwijoPjwL3daG2FSchkoEmzfVoAx9Gu+BNr0U2kcS0EabBCnARm2Jkodd26Kk4diemvWeSQuJiLyGQ+tvMXnyZAwePBj9+vXDSy+9VOO25eXlKC8vN78uKSmxue25I5ewZnkIdN8nYNWx1jhjiLRY3zo4D9rUExg0oh7ueiwVdZt0cazA/jhSR0nDsT01Ek+JtWRERFQjRQRDn376KXbu3Ilt27Y5tP3cuXMxe7b1BD3663r8smQfdJ+ch25HE2wrTYVAD/P6eriCvtF7oe1TjoGPJqJFnyQASe44DP+glCDPk0GLA02sRESkHLJvJsvPz0eXLl2wevVqtG/fHgDQp0+fGpvJrNUMJSQk4L641cg91QUXRSOL7duFHoS23WloHwhHzz+lIaR+iMeOh7zMk017/tgUSkQkI5yO44aVK1fivvvuQ2CVh4xer4ckSQgICEB5ebnFOmtMJxMoBhCGhtIlDIjfB20/PQZMug1xXdjZ1a8xaCEiUiT2Gbqhb9+++N///mexbOLEiUhOTsb06dPtBkJVTe+xEcPGN8Md41IQFNrD/hvIPyilaY+IiHxC9sFQgwYN0LZtW4tl9erVQ+PGjastt+fZH9I9GlmSCrCWiYjI78g+GCKSDaVPzkpERFbJvs+QO3irzZH8mK3JWU0j05QyOSsRkYKwA7UbKSoY8rdmGH84HlOiRVvTezDRIhGRR3jr+a24ucn8Wna28aGbkQGMGWP8nZjo2uzqcuDr49HrjZmoly0z/nZ1JnlOzkpE5NcYDMmFqRnm1oduQYFxudICIl8fjzsDMU7OSkTk1xgMyYFeb+yYa63F0rQsK8v1mg1v8/XxuDsQ4+SsRER+jcGQHPhbM4wvj8cTgZhpnjPJxqS8kmTMau3sPGdERCQLDIbkwN+aYXx5PJ4IxEzznAHVAyJOzkpEpHgMhuTA35phfHk8ngrETJOzxsVZLo+P57B6IiKFY9JFOTA1wxQUWG/eMQ3dVkozjC+Px5OBWGYmMGyY8lMFEBGRBdYMyYG/NcP48ng83b/HNM/Z6NHG30q5JkREZBODIbnwt2YYXx2PvwWWRETkccxALTf+kLG5Kl8dj7V5xBISjIGQ0gJLIiKV4nQcbiSbYMjfAh254/kmIlI0bz2/2YHaWzjjufeZ+vcQERHVgH2GvMHXU1MQERGRTQyGPM3XU1MQERFRjRgMeZq/TbVBRETkZxgMeZq/TbVBRETkZxgMeZq/TbVBRETkZxgMeRpnPCciIpI1BkOexozIREREssZgyBv8baoNIiIiP8Kki95S04znzJRMRETkMwyGvMlaRmRmpiYiIvIpNpP5EjNTExER+RyDIV9hZmoiIiJZYDDkK8xMTUREJAsMhnyFmamJiIhkgcGQrzAzNRERkSwwGPIVZqYmIiKSBQZDvsLM1ERERLLAYMiXmJmaiIjI55h00ddqykxNREREHsdgSA6sZaYmIiIir2AzGREREakagyEiIiJSNQZDREREpGoMhoiIiEjVGAwRERGRqsk+GJo7dy7uuOMONGjQAJGRkRg+fDgOHjzo62IRERGRn5B9MLR+/XpMnjwZW7ZswZo1a1BZWYkBAwagtLTU10UjIiIiPyAJIYSvC+GMs2fPIjIyEuvXr8ddd93l0HtKSkoQHh6O4uJihIWFebiERERE5A7een4rLulicXExACAiIsLmNuXl5SgvLze/Likp8Xi5iIiISJlk30xWlRAC06ZNQ69evdC2bVub282dOxfh4eHmn4SEBC+WkoiIiJREUc1kkydPxnfffYeffvoJ8fHxNrezVjOUkJDAZjIiIiIFYTPZLaZOnYqvv/4aGzZsqDEQAgCNRgONRuOlkhEREZGSyT4YEkJg6tSpWLFiBXJzc5GUlOTrIhEREZEfkX0wNHnyZCxduhRfffUVGjRogMLCQgBAeHg46tSp4+PSERERkdLJvs+QJElWly9evBgTJkxwaB922xz1emDjRuD0aSAmBkhPBwIDa1FqIiIiqi32GbrB47Fadjbw5z8DJ0/eXBYfD7z5JpCZ6dnPJiIiIp9T1NB6t8vOBkaMsAyEAKCgwLg8O9s35SIiIiKvUW8wpNcba4Ss1TyZlmVlGbcjIiIiv6XeYGjjxuo1QlUJAeTnG7cjIiIiv6XeYOj0afduR0RERIqk3mAoJsa92xEREZEiqTcYSk83jhqzMXQfkgQkJBi3IyIiIr+l3mAoMNA4fB6oHhCZXr/xBvMNERER+Tn1BkOAMY/Ql18CcXGWy+PjjcuZZ4iIiMjvyT7posdlZgLDhjEDNRERkUoxGAKMgU+fPr4uBREREfmAupvJiIiISPUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKqmmGDo3XffRVJSEkJDQ9G5c2ds3LjR10UiIiIiP6CIYOizzz5DVlYWnnvuOezatQvp6ekYNGgQTpw44euiERERkcJJQgjh60LY07VrV3Tq1AnvvfeeeVlKSgqGDx+OuXPn2n1/SUkJwsPDUVxcjLCwME8WlYiIiNzEW89v2dcMXb9+HTt27MCAAQMslg8YMACbNm3yUamIiIjIXwT5ugD2nDt3Dnq9HlFRURbLo6KiUFhYaPU95eXlKC8vN78uLi4GYIwwiYiISBlMz21PN2LJPhgykSTJ4rUQotoyk7lz52L27NnVlickJHikbEREROQ558+fR3h4uMf2L/tgqEmTJggMDKxWC1RUVFSttshk5syZmDZtmvn1pUuX0Lx5c5w4ccKjJ1NuSkpKkJCQgPz8fFX1leJx87jVgMfN41aD4uJiNGvWDBERER79HNkHQyEhIejcuTPWrFmD++67z7x8zZo1GDZsmNX3aDQaaDSaasvDw8NV9SUyCQsL43GrCI9bXXjc6qLW4w4I8GwXZ9kHQwAwbdo0jB07Fl26dEH37t2xcOFCnDhxAo899pivi0ZEREQKp4hg6IEHHsD58+fx97//HadPn0bbtm3x/fffo3nz5r4uGhERESmcIoIhAJg0aRImTZrk0ns1Gg1eeOEFq01n/ozHzeNWAx43j1sNeNyePW5FJF0kIiIi8hTZJ10kIiIi8iQGQ0RERKRqDIaIiIhI1RgMERERkaopMhh69913kZSUhNDQUHTu3BkbN26scfv169ejc+fOCA0NRYsWLbBgwYJq2yxfvhypqanQaDRITU3FihUrPFV8lzlz3NnZ2ejfvz+aNm2KsLAwdO/eHatWrbLYZsmSJZAkqdpPWVmZpw/FKc4cd25urtVjOnDggMV2/na9J0yYYPW409LSzNso4Xpv2LABQ4cORWxsLCRJwsqVK+2+xx/ub2eP21/ub2eP21/ub2eP21/u77lz5+KOO+5AgwYNEBkZieHDh+PgwYN23+eNe1xxwdBnn32GrKwsPPfcc9i1axfS09MxaNAgnDhxwur2eXl5uOeee5Ceno5du3bh2WefxRNPPIHly5ebt9m8eTMeeOABjB07Fr/++ivGjh2LkSNHYuvWrd46LLucPe4NGzagf//++P7777Fjxw5kZGRg6NCh2LVrl8V2YWFhOH36tMVPaGioNw7JIc4et8nBgwctjqlVq1bmdf54vd98802L483Pz0dERATuv/9+i+3kfr1LS0vRvn17zJ8/36Ht/eX+dva4/eX+dva4TZR+fzt73P5yf69fvx6TJ0/Gli1bsGbNGlRWVmLAgAEoLS21+R6v3eNCYe68807x2GOPWSxLTk4WM2bMsLr9M888I5KTky2WPfroo6Jbt27m1yNHjhRardZim4EDB4pRo0a5qdS15+xxW5Oamipmz55tfr148WIRHh7uriJ6hLPHnZOTIwCIixcv2tynGq73ihUrhCRJ4tixY+ZlSrjeVQEQK1asqHEbf7m/q3LkuK1R4v1dlSPH7S/3d1WuXG9/uL+FEKKoqEgAEOvXr7e5jbfucUXVDF2/fh07duzAgAEDLJYPGDAAmzZtsvqezZs3V9t+4MCB2L59OyoqKmrcxtY+vc2V476VwWDA5cuXq012d+XKFTRv3hzx8fEYMmRItf8sfak2x92xY0fExMSgb9++yMnJsVinhuu9aNEi9OvXr1qWdjlfb1f4w/3tDkq8v2tDyfe3O/jL/V1cXAwANU7C6q17XFHB0Llz56DX66vNVh8VFVVtVnuTwsJCq9tXVlbi3LlzNW5ja5/e5spx3+rVV19FaWkpRo4caV6WnJyMJUuW4Ouvv8ayZcsQGhqKnj174vDhw24tv6tcOe6YmBgsXLgQy5cvR3Z2Ntq0aYO+fftiw4YN5m38/XqfPn0aP/zwAx5++GGL5XK/3q7wh/vbHZR4f7vCH+7v2vKX+1sIgWnTpqFXr15o27atze28dY8rZjqOqiRJsngthKi2zN72ty53dp++4GoZly1bhlmzZuGrr75CZGSkeXm3bt3QrVs38+uePXuiU6dOePvtt/HWW2+5r+C15Mxxt2nTBm3atDG/7t69O/Lz8/HKK6/grrvucmmfvuJqGZcsWYKGDRti+PDhFsuVcr2d5S/3t6uUfn87w5/ub1f5y/09ZcoU/Pbbb/jpp5/sbuuNe1xRNUNNmjRBYGBgtWivqKioWlRoEh0dbXX7oKAgNG7cuMZtbO3T21w5bpPPPvsMDz30ED7//HP069evxm0DAgJwxx13yOY/idocd1XdunWzOCZ/vt5CCHzwwQcYO3YsQkJCatxWbtfbFf5wf9eGku9vd1Ha/V0b/nJ/T506FV9//TVycnIQHx9f47beuscVFQyFhISgc+fOWLNmjcXyNWvWoEePHlbf071792rbr169Gl26dEFwcHCN29jap7e5ctyA8T/GCRMmYOnSpRg8eLDdzxFCYPfu3YiJial1md3B1eO+1a5duyyOyV+vN2AcrXHkyBE89NBDdj9HbtfbFf5wf7tK6fe3uyjt/q4Npd/fQghMmTIF2dnZWLduHZKSkuy+x2v3uMNdrWXi008/FcHBwWLRokVi3759IisrS9SrV8/cq37GjBli7Nix5u1///13UbduXfGXv/xF7Nu3TyxatEgEBweLL7/80rzNzz//LAIDA8U///lPsX//fvHPf/5TBAUFiS1btnj9+Gxx9riXLl0qgoKCxDvvvCNOnz5t/rl06ZJ5m1mzZgmdTieOHj0qdu3aJSZOnCiCgoLE1q1bvX58tjh73K+//rpYsWKFOHTokNizZ4+YMWOGACCWL19u3sYfr7fJH//4R9G1a1er+1TC9b58+bLYtWuX2LVrlwAgXnvtNbFr1y5x/PhxIYT/3t/OHre/3N/OHre/3N/OHreJ0u/vxx9/XISHh4vc3FyL7+3Vq1fN2/jqHldcMCSEEO+8845o3ry5CAkJEZ06dbIYljd+/HjRu3dvi+1zc3NFx44dRUhIiEhMTBTvvfdetX1+8cUXok2bNiI4OFgkJydb3Fxy4cxx9+7dWwCo9jN+/HjzNllZWaJZs2YiJCRENG3aVAwYMEBs2rTJi0fkGGeOe968eaJly5YiNDRUNGrUSPTq1Ut899131fbpb9dbCCEuXbok6tSpIxYuXGh1f0q43qah07a+t/56fzt73P5yfzt73P5yf7vyPfeH+9vaMQMQixcvNm/jq3tculFAIiIiIlVSVJ8hIiIiIndjMERERESqxmCIiIiIVI3BEBEREakagyEiIiJSNQZDREREpGoMhoiIiEjVGAwRERGRqjEYIiIiIlVjMERERESqxmCIiBRp2bJlCA0NRUFBgXnZww8/jHbt2qG4uNiHJSMipeHcZESkSEIIdOjQAenp6Zg/fz5mz56N999/H1u2bEFcXJyvi0dEChLk6wIQEblCkiTMmTMHI0aMQGxsLN58801s3LiRgRAROY01Q0SkaJ06dcLevXuxevVq9O7d29fFISIFYp8hIlKsVatW4cCBA9Dr9YiKivJ1cYhIoVgzRESKtHPnTvTp0wfvvPMOPv30U9StWxdffPGFr4tFRArEPkNEpDjHjh3D4MGDMWPGDIwdOxapqam44447sGPHDnTu3NnXxSMihWHNEBEpyoULF9CzZ0/cdddd+Pe//21ePmzYMJSXl0On0/mwdESkRAyGiIiISNXYgZqIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkav8PtFJUDcDRlWgAAAAASUVORK5CYII=", - "text/plain": [ - "
" - ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], + "execution_count": 6, + "id": "41a929b5", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "%matplotlib inline\n", "\n", @@ -763,8 +759,10 @@ }, { "cell_type": "markdown", - "id": "7e858f37", - "metadata": {}, + "id": "af8f3db9", + "metadata": { + "editable": true + }, "source": [ "## Replace or not\n", "\n", @@ -776,8 +774,10 @@ }, { "cell_type": "markdown", - "id": "7dace8c0", - "metadata": {}, + "id": "ce1d1147", + "metadata": { + "editable": true + }, "source": [ "## Momentum based GD\n", "\n", @@ -789,8 +789,10 @@ }, { "cell_type": "markdown", - "id": "3cd079d0", - "metadata": {}, + "id": "b8750f09", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\mathbf{v}_{t}=\\gamma \\mathbf{v}_{t-1}+\\eta_{t}\\nabla_\\theta E(\\boldsymbol{\\theta}_t) \\nonumber\n", @@ -799,8 +801,10 @@ }, { "cell_type": "markdown", - "id": "305a75c3", - "metadata": {}, + "id": "6b18d51a", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -815,8 +819,10 @@ }, { "cell_type": "markdown", - "id": "026d8598", - "metadata": {}, + "id": "efa3113f", + "metadata": { + "editable": true + }, "source": [ "where we have introduced a momentum parameter $\\gamma$, with\n", "$0\\le\\gamma\\le 1$, and for brevity we dropped the explicit notation to\n", @@ -832,8 +838,10 @@ }, { "cell_type": "markdown", - "id": "80e73593", - "metadata": {}, + "id": "2007f72c", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\Delta \\boldsymbol{\\theta}_{t+1} = \\gamma \\Delta \\boldsymbol{\\theta}_t -\\ \\eta_{t}\\nabla_\\theta E(\\boldsymbol{\\theta}_t),\n", @@ -842,16 +850,20 @@ }, { "cell_type": "markdown", - "id": "4a5b87d4", - "metadata": {}, + "id": "149a0faa", + "metadata": { + "editable": true + }, "source": [ "where we have defined $\\Delta \\boldsymbol{\\theta}_{t}= \\boldsymbol{\\theta}_t-\\boldsymbol{\\theta}_{t-1}$." ] }, { "cell_type": "markdown", - "id": "f9bbf0cd", - "metadata": {}, + "id": "3930d988", + "metadata": { + "editable": true + }, "source": [ "## More on momentum based approaches\n", "\n", @@ -864,8 +876,10 @@ }, { "cell_type": "markdown", - "id": "9e7986cc", - "metadata": {}, + "id": "8560c22c", + "metadata": { + "editable": true + }, "source": [ "$$\n", "m {d^2 \\mathbf{w} \\over dt^2} + \\mu {d \\mathbf{w} \\over dt }= -\\nabla_w E(\\mathbf{w}).\n", @@ -874,16 +888,20 @@ }, { "cell_type": "markdown", - "id": "50d69000", - "metadata": {}, + "id": "6f4563fe", + "metadata": { + "editable": true + }, "source": [ "We can discretize this equation in the usual way to get" ] }, { "cell_type": "markdown", - "id": "e7d9df0a", - "metadata": {}, + "id": "8fe2b7ac", + "metadata": { + "editable": true + }, "source": [ "$$\n", "m { \\mathbf{w}_{t+\\Delta t}-2 \\mathbf{w}_{t} +\\mathbf{w}_{t-\\Delta t} \\over (\\Delta t)^2}+\\mu {\\mathbf{w}_{t+\\Delta t}- \\mathbf{w}_{t} \\over \\Delta t} = -\\nabla_w E(\\mathbf{w}).\n", @@ -892,16 +910,20 @@ }, { "cell_type": "markdown", - "id": "e6f67ad8", - "metadata": {}, + "id": "207eae67", + "metadata": { + "editable": true + }, "source": [ "Rearranging this equation, we can rewrite this as" ] }, { "cell_type": "markdown", - "id": "443f0b02", - "metadata": {}, + "id": "9770730e", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\Delta \\mathbf{w}_{t +\\Delta t}= - { (\\Delta t)^2 \\over m +\\mu \\Delta t} \\nabla_w E(\\mathbf{w})+ {m \\over m +\\mu \\Delta t} \\Delta \\mathbf{w}_t.\n", @@ -910,8 +932,10 @@ }, { "cell_type": "markdown", - "id": "d89ab74d", - "metadata": {}, + "id": "c233679d", + "metadata": { + "editable": true + }, "source": [ "## Momentum parameter\n", "\n", @@ -924,8 +948,10 @@ }, { "cell_type": "markdown", - "id": "3401047f", - "metadata": {}, + "id": "cf54be10", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\gamma= {m \\over m +\\mu \\Delta t }, \\qquad \\eta = {(\\Delta t)^2 \\over m +\\mu \\Delta t}.\n", @@ -934,8 +960,10 @@ }, { "cell_type": "markdown", - "id": "c7c24040", - "metadata": {}, + "id": "35f187e7", + "metadata": { + "editable": true + }, "source": [ "Thus, as the name suggests, the momentum parameter is proportional to\n", "the mass of the particle and effectively provides inertia.\n", @@ -965,8 +993,10 @@ }, { "cell_type": "markdown", - "id": "22e04f6c", - "metadata": {}, + "id": "476338d5", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\mathbf{v}_{t}=\\gamma \\mathbf{v}_{t-1}+\\eta_{t}\\nabla_\\theta E(\\boldsymbol{\\theta}_t +\\gamma \\mathbf{v}_{t-1}) \\nonumber\n", @@ -975,8 +1005,10 @@ }, { "cell_type": "markdown", - "id": "65b1fa09", - "metadata": {}, + "id": "c23f6df7", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -991,16 +1023,20 @@ }, { "cell_type": "markdown", - "id": "7acccb8b", - "metadata": {}, + "id": "e36c0680", + "metadata": { + "editable": true + }, "source": [ "One of the major advantages of NAG is that it allows for the use of a larger learning rate than GDM for the same choice of $\\gamma$." ] }, { "cell_type": "markdown", - "id": "795e6ab5", - "metadata": {}, + "id": "484048bb", + "metadata": { + "editable": true + }, "source": [ "## Second moment of the gradient\n", "\n", @@ -1028,8 +1064,10 @@ }, { "cell_type": "markdown", - "id": "dec5061d", - "metadata": {}, + "id": "ed915ab1", + "metadata": { + "editable": true + }, "source": [ "## RMS prop\n", "\n", @@ -1041,8 +1079,10 @@ }, { "cell_type": "markdown", - "id": "3dfb0934", - "metadata": {}, + "id": "c4d8b1a8", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -1057,8 +1097,10 @@ }, { "cell_type": "markdown", - "id": "bf4b7a89", - "metadata": {}, + "id": "6819d54f", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\mathbf{s}_t =\\beta \\mathbf{s}_{t-1} +(1-\\beta)\\mathbf{g}_t^2 \\nonumber\n", @@ -1067,8 +1109,10 @@ }, { "cell_type": "markdown", - "id": "510c8591", - "metadata": {}, + "id": "c38fa00d", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\boldsymbol{\\theta}_{t+1}=\\boldsymbol{\\theta}_t - \\eta_t { \\mathbf{g}_t \\over \\sqrt{\\mathbf{s}_t +\\epsilon}}, \\nonumber\n", @@ -1077,8 +1121,10 @@ }, { "cell_type": "markdown", - "id": "1a0e569f", - "metadata": {}, + "id": "7ff83ef0", + "metadata": { + "editable": true + }, "source": [ "where $\\beta$ controls the averaging time of the second moment and is\n", "typically taken to be about $\\beta=0.9$, $\\eta_t$ is a learning rate\n", @@ -1093,8 +1139,10 @@ }, { "cell_type": "markdown", - "id": "977c9c79", - "metadata": {}, + "id": "ba98f789", + "metadata": { + "editable": true + }, "source": [ "## [ADAM optimizer](https://arxiv.org/abs/1412.6980)\n", "\n", @@ -1120,8 +1168,10 @@ }, { "cell_type": "markdown", - "id": "d188330b", - "metadata": {}, + "id": "03428756", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -1136,8 +1186,10 @@ }, { "cell_type": "markdown", - "id": "776b649a", - "metadata": {}, + "id": "ef5b461b", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\mathbf{m}_t = \\beta_1 \\mathbf{m}_{t-1} + (1-\\beta_1) \\mathbf{g}_t \\nonumber\n", @@ -1146,8 +1198,10 @@ }, { "cell_type": "markdown", - "id": "6f8a0d72", - "metadata": {}, + "id": "0149850a", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\mathbf{s}_t =\\beta_2 \\mathbf{s}_{t-1} +(1-\\beta_2)\\mathbf{g}_t^2 \\nonumber\n", @@ -1156,8 +1210,10 @@ }, { "cell_type": "markdown", - "id": "53f1a2ce", - "metadata": {}, + "id": "4ae41be8", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\boldsymbol{\\mathbf{m}}_t={\\mathbf{m}_t \\over 1-\\beta_1^t} \\nonumber\n", @@ -1166,8 +1222,10 @@ }, { "cell_type": "markdown", - "id": "cc7cd55a", - "metadata": {}, + "id": "5d36d54a", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\boldsymbol{\\mathbf{s}}_t ={\\mathbf{s}_t \\over1-\\beta_2^t} \\nonumber\n", @@ -1176,8 +1234,10 @@ }, { "cell_type": "markdown", - "id": "6bd6e651", - "metadata": {}, + "id": "08eb5528", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\boldsymbol{\\theta}_{t+1}=\\boldsymbol{\\theta}_t - \\eta_t { \\boldsymbol{\\mathbf{m}}_t \\over \\sqrt{\\boldsymbol{\\mathbf{s}}_t} +\\epsilon}, \\nonumber\n", @@ -1186,8 +1246,10 @@ }, { "cell_type": "markdown", - "id": "677f1aef", - "metadata": {}, + "id": "4a5e4b7b", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -1201,8 +1263,10 @@ }, { "cell_type": "markdown", - "id": "4bb1d86d", - "metadata": {}, + "id": "b71679d3", + "metadata": { + "editable": true + }, "source": [ "where $\\beta_1$ and $\\beta_2$ set the memory lifetime of the first and\n", "second moment and are typically taken to be $0.9$ and $0.99$\n", @@ -1218,8 +1282,10 @@ }, { "cell_type": "markdown", - "id": "812cca90", - "metadata": {}, + "id": "a9910c4b", + "metadata": { + "editable": true + }, "source": [ "$$\n", "\\Delta \\theta_{t+1}= -\\eta_t { \\boldsymbol{m}_t \\over \\sqrt{\\sigma_t^2 + m_t^2 }+\\epsilon}.\n", @@ -1228,8 +1294,10 @@ }, { "cell_type": "markdown", - "id": "51ddf251", - "metadata": {}, + "id": "85d963d2", + "metadata": { + "editable": true + }, "source": [ "## Algorithms and codes for Adagrad, RMSprop and Adam\n", "\n", @@ -1240,8 +1308,10 @@ }, { "cell_type": "markdown", - "id": "676bc1af", - "metadata": {}, + "id": "bc9de56d", + "metadata": { + "editable": true + }, "source": [ "## AdaGrad algorithm, taken from [Goodfellow et al](https://www.deeplearningbook.org/contents/optimization.html)\n", "\n", @@ -1254,8 +1324,10 @@ }, { "cell_type": "markdown", - "id": "5e0a4bd5", - "metadata": {}, + "id": "e6293208", + "metadata": { + "editable": true + }, "source": [ "## RMSProp algorithm, taken from [Goodfellow et al](https://www.deeplearningbook.org/contents/optimization.html)\n", "\n", @@ -1268,8 +1340,10 @@ }, { "cell_type": "markdown", - "id": "d9eccc07", - "metadata": {}, + "id": "40fde17d", + "metadata": { + "editable": true + }, "source": [ "## ADAM algorithm, taken from [Goodfellow et al](https://www.deeplearningbook.org/contents/optimization.html)\n", "\n", @@ -1282,8 +1356,10 @@ }, { "cell_type": "markdown", - "id": "b81a38cf", - "metadata": {}, + "id": "f9066e5f", + "metadata": { + "editable": true + }, "source": [ "## Practical tips\n", "\n", @@ -1300,8 +1376,10 @@ }, { "cell_type": "markdown", - "id": "2be4b8ad", - "metadata": {}, + "id": "cfac43d8", + "metadata": { + "editable": true + }, "source": [ "## Automatic differentiation\n", "\n", @@ -1336,8 +1414,10 @@ }, { "cell_type": "markdown", - "id": "78ce59cc", - "metadata": {}, + "id": "6c1afa20", + "metadata": { + "editable": true + }, "source": [ "$$\n", "f(x) = \\sin\\left(2\\pi x + x^2\\right)\n", @@ -1346,16 +1426,20 @@ }, { "cell_type": "markdown", - "id": "a1de3aaf", - "metadata": {}, + "id": "4c038cf3", + "metadata": { + "editable": true + }, "source": [ "which has the following derivative" ] }, { "cell_type": "markdown", - "id": "99aa41ec", - "metadata": {}, + "id": "eed0ca87", + "metadata": { + "editable": true + }, "source": [ "$$\n", "f'(x) = \\cos\\left(2\\pi x + x^2\\right)\\left(2\\pi + 2x\\right)\n", @@ -1364,36 +1448,23 @@ }, { "cell_type": "markdown", - "id": "76989f22", - "metadata": {}, + "id": "3f493ed1", + "metadata": { + "editable": true + }, "source": [ "Using **autograd** we have" ] }, { "cell_type": "code", - "execution_count": 48, - "id": "b9cd37f2", - "metadata": {}, - "outputs": [ - { - "data": { - "image/png": "iVBORw0KGgoAAAANSUhEUgAAApMAAAHFCAYAAACuKXKKAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjguMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy81sbWrAAAACXBIWXMAAA9hAAAPYQGoP6dpAACCb0lEQVR4nO3dd1xV9f8H8Ne5wGXvIVNARQRBUXBvza2paZaaOSstKzUbthwN82uZ1dcyrdwrU8u9Rw5UUMGBeyCKKKAMkX0/vz/4cn9eAQUEPsB9PR+P+1AO55z7up97xpszPkcRQggQEREREZWCSnYAIiIiIqq6WEwSERERUamxmCQiIiKiUmMxSURERESlxmKSiIiIiEqNxSQRERERlRqLSSIiIiIqNRaTRERERFRqLCaJiIiIqNRKVEwuWrQIiqJoXyYmJnB2dkaHDh0wY8YM3L17t1xC5r/v9evXy2X+ALBlyxZMnTq10N95eXlh+PDh5fbe+io2NhZTp05FREREmc+7JMvMTz/9hDp16kCtVkNRFCQlJZV5nvIwceJEKIqCXr16PfO8VqxYgTlz5jx7KMkqYluh76ZOnQpFUcpt/oqi6GyLo6KiMHXq1EK/0/bt2yMgIKDU7/X111/j77//LjA8fzkKDw8v9bwru3379kFRFOzbt6/E0z5pe/H491fWnnV/XB75nqUti+vw4cOYOnVqofun9u3bo3379uX23sVRqiOTCxcuRGhoKHbu3Im5c+ciKCgIM2fOhJ+fH3bt2lXWGdGzZ0+EhobCxcWlzOedb8uWLZg2bVqhv1u/fj0+++yzcntvfRUbG4tp06aVSzFZXBEREXjnnXfQoUMH7NmzB6GhobC0tJSWp7iys7OxbNkyAMC2bdtw69atZ5pfdSkmqeoLDQ3F6NGjtT9HRUVh2rRp5fIHQlHFJD3Zk7YXj39/+qBx48YIDQ1F48aNy+09Dh8+jGnTphVaTP7888/4+eefy+29i8OwNBMFBAQgJCRE+3P//v0xYcIEtG7dGi+88AIuXbqEGjVqPHO49PR0mJiYwNHREY6Ojs88v9Jq1KiRtPem8nX27FkAwGuvvYamTZs+cdyHDx/CzMysImI91T///IP4+Hj07NkTmzdvxuLFi/Hxxx/LjlVqlaltq6vs7GwoigJDw1Jt9itM8+bNZUegZ6BP31/+OmVlZSX1c/v7+0t773xlds1kzZo18d133yE1NRW//vqrzu/Cw8Px/PPPw87ODiYmJmjUqBH+/PNPnXHyTyvs2LEDI0eOhKOjI8zMzJCZmVng1NX48eNhbm6OlJSUAjleeukl1KhRA9nZ2QCA1atXo0uXLnBxcYGpqSn8/Pzw0UcfIS0tTTvN8OHDMXfuXADQOY2f/36PHlaPj4+HWq0u9Ejl+fPnoSgKfvzxR+2wuLg4vPHGG3B3d4darYa3tzemTZuGnJycYrXrihUr0KJFC1hYWMDCwgJBQUH4/fffdcb5448/0LBhQ5iYmMDOzg79+vXDuXPndMYZPnw4LCwscP78eXTt2hXm5uZwcXHBN998AwA4cuQIWrduDXNzc9StWxeLFy/WmT7/O9i5cydGjBgBOzs7mJubo3fv3rh69arOuEWdhnj0UPy+ffvQpEkTAMCIESO0bf7o6YfiLDf52Vu1agUTExO4urpi8uTJ2u//Sdq3b49XXnkFANCsWTMoiqLNnX/67N9//0XLli1hZmaGkSNHAgBu3LiBV155BU5OTjA2Noafnx++++47aDQa7byvX78ORVEwa9YszJw5E15eXjA1NUX79u1x8eJFZGdn46OPPoKrqyusra3Rr1+/El0m8vvvv0OtVmPhwoXw8PDAwoULIYTQGaeoU76Pn5Jp3749Nm/ejOjoaJ3lP9+9e/fw5ptvws3NDWq1GrVq1cInn3yCzMxMnfkmJSVh1KhRsLOzg4WFBXr27ImrV68W+F7zT5OeOHECAwYMgK2tLWrXrg0g7zt/+eWXte3l5eWFQYMGITo6ukAblPZ7z3f06FH07t0b9vb2MDExQe3atTF+/HidcQ4ePIhOnTrB0tISZmZmaNmyJTZv3lxoO+/ZswevvfYa7O3tYWVlhVdffRVpaWmIi4vDwIEDYWNjAxcXF0yaNEknZ/6y8p///AdfffUVatasCRMTE4SEhGD37t0673X58mWMGDECPj4+MDMzg5ubG3r37o3Tp0/rjJf/HS9duhTvvfce3NzcYGxsjMuXLwMAdu3ahU6dOsHKygpmZmZo1apVgfcCgM2bNyMoKAjGxsbw9vbGt99+W6y2nTt3LlQqlc4y/d1330FRFLz11lvaYRqNBra2tnjvvfe0wx5dXhYtWoQXX3wRANChQwftsrlo0SKd9wsLC0ObNm1gZmaGWrVq4ZtvvtFZHwujKArS0tKwePFi7XwfP1WYmpqKsWPHwsHBAfb29njhhRcQGxtbYF6rV69GixYtYG5uDgsLC3Tt2hUnT558ajvFx8fjzTffhL+/PywsLODk5ISOHTviwIEDOuPlLyPffvstZs+eDW9vb1hYWKBFixY4cuSIzrglWYcetXTpUiiKgtDQ0AK/mz59OoyMjBAbG/vU7UVhp5Fv3bqF119/HR4eHlCr1XB1dcWAAQNw584dAEBGRgbee+89BAUFwdraGnZ2dmjRogX++eefp7ZhUVJSUrTro4WFBbp164aLFy8WOu6lS5cwePBgnW16fk2Q70nr1OPb1Dlz5kBRFO369qgPP/wQarUaCQkJAICdO3eiT58+cHd3h4mJCerUqYM33nhD+3sgb5v5/vvvAwC8vb21bf7oNjx/2c3OzoaTkxOGDh1a4L2TkpJgamqKiRMn6rTTpEmT4O3tDbVaDTc3N4wfP16nRioWUQILFy4UAERYWFihv3/w4IEwMDAQnTp10g7bs2ePUKvVok2bNmL16tVi27ZtYvjw4QKAWLhwYYF5u7m5iddff11s3bpV/PXXXyInJ0f7u2vXrgkhhIiMjBQAxIIFC3Te//79+8LY2FhMnDhRO+yLL74Q33//vdi8ebPYt2+fmDdvnvD29hYdOnTQjnP58mUxYMAAAUCEhoZqXxkZGUIIITw9PcWwYcO04/fr1094eHiI3Nxcnff/4IMPhFqtFgkJCUIIIW7fvi08PDyEp6en+PXXX8WuXbvEF198IYyNjcXw4cOf2t6fffaZACBeeOEFsWbNGrFjxw4xe/Zs8dlnn2nH+frrrwUAMWjQILF582axZMkSUatWLWFtbS0uXryoHW/YsGFCrVYLPz8/8cMPP4idO3eKESNGCABi8uTJom7duuL3338X27dvF7169RIARHh4eIHvx8PDQ4wcOVJs3bpVzJ8/Xzg5OQkPDw9x//597biPt1e+du3aiXbt2gkhhEhOTtbO89NPP9W2eUxMjBCi+MvN2bNnhZmZmfD39xcrV64U//zzj+jatauoWbOmzjJTmLNnz4pPP/1UO8/Q0FBx+fJlbVY7Ozvh4eEhfvrpJ7F3716xf/9+cffuXeHm5iYcHR3FvHnzxLZt28S4ceMEADF27FjtvK9duyYACE9PT9G7d2+xadMmsWzZMlGjRg1Rt25dMXToUG07zps3T1hYWIjevXs/dZkQQoiYmBihUqnEiy++KIQQ2s+wb98+nfEeX2/y7d27VwAQe/fu1bZDq1athLOzs87yL4QQ6enpokGDBsLc3Fx8++23YseOHeKzzz4ThoaGokePHtp55ubmitatWwsTExPxzTffiB07dohp06YJHx8fAUBMmTJFO+6UKVO0bfPhhx+KnTt3ir///lsIIcSaNWvE559/LtavXy/2798vVq1aJdq1ayccHR1FfHx8mXzvQgixbds2YWRkJBo0aCAWLVok9uzZI/744w/x8ssva8fZt2+fMDIyEsHBwWL16tXi77//Fl26dBGKoohVq1YVaGdvb2/x3nvviR07doiZM2cKAwMDMWjQING4cWPx5Zdfip07d4oPP/xQABDfffeddvr8ZcXDw0O0bt1arF27VqxZs0Y0adJEGBkZicOHD2vH3b9/v3jvvffEX3/9Jfbv3y/Wr18v+vbtK0xNTcX58+cLfMdubm5iwIABYsOGDWLTpk0iMTFRLF26VCiKIvr27SvWrVsnNm7cKHr16iUMDAzErl27tPPYtWuXMDAwEK1btxbr1q3TZspv4yc5f/68ACBWrFihHdatWzdhamoqfHx8tMOOHj0qAIgtW7Zohz26vNy9e1e7jZs7d6522bx7964QIm89tbe3Fz4+PmLevHli586d4s033xQAxOLFi5+YMTQ0VJiamooePXpo53v27Fmd77RWrVri7bffFtu3bxe//fabsLW11dl3CCHEV199JRRFESNHjhSbNm0S69atEy1atBDm5uba+T2pncaOHStWrVol9u3bJzZt2iRGjRolVCqVdv0U4v+XES8vL9GtWzfx999/i7///lsEBgYKW1tbkZSUpB23uOvQ49uBzMxM4ezsLIYMGaKTMTs7W7i6umq3N0/aXjz+/QkhxM2bN4WLi4twcHAQs2fPFrt27RKrV68WI0eOFOfOnRNCCJGUlCSGDx8uli5dKvbs2SO2bdsmJk2aJFQqVYHvsaj9y6M0Go3o0KGDMDY2Fl999ZXYsWOHmDJliqhVq1aBfGfPnhXW1tYiMDBQLFmyROzYsUO89957QqVSialTpxZor8LWqcfbMj4+XqjVavHJJ5/o5MrJyRGurq7ihRde0A775ZdfxIwZM8SGDRvE/v37xeLFi0XDhg2Fr6+vyMrKEkLkbfPffvttAUCsW7dO2+bJyclCCN19qxBCTJgwQZiammp/n+/nn38WAMSpU6eEEEKkpaWJoKAgne/mhx9+ENbW1qJjx45Co9E8sZ0fVabFpBBC1KhRQ/j5+Wl/rlevnmjUqJHIzs7WGa9Xr17CxcVFW5Dlz/vVV18t8n0f3UE0btxYtGzZUme8/IY6ffp0odk0Go3Izs4W+/fvFwBEZGSk9ndvvfVWkRvIxxfeDRs2CABix44d2mH5C0n//v21w9544w1hYWEhoqOjdeb37bffCgBP3NBcvXpVGBgYFFixH3X//n3txvBRN27cEMbGxmLw4MHaYcOGDRMAxNq1a7XDsrOzhaOjowAgTpw4oR2emJgoDAwMdIry/O+gX79+Ou916NAhAUB8+eWX2mHFKSaFECIsLKxAcZivuMvNSy+9JExNTUVcXJx2nJycHFGvXr1iFRVFLdPt2rUTAMTu3bt1hn/00UcCgDh69KjO8LFjxwpFUcSFCxeEEP+/8W/YsKHOHx1z5swRAMTzzz+vM/348eMFgAIrf2GmT58uAIht27YJIfKWFUVRxNChQwv9bE8rJoUQomfPnsLT07PAe82bN08AEH/++afO8JkzZ+qsA5s3bxYAxC+//KIz3owZM4osJj///POnftacnBzx4MEDYW5uLn744Qft8Gf93mvXri1q164t0tPTixynefPmwsnJSaSmpuq8R0BAgHB3d9duaPPb+e2339aZvm/fvgKAmD17ts7woKAg0bhxY+3P+cuKq6urTp6UlBRhZ2cnnnvuuSIz5uTkiKysLOHj4yMmTJigHZ7/Hbdt21Zn/LS0NGFnZ1fgD5fc3FzRsGFD0bRpU+2wZs2aFZmpOMch3N3dxciRI4UQeYWKubm5tpjO3yZ+9dVXwsjISDx48EA73ePLy5o1awosr/ny19PH10d/f3/RtWvXp2Y0NzcvdFuV/52++eabOsP/85//CADi9u3bQoi8ba2hoWGB7z41NVU4OzuLgQMHPjXDo3JyckR2drbo1KmTzrY2fxkJDAwUOTk52uHHjh0TAMTKlSufOM/C1qHCtgNTpkwRarVa3LlzRzts9erVAoDYv3+/dlhR2wshCn5/I0eOFEZGRiIqKqo4TaDNnJ2dLUaNGiUaNWqk87viFJNbt24VAHQ+rxB5y9vj+bp27Src3d0LbHvHjRsnTExMxL1794QQRa9Tj/7u0bZ84YUXhLu7u872f8uWLQKA2LhxY6G582uU6OhoAUD8888/2t/NmjWryG3b4/vWU6dOCQBi/vz5OuM1bdpUBAcHa3+eMWOGUKlUBfZ/f/31V4E/8p6mzLsGEo+cart8+TLOnz+PIUOGAABycnK0rx49euD27du4cOGCzvT9+/cv1vuMGDEChw8f1pl+4cKFaNKkic7dfVevXsXgwYPh7OwMAwMDGBkZoV27dgBQ4FRwcXXv3h3Ozs5YuHChdtj27dsRGxurPRUKAJs2bUKHDh3g6uqq89m7d+8OANi/f3+R77Fz507k5ubqnBJ6XGhoKNLT0wucUvbw8EDHjh0LnLZSFAU9evTQ/mxoaIg6derAxcVF57pQOzs7ODk5FXpaJP+7zNeyZUt4enpi7969ReYsqZIsN3v37kWnTp10rtE1MDDASy+99Mw5bG1t0bFjR51he/bsgb+/f4HrK4cPHw4hBPbs2aMzvEePHlCp/n818/PzA5B3U9mj8offuHHjiZmEENpT2507dwaQd9qjffv2WLt2baGXfjyLPXv2wNzcHAMGDNAZnr/M5S9j+cvywIEDdcYbNGhQkfMubF1/8OABPvzwQ9SpUweGhoYwNDSEhYUF0tLSdNbXZ/neL168iCtXrmDUqFEwMTEpdJy0tDQcPXoUAwYMgIWFhc57DB06FDdv3iyw7Xr8rvonfdeFrVsvvPCCTh5LS0v07t0b//77L3JzcwHkrQtff/01/P39oVarYWhoCLVajUuXLhW6PXu8jQ8fPox79+5h2LBhOuuVRqNBt27dEBYWhrS0NKSlpSEsLKzITMXRqVMn7Q2Zhw8fxsOHDzFx4kQ4ODhg586dAPJOt+efHi4tZ2fnAutjgwYNnnpatzief/75AvMFoJ339u3bkZOTg1dffVWnPU1MTNCuXbti3d07b948NG7cGCYmJjA0NISRkRF2795d6PfZs2dPGBgYFJkHKP46VJixY8cCABYsWKAd9t///heBgYFo27btUz9LYbZu3YoOHTpo14eirFmzBq1atYKFhYW2HX7//fdS7afz90eP768GDx6s83NGRgZ2796Nfv36wczMrMC+JiMjo8BlBCWpUW7evKlzU/LChQvh7OysrQEA4O7duxgzZgw8PDy0n9vT0xNA6WuUwMBABAcH69Qo586dw7FjxwrUKAEBAQgKCtL57F27di3x3ellWkympaUhMTERrq6uAKC9HmLSpEkwMjLSeb355psAoHNdAIBi37E9ZMgQGBsba6+diYqKQlhYGEaMGKEd58GDB2jTpg2OHj2KL7/8Evv27UNYWBjWrVsHIO8Gn9IwNDTE0KFDsX79eu2dVYsWLYKLiwu6du2qHe/OnTvYuHFjgc9ev379Qj/7o+Lj4wEA7u7uRY6TmJgIoPA2c3V11f4+n5mZWYGdp1qthp2dXYHp1Wo1MjIyCgx3dnYudNjj7/UsSrLcJCYmFpnpWRXWromJiUW2d/7vH/V426rV6icOL6zNH7Vnzx5cu3YNL774IlJSUpCUlISkpCQMHDgQDx8+xMqVK5/yqUomv30f7wrGyckJhoaG2s+bmJgIQ0PDAp/rSTfiFdaOgwcPxn//+1+MHj0a27dvx7FjxxAWFgZHR0ed9fVZvvfirFv379+HEKLcvuuSrFtZWVl48OABgLzuoD777DP07dsXGzduxNGjRxEWFoaGDRsWuj17PH/+ujVgwIAC69bMmTMhhMC9e/dw//59aDSaZ1q3nnvuOdy4cQOXLl3Crl270KhRI+01gbt27UJ6ejoOHz6M5557rljzK4q9vX2BYcbGxqXevj9p3sbGxgD+f9+R355NmjQp0J6rV69+4jYeAGbPno2xY8eiWbNmWLt2LY4cOYKwsDB069at0PxPywMUfx0qTI0aNfDSSy/h119/RW5uLk6dOoUDBw5g3LhxT5zuSeLj45+4rgHAunXrMHDgQLi5uWHZsmUIDQ1FWFgYRo4c+dRtYmHyt0ePt9fjy25iYiJycnLw008/Ffj+8g+8lLZG6d69O1xcXLQF3f3797Fhwwa8+uqr2j8INBoNunTpgnXr1uGDDz7A7t27cezYMW0B+yzL8MiRIxEaGorz588DyCtkjY2Ndf7Av3PnDk6dOlXgs1taWkII8dTl91Flelvf5s2bkZubq70Q1MHBAQAwefJkvPDCC4VO4+vrq/Nzcfsvs7W1RZ8+fbBkyRJ8+eWXWLhwIUxMTHQaas+ePYiNjcW+ffu0RyMBlEk/giNGjMCsWbOwatUqvPTSS9iwYQPGjx+v81ejg4MDGjRogK+++qrQeeTvlAqTf/f6zZs34eHhUeg4+SvK7du3C/wuNjZW2/5lKS4urtBhderU0f5sYmJS4OYMIG+lLE6mkiw39vb2RWZ6VoUti/b29kW2N4ByafNH5d98NXv2bMyePbvQ37/xxhsAoP3D4fHvoiQbCHt7exw9ehRCCJ32uHv3LnJycrSf197eHjk5Obh3755O8fSk7+Hx9k1OTsamTZswZcoUfPTRR9rhmZmZuHfvXoFcpf3eH123imJrawuVSlWh33VRn0etVmuPji5btgyvvvoqvv76a53xEhISYGNjU2D6x9s4P/NPP/1U5N2n+TcwKoryTOtWp06dAOQdfdy5c6f2SHqnTp3w6aef4t9//0VmZuYzF5My5bfnX3/9pT2aVBLLli1D+/bt8csvv+gMT01NLVWekqxDRXn33XexdOlS/PPPP9i2bRtsbGwKHOErCUdHxyeua0BeO3h7e2P16tU6y2xh+5HiyN8eJSYm6hSUjy+7tra22rMNRZ0F9Pb21vm5uDVK/nx//PFHJCUlYcWKFcjMzNQ54HXmzBlERkZi0aJFGDZsmHZ4YTfulNSgQYMwceJELFq0CF999RWWLl2Kvn37wtbWVjuOg4MDTE1N8ccffxQ6j5Js48rsyOSNGzcwadIkWFtba3dmvr6+8PHxQWRkJEJCQgp9PUuffiNGjEBsbCy2bNmCZcuWoV+/fjob1PwvPf+vt3yP323+6DjF/UvAz88PzZo1w8KFCwtdSIC8015nzpxB7dq1C/3sTyomu3TpAgMDgwIbmUe1aNECpqam2v4G8928eRN79uzRbszL0vLly3V+Pnz4MKKjo3XugvTy8sKpU6d0xrt48WKB04JFtXlJlpsOHTpg9+7d2iMEAJCbm4vVq1c/82ctTKdOnRAVFYUTJ07oDF+yZAkURUGHDh3K5X2BvL9s169fj1atWmHv3r0FXkOGDEFYWBjOnDkDIO97AFDgu9iwYUOBeRd1JKdTp0548OBBgb74lixZov09AO0fa4+3+6pVq4r9+RRFgRCiwPr622+/aU/z5nuW771u3bqoXbs2/vjjjyJ3Vubm5mjWrBnWrVun0y4ajQbLli2Du7s76tatW+zPVhzr1q3TOQqTmpqKjRs3ok2bNto/UhVFKdA+mzdvLnY/o61atYKNjQ2ioqKKXLfUajXMzc3RtGnTIjMVh4uLC/z9/bF27VocP35cW0x27twZ8fHxmD17NqysrLS9OhSlpNvmknjWI5hdu3aFoaEhrly5UmR7Pklh3+epU6cKvaO6OEqyDhUlODgYLVu2xMyZM7F8+XIMHz68wGUIJWm37t27Y+/evQW2/4/nzn9oRL64uLhS382dvx1+fH+1YsUKnZ/NzMzQoUMHnDx5Eg0aNCj0+yvsyHdxjRgxAhkZGVi5ciUWLVqEFi1aoF69etrfl2eNYmtri759+2LJkiXYtGkT4uLidE5xA3k1ypUrV2Bvb1/oZ8/fhxRHqY5MnjlzRntu/e7duzhw4AAWLlwIAwMDrF+/XqdPyF9//RXdu3dH165dMXz4cLi5ueHevXs4d+4cTpw4gTVr1pQmAoC8gsvd3R1vvvkm4uLiChRzLVu2hK2tLcaMGYMpU6bAyMgIy5cvR2RkZIF5BQYGAgBmzpyJ7t27w8DAAA0aNNCeqirMyJEj8cYbbyA2NhYtW7YscJR1+vTp2LlzJ1q2bIl33nkHvr6+yMjIwPXr17FlyxbMmzevyMP/Xl5e+Pjjj/HFF18gPT0dgwYNgrW1NaKiopCQkIBp06bBxsYGn332GT7++GO8+uqrGDRoEBITEzFt2jSYmJhgypQpJW3SpwoPD8fo0aPx4osvIiYmBp988gnc3Ny0p58BYOjQoXjllVfw5ptvon///oiOjsZ//vOfAn2F1q5dG6ampli+fDn8/PxgYWEBV1dXuLq6Fnu5+fTTT7FhwwZ07NgRn3/+OczMzDB37tySd2tQTBMmTMCSJUvQs2dPTJ8+HZ6enti8eTN+/vlnjB07tswLjEctX74cGRkZeOeddwp92oG9vT2WL1+O33//Hd9//z2aNGkCX19fTJo0CTk5ObC1tcX69etx8ODBAtMGBgZi3bp1+OWXXxAcHAyVSoWQkBC8+uqrmDt3LoYNG4br168jMDAQBw8exNdff40ePXpojyp169YNrVq1wnvvvYeUlBQEBwcjNDRUW3Q+et1oUaysrNC2bVvMmjULDg4O8PLywv79+/H7778XOOr2rN/73Llz0bt3bzRv3hwTJkxAzZo1cePGDWzfvl27A5oxYwY6d+6MDh06YNKkSVCr1fj5559x5swZrFy5ssyfAmNgYIDOnTtj4sSJ0Gg0mDlzJlJSUnQeptCrVy8sWrQI9erVQ4MGDXD8+HHMmjXrqacR81lYWOCnn37CsGHDcO/ePQwYMABOTk6Ij49HZGQk4uPjtX/AfvHFF+jWrRs6d+6M9957D7m5uZg5cybMzc2LfZSrU6dO+Omnn2BqaopWrVoByDvS4+3tjR07duD5559/ar+X+dfAz58/H5aWljAxMYG3t/cz7eTzBQYGYt++fdi4cSNcXFxgaWlZYDv+JF5eXpg+fTo++eQTXL16Fd26dYOtrS3u3LmDY8eOwdzcvMiHYQB53+cXX3yBKVOmoF27drhw4QKmT58Ob2/vYncf96iSrENP8u677+Kll16Coig62/Z8RW0vCjN9+nRs3boVbdu2xccff4zAwEAkJSVh27ZtmDhxIurVq4devXph3bp1ePPNNzFgwADExMTgiy++gIuLCy5dulTidujSpQvatm2LDz74AGlpaQgJCcGhQ4ewdOnSAuP+8MMPaN26Ndq0aYOxY8fCy8sLqampuHz5MjZu3FjgOviSqFevHlq0aIEZM2YgJiYG8+fPL/D72rVr46OPPoIQAnZ2dti4caP2muJH5dcoP/zwA4YNGwYjIyP4+vo+8YDcyJEjsXr1aowbNw7u7u4FzgKMHz8ea9euRdu2bTFhwgQ0aNAAGo0GN27cwI4dO/Dee++hWbNmxfuwxb5VR/z/HW75L7VaLZycnES7du3E119/re2u4XGRkZFi4MCBwsnJSRgZGQlnZ2fRsWNHMW/evALzLuxO8aLuShVCiI8//ljbrcbjXfUIIcThw4dFixYthJmZmXB0dBSjR48WJ06cKHAXcWZmphg9erRwdHQUiqLovF9Rd48lJycLU1PTQrspyhcfHy/eeecd4e3tLYyMjISdnZ0IDg4Wn3zyic4djEVZsmSJaNKkiTAxMREWFhaiUaNGBe5+/u2330SDBg2EWq0W1tbWok+fPgXuFB82bJgwNzcvMP927dqJ+vXrFxju6ekpevbsqf05/zvYsWOHGDp0qLCxsdHeSX7p0iWdaTUajfjPf/4jatWqJUxMTERISIjYs2dPgTvOhBBi5cqVol69esLIyKjAXXbFWW6EyLujvHnz5sLY2Fg4OzuL999/X8yfP/+Z7+YurF2EECI6OloMHjxY2NvbCyMjI+Hr6ytmzZqls/zl3305a9YsnWnz7/pbs2ZNsXI8KigoSDg5OYnMzMwix2nevLlwcHDQjnPx4kXRpUsXYWVlJRwdHcXbb7+tvfP60TsP7927JwYMGCBsbGy0y3++xMREMWbMGOHi4iIMDQ2Fp6enmDx5srbrrEfnMWLECGFjYyPMzMxE586dxZEjRwrcVZl/N/ej3ZTku3nzpujfv7+wtbUVlpaWolu3buLMmTOFroPP8r0Lkdc1TPfu3YW1tbUwNjYWtWvX1rkjWgghDhw4IDp27CjMzc2FqampaN68eYE7MYv67or6nI+vi/nLysyZM8W0adOEu7u7UKvVolGjRmL79u06096/f1+MGjVKODk5CTMzM9G6dWtx4MCBAutWUctZvv3794uePXsKOzs7YWRkJNzc3ETPnj0LjL9hwwbttqVmzZrim2++0X6u4vjnn38EANG5c2ed4a+99poAIH788ccC0zy+HRAirxcEb29vYWBgoLPtLmo9HTZsWJF3Gz8qIiJCtGrVSpiZmQkA2jYs6jst7K5dIYT4+++/RYcOHYSVlZUwNjYWnp6eYsCAATpdLRUmMzNTTJo0Sbi5uQkTExPRuHFj8ffffxfIX9T2RIjCu+IpzjpU1GfJz2VsbCy6detWaO4nbS8K+/5iYmLEyJEjhbOzszAyMhKurq5i4MCBOneNf/PNN8LLy0sYGxsLPz8/sWDBgkKXteLczS1EXndDI0eO1Nke5XdZ9Xi+a9euiZEjRwo3NzdhZGQkHB0dRcuWLXV6KXnSOvWktszfJhXWVY8QQkRFRYnOnTsLS0tLYWtrK1588UVx48aNQnNOnjxZuLq6CpVKpfN+he1bhcjrpcHDw0MAKNBNUb4HDx6ITz/9VPj6+mpriMDAQDFhwgSd3jKeRhHisZ6OiQqxaNEijBgxAmFhYU89dUOUb8WKFRgyZAgOHTqEli1byo5TKV2/fh3e3t6YNWsWJk2aJDsOETZu3Ijnn38emzdv1ukBhKgolfu5WkRUZaxcuRK3bt1CYGAgVCoVjhw5glmzZqFt27YsJImqgKioKERHR2ufRvNoFzZET8JikojKhKWlJVatWoUvv/wSaWlpcHFxwfDhw/Hll1/KjkZExfDmm2/i0KFDaNy4sfYxk0TFwdPcRERERFRqZf4EHCIiIiLSHywmiYiIiKjUWEwSERERUanxBpwyoNFoEBsbC0tLS16wTEREVEUIIZCamgpXV9diPVyBCsdisgzExsYW+fxsIiIiqtxiYmKK/SQpKojFZBnIf5xRTEwMrKysJKchIiKi4khJSYGHh8cTH0tIT8disgzkn9q2srJiMUlERFTF8BK1Z8MLBIiIiIio1FhMEhEREVGpsZgkIiIiolLjNZMVRKPRICsrS3YMKiEjIyMYGBjIjkFERFRpsZisAFlZWbh27Ro0Go3sKFQKNjY2cHZ25gXaREREhWAxWc6EELh9+zYMDAzg4eHBTlGrECEEHj58iLt37wIAXFxcJCciIiKqfFhMlrOcnBw8fPgQrq6uMDMzkx2HSsjU1BQAcPfuXTg5OfGUNxER0WN4mKyc5ebmAgDUarXkJFRa+X8EZGdnS05CRERU+bCYrCC83q7q4ndHRERUNBaTRERERFRqLCZJ712/fh2KoiAiIkJ2FCIioipH74vJnJwcfPrpp/D29oapqSlq1aqF6dOnsxufMrBo0SLY2NjIjkFERETlSO/v5p45cybmzZuHxYsXo379+ggPD8eIESNgbW2Nd999V3Y8Kqbs7GwYGRnJjkFEJIXQaJByPx6ZGQ+hMjCEla0j1MYmsmORntD7I5OhoaHo06cPevbsCS8vLwwYMABdunRBeHi47GjSbdu2Da1bt4aNjQ3s7e3Rq1cvXLlyBQCwb98+KIqCpKQk7fgRERFQFAXXr1/Hvn37MGLECCQnJ0NRFCiKgqlTpwIA7t+/j1dffRW2trYwMzND9+7dcenSJZ33XrBgATw8PGBmZoZ+/fph9uzZOkc5p06diqCgIPzxxx+oVasWjI2NIYR4YuZ8x44dQ6NGjWBiYoKQkBCcPHmyXNqPiKi8JN65iWNrv0fY9y/h+vRAZE9zgPVPdeG0IAgO8wJg+LUz4qd6IfKb5xC68ENcjjwEwTNuVE70/shk69atMW/ePFy8eBF169ZFZGQkDh48iDlz5hQ5TWZmJjIzM7U/p6SkFPv9hBBIz859lsilZmpkUKI7k9PS0jBx4kQEBgYiLS0Nn3/+Ofr161esawtbtmyJOXPm4PPPP8eFCxcAABYWFgCA4cOH49KlS9iwYQOsrKzw4YcfokePHoiKioKRkREOHTqEMWPGYObMmXj++eexa9cufPbZZwXe4/Lly/jzzz+xdu1abf+PT8qsUqmQlpaGXr16oWPHjli2bBmuXbvGI9BEVCXk5uQgcvdKqE/8Br+MSDRVxP//8n+b9hyhgqGigUoRcMR9OGaEAdFhQPQ83PzbGTfrDIZ/z3GwsrGX8yGoWtL7YvLDDz9EcnIy6tWrBwMDA+Tm5uKrr77CoEGDipxmxowZmDZtWqneLz07F/6fby9t3GcSNb0rzNTF/8r79++v8/Pvv/8OJycnREVFPXVatVoNa2trKIoCZ2dn7fD8IvLQoUNo2bIlAGD58uXw8PDA33//jRdffBE//fQTunfvjkmTJgEA6tati8OHD2PTpk0675GVlYWlS5fC0dGxWJkDAgKwfPly5Obm4o8//oCZmRnq16+PmzdvYuzYscVuFyKiiiQ0GhzfvADOJ75HY3E7b6ACXDL0QYJLO5h6NUGNOo1gV8MDxiZmEBoN7ifcRvyNC0i6fBTqmIOo9+AY3BEH90uzkfb9zwitORQNX/oMZhbWcj8cVQt6X0yuXr0ay5Ytw4oVK1C/fn1ERERg/PjxcHV1xbBhwwqdZvLkyZg4caL255SUFHh4eFRU5Apz5coVfPbZZzhy5AgSEhK0NyXduHGj1E/zOXfuHAwNDdGsWTPtMHt7e/j6+uLcuXMAgAsXLqBfv3460zVt2rRAMenp6alTSD4tc0BAAM6dO4eGDRvq5G/RokWpPgsRUXm7FHEAmk2TEJJzHgCQDHNEuQ6AZ+c34eNdDz6FTKOoVLBzcoOdkxsQ0hEA8PBBMo5t/wNOZ3+HlyYGLWIW4O63a3Gu6acI7jGqAj8RVUd6X0y+//77+Oijj/Dyyy8DAAIDAxEdHY0ZM2YUWUwaGxvD2Ni4VO9namSAqOldS533WZgalexRgL1794aHhwcWLFgAV1dXaDQaBAQEICsrS3vKWoj/P81SnCfEPDr+48PzT8E/+v8nTWdubl6izE96fyKiyiQ7KxPhyz5Fk+jfYKho8FAYI9J7JBr0/wgtLG1KPD8zC2s07T8Bot+7OL5tMVzCvoaruAunYxMRfn4LfIbPg7Wd49NnRFQIvS8mHz58CJVK9z4kAwODcusaSFGUEp1qliUxMRHnzp3Dr7/+ijZt2gAADh48qP19/hHB27dvw9bWFgAKXEupVqu1j5PM5+/vj5ycHBw9elR7mjsxMREXL16En58fAKBevXo4duyYznTFuSHqaZnz33/p0qVIT0/XPnf7yJEjT503EVFFuXvrGu4vfBktcs4DCnDcoj1qDv4BLVy9nnneikqF4B4jkNFhIEJXfI4mN/5ASMouxP3YAgkvLEHtBi2f/QOQ3tH7u7l79+6Nr776Cps3b8b169exfv16zJ49u8BpVn1ja2sLe3t7zJ8/H5cvX8aePXt0Tu3XqVMHHh4emDp1Ki5evIjNmzfju+++05mHl5cXHjx4gN27dyMhIQEPHz6Ej48P+vTpg9deew0HDx5EZGQkXnnlFbi5uaFPnz4AgLfffhtbtmzB7NmzcenSJfz666/YunXrU28eelpmABg8eDBUKhVGjRqFqKgobNmyBd9++20ZtRoR0bM5H7YLqgXt4ZtzHikwQ3jILARP+geOZVBIPsrE1BwtRn2HK73X4qbiDGfEw2VtX5zcvrhM34f0hNBzKSkp4t133xU1a9YUJiYmolatWuKTTz4RmZmZxZ5HcnKyACCSk5ML/C49PV1ERUWJ9PT0soxdIXbu3Cn8/PyEsbGxaNCggdi3b58AINavXy+EEOLgwYMiMDBQmJiYiDZt2og1a9YIAOLatWvaeYwZM0bY29sLAGLKlClCCCHu3bsnhg4dKqytrYWpqano2rWruHjxos57z58/X7i5uQlTU1PRt29f8eWXXwpnZ2ft76dMmSIaNmxY4sxCCBEaGioaNmwo1Gq1CAoKEmvXrhUAxMmTJwtth6r8HRJR1RG++Q+R+bmdEFOsxNVpDcTNK1EV8r5JiXdF5IwOQkyxEmKKlQhd8VWFvG9l8KT9NxWfIgQvIntWKSkpsLa2RnJyMqysrHR+l5GRgWvXrsHb2xsmJuxAtrRee+01nD9/HgcOHKjw9+Z3SETlLWzdD2gcOQUGisBJs1aoO3YFzEtxbWRp5WRn4fj8sWgW/xcAINT7LbQY9nWFvb8sT9p/U/Hp/Wluqpy+/fZbREZG4vLly/jpp5+wePHiIm+IIiKqyo6s+BJNTn0OA0XgmG0vNJi4oUILSQAwNFKj6dgFCPV4DQDQ4tpchC78sEIzUNXFYpIqpWPHjqFz584IDAzEvHnz8OOPP2L06NGyYxERlamja75F84uzAABHagxCk7eXwsBQzk2aikqFFqO+xZHaeQ9yaBE9D0dXfyMlC1Utlf+2YtJLf/75p+wIRETl6viWhWhy5ktAAUJdX0Xz0T9AUck/xtN86HSE/pGOFjfmo0nUNwjfZIeQXq/LjkWVmPylloiISM+c/nc9Ao++B5UicNS+T6UpJPM1Hz4TRx36Q6UINAibjPNhu2RHokqs8iy5REREeiD6/Al47R4LtZKL45YdEDL2j0pVSAJ5p7ybjF2AE+ZtoFZy4Lh5JOJuXJIdiyqpyrX0EhERVWPJiXdgsHoQLJV0RKkDEThulbRrJJ9GZWCAemOX44qBN+yRjLTFLyLj4QPZsagSYjFJRERUAbKzMhEzfyDcRRxiFSc4j14NtXHl7m7MzMIa5sPWIBHWqJ17DZG/jZUdiSohFpNEREQV4PgfExCQGYGHwhgZ/ZfBzslNdqRica7pg9iOP0EjFDS7twHhmxfIjkSVDItJIiKicha5ZxWaxy0HAFxoOQu1AppJTlQygW374KjHCACA37FPEXP5tOREVJmwmCSp2rdvj/Hjxz/TPK5fvw5FURAREVEmmYiIylJczGV4/vseAOCI44to1LVqPoChybCZiFIHwlzJQMbK4cjOypQdiSoJFpNUpQwfPhx9+/bVGebh4YHbt28jICBATigioiLkZGfh/pKhsMEDXDKog0ajfpQdqdQMjdRwGLYUKTCHT+5lhK+YIjsSVRIsJqnKMzAwgLOzMwwr6R2RRKS/wpdPhV92FFKFKcyGLIGxiZnsSM/Eyc0bFxt/BgAIvjYfV88clZyIKgMWk1Skbdu2oXXr1rCxsYG9vT169eqFK1euAPj/U8vr1q1Dhw4dYGZmhoYNGyI0NFQ7fWJiIgYNGgR3d3eYmZkhMDAQK1euLPL9pk+fjsDAwALDg4OD8fnnn2Pq1KlYvHgx/vnnHyiKAkVRsG/fvkJPc589exY9e/aElZUVLC0t0aZNG212IqKKcPXMUTS+Ng8AcL7RZ3CrVV9yorIR3OsNnDRrCbWSC836sTzdTSwmK5wQQFaanJcQJYqalpaGiRMnIiwsDLt374ZKpUK/fv2g0Wi043zyySeYNGkSIiIiULduXQwaNAg5OTkAgIyMDAQHB2PTpk04c+YMXn/9dQwdOhRHjxb+l+zIkSMRFRWFsLAw7bBTp07h5MmTGD58OCZNmoSBAweiW7duuH37Nm7fvo2WLVsWmM+tW7fQtm1bmJiYYM+ePTh+/DhGjhypzUVEVN6yMjMg1o+BWsnFSbOWCHm++nSpo6hU8Hj1VyTBAnVyr/B0N/HZ3BUu+yHwtauc9/44FlCbF3v0/v376/z8+++/w8nJCVFRUbCwsAAATJo0CT179gQATJs2DfXr18fly5dRr149uLm5YdKkSdrp3377bWzbtg1r1qxBs2YF72R0d3dH165dsXDhQjRp0gQAsHDhQrRr1w61atUCAJiamiIzMxPOzs5F5p47dy6sra2xatUqGBkZAQDq1q1b7M9NRPSsji/7BC1yryIJFvB49ddK94SbZ+XgXBPhjT9FyImP0Ojab4i9Nhyu3vVkxyJJqtfSTWXqypUrGDx4MGrVqgUrKyt4e3sDAG7cuKEdp0GDBtr/u7i4AADu3r0LAMjNzcVXX32FBg0awN7eHhYWFtixY4fO9I977bXXsHLlSmRkZCA7OxvLly/HyJEjS5Q7IiICbdq00RaSREQV6cqpw2hy44+8/zeZBgfnmpITlY/gXm/grLohTJRsxP/5DsQjZ61Iv/DIZEUzMss7QijrvUugd+/e8PDwwIIFC+Dq6gqNRoOAgABkZWX9/ywfKdgURQEA7Wnw7777Dt9//z3mzJmDwMBAmJubY/z48TrTF/aexsbGWL9+PYyNjZGZmVngCOnTmJqalmh8IqKykpuTg9wN78JQ0eCERVsE9xwtO1K5UVQqWLwwB1krn0PD9KM4uWsFGnV5RXYskoDFZEVTlBKdapYlMTER586dw6+//oo2bdoAAA4ePFiieRw4cAB9+vTBK6/kbVw0Gg0uXboEPz+/IqcxNDTEsGHDsHDhQhgbG+Pll1+Gmdn/F8FqtRq5ublPfN8GDRpg8eLFyM7O5tFJIqpQ4etmo1nORaQKU9Qc/F/ZccqdZ73GCHV7BS1iF8Pl8BQ8bNkbZhbWsmNRBeNpbiqUra0t7O3tMX/+fFy+fBl79uzBxIkTSzSPOnXqYOfOnTh8+DDOnTuHN954A3FxcU+dbvTo0dizZw+2bt1a4BS3l5cXTp06hQsXLiAhIQHZ2dkFph83bhxSUlLw8ssvIzw8HJcuXcLSpUtx4cKFEuUnIiqJhLgb8Iv6HgAQ5T8eDq6ekhNVjKAhX+E2HOGMBET++aXsOCQBi0kqlEqlwqpVq3D8+HEEBARgwoQJmDVrVonm8dlnn6Fx48bo2rUr2rdvD2dn5wIdjhfGx8cHLVu2hK+vb4EbdV577TX4+voiJCQEjo6OOHToUIHp7e3tsWfPHjx48ADt2rVDcHAwFixYwKOURFSuri8fDys8xCVDH4T0n/T0CaoJU3NLxDb9BADQMHox7t66JjkRVTRFiBL2F0MFpKSkwNraGsnJybCystL5XUZGBq5duwZvb2+YmJhISli1CCFQr149vPHGGyU+Gloe+B0S0dOc/vcfBO55FblCwdV+G+ET1EZ2pAolNBpcmNEK9bKjEGbTHU3Gr5IdqVietP+m4uORSapU7t69i9mzZ+PWrVsYMWKE7DhERE+Vk50Fy32fAgDCnfrrXSEJ5N2Mo3T9CgAQfH8bLkcWPGtE1ReLSapUatSogW+++Qbz58+Hra2t7DhERE91fP0ceGlu4D4sUW/QN7LjSOMb0hHhVs9BpQhkbp7MroL0CItJqlSEEIiPj8fgwYNlRyEieqrk+wmoG/UjAOCi3zhY2zlKTiSX+4BvkCmMUD8rEmcO/iM7DlUQFpNERESldG7VJ7BFKq6rPBD8gvxrvGVzrumDkzX6AQCM//2aRyf1BIvJCsL7nKoufndEVJiYS5EIjlsDAEhpOw2GRmrJiSqHOi98jofCGHVzLiJyd9W4EYeeDYvJcmZgYAAAT3zqC1VuDx8+BAB2LUREOhLWT4aRkotI06Zo0L5kT+qqzhycPRDp9jIAwCp0JjRPedAEVX18Ak45MzQ0hJmZGeLj42FkZASVivV7VSGEwMOHD3H37l3Y2Nho/zAgIroQvgeNHh5CrlBg87z+3nRTFP/+nyD1xz9RS3Md4dv+QEjP12RHonLEYrKcKYoCFxcXXLt2DdHR0bLjUCnY2NjA2dlZdgwiqiSERoOcHVMBACdsu6GJX7DcQJWQtX0NhHoNQ4voeagRPhs5XYbxMoBqjMVkBVCr1fDx8Snxqe7zR7Yi895NiMwHQGYKoMkBFBWEygBQW8LQ3B5GVo6wdasDBxdvGBjy6yxrRkZGPCJJRDrOHPwHgVmRyBKGcO83TXacSiuw/0e4P3s5PEQswrcvQkiv12VHonLC6qOCqFSqEj89RX3oWwRlnynWuJnCCDcMPZFo1whG3q1Qq0k32Dq6lCYqEREVQWg0MPk3r3PuEzVeQHNPX8mJKi8LK1uEeg5Bi+h5sD/xX2i6j4KKf5xXSywmK7HkGk1x4r4dcowsoDG2hjBQAyIXiiYHBhlJUGcmwiorHq65t2CsZMMn9zJ84i8D8WuQe1TBWeMApHp1RZ32r8LB1VP2xyEiqvJO7liCxjmX8FAYw6f/FNlxKj3/vu8jdc5ieGuicXL3SjTq8orsSFQO+GzuMiD72Z65OTmIu3EBcedCkXPtMJzuHYe35rr29zlChdPmzaE0fhUNOgzkX4ZERKWQk52F2BlBqKm5hSPuo9B89GzZkaqE0PnvoEXsYlw0rAufj49CqUQ3osref1cXlecblejWrVt45ZVXYG9vDzMzMwQFBeH48eOyYxWbgaEh3GrVR3DP0Wg27g94fx6J2OHHcKTu+zhv6AdDRYNGDw8j6OAYxHzVAMfW/4SszAzZsYmIqpSTmxegpuYW7sMS/gM+kR2nyqjb5wOkCzXq5lzEmYMbZcehcqD3xeT9+/fRqlUrGBkZYevWrYiKisJ3330HGxsb2dGeiauXL5oP/hT1Pj2C6Jf34ojzEKTAHJ6am2ga+Snuz/BH2LofkJuTIzsqEVGll5uTA+fI/wIAznsPg5WNveREVYd9DXdEOvUBAKgOfis5DZUHvT/N/dFHH+HQoUM4cOBAqedRVQ6Tpybfw9kNc1DnymI4IAkAcFXlhbT20xHYto/ccERElVj4xl8RcvwDJMEChhPPwMLKVnakKiUu5jLsfmsKtZKL873WoV5IJ9mRAFSd/Xdlp/dHJjds2ICQkBC8+OKLcHJyQqNGjbBgwYInTpOZmYmUlBSdV1VgaW2H5kOnw+LDKBzxmYgUmKOW5joC97yKE7N6IyHuhuyIRESVTm5ODhxP/gQAOOc1lIVkKTh71EGEbVcAwMN9c+SGoTKn98Xk1atX8csvv8DHxwfbt2/HmDFj8M4772DJkiVFTjNjxgxYW1trXx4eHhWY+NmZmJqj+ZAp0Iw7gSNOA5EtDNA47V8YzWuOY+t/gtBoZEckIqo0InYshqcmBikwR0C/D2THqbIcu0wEADRMPYDYa+clp6GypPenudVqNUJCQnD48GHtsHfeeQdhYWEIDQ0tdJrMzExkZmZqf05JSYGHh0eVPUx+5dRhiH/GoU7uFQBApGlTeIxYBDsnN8nJiIjk0uTmIvqrRvDWRCO05htoMfI/siNVaae+6YgGGcdxxGkgmr/55LOAFYGnucuG3h+ZdHFxgb+/v84wPz8/3LhR9ClfY2NjWFlZ6byqstoNWsLroyM4UvtdZAojNEw/htyfW+HMId51R0T6LXLXMnhropEqTOHPo5LPrvlbAIDAOxuQfD9BchgqK3pfTLZq1QoXLlzQGXbx4kV4eupXJ9+GRmo0HzodsQM3I1rlAUfch/+OoQj9431ocnNlxyMiqnBCo4HVsTkAgLMeg2Ft6yA3UDUQ2LYfrqtqwlzJwLlNP8qOQ2VE74vJCRMm4MiRI/j6669x+fJlrFixAvPnz8dbb70lO5oU3vWbwXHiIRyz6QGVItDixnxEzn4eaalJsqMREVWoMwf+Ru3cq3gojFGvL49KlgVFpUJ8wGgAgPeVZcjOynzKFFQV6H0x2aRJE6xfvx4rV65EQEAAvvjiC8yZMwdDhgyRHU0aMwtrNB2/EscafoksYYhGaQdx5/t2iL1+4ekTExFVE8rhHwAAp2r0hY2Ds+Q01Udg99FIhDVqIBGROxbLjkNlQO+LSQDo1asXTp8+jYyMDJw7dw6vvfaa7EiVQtN+b+Nqz1VIgA1qaa7DZNFzuHTyX9mxiIjK3aWT/yIgMwI5QgWvXu/LjlOtmJia42LNlwAA5pELJaehssBikp6oXtPOyBm1G1cMasEOKXD9+0Wc/vcf2bGIiMpVyu7vAAAR1p3gXNNHcprqx6fbOGQLA/hlR+HKqcNPn4AqNRaT9FTOHnXg9M5unDEOgrmSAd/dI3B882+yYxERlYtbV88iKHU/AMC+K49KlgcHV0+csmwDAEjcO1dyGnpWLCapWCyt7eAzYStOWLSDWslFo2OTELbuB9mxiIjK3M3N/4GBIhBp0gTe9ZvJjlNtmbYaAwAIvLcDyffiJaehZ8FikorN2MQMDcevw1H7vlApAsGRU1hQElG1knjnJhombAYAGLaZIDlN9ebXrCuuqTxhqmTh3NZfZMehZ8BikkrEwNAQTd9aiKMO/aFSBJqc+hzH1s6RHYuIqExc3PgdTJRsXDSsC/8W3WXHqdYUlQp36w0FALhfXsE+jaswFpNUYopKhaZv/oajjgMAAE1PT0HY37zmhYiqtvS0VPjfXA0AeBDyFhQVd5HlLaD7a0gVpnAXt3HmwN+y41ApcU2hUlFUKjQdu0BbUDY6+Skidq2UnIqIqPRObfkV1khDrFIDDZ97RXYcvWBuaYMop54AAM0x+c/qptJhMUmlpqhUaDJmPsKsu8JQ0aDegbcRFbpVdiwiohITGg1qnFsEALhR5xUYGBrKDaRHnJ97GwDQIO0I4mIuS05DpcFikp6JysAAQW8tRYRZC5go2fDYNoJ9hhFRlXPm4D/w0sQgTZjAv6d+Pk5XFk/fIJxVB0KlCFzbOV92HCoFFpP0zIzUxqg37i9EGQXAUkmH9bpBuB3NRy8SUdWhCc27m/iMY09Y2dhLTqN/0gPyLivwvrEOuTk5ktNQSbGYpDJhYmYB97c24KrKCw5IQsbigXiQcl92LCKip4q5FImG6UcBAK7d2B2QDAHPvYIUmMMZ8Th7kE9Zq2pYTFKZsbKxh9mItUiADbw113Hll5f4FyYRVXqx2/P6y400bQaPOoGS0+gnEzMLnHPM64opJ3yR3DBUYiwmqUw5e9TBvecXI0MYoWH6UYTNHys7EhFRkVKSEhEQn9dJuaoFt1cyObZ7HQAQkHoIiXduSk5DJcFikspc3cbtEdV8FgCg+d0/cXTNt5ITEREVLmrzXJgrGbiu8kBA6z6y4+i1WgHNcNGwLtRKLi7tZDdBVQmLSSoXjbuPwBGvvDsiG535GufDd0tORESkKzcnBzUvLwMA3PEbzk7KK4GkeoMAAK5X10BoNJLTUHFxzaFy0+zVL3HCoi3USi7sNo1GQlyM7EhERFqn9qyCq7iDZJijQY83ZMchAP5dRuChMEZNzS2cO7ZDdhwqJhaTVG4UlQp1X1+CaJU7nHAPd/4YhJzsLNmxiIgAAIbHfwcAnHPuC1NzS8lpCAAsrGxxxu45AEBa6B+S01BxsZikcmVhZQu8tBxpwgT1s04j/Ld3ZEciIkLM5dMIzDwBjVDg0eVt2XHoEVYtRgAA6iftQ1pqktwwVCwsJqncefoG4UKLmQCA5ndW4sT2pZITEZG+u7VzLgDgtGkI3Gr5SU5Dj/IN6YQYxRVmSiaidi+XHYeKgcUkVYjG3YbjiPMQAEDt0A8Rd+OS5EREpK8yHj5AvTsbAQAiZJTkNPQ4RaXCzZrPAwBMz/0pOQ0VB4tJqjCNR8zGRcO6sEYa7i8dxusniUiK0zsWwQYPEAdHBLZ/UXYcKoRXx5EAAP+MSB58qAJYTFKFURubwHzwEjwQpvDLPouwJZNlRyIiPWR1ZgkA4LrXQBgYGkpOQ4Vx8fTFWXVDqBSBa3t+lx2HnoLFJFUot1p+ON9kOgCg6Y3fcfbwFsmJiEifXI48BN+cC8gSBqjTjU+8qcwe+g8EALhH/8M+Jys5FpNU4UJ6vY5jNj1goAg47ngLSQlxsiMRkZ64t/8XAMBpq7ZwcPaQnIaexL/TK3gojOEhYnHh+B7ZcegJWEySFAGj5+GGyg1OuIcri8fIjkNEeiAlKREBiXkdYZu2ZCfllZ25pQ3O2rQHACQfWSI3DD0Ri0mSwszCGpm95yFHqBCcuhfHN/8mOxIRVXNRW3+FmZKJ66qa8GvWVXYcKgbTkLxeQPwSdyEjPU1yGioKi0mSxqdRW4TVzLtjr3bYFCTERktORETVldBo4HxpBQDgTt3BfA53FeHfshfi4AArpOHs3lWy41ARuDaRVMGvfIXLBrVhgwe4ufR1XmRNROXiQvhueGli8FAYw6/b67LjUDGpDAwQ7T8GR3wmwiuYR5MrKxaTJJXa2AQG/X9FljBEUPoRhP3zX9mRiKgaSj2c173MGdtOsLKxl5yGSqLZwPfRfMgU2Ndwlx2FisBikqTz9m+CE7XfBAD4R3zNDmqJqEylJCWi/v28u4GtWo6UnIao+mExSZVCk8FTcN7IHxZKOu6sfJOnu4mozJzbuRBmSiaiVR7wDekkOw5RtcNikioFA0NDmA74BVnCEA3Tj+H4Ft7dTURlw+5C3o0bt2u/yBtviMoB1yqqNDx9g3DcazQAoHb4F7gff1tyIiKq6q6cOgyfnEvIEgao23m07DhE1RKLycfMmDEDiqJg/PjxsqPopeDB03BN5QlbpODysndlxyGiKi7h37yzHGcsW8POyU1yGqLqicXkI8LCwjB//nw0aNBAdhS9pTY2QVaPOdAIBU2St+P0/nWyIxFRFZXx8AH8ErYBAIyajpCchqj6YjH5Pw8ePMCQIUOwYMEC2Nrayo6j13xDOuJYjRcBAPb7PsTDB8mSExFRVXRm11JYIQ234Yj6rZ6XHYeo2mIx+T9vvfUWevbsieeee+6p42ZmZiIlJUXnRWUrcOgsxMERruIuTi2bLDsOEVVBpmeWAwCue/aHysBAchqi6ovFJIBVq1bhxIkTmDFjRrHGnzFjBqytrbUvDw+Pck6of8wtbXCn7ZcAgODbqxB97rjkRERUlcRcikT9rNPIFQq8n3tNdhyiak3vi8mYmBi8++67WLZsGUxMTIo1zeTJk5GcnKx9xcTElHNK/dSw48s4adYSRkouHqwfz74niajYbu753403Zk3g7FFHchqi6k3vi8njx4/j7t27CA4OhqGhIQwNDbF//378+OOPMDQ0RG5uboFpjI2NYWVlpfOi8lFj4BxkCCPUzzrFvieJqFiyszLhc3sDACA36FXJaYiqP70vJjt16oTTp08jIiJC+woJCcGQIUMQEREBA15nI5Wrly9Oeo0CAHiGf43U5HuSExFRZXdm3xo4IAkJsEFgh4Gy4xBVe3pfTFpaWiIgIEDnZW5uDnt7ewQEBMiORwAaD5qCGMUVjriPs8s/kh2HiCq7iLwbby4794SR2lhyGKLqT++LSar8jE3McL9d3s04IXfW4OqZo5ITEVFllXjnJgLS8rYRLu1GSU5DpB9YTBZi3759mDNnjuwY9IgG7fvjhHlbGCoaZP4zgTfjEFGhLu1eCCMlFxcN68LTL1h2HCK9wGKSqgzXl7/HQ2EMv+yzOLFtoew4RFQJOV7Je2rWfZ8BkpMQ6Q8Wk1RlOHvUQaTncACA67EZyHj4QG4gIqpUrpw6jNq5V5ElDFHvueGy4xDpDRaTVKUEvfQZ7sAeLojHyT+/lB2HiCqR+IOLAABnLFvC2r6G3DBEeoTFJFUppuaWiAn+EADQ8NofiI+9LjcQEVUK2VmZqHt3KwDAoPEQyWmI9AuLSapygnu+hguG9WCmZOL6n+wqiIiAs/vXwg4pSIAN6rd5QXYcIr3CYpKqHEWlArrlPUe9SdJWXIo4IDkREckm8vuWrNEdhkZqyWmI9AuLSaqSfEM6ItyqMwAgZ/OH7CqISI/dj7+N+g9CAQA12o6QnIZI/7CYpCrLY+DMR7oKWiw7DhFJcmHXQqiVXFw2qA3v+s1kxyHSOywmqcqq4V4bkZ7D8v4f9g2yMjMkJyIiGRwu/wUASKjDviWJZGAxSVVagxc/QQJs4C7icHL997LjEFEFu3b2KOrkXkGWMIDvczzFTSQDi0mq0swtbXDF/y0AgM/5n5GafE9yIiKqSHf+zXsa1hmLlrB1dJGchkg/sZikKq9x33cRo7jCDik4u4YdmRPpi+ysTNS5k9e3pCposOQ0RPqLxSRVeUZqY8Q3y+vIvEHMMiTERktOREQV4eyB9XBAEu7BCvXb9Zcdh0hvsZikaqFRl1e1HZlfWfuZ7DhEVAE0J/P6lrxYoweM1MaS0xDpLxaTVC0oKhVyn5sGAAhO2IgbFyPkBiKicpWSlIj6qXl9Szq0fFVyGiL9xmKSqg3/5t1w0qwlDBUNEv/5RHYcIipH5/eugLGSjWiVB2oHtpAdh0ivsZikasWu95fIFQoapR3E+WM7ZcchonJien4tACDWo2feI1aJSBqugVStePoF47hdTwBA7q7pfMwiUTWUEBsN/4wIAEDNdsOlZiEiFpNUDdXsNxVZwhD1s07h7KGNsuMQURm7vG8JDBSBC4b14FbLT3YcIr3HYpKqHeeaPjjh1A8AYLT/ax6dJKpm7K5uAAAk1ekrNwgRAWAxSdVUnf6fI12o4ZtzHpF7/5Qdh4jKSMzl06ibcxE5QoU6HYbKjkNEYDFJ1ZSDc01EuA4EAFgenglNbq7kRERUFm7+uwQAEGUaDPsa7pLTEBHAYpKqMb/+n+GBMEXt3Ks4uX2J7DhE9IyERgP3mE0AgEy/FySnIaJ8LCap2rJxcMbpmq8AABzCv0VuTo7kRET0LC5HHoSHiEW6UMOvwyDZcYjof1hMUrVWv/9kJMECnpqbOLHpV9lxiOgZJIYuAwBEWbWChZWt5DRElI/FJFVrVjb2OFdrJADALfIHZGdlSk5ERKWRm5ODOne3AwAMGr4kOQ0RPYrFJFV7DV+YhATYwFXcwYl//is7DhGVQtThzXBAEpJgAf82/WTHIaJHsJikas/MwhqXfV8HAHidnYvMjIeSExFRSaWfWAUAuGDfCWpjE8lpiOhRLCZJLwT1HY+7sEMNJCJi48+y4xBRCWSkp8Hv/l4AgGUIb7whqmxYTJJeMDE1x1Xf0QAAz7PzkJWZITkRERVX1P41sFTSEQcH1GvaRXYcInoMi0nSG0F93kUCbOCMeB6dJKpKTv8FALjm0g0qAwPJYYjocSwmSW+YmFngct28o5PuZ3/hnd1EVUDy/QQEPAgFANRo9arkNERUGBaTpFca9hn/vzu77yJi0zzZcYjoKS7uXQ61koPrqprw9m8iOw4RFULvi8kZM2agSZMmsLS0hJOTE/r27YsLFy7IjkXlxNTcEpfrjAAAuJ6ey6OTRJWc6YV1AIDbnr2hqPR+l0VUKen9mrl//3689dZbOHLkCHbu3ImcnBx06dIFaWlpsqNROWnQdwLuwQpu4g4itiyQHYeIihAfex3+GZEAAM92wySnIaKi6H0xuW3bNgwfPhz169dHw4YNsXDhQty4cQPHjx+XHY3KiZmFNS7WGg4AcIn8L3Kys+QGIqJCXdm7GCpF4JyRP1y9fGXHIaIi6H0x+bjk5GQAgJ2dXZHjZGZmIiUlRedFVUtgv/dwH5ZwF7dxcstvsuMQUSHsr24AAKTU6Ss3CBE9EYvJRwghMHHiRLRu3RoBAQFFjjdjxgxYW1trXx4eHhWYksqCuaUNznvn3RnqHPETcnNyJCciokfduBgBn9zLyBYGqNuRd3ETVWYsJh8xbtw4nDp1CitXrnzieJMnT0ZycrL2FRMTU0EJqSwF9nsfSbCAh4jFya2/y45DRI+4dWApACDKLBi2ji6S0xDRk7CY/J+3334bGzZswN69e+Hu7v7EcY2NjWFlZaXzoqrHwsoW57yGAgAcTv4ETW6u5EREBABCo4HHzU0AgGz/AZLTENHT6H0xKYTAuHHjsG7dOuzZswfe3t6yI1EFqt/3faQKU3hpYhC5+8lHpImoYlyK+BfuIg4PhTH82r8kOw4RPYXeF5NvvfUWli1bhhUrVsDS0hJxcXGIi4tDenq67GhUAaxs7HHGPW9nZX7sBwiNRnIiIroXugwAEGXdBuaWNnLDENFT6X0x+csvvyA5ORnt27eHi4uL9rV69WrZ0aiC1H3+fWQII9TNuYizhzbKjkOk13Kys1AnficAwCjoRclpiKg49L6YFEIU+ho+fLjsaFRB7Gu4I9KpT94PB2fLDUOk584d3gQHJOE+LOHfup/sOERUDHpfTBIBgGfvj5AtDBCQGYHz4btlxyHSWxkn8s4KXbTvBCO1seQ0RFQcLCaJADjX9MFJ264AgPQ930pOQ6SfMh4+gF/SfgCAVdPBktMQUXGxmCT6H+ceH0IjFDR6eBjXosJkxyHSO2f3rYGFko7bcIRvyHOy4xBRMbGYJPqfmnWDEGHZFgCQuO0byWmI9I/qzJ8AgOuu3aEyMJCchoiKi8Uk0SOsOn8IAGiUvBu3rp6TnIZIfyTfi0f9tKMAAOfWfHwiUVXCYpLoEXUatsIpkyYwUARubp4hOw6R3riwZynUSi6uqbzg7d9EdhwiKgEWk0SPMWw/CQDQKGEz4mOvyw1DpCfML64HAMR5PS85CRGVFItJosf4N++Gc0b1oVZycOUfXjtJVN7u3LwCv8zTAACvdq9ITkNEJcVikqgQWS0nAAAaxK1DcuIdyWmIqrdr+5ZApQhEGQXAxdNXdhwiKiEWk0SFaNCuP66qvGCmZOLcxh9kxyGq1hyvbQAApPr0lRuEiEqFxSRRIRSVCveCxgIAfK4vQ0Z6muRERNVT9LnjqJ17FdnCAL4dh8qOQ0SlwGKSqAgNu41AHBxhj2REbponOw5RtRR7cCkA4KxZE9g4OEtOQ0SlwWKSqAhGamNcrzsMAOAa9Rtyc3IkJyKqXoRGA8/YLQCAnIABktMQUWmxmCR6gsDebyMZ5vAQsTi1e7nsOETVyoXje+Aq7uChMIZ/u4Gy4xBRKbGYJHoCc0sbRLnl7eTMwuZCaDSSExFVH8lHVwAAoqzbwszCWnIaIiotFpNET+HT+z1kCiP45lzAuWM7ZMchqhayszLhk7ATAGDU6CXJaYjoWbCYJHoKB2cPRDj0AABk7f9echqi6uHcoY2wQwruwQr+rfjUG6KqjMUkUTG4dn8fGqEgKP0Irp8Llx2HqMrLOrkKAHDJ4TkYqY0lpyGiZ8FikqgYPOoEIsKiNQAgfvu3ktMQVW3paanwT/4XAGDdbIjkNET0rFhMEhWTeYeJAICG93fg7q1rktMQVV1n962CmZKJWKUGfIM7yo5DRM+IxSRRMfmGdESUOhBqJRdXN86SHYeoyjI8uxYAEO3aA4qKuyGiqo5rMVEJZDUbBwAIuL0OKUmJktMQVT1JCXGon3YMAODamo9PJKoOWEwSlUCD9i/iusoDFko6ojbMkR2HqMq5sHcZjJRcXDGoBU+/YNlxiKgMsJgkKgGVgQHuBr4BAKh9dSkyMx5KTkRUtVheXA8AiPfqLTkJEZUVFpNEJRTU4zXchR0ccR+ntiyQHYeoyoi7cQn+2WegEQq8OwyTHYeIykilKSaHDx+Of//9V3YMoqdSG5vgau28a70czyzgIxaJiunaviUAgHPGAajhXltyGiIqK5WmmExNTUWXLl3g4+ODr7/+Grdu3ZIdiahI/r3fxQNhCi9NDE7tXys7DlGVUOP6BgBAWt0XJCchorJUaYrJtWvX4tatWxg3bhzWrFkDLy8vdO/eHX/99Reys7NlxyPSYWVjjzPOfQAAqiNzJachqvyuRYWhluY6soQBfDuwo3Ki6qTSFJMAYG9vj3fffRcnT57EsWPHUKdOHQwdOhSurq6YMGECLl26JDsikVbN7hORKxQEZp7EldNHZMchqtTiDi4FAJw1bwZr+xqS0xBRWapUxWS+27dvY8eOHdixYwcMDAzQo0cPnD17Fv7+/vj+++9lxyMCALh6+SLCsh0A4N6u2ZLTEFVemtxceMVuyft/wADJaYiorFWaYjI7Oxtr165Fr1694OnpiTVr1mDChAm4ffs2Fi9ejB07dmDp0qWYPn267KhEWpYdJwAAGibtQnzsdblhiCqpi+G74YJ4pAkT+LcbKDsOEZUxQ9kB8rm4uECj0WDQoEE4duwYgoKCCozTtWtX2NjYVHg2oqLUbdwe57b6wy87Cpc3zYbj6z/KjkRU6SQfWw4AiLJphybmlpLTEFFZqzRHJr///nvExsZi7ty5hRaSAGBra4tr165VbDCip0gPeRMA4B/7Fx4+SJachqhyyc7KRN3E3QAA40YvSU5DROWh0hSTQ4cOhYmJibT3//nnn+Ht7Q0TExMEBwfjwIED0rJQ1dKw0yDcVJxhjTSc3vyL7DhElUrUwfWwRSoSYQ3/VnzqDVF1VGmKSZlWr16N8ePH45NPPsHJkyfRpk0bdO/eHTdu3JAdjaoAA0ND3Ko3AgDgdn4hcnNyJCciqjyyI9YAAC47doahkVpyGiIqDywmAcyePRujRo3C6NGj4efnhzlz5sDDwwO//MKjTFQ8gT3HIhnmcBdxiNy9UnYcokohLTUJ/sl5Z3lsmrFvSaLqSu+LyaysLBw/fhxdunTRGd6lSxccPny40GkyMzORkpKi8yL9ZmZhjSjXvC5PTMN/lpyGqHI4t281zJRM3FScUbdxe9lxiKic6H0xmZCQgNzcXNSooduJbo0aNRAXF1foNDNmzIC1tbX25eHhURFRqZKr02sisoQB/LKjcCF8j+w4RNIZRf0FALjp1hOKSu93N0TVFtfu/1EURednIUSBYfkmT56M5ORk7SsmJqYiIlIl5+jqhUib5wAAD/b9IDkNkVz37t5C/YfhAACXNq9KTkNE5Unvi0kHBwcYGBgUOAp59+7dAkcr8xkbG8PKykrnRQQAds9NBAAEpe5H7PULktMQyXNp7zIYKhpcNqgNT98g2XGIqBzpfTGpVqsRHByMnTt36gzfuXMnWrZsKSkVVVW1A5vjtHEjGCgCN7byEYukv6wu/w0ASPB+Xm4QIip3el9MAsDEiRPx22+/4Y8//sC5c+cwYcIE3LhxA2PGjJEdjaog0XwcACAg7h+kJCVKTkNU8WKvX4BfdhQ0QkGtDsNkxyGicsZiEsBLL72EOXPmYPr06QgKCsK///6LLVu2wNPTU3Y0qoIC272A6yoPWCjpiNrExyuS/rmxbzEAIMqkIZzcvCWnIaLyxmLyf958801cv34dmZmZOH78ONq2bSs7ElVRikqFu/VHAwC8Li9Ddlam5EREFUdoNHC5sQEAkO77guQ0RFQRWEwSlYMGPV5DIqzhjARE7lgsOw5RhblyOhSemhhkCiP4dnxFdhwiqgAsJonKgYmpOS7WfBkAYH3yVwiNRnIiooqRcHgpAOCsZQtY2dhLTkNEFYHFJFE58e31LjKEEXxyL+Pc0e2y4xCVu9ycHNS6k7esKw1ekpyGiCoKi0micmLn5IZIhx4AgMwDvBGHqr9zoZvhhHtIgTn82/J6SSJ9wWKSqBw5d8nrxLxhWihiLkVKTkNUvh4eXwUAOGfXCcYmZpLTEFFFYTFJVI48fYMQYdocKkUgdhs7MafqKyM9DX739wIALJsMlpyGiCoSi0micmbU+h0AQIOELUhKiHvK2ERVU9S+P2GppCMODqjXtIvsOERUgVhMEpUz/xbdcdmgNkyVLJzbNEd2HKJyoZxeAwC45tIDKgMDyWmIqCKxmCQqZ4pKhaSGrwMAfK6vRGbGQ8mJiMpWcuId1E87AgBwbvOq5DREVNFYTBJVgIbdRuAu7OCAJERu/V12HKIydX7PMqiVXFxVecHbv4nsOERUwVhMElUAI7UxrtbKexqI4+nf2Ik5VSuWl9YDAO56PS85CRHJwGKSqIL49XoHD4UxvDXXcebgP7LjEJWJuBuX4J91GhqhwKvDMNlxiEgCFpNEFcTazhGnnXoDAMThuZLTEJWNa3sXAQDOGQfC2aOO3DBEJAWLSaIK5N59EjRCQYOMMFw/Fy47DtEzc47eCABI8+UTb4j0FYtJogrkVssPERatAQB3d7ATc6rarp45Cm9NNLKEIXw7DpUdh4gkYTFJVMHM2r0LAAi6tx0JcTGS0xCV3p1DSwAAZyxawNrWQXIaIpKFxSRRBfMN6YQLhr5QKzm4tHmO7DhEpaLJzUWt21sBAEqDFyWnISKZWEwSVTBFpcKDxmMBAPVi/kTGwweSExGV3Lkj21ADiUiBGfzaDpAdh4gkYjFJJEHDzkNwG46wRQoiN/8qOw5RiaWFrwAAnLftCBNTc8lpiEgmFpNEEhgaqRFdN69PPudzf0CTmys5EVHxZWY8RL37ewEA5iGDJachItlYTBJJUr/nW0gVpvDU3MTp/WtkxyEqtrP7/oQV0nAH9vBr3k12HCKSjMUkkSSW1nY465LXN5/B0V8kpyEqPtWpVQCAq669oDIwkJyGiGRjMUkkkVePCcgRKgRkRuDKqcOy4xA9VeKdm6ifdgwA4Np2uNwwRFQpsJgkksi5pg8irDoAAO7t/l5yGqKnu7RnMYyUXFw0rAvPeo1lxyGiSoDFJJFk1h3HAwCCknbj7q1rcsMQPYX95XUAgPt1+PhEIsrDYpJIMp9GbRGlDoSRkosrm/mIRaq8rp8Lh0/uZWQLA9TtNFx2HCKqJFhMElUCmSFjAAD1Y9ciLTVJbhiiItz+dyEA4Ix5M9g6ukhOQ0SVBYtJokqgYadBuKm4wAppOLOZd3ZT5ZObk4Pat7fk/dDwZblhiKhSYTFJVAmoDAxwq94IAID7hYXIzcmRnIhIV9ThjXDCPSTBAv7t+CxuIvp/LCaJKonAnmOQBAu4iTuI3L1SdhwiHZnhywEAFxy6wNjETHIaIqpMWEwSVRJmFtY45zYAAGAa/rPkNET/70HKffgn/wsAsGk+VHIaIqpsWEwSVSJ1ek5AljCAX3YULoTvkR2HCAAQtXsZzJRMxCiuqNu4vew4RFTJsJgkqkQcXb0QadMZAPBg/4+S0xDlMT+X9+z4m559oKi42yAiXXq9Vbh+/TpGjRoFb29vmJqaonbt2pgyZQqysrJkRyM9ZvfcBABAw5T9uB19QXIa0ne3oy+gflYkAMCrwwjJaYioMtLrYvL8+fPQaDT49ddfcfbsWXz//feYN28ePv74Y9nRSI/VDmyO08aNYKhoEL2Fj1gkuaL3LgYAnFU3gIunr+Q0RFQZGcoOIFO3bt3QrVs37c+1atXChQsX8Msvv+Dbb7+VmIz0nab5W8D+0QiI+xspSV/BysZediTSQ0KjgeuNvwEAaX7sDoiICqfXRyYLk5ycDDs7uyeOk5mZiZSUFJ0XUVlq0K4/rqs8YKGkI2rzf2XHIT118cQ+1NTcQrpQw6/jK7LjEFElxWLyEVeuXMFPP/2EMWPGPHG8GTNmwNraWvvy8PCooISkLxSVCnfrjwIAeF1aipxsXsdLFS8p9H+nuK3bwtL6yX9kE5H+qpbF5NSpU6EoyhNf4eHhOtPExsaiW7duePHFFzF69Ognzn/y5MlITk7WvmJiYsrz45CeatDjddyDFZwRj8gdS2THIT2TnpYK/4TtAACTJq9KTkNElVm1vGZy3LhxePnlJz871svLS/v/2NhYdOjQAS1atMD8+fOfOn9jY2MYGxs/a0yiJzIxNcfJmi+jxY35sDz5K0T3keyWhSrM2d3LEaKk4zYc4d+yl+w4RFSJVcti0sHBAQ4ODsUa99atW+jQoQOCg4OxcOFCqLizpkrEt9d4ZM5diLo5F3EubCf8mnWVHYn0hMnZvEd6XvfoCxcDA8lpiKgy0+vKKTY2Fu3bt4eHhwe+/fZbxMfHIy4uDnFxcbKjEQEA7JzcEGmf1+NAxv4fJKchfRF7/QICMiMAAJ6dXpMbhogqPb0uJnfs2IHLly9jz549cHd3h4uLi/ZFVFnU6DIRANAw7TBuXj4jOQ3pg+jdCwAAZ4yD4OrFviWJ6Mn0upgcPnw4hBCFvogqC896jRFp2hQqReDWttmy41A1p8nNhVfM3wCAjIDBcsMQUZWg18UkUVVh0OptAEBg/CYkJ96RnIaqs6jDm+CCeKTADAGdhsiOQ0RVAItJoiqgfsteuGLgDTMlE1GbeO0klZ+MsLxuqM7Zd4GJmYXkNERUFbCYJKoCFJUK9xu+AQDwubYcGelpkhNRdZR8PwEByfsBALatRkpOQ0RVBYtJoiqiYbeRiIMDHJCEyE3zZMehauj8zoUwUbJxTeUJn6A2suMQURXBYpKoijBSG+N63eEAALeoBcjNyZEbiKod24t/AgDu1B7ADvKJqNi4tSCqQgJ7v41kmMNd3EbkrmWy41A1cu3sUdTNuYhsYYC6nUfJjkNEVQiLSaIqxNzSBufc8x4VahE+F0KjkZyIqos7//4BADhj0QJ2Tm6S0xBRVcJikqiKqfv8e8gQRqibcxFnQzfLjkPVQGbGQ/je2QIAUBq9IjkNEVU1LCaJqhg7JzdEOvYGAGgOzJEbhqqFM7tXwBYpuAs7BLTrLzsOEVUxLCaJqiD3Hh8gVyhokBGOK6cOy45DVZzxqaUAgCseL8DQSC05DRFVNSwmiaogt1p+iLDqAAC4v+s7yWmoKou5fBoBmRHQCAXencfIjkNEVRCLSaIqyvq5SQCAoOQ9iL1+QXIaqqpu7s7rs/S0WRM41/SRnIaIqiIWk0RVVJ2GrXDauDEMFQ1iNs2UHYeqoKzMDNS9vREAoGk0THIaIqqqWEwSVWFK6/EAgAbxG3Hv7i25YajKObNnJeyRjHjYIrDDQNlxiKiKYjFJVIXVb9UblwzqwFTJwoWN38uOQ1WMUcQSAMBl93688YaISo3FJFEVpqhUSAkeBwDwi1mJhw+SJSeiquLW1XMIzDwBjVDg+RxvvCGi0mMxSVTFBXUZipuKM2zwAKc2/ld2HKoibuz6BQBwxjQErl6+ktMQUVXGYpKoijMwNMQtv9EAAK8LC5GdlSk5EVV22VmZ8In9BwCQwxtviOgZsZgkqgYa9hqLRFjDGfGI2PKb7DhUyZ3ZuwoOSEICbHjjDRE9MxaTRNWAiZkFLnoPBQA4nfoZmtxcyYmoMjM4uRgAcMmtL4zUxpLTEFFVx2KSqJoI6PseUmAOT81NROxYIjsOVVIxl0+jQcbx/914M1Z2HCKqBlhMElUTltZ2OOsxCABgHf4DhEYjORFVRrd25t2kddqsKVy960lOQ0TVAYtJomrEr8/7SBMmqJ17Daf2/Sk7DlUy6Wmp8L+T98QbNH1NbhgiqjZYTBJVIzYOzjjlOgAAYHL4ex6dJB2nt/0OK6ThllIDgW1fkB2HiKoJFpNE1YxPn4+QIYzgm3MeZw9vkh2HKgmh0cAuKu9a2pjag6AyMJCciIiqCxaTRNWMg7MHIp36AACUf7+VnIYqiwvH96BO7hVkCCP4dX9TdhwiqkZYTBJVQ57PT0aWMED9rEicP7ZTdhyqBB4cyHvizSnbzrC2ryE5DRFVJywmiaohZ486iLDrDgDI3PsfyWlItsQ7N9EgeR8AwLY9j0oSUdliMUlUTbn2nIxcoaBh+jFcjjwoOw5JdGnrz1ArObhoWBc+QW1kxyGiaobFJFE15V4nACetOwEAUnbMlJyGZMnNyYHX9dUAgOSA4XLDEFG1xGKSqBpz6D4ZANA47V9EnzsuOQ3JcGrPKjgjAfdhhcCuw2XHIaJqiMUkUTXm5ReCE+Z5pzXjt3wlOQ3JYBw+DwBw3rUvTEzNJachouqIxSRRNWfd9WMAQOOUPTw6qWcuRx6Ef9ZpZAsD1O45UXYcIqqmWEz+T2ZmJoKCgqAoCiIiImTHISoztRu0xEnz1lApAglbvpAdhyrQ/T0/AAAirTvAyc1bchoiqq5YTP7PBx98AFdXV9kxiMqFdffPAQCNUvbhWlSY5DRUERJio9EwaTcAwKr9O5LTEFF1xmISwNatW7Fjxw58+y2fFkLVU62AZjhh0RYqReD+lumy41AFuLRlDtRKLs4Z+aNu43ay4xBRNab3xeSdO3fw2muvYenSpTAzMyvWNJmZmUhJSdF5EVV2tj0+h0YoaPzgX1w9c1R2HCpHGQ8foN7NvwAA6cFvSE5DRNWdXheTQggMHz4cY8aMQUhISLGnmzFjBqytrbUvDw+PckxJVDa8/ZvgpGXeEaqkrbx2sjo7tfU32CIFt+GIBp0Gy45DRNVctSwmp06dCkVRnvgKDw/HTz/9hJSUFEyePLlE8588eTKSk5O1r5iYmHL6JERly6Hn/45Oph3AlVOHZcehciA0Gjid/R0AEO0zFIZGasmJiKi6U4QQQnaIspaQkICEhIQnjuPl5YWXX34ZGzduhKIo2uG5ubkwMDDAkCFDsHjx4mK9X0pKCqytrZGcnAwrK6tnyk5U3sK/ewEhqbtx0qwlGn2wVXYcKmOn//0HgXteRZowQe6EKFjZ2MuORFRpcf9dNqplMVlcN27c0LneMTY2Fl27dsVff/2FZs2awd3dvVjz4cJIVUn0hQi4r2gPA0XgUt9NfFZzNRM5szMaph/DEccX0fyt32THIarUuP8uG4ayA8hUs2ZNnZ8tLCwAALVr1y52IUlU1Xj6BiHcuhNCUnYhbfuXQNB22ZGojFw7exQN048hVyjw6D5Bdhwi0hPV8ppJInqyGr0/R65QEJR+BOfDdsmOQ2UkcfssAECkZVu41aovOQ0R6QsWk4/w8vKCEAJBQUGyoxCVKw+fhjhu1wMAoNk5FUKjkZyIntXt6AsISs7rpNzyufclpyEifcJikkhP1XxhOjKFEfyzTuP0/nWy49Azit40C4aKBqeNG/E6WCKqUCwmifSUs0cdnHQeAAAwP/gVNLm5khNRaSUlxKHB3Q15P7TitZJEVLFYTBLpsXovTkWqMEXt3Ks4se0P2XGolM5t+A5mSiYuG9RGQOvesuMQkZ5hMUmkx2wcnHHGaxgAwDn8W2RnZUpORCX18EEy6t1YCQBIDn4LioqbdSKqWNzqEOm5BgMm4x6s4C7icOKfn2THoRI6tXEubJGKm4ozgroMkx2HiPQQi0kiPWduaYOLvmMBALXO/hfpaamSE1FxZWVmwOtC3uUJt/xGw8BQr7sOJiJJWEwSERr1G49YxQmOuI+Itf+RHYeKKWLjz3BGPBJgg4a9xsqOQ0R6isUkEcHYxAy3gvLuAq5/9TckJcRJTkRPk52VCfezvwAALtcdDRMzC8mJiEhfsZgkIgBA456v46rKC1Z4iPOrP5Udh54iYtM8uIq7eUcl+4yXHYeI9BiLSSICABgYGiKt/XQAQPDddYi5FCk5ERUlJzsLrqfnAgAu1xkBU3NLyYmISJ+xmCQircC2fRBp2gxGSi4S1n8kOw4V4eTm+XATd3APVmjQl52UE5FcLCaJSIdNn2+QI1Ro9PAwzh7aLDsOPSYnOwsukf8FAFysNRxmFtaSExGRvmMxSUQ6POs1xnHHvgAA4z2f8TGLlUzE1t/hLm7jPiwR2O892XGIiFhMElFBPgO/RKowRZ3cKzi+cZ7sOPQ/OdlZcIrI61j+vPerMLe0kRuIiAgsJomoEHZObjhb+zUAgGfEt+zIvJI4ufEX1NTcwn1YIqDvJNlxiIgAsJgkoiIEvfgRYhUnOOEeIlZNkx1H72Wkp8Hj1I8AgAt1RsPS2k5yIiKiPCwmiahQJqbmuN3kYwBAoxuLEHvtvORE+i1i/Ww4IwF3YYegF3hUkogqDxaTRFSkxt2G4YxxEEyUbNxZwy5oZHmQch++F+cDAK4HvM2n3RBRpcJikoiKpKhUsOw7G9nCAI0eHkbk3jWyI+ml0399DVukIEZxReM+42THISLSwWKSiJ7I0y8Yx50HAgDs/v0cmRkPJSfSL/fjbyMweikA4G6TSTA0UktORESki8UkET1V/cFfIwE28BCxOLH6S9lx9MqFNVNgoaTjskFtNOo6XHYcIqICWEwS0VNZWtvheuO8xys2vPob4mIuS06kH2IuRSL4zl8AgPS2n0JlYCA5ERFRQSwmiahYgnu9gXNG9WGmZOL2qndlx9ELCes/gpGSi0jTpghs94LsOEREhWIxSUTFoqhUMOn7fd7NOGkHcXLHMtmRqrUzhzai0cPDyBEq2PSZKTsOEVGRWEwSUbF512+GcLdXAABuhz9DavI9yYmqp9ycHJju+RwAcNyxLzzrNZaciIioaCwmiahEGr3yNW4qznDCPUQtZefZ5eH4xp9RO/cqUmCGui99LTsOEdETsZgkohIxMbNAUsf/AACaxK/D+fDdkhNVLw9S7sM7cjYAIKrOG7B1dJGciIjoyVhMElGJBbTpgzDrblApAsZbJiA7K1N2pGrjzPLJcMR93FSc0WjAB7LjEBE9FYtJIiqVOq/MwX1YwVsTjfDln8uOUy1ciwpDSNxqAEBi2y9hbGImORER0dOxmCSiUrF1dMGVxp8AAIKvL8CV00ckJ6rahEaDjPXvwlDR4KR5azTs8KLsSERExcJikohKLbjX6zhp1gpqJRfK+jeQlZkhO1KVFb7hZ/hln8VDYQyXl+bIjkNEVGwsJomo1BSVCh6v/or7sEItzXUcX/KR7EhVUvK9eNSOyOtLMrL2G3Cu6SM5ERFR8bGYJKJn4uDsgWvNpgMAmtxcjIsn9skNVAVdWPIO7JCCaJUHgl/6RHYcIqISYTEJYPPmzWjWrBlMTU3h4OCAF17gY8uISqJx9xEIt3oOhooGxpveQnpaquxIVcbp/evQNGkLNEJBetfZUBubyI5ERFQiel9Mrl27FkOHDsWIESMQGRmJQ4cOYfDgwbJjEVU5PsN+Rjxs4am5iVN/vCU7TpXwIOU+HPbmdf8T5tQf9Zp1kZyIiKjkFCGEkB1ClpycHHh5eWHatGkYNWpUqeeTkpICa2trJCcnw8rKqgwTElUtp//9B/V3D4NKETjR/Ac07jZcdqRK7eh/R6BZwjrEKk6wnhgGc0sb2ZGI9Ar332VDr49MnjhxArdu3YJKpUKjRo3g4uKC7t274+zZs0+cLjMzEykpKTovIgIC2/bBUdehAIA6Rz7G7egLkhNVXlGhW9EsYR0AILHDtywkiajK0uti8urVqwCAqVOn4tNPP8WmTZtga2uLdu3a4d69e0VON2PGDFhbW2tfHh4eFRWZqNILGfEtLhj6wgppSFo2HDnZWbIjVTrJ9xNgt/1tAMAx254IbNtHciIiotKrlsXk1KlToSjKE1/h4eHQaDQAgE8++QT9+/dHcHAwFi5cCEVRsGbNmiLnP3nyZCQnJ2tfMTExFfXRiCo9I7UxLIcsQaowhV92FMIW8ZGAj7u08A04Ix63lBrwG/5f2XGIiJ6JoewA5WHcuHF4+eWXnziOl5cXUlPz7jj19/fXDjc2NkatWrVw48aNIqc1NjaGsbFx2YQlqoZcvevheNMvERz2HlrcWoiInU0R1Jk3tgFA+IZ5CEnZhRyhQmrPn+FmbSc7EhHRM6mWxaSDgwMcHByeOl5wcDCMjY1x4cIFtG7dGgCQnZ2N69evw9PTs7xjElVrwT1H4+j1UDSL/wu1D07EDU9/1KwbJDuWVLHXL8D3+FRAAcI8X0OLJs/JjkRE9Myq5Wnu4rKyssKYMWMwZcoU7NixAxcuXMDYsWMBAC++yOfiEj2rxq/9jCijAFgq6RCrXsGDlPuyI0mTmfEQqcuGwlJJx3kjfzQZ+qXsSEREZUKvi0kAmDVrFl5++WUMHToUTZo0QXR0NPbs2QNbW1vZ0YiqPCO1MZxGrcRd2MFTE4NLv74CTW6u7FhSRCwYC9+cC0iGOayGLIKhkVp2JCKiMqHX/UyWFfZTRfRk58N3o9bGF6FWcnHEfRSaj54tO1KFCvvnZzQ5ORkaoeB0u/lo2HGg7EhEBO6/y4reH5kkovJXL6QTIhp8DgBofvN3HFv/k+REFefqmaMIODEFAHC05mgWkkRU7bCYJKIK0bT/eIS6DgMANIqYgjMH/pGcqPwl3rkJk7WvwFTJwimTJmg2fKbsSEREZY7FJBFVmGajvke4ZScYKbnw3PUGrp09KjtSucl4+AAJC/rDVdzFTcUZNUcvg8rAQHYsIqIyx2KSiCqMysAAgW8t097hbblmIGIun5Ydq8xpcnNx9uch8M05j2SYQzNoNWwcnGXHIiIqFywmiahCGZuYwW3s37hi4A0HJMFoWd9q9QxvodHg2Py3EPxgH7KEAW52XqD3/WsSUfXGYpKIKpy1nSNsXt+EaJU7nJEAzaLeuHvrmuxYZeLIoo/Q/M5KAEBkoy9Qv1VPyYmIiMoXi0kiksK+hjtMR23CLaUG3MQdZP3WvcofoTyyfDpa3Pg17/9130eTvm9JTkREVP5YTBKRNE5u3lCGbUSsUgPu4jYMFnZD9PkTsmOVypEVX6D5pe8AAKGeY9B88KeSExERVQwWk0QklauXLwxHb8d1lQeccA9Wq/rgUsQB2bGKTWg0CP3jAzS/+C0AINTlVTQfNkNyKiKiisNikoikc3LzhvXYnbhk6ANbpMBtfX+c3LFMdqyn0uTm4uivb2pPbYd6jkHz136AouKmlYj0B7d4RFQp2Dq6wPntHTht3AhmSiYaHhqH0MUfQ2g0sqMVKi01CZHf9dLebHOk7iS0GDGThSQR6R1u9Yio0rC0tkO997bjqMMLUCkCLa7NxcnZfZB8P0F2NB23oy8gbk57NHp4GJnCCOHB/0HzwZ/JjkVEJAWLSSKqVIzUxmg2biGO+n+CbGGAxg/+xcMfmuN82C7Z0QAAJ7YtgvnCDqidew0JsMG13qsR0vsN2bGIiKRhMUlElVKzgR/gWp91uKXUgAviUWfTizgy702kp6VKyfMg5T6O/jgUjY+8Cyuk4aJhXeSM3IV6IZ2k5CEiqixYTBJRpVW3cXtYvhuKcMtOMFQ0aB63HPe/DUbk3jUVdi2l0GhwfMtCPJzdGM3ubYBGKAh1fRXeHxyEc02fCslARFSZKUIIITtEVZeSkgJra2skJyfDyspKdhyiaili5wq4HPoUNZAIADirbgCDLlPL9cjgxRP7kLl9KgIzTwIAbirOSOo0CwGtny+39ySiisP9d9lgMVkGuDASVYwHKfdxZvlkNI5bA7WSAwA4bdwIuSGvI7DDQBgYGj7zewiNBmcOboQmdC4aph8FAGQJQxyvORyNBk2DiZnFM78HEVUO3H+XDRaTZYALI1HFuh19ATHrpyL4/lYYKHmbsFjFCdEu3eDQ5EXUadi6RF30CI0G0RdO4PaRNXCL2YiamlsAgFyh4IRNV7j2mQq3Wn7l8lmISB7uv8sGi8kywIWRSI7Ya+dxY/uP8Iv7G9ZI0w6/D0tcNwtEhkMAjBzrwMLJG8aWtlCbWCAn8yEy01Px4M41ZMZfhfHdSLg/OA0n3NNO/0CY4qxjd7h2HQ8Pn4YyPhoRVQDuv8sGi8kywIWRSK70tFRE7VsN5dwG1Es9AjMls8TzyBKGiDILQVbdnvDvNBQWVrblkJSIKhPuv8sGi8kywIWRqPLIyszAtdOHcf/8v1AlXIBF2g1Y58TDVKTDRGQiU1EjEyZIMnTAAzM35Nj5wrJua3g3aAUzC2vZ8YmoAnH/XTae/Wp1IqJKRG1sAt+QjkBIx0J/b/a/f50rLhIRUbXGfiaJiIiIqNRYTBIRERFRqbGYJCIiIqJSYzFJRERERKXGYpKIiIiISo3FJBERERGVGotJIiIiIio1FpNEREREVGosJomIiIio1FhMEhEREVGpsZgkIiIiolJjMUlEREREpcZikoiIiIhKjcUkEREREZWaoewA1YEQAgCQkpIiOQkREREVV/5+O38/TqXDYrIMpKamAgA8PDwkJyEiIqKSSk1NhbW1tewYVZYiWI4/M41Gg9jYWFhaWkJRlDKbb0pKCjw8PBATEwMrK6symy/pYjtXHLZ1xWA7Vwy2c8Uoz3YWQiA1NRWurq5QqXjlX2nxyGQZUKlUcHd3L7f5W1lZcUNVAdjOFYdtXTHYzhWD7VwxyqudeUTy2bEMJyIiIqJSYzFJRERERKXGYrISMzY2xpQpU2BsbCw7SrXGdq44bOuKwXauGGznisF2rvx4Aw4RERERlRqPTBIRERFRqbGYJCIiIqJSYzFJRERERKXGYpKIiIiISo3FpGQ///wzvL29YWJiguDgYBw4cOCJ4+/fvx/BwcEwMTFBrVq1MG/evApKWrWVpJ3XrVuHzp07w9HREVZWVmjRogW2b99egWmrrpIuz/kOHToEQ0NDBAUFlW/AaqSkbZ2ZmYlPPvkEnp6eMDY2Ru3atfHHH39UUNqqq6TtvHz5cjRs2BBmZmZwcXHBiBEjkJiYWEFpq6Z///0XvXv3hqurKxRFwd9///3UabgvrGQESbNq1SphZGQkFixYIKKiosS7774rzM3NRXR0dKHjX716VZiZmYl3331XREVFiQULFggjIyPx119/VXDyqqWk7fzuu++KmTNnimPHjomLFy+KyZMnCyMjI3HixIkKTl61lLSd8yUlJYlatWqJLl26iIYNG1ZM2CquNG39/PPPi2bNmomdO3eKa9euiaNHj4pDhw5VYOqqp6TtfODAAaFSqcQPP/wgrl69Kg4cOCDq168v+vbtW8HJq5YtW7aITz75RKxdu1YAEOvXr3/i+NwXVj4sJiVq2rSpGDNmjM6wevXqiY8++qjQ8T/44ANRr149nWFvvPGGaN68ebllrA5K2s6F8ff3F9OmTSvraNVKadv5pZdeEp9++qmYMmUKi8liKmlbb926VVhbW4vExMSKiFdtlLSdZ82aJWrVqqUz7McffxTu7u7llrG6KU4xyX1h5cPT3JJkZWXh+PHj6NKli87wLl264PDhw4VOExoaWmD8rl27Ijw8HNnZ2eWWtSorTTs/TqPRIDU1FXZ2duURsVoobTsvXLgQV65cwZQpU8o7YrVRmrbesGEDQkJC8J///Adubm6oW7cuJk2ahPT09IqIXCWVpp1btmyJmzdvYsuWLRBC4M6dO/jrr7/Qs2fPioisN7gvrHwMZQfQVwkJCcjNzUWNGjV0hteoUQNxcXGFThMXF1fo+Dk5OUhISICLi0u55a2qStPOj/vuu++QlpaGgQMHlkfEaqE07Xzp0iV89NFHOHDgAAwNuSkqrtK09dWrV3Hw4EGYmJhg/fr1SEhIwJtvvol79+7xuskilKadW7ZsieXLl+Oll15CRkYGcnJy8Pzzz+Onn36qiMh6g/vCyodHJiVTFEXnZyFEgWFPG7+w4aSrpO2cb+XKlZg6dSpWr14NJyen8opXbRS3nXNzczF48GBMmzYNdevWrah41UpJlmmNRgNFUbB8+XI0bdoUPXr0wOzZs7Fo0SIenXyKkrRzVFQU3nnnHXz++ec4fvw4tm3bhmvXrmHMmDEVEVWvcF9YufBwgCQODg4wMDAo8Bfu3bt3C/zFlc/Z2bnQ8Q0NDWFvb19uWauy0rRzvtWrV2PUqFFYs2YNnnvuufKMWeWVtJ1TU1MRHh6OkydPYty4cQDyCh4hBAwNDbFjxw507NixQrJXNaVZpl1cXODm5gZra2vtMD8/PwghcPPmTfj4+JRr5qqoNO08Y8YMtGrVCu+//z4AoEGDBjA3N0ebNm3w5Zdf8ohZGeG+sPLhkUlJ1Go1goODsXPnTp3hO3fuRMuWLQudpkWLFgXG37FjB0JCQmBkZFRuWauy0rQzkHdEcvjw4VixYgWvdyqGkrazlZUVTp8+jYiICO1rzJgx8PX1RUREBJo1a1ZR0auc0izTrVq1QmxsLB48eKAddvHiRahUKri7u5dr3qqqNO388OFDqFS6u1UDAwMA/3/kjJ4d94WVkKQbf0j8f7cTv//+u4iKihLjx48X5ubm4vr160IIIT766CMxdOhQ7fj53SFMmDBBREVFid9//53dIRRDSdt5xYoVwtDQUMydO1fcvn1b+0pKSpL1EaqEkrbz43g3d/GVtK1TU1OFu7u7GDBggDh79qzYv3+/8PHxEaNHj5b1EaqEkrbzwoULhaGhofj555/FlStXxMGDB0VISIho2rSprI9QJaSmpoqTJ0+KkydPCgBi9uzZ4uTJk9oumLgvrPxYTEo2d+5c4enpKdRqtWjcuLHYv3+/9nfDhg0T7dq10xl/3759olGjRkKtVgsvLy/xyy+/VHDiqqkk7dyuXTsBoMBr2LBhFR+8iinp8vwoFpMlU9K2PnfunHjuueeEqampcHd3FxMnThQPHz6s4NRVT0nb+ccffxT+/v7C1NRUuLi4iCFDhoibN29WcOqqZe/evU/c5nJfWPkpQvDYOxERERGVDq+ZJCIiIqJSYzFJRERERKXGYpKIiIiISo3FJBERERGVGotJIiIiIio1FpNEREREVGosJomIiIio1FhMEhEREVGpsZgkIiIiolJjMUlEREREpcZikojoMfHx8XB2dsbXX3+tHXb06FGo1Wrs2LFDYjIiosqHz+YmIirEli1b0LdvXxw+fBj16tVDo0aN0LNnT8yZM0d2NCKiSoXFJBFREd566y3s2rULTZo0QWRkJMLCwmBiYiI7FhFRpcJikoioCOnp6QgICEBMTAzCw8PRoEED2ZGIiCodXjNJRFSEq1evIjY2FhqNBtHR0bLjEBFVSjwySURUiKysLDRt2hRBQUGoV68eZs+ejdOnT6NGjRqyoxERVSosJomICvH+++/jr7/+QmRkJCwsLNChQwdYWlpi06ZNsqMREVUqPM1NRPSYffv2Yc6cOVi6dCmsrKygUqmwdOlSHDx4EL/88ovseERElQqPTBIRERFRqfHIJBERERGVGotJIiIiIio1FpNEREREVGosJomIiIio1FhMEhEREVGpsZgkIiIiolJjMUlEREREpcZikoiIiIhKjcUkEREREZUai0kiIiIiKjUWk0RERERUaiwmiYiIiKjU/g84H4ybSNIaSwAAAABJRU5ErkJggg==", - "text/plain": [ - "
" - ] - }, - "metadata": {}, - "output_type": "display_data" - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "The max absolute difference is: 1.77636e-15\n" - ] - } - ], + "execution_count": 7, + "id": "f42e9964", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "import autograd.numpy as np\n", "\n", @@ -1433,8 +1504,10 @@ }, { "cell_type": "markdown", - "id": "7f495197", - "metadata": {}, + "id": "9a9dd7cb", + "metadata": { + "editable": true + }, "source": [ "## Using autograd\n", "\n", @@ -1447,19 +1520,13 @@ }, { "cell_type": "code", - "execution_count": 49, - "id": "3e79535c", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "The gradient of f1 evaluated at a = 1 using autograd is: 3\n", - "The gradient of f1 evaluated at a = 1 by finding the analytic expression is: 3\n" - ] - } - ], + "execution_count": 8, + "id": "f5d99737", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "import autograd.numpy as np\n", "from autograd import grad\n", @@ -1482,8 +1549,10 @@ }, { "cell_type": "markdown", - "id": "9d764d7c", - "metadata": {}, + "id": "1a033f2a", + "metadata": { + "editable": true + }, "source": [ "## Autograd with more complicated functions\n", "\n", @@ -1494,24 +1563,13 @@ }, { "cell_type": "code", - "execution_count": 50, - "id": "b171c0bc", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Evaluating at x1 = 1, x2 = 3\n", - "------------------------------\n", - "The derivative of f2 w.r.t x1: 12\n", - "The analytical derivative of f2 w.r.t x1: 12\n", - "\n", - "The derivative of f2 w.r.t x2: -4\n", - "The analytical derivative of f2 w.r.t x2: -4\n" - ] - } - ], + "execution_count": 9, + "id": "36ba3883", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "import autograd.numpy as np\n", "from autograd import grad\n", @@ -1550,25 +1608,32 @@ }, { "cell_type": "markdown", - "id": "65098808", - "metadata": {}, + "id": "98a7ad40", + "metadata": { + "editable": true + }, "source": [ "Note that the grad function will not produce the true gradient of the function. The true gradient of a function with two or more variables will produce a vector, where each element is the function differentiated w.r.t a variable." ] }, { "cell_type": "markdown", - "id": "5d60df18", - "metadata": {}, + "id": "a840a46c", + "metadata": { + "editable": true + }, "source": [ "## More complicated functions using the elements of their arguments directly" ] }, { "cell_type": "code", - "execution_count": 16, - "id": "cc4cc7eb", - "metadata": {}, + "execution_count": 10, + "id": "0ce16fc4", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "import autograd.numpy as np\n", @@ -1592,8 +1657,10 @@ }, { "cell_type": "markdown", - "id": "d71a9a54", - "metadata": {}, + "id": "470f7e16", + "metadata": { + "editable": true + }, "source": [ "Note that in this case, when sending an array as input argument, the\n", "output from Autograd is another array. This is the true gradient of\n", @@ -1605,17 +1672,22 @@ }, { "cell_type": "markdown", - "id": "290988a2", - "metadata": {}, + "id": "4d7c7e61", + "metadata": { + "editable": true + }, "source": [ "## Functions using mathematical functions from Numpy" ] }, { "cell_type": "code", - "execution_count": 17, - "id": "4afa9fe3", - "metadata": {}, + "execution_count": 11, + "id": "69eceec6", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "import autograd.numpy as np\n", @@ -1639,17 +1711,22 @@ }, { "cell_type": "markdown", - "id": "ec23dce0", - "metadata": {}, + "id": "02192e06", + "metadata": { + "editable": true + }, "source": [ "## More autograd" ] }, { "cell_type": "code", - "execution_count": 18, - "id": "be794060", - "metadata": {}, + "execution_count": 12, + "id": "6f5d7fa7", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "import autograd.numpy as np\n", @@ -1670,17 +1747,22 @@ }, { "cell_type": "markdown", - "id": "1d8e15c2", - "metadata": {}, + "id": "25b7c609", + "metadata": { + "editable": true + }, "source": [ "## And with loops" ] }, { "cell_type": "code", - "execution_count": 19, - "id": "d696c96c", - "metadata": {}, + "execution_count": 13, + "id": "043eb7de", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "import autograd.numpy as np\n", @@ -1711,9 +1793,12 @@ }, { "cell_type": "code", - "execution_count": 20, - "id": "5cdbff7d", - "metadata": {}, + "execution_count": 14, + "id": "880bc7f0", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "import autograd.numpy as np\n", @@ -1729,17 +1814,22 @@ }, { "cell_type": "markdown", - "id": "ec95c41c", - "metadata": {}, + "id": "322163dd", + "metadata": { + "editable": true + }, "source": [ "## Using recursion" ] }, { "cell_type": "code", - "execution_count": 21, - "id": "06c8423e", - "metadata": {}, + "execution_count": 15, + "id": "09f1a79b", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "import autograd.numpy as np\n", @@ -1773,16 +1863,20 @@ }, { "cell_type": "markdown", - "id": "4675445a", - "metadata": {}, + "id": "33d9596d", + "metadata": { + "editable": true + }, "source": [ "Note that if n is equal to zero or one, Autograd will give an error message. This message appears when the output is independent on input." ] }, { "cell_type": "markdown", - "id": "3ea2267f", - "metadata": {}, + "id": "2b87a3af", + "metadata": { + "editable": true + }, "source": [ "## Using Autograd with OLS\n", "\n", @@ -1793,34 +1887,13 @@ }, { "cell_type": "code", - "execution_count": 51, - "id": "49c5a124", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Own inversion\n", - "[[3.98094809]\n", - " [3.10504501]]\n", - "Eigenvalues of Hessian Matrix:[0.27678028 4.83090115]\n", - "theta from own gd\n", - "[[3.98094809]\n", - " [3.10504501]]\n" - ] - }, - { - "data": { - "image/png": "iVBORw0KGgoAAAANSUhEUgAAAkMAAAHFCAYAAADxOP3DAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjguMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy81sbWrAAAACXBIWXMAAA9hAAAPYQGoP6dpAABWNElEQVR4nO3deXxM5/4H8M9kFyQE2RNCEcS+L0HaotZBVcuvqm53S6toS7UXbdWl2tKr2uu25d660YUwVDclQYtWLbUTGsQSsSaRkGXm+f0xnUkmmWSWnJk5M+fzfr3ySuecM+c8Z8Z0vnme7/N9VEIIASIiIiKF8nJ1A4iIiIhcicEQERERKRqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUjcEQkQytWrUKKpXK+OPj44OIiAg88sgjSE9Pd1m75s6dC5VK5bLru4OzZ89CpVJh8eLFrm4KEVnJx9UNIKLKrVy5EvHx8bh79y5++eUXzJ8/H6mpqThx4gTq1q3r6uYREXkEBkNEMpaQkIBOnToBAPr27QutVos5c+Zgw4YNmDBhgotbR65UXFxs7DUkourhMBmRGzEERleuXDFuu3v3LqZPn4527dohODgYISEh6N69OzQaTYXnq1QqTJ48GZ9//jlatGiBwMBAtG3bFt98802FYzdv3ox27drB398fcXFxlQ773L17F7NmzUJcXBz8/PwQFRWFSZMm4datWybHNWrUCEOGDME333yD9u3bo0aNGmjRooXx2qtWrUKLFi1Qs2ZNdOnSBb///rvF18MwnJiamornnnsO9evXR7169TBy5EhcunSpwr3PnTu3wjkaNWqExx9/vMI5t23bhqeeegr16tVDUFAQHnvsMeTn5yMrKwujR49GnTp1EBERgRkzZqC4uLjCeXU6HebPn4/Y2FgEBASgU6dO2Lp1a4Xj0tPTMXbsWISGhsLf3x8tWrTAhx9+aHJMWloaVCoVPv/8c0yfPh1RUVHw9/fH6dOnUVBQgBkzZiAuLg4BAQEICQlBp06dsGbNGouvHxHp8U8KIjeSkZEBAGjWrJlxW2FhIW7cuIEZM2YgKioKRUVF+OmnnzBy5EisXLkSjz32mMk5Nm/ejL179+KNN95ArVq1sGjRIowYMQInT55E48aNAQBbt26FWq1G9+7d8cUXX0Cr1WLRokUmQRgACCEwfPhwbN26FbNmzUJiYiIOHTqEOXPmYPfu3di9ezf8/f2Nx//xxx+YNWsWZs+ejeDgYMybNw8jR47ErFmzsHXrVrz99ttQqVR45ZVXMGTIEGRkZKBGjRoWX5cnn3wSgwcPRnJyMjIzM/HSSy/h0UcfxbZt2+x+rZ988kmMHDkSX3zxBQ4cOIBXX30VJSUlOHnyJEaOHImnn34aP/30ExYuXIjIyEhMmzbN5PnLli1Dw4YNsWTJEuh0OixatAgDBw7E9u3b0b17dwDAsWPH0KNHD8TGxuLdd99FeHg4fvjhBzz//PO4du0a5syZY3LOWbNmoXv37vj444/h5eWF0NBQTJs2DZ9//jneeusttG/fHvn5+Thy5AiuX79u970TKY4gItlZuXKlACD27NkjiouLRV5envj+++9FeHi46N27tyguLq70uSUlJaK4uFg88cQTon379ib7AIiwsDCRm5tr3JaVlSW8vLzEggULjNu6du0qIiMjxZ07d4zbcnNzRUhIiCj7v43vv/9eABCLFi0yuc6XX34pAIgVK1YYtzVs2FDUqFFDXLhwwbjt4MGDAoCIiIgQ+fn5xu0bNmwQAMTGjRutep0mTpxosn3RokUCgLh8+bLJvc+ZM6fCORo2bCjGjx9f4ZxTpkwxOW748OECgHjvvfdMtrdr10506NDB+DgjI0MAqPT1u//++43bBgwYIKKjo0VOTo7JOSdPniwCAgLEjRs3hBBCpKamCgCid+/eFdqfkJAghg8fXmE7EVmPw2REMtatWzf4+vqidu3aeOCBB1C3bl1oNJoKeSJff/01evbsiVq1asHHxwe+vr749NNPcfz48QrnTEpKQu3atY2Pw8LCEBoainPnzgEA8vPzsXfvXowcORIBAQHG42rXro2hQ4eanMvQ81J2mAkAHnroIdSsWbPCsFC7du0QFRVlfNyiRQsA+nyowMDACtsNbbJk2LBhJo/btGlj0/PNGTJkiMljQ5sGDx5cYbu561T2+u3YsQNarRZ3797F1q1bMWLECAQGBqKkpMT4M2jQINy9exd79uwxOeeDDz5Y4TpdunTBd999h5kzZyItLQ137tyx+56JlIrBEJGM/fe//8XevXuxbds2PPPMMzh+/DjGjBljckxKSgpGjx6NqKgorF69Grt378bevXvxt7/9DXfv3q1wznr16lXY5u/vb/wSvXnzJnQ6HcLDwyscV37b9evX4ePjgwYNGphsV6lUCA8PrzBUExISYvLYz8+vyu3m2m9O+XsyDM1VJzCwpa3m2lnZ61dUVITbt2/j+vXrKCkpwT//+U/4+vqa/AwaNAgAcO3aNZPnR0REVDjnBx98gFdeeQUbNmxAUlISQkJCMHz4cJeWYCByN8wZIpKxFi1aGJOmk5KSoNVq8cknn2Dt2rUYNWoUAGD16tWIi4vDl19+aVIDqLCw0K5r1q1bFyqVCllZWRX2ld9Wr149lJSU4OrVqyYBkRACWVlZ6Ny5s11tcAR/f3+zr4mjcmsqe/38/PxQq1Yt+Pr6wtvbG+PGjcOkSZPMniMuLs7ksbkaTzVr1sS8efMwb948XLlyxdhLNHToUJw4cUKamyHycOwZInIjixYtQt26dfH3v/8dOp0OgP4L0s/Pz+SLMisry+xsMmsYZnOlpKSY9Hjk5eVh06ZNJsfed999APQBWVnr1q1Dfn6+cb8cNGrUCIcOHTLZtm3bNty+fdsh16vs9UtMTIS3tzcCAwORlJSEAwcOoE2bNujUqVOFH3O9eFUJCwvD448/jjFjxuDkyZMoKCiQ+raIPBJ7hojcSN26dTFr1iy8/PLLSE5OxqOPPoohQ4YgJSUFEydOxKhRo5CZmYk333wTERERdg+VvPnmm3jggQfQr18/TJ8+HVqtFgsXLkTNmjVx48YN43H9+vXDgAED8MorryA3Nxc9e/Y0ziZr3749xo0bJ9WtV9u4cePw+uuv4+9//zv69OmDY8eOYdmyZQgODnbI9by9vdGvXz9MmzYNOp0OCxcuRG5uLubNm2c8ZunSpejVqxcSExPx3HPPoVGjRsjLy8Pp06exadMmq2bDde3aFUOGDEGbNm1Qt25dHD9+HJ9//jm6d+9ukodFRJVjMETkZqZMmYJly5bhjTfewJgxYzBhwgRkZ2fj448/xmeffYbGjRtj5syZuHDhgskXry369euHDRs24LXXXsPDDz+M8PBwTJw4EXfu3DE5p0qlwoYNGzB37lysXLkS8+fPR/369TFu3Di8/fbbJtPqXe2ll15Cbm4uVq1ahcWLF6NLly746quvoFarHXK9yZMn4+7du3j++eeRnZ2NVq1aYfPmzejZs6fxmJYtW2L//v1488038dprryE7Oxt16tRB06ZNjXlDltx7773YuHEj3n//fRQUFCAqKgqPPfYYZs+e7ZD7IvJEKiGEcHUjiIiIiFyFOUNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUTRF1hnQ6HS5duoTatWubLWdPRERE8iOEQF5eHiIjI+Hl5bj+G0UEQ5cuXUJMTIyrm0FERER2yMzMRHR0tMPOr4hgqHbt2gD0L2ZQUJCLW0NERETWyM3NRUxMjPF73FEUEQwZhsaCgoIYDBEREbkZR6e4MIGaiIiIFI3BEBERESkagyEiIiJSNAZDREREpGgMhoiIiEjRGAwRERGRojEYIiIiIkVjMERERESKxmCIiIiIFI3BEBERESkagyEiIiJSNAZDREREpGgMhoiIiEjRGAwRERGRojEYIiIiIkVjMERERESKxmCIiIiIFM3lwdCOHTswdOhQREZGQqVSYcOGDZUe+8wzz0ClUmHJkiVOax8RERF5NpcHQ/n5+Wjbti2WLVtW5XEbNmzAr7/+isjISCe1jIiIiJTAx9UNGDhwIAYOHFjlMRcvXsTkyZPxww8/YPDgwU5qGRERESmBy3uGLNHpdBg3bhxeeukltGrVytXNISIiIg/j8p4hSxYuXAgfHx88//zzVj+nsLAQhYWFxse5ubmOaBoRERF5AFn3DO3btw9Lly7FqlWroFKprH7eggULEBwcbPyJiYlxYCuJiIjInck6GNq5cyeys7MRGxsLHx8f+Pj44Ny5c5g+fToaNWpU6fNmzZqFnJwc409mZqbzGk1ERERuRdbDZOPGjcP9999vsm3AgAEYN24cJkyYUOnz/P394e/v7+jmERERkQdweTB0+/ZtnD592vg4IyMDBw8eREhICGJjY1GvXj2T4319fREeHo7mzZs7u6lERETkgVweDP3+++9ISkoyPp42bRoAYPz48Vi1apWLWkVERERK4fJgqG/fvhBCWH382bNnHdcYIiIiUhxZJ1ATERERORqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUjcEQERERKRqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUjcEQERERKRqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUjcEQERERKRqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUjcEQERERKRqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrm8mBox44dGDp0KCIjI6FSqbBhwwbjvuLiYrzyyito3bo1atasicjISDz22GO4dOmS6xpMREREHsXlwVB+fj7atm2LZcuWVdhXUFCA/fv34/XXX8f+/fuRkpKCU6dOYdiwYS5oKREREXkilRBCuLoRBiqVCuvXr8fw4cMrPWbv3r3o0qULzp07h9jYWKvOm5ubi+DgYOTk5CAoKEii1hIREZEjOev728dhZ3aQnJwcqFQq1KlTp9JjCgsLUVhYaHycm5vrhJYRERGRO3L5MJkt7t69i5kzZ2Ls2LFVRogLFixAcHCw8ScmJsaJrSQiIiJ34jbBUHFxMR555BHodDosX768ymNnzZqFnJwc409mZqaTWklERETuxi2GyYqLizF69GhkZGRg27ZtFscN/f394e/v76TWERERkTuTfTBkCITS09ORmpqKevXqubpJRERE5EFcHgzdvn0bp0+fNj7OyMjAwYMHERISgsjISIwaNQr79+/HN998A61Wi6ysLABASEgI/Pz8XNVsIiIi8hAun1qflpaGpKSkCtvHjx+PuXPnIi4uzuzzUlNT0bdvX6uuwan1RERE7kcxU+v79u2LquIxGZVBIiIiIg/kNrPJiIiIiByBwRAREREpGoMhIiIiUjQGQ0RERKRoDIaIiIhI0RgMERERkaK5fGo9ERGR29BqgZ07gcuXgYgIIDER8PZ2dauomhgMERERWSMlBXjhBeDChdJt0dHA0qXAyJGuaxdVG4fJiIiILElJAUaNMg2EAODiRf32lBTXtIskwWCIiIioKlqtvkfI3IoIhm1Tp+qPI7fEYIiIiKgqO3dW7BEqSwggM1N/nLvSaoG0NGDNGv1vhQV2zBkiIiKqyuXL0h7nLNYme9uTC+VhieTsGSIiIqpKRIS0xzlDSgrQqBGQlASMHav/3ahRxdwme3KhrD23G1EJBSwLn5ubi+DgYOTk5CAoKMjVzSEiInei1eq/7C9eNJ83pFLpe1IyMuTRO2IIcMq3VaXS/167Vt/jY7ivyoYAzd2XteeWiLO+v9kzREREVBVvb/2QEVD6pW9geLxkiTwCIUvJ3kLo9xuGuWzJhfLgRHIGQ0RERJaMHKnv9YiKMt0eHW1db4izEpQtBTiAfv/8+bbnQnlwIjkTqImIiKwxciSgVtueOOzMYo0ajXXHzZkDzJtn3bGGXCh3TSS3AoMhIiIia3l7A337Wn98ZTk2hgRlKXNsUlL0w3XW+ve/9UGZpVyoxET9Y3dMJLcSh8mIiIgcwZk5NoZr2eLCBeCpp/T/bU0uVGKiPjgqf2zZ58TElAZPboTBEBERkSM4M8fGmlwhc5o2tT4Xyp0SyW3EYIiIiMgRnJljY+85IiL0Ac/Zs0BqKpCcrP+dkWF++K66ieQyxZwhIiIiR3Bmjo2t5yifD2RLLpS9ieQyxmCIiIjIEQw5NtYmKDvyWuWvC1RvSMvWRHKZ4zAZERGRIzgzx6aqa5Xn5kNajsBgiIiIyFGcmWNT1bXmzbOcD6RgXJuMiIjI0Zy5yrsrVpR30DWd9f3NnCEiIiJHc2aOjbPzeZxZYdtBOExGRERE9jFU2C5f48hQYTslxTXtshGDISIiIrKdB61iz2CIiIiIbOdBq9gzGCIiIiLbedAq9gyGiIiIyHYetIo9gyEiIiKynQetYs9giIiIiGznQavYMxgiIiLydFotkJYGrFmj/y3VDC8PWcWeRReJiIg8maOLInrAKvYMhoiIiDyVoShi+VpAhqKIUvXeOKDqdX52Pr75x++SnrMyXJuMiIjIE2m1QKNGldcCUqn0PUQZGfLoxdFqceO/m3Bw5QFsORyOD26NQwF0ABz//e3ynKEdO3Zg6NChiIyMhEqlwoYNG0z2CyEwd+5cREZGokaNGujbty+OHj3qmsYSERG5Czcpinji2z+xvv0buOIbhZC/jcC9O9/AglsTcQItMEG10iltcHkwlJ+fj7Zt22LZsmVm9y9atAjvvfceli1bhr179yI8PBz9+vVDXl6ek1tKRETkRmRaFFFbpMUvHx3Cy13S0NwvA68OPgj1wbloIK6YHBeNi3hfTHVKm1yeMzRw4EAMHDjQ7D4hBJYsWYLZs2dj5F9jmv/5z38QFhaG5ORkPPPMM85sKhERkW20WtclFsuoKGLBtQL89P5haL4uwqbT8bgq2gAAvKDFT0iECgLlqxWZ2+YoLg+GqpKRkYGsrCz079/fuM3f3x99+vTBrl27Kg2GCgsLUVhYaHycm5vr8LYSERGZcPQsLksMRREvXjS/mKohZ8hBRRGvHr+Gb945Ds13fvgxqzXuoKtxXzByMLjhETzZ6QBi1l10yPVt4fJhsqpkZWUBAMLCwky2h4WFGfeZs2DBAgQHBxt/YmJiHNpOIiIiE4ZZXOVzdgyzuFJSHN8GFxRFTN9yFouHpCEx+A+Et6yLv61MhCarK+4gELHeFzClzXb8tGg/ruYH4n9neyLpwXqSXbs6ZN0zZKAq9yYKISpsK2vWrFmYNm2a8XFubi4DIiIicg6tVt8jZK43Rgh9IDJ1qr42j6OHzAxFEc31UC1ZUu0eKl2JDr+tOgbNp9eg2R+D40VNADQy7m9f4zjUXa9A/WwE2j7UDCqvaNMTyGTdMlkHQ+Hh4QD0PUQRZV6w7OzsCr1FZfn7+8Pf39/h7SMiIqrAlllcEtfmMUviooh3b93F1iWHofnyDjadao4sXYJxnw+K0TfkENT33sawafcgtnsLAC0qP5mloTwnkXUwFBcXh/DwcGzZsgXt27cHABQVFWH79u1YuHChi1tHREQO4cqkYynIcRZXNYsiXk+/gc3vHINmsw9+uJSAfHQ27gtCDgbGHIVaDQyc0Qp1Gna0rV1Ll+qHDlUqlwVELg+Gbt++jdOnTxsfZ2Rk4ODBgwgJCUFsbCymTp2Kt99+G02bNkXTpk3x9ttvIzAwEGPHjnVhq4mIyCFcnXQsBRnN4qqOP9POQ7PkT2jS6mBnTmvo0Mu4L9r7Eoa1SId6bC30ndIafrV62H8hw1De008D16+b7qtbF7h50/5zW8nlwdDvv/+OpKQk42NDrs/48eOxatUqvPzyy7hz5w4mTpyImzdvomvXrvjxxx9Ru3ZtVzWZiMi9uEtPi7OWjnA0F8/ispeusBin5vwPh9afwXcZzfHf4jHQIda4v23ASQzrfBnqp8PQYWw8VF6R0jbgxo2K25wQCAFcjoOIyLO5S0+Lq5aOcFSgaAjsANOAyDD5RyaBXWFuIbYtOYTz//4BQy8sRyRKh+6yUR/b/fpD1aUzOr01Ao36NHTM61XFe58LIBhw/Pe3UICcnBwBQOTk5Li6KUREzrNunRAqlRD6r+PSH5VK/7NunatbWCo1tWI7zf2kpkp3zXXrhIiONj1/dLR0r4u589erJ8S8eUKUlEhzDTvc+POm+PzZn8WoqF2iFnLFCKwTWqiEtqrXPTpaiJdecszrVcV7nwM45fubPUNERJ7I3RbpXLMGsCYXNDkZGDOm+terbEhO6p4brRaYP1/fE1d2GMjJvXNnf74AzXtnoEkNwo5braH9K0vGC1pkIgYRuGxftWcpXq8q3ntn9QzJuugiERHZyU0W6TRyZtKxpTpAgL4OkFZb/WtpNMDcuRXzYRxcfFHoBPatPo6/905D2xonEZcYjanr+yD1Vnto4YME/3TM7pmGo698jkh7AyFAmtdLBonkDIaIiDyRHKd3V8WQdFxZQV2VCoiJkSbp2FmBojODLgBFt4vw44J9mNR6O2L9LqPTuBZ4c2dfHLrbHF7Qok/wQbynTsPpredw+G5TvPVzX8S3laAmX3VfL0vvvRO4fDYZERE5gLtN766q3ozUS0c4K1B0QvHFW+dy8N3io9BogO8yWyEXpTV+auI2BkQegXpwCQa/1BL1mrareAIp3397Xy8Z1BpiMERE5InccXq3g5eOMHJWoOigoOv87ovY+N5paLbVQtqNNihBaY2fMK9sDGt2AuqHa+C+qa0RUKdb1SeTsgJ0dV6vyt77qCh92xyMwRARkSdyZk+LlCReOsIsQwBQVa8NAFy9Wr3rSBR0CZ3AH1+fgubjy9D8GoYDd1oAiDLub+F3BuoOmVA/UR9dHm8JL5/e1rdRil4ZqQJrc+9927ZASEj1zmsFziYjIvJk5uoMxcRI29MiF7bUwFm7FnjooarPFxNTvdl2hhl9lnrnzFyjuKAYOz48DM3qPGw82gTntKULnHpBix5BR6BOvAn1C43QtF8j+9pXlrl/J9ZwcN0kZ31/MxgiIvJ07lKBujpsLS6ZlgaUWf2gUqmp1VtM1Ybii7kXcvH9u0egWS/w7flWuCXqGA+vgQL0Dz8M9cAiDHmpBRq0qG9/mypj+Hei0QCrVwPXrpXui4kBHnlEPw3eiYE1gyEJMRgiItlSQqDiaPbUDHJmXaMqeucuxnbHxnfTodkSiG3X26AYfsZDGqiuYug9J6B+yA/3v9gagfUDq9cOW1T279LJ/14ZDEmIwRB5FH55eg53WSpDzuwtLumsnqGy7dy5E+LiJWSc1mLNjkhs2BOB3wtamhzWzDcD6nbnoJ4Qgm5PtIK3n7I/2wyGJMRgiDwGvzw9h7MqIHs6e4OaauTz2Krkbgl2Lj+MjatzoTkch4yS0sVPVdChW62jUPe6DvWUWMQPalyta3kaZ31/czYZkbvwlBW9yXIxPpVKX4xPrWavnyX2Tl938Gy7vEt5+OHdI9Cs12Lz2Va4Kdob9wXgDu4PPQz1A4UY+lI8whJa23UNkg6DISJ3wC9Pz+KEYnyKUZ3p6xLXNbp88Ao2vnMSmi01sPVqGxShu3FfPdV1DG1yDOpRfuj3YgJqhnax6dzkWAyGiNwBvzw9i7stlSFn1S0uWY26RkIncGzTGWg+vADNrvr4LT8BQJhx/z2+Z6Fucxbqx+uix9MJ8PaTuMClM/MHPTxXkcEQkTvgl6dncbelMuRMiuEub2+r/4jQFmnxy7+OQPOfm9D8EYczJfcAuMe4v2vNI1D3vAb1pGi0GNIEKq9Gtt6RdZyZP6iAXEUmUBO5A2fPfCHHcmLyrmI4sLhkfnY+fnznIE4m78efl/xxCs2wE4nQwRv+uIv7GhyGuv8dDJ3RHBHtwiyf0Fble2WuXgUeftg5yfcuTvTnbDIJMRgit8cvT89jQzE+spKEQzlXjlzFpndOQPO9P2pmn8E7eBkxKA20rns3wKnBL6L1v6agVngtqe6gInNBnqHejzm2/L/A0utlb9kCCTnt+1soQE5OjgAgcnJyXN0UIvutWyeESqX/0X996n8M29atc3ULyVbr1gkRHW36fsbE8L10keObz4h/PJAqutc6JFTQCkCIEVgntFAJbdn3yFmfO8Nnvvy1rflJTbV87vL/9qKjS++npESI99+X5lrV4Kzvb/YMEbkTJa0zpRQenpgqZ9oiLfZ8ehSalTegOdgQp4rjTPZ3qXEYW3T3oXbhVajMncCRPSOWemUsqapytqWhrxkzKi67Ye+1qol1hoioImes6E3OZUPyLlVfwbUC/PT+YWi+LsKm0/G4KtoY9/miCPfWOwR1vwIMm94UUbevA0lVrFzvyFmclmaQWlI2+b5swB0aWnWZDgB45x37r+WmGAwRuRt+eSoPe4+q5erxa/jmnePQfOeHH7Na4w66GvcFIweDGx6BeoQKD0xPQFB0p9Inrkmz7gKOmMVp7znLlxKwdzV6e67lxhgMERHJmQKmNTtC+paz0Cw9C83OutiVmwAdSr+wY70vQN3qDNSP1kbvSa3hG9jT/ElcWQLBnnOWLyVQ2XCYFCSo0i0nzBkiImVwx94VqaY1u+O920hXosNvq45B8+k1aPbH4HhRE5P97Wsch7rrFaifjUDbh5pB5WU2C8iUK2dxWro2UHFWWdn8wermHFnipFxFTq2XEIMhIoVzx94VqaY1u+O9W+nOjTvYuuQwNF/dxab0eFzRhRr3+aAYfUMOQX3vbQybdg9iu0fZdxFXlkCwdO2vvgLq1zcf5Fpbm8we778PTJnilICaU+slxKn1RApW2fRkuZckSE2t/rRmd733Klw7dV2senKnGBGxWwTitsltBeGWeCT2F5E8+Rdx8+wt6S7qyhII9l47Odm+KflV/ahU+muXlDj+vv/CqfUSYs8QkULJoGic3dasAcaOtXxcZdOa3fneyzmz7Rw0SzOg2V4HP+e0hg6l7Y32vgR1y3Sox9ZCn8mt4VfLzzGNcOVQoz3XtqdnKCYGeOQRYPFi/WMZFAPl1Hoioupy5wVuq5u868b3rivR4ffPj0PzyVVo9kXhaGFTAA2N+9sGnIS6y2Wonw5D+zHxUHlFOr5RrpzFac+1rVnANioKWLUKyM42DbK6dTM/tOrB9cwYDBGR53LnBW6ruxp7de7dBb0ghbmF2LbkEDRf3MGmk01xSdfKuM8bJehT9xDUSXkY9mITNOrVHEBzh7bH7VmzgO3SpcB991V8rgLrmTEYIiLP5c6rw1d3NXZ7792JCdc3M25h86Kj0GzywvcXE3AbnY37aiEPA6OPQD1Uh0EvtULduA6SXlsRRo7UD2vZ08ujsHpmzBkiIs/lCQvc2rsEiz337oQVys/+fAGa985AkxqEHbdaQ1vmb/JIr8sYFp8O9ZhAJD3fGv5B/tW6Fv3FjUsrcGq9hBgMESmYJ6wOb83q4ub223LvDkq4FjqB/cknoFlxBZq9ETh013R4K8E/HepOF6F+KhQd/y8eXj5eVp+bPB+DIQkxGCJSOE9e4NbSsJa1927t7KPUVIvDJ0W3i5D2z8PQJN/GxuNNcUFbmuDsBS0Sgw9D3fcW1FMbo3HfWKtuk5SJs8mIiKTiqQmhlQ1rXbgAPPgg8PXX+v3W3Hs1k81vncvBd4uPQqMBvstshVx0NO6ridsYEHkE6sElGPxSS9Rr2s6GmyRyPAZDRKQMUiSEyin3QqutfPVxg0ce0dcreughy/duR8L1+d0XsfG909Bsq4W0G21Qgh7GfWFe2RjW7ATUD9fAfVNbI6BON+vOT+QCDIaIiKwht2UtLNURAvQB0+jRwLp1lttoxVR+ER2NPy6HQpOUBs2vYThwpwWA0mUuWvidgbpDJtRP1EeXx1vCy6e37fdF5ALMGSIissSeWVaO7kWytkI1oM8RsibxuZKEa8N/Peu1Ait0Txm3e0GLHkFHoE68CfULjdC0XyPr209kBSZQS4jBEBHZzZ5ZVs7oRbJ1uQUrEp8BACkp0E2eAq/Ll4ybziMGU7EE6zESNVCAARGHMOyBYgx5qQUatKhvc9PdkpyGSBXEWd/fsp/DWFJSgtdeew1xcXGoUaMGGjdujDfeeAM6nc7VTSMyT6vVf1GtWaP/rdW6ukVUHbYsawGU9q6Uf87Fi/rtKSnStMswrGUtCwnSF/ZexvJHtuOBp2MRePk0+iIVY5CMvkhFF/yGuk0bYONrv+H6dRXWX+qGCZ8lKicQSknRB8RJSfreuKQk/WOp3ktyOdnnDC1cuBAff/wx/vOf/6BVq1b4/fffMWHCBAQHB+OFF15wdfOITMktr4Sqz5ZZVlUlNQuh70WaOlU/u6u6vQqGCtUPPmjd8eUSpIVO4HBKOjQfXYJmTyj2FbQEUHrMZd+G6NIOmDwhBN2eaABvv/DqtdddVTZEaghu3aFOFVkk+2GyIUOGICwsDJ9++qlx24MPPojAwEB8/vnnVp2Dw2TkFE6o3ksuYEv9HUCyWj1WW7tWP2ussh7IMsN4JcUCO5cfhubzXGw8EoeMktIaPyro0L32Eah73YB6SiyaD2wsTfvcmYMKUZL1OEz2l169emHr1q04deoUAOCPP/7Azz//jEGDBrm4ZURlWOoRAPQ9Ahwycz+G4ShDUFueSqVPUE5MdO7CsIbh2OJi4LXXKm2bALCr3XMY13Q3QgPzcO/09lh6sA8ySmIRgDsYGvYrPhm/E5cPX8cvuW3w8rd9GQgZ2DpESm5L9sNkr7zyCnJychAfHw9vb29otVrMnz8fY8aMqfQ5hYWFKCwsND7Ozc11RlNJyWz5n6aCFj/0CLYsmOqshWHNDcfWq6f/ff26cVO2KhSTdUvx9aaHjdvqq65hSJPjUI/yQ78XE1AztGv12uLJnBnckkvJPhj68ssvsXr1aiQnJ6NVq1Y4ePAgpk6disjISIwfP97scxYsWIB58+Y5uaWkaPyfpmezdvVvQy+SpWGVxET721LJcKy4fgOAwArfSUgr7onLiMBOXSJ08MY9vmehbnMW6sfrosfTCfD2q8b1lcRZwS25nOxzhmJiYjBz5kxMmjTJuO2tt97C6tWrceLECbPPMdczFBMTw5whchwJ13UiGbNmevXLLwPvvGP++SpV9XLHLOSw6KDCBUQjDhnoXPM41D2vQT0pGi2GNIHKq5JhPjlz1XR2w3UvXgRefBG4dq3SQpSV5gxxKr4kuDbZXwoKCuDlZZra5O3tXeXUen9/f/j7+zu6aUSlrKjeW+0eAXI9S0t6rF1beSAEADNmVCuJ/s7GH1GjiuFYLwjEIhPZ/9ag3pNunqzvqpmZ5q5rTvkhUkvn4KxSWZN9AvXQoUMxf/58bN68GWfPnsX69evx3nvvYcSIEa5uGlEpQ14JUDHRtqr/aZLn+Ppr/ayuyqhUwBdf2JxEf+XIVXwyfieGhv2GZ0dmW/WcejULLR/kLPbU3XJWrSZrr2tOdLT5Xj5XtZ2qR8hcbm6ueOGFF0RsbKwICAgQjRs3FrNnzxaFhYVWnyMnJ0cAEDk5OQ5sKZEQYt06IaKjhdD3D+l/YmL028lzrVtn+p5X9ZOaavF0xzefEf94IFV0r3VIqKA1PrUPUiW7hlOY+zxER1f9eSgpqficsj8qlf4zVVIibVstXRcQokEDIVav1r++5q7vqrZ7MGd9f8s+Z0gKrDNETsVcAddwZX5JVbVoyktOBsrNhtUWabHn06PQrLwBzcGGOFUcZ7K/U+AxqLtnQ/10GBKm94fK0nCsHOre2Ft3y9n5d4Z/N1u3Am+9Vb3rMndQcswZInJXlvJKSHquzNGwZvX4sv6aeVRwrQA/vX8Ymq+LsOl0PK6KNsZD/FCIe+sfwrD772DY9KaI6tQSQEv9Th8rp/k7W9lgNDQUeP55+ypxO3NmprX5QdZel7NK3RaDISJyb65eLsGGLzZteCT+uxLQjPkVP2a1xh2U1vipo7qFQbFHoR6hwgPTExAU3dn8Sayd5u9MtgYVVdXdcmatJnP/bqpzXU7Fd1s2DZNlZmYiJibGke1xCA6TEXkoOSyXYMPq8X/HXLyJOcbHsd4XoG51BupHa6P3pNbwDfS1/rpyGY61N6gAzA4ZGt9TRw4F2jq0ae11ndF2hZHlchzx8fF4/fXXkZ+f76j2EBFZTw7LJSQmAiEhVh2ajmboUOM45iWl4eCXJ3G2KAof/NEH973UwbZACCgdjh0zRv/bVUNjlS1DYw1zPSTOmJlp69CmtdflrFK3ZVMwtGXLFvz4449o2rQpVq5c6ag2ERFZRw45Gt7eKH56olWHLv3QF/sKWuDv2/qi7ejm8iiEaM/UdwNbgwqDsuu5mWMYCoyKMt1e2XR2W9n678GW6zq67eQQNuUM9ejRA7/++iv++9//Yvbs2fjggw/w/vvvoy+TRYnIFVyYo3E9/Qa+WXQMms0+2HL5JWTgI9TDdZgNb/4aHgl9Rmb10aqbeG5PkGltD8nIkfoEa6mHArVa4MoV64597TXgvvtsv66j2k4OY/fU+jt37mDBggV499130b9/f7zzzju45557pG6fJJgzROSh7M3RsDPf5sy2c9AszYBmex38nNMaOpQ+50mvT7BC95T+suXbALimV6D8ffboAezapX+cng7MmVPxOZW119xrtnOn1flSRjEx8k/0Zm6PbDjt+9veAkX5+fli586dYurUqcLLy0v4+/uLadOmidzcXGkqIEmIRReJPNi6dfpidipVxQJ3KlXFAn82FALUFmvFr58dEa/2SBWt/E9VqKHXNuCE+HvvVLFv9TGh0+rkVXTTXFu8va0r2li+OGBlr9lXX+l/l3/ty54nOlqIn34SIjm58mKFzno9KmunNf9uyCVkWXTx448/xt69e7F3714cP34c3t7eaNOmDbp164Z27drhf//7H06dOoX169ejU6dOjovgbMSeISIPZ+4vfnM9EFYUAiy8fzC2LTkEzRd3sPFkM1zWhRsP80YJ+tQ9BHVSHoa92ASNekVXbIscZnlVZ4ZXWampwI0bVb9mM2YAixfr/9tc3SM55MnYMnvMlT1XVIGzvr9tCoZiYmLQrVs340+nTp0qLIj69ttvIzk5GUeOHJG8sfZiMESyJocvT09g6XW08IUoAFz3DkUT7Unkoo5xey3kYWD0EaiH6jDopVaoG1fH7PNlw55p45VZvRqYOdNy6YL33tOv7m4pGHUVa8sfvP8+MGUKP38yIssK1JmZmRaPeeKJJ/D666/b3SAiReHq1tKxVPnbwswnFYD62my0x0GkezXHsPh0qMcEIun51vAP6i55cx3G3hle5ly9al3pgvr1gbNn5RvUW5voHRYmnzaTU0legTo0NBTbtm2T+rREnsfVlZMVRly8ZH6mVzmfPrsXcf/sDS8fN60SLEUZAUOPT4MG1l9TzsvQsDI0WWBTnSFrqFQq9OnTR+rTEnmWqorVGVI5X3jBtpovVEHR7SL8uGAfJrXejtGP+Vn1nCYPd4aXj+T/a3Se6n6hl536Xr5WjqOu6WiJifrgrnwhRANLdY/I47nxJ57IjVkzlHHhAjB/vnPa40FuncvBmim78EjsLjSofQcDXu2I5Uf6IEU3AhcQBV1lT/SUL0RLX/yWlC0O6ClBBCtDkwVcqJXIFawdypgzB0hIkO9wmUySv8/vvgjNu6eh2VYb22+2Rgl6GPeFe13B0GYnoX64BkKbLIbX+LH6HXJa8V1Khi9+cyvbl2e477lzgaZNK76HVZ3L3V4zOS5wS/Lh0In7MsE6QyQ7qanW1Xsx1KlxVW2WqthQr0dqOq1O7E8+Lub0SRXtahyv8JK19E8Xs7qnij2fHBbaYq3ldruqFpAjWVNnyNr79qTXrKRE//lzdd0jsoos6wy5K06tJ9mxdfpzaqq8klOtqNcj9V/axQXF2L7sMDSr87DxWBOc15bW+PGCFj2DjkDd+yaGPd8ITfs1qvpkMunRcriqKlDbet9Kec1IVmRZZ8hdMRgiWUpJAR580Lpjk5P1q5PLgaVATsKlDHIv5OK7d45AoxH49lwCchBs3FcDBRgQcQjqQSUYPD0eDVrUr9a1iEh+ZFlniIgkNHIkMG+e+fWhypPTbB1Lyd+G2jM7d9rVm3Vh72VsfPcUND/VROr1Niguk/8TqrqKoU1PQD3aH/e/2Bo1QrrZcQNWUHIvSNl7Dw3Vb8vOVt7rQIrCYIjIlWbPBv79b8u9LHKarWNt8reVxwmdwOGUdGg+ugTNnlDsK2gJoDT4a+73J9TtzkP9t3roOqElvP0c/FoouRCmpYVMlfI6kOIwGCJypbKzdQD3mK1jbS/VlSv6XgYzbS+5W4Kdyw9D83kuNEca42xJMwDNAAAq6NC99hGoe92Aekosmg9sDKBx1deSqidHyYUwrVnPTAmvAykSc4aI5MDahUadzVyQAehzhi5etLwQaJmehLxLefjh3SPQrNdi89lWuCnqGg8LwB30CzsE9QNFGDIjHmEJVlY+BqTryXFiLpTs2JLQ78mvA8kOE6glxGCIJOHoPBK55alUFWQA5nuzyhF/1aaZH7QQb+a+gCKULuxcX3UNQ5och3qUH/q9mICaoTXta6NUs9qsXcxTbjP7pGDtvZflia8DyY6zvr9ZgZrIGikp+r+ck5KAsWP1vxs10m+XimFtpzFj9L9dHQiNGlWxp8AwTALoAw0LyzWohICACo/lLkMJfHCP71lM75iGHf/8A1l362JleiKGL+hqXyBkaUkTAJg61folTSTOhXIr9tyTJ74OpFgMhsh5tFr9X6Br1uh/u8u6W5YCAykDIjmwNshQq4GzZ6FdtLjK03lBIBaZOPPWFzh1tyEW/94XiZPbwtuvmsGeLbParKHkxTztuSdPfB1IsRgMkXM4o2fFEaTufXAHVgYZOx/9Fx5vvhvPvVzbqtM2auwFlZed62WZI3VPTo8elnvjvL31x3kaW9Yzc5f1yIhswGCIHM+de1ak7n1wB1YGD8u/qIv/nOmFU3/NArNI6p4EqXtydu2yHNRqtfrjPE1VC5mWJdcZjkTVxGCIHMvde1aUmEdiZfCg8lLhxQ5pmPtubYgoF6xsLvWK6kp8r8syLGRaVR5Y2RXtiTwI6wyRYzm4WrHDKSyPRFukxe4jwUjwbYCg4mvwQsUgVgAorheB/10eBZXvX/8LaeSClc2lXlFdYe+1WSNH6nPBWIGaFIbBEDmWu/+1beh9qKymjhwrRNuo4FoBtrx3GJq1RfjmdDyuivYYgY+xFqOgg8o0IFKpoALgt2IZ4Fvmfx+GXgVzU/EdWStJyusq4L22imFWI5GCMBgix3L3v7al7n2QieyjV/HN4hPQfO+HLVmtcQddjfvqqG4hsGEY9iTMR7d9y4DLl0qfWFWQUb5XwVk9CVJd19b3Wm51oYjIbiy6SI5lqGxr6a9tuVezlWuFaBuc+iEDmg/OQbMzBLvyEiDKpAw29L4AdcIZqMcFIfG5BPgG+up3eMoXvi33Yc17reT1y4iciBWoJcRgyMUMs8kA839tu0tCppsFBroSHX797Cg0n12H5kAMThQ1MdnfocZxqLtdgfrZCLQZ1Uzaae9yYk/gUtV7LWXVayKqEoMhCTEYkgEP6FlxOjuCrzs37mDrksPQfHUXm9LjcUUXatzng2IkhRyC+r7bGDa9KWK6Rjr6DlxP6sBFyeuXEbkAgyEJMRiSCTfrWXEpG3ozrp28js2Lj0Oz2Qc/XG6NApQubRGEHAyKPQq1Ghg4oxWCY4OddQeu54jARcnrlxG5gLO+v5lATc7DWSrWqaw3w1Ckcu1anKnTEZqlGdBsr4Ofc1pDh17Gw6K9L0HdMh3qsbXQZ3Jr+NXywIrJ1nBEWQd3nx1JRGYxGCKSEwtFKgWArAcnoxkyoUND4662ASeh7nIZ6qfD0H5MPFReMhgCc3VPoCMCF3efHUlEZjEYIpITC70ZKgARuIy+SAPq1oU6KQ/DXmyCRr2aA2jurFZaJofZVo4IXFiLiMgjMRhSElf/pU4W3T54GrWsOE6zJAO1XrjP4e2xixXDfE4JiBwRuHho3SkipXOLtckuXryIRx99FPXq1UNgYCDatWuHffv2ubpZ7sVdV41XgIwdmVgyYjuS6h6A+sU4q55Tq+09Dm6VneS0Fl1Vi49WJ3CpbA0vrttF5LZkP5vs5s2baN++PZKSkvDcc88hNDQUZ86cQaNGjdCkSRPLJwBnk7EuirwIncC+1ceh+Xc2Nv4egUN3S4e3vKDFRUQjDFkwW/VH7lO35TjbylFlHdjTSuRwnE32l4ULFyImJgYrV640bmvUqJHrGuRuLP2lrlLp/1JXq/k/cgcqul2E1KWHoFlTgI3Hm+KiriWAlgAAb5Qgsc5hqPvmYtgLcQi/8WHVRSrlPAwjx9lWjlomhLMjiTyG7IOhjRs3YsCAAXjooYewfft2REVFYeLEiXjqqacqfU5hYSEKCwuNj3Nzc53RVHly91Xj3ditczn4dtERaDap8F1mAvLQybivJm7jgajDUA/RYtD0lqjXtH2ZZ8Y6ZtFTZ/RkyHW2FQMXIqqC7IOhP//8Ex999BGmTZuGV199Fb/99huef/55+Pv747HHHjP7nAULFmDevHlObqlMyfEvdQ92fvdFaN49Dc222th+szVK0NO4L9zrCoY1Own1IzVw7wutEVCne+Unkro3w1mzuzjbiojckOxzhvz8/NCpUyfs2rXLuO3555/H3r17sXv3brPPMdczFBMTo8ycITnmcHgQoRM4+OVJaP6VBc1v4Th4J95kf0v/01B3uAD1hLro3Pg6vLKvVC+wsad3x9k5Y3Jci475PURuyWk5v0LmYmNjxRNPPGGybfny5SIyMtLqc+Tk5AgAIicnR+rmyV9JiRDR0UKoVELov5pMf1QqIWJi9MeRVYryi8SWhfvE5NZpItY70+Tl9EKJSAw6KBYPSRXpP53VP2HdOv17UPbA6Gj9dlvYcx7D+2/uvXfk+2+urTExtt+zo9piz+tPRE7nrO9v2Q+T9ezZEydPnjTZdurUKTRs2LCSZ5AJ1kWRRO6FXHz3zhFoNALfnktADjoY99VAAQZEHIJ6UAkGT49HgxZtS58oVc0de8/jqpwxRyUt20ouNY+ISN4cGmpJ4LfffhM+Pj5i/vz5Ij09Xfzvf/8TgYGBYvXq1VafQ9E9QwZy+kvdTWT+dkl8+HCa6F9vr/BFoclLF6rKFk802yE2vvarKLheYP4E9vbKlJQIkZoqRHKy/ndhof29O8nJlT+v7E9ystQvn+u5qleMiCTjrO9v2ecMAcA333yDWbNmIT09HXFxcZg2bVqVs8nKU3ydIQPmTVRJ6AQOp6RD89ElaPaEYl9BS5P9zf3+hLrdeaj/Vg9dJ7SEt5+F186efC1zic716wPXrtl2nuq0wVMo+d6JPATrDJUxZMgQDBkyxNXNcH9ymF4ss4Cs5G4Jdi4/DM3nudAcaYyzJc0ANAMAqKBD99pHoO51A+opsWg+sDGAxtaf3NaZfJUN6VgTCFV2PSXP7uJMSiKyklsEQ+Qh5LB4J4C8S3n44d0j0KzXYvPZVrgpSmv8BOAO+oUdgvqBIgyZEY+whDb2X8iWmjtVFceszvWUnDMm15pHRCQ7bjFMVl0cJpMBFy8Jcml/Fja9ewqaLTWw9WobFMHfuK++6hqGNDkO9Sg/9HsxATVDa0pzUa1Wv/6bpV6ZjAx9b5k1QzrmWLNEh6OWpJAzW15/TwwGiTwAh8nIc0ixJEhREbB8OXDmDNCkCTBxIuDnV+klhU7gqOY0NMsvYuPu+vgtPwFAuHH/Pb5noW5zFsP/FoLuT7aCt58Dhols6ZWxd6jG2t4duczuciYl94oRkW0cmp4tE5xN5mKpqdbNaEpNNf/8l14Swtvb9Fhvb/32MorvFIu0JQfEix1SRROfsxVO37XmYfF2/1RxVJMudFqdw2/byJqZfNa+Rg0acEagrTiTkshtsc4QuYYjEpyrk8j68svAO++Yb+c776CooBjfBD4MzboSbM5ogeuinfEQf9zF/aGHoB5wF0NnxCO8TYJ97a8ua3plrE10Pn0a2LXLtvdHZknrTqfEXjEisglzhqiUoxKc7Z3iXFQEBAbqv8zNEAC08EYNFKAE+iGzENUNDIk7BvWDPug/LQG1wmvZ325nc8QyFjJJWicisoezvr8ZDJGeIxOc7U1kXbIEePFFi6d/U/U6bra/F+rH6qDnMwnwCXDjDk8pE51dnLRORFRdDIYkxGDIAkOwUtmyDVLMurGx10NbpEVW/0cRtf0Li6cWEydB9eEy+9olR1IMaznjPSUicjBnfX97OezM7kir1Q/prFmj/13J8IzHsWX9KnuNHKkPeKKiTLdHRxsDoYJrBdC8+iv+1mwnIgJu4J3tXa06tarpPfa3S44MxTHHjNH/tidYccZ7SkTkIdx4PEFilnIryv+13qOH7YmscuWsSr1mElmzQ+Lxzfvp0Ez6FVuyWuMOSgOg/2Es3sV0eEEHVWXn9PbWT7MnU6y+TERkNQZDgOWVrWfM0PcWlQ2UvL1Ne47cOSnVmZV6vb1xqrAhNKsBzc4Q7MoLhShT/6eh9wWoE85APS4Iic8lwHvudPOzyQymTauy3pBisfoyEZHVmDNkKbfCWu6clOrgSr26Eh1+/ewoNJ9dh+ZADE4UNTHZ36HGcai7XYH62Qi0GdUMKq9y/UAvvwy8955p8OntrQ+EFi2yuT2KwOrLROQBmEAtoSpfTGunfVvD2V8wUtaPkXha950bd7B1yWFovrqLTenxuKILNe7zRRH6hhyG+r7bGDa9KWK6Rlo+oY0VqAmOmapPROREDIYkVOWLuWYNMHastBcsXy/HERxRP6aa07qvnbyOzYuPQ7PZBz9cbo0ClK7xFYQcDIo9CrUaGDijFYJjg+1rI9lGiWuSEZHHYDAkIaf1DBkkJ+tnAjmKo2sC2dDbdHrrOWz8IAOa7XXwc05r6FB6bIz3RQxreRrqsbXQZ3Jr+NViT45LKL0CNRG5LQZDErIqZ6iy3Ap7OLJnyMX1Y3QlOuz9zzFoPr0Gzf5oHCs0ndbeNuAk1F0uQ/10GNqPia+Y/0NERGQlrlrvLFWtbG0rQyCS6IAV0A1sqR8jUUB299ZdbFt6GJov7mDTqWa4rCtd48sHxehT9zDU9+Zh6NQmaNSrOYDmklyXiIjIGRgMAaUFAc3lVjzyCLB4sf5xVYGSYYhqyRLHDkE4qX7MjTM3sfmdo9B8440fLibgNjob99VGLgbGHIF6qMDAGa1QN65Dta5FRETkSgyGDKpa2bpbt4qBkrk6Q85ISnVg/ZiMHZnQvP8nNGlB2HmrNbToZdwX5XUZw1qkQz0mEH2ntIZ/UA+bz09ERCRHzBmyllwqUEtYP0boBPatPg7Nv7Oh+T0Sh+82M9nfOuAU1J0uQf1UKDo+2oL5P0RE5FTMGZIbw3pRZTl6+nxl7agsx8mKobqi20VIXXoImjUF2Hi8KS7qWgJoqT81SpBY5zDUfXMx7IU4NO7bDEAzs+chIiLyFAyG3FFlOU6VDNXdOpeDbxcdgWaTCt9lJiAPnYz7auI2Hog6DPUQLQZNb4l6Tds76SYUitPciYhkh8Nk7qyKL9Zzv1zAxvfPQLOtNrbfbI0S+BqfFu51BcOanYT6kRq494XWCKgT4Ko7UBZHFMokIvJgrDMkIY8NhsoQOoGDX56E5l9Z0PwWjoN34k32t/Q/DXWHC1A/UR+dx7eEl4+Xi1qqUI4slElE5KEYDEnI6cGQk4ZCiguKsX3ZYWhW52HjsSY4r4027vOCFj2DjkDd+ybUU+Nwz30NJb8+WcnFhTKJiNwVE6jdlYOHQnIv5OK7d45AoxH49lwCclBa4ycQ+egfcRjqQSUY8lIL1G/ettrXc2tyyc9xQaFMIiKyHoMhKVU2FHLxon67nUMhmb9ewqb306H5qSZSr7dBMUpr/ISqrmJo0xNQj/bH/S+2Ro2QbtW9C88gp/wcJxXKJCIi+zAYkopWq//yNTfqKIR+KGTqVH1hRyvq/xxaewqajy9DsycM+++0ABBp3N/c70+o252H+m/10HVCS3j7OXD5D1vIpSfGQUGp3RxYKJOIiKqPOUNSSUsDkpIsH1fJIq7FBcXY+dERaD7PxcajjXG2JMa4TwUdetQ+AnXiDQybHIvmAxtL126pyKUnRo75ORIWyiQiUhLmDLkbO4ZC8i7l4fvFR6BZr8O351ripiit8ROAO+gffgjqB4owZEY8Qlu1kbrF0pFTT4wc83OqWSiTiIgci8GQVKwc4riW54+1Y3dAs6UGtl1rgyJ0N+6rr7qGofcch3qUH/pNa43A+l0d1VrpSDg8KAm55ufYWCiTiIich8GQVBIT9V9slQyFCABXVOGIekYNHUqDgqa+GVC3PQf1hBB0f7KVfPJ/rCW3nhg55+dUtRgwERG5DIMhqZQZChEqFVRlAiId9EMhE8WH0MEb3WodhrrndagnxyB+UGOovOJc1erqk1tPjIWg1Jifk+iioNPcGndERORSDIYkcjvrNn7cE4kLoW/iwSvLEYVLxn0XEYX/Bk3GQHV9LJ+RjfA2rV3YUonJrSeG+TlERGQjziarhqxD2di0+AQ0PwTgp+w2KIR+jS8vaDEYmzEwdD9aJYWiw7v/h1pRwZJdV1bkOlPK3Oy2mBjm5xARuREuxyEhqV5MoRM48e2f0CzLhOaXevj1disIlK7x1djnHNRtMqB+rA56PpMAn4AqOt7kUpNHCobZZID5nhhXrbvlSa8xEZECMRiSUHVeTG2RFrs/OQrNyhvQ/NEQ6cWm+T2dax6FuvtVqCdGoZX6Hqi8VJZPKpeaPFJiTwwREUmMwZCEbH0xC64VYMt7h6FZW4RvTsfjqmhg3OeHQtxb/xDU/e5g6LSmiOpkYy6MJ69ezp4YIiKSEIOhSixYsACvvvoqXnjhBSxZssSq51jzYmYfvYpvFp+A5ns/bMlqjTsINO6ro7qFwQ2PQj3CCw/MSEDtyNr2NV6O1ZGJiIhkihWozdi7dy9WrFiBNm2kqcZ88rs/ofnneWh+DsHuvAQIlE63buh9AeqEM1CPC0LicwnwDexZ/QvKrSYPERERuU8wdPv2bfzf//0f/v3vf+Ott96y6xy6Eh12rziMDZ9eh+ZgLE4WNQZQus5Xx8BjGNY1G+pnI9BmVDOovKIlav1f5FaTh4iIiNwnGJo0aRIGDx6M+++/32IwVFhYiMLCQuPj3NxcAECz+tdxVZTW+PFFEZLqHYL6/nwMm94M0Z1bAmjpkPYDkF9NHiIiInKPYOiLL77A/v37sXfvXquOX7BgAebNm1dh+1XRAMHIwaCGR6BWq/DA9FYIju0kdXMrJ/fqyERERArkZfkQ18rMzMQLL7yA1atXIyAgwKrnzJo1Czk5OcafzMxMAMD6OQeQnVcDyWd74uGlPRAcW64QolYLpKUBa9bof2u10t2IYaaVuZlkAKsjExERuYjsZ5Nt2LABI0aMgHeZAEGr1UKlUsHLywuFhYUm+8yxKhvdkbV/zJ3b29s02Cpfk4fT1ImISOE4tf4veXl5OHfunMm2CRMmID4+Hq+88goSEhIsnsPii+nI2j9VnVsIYOpU/UrmPXoAu3bpg5/0dGDFCv1wmoG7F2UkIiKyEafW/6V27doVAp6aNWuiXr16VgVCJr7+GmjSxLSXRavV99qYiwmF0ActhoDF1p4Za869bp0+EGrSpOpp9xcv6oMqORdlZG8WERG5IdnnDEnqySeBpCR94cOUFP02W2r/2Mrac48eXfVxhmMBfWAmZS6TVFJS9K9rUhIwdmzF15mIiEimZN8zZE5aWlr1TlC2l6XMFPwq2VP7R+p6QXItyljZUKA79GYREZHiKatnyKBsL0toqHXPsaf2j6PqBcmpKKOloUBAvr1ZREREUGowBJT2sgD65GRVJavNq1T6mV721P4x1BWq7Nz2klNRRkcOMxIRETmBcoMhg+xs/SwtoGLQUt3aP97els9ti+oEZo7CJUaIiMjNMRiKiNDns6xdC0RFme6Ljq5+vktV5/76a+t7juRalJFLjBARkZuTfZ0hKRjrFAAwVikwLH2RkWE6zd5RU8MrO7ch+Rgwn3djUL4oo1xotfpZY5aWGCn7OhMREVmBRRclVCEYkqKYopQqq3791FNA06byr9lTWUAnt9eZiIjcCoMhCVUIhuTYy+LuBQvNBXRyfJ2JiMhtMBiSkPHF/OQTBJWvQE3ScfeAjoiIZIXLcTjCQw8BDnwxFc/bW17FIImIiKzA2WRERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRVNWArXccTYWERGR0zEYkovKCi8uXco6PURERA7EYTI5MFRwLr/6+8WL+u0pKa5pFxERkQIwGHI1rVbfI2Su9qVh29Sp+uOIiIhIcgyGXG3nzoo9QmUJAWRm6o8jIiIiyTEYcrXLl6U9joiIiGzCYMjVIiKkPY6IiIhswmDI1RIT9bPGVCrz+1Uq/erviYnObRcREZFCMBhyNW9v/fR5oGJAZHi8ZAnrDRERETkIgyE5GDkSWLsWiIoy3R4drd/OOkNEREQOw6KLcjFyJKBWswI1ERGRkzEYkhNvb6BvX1e3goiISFE4TEZERESKxmCIiIiIFI3BEBERESkagyEiIiJSNAZDREREpGgMhoiIiEjRGAwRERGRojEYIiIiIkVjMERERESKxmCIiIiIFI3BEBERESkagyEiIiJSNAZDREREpGiyD4YWLFiAzp07o3bt2ggNDcXw4cNx8uRJVzeLiIiIPITsg6Ht27dj0qRJ2LNnD7Zs2YKSkhL0798f+fn5rm4aEREReQCVEEK4uhG2uHr1KkJDQ7F9+3b07t3bqufk5uYiODgYOTk5CAoKcnALiYiISArO+v72cdiZHSQnJwcAEBISUukxhYWFKCwsND7Ozc11eLuIiIjIPcl+mKwsIQSmTZuGXr16ISEhodLjFixYgODgYONPTEyME1tJRERE7sSthskmTZqEzZs34+eff0Z0dHSlx5nrGYqJieEwGRERkRvhMFk5U6ZMwcaNG7Fjx44qAyEA8Pf3h7+/v5NaRkRERO5M9sGQEAJTpkzB+vXrkZaWhri4OFc3iYiIiDyI7IOhSZMmITk5GRqNBrVr10ZWVhYAIDg4GDVq1HBx64iIiMjdyT5nSKVSmd2+cuVKPP7441adg1PriYiI3A9zhv4i81iNiIiI3JxbTa0nIiIikhqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUjcEQERERKRqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUjcEQERERKRqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUjcEQERERKRqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRWMwRERERIrGYIiIiIgUjcEQERERKRqDISIiIlI0BkNERESkaAyGiIiISNEYDBEREZGiMRgiIiIiRXObYGj58uWIi4tDQEAAOnbsiJ07d7q6SUREROQB3CIY+vLLLzF16lTMnj0bBw4cQGJiIgYOHIjz58+7umlERETk5lRCCOHqRljStWtXdOjQAR999JFxW4sWLTB8+HAsWLDA4vNzc3MRHByMnJwcBAUFObKpREREJBFnfX/LvmeoqKgI+/btQ//+/U229+/fH7t27XJRq4iIiMhT+Li6AZZcu3YNWq0WYWFhJtvDwsKQlZVl9jmFhYUoLCw0Ps7JyQGgjzCJiIjIPRi+tx09iCX7YMhApVKZPBZCVNhmsGDBAsybN6/C9piYGIe0jYiIiBzn+vXrCA4Odtj5ZR8M1a9fH97e3hV6gbKzsyv0FhnMmjUL06ZNMz6+desWGjZsiPPnzzv0xZSb3NxcxMTEIDMzU1G5Urxv3rcS8L5530qQk5OD2NhYhISEOPQ6sg+G/Pz80LFjR2zZsgUjRowwbt+yZQvUarXZ5/j7+8Pf37/C9uDgYEX9IzIICgrifSsI71tZeN/KotT79vJybIqz7IMhAJg2bRrGjRuHTp06oXv37lixYgXOnz+PZ5991tVNIyIiIjfnFsHQww8/jOvXr+ONN97A5cuXkZCQgG+//RYNGzZ0ddOIiIjIzblFMAQAEydOxMSJE+16rr+/P+bMmWN26MyT8b5530rA++Z9KwHv27H37RZFF4mIiIgcRfZFF4mIiIgcicEQERERKRqDISIiIlI0BkNERESkaG4ZDC1fvhxxcXEICAhAx44dsXPnziqP3759Ozp27IiAgAA0btwYH3/8cYVj1q1bh5YtW8Lf3x8tW7bE+vXrHdV8u9ly3ykpKejXrx8aNGiAoKAgdO/eHT/88IPJMatWrYJKparwc/fuXUffik1sue+0tDSz93TixAmT4zzt/X788cfN3nerVq2Mx7jD+71jxw4MHToUkZGRUKlU2LBhg8XneMLn29b79pTPt6337Smfb1vv21M+3wsWLEDnzp1Ru3ZthIaGYvjw4Th58qTF5znjM+52wdCXX36JqVOnYvbs2Thw4AASExMxcOBAnD9/3uzxGRkZGDRoEBITE3HgwAG8+uqreP7557Fu3TrjMbt378bDDz+McePG4Y8//sC4ceMwevRo/Prrr866LYtsve8dO3agX79++Pbbb7Fv3z4kJSVh6NChOHDggMlxQUFBuHz5sslPQECAM27JKrbet8HJkydN7qlp06bGfZ74fi9dutTkfjMzMxESEoKHHnrI5Di5v9/5+flo27Ytli1bZtXxnvL5tvW+PeXzbet9G7j759vW+/aUz/f27dsxadIk7NmzB1u2bEFJSQn69++P/Pz8Sp/jtM+4cDNdunQRzz77rMm2+Ph4MXPmTLPHv/zyyyI+Pt5k2zPPPCO6detmfDx69GjxwAMPmBwzYMAA8cgjj0jU6uqz9b7NadmypZg3b57x8cqVK0VwcLBUTXQIW+87NTVVABA3b96s9JxKeL/Xr18vVCqVOHv2rHGbO7zfZQEQ69evr/IYT/l8l2XNfZvjjp/vsqy5b0/5fJdlz/vtCZ9vIYTIzs4WAMT27dsrPcZZn3G36hkqKirCvn370L9/f5Pt/fv3x65du8w+Z/fu3RWOHzBgAH7//XcUFxdXeUxl53Q2e+67PJ1Oh7y8vAqL3d2+fRsNGzZEdHQ0hgwZUuEvS1eqzn23b98eERERuO+++5CammqyTwnv96effor777+/QpV2Ob/f9vCEz7cU3PHzXR3u/PmWgqd8vnNycgCgykVYnfUZd6tg6Nq1a9BqtRVWqw8LC6uwqr1BVlaW2eNLSkpw7dq1Ko+p7JzOZs99l/fuu+8iPz8fo0ePNm6Lj4/HqlWrsHHjRqxZswYBAQHo2bMn0tPTJW2/vey574iICKxYsQLr1q1DSkoKmjdvjvvuuw87duwwHuPp7/fly5fx3Xff4cknnzTZLvf32x6e8PmWgjt+vu3hCZ/v6vKUz7cQAtOmTUOvXr2QkJBQ6XHO+oy7zXIcZalUKpPHQogK2ywdX367red0BXvbuGbNGsydOxcajQahoaHG7d26dUO3bt2Mj3v27IkOHTrgn//8Jz744APpGl5Nttx38+bN0bx5c+Pj7t27IzMzE4sXL0bv3r3tOqer2NvGVatWoU6dOhg+fLjJdnd5v23lKZ9ve7n759sWnvT5tpenfL4nT56MQ4cO4eeff7Z4rDM+427VM1S/fn14e3tXiPays7MrRIUG4eHhZo/38fFBvXr1qjymsnM6mz33bfDll1/iiSeewFdffYX777+/ymO9vLzQuXNn2fwlUZ37Lqtbt24m9+TJ77cQAp999hnGjRsHPz+/Ko+V2/ttD0/4fFeHO3++peJun+/q8JTP95QpU7Bx40akpqYiOjq6ymOd9Rl3q2DIz88PHTt2xJYtW0y2b9myBT169DD7nO7du1c4/scff0SnTp3g6+tb5TGVndPZ7LlvQP8X4+OPP47k5GQMHjzY4nWEEDh48CAiIiKq3WYp2Hvf5R04cMDknjz1/Qb0szVOnz6NJ554wuJ15PZ+28MTPt/2cvfPt1Tc7fNdHe7++RZCYPLkyUhJScG2bdsQFxdn8TlO+4xbnWotE1988YXw9fUVn376qTh27JiYOnWqqFmzpjGrfubMmWLcuHHG4//8808RGBgoXnzxRXHs2DHx6aefCl9fX7F27VrjMb/88ovw9vYW//jHP8Tx48fFP/7xD+Hj4yP27Nnj9PurjK33nZycLHx8fMSHH34oLl++bPy5deuW8Zi5c+eK77//Xpw5c0YcOHBATJgwQfj4+Ihff/3V6fdXGVvv+/333xfr168Xp06dEkeOHBEzZ84UAMS6deuMx3ji+23w6KOPiq5du5o9pzu833l5eeLAgQPiwIEDAoB47733xIEDB8S5c+eEEJ77+bb1vj3l823rfXvK59vW+zZw98/3c889J4KDg0VaWprJv9uCggLjMa76jLtdMCSEEB9++KFo2LCh8PPzEx06dDCZljd+/HjRp08fk+PT0tJE+/bthZ+fn2jUqJH46KOPKpzz66+/Fs2bNxe+vr4iPj7e5MMlF7bcd58+fQSACj/jx483HjN16lQRGxsr/Pz8RIMGDUT//v3Frl27nHhH1rHlvhcuXCiaNGkiAgICRN26dUWvXr3E5s2bK5zT095vIYS4deuWqFGjhlixYoXZ87nD+22YOl3Zv1tP/Xzbet+e8vm29b495fNtz79zT/h8m7tnAGLlypXGY1z1GVf91UAiIiIiRXKrnCEiIiIiqTEYIiIiIkVjMERERESKxmCIiIiIFI3BEBERESkagyEiIiJSNAZDREREpGgMhoiIiEjRGAwRERGRojEYIiIiIkVjMEREbmnNmjUICAjAxYsXjduefPJJtGnTBjk5OS5sGRG5G65NRkRuSQiBdu3aITExEcuWLcO8efPwySefYM+ePYiKinJ184jIjfi4ugFERPZQqVSYP38+Ro0ahcjISCxduhQ7d+5kIERENmPPEBG5tQ4dOuDo0aP48ccf0adPH1c3h4jcEHOGiMht/fDDDzhx4gS0Wi3CwsJc3RwiclPsGSIit7R//3707dsXH374Ib744gsEBgbi66+/dnWziMgNMWeIiNzO2bNnMXjwYMycORPjxo1Dy5Yt0blzZ+zbtw8dO3Z0dfOIyM2wZ4iI3MqNGzfQs2dP9O7dG//617+M29VqNQoLC/H999+7sHVE5I4YDBEREZGiMYGaiIiIFI3BEBERESkagyEiIiJSNAZDREREpGgMhoiIiEjRGAwRERGRojEYIiIiIkVjMERERESKxmCIiIiIFI3BEBERESkagyEiIiJSNAZDREREpGj/D1XGC/oCuJA+AAAAAElFTkSuQmCC", - "text/plain": [ - "
" - ] - }, - "metadata": {}, - "output_type": "display_data" - } - ], + "execution_count": 16, + "id": "4674f449", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "# Using Autograd to calculate gradients for OLS\n", "from random import random, seed\n", @@ -1875,95 +1948,23 @@ }, { "cell_type": "markdown", - "id": "f952160a", - "metadata": {}, + "id": "7c4e2d90", + "metadata": { + "editable": true + }, "source": [ "## Same code but now with momentum gradient descent" ] }, { "cell_type": "code", - "execution_count": 52, - "id": "b0595e43", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Own inversion\n", - "[[4.]\n", - " [3.]]\n", - "Eigenvalues of Hessian Matrix:[0.25823312 3.94225609]\n", - "0 [-12.96884773] [-13.21205258]\n", - "1 [-0.22528633] [0.21334212]\n", - "2 [-0.21052919] [0.19936738]\n", - "3 [-0.19673871] [0.18630804]\n", - "4 [-0.18385156] [0.17410414]\n", - "5 [-0.17180857] [0.16269964]\n", - "6 [-0.16055444] [0.15204218]\n", - "7 [-0.1500375] [0.14208282]\n", - "8 [-0.14020946] [0.13277585]\n", - "9 [-0.13102519] [0.12407851]\n", - "10 [-0.12244253] [0.11595089]\n", - "11 [-0.11442207] [0.10835565]\n", - "12 [-0.10692698] [0.10125793]\n", - "13 [-0.09992285] [0.09462515]\n", - "14 [-0.09337751] [0.08842683]\n", - "15 [-0.08726092] [0.08263453]\n", - "16 [-0.08154499] [0.07722165]\n", - "17 [-0.07620348] [0.07216333]\n", - "18 [-0.07121185] [0.06743635]\n", - "19 [-0.0665472] [0.063019]\n", - "20 [-0.0621881] [0.05889101]\n", - "21 [-0.05811453] [0.05503342]\n", - "22 [-0.05430781] [0.05142852]\n", - "23 [-0.05075043] [0.04805975]\n", - "24 [-0.04742608] [0.04491165]\n", - "25 [-0.04431949] [0.04196976]\n", - "26 [-0.04141639] [0.03922058]\n", - "27 [-0.03870346] [0.03665148]\n", - "28 [-0.03616823] [0.03425066]\n", - "29 [-0.03379907] [0.03200711]\n", - "theta from own gd\n", - "[[3.87768766]\n", - " [3.1158276 ]]\n", - "0 [-0.0315851] [0.02991052]\n", - "1 [-0.02951615] [0.02795127]\n", - "2 [-0.02696204] [0.02553257]\n", - "3 [-0.02442969] [0.02313448]\n", - "4 [-0.02206975] [0.02089966]\n", - "5 [-0.01991611] [0.0188602]\n", - "6 [-0.01796544] [0.01701295]\n", - "7 [-0.01620343] [0.01534436]\n", - "8 [-0.01461344] [0.01383866]\n", - "9 [-0.0131792] [0.01248047]\n", - "10 [-0.01188564] [0.01125549]\n", - "11 [-0.01071902] [0.01015072]\n", - "12 [-0.0096669] [0.00915438]\n", - "13 [-0.00871804] [0.00825583]\n", - "14 [-0.00786232] [0.00744547]\n", - "15 [-0.00709059] [0.00671466]\n", - "16 [-0.00639461] [0.00605558]\n", - "17 [-0.00576694] [0.00546119]\n", - "18 [-0.00520089] [0.00492515]\n", - "19 [-0.00469039] [0.00444172]\n", - "20 [-0.00423] [0.00400574]\n", - "21 [-0.0038148] [0.00361255]\n", - "22 [-0.00344036] [0.00325796]\n", - "23 [-0.00310267] [0.00293817]\n", - "24 [-0.00279813] [0.00264978]\n", - "25 [-0.00252348] [0.00238969]\n", - "26 [-0.00227578] [0.00215513]\n", - "27 [-0.0020524] [0.00194359]\n", - "28 [-0.00185095] [0.00175281]\n", - "29 [-0.00166927] [0.00158077]\n", - "theta from own gd wth momentum\n", - "[[3.99417031]\n", - " [3.00552061]]\n" - ] - } - ], + "execution_count": 17, + "id": "be5e6b23", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "# Using Autograd to calculate gradients for OLS\n", "from random import random, seed\n", @@ -2022,8 +2023,10 @@ }, { "cell_type": "markdown", - "id": "43200e36", - "metadata": {}, + "id": "0002f816", + "metadata": { + "editable": true + }, "source": [ "## Including Stochastic Gradient Descent with Autograd\n", "In this code we include the stochastic gradient descent approach discussed above. Note here that we specify which argument we are taking the derivative with respect to when using **autograd**." @@ -2031,43 +2034,13 @@ }, { "cell_type": "code", - "execution_count": 53, - "id": "b369d846", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Own inversion\n", - "[[4.23287562]\n", - " [2.86347636]]\n", - "Eigenvalues of Hessian Matrix:[0.31306035 4.34432759]\n", - "theta from own gd\n", - "[[4.23287562]\n", - " [2.86347636]]\n" - ] - }, - { - "data": { - "image/png": "iVBORw0KGgoAAAANSUhEUgAAAkMAAAHFCAYAAADxOP3DAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjguMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy81sbWrAAAACXBIWXMAAA9hAAAPYQGoP6dpAABVxUlEQVR4nO3deVxU5f4H8M8BBFwABQXZVNwBc98Nl3JhMtO8ZlmZdqtbuWW26a170+4tr95u5ZLX/N3SeyvMSrRuNZgpqOUSbnXdl1ARQVwBQbaZ5/fHyMjADLMwyzlzPu/XixevOeeZM885w3C+8zzf53kkIYQAERERkUr5eLoCRERERJ7EYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIhIhtasWQNJkow/fn5+iIyMxEMPPYSTJ096rF7z58+HJEkee30lOHPmDCRJwttvv+3pqhCRjfw8XQEismz16tXo3LkzSktL8dNPP+HNN99Eeno6jh07hmbNmnm6ekREXoHBEJGMdenSBb179wYADB06FDqdDq+//jo2btyIxx9/3MO1I0+qqKgwthoSUf2wm4xIQaoCo4sXLxq3lZaW4oUXXkD37t0REhKC0NBQDBgwAF999VWt50uShBkzZuDjjz9GfHw8GjVqhG7duuGbb76pVfbbb79F9+7dERAQgLi4OIvdPqWlpZg3bx7i4uLg7++P6OhoTJ8+HdevXzcp16ZNG9x777345ptv0KNHDzRs2BDx8fHG116zZg3i4+PRuHFj9O3bF3v37rV6Paq6E9PT0/Hss8+iefPmCAsLw/jx43HhwoVa5z5//vxax2jTpg2mTp1a65hbt27FU089hbCwMAQHB+Oxxx5DcXEx8vLyMHHiRDRt2hSRkZF48cUXUVFRUeu4er0eb775Jlq1aoXAwED07t0bW7ZsqVXu5MmTePjhhxEeHo6AgADEx8fj/fffNymTkZEBSZLw8ccf44UXXkB0dDQCAgJw6tQplJSU4MUXX0RcXBwCAwMRGhqK3r17Y+3atVavHxEZ8CsFkYJkZWUBADp27GjcVlZWhqtXr+LFF19EdHQ0ysvL8cMPP2D8+PFYvXo1HnvsMZNjfPvtt8jMzMQbb7yBJk2aYPHixbj//vtx/PhxtG3bFgCwZcsWjB07FgMGDMBnn30GnU6HxYsXmwRhACCEwLhx47BlyxbMmzcPSUlJ+PXXX/H6669j165d2LVrFwICAozlf/nlF8ybNw+vvvoqQkJCsGDBAowfPx7z5s3Dli1b8NZbb0GSJLzyyiu49957kZWVhYYNG1q9Lk8++SRGjx6NlJQUZGdn46WXXsKjjz6KrVu3Onytn3zySYwfPx6fffYZDhw4gD/+8Y+orKzE8ePHMX78ePzhD3/ADz/8gEWLFiEqKgpz5swxef7y5cvRunVrvPfee9Dr9Vi8eDE0Gg22bduGAQMGAACOHDmCgQMHolWrVvjHP/6Bli1bYtOmTZg1axYuX76M119/3eSY8+bNw4ABA7By5Ur4+PggPDwcc+bMwccff4y//vWv6NGjB4qLi3Ho0CFcuXLF4XMnUh1BRLKzevVqAUDs3r1bVFRUiKKiIpGWliZatmwpBg8eLCoqKiw+t7KyUlRUVIgnnnhC9OjRw2QfABERESEKCwuN2/Ly8oSPj49YuHChcVu/fv1EVFSUuHnzpnFbYWGhCA0NFdX/baSlpQkAYvHixSavs27dOgFArFq1yritdevWomHDhuL8+fPGbQcPHhQARGRkpCguLjZu37hxowAgvv76a5uu07Rp00y2L168WAAQubm5Juf++uuv1zpG69atxZQpU2odc+bMmSblxo0bJwCId955x2R79+7dRc+ePY2Ps7KyBACL12/48OHGbaNGjRIxMTGioKDA5JgzZswQgYGB4urVq0IIIdLT0wUAMXjw4Fr179Klixg3blyt7URkO3aTEclY//790aBBAwQFBSE5ORnNmjXDV199VStP5IsvvsCgQYPQpEkT+Pn5oUGDBvjwww9x9OjRWsccNmwYgoKCjI8jIiIQHh6Os2fPAgCKi4uRmZmJ8ePHIzAw0FguKCgIY8aMMTlWVctL9W4mAHjggQfQuHHjWt1C3bt3R3R0tPFxfHw8AEM+VKNGjWptr6qTNffdd5/J465du9r1fHPuvfdek8dVdRo9enSt7eZex9L12759O3Q6HUpLS7Flyxbcf//9aNSoESorK40/99xzD0pLS7F7926TY/7ud7+r9Tp9+/aFVqvF3LlzkZGRgZs3bzp8zkRqxWCISMb+85//IDMzE1u3bsXTTz+No0ePYtKkSSZlUlNTMXHiRERHR+OTTz7Brl27kJmZid///vcoLS2tdcywsLBa2wICAow30WvXrkGv16Nly5a1ytXcduXKFfj5+aFFixYm2yVJQsuWLWt11YSGhpo89vf3r3O7ufqbU/Ocqrrm6hMY2FNXc/W0dP3Ky8tx48YNXLlyBZWVlVi2bBkaNGhg8nPPPfcAAC5fvmzy/MjIyFrHXLp0KV555RVs3LgRw4YNQ2hoKMaNG+fRKRiIlIY5Q0QyFh8fb0yaHjZsGHQ6Hf71r3/hyy+/xIQJEwAAn3zyCeLi4rBu3TqTOYDKysoces1mzZpBkiTk5eXV2ldzW1hYGCorK3Hp0iWTgEgIgby8PPTp08ehOrhCQECA2WviqtwaS9fP398fTZo0QYMGDeDr64vJkydj+vTpZo8RFxdn8tjcHE+NGzfGggULsGDBAly8eNHYSjRmzBgcO3bMOSdD5OXYMkSkIIsXL0azZs3w5z//GXq9HoDhBunv729yo8zLyzM7mswWVaO5UlNTTVo8ioqK8N///tek7N133w3AEJBVt379ehQXFxv3y0GbNm3w66+/mmzbunUrbty44ZLXs3T9kpKS4Ovri0aNGmHYsGE4cOAAunbtit69e9f6MdeKV5eIiAhMnToVkyZNwvHjx1FSUuLs0yLySmwZIlKQZs2aYd68eXj55ZeRkpKCRx99FPfeey9SU1Mxbdo0TJgwAdnZ2fjLX/6CyMhIh7tK/vKXvyA5ORkjRozACy+8AJ1Oh0WLFqFx48a4evWqsdyIESMwatQovPLKKygsLMSgQYOMo8l69OiByZMnO+vU623y5Mn405/+hD//+c8YMmQIjhw5guXLlyMkJMQlr+fr64sRI0Zgzpw50Ov1WLRoEQoLC7FgwQJjmSVLluDOO+9EUlISnn32WbRp0wZFRUU4deoU/vvf/9o0Gq5fv36499570bVrVzRr1gxHjx7Fxx9/jAEDBpjkYRGRZQyGiBRm5syZWL58Od544w1MmjQJjz/+OPLz87Fy5Up89NFHaNu2LebOnYvz58+b3HjtMWLECGzcuBGvvfYaHnzwQbRs2RLTpk3DzZs3TY4pSRI2btyI+fPnY/Xq1XjzzTfRvHlzTJ48GW+99ZbJsHpPe+mll1BYWIg1a9bg7bffRt++ffH5559j7NixLnm9GTNmoLS0FLNmzUJ+fj4SExPx7bffYtCgQcYyCQkJ2L9/P/7yl7/gtddeQ35+Ppo2bYoOHToY84asueuuu/D111/j3XffRUlJCaKjo/HYY4/h1Vdfdcl5EXkjSQghPF0JIiIiIk9hzhARERGpGoMhIiIiUjUGQ0RERKRqDIaIiIhI1RgMERERkaoxGCIiIiJVU8U8Q3q9HhcuXEBQUJDZ6eyJiIhIfoQQKCoqQlRUFHx8XNd+o4pg6MKFC4iNjfV0NYiIiMgB2dnZiImJcdnxVREMBQUFATBczODgYA/XhoiIiGxRWFiI2NhY433cVVQRDFV1jQUHBzMYIiIiUhhXp7gwgZqIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUzePB0Pbt2zFmzBhERUVBkiRs3LjRYtmnn34akiThvffec1v9iIiIyLt5PBgqLi5Gt27dsHz58jrLbdy4EXv27EFUVJSbakZERERq4OfpCmg0Gmg0mjrL5OTkYMaMGdi0aRNGjx7tppoRERGRGni8ZcgavV6PyZMn46WXXkJiYqKnq0NERERexuMtQ9YsWrQIfn5+mDVrls3PKSsrQ1lZmfFxYWGhK6pGREREXkDWLUP79u3DkiVLsGbNGkiSZPPzFi5ciJCQEONPbGysC2tJRERESibrYGjHjh3Iz89Hq1at4OfnBz8/P5w9exYvvPAC2rRpY/F58+bNQ0FBgfEnOzvbfZUmIiIiRZF1N9nkyZMxfPhwk22jRo3C5MmT8fjjj1t8XkBAAAICAlxdPSIiIvICHg+Gbty4gVOnThkfZ2Vl4eDBgwgNDUWrVq0QFhZmUr5BgwZo2bIlOnXq5O6qEhERkRfyeDC0d+9eDBs2zPh4zpw5AIApU6ZgzZo1HqoVERERqYXHg6GhQ4dCCGFz+TNnzriuMkRERKQ6sk6gJiIiInI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUzePB0Pbt2zFmzBhERUVBkiRs3LjRuK+iogKvvPIK7rjjDjRu3BhRUVF47LHHcOHCBc9VmIiIiLyKx4Oh4uJidOvWDcuXL6+1r6SkBPv378ef/vQn7N+/H6mpqThx4gTuu+8+D9SUiIiIvJEkhBCerkQVSZKwYcMGjBs3zmKZzMxM9O3bF2fPnkWrVq1sOm5hYSFCQkJQUFCA4OBgJ9WWiIiIXMld928/lx3ZRQoKCiBJEpo2bWqxTFlZGcrKyoyPCwsL3VAzIiIiUiKPd5PZo7S0FHPnzsXDDz9cZ4S4cOFChISEGH9iY2PdWEsiIiJSEsUEQxUVFXjooYeg1+uxYsWKOsvOmzcPBQUFxp/s7Gw31ZKIiIiURhHdZBUVFZg4cSKysrKwdetWq/2GAQEBCAgIcFPtiIiISMlkHwxVBUInT55Eeno6wsLCPF0lIiIi8iIeD4Zu3LiBU6dOGR9nZWXh4MGDCA0NRVRUFCZMmID9+/fjm2++gU6nQ15eHgAgNDQU/v7+nqo2EREReQmPD63PyMjAsGHDam2fMmUK5s+fj7i4OLPPS09Px9ChQ216DQ6tJyIiUh7VDK0fOnQo6orHZDQNEhEREXkhxYwmIyIiInIFBkNERESkah7vJiMiIiIZ0umAHTuA3FwgMhJISgJ8fT1dK5dgMERERESmUlOB554Dzp+/vS0mBliyBBg/3nP1chF2kxEREdFtqanAhAmmgRAA5OQYtqemeqZeLsRgiIiIiAx0OkOLkLmR3FXbZs82lPMiDIaIiIjIYMeO2i1C1QkBZGcbynkRBkNERERkkJvr3HIKwWCIiIiIDCIjnVtOIRgMERERkUFSkmHUmCSZ3y9JQGysoZwXYTBEREREBr6+huHzQO2AqOrxe+953XxDDIaIiIjotvHjgS+/BKKjTbfHxBi2e+E8Q5x0kYiIiEyNHw+MHcsZqImIiEjFfH2BoUM9XQu3YDcZERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqcdV6IiIiW+h0wI4dQG4uEBkJJCUZVnYnxWMwREREZE1qKvDcc8D587e3xcQAS5YA48d7rl7kFOwmIyIiqktqKjBhgmkgBAA5OYbtqameqRc5DYMhIiIiS3Q6Q4uQELX3VW2bPdtQTm50OiAjA1i71vBbjnWUCQZDREREluzYUbtFqDohgOxsQzk5SU0F2rQBhg0DHn7Y8LtNG7ZiWcBgiIiIyJLcXOeWcwd269mNwRAREZElkZHOLedqSu7W8yAGQ0RERJYkJRlGjUmS+f2SBMTGGsrJgVK79TyMQ+uJiIgs8fU1DJ+fMMEQ+FRvcakKkN57Tz7zDdWnW89Z8yiVlwMrVgCnTwPt2gHTpgH+/vYfx43YMkRERN6tvqOqxo8HvvwSiI423R4TY9gup3mGHO3Wc1bC9csvA40aAc8/DyxfbvjdqJFhu4xJQpjrWPQuhYWFCAkJQUFBAYKDgz1dHSIichdnTpaohBmodTpDEJOTYz5vSJIM55+VdbvuVQnXNctXtXzZGvC9/DLw979b3v/SS8DixTadRhV33b893jK0fft2jBkzBlFRUZAkCRs3bjTZL4TA/PnzERUVhYYNG2Lo0KE4fPiwZypLRETK4exRVb6+wNChwKRJht9yC4SA2916QO08J3Pdes5KuC4vB955p+4y77xjKCdDHg+GiouL0a1bNyxfvtzs/sWLF+Odd97B8uXLkZmZiZYtW2LEiBEoKipyc02JiEgx1Dyqyp5uPWclXK9YYf1a6nSGcjLk8QRqjUYDjUZjdp8QAu+99x5effVVjL/15v373/9GREQEUlJS8PTTT7uzqkREpBT23OSHDnVbtdxm/Hhg7Fjr3XrOmkfp9GnbjmNrOTfzeDBUl6ysLOTl5WHkyJHGbQEBARgyZAh27txpMRgqKytDWVmZ8XFhYaHL60pERDKixMkSna2qW68uzppHqV07245jazk383g3WV3y8vIAABERESbbIyIijPvMWbhwIUJCQow/sbGxLq0nERHJjNImS/QUZ82jNG2a9RwqX19DORtcy7qOdc/txLM9dtpUvr5kHQxVkWq8SUKIWtuqmzdvHgoKCow/2dnZrq4iERHJidImS/QUexOuLfH3B+bMqbvMnDkW5xvSV+qx9z9H8NfhGRgU/Cuatw3CQ0sHIuW3gdbPwQlkHQy1bNkSAGq1AuXn59dqLaouICAAwcHBJj9ERKQizrrJq4Gz5lFavNgwfL7mNfX1NTus/srJq1g7cycea/cjIv2voM+UBPxpy1DsLOoKPXyRGHASM3u4Z6ZsWecMxcXFoWXLlti8eTN69OgBACgvL8e2bduwaNEiD9eOiIhkreomb26eoffek9dkiZ5ma8K1NYsXA3/9q9kZqPWVeuz9+Ci0/7mEtL1h+PlGAvS43fLTBEUYHnkYmrvKkTy9HVoN6IDCwggsC3HyuZrh8WDoxo0bOHXqlPFxVlYWDh48iNDQULRq1QqzZ8/GW2+9hQ4dOqBDhw5466230KhRIzz88MMerDURESmCs27yamBLwrUt/P0N0xYAuHz8CjbNzoRWC2w62wmXRaJJ0TsCT0DT9QI0k5pi4JMJ8G/Sv/6v7wCPB0N79+7FsGHDjI/n3OpznDJlCtasWYOXX34ZN2/exLRp03Dt2jX069cP33//PYKCgjxVZSIiUhJn3eTJKl25Dpn/OQrtx5eRtq85MosTIDDIuD8YBRgRfQSa4ZUYNb09Yvp0BNDRcxW+hctxEBERkcPyD1/CpmXHoU2T8P25zrgiwkz2dws8Dk33XGgeboYBTySgQaMGNh/bXfdvj7cMERERkXLoynXYs/oItJ9cgXZ/OPaVJABoYdwfggKMjDkCzYhKjJrRAVE9OwHo5LH62oLBEJEnKWHhRyJSFzP/l/IOX0Ha0hNI+94H35+PxzVxh8lTejQ8Ck2Pi9A8Eor+v0+AX+AAD1XeMQyGiDzFmatpExE5g5n/S3mIwDSswAbc/r/UTLqGkTFHoRmlx6iZHdGyazyA+NrHU8gXPuYMEXlC1WraNT9+VfOf2DO3BxGRE1x9+0M0e+lJAED1mZn0tx7N9X8Xgf26IfmRMPSdEg+/QCvtKU74wueu+zeDISJ30+mANm0sLyIpSYZ/GFlZsvwGReRSCmlJcBsXXo+Kkgrs+vAItCnXsOlAOL4qG4VonDc7G7OQJEj2/F9y0hc+d92/ZT0DNZFXsmc1bSI1SU01fFEYNgx4+GHD7zZtDNttpdMBGRnA2rWG3zqda+rqDs64HjWcz8zFv6bswO+id6N54xIMmdUNf9s9FMFl+Yi1EAgBgGTP/yWdztAiZK6tpWrb7Nmyem+YM0TkblxNm6g2Sy0JOTmG7Z9/DjRvXncLiTfl4Vm7Hja2rJTfKMdPqw4jbV0BtL9G4X+lHQHcXpy2uXQZo1ofxzPtM4AfbKiXLf+X7PnCJ5P5nxgMEbkbV9MmMmVLS8JDD5m2JNQMcuoTPMita87a9ZAkQ8vK2LFm65m95wK0y05Bu9UfW3ITUIQexn0S9OjX5DA0fa5AMyUcvR7pDB+/QUBGBfDDAut1s+X/kgK/8DEYInK3qtW0c3LM/7OryhlS+2rapB7WWhKA2l0q1YOcsWMdDx7k2JpkZ8tKWWEZfvzgMLTrCqE9FIMjZe0BRBmLh0uXkBx3HMn3+GDkrM4I63BH7WM68/+SrV/kTp60rZwbMBgicreq1bQnTDD8g6n+j4eraZMaOdJCUD3ICQlxrFvGSV1RTmfj9fjhj1uxLKshtuQlohg9jdt9oEP/oMPQ9L0KzdQI9HioE3z87qz7YM78v2QtsKoyfz7QpYssujCZQE3kCVWraUdHm26PieGwelIfR7uEq4KcjAzbylcPMuSc5Gvj9fjrrrvwdV4/FKMJWvpcxNT2O7Bu9k5cOlWInwq74rUfhqLXo/Hw8bPxVu+s/0tVgZUtg9VlkkjNliEiT+Fq2kQGtrYk1Ff1IEPOSb63roc4nwMJta+HHhLOIxoiKBhv9s+A5vGW6PZAR/j4Rdj3OuZypZz1f2n8eGDBAuD11y2XqbrGy5YBEREe/R/IYIjIk7iaNlHdXTS2GDoUWLPGvnwXGSb5ll4vxbb3D0H7ZTEqc/+IpZgOAQk+1QIiPQAJAmEr38K2p3taPpg11nKlnPF/qUMH28o9/7z5OrgRu8mIiMjzLHXR+Fi5TYWFGW7cS5YYHlflt1SxlO8ik1Gdp7acxbIJ23BPeCZCm+mR/FpvLDk4BO/rnsWD+AyXpXCT8j4xMZAWLEDjYD/H5lHS6YA33gB+97vaLWNVuVL1mMfIhCPXztl1sBFnoCYiIvmo3nUTHg48+CBw5Yrl8mFhwMWLhkDHXGtHbKwhEKrZ0lA1E7y11iQnzwRfcrkE21YchnZ9CbRHW+NURRuT/dE+udB0OAnNff64e0Y8QqKb3L4eJ08C//d/jo98S00FZs0ynLMlzjxva9fYhjoUFhdzOQ5nYTBERKRAGRmGWZetSU+/3a1j65xBOh3w5pvmc1qcuEag0Auc3HwG2g/OQbu9MbZdSUQpGhr3N0A57mx6GJqBBUj+fRS63N8BktDXPoevvqrf8haWRs5ZUv2a1kfV6wL2d3+mp6OwZ0+33L+ZM0REpHZym3SwiiN5Pbbk4ZlrQaouJsZ8a5KNivOLkbHiCLSpJdAebYPfKuMAxBn3x/rmQNPhNDTjAnD3zAQERd2eFNFs3aKjgdJShydhrHPknCXOypWq6v6s63q7ug42YDBERKRmcpx0sIor8nqstZAsWAC8+qpdwaDQCxxPy4J21TlodwRh+9VElKGPcX8DlGNws0PQDCpE8pMxSBjTDpJPdO0D1TXvUZ0VsDLyzZZJLWtyZq5UzRFqFy+aJk27ow5WsJuMiEitnLSyuMs4O6+n6niWAgM7jncj7wa2LjsM7cYypJ2Iw5nKWJP9rX3P456OJ/FIz6PoNaghAuPj6m5xs1Y3W6SkAJMm1d6+dq1hoVdbuChXyoQd76u7cobYMkREpEb1XP/KLeozK7K5rr96zC0k9AJHvzkN7f+dh/anYOy4lohy9DPu90cZhoQegiapCJo/tEKnkgOQnp8NfHoe+PRWobpa3BxpvanJUkuKvS0srp4BX46z8AsVKCgoEABEQUGBp6tCROQ6lZVCpKcLkZJi+F1ZablseroQhttQ3T/p6e6pe13WrxciJsa0XrGxhu22lo+JEWL2bNvOOSVFCCFEYU6h2DB3t/hD522ilW92rWJt/c6I6XdkiP/+aY+4cfGG6etLUu3jSpLhx1y9U1Jsq5u5H0kyXA9L73dlpeH8zdWp5jWydE1dwYb31V33b3aTERF5A3tzf2ztOrHU9eJutiZ519X1Z+Pt7rN+72LV8SH48XoiKuBv3B6AUgwNOwTN4GJonm6FDiPaQPKpMa+Ro11xto6cM3c8wPbRZID56+BArpRTWHlf3XX/ZjBERKR0juT+ODJsXe5sCUR8fCxOVGhY5iIGcciCHoYbcvsGZ6CJP4vkcQG4q+d1BJZcqzsYc/S62pJHExoKNGxo2zxK5tgzD5NMMBhyIgZDROS1HG2J8NCkgy5lYyBSdbbV23T0tx49jE9R2KI9NINLoHm2Ddrf3dq+Vrf6tLhZar2pHtTWtW6YLa1ncp1GwQK33b9d2gknE8wZIiKvVZ/cn6rclpq5JHXltsiZjXk3/8BscQ6muSpXG4SL/ZMWiZIrJabHtDf/p765WPbmR9X1PHfnALkAc4aciC1DROS16pv7o8CuE4tsbBlKxncIaNEUUxP2YGCSLyLuvsNyK4q9rW7OaHGzt/VG7lMk1IO77t8cWk9EpGT1nZiw5oR4jnSdyKDr5VrWdWxe74vhvi3QVHfZZKX3KgJAaUgENp4ejMCwxgAG1H1QR4biO2PYuC2zaFdRwhQJCsBgiIgsk8FNTnHcfc2SkgwtDdZaIpKSLB/DnptvTR6awVpfqceBz45Du+YitD+HYndRIvRIwv1YiS8xAXpIpgGRJEEC0PCjFUBYY9texJHlQADLS1DUc5kPs+oxdxLdxmCIiMyT8zINcuWJa+bJCezqWj5iwgSnd89cOXkV3y89Bu13emzK6oR8EQ8g3rg/IeAU2nYJxaGExbhjy3vAhWrLWDgSiNSn1c0ZLW62cDRgIxPMGSKi2rw4B8FlPH3N3J3748SlLSzRV+qx79Nj0P47H9rMMPx8I8E45B0AmqAIwyMPQ3NXOZKnt0OrAdXW+3JGC50SRtw5Y4oEGbcAc2i9EzEYIrKDG25yXkcu18ydNzUXzVN0+fgVbFpyDFotsOlsJ1wWzU323xF4Asl3XIDmoRAM+kMi/Jv4WziSk9gy3F3J67fJvAWYCdRE5BnMQbCfXK5ZfXJ/7OWk7hlduQ6Z/zmKtE8uQ7u3OTKLEyAwCADgAx3uwTcY3nQ/OvZtim4LxiOmf0cAHetZeTu4M//HEfXpJnVzN6ecMRgiIlPemIPg6hYTb7xm1tQjnyb/8CVsWnYc2jQJ35/rjCuii8n+boHH8WKrdZiQvwKB1y8C1wF8D+DI3z3TYuGu/B9HORKwcRSaCQZDRGSqvkO15cYd3QDeds1sYccoNl25DntWH4H2kytI2x+OvSUJAFoYi4agACOij0AzohLJMzsg6sxhYMJ8ebVYuLPVzRH2Bmxyac2UCeYMEZEpJSSN2spaUvO6dUCLFvX/tu9N18wedeTTCAAZd/0FH5wYhu/Px+OaaGby1B4Nj0LT4yI0j4Si/+8T4Bd467u5XPKvvJ1CFuplzhAReYYnh2o7k7VuAMDwT776op2Othh5yzWzl4XumTwRgWl4Hxu23L6OTaXrGBlzBJqReoya0QGR3U2HxRuxxcI91NiaWQcGQ0RUm9yTRm1h7aYK1F69vD7dMN5wzex0YX8eNn3TAmliLYpxHUEoQi4isQNJ0MMXvRodgaZnPjSPhqHvlHj4BQ60flBb86pycgwj2uSYw6MEzpis04uwm4yILJPx/CNW2doNUFN9u2GUfM2sqCipwK4Pj0Cbcg3ag5H4pbSTyf5Q6SpGtToKTbLAyBmdENGlhYUj1cHWIfvNmwOXL99+LKPh4Ioh92kDwHmGjCorKzF//nx8+umnyMvLQ2RkJKZOnYrXXnsNPj4+Nh2DwRCRCtl6U7XEzvlxvFXO3lxol51C2hY/bM5JQCFCjPsk6NG78VFoel2CZnJz9HksHr7+9Qz8rOVfWSKjG7iiyHyhXuYM3bJo0SKsXLkS//73v5GYmIi9e/fi8ccfR0hICJ577jlPV4+I5MpaN4A13jQM3g7lN8qx819HoF17Hdpfo/C/0o4AbueNNJcuY1Tr40hOBkbN6oQW8YnOrYC1/CtL76UKh4M7hdynDXAT2QdDu3btwtixYzF69GgAQJs2bbB27Vrs3bvXwzUjIlmr66ZqC5UkjgJA9p4L0C47Be1Wf2zJTUARuhv3SdCjb+Mj0PS5DM1jLdDrkc7w9R/k2gpZyr9q3hy4dMny85hc7Ri5TxvgBrIPhu68806sXLkSJ06cQMeOHfHLL7/gxx9/xHvvvefpqhGR3Fm6qfr61k6erqKCxNHyG+X48YPD0H5WAO3/onG0rC2ScAKRyEJPlOIYOmNk21PQ3OODkbM6I6xDF+sHdTZzLRY5OcCjj1p/rkpb9chxsg+GXnnlFRQUFKBz587w9fWFTqfDm2++iUl1zHtQVlaGsrIy4+PCwkJ3VJWI5MjcTfXyZWDiRMN+lQyDP/vTeWjf/w3a9ABsyUtEMXoAAO5HKrS4C7G4HSyKmBhIf5dBMnLNFouMDNuep6JWPXIO2QdD69atwyeffIKUlBQkJibi4MGDmD17NqKiojBlyhSzz1m4cCEWLFjg5poSkWyZ6waw1A2zYoXngwAnKCssw/YVh5D2ZRG0/4vF0fJ2AGKM+yN88vFqi//DjIuv1XquJNe1qTgcnFxE9qPJYmNjMXfuXEyfPt247a9//Ss++eQTHDt2zOxzzLUMxcbGcjQZEZn64gtg2jSvGaKdtT0b2hW/QZveEFvzE1GCxsZ9vqjEgODDSO57DZqpEeg+oT182rdV3kzPChgO7lFeNrUDR5PdUlJSUmsIva+vL/R6vcXnBAQEICAgwNVVIyIlS00FHnxQXutf2an0eim2vX8I2i+LoT3cCicq4gDEGvdH+uQhud1JaO71w/CZ8WgW1+32kzMylDnTswont7SZO9bh81KyD4bGjBmDN998E61atUJiYiIOHDiAd955B7///e89XTUiUioFr9h9eutZaP95BtptjZB+KRE30du4zxeVGBRyCJr+16H5fSS6TugIyael+QPZmmQsx2RkDgevzdI6fAoK7j1J9t1kRUVF+NOf/oQNGzYgPz8fUVFRmDRpEv785z/D39/fpmNw0kUiMmHrhIwymHjx5tWbyFh+CNr1JdAebY1TFW1M9kf75CK5/Slo7vPD8JkJCGkVYv5ANSnoGpAVXry4LbvJbgkKCsJ7773HofRE5DwybhUReoGTm88gbdU5aLc3QsblLihFH+N+P1TgzqaHoBlQAM0TUehyfwdIPg6MnmIysvfg4rb1JvtgiIgUQu6Jm9Xrd/Gibc9x0xDtksslSF9+GNrUEmiPtsFvlXEA4oz7Y31zoOlwGsn3+ePumQkIjulR/xe1NtMz4JVTDHglGQf3SsFgiIjqT+6Jm+bq58GJF4Ve4HhaFrSrzkG7IwjbryairFrrTwOUI6nZIWgGFkLzVAwSxrSD5BPt/IowGdk72Bq0c/4li+zKGcrOzkZsbKz1gjLDnCGiapzdgmMpcVMuQ50t1c8SF9X7Rt4NpL9/BNoNpdAej8OZStP/pa19z0PT6TdoxgVg2PQEBEUFOe21rZJ7qx7VzdritswZssquYKhx48aYM2cO5s6di8aNG1t/gkwwGCK6xdktOHJP3LRWP6B2C5GTVuwWeoGj35yG9v/OQ/tTMHZcS0Q5bk/54Y8yDA49BM2dRdA8FYvO97SF5CPV6zVJxbx0/iVZBkM7d+7E888/j+zsbLz55pt4/PHHXVYxZ2IwRATXtODIfUSSrfV7910gIqLerSJFF4qwZdkRpH1VBu2JtjinizHZH+d3DprOWdDc3xDDZiSicbhyvlSSApj7suOk4N5TZDmabODAgdizZw/+85//4NVXX8XSpUvx7rvvYiiz08nV2IxfP66aV0fuiZu2vm5EBFDHeoeWCL3A4a9OQfuvHGh3huDH64moQD/j/gCUYmjYISQnFUPzh1h0HBUHyaeV3a9DZBPOv+QwhxKoH3vsMTzwwANYuHAhRo8ejZEjR+Lvf/872rdv7+z6Eck/OVcJXDX0Vu6Jmy6oX+H5Qvyw9Ai0X5cj7VR7nNd1ANDBuL+d31lo4s9A87tGGDo9EY2a97Z8MCJnM7cOH1nl8GgyIQRGjhyJoqIiLF26FFqtFtOnT8f8+fMRFOTGxD/ybpxV1Tlc1YIj97lqnFA/UVGJ395ai8OpJ7D1dGv8s/hRlKO/cX8gbmJYi0PQDC5B8tOt0WFEGwCtnX8uROQyduUMrVy5EpmZmcjMzMTRo0fh6+uLrl27on///ujevTs+/fRTnDhxAhs2bEDv3vL5NsScIYWSe3Kukrgyt0fuiZsO1O/62QL8sPQILq7dgvtzVyAKt4PEbMRgke8f4dslAZoJjTFkWiIahjZ09VkQqZIsE6hjY2PRv39/40/v3r1rLYj61ltvISUlBYcOHXJ6ZR3FYEih5J6cqySuHnrrzsRNR/LHrNRP6AUOrjsO7eo8pO1php2FibgPX+NLTAAgUH2paAHJEEd5OsgjUgFZBkO2uHjxIqKioqCzNJmZBzAYUqi1a4GHH7ZeLiXFoeRX1XF1C447ktzrkz9Wo37XYu7A5vePQ/uNDmm/dUSePsJY1Ac6nEcMWiIPZge7s1WSyC1kOZrMFuHh4di6dauzD0tqJPfkXKVx9WzDrk7crGf+mF5IOHA+Ato1QNrPodhV1BR6DDTub4Ri3B1xCJphZRjXPw+Rs/Ms14VrPRF5FdmvWu8MbBlSKC+eVdWjlDhNgYP5Y1dPX8P3S45C+60em850xEV9uMnTEgJOQdPlPJInBiPpmUQEBN/q9merJJEsKLZliMhpuJCkayhx6K2NUwPoM7Zh3/mW0P47H9rMMPx8I8Gk9acJinB3yyPQ3FWG5Glt0XpQewBmpgSxtbXx4kVD4KSUoJKIzGLLEMmfEmdVVWLri5zUvH45OcCjj1p92tNYiVV42mRbl4CT0HTNgeahEAz6QyL8m/jb9vr2LuPBua+InE6xCdRyxGDICygpuOAkkfVj7vq1aAFcumT1qUORjoPohllhazE0Pg9dJnVF+NP3O/a38vLLwN//bnt5uUwlQORFGAw5EYMhchtPrOCupEDRGgvXT9zqJhWAyTD3KnpIKPRvjpxJLyHhhyWQcnJu73QkELWlZcgc5rERORWDISdiMERu4YlJIpXeClU9kAsPB6ZOtXj99AAkoFZAZJz358UXgbffdk4gauscV5Zw7isip3DX/dvclywicoQ96385Q1UrSs3XrBpqnprqnNdxldRUQ/A4bJhh5Nbw4XVePx8YgqHKxs1MtkuxMcDnnxsSmS0tRAsYFqK1df6z+i4s66mFaYnIIQyGiJzFnSu4W1uFHrDv5u9uqakQEyZA2NsNBcD/g2WGlpeUFMPvrCygeXPbAtFly2y7JvWdu4pzXxEpCoMhImdx5ySR7m6FcpLcgxexZmoGLk98FkII87M7WxMdbeiCmjTJ8NvX1/YA8/nnDa1R1lrNqhZ4leysYVVXqE5naKnKyJBvQEpERgyGiJzF2g1UkgxTAjhjBff6tELpdIabtBtu1hUlFdi+7BfMG5CBHo2OIapHBNb8G2iuy7f/n09d18+eANOWbsSqOa6qXtfW+gkB3Lxp6PJ7+GFDF6AtwRcReRSDISJnqesG6uxJIh1thaqZp+OCm3XO3lx8OHUHJsTsQvPGJRgyqxv+tnsoDt7sDAl63BmQaf9BrV0/e1pybO1GrFq+JDradHtsLPDSS4bXqy401PD7yhXT7UrJ4SJSMY4mI3I2d0wS6chSJS4a9l9RUoGfVh2Gdu11bPolAk3LLiISuchFJHYgCc2k6xjV6hg0GmDkjI4Iv3TY/pFa5q5fzSkFLl0CHnzQsM/Wf2u2jPqyNHWBHSPhOOSeyDEcWu9Esg2GvGl+GDLlrhXcbV2F3snD/rP3XEDa+6eg/cEfP+QmoAjBuB+pWILnEIvbr1HWLAJ+K5fDd+KE20+2JZCLjgbWrAHy881fP0tTCkyaZOj+szUx21lri9k6FJ9D7ons4rb7t1CBgoICAUAUFBR4uiq3rV8vREyMEIbbgeEnJsawXYkqK4VITxciJcXwu7LS0zVSB3N/R7Gxtf+O0tNNy1j6SU83+zJlRWViy9v7xYu900ViwIlaT5uKj4QeEPqaOyTJ8FOzPuvX395nS3lzz7X0Wl98IcS779brfO2WkmLb66WkOOf1iFTCXfdvBkOeYO2fudICIm8L7JTGlkDUgZv1mR+zxT8nbRNjW+4WTVBoUswHlWJAk1/FG3eli8zVvwp9zfe/5t91bGztetkayNU8V1teq6zMUM7c56yuOjmqnsEmEZnnrvs3u8nczROzFLuSK/JQ2H3ofDZ24+z7wwdI2dcR2v/F4mh5O5N94dIlJMcdh2a0D0Y+F4/Qds3sOrbZLiJ732t7XuvqVdu7EevLkRwuIrLKXfdvP5cdmcyzZ34YuecWWJv4T5IMI3bGjrX9BmDv8hIMnGxTNdrKws1aDyAHMei76gnoYbh+PtBhQNBhaPpdhWZqBLo/2Ak+fnfWPnZ9hvn7+tr3d27Pa02aZAh4zP09OTOZHbg9knDChNtD7Ks4eyQhETkdgyF3c+csxa7m7MDOUitT1dDkmt/klb4ulzvdulmLWy0l1Qeg6289eg5LEOFzCcntTiJ5tC9GzEpAs7iu1o/tzskm7X2t8eMNwbg7AuaqofjuCL6IyKkYDLmbO28crubMwM7eViZ7Ayclq2fr1+mtZ6H95xlot8UiWHyKxXjZZMTXJSkcP3adhj/PS0S3ByIg+bS0r07h4YbRXxcu1N1F5IzJJq20cJl9LXtbn+rDncEXETkNgyFns3bjcuSfuVw5M7Czp5UpKcn53XNy5UDr182rN5Gx/BDSUkugPdIKJyviALS+tbcPfpSSMCs6FYO7XUPi5F6ImKDB7+y5Tubq1KTJ7Wvvyi4iR7qj3N2V6s7gi4icw6Xp2TLhttFkto6qqs+wYjmpGtnjjBE79ox2snfkjlKH/dsx6vDE91liyfgMkdz8ZxGIEpPifigXQ0IOiL8lp4tfvjgu9Dq98+tkHGbmY9/osPrUw5aRaBzpSKRoHFrvRG65mPYOl3dkWLEcOSuwsyfAsSdwUurN0MoQcr0kiZLgCDGjyxbRzu9MrSIxvjniqc7bROrLu0RBtpP+7q0Na6/+M3u26wNPa0Gut01hQaRCHFrvRC4fmufocHlvGQnljOUn7BmavGOHbcOrFywA5s+vfTxXDK12NhuHkA9FOrZhKBqgHEnNDiF5QCE0T0YjcWx7SD4OrQlf7zoBMLz/nhxG7m1TWBCpFIfWK4mjo6q8JbfAGUmj9uSCVOVdWVtyYelS5eYV2Zic/mjUVjw/pSHumpGAoKiesqgTAM9PD+FNU1gQkctx1Xpn8Kbh8o6qCuwmTTL8diTAsLRKeEyMaSuOry/wzjvWj1dz9fDqqt8MZULoBY58fQrvjM3AC08X2vScJz+9C2Pf6oegqCAX1w72j3D05N87P5NEZAe2DDmDXIbLe0O3m62tTC1aOOf1PHwzLLpQhK3Lj0C7sQxpJ9rirK49gPbwQRJm46+IRg58UEe3oTtHHSYlAaGhhpmdbeHJ6SFOnrStnBKmsCAil2Mw5AxyGC7vTRMQ2tJ96Kwgxs03Q6EXOPzVKWj/lYO0XcHYca0LKtDPuD8ApRgSdgiapGL4JP4R0lvTAchkRmNfX8Pf2OuvWy/booXnpofQ6YBVq6yXU8oUFkTkcoroJsvJycGjjz6KsLAwNGrUCN27d8e+ffs8Xa3bqvJdgNs3qiruuHFVTUBYM0eiagLC1FTXvK4n1TeIkSRDkq8bboaF5wux4ZXd+EP8drT2v4A7xnfAy98NxdZrPVEBf7T1O4vpd2zDN69n4spFHTZd7o3ZG4Yg+q/PQrKl29CdXn0VCAuzXu799z3XKrljh+Fv35qnnlJeyykRuYTsW4auXbuGQYMGYdiwYdBqtQgPD8fp06fRtGlTT1fNlKem4nfF+mBKYEtrXPUuHTe2rAi9wP9ST0L74QVodzXFTwWJqER/4/5A3MTQ5oegGVwCzTOt0WFEG9yeFLEGuc1o7OtraHX53e8sl3npJeCBB9xXp5psbTXs0MG19SAixZD90Pq5c+fip59+wo56JLq6ddV6d+ft1GfFcKWrahEDzAc7X35p+F3fYf82KDhXgM1LjiDtm0qknWqPHL1py1WHBlnQJJyDZkJjDJmWiIahDZ322h5hrlu2RQtgxYrb74mnqPkzQeRl3HX/ln0wlJCQgFGjRuH8+fPYtm0boqOjMW3aNDz11FMWn1NWVoaysjLj48LCQsTGxronGHK3tWuBhx+2Xi4lxTDSy9vYMseRCwJUoRf45YsT0H6UC+3uZthZmAhdtYbWhijBsBaHoRlSAs2zbdDuLgstP0om14R9e+askkN9icgiBkO3BAYGAgDmzJmDBx54AD///DNmz56NDz74AI899pjZ58yfPx8LFiyotd0rgyF+C3bbTfla1nVsXnoEad/qkHa6A3L1pguadvL/DZrEbGgeaILBzyYisGmg0+tANrKl1VDOAwvkGmgSuRmDoVv8/f3Ru3dv7Ny507ht1qxZyMzMxK5du8w+R1UtQ/wW7DL6Sj0OrjsO7ZqL0O4Jxe6iBJPWn0Yoxl3hh6EZdhOaaW0RNzjWg7VVEHfd6J0xM7oneNPIUKJ64gzUt0RGRiIhIcFkW3x8PNavX2/xOQEBAQgICHB11eTBkVW8yaKrp6/h+yVHof1Wj01nOuKiPh5AvHF/vP9paO7IhmZiMJKeSURAcF/PVVaJ3Hmjl1vyuS2qWrRqfrGpGhkq9xYtIoWSfTA0aNAgHD9+3GTbiRMn0Lq1F+ZgOMqTI9mUdKMxQ1+px75PjyHtP/nQ/hyGPTcSoMdA4/4mKMLdLY9Ac1cZkqe1RetB7QC081yF7SG398cTN3olLXmj1pGhRDIg+26yzMxMDBw4EAsWLMDEiRPx888/46mnnsKqVavwyCOP2HQMt44m8yR33vwU3JR/+fgVfL/0GLRagU1nOuGSMJ3NOjHgJDR35EDzUAjufDoR/k38PVTTepDb++PJhVPlFhRawvw/olrcdv+u/8L3rvff//5XdOnSRQQEBIjOnTuLVatW2fX8goICAUAUFBS4qIYqs369EJIkhOH76u0fSTL8rF/v6RqaqCyrFLv/9T/x+pB00bfx/4QEnUm1g1Ag7o/cJVZN3ibO7c7xdHXrT07vT2WlEOnpQrz2Wu36mPtJT3fu669fL0RMjOlrxMTI7m9UCCFESopt1yglxdM1JXIbd92/Zd8y5AyqaRlyB09+w7fDpaOXsWnpcWi1wKZznXFFmM6afEfgCWi6XoBmUlMMfDJBma0/5sjp/THXOmWNM6eAsNQtJ9cRZWwZIqqFo8mciMGQE8n0H7auXIef1xyB9pMr0O4Lx76SzhDVVpsJRgFGRB+BZnglkme0R3RvL12gUy7vj6VAxBpn1UtOQaGtODKUqBaOJlMbpeQ12LrUgRtWg7946JKh9WeTD77P7oyr4g6T/d0bHoOmex6SJzXDgCcS0KDRAJfXyePk8P7UlQhsibMXM96xo+4WKSGA7GxDObm0snBkKJHHMBiSA7klu9bF1gVSXbAafGVpJfasPgLtp1eh3R+B/TfjAdxOfm4qXceI6KPQjKhE8qyOiOzeGUBnp9ej3lwZ+Hrw/TGyFojU5IobvRyCQkd4amQokcoxGPI0pc0rYssCqfZ8w7cSGOQevIi0pSeg3eyHzTnxuC66mjy9Z8Oj0PS8CM0joej3eAL8AmXe+uPqwNfZ748j7A0wXHGjl0NQ6Cglzo9EpHDMGfIkJeY1AM5b6sBMYCCiY3A0+Xl8cqQntAdb4uBN05adZtI1jIw5Cs0oPUbN7IiWXcPrezbu466EXk8vRWFr3tJrrwF33+2aGz3zb4i8AofWO5Fsh9anp3tmuLEzmBuyHBtr+5BlC8O/dZCEDpK4H+uNm3s3Oiz+lJQudn7wq6i4WeHa83KVysra16vmsPfYWEM5Z6jv+1MfVedqbni/K87Vkqq/sZr1kOkUEERUG4fWO5FsW4aUvuK8g7kvFUWl0LVqg4DrFyGZ2a+HhKu+LZD2+88x8rkEhCe2MFNKYTwxysuTSfmebp2qXg9XrE+mlAEPRArH0WRqoOS8BsCupQ7OZ+ZCu+wktD/4ozT3Cr7DRYtlfSDQXJePRx8WgDcEQoBnEno9uRSFXBKBXZF/o6QBD0RkEwZDnuSuZFcPfIstv1GOHz84DO1nBUj7XzQOlXUAYAjqHsJa2w4it5E+9aH0wNcRckkEdmZQqLQBD0RkEwZDnuSOeUXc+C323K4caJefhnZrALbkJeAGehj3SdCjX5PD0PS5gol9y4BFNhzQmwIDOYzy8gQlLZRqDRdSJfJazBmSA1flNbh49FJZYRl2rDwM7eeF0P4vFkfLTVdzD5cuITnuODSjfTBiZmeEdQg17FDrSB+55NGQY+QyuzeRijBnSE1c0Z3gom+xZ348D+37v0GbHoCtFxNRjJ7GfT7QYUDQYST3vQrN1Aj0eKgTfPzurH0Qtc60K5c8GnKMUidyJCKrGAzJhbO7E5y0HEHp9VJs/+dhaL+4Ae3hWBwvbwsgxri/pc9FJLc9Ac29vhgxKwHN4rpaPJYJtQYGcsmjIfupMe+LSCUYDHmrenyLPb31LLT/PIO07Q2Rnp+IEvQy7vNFJQYGH4am/zUkT22Jbg90hI9fhGN1VGtg4E15NGqi1rwvIhVgMOSt7PgWe/PqTWxbcRjaL4uhPdIKJyviALQ2FonyyUVyu1PQjPHD8FkJaNq6m/PqycCAlEKt3btEKsBgSAkcGRpv5VusgIQbDVvgoQmB2HoFKEVv4z4/VGBQyGFoBlyH5oko3DG+AyQfNv0TqbZ7l8jLcTSZ3NVnaLyF0Uv6W/M+T8CX2ADDMaJ9cqHpcBKa+/xx94x4hLQKceppEHkVzkBN5Bbuun8zGJKzegyNF3qBE5uycGL+p+i/dzla6PON+84hBh/h9/BrFIj2dzRElxeTkTi+EyQfc4tjEBEReQaDISdSZDDkwIr2xfnF2LrsMNI23oT2WByyKlsBMAx5T8IO3CEdwoiw/RhR9g0aFl26fSx3LyWglG/VSqknEZGX4jxDamfj0Piziz/D+t3R0P4YhO1Xu6AcfY1F/FGGpGaHoRlUCM1TMYgvvwJp4hrPLiWglHWdlFJPIiKqN7YMyZWNK9pPQgo+w+0V7dv4ZUPTKQua+wMxbHoCmrRsYtjhQEuT07l4RmynUUo9iYi8HLvJnEiRwZCNU/+PwCZIoWHQJBVB84dW6JQcZz73x9NLCcghGLOFUupJRKQC7CZTscLzhdjybQMM8WuBppWX4QNzQ+OB0uAIbDzWH40jzfyB1Mx3ycmx7cVdtZSAk2bEdjml1JOIiJyGwZAMCL3A/1JPQvvhBaTtDsGP17ugEoNwP1biS0yAHpJJQCQkCRKAhqtXAOYCIXP5Ls2b21YZVy0loJR1nZRSTyIichoGQx4aMVRwrgA/LDsC7deVSDvVHjn6jgA6Gve3b3AGMfFhOBj/N3TfsRS4cLtlR6prgjdL+S6XL9ddIVcvJaCUdZ2UUk8iInIadecMuXHEkNAL/PLFCWg/ykXanqbYWZCISjQw7m+IEgxrcRiaISVIfqYN2t99ezkMmwM2a/kuVSwtJeDKxOCqullb18nTuThKqScRkQowZ8jVLLWgOHGY+bWs6/hh2VFov6lE2ukOyNV3AtDJuL9jgyxoEs9BM6ExBj+biIahfcwfyNb1u6zlu1Rp3hy4VGOeIVcvJaCUdZ2UUk8iInIadbYMuWjEkL5Sj4PrjkO75iK0e0KxuygBumrxZiMU467ww9AMu4nkZ+LQdmgr+07EWguRjcPx8cknQHS0ZyYTNNcaFxsrv3WdlFJPIiIvxqH1TlTrYjpxmPnV09fw/ZKjSPtOj7SsjrioDzfZH+9/GsldsqF5IAhJzyQisGmgYydhS5eeq4bPOzuvSikzOyulnkREXordZK5UjxFD+ko99qccg/bf+dD+HIY9NxKgx0Dj/sa4gbtbHoZmWBmSp7VFmzvbAWhXv/ra2qVnZaV6h5KkXZFXZWu3n6cppZ5ERFQv6gyG7BwxdPn4FXy/9BjS0gQ2ZXVCvkgAkGAslhhwEpo7cqB5KASDnkpAQHA/59VVpzMEI+aCGyEMAc7s2cDYsc7Pd3FDXhUREZGnqbObzMqIISFJKG8WgUV3fILv9kbg5+IECPgY9zdBEYZHHobmrnIkT2+HVgOiXVd5R7q+nJHvwpmYiYjIw9hN5krVW1DMEQLvXZ2M17fdbdx0R+AJaLpegGZSUwx8MgH+Tfq7p66OdOmNH29oKapPvgtnYiYiIpVQZzAEQHfvWOQNn4KozWtQcyUvAeAlvA2pWShCxwxC8oz2iOljOimi2zg6CWB98104EzMREamEqoKh/COXsfGjX6Hd5IMfznXAfvwAAdQKhnwACAl4uckK4KOXPNsN5IqkaFtwJmYiIlIJVQVDHQY0B9AWADAEGYiF5W4gSS7dQHUlRQOGx//4h/MDNk8FYURERG7mY72Id+nR8Cj+ODADKx/fY9sT5NANNH68YeRWtIVE7TlzDEnTzuTrC7zzjuVACOBMzERE5BVU1TJ04qdL6DAwHkA8kAFgtQ1PcnY3kKMT+Y0fD+j1wAMP1N7niqHuqamGIMscdyzfQURE5CaKaxlauHAhJEnC7Nmz7X5uRJcWtx9UdQNJNTOGbpEkw3B0Z3YDpaYahqsPG2ZYNmPYMMNjW1p1dDrg+efN76tqvZk921DOGfWcMMHyaLJ33mEgREREXkNRwVBmZiZWrVqFrl271v9gVbk4QO2AyBXdQJYCjKpWHWsBkT1D3eujrkkeAcO1mTPHOUEXERGRDCgmGLpx4wYeeeQR/N///R+aNWvmnINaysWJiXFul5O1WaQB66067hrq7q6gi4iISCYUEwxNnz4do0ePxvDhw62WLSsrQ2FhocmPRePHA2fOGGZwTkkx/M7Kcm43kDMCDHcNdef8QkREpDKKSKD+7LPPsH//fmRmZtpUfuHChViwYIHtL+DqBTltDRy++spyPdw11F1O8wtx1XgiInID2bcMZWdn47nnnsMnn3yCwMBAm54zb948FBQUGH+ys7NdXEsrbA0cPv3UcleZu3KcPJFYbk59ks2JiIjsIPtgaN++fcjPz0evXr3g5+cHPz8/bNu2DUuXLoWfnx90ZoKHgIAABAcHm/x4VFIS0KKF9XKXLtXdVeaOHCd3J5abU99kcyIiIjvIftX6oqIinD171mTb448/js6dO+OVV15Bly5drB7DXave1un55w1BhDUpKcCkSXWXcUf3UWqqIem7ekASG+v6+YV0OkMLkKUcq6ruwKwsdpkREXk5rlp/S1BQUK2Ap3HjxggLC7MpEJKNsWNtC4Zs6VJzdY4TYAh4xo51f86OPcnmnlwmhYiIvIbsgyGvUZWLY63FQ05rfbkj6KqJo9mIiMjNFBkMZWRkeLoK9qu+4CpgOiKMa33dJqfRbEREpAqyT6D2Ku6a5FHJ5DKajYiIVEORLUP14um5azyVi6MU1VvQJIktaERE5HLqCoa+/hqYN880bycmxnDzdWerjCdycZSkqgWt5mi2mBjXj2YjIiLVkf3QemcwDs0DUGtgXlVrA7up5MfTrXhERORR7hpaz2AI4Nw1REREMuSuYIgJ1ABXYiciIlIxBkPVce4aIiIi1WEwVB3nriEiIlIddY0ms0SOsz8TERGRW6ivZchTK7ETERGRLKkrGPr4Y87+TERERCbU1U12333ApEmGUWM5OcClS0CLFkBoqGFOG7YMERERqY66giHAEPBcvQrMnev5maiJiIjI49TVTQYAqamGda+qB0KAoaVowgTDfiIiIlINdQVDOp1hvStzk25XbZs921COiIiIVEFdwdDOnbVbhKrjTNRERESqo65gKC/PtnKciZqIiEg11BUMtWxpWznORE1ERKQa6gqGBg40jBqrOfFiFUkCYmM5EzUREZGKqCsY8vU1DJ8HOBM1ERERAVBbMAQY5hH68kvORE1EREQA1DjpImAIeMaONYway8015AglJbFFiIiISIXUGQwBhsBn6FBP14KIiIg8TL3BEDlGp2OLGhEReRUGQ2S71FTDDN5c042IiLyI+hKoyTFc042IiLwUgyGyjmu6ERGRF2MwRNbt2ME13YiIyGsxGCLrbF2rjWu6ERGRAjEYIutsXauNa7oREZECMRgi65KSuKYbERF5LQZDZB3XdCMiIi/GYIhswzXdiIjIS3HSRbId13QjIiIvxGCI7MM13YiIyMuwm4yIiIhUjcEQERERqRqDISIiIlI12QdDCxcuRJ8+fRAUFITw8HCMGzcOx48f93S1iIiIyEvIPhjatm0bpk+fjt27d2Pz5s2orKzEyJEjUVxc7OmqERERkReQhDC3FLl8Xbp0CeHh4di2bRsGDx5s03MKCwsREhKCgoICBAcHu7iGRERE5Azuun8rbmh9QUEBACA0NNRimbKyMpSVlRkfFxYWurxeREREpEyy7yarTgiBOXPm4M4770SXLl0sllu4cCFCQkKMP7GxsW6sJRERESmJorrJpk+fjm+//RY//vgjYmJiLJYz1zIUGxvLbjIiIiIFYTdZDTNnzsTXX3+N7du31xkIAUBAQAACAgLcVDMiIiJSMtkHQ0IIzJw5Exs2bEBGRgbi4uI8XSUiIiLyIrIPhqZPn46UlBR89dVXCAoKQl5eHgAgJCQEDRs29HDtiIiISOlknzMkSZLZ7atXr8bUqVNtOgaH1hMRESkPc4ZukXmsRkRERAqnqKH1RERERM7GYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUUEwytWLECcXFxCAwMRK9evbBjxw5PV4mIiIi8gCKCoXXr1mH27Nl49dVXceDAASQlJUGj0eDcuXOerhoREREpnCSEEJ6uhDX9+vVDz5498c9//tO4LT4+HuPGjcPChQutPr+wsBAhISEoKChAcHCwK6tKRERETuKu+7fsW4bKy8uxb98+jBw50mT7yJEjsXPnTg/VioiIiLyFn6crYM3ly5eh0+kQERFhsj0iIgJ5eXlmn1NWVoaysjLj44KCAgCGCJOIiIiUoeq+7epOLNkHQ1UkSTJ5LISota3KwoULsWDBglrbY2NjXVI3IiIicp0rV64gJCTEZceXfTDUvHlz+Pr61moFys/Pr9VaVGXevHmYM2eO8fH169fRunVrnDt3zqUXU24KCwsRGxuL7OxsVeVK8bx53mrA8+Z5q0FBQQFatWqF0NBQl76O7IMhf39/9OrVC5s3b8b9999v3L5582aMHTvW7HMCAgIQEBBQa3tISIiq/oiqBAcH87xVhOetLjxvdVHrefv4uDbFWfbBEADMmTMHkydPRu/evTFgwACsWrUK586dwzPPPOPpqhEREZHCKSIYevDBB3HlyhW88cYbyM3NRZcuXfDdd9+hdevWnq4aERERKZwigiEAmDZtGqZNm+bQcwMCAvD666+b7TrzZjxvnrca8Lx53mrA83bteSti0kUiIiIiV5H9pItERERErsRgiIiIiFSNwRARERGpGoMhIiIiUjVFBkMrVqxAXFwcAgMD0atXL+zYsaPO8tu2bUOvXr0QGBiItm3bYuXKlbXKrF+/HgkJCQgICEBCQgI2bNjgquo7zJ7zTk1NxYgRI9CiRQsEBwdjwIAB2LRpk0mZNWvWQJKkWj+lpaWuPhW72HPeGRkZZs/p2LFjJuW87f2eOnWq2fNOTEw0llHC+719+3aMGTMGUVFRkCQJGzdutPocb/h823ve3vL5tve8veXzbe95e8vne+HChejTpw+CgoIQHh6OcePG4fjx41af547PuOKCoXXr1mH27Nl49dVXceDAASQlJUGj0eDcuXNmy2dlZeGee+5BUlISDhw4gD/+8Y+YNWsW1q9fbyyza9cuPPjgg5g8eTJ++eUXTJ48GRMnTsSePXvcdVpW2Xve27dvx4gRI/Ddd99h3759GDZsGMaMGYMDBw6YlAsODkZubq7JT2BgoDtOySb2nneV48ePm5xThw4djPu88f1esmSJyflmZ2cjNDQUDzzwgEk5ub/fxcXF6NatG5YvX25TeW/5fNt73t7y+bb3vKso/fNt73l7y+d727ZtmD59Onbv3o3NmzejsrISI0eORHFxscXnuO0zLhSmb9++4plnnjHZ1rlzZzF37lyz5V9++WXRuXNnk21PP/206N+/v/HxxIkTRXJyskmZUaNGiYceeshJta4/e8/bnISEBLFgwQLj49WrV4uQkBBnVdEl7D3v9PR0AUBcu3bN4jHV8H5v2LBBSJIkzpw5Y9ymhPe7OgBiw4YNdZbxls93dbactzlK/HxXZ8t5e8vnuzpH3m9v+HwLIUR+fr4AILZt22axjLs+44pqGSovL8e+ffswcuRIk+0jR47Ezp07zT5n165dtcqPGjUKe/fuRUVFRZ1lLB3T3Rw575r0ej2KiopqLXZ348YNtG7dGjExMbj33ntrfbP0pPqcd48ePRAZGYm7774b6enpJvvU8H5/+OGHGD58eK1Z2uX8fjvCGz7fzqDEz3d9KPnz7Qze8vkuKCgAgDoXYXXXZ1xRwdDly5eh0+lqrVYfERFRa1X7Knl5eWbLV1ZW4vLly3WWsXRMd3PkvGv6xz/+geLiYkycONG4rXPnzlizZg2+/vprrF27FoGBgRg0aBBOnjzp1Po7ypHzjoyMxKpVq7B+/XqkpqaiU6dOuPvuu7F9+3ZjGW9/v3Nzc6HVavHkk0+abJf7++0Ib/h8O4MSP9+O8IbPd315y+dbCIE5c+bgzjvvRJcuXSyWc9dnXDHLcVQnSZLJYyFErW3Wytfcbu8xPcHROq5duxbz58/HV199hfDwcOP2/v37o3///sbHgwYNQs+ePbFs2TIsXbrUeRWvJ3vOu1OnTujUqZPx8YABA5CdnY23334bgwcPduiYnuJoHdesWYOmTZti3LhxJtuV8n7by1s+345S+ufbHt70+XaUt3y+Z8yYgV9//RU//vij1bLu+IwrqmWoefPm8PX1rRXt5efn14oKq7Rs2dJseT8/P4SFhdVZxtIx3c2R866ybt06PPHEE/j8888xfPjwOsv6+PigT58+svkmUZ/zrq5///4m5+TN77cQAh999BEmT54Mf3//OsvK7f12hDd8vutDyZ9vZ1Ha57s+vOXzPXPmTHz99ddIT09HTExMnWXd9RlXVDDk7++PXr16YfPmzSbbN2/ejIEDB5p9zoABA2qV//7779G7d280aNCgzjKWjulujpw3YPjGOHXqVKSkpGD06NFWX0cIgYMHDyIyMrLedXYGR8+7pgMHDpick7e+34BhtMapU6fwxBNPWH0dub3fjvCGz7ejlP75dhalfb7rQ+mfbyEEZsyYgdTUVGzduhVxcXFWn+O2z7jNqdYy8dlnn4kGDRqIDz/8UBw5ckTMnj1bNG7c2JhVP3fuXDF58mRj+d9++000atRIPP/88+LIkSPiww8/FA0aNBBffvmlscxPP/0kfH19xd/+9jdx9OhR8be//U34+fmJ3bt3u/38LLH3vFNSUoSfn594//33RW5urvHn+vXrxjLz588XaWlp4vTp0+LAgQPi8ccfF35+fmLPnj1uPz9L7D3vd999V2zYsEGcOHFCHDp0SMydO1cAEOvXrzeW8cb3u8qjjz4q+vXrZ/aYSni/i4qKxIEDB8SBAwcEAPHOO++IAwcOiLNnzwohvPfzbe95e8vn297z9pbPt73nXUXpn+9nn31WhISEiIyMDJO/25KSEmMZT33GFRcMCSHE+++/L1q3bi38/f1Fz549TYblTZkyRQwZMsSkfEZGhujRo4fw9/cXbdq0Ef/85z9rHfOLL74QnTp1Eg0aNBCdO3c2+XDJhT3nPWTIEAGg1s+UKVOMZWbPni1atWol/P39RYsWLcTIkSPFzp073XhGtrHnvBctWiTatWsnAgMDRbNmzcSdd94pvv3221rH9Lb3Wwghrl+/Lho2bChWrVpl9nhKeL+rhk5b+rv11s+3veftLZ9ve8/bWz7fjvyde8Pn29w5AxCrV682lvHUZ1y6VUEiIiIiVVJUzhARERGRszEYIiIiIlVjMERERESqxmCIiIiIVI3BEBEREakagyEiIiJSNQZDREREpGoMhoiIiEjVGAwRERGRqjEYIiIiIlVjMEREirR27VoEBgYiJyfHuO3JJ59E165dUVBQ4MGaEZHScG0yIlIkIQS6d++OpKQkLF++HAsWLMC//vUv7N69G9HR0Z6uHhEpiJ+nK0BE5AhJkvDmm29iwoQJiIqKwpIlS7Bjxw4GQkRkN7YMEZGi9ezZE4cPH8b333+PIUOGeLo6RKRAzBkiIsXatGkTjh07Bp1Oh4iICE9Xh4gUii1DRKRI+/fvx9ChQ/H+++/js88+Q6NGjfDFF194ulpEpEDMGSIixTlz5gxGjx6NuXPnYvLkyUhISECfPn2wb98+9OrVy9PVIyKFYcsQESnK1atXMWjQIAwePBgffPCBcfvYsWNRVlaGtLQ0D9aOiJSIwRARERGpGhOoiYiISNUYDBEREZGqMRgiIiIiVWMwRERERKrGYIiIiIhUjcEQERERqRqDISIiIlI1BkNERESkagyGiIiISNUYDBEREZGqMRgiIiIiVWMwRERERKr2/6YB0BXcksAUAAAAAElFTkSuQmCC", - "text/plain": [ - "
" - ] - }, - "metadata": {}, - "output_type": "display_data" - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "theta from own sdg\n", - "[[4.25869167]\n", - " [2.84271642]]\n" - ] - } - ], + "execution_count": 18, + "id": "ccb60a39", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "# Using Autograd to calculate gradients using SGD\n", "# OLS example\n", @@ -2146,35 +2119,23 @@ }, { "cell_type": "markdown", - "id": "1caa8279", - "metadata": {}, + "id": "502d537b", + "metadata": { + "editable": true + }, "source": [ "## Same code but now with momentum gradient descent" ] }, { "cell_type": "code", - "execution_count": 54, - "id": "a9695688", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Own inversion\n", - "[[3.96584049]\n", - " [3.04808331]]\n", - "Eigenvalues of Hessian Matrix:[0.31564325 4.60725403]\n", - "theta from own gd\n", - "[[3.96536405]\n", - " [3.04846625]]\n", - "theta from own sdg with momentum\n", - "[[4.01326831]\n", - " [3.04081676]]\n" - ] - } - ], + "execution_count": 19, + "id": "d62b1fd8", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "# Using Autograd to calculate gradients using SGD\n", "# OLS example\n", @@ -2247,33 +2208,23 @@ }, { "cell_type": "markdown", - "id": "7e8ab93f", - "metadata": {}, + "id": "ab2dfdcf", + "metadata": { + "editable": true + }, "source": [ "## Similar (second order function now) problem but now with AdaGrad" ] }, { "cell_type": "code", - "execution_count": 55, - "id": "be9894c6", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Own inversion\n", - "[[2.]\n", - " [3.]\n", - " [4.]]\n", - "theta from own AdaGrad\n", - "[[1.99993955]\n", - " [3.00039584]\n", - " [3.99962062]]\n" - ] - } - ], + "execution_count": 20, + "id": "24784ec8", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "# Using Autograd to calculate gradients using AdaGrad and Stochastic Gradient descent\n", "# OLS example\n", @@ -2327,41 +2278,33 @@ }, { "cell_type": "markdown", - "id": "f9c181ef", - "metadata": {}, + "id": "b525a878", + "metadata": { + "editable": true + }, "source": [ "Running this code we note an almost perfect agreement with the results from matrix inversion." ] }, { "cell_type": "markdown", - "id": "3f40101d", - "metadata": {}, + "id": "f3de5529", + "metadata": { + "editable": true + }, "source": [ "## RMSprop for adaptive learning rate with Stochastic Gradient Descent" ] }, { "cell_type": "code", - "execution_count": 56, - "id": "da9f2895", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Own inversion\n", - "[[2.]\n", - " [3.]\n", - " [4.]]\n", - "theta from own RMSprop\n", - "[[1.99943878]\n", - " [2.99892878]\n", - " [3.99871777]]\n" - ] - } - ], + "execution_count": 21, + "id": "770a0f44", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "# Using Autograd to calculate gradients using RMSprop and Stochastic Gradient descent\n", "# OLS example\n", @@ -2421,33 +2364,23 @@ }, { "cell_type": "markdown", - "id": "2075df0a", - "metadata": {}, + "id": "2cf458d4", + "metadata": { + "editable": true + }, "source": [ "## And finally [ADAM](https://arxiv.org/pdf/1412.6980.pdf)" ] }, { "cell_type": "code", - "execution_count": 57, - "id": "b9e0fd59", - "metadata": {}, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Own inversion\n", - "[[2.]\n", - " [3.]\n", - " [4.]]\n", - "theta from own ADAM\n", - "[[1.99994314]\n", - " [3.00031228]\n", - " [3.99972037]]\n" - ] - } - ], + "execution_count": 22, + "id": "ebe031fe", + "metadata": { + "collapsed": false, + "editable": true + }, + "outputs": [], "source": [ "# Using Autograd to calculate gradients using RMSprop and Stochastic Gradient descent\n", "# OLS example\n", @@ -2512,17 +2445,22 @@ }, { "cell_type": "markdown", - "id": "3186664b", - "metadata": {}, + "id": "df82f58c", + "metadata": { + "editable": true + }, "source": [ "## And Logistic Regression" ] }, { "cell_type": "code", - "execution_count": 29, - "id": "c4119a68", - "metadata": {}, + "execution_count": 23, + "id": "23a3aae7", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "import autograd.numpy as np\n", @@ -2562,8 +2500,10 @@ }, { "cell_type": "markdown", - "id": "55e182eb", - "metadata": {}, + "id": "04692c2e", + "metadata": { + "editable": true + }, "source": [ "## Introducing [JAX](https://jax.readthedocs.io/en/latest/)\n", "\n", @@ -2576,17 +2516,22 @@ }, { "cell_type": "markdown", - "id": "ae059fd0", - "metadata": {}, + "id": "c9531ff9", + "metadata": { + "editable": true + }, "source": [ "### Getting started with Jax, note the way we import numpy" ] }, { "cell_type": "code", - "execution_count": 30, - "id": "1ad5b0d3", - "metadata": {}, + "execution_count": 24, + "id": "1082677a", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "import jax\n", @@ -2599,17 +2544,22 @@ }, { "cell_type": "markdown", - "id": "bc8fd16c", - "metadata": {}, + "id": "ddab1050", + "metadata": { + "editable": true + }, "source": [ "### A warm-up example" ] }, { "cell_type": "code", - "execution_count": 31, - "id": "443386ca", - "metadata": {}, + "execution_count": 25, + "id": "9a64315e", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "def function(x):\n", @@ -2650,17 +2600,22 @@ }, { "cell_type": "markdown", - "id": "b313e4d6", - "metadata": {}, + "id": "fbaa615b", + "metadata": { + "editable": true + }, "source": [ "### A more advanced example" ] }, { "cell_type": "code", - "execution_count": 32, - "id": "7ff7b64d", - "metadata": {}, + "execution_count": 26, + "id": "6400dac8", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "backend = np\n", @@ -2687,8 +2642,10 @@ }, { "cell_type": "markdown", - "id": "b913d744", - "metadata": {}, + "id": "b7cd2078", + "metadata": { + "editable": true + }, "source": [ "## Introduction to Neural networks\n", "\n", @@ -2703,8 +2660,10 @@ }, { "cell_type": "markdown", - "id": "04b70882", - "metadata": {}, + "id": "4b41d4a3", + "metadata": { + "editable": true + }, "source": [ "## Artificial neurons\n", "\n", @@ -2725,8 +2684,10 @@ }, { "cell_type": "markdown", - "id": "44405ff2", - "metadata": {}, + "id": "05bbca92", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -2741,8 +2702,10 @@ }, { "cell_type": "markdown", - "id": "b39653f7", - "metadata": {}, + "id": "63e4ecd2", + "metadata": { + "editable": true + }, "source": [ "Here, the output $y$ of the neuron is the value of its activation function, which have as input\n", "a weighted sum of signals $x_i, \\dots ,x_n$ received by $n$ other neurons.\n", @@ -2779,8 +2742,10 @@ }, { "cell_type": "markdown", - "id": "4db5fb89", - "metadata": {}, + "id": "16405c0c", + "metadata": { + "editable": true + }, "source": [ "## Neural network types\n", "\n", @@ -2806,8 +2771,10 @@ }, { "cell_type": "markdown", - "id": "400c590f", - "metadata": {}, + "id": "49a77aeb", + "metadata": { + "editable": true + }, "source": [ "## Feed-forward neural networks\n", "\n", @@ -2825,8 +2792,10 @@ }, { "cell_type": "markdown", - "id": "1536d443", - "metadata": {}, + "id": "4408658f", + "metadata": { + "editable": true + }, "source": [ "## Convolutional Neural Network\n", "\n", @@ -2852,8 +2821,10 @@ }, { "cell_type": "markdown", - "id": "0ce4aacc", - "metadata": {}, + "id": "cf8d97ad", + "metadata": { + "editable": true + }, "source": [ "## Recurrent neural networks\n", "\n", @@ -2871,8 +2842,10 @@ }, { "cell_type": "markdown", - "id": "c187a3e9", - "metadata": {}, + "id": "3cc3819b", + "metadata": { + "editable": true + }, "source": [ "## Other types of networks\n", "\n", @@ -2890,8 +2863,10 @@ }, { "cell_type": "markdown", - "id": "7a5d9c4f", - "metadata": {}, + "id": "920fd548", + "metadata": { + "editable": true + }, "source": [ "## Multilayer perceptrons\n", "\n", @@ -2905,8 +2880,10 @@ }, { "cell_type": "markdown", - "id": "2abe1a3e", - "metadata": {}, + "id": "d08f461e", + "metadata": { + "editable": true + }, "source": [ "## Why multilayer perceptrons?\n", "\n", @@ -2924,8 +2901,10 @@ }, { "cell_type": "markdown", - "id": "187cb30d", - "metadata": {}, + "id": "dc59c40b", + "metadata": { + "editable": true + }, "source": [ "## Illustration of a single perceptron model and a multi-perceptron model\n", "\n", @@ -2938,8 +2917,10 @@ }, { "cell_type": "markdown", - "id": "6269f804", - "metadata": {}, + "id": "89c1b368", + "metadata": { + "editable": true + }, "source": [ "## Examples of XOR, OR and AND gates\n", "\n", @@ -2952,9 +2933,12 @@ }, { "cell_type": "code", - "execution_count": 33, - "id": "1ad6269c", - "metadata": {}, + "execution_count": 27, + "id": "f2a213fe", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "\"\"\"\n", @@ -2991,25 +2975,32 @@ }, { "cell_type": "markdown", - "id": "a4ac557d", - "metadata": {}, + "id": "046c878f", + "metadata": { + "editable": true + }, "source": [ "What is happening here?" ] }, { "cell_type": "markdown", - "id": "6c5b5b78", - "metadata": {}, + "id": "8dbddf81", + "metadata": { + "editable": true + }, "source": [ "## Does Logistic Regression do a better Job?" ] }, { "cell_type": "code", - "execution_count": 34, - "id": "78d9fe1b", - "metadata": {}, + "execution_count": 28, + "id": "3032a2c1", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "\"\"\"\n", @@ -3065,25 +3056,32 @@ }, { "cell_type": "markdown", - "id": "522ea0b9", - "metadata": {}, + "id": "ea8b4e4b", + "metadata": { + "editable": true + }, "source": [ "Not exactly impressive, but somewhat better." ] }, { "cell_type": "markdown", - "id": "633277bf", - "metadata": {}, + "id": "ef2b283b", + "metadata": { + "editable": true + }, "source": [ "## Adding Neural Networks" ] }, { "cell_type": "code", - "execution_count": 35, - "id": "55106a0e", - "metadata": {}, + "execution_count": 29, + "id": "7415b824", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "\n", @@ -3099,8 +3097,10 @@ }, { "cell_type": "markdown", - "id": "6933a546", - "metadata": {}, + "id": "bbfc7004", + "metadata": { + "editable": true + }, "source": [ "## Mathematical model\n", "\n", @@ -3109,8 +3109,10 @@ }, { "cell_type": "markdown", - "id": "a392cc52", - "metadata": {}, + "id": "973905d4", + "metadata": { + "editable": true + }, "source": [ "$$\n", "y = f\\left(\\sum_{i=1}^n w_ix_i + b_i\\right) = f(z),\n", @@ -3119,8 +3121,10 @@ }, { "cell_type": "markdown", - "id": "bc1e3563", - "metadata": {}, + "id": "9343ae60", + "metadata": { + "editable": true + }, "source": [ "This function receives $x_i$ as inputs.\n", "Here the activation $z=(\\sum_{i=1}^n w_ix_i+b_i)$. \n", @@ -3132,8 +3136,10 @@ }, { "cell_type": "markdown", - "id": "947e6060", - "metadata": {}, + "id": "0fcd0bdf", + "metadata": { + "editable": true + }, "source": [ "## Mathematical model\n", "\n", @@ -3142,8 +3148,10 @@ }, { "cell_type": "markdown", - "id": "190e7764", - "metadata": {}, + "id": "98e91440", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3157,8 +3165,10 @@ }, { "cell_type": "markdown", - "id": "9d4df41f", - "metadata": {}, + "id": "944ccc68", + "metadata": { + "editable": true + }, "source": [ "Here $b_i$ is the so-called bias which is normally needed in\n", "case of zero activation weights or inputs. How to fix the biases and\n", @@ -3170,8 +3180,10 @@ }, { "cell_type": "markdown", - "id": "e8c69c2e", - "metadata": {}, + "id": "17edaee3", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3186,8 +3198,10 @@ }, { "cell_type": "markdown", - "id": "80a632b1", - "metadata": {}, + "id": "dbe292f0", + "metadata": { + "editable": true + }, "source": [ "where we assume that all nodes in the same layer have identical\n", "activation functions, hence the notation $f$. In general, we could assume in the more general case that different layers have different activation functions.\n", @@ -3196,8 +3210,10 @@ }, { "cell_type": "markdown", - "id": "20de39bb", - "metadata": {}, + "id": "ab06ec71", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3212,8 +3228,10 @@ }, { "cell_type": "markdown", - "id": "01031b37", - "metadata": {}, + "id": "0f069e07", + "metadata": { + "editable": true + }, "source": [ "where $N_l$ is the number of nodes in layer $l$. When the output of\n", "all the nodes in the first hidden layer are computed, the values of\n", @@ -3223,8 +3241,10 @@ }, { "cell_type": "markdown", - "id": "9560b5e1", - "metadata": {}, + "id": "3ee71e06", + "metadata": { + "editable": true + }, "source": [ "## Mathematical model\n", "\n", @@ -3233,8 +3253,10 @@ }, { "cell_type": "markdown", - "id": "baaac514", - "metadata": {}, + "id": "cecfe50e", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3249,8 +3271,10 @@ }, { "cell_type": "markdown", - "id": "f2a439d9", - "metadata": {}, + "id": "dc2a6523", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3265,16 +3289,20 @@ }, { "cell_type": "markdown", - "id": "9ba7b5ad", - "metadata": {}, + "id": "3f73c82a", + "metadata": { + "editable": true + }, "source": [ "where we have substituted $y_k^1$ with the inputs $x_k$. Finally, the ANN output reads" ] }, { "cell_type": "markdown", - "id": "bed342fd", - "metadata": {}, + "id": "8b1a1945", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3289,8 +3317,10 @@ }, { "cell_type": "markdown", - "id": "d1beb8c9", - "metadata": {}, + "id": "ecd88770", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3306,8 +3336,10 @@ }, { "cell_type": "markdown", - "id": "a71895ad", - "metadata": {}, + "id": "6b6ce470", + "metadata": { + "editable": true + }, "source": [ "## Mathematical model\n", "\n", @@ -3317,8 +3349,10 @@ }, { "cell_type": "markdown", - "id": "d9bd25ff", - "metadata": {}, + "id": "6e018962", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3333,8 +3367,10 @@ }, { "cell_type": "markdown", - "id": "e7737a5b", - "metadata": {}, + "id": "bf0b66e0", + "metadata": { + "editable": true + }, "source": [ "which illustrates a basic property of MLPs: The only independent\n", "variables are the input values $x_n$." @@ -3342,8 +3378,10 @@ }, { "cell_type": "markdown", - "id": "384040ce", - "metadata": {}, + "id": "4827bb05", + "metadata": { + "editable": true + }, "source": [ "## Mathematical model\n", "\n", @@ -3359,8 +3397,10 @@ }, { "cell_type": "markdown", - "id": "4a27ed92", - "metadata": {}, + "id": "6fc6eadd", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3375,8 +3415,10 @@ }, { "cell_type": "markdown", - "id": "c71650e0", - "metadata": {}, + "id": "f7c37a39", + "metadata": { + "editable": true + }, "source": [ "where the parameters $c_i$ are weights and biases. By adjusting these\n", "parameters, the activation functions can be shifted up and down or\n", @@ -3386,8 +3428,10 @@ }, { "cell_type": "markdown", - "id": "b6291c8a", - "metadata": {}, + "id": "09472aa3", + "metadata": { + "editable": true + }, "source": [ "### Matrix-vector notation\n", "\n", @@ -3404,8 +3448,10 @@ }, { "cell_type": "markdown", - "id": "da4b43f7", - "metadata": {}, + "id": "1824564d", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3435,8 +3481,10 @@ }, { "cell_type": "markdown", - "id": "7fe1f511", - "metadata": {}, + "id": "eafbe02e", + "metadata": { + "editable": true + }, "source": [ "### Matrix-vector notation and activation\n", "\n", @@ -3445,8 +3493,10 @@ }, { "cell_type": "markdown", - "id": "d53241ba", - "metadata": {}, + "id": "f52242e3", + "metadata": { + "editable": true + }, "source": [ "\n", "
\n", @@ -3462,8 +3512,10 @@ }, { "cell_type": "markdown", - "id": "962e06e9", - "metadata": {}, + "id": "72371715", + "metadata": { + "editable": true + }, "source": [ "This is not just a convenient and compact notation, but also a useful\n", "and intuitive way to think about MLPs: The output is calculated by a\n", @@ -3474,8 +3526,10 @@ }, { "cell_type": "markdown", - "id": "6446fdc6", - "metadata": {}, + "id": "b455d9ae", + "metadata": { + "editable": true + }, "source": [ "### Activation functions\n", "\n", @@ -3495,8 +3549,10 @@ }, { "cell_type": "markdown", - "id": "69aff123", - "metadata": {}, + "id": "7de531f8", + "metadata": { + "editable": true + }, "source": [ "### Activation functions, Logistic and Hyperbolic ones\n", "\n", @@ -3512,8 +3568,10 @@ }, { "cell_type": "markdown", - "id": "dbb74732", - "metadata": {}, + "id": "dedb08ff", + "metadata": { + "editable": true + }, "source": [ "$$\n", "f(x) = \\frac{1}{1 + e^{-x}},\n", @@ -3522,16 +3580,20 @@ }, { "cell_type": "markdown", - "id": "216973d6", - "metadata": {}, + "id": "ed7c69c9", + "metadata": { + "editable": true + }, "source": [ "and the *hyperbolic tangent* function" ] }, { "cell_type": "markdown", - "id": "a8643aed", - "metadata": {}, + "id": "37be8225", + "metadata": { + "editable": true + }, "source": [ "$$\n", "f(x) = \\tanh(x)\n", @@ -3540,8 +3602,10 @@ }, { "cell_type": "markdown", - "id": "b6450655", - "metadata": {}, + "id": "a8176533", + "metadata": { + "editable": true + }, "source": [ "### Relevance\n", "\n", @@ -3554,9 +3618,12 @@ }, { "cell_type": "code", - "execution_count": 36, - "id": "0565ead1", - "metadata": {}, + "execution_count": 30, + "id": "1b3252bc", + "metadata": { + "collapsed": false, + "editable": true + }, "outputs": [], "source": [ "\"\"\"The sigmoid function (or the logistic curve) is a \n", @@ -3633,25 +3700,7 @@ ] } ], - "metadata": { - "kernelspec": { - "display_name": "Python 3 (ipykernel)", - "language": "python", - "name": "python3" - }, - "language_info": { - "codemirror_mode": { - "name": "ipython", - "version": 3 - }, - "file_extension": ".py", - "mimetype": "text/x-python", - "name": "python", - "nbconvert_exporter": "python", - "pygments_lexer": "ipython3", - "version": "3.9.18" - } - }, + "metadata": {}, "nbformat": 4, "nbformat_minor": 5 }