tennis-train.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Collaboration and Competition\n",
    "\n",
    "---\n",
    "\n",
    "In this notebook, you will learn how to use the Unity ML-Agents environment for the third project of the [Deep Reinforcement Learning Nanodegree](https://www.udacity.com/course/deep-reinforcement-learning-nanodegree--nd893) program.\n",
    "\n",
    "### 1. Start the Environment\n",
    "\n",
    "We begin by importing the necessary packages.  If the code cell below returns an error, please revisit the project instructions to double-check that you have installed [Unity ML-Agents](https://github.com/Unity-Technologies/ml-agents/blob/master/docs/Installation.md) and [NumPy](http://www.numpy.org/)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "from unityagents import UnityEnvironment\n",
    "import numpy as np\n",
    "\n",
    "import torch\n",
    "from collections import deque\n",
    "import datetime;\n",
    "\n",
    "import json\n",
    "config = json.load(open('config.json'))\n",
    "train = True"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Next, we will start the environment!  **_Before running the code cell below_**, change the `file_name` parameter to match the location of the Unity environment that you downloaded.\n",
    "\n",
    "- **Mac**: `\"path/to/Tennis.app\"`\n",
    "- **Windows** (x86): `\"path/to/Tennis_Windows_x86/Tennis.exe\"`\n",
    "- **Windows** (x86_64): `\"path/to/Tennis_Windows_x86_64/Tennis.exe\"`\n",
    "- **Linux** (x86): `\"path/to/Tennis_Linux/Tennis.x86\"`\n",
    "- **Linux** (x86_64): `\"path/to/Tennis_Linux/Tennis.x86_64\"`\n",
    "- **Linux** (x86, headless): `\"path/to/Tennis_Linux_NoVis/Tennis.x86\"`\n",
    "- **Linux** (x86_64, headless): `\"path/to/Tennis_Linux_NoVis/Tennis.x86_64\"`\n",
    "\n",
    "For instance, if you are using a Mac, then you downloaded `Tennis.app`.  If this file is in the same folder as the notebook, then the line below should appear as follows:\n",
    "```\n",
    "env = UnityEnvironment(file_name=\"Tennis.app\")\n",
    "```"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "INFO:unityagents:\n",
      "'Academy' started successfully!\n",
      "Unity Academy name: Academy\n",
      "        Number of Brains: 1\n",
      "        Number of External Brains : 1\n",
      "        Lesson number : 0\n",
      "        Reset Parameters :\n",
      "\t\t\n",
      "Unity brain name: TennisBrain\n",
      "        Number of Visual Observations (per agent): 0\n",
      "        Vector Observation space type: continuous\n",
      "        Vector Observation space size (per agent): 8\n",
      "        Number of stacked Vector Observation: 3\n",
      "        Vector Action space type: continuous\n",
      "        Vector Action space size (per agent): 2\n",
      "        Vector Action descriptions: , \n"
     ]
    }
   ],
   "source": [
    "env = UnityEnvironment(file_name=\"Tennis_Windows_x86_64/Tennis.exe\",no_graphics=train, seed = config['seed']['environment'])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Environments contain **_brains_** which are responsible for deciding the actions of their associated agents. Here we check for the first brain available, and set it as the default brain we will be controlling from Python."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "# get the default brain\n",
    "brain_name = env.brain_names[0]\n",
    "brain = env.brains[brain_name]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 2. Examine the State and Action Spaces\n",
    "\n",
    "In this environment, two agents control rackets to bounce a ball over a net. If an agent hits the ball over the net, it receives a reward of +0.1.  If an agent lets a ball hit the ground or hits the ball out of bounds, it receives a reward of -0.01.  Thus, the goal of each agent is to keep the ball in play.\n",
    "\n",
    "The observation space consists of 8 variables corresponding to the position and velocity of the ball and racket. Two continuous actions are available, corresponding to movement toward (or away from) the net, and jumping. \n",
    "\n",
    "Run the code cell below to print some information about the environment."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Number of agents: 2\n",
      "Size of each action: 2\n",
      "There are 2 agents. Each observes a state with length: 48\n",
      "The state for the first agent looks like: [ 0.          0.          0.          0.          0.          0.\n",
      "  0.          0.          0.          0.          0.          0.\n",
      "  0.          0.          0.          0.         -6.64731312 -1.5\n",
      " -0.          0.          7.99828482  6.         -0.          0.        ]\n",
      "The state for the first agent looks like: [ 0.          0.          0.          0.          0.          0.\n",
      "  0.          0.          0.          0.          0.          0.\n",
      "  0.          0.          0.          0.         -7.15059757 -1.5\n",
      "  0.          0.         -7.99828482  6.          0.          0.        ]\n"
     ]
    }
   ],
   "source": [
    "# reset the environment\n",
    "env_info = env.reset(train_mode=train)[brain_name]\n",
    "\n",
    "# number of agents \n",
    "num_agents = len(env_info.agents)\n",
    "print('Number of agents:', num_agents)\n",
    "\n",
    "# size of each action\n",
    "action_size = brain.vector_action_space_size\n",
    "print('Size of each action:', action_size)\n",
    "\n",
    "# examine the state space \n",
    "states = env_info.vector_observations\n",
    "# both states will be concatenated so i won't have to fix this at multiple spots i multiply it here by 2\n",
    "state_size = states.shape[1] *2\n",
    "\n",
    "print('There are {} agents. Each observes a state with length: {}'.format(states.shape[0], state_size))\n",
    "print('The state for the first agent looks like:', states[0])\n",
    "print('The state for the first agent looks like:', states[1])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "#variables to store values for plotting\n",
    "scores = []\n",
    "scores_window = deque(maxlen=100)\n",
    "avg_scores = []\n",
    "solved_episode = -1\n",
    "game_length_window =deque(maxlen=100)\n",
    "game_length = []\n",
    "avg_game_length = []\n",
    "network_loss = []\n",
    "\n",
    "# hyperparameters\n",
    "GAMMA = config['GAMMA']            # discount factor\n",
    "TAU = config['TAU']              # for soft update of target parameters\n",
    "LR_ACTOR = config['LR_ACTOR']        # learning rate of the actor \n",
    "LR_CRITIC = config['LR_CRITIC']        # learning rate of the critic\n",
    "\n",
    "noise=config['noise_factor']\n",
    "noise_decay=config['noise_decay']\n",
    "\n",
    "def concatStates(states):\n",
    "    concated_states = []\n",
    "    concated_states.append(np.reshape(states,(1,states[1].size*2)))\n",
    "    concated_states.append(np.reshape(states[::-1],(1,states[1].size*2)))\n",
    "    return torch.FloatTensor(concated_states)\n",
    "        "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[<ddpg.DDPGAgent object at 0x000002AEB33E3F98>, <ddpg.DDPGAgent object at 0x000002AEB3401CC0>]\n",
      "{\n",
      "  \"train_per_episode\": 2,\n",
      "  \"BUFFER_SIZE\": 50000,\n",
      "  \"BATCH_SIZE\": 256,\n",
      "  \"TAU\": 0.01,\n",
      "  \"LR_CRITIC\": 0.001,\n",
      "  \"LR_ACTOR\": 0.001,\n",
      "  \"GAMMA\": 0.99,\n",
      "  \"noise\": {\n",
      "    \"sigma\": 1.0,\n",
      "    \"mu\": 0.0,\n",
      "    \"theta\": 0.15\n",
      "  },\n",
      "  \"noise_factor\": 0.6,\n",
      "  \"noise_decay\": 0.998,\n",
      "  \"random\": {\n",
      "    \"seed\": 42,\n",
      "    \"count\": 0\n",
      "  },\n",
      "  \"seed\": {\n",
      "    \"environment\": 42,\n",
      "    \"agent\": 6\n",
      "  },\n",
      "  \"network\": {\n",
      "    \"hidden\": 256\n",
      "  }\n",
      "}\n"
     ]
    }
   ],
   "source": [
    "from maddpg import MADDPG\n",
    "from er import ReplayBuffer\n",
    "\n",
    "def seeding(seed=1):\n",
    "    np.random.seed(seed)\n",
    "    torch.manual_seed(seed)    \n",
    "    \n",
    "buffer = ReplayBuffer(action_size, config['BUFFER_SIZE'], config['BATCH_SIZE'], config['seed']['agent'])\n",
    "\n",
    "maddpg = MADDPG(config, state_size, action_size, num_agents, gamma=GAMMA, tau=TAU)\n",
    "print(maddpg.maddpg_agent)\n",
    "print(json.dumps(config, indent=2))\n",
    "#print(agents[0].actor_local)\n",
    "#print(agents[0].critic_local)\n",
    "device = 'cpu'"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Random Seed with 0/0 hits\n"
     ]
    }
   ],
   "source": [
    "#seed replay buffer with random actions\n",
    "np.random.seed(config['random']['seed'])\n",
    "count_positiv_random_rewards =0\n",
    "count_all_actions = 0\n",
    "for i in range(1, config['random']['count']):                                      # play game for 5 episodes\n",
    "    env_info = env.reset(train_mode=True)[brain_name]     # reset the environment    \n",
    "    states = env_info.vector_observations                  # get the current state (for each agent)\n",
    "    ep_scores = np.zeros(num_agents)                          # initialize the score (for each agent)\n",
    "    while True:\n",
    "        actions = np.random.randn(num_agents, action_size) # select an action (for each agent)\n",
    "        actions = np.clip(actions, -1, 1)                  # all actions between -1 and 1\n",
    "        env_info = env.step(actions)[brain_name]           # send all actions to tne environment\n",
    "        next_states = env_info.vector_observations         # get next state (for each agent)\n",
    "        rewards = env_info.rewards                         # get reward (for each agent)\n",
    "        dones = env_info.local_done                        # see if episode finished\n",
    "        ep_scores += env_info.rewards                         # update the score (for each agent)\n",
    "        states = next_states     # roll over states to next time step\n",
    "        \n",
    "        if np.any(dones):                                  # exit loop if episode finished\n",
    "            break\n",
    "        \n",
    "        states_for_replay = concatStates(env_info.vector_observations)\n",
    "        next_states_for_replay = concatStates(next_states)\n",
    "        [buffer.add(states_for_replay[i], actions[i], sum(rewards), next_states_for_replay[i], dones[i]) for i in range(num_agents)]\n",
    "        #print(states_for_replay[0], actions[0], sum(rewards), next_states_for_replay[0], dones[0])\n",
    "        count_all_actions+= 1\n",
    "        if (np.max(ep_scores) > 0):\n",
    "            count_positiv_random_rewards += 1\n",
    "\n",
    "print('Random Seed with {:d}/{:d} hits'.format(count_positiv_random_rewards,count_all_actions))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Score (max over agents) from episode\t10:\t0.00\tAverage Score:\t0.0000\ttime:\t0:00:00.159576\tactions:\t14\tNoise:\t0.58811\t284\n",
      "Score (max over agents) from episode\t20:\t0.00\tAverage Score:\t0.0000\ttime:\t0:00:00.198473\tactions:\t15\tNoise:\t0.57645\t568\n",
      "Score (max over agents) from episode\t30:\t0.00\tAverage Score:\t0.0000\ttime:\t0:00:00.174045\tactions:\t15\tNoise:\t0.56502\t852\n",
      "Score (max over agents) from episode\t37:\t0.09\tAverage Score:\t0.0009\ttime:\t0:00:00.218419\tactions:\t31\tNoise:\t0.55716\t1084\n",
      "Score (max over agents) from episode\t40:\t0.00\tAverage Score:\t0.0009\ttime:\t0:00:00.159574\tactions:\t14\tNoise:\t0.55383\t1168\n",
      "Score (max over agents) from episode\t50:\t0.00\tAverage Score:\t0.0009\ttime:\t0:00:00.159575\tactions:\t14\tNoise:\t0.54285\t1452\n",
      "Score (max over agents) from episode\t56:\t0.10\tAverage Score:\t0.0019\ttime:\t0:00:00.240360\tactions:\t31\tNoise:\t0.53637\t1656\n",
      "Score (max over agents) from episode\t60:\t0.00\tAverage Score:\t0.0019\ttime:\t0:00:00.209000\tactions:\t14\tNoise:\t0.53209\t1770\n",
      "Score (max over agents) from episode\t63:\t0.10\tAverage Score:\t0.0029\ttime:\t0:00:00.234100\tactions:\t30\tNoise:\t0.52890\t1888\n",
      "Score (max over agents) from episode\t68:\t0.10\tAverage Score:\t0.0039\ttime:\t0:00:00.259310\tactions:\t33\tNoise:\t0.52363\t2068\n",
      "Score (max over agents) from episode\t70:\t0.00\tAverage Score:\t0.0039\ttime:\t0:00:00.193486\tactions:\t13\tNoise:\t0.52154\t2124\n",
      "Score (max over agents) from episode\t80:\t0.00\tAverage Score:\t0.0039\ttime:\t0:00:00.183021\tactions:\t14\tNoise:\t0.51120\t2408\n",
      "Score (max over agents) from episode\t90:\t0.00\tAverage Score:\t0.0039\ttime:\t0:00:00.177528\tactions:\t14\tNoise:\t0.50107\t2690\n",
      "Score (max over agents) from episode\t100:\t0.00\tAverage Score:\t0.0039\ttime:\t0:00:00.178525\tactions:\t13\tNoise:\t0.49114\t2974\n",
      "Score (max over agents) from episode\t110:\t0.00\tAverage Score:\t0.0039\ttime:\t0:00:00.189495\tactions:\t15\tNoise:\t0.48141\t3258\n",
      "Score (max over agents) from episode\t112:\t0.10\tAverage Score:\t0.0049\ttime:\t0:00:00.317155\tactions:\t56\tNoise:\t0.47948\t3398\n",
      "Score (max over agents) from episode\t114:\t0.10\tAverage Score:\t0.0059\ttime:\t0:00:00.234886\tactions:\t30\tNoise:\t0.47757\t3486\n",
      "Score (max over agents) from episode\t117:\t0.10\tAverage Score:\t0.0069\ttime:\t0:00:00.236370\tactions:\t30\tNoise:\t0.47471\t3602\n",
      "Score (max over agents) from episode\t118:\t0.10\tAverage Score:\t0.0079\ttime:\t0:00:00.248339\tactions:\t31\tNoise:\t0.47376\t3664\n",
      "Score (max over agents) from episode\t120:\t0.00\tAverage Score:\t0.0079\ttime:\t0:00:00.182028\tactions:\t14\tNoise:\t0.47186\t3720\n",
      "Score (max over agents) from episode\t121:\t0.10\tAverage Score:\t0.0089\ttime:\t0:00:00.244348\tactions:\t32\tNoise:\t0.47092\t3784\n",
      "Score (max over agents) from episode\t124:\t0.09\tAverage Score:\t0.0098\ttime:\t0:00:00.257314\tactions:\t33\tNoise:\t0.46810\t3906\n",
      "Score (max over agents) from episode\t125:\t0.09\tAverage Score:\t0.0107\ttime:\t0:00:00.258312\tactions:\t29\tNoise:\t0.46716\t3964\n",
      "Score (max over agents) from episode\t128:\t0.10\tAverage Score:\t0.0117\ttime:\t0:00:00.233317\tactions:\t32\tNoise:\t0.46437\t4086\n",
      "Score (max over agents) from episode\t129:\t0.09\tAverage Score:\t0.0126\ttime:\t0:00:00.237369\tactions:\t32\tNoise:\t0.46344\t4150\n",
      "Score (max over agents) from episode\t130:\t0.00\tAverage Score:\t0.0126\ttime:\t0:00:00.184209\tactions:\t14\tNoise:\t0.46251\t4178\n",
      "Score (max over agents) from episode\t138:\t0.09\tAverage Score:\t0.0126\ttime:\t0:00:00.248846\tactions:\t32\tNoise:\t0.45516\t4446\n",
      "Score (max over agents) from episode\t139:\t0.10\tAverage Score:\t0.0136\ttime:\t0:00:00.242354\tactions:\t30\tNoise:\t0.45425\t4506\n",
      "Score (max over agents) from episode\t140:\t0.00\tAverage Score:\t0.0136\ttime:\t0:00:00.183512\tactions:\t15\tNoise:\t0.45334\t4536\n",
      "Score (max over agents) from episode\t142:\t0.10\tAverage Score:\t0.0146\ttime:\t0:00:00.301725\tactions:\t51\tNoise:\t0.45153\t4664\n",
      "Score (max over agents) from episode\t149:\t0.10\tAverage Score:\t0.0156\ttime:\t0:00:00.271706\tactions:\t45\tNoise:\t0.44525\t4922\n",
      "Score (max over agents) from episode\t150:\t0.00\tAverage Score:\t0.0156\ttime:\t0:00:00.184508\tactions:\t14\tNoise:\t0.44436\t4950\n",
      "Score (max over agents) from episode\t152:\t0.20\tAverage Score:\t0.0176\ttime:\t0:00:00.414306\tactions:\t89\tNoise:\t0.44258\t5156\n",
      "Score (max over agents) from episode\t156:\t0.10\tAverage Score:\t0.0176\ttime:\t0:00:00.236371\tactions:\t32\tNoise:\t0.43905\t5302\n",
      "Score (max over agents) from episode\t157:\t0.10\tAverage Score:\t0.0186\ttime:\t0:00:00.228907\tactions:\t28\tNoise:\t0.43817\t5358\n",
      "Score (max over agents) from episode\t158:\t0.10\tAverage Score:\t0.0196\ttime:\t0:00:00.323145\tactions:\t52\tNoise:\t0.43730\t5462\n",
      "Score (max over agents) from episode\t160:\t0.10\tAverage Score:\t0.0206\ttime:\t0:00:00.230105\tactions:\t30\tNoise:\t0.43555\t5548\n",
      "Score (max over agents) from episode\t161:\t0.20\tAverage Score:\t0.0226\ttime:\t0:00:00.349805\tactions:\t70\tNoise:\t0.43468\t5688\n",
      "Score (max over agents) from episode\t162:\t0.10\tAverage Score:\t0.0236\ttime:\t0:00:00.232381\tactions:\t31\tNoise:\t0.43381\t5750\n",
      "Score (max over agents) from episode\t163:\t0.09\tAverage Score:\t0.0235\ttime:\t0:00:00.259312\tactions:\t30\tNoise:\t0.43294\t5810\n",
      "Score (max over agents) from episode\t164:\t0.10\tAverage Score:\t0.0245\ttime:\t0:00:00.243352\tactions:\t31\tNoise:\t0.43208\t5872\n",
      "Score (max over agents) from episode\t166:\t0.09\tAverage Score:\t0.0254\ttime:\t0:00:00.238366\tactions:\t31\tNoise:\t0.43035\t5962\n",
      "Score (max over agents) from episode\t169:\t0.09\tAverage Score:\t0.0253\ttime:\t0:00:00.234884\tactions:\t29\tNoise:\t0.42777\t6076\n",
      "Score (max over agents) from episode\t170:\t0.09\tAverage Score:\t0.0262\ttime:\t0:00:00.269824\tactions:\t33\tNoise:\t0.42692\t6142\n",
      "Score (max over agents) from episode\t172:\t0.10\tAverage Score:\t0.0272\ttime:\t0:00:00.253352\tactions:\t30\tNoise:\t0.42521\t6230\n",
      "Score (max over agents) from episode\t173:\t0.10\tAverage Score:\t0.0282\ttime:\t0:00:00.239387\tactions:\t33\tNoise:\t0.42436\t6296\n",
      "Score (max over agents) from episode\t175:\t0.10\tAverage Score:\t0.0292\ttime:\t0:00:00.325161\tactions:\t49\tNoise:\t0.42266\t6422\n",
      "Score (max over agents) from episode\t180:\t0.00\tAverage Score:\t0.0292\ttime:\t0:00:00.190494\tactions:\t16\tNoise:\t0.41845\t6568\n",
      "Score (max over agents) from episode\t187:\t0.10\tAverage Score:\t0.0302\ttime:\t0:00:00.221917\tactions:\t30\tNoise:\t0.41263\t6796\n",
      "Score (max over agents) from episode\t189:\t0.10\tAverage Score:\t0.0312\ttime:\t0:00:00.244348\tactions:\t33\tNoise:\t0.41098\t6890\n",
      "Score (max over agents) from episode\t190:\t0.00\tAverage Score:\t0.0312\ttime:\t0:00:00.184526\tactions:\t13\tNoise:\t0.41016\t6916\n",
      "Score (max over agents) from episode\t196:\t0.09\tAverage Score:\t0.0321\ttime:\t0:00:00.242370\tactions:\t32\tNoise:\t0.40526\t7120\n",
      "Score (max over agents) from episode\t197:\t0.09\tAverage Score:\t0.0330\ttime:\t0:00:00.272708\tactions:\t34\tNoise:\t0.40445\t7188\n",
      "Score (max over agents) from episode\t200:\t0.00\tAverage Score:\t0.0330\ttime:\t0:00:00.179034\tactions:\t14\tNoise:\t0.40203\t7272\n",
      "Score (max over agents) from episode\t204:\t0.10\tAverage Score:\t0.0340\ttime:\t0:00:00.256317\tactions:\t31\tNoise:\t0.39882\t7418\n",
      "Score (max over agents) from episode\t206:\t0.09\tAverage Score:\t0.0349\ttime:\t0:00:00.230386\tactions:\t29\tNoise:\t0.39723\t7506\n",
      "Score (max over agents) from episode\t210:\t0.09\tAverage Score:\t0.0358\ttime:\t0:00:00.230404\tactions:\t30\tNoise:\t0.39406\t7662\n",
      "Score (max over agents) from episode\t214:\t0.10\tAverage Score:\t0.0348\ttime:\t0:00:00.230894\tactions:\t30\tNoise:\t0.39092\t7808\n",
      "Score (max over agents) from episode\t216:\t0.09\tAverage Score:\t0.0357\ttime:\t0:00:00.241359\tactions:\t30\tNoise:\t0.38936\t7896\n",
      "Score (max over agents) from episode\t217:\t0.10\tAverage Score:\t0.0357\ttime:\t0:00:00.246345\tactions:\t31\tNoise:\t0.38858\t7958\n",
      "Score (max over agents) from episode\t220:\t0.00\tAverage Score:\t0.0347\ttime:\t0:00:00.182513\tactions:\t14\tNoise:\t0.38625\t8044\n",
      "Score (max over agents) from episode\t223:\t0.09\tAverage Score:\t0.0346\ttime:\t0:00:00.242206\tactions:\t30\tNoise:\t0.38394\t8160\n",
      "Score (max over agents) from episode\t225:\t0.09\tAverage Score:\t0.0337\ttime:\t0:00:00.260912\tactions:\t31\tNoise:\t0.38240\t8250\n",
      "Score (max over agents) from episode\t228:\t0.09\tAverage Score:\t0.0336\ttime:\t0:00:00.237491\tactions:\t30\tNoise:\t0.38011\t8372\n",
      "Score (max over agents) from episode\t230:\t0.00\tAverage Score:\t0.0327\ttime:\t0:00:00.252700\tactions:\t14\tNoise:\t0.37860\t8428\n",
      "Score (max over agents) from episode\t234:\t0.10\tAverage Score:\t0.0337\ttime:\t0:00:00.240361\tactions:\t32\tNoise:\t0.37558\t8578\n",
      "Score (max over agents) from episode\t236:\t0.09\tAverage Score:\t0.0346\ttime:\t0:00:00.253855\tactions:\t31\tNoise:\t0.37408\t8672\n",
      "Score (max over agents) from episode\t240:\t0.00\tAverage Score:\t0.0327\ttime:\t0:00:00.185017\tactions:\t14\tNoise:\t0.37109\t8786\n",
      "Score (max over agents) from episode\t250:\t0.00\tAverage Score:\t0.0307\ttime:\t0:00:00.207448\tactions:\t14\tNoise:\t0.36374\t9070\n",
      "Score (max over agents) from episode\t256:\t0.10\tAverage Score:\t0.0287\ttime:\t0:00:00.216601\tactions:\t29\tNoise:\t0.35939\t9274\n",
      "Score (max over agents) from episode\t257:\t0.09\tAverage Score:\t0.0286\ttime:\t0:00:00.227362\tactions:\t33\tNoise:\t0.35867\t9340\n",
      "Score (max over agents) from episode\t258:\t0.09\tAverage Score:\t0.0285\ttime:\t0:00:00.246345\tactions:\t30\tNoise:\t0.35796\t9400\n",
      "Score (max over agents) from episode\t260:\t0.00\tAverage Score:\t0.0275\ttime:\t0:00:00.175941\tactions:\t14\tNoise:\t0.35653\t9458\n",
      "Score (max over agents) from episode\t261:\t0.10\tAverage Score:\t0.0265\ttime:\t0:00:00.227907\tactions:\t30\tNoise:\t0.35581\t9518\n",
      "Score (max over agents) from episode\t265:\t0.10\tAverage Score:\t0.0246\ttime:\t0:00:00.296078\tactions:\t46\tNoise:\t0.35298\t9700\n",
      "Score (max over agents) from episode\t266:\t0.10\tAverage Score:\t0.0247\ttime:\t0:00:00.206528\tactions:\t24\tNoise:\t0.35227\t9748\n",
      "Score (max over agents) from episode\t270:\t0.10\tAverage Score:\t0.0239\ttime:\t0:00:00.228392\tactions:\t33\tNoise:\t0.34946\t9904\n",
      "Score (max over agents) from episode\t276:\t0.09\tAverage Score:\t0.0218\ttime:\t0:00:00.206462\tactions:\t19\tNoise:\t0.34529\t10084\n",
      "Score (max over agents) from episode\t280:\t0.00\tAverage Score:\t0.0218\ttime:\t0:00:00.201464\tactions:\t15\tNoise:\t0.34253\t10198\n",
      "Score (max over agents) from episode\t285:\t0.10\tAverage Score:\t0.0228\ttime:\t0:00:00.238365\tactions:\t30\tNoise:\t0.33912\t10370\n",
      "Score (max over agents) from episode\t286:\t0.10\tAverage Score:\t0.0238\ttime:\t0:00:00.238365\tactions:\t26\tNoise:\t0.33844\t10422\n",
      "Score (max over agents) from episode\t290:\t0.00\tAverage Score:\t0.0218\ttime:\t0:00:00.191002\tactions:\t14\tNoise:\t0.33574\t10536\n",
      "Score (max over agents) from episode\t291:\t0.10\tAverage Score:\t0.0228\ttime:\t0:00:00.246344\tactions:\t31\tNoise:\t0.33507\t10598\n",
      "Score (max over agents) from episode\t300:\t0.00\tAverage Score:\t0.0210\ttime:\t0:00:00.192488\tactions:\t14\tNoise:\t0.32909\t10854\n",
      "Score (max over agents) from episode\t310:\t0.00\tAverage Score:\t0.0182\ttime:\t0:00:00.181592\tactions:\t15\tNoise:\t0.32257\t11142\n",
      "Score (max over agents) from episode\t320:\t0.00\tAverage Score:\t0.0153\ttime:\t0:00:00.181515\tactions:\t15\tNoise:\t0.31617\t11426\n",
      "Score (max over agents) from episode\t330:\t0.00\tAverage Score:\t0.0126\ttime:\t0:00:00.216423\tactions:\t15\tNoise:\t0.30991\t11710\n",
      "Score (max over agents) from episode\t340:\t0.00\tAverage Score:\t0.0107\ttime:\t0:00:00.203966\tactions:\t15\tNoise:\t0.30376\t11994\n",
      "Score (max over agents) from episode\t350:\t0.00\tAverage Score:\t0.0107\ttime:\t0:00:00.178957\tactions:\t15\tNoise:\t0.29774\t12278\n",
      "Score (max over agents) from episode\t360:\t0.00\tAverage Score:\t0.0079\ttime:\t0:00:00.185364\tactions:\t15\tNoise:\t0.29184\t12562\n",
      "Score (max over agents) from episode\t370:\t0.00\tAverage Score:\t0.0039\ttime:\t0:00:00.174535\tactions:\t15\tNoise:\t0.28606\t12846\n",
      "Score (max over agents) from episode\t380:\t0.00\tAverage Score:\t0.0030\ttime:\t0:00:00.186503\tactions:\t15\tNoise:\t0.28039\t13130\n",
      "Score (max over agents) from episode\t390:\t0.00\tAverage Score:\t0.0010\ttime:\t0:00:00.185506\tactions:\t15\tNoise:\t0.27483\t13414\n",
      "Score (max over agents) from episode\t400:\t0.00\tAverage Score:\t0.0000\ttime:\t0:00:00.204963\tactions:\t14\tNoise:\t0.26938\t13696\n",
      "Score (max over agents) from episode\t410:\t0.00\tAverage Score:\t0.0000\ttime:\t0:00:00.199469\tactions:\t14\tNoise:\t0.26404\t13980\n",
      "Score (max over agents) from episode\t420:\t0.00\tAverage Score:\t0.0000\ttime:\t0:00:00.172541\tactions:\t14\tNoise:\t0.25881\t14264\n",
      "Score (max over agents) from episode\t430:\t0.00\tAverage Score:\t0.0000\ttime:\t0:00:00.181518\tactions:\t14\tNoise:\t0.25368\t14548\n",
      "Score (max over agents) from episode\t440:\t0.00\tAverage Score:\t0.0000\ttime:\t0:00:00.205597\tactions:\t14\tNoise:\t0.24865\t14832\n",
      "Score (max over agents) from episode\t450:\t0.09\tAverage Score:\t0.0009\ttime:\t0:00:00.227394\tactions:\t31\tNoise:\t0.24372\t15152\n",
      "Score (max over agents) from episode\t460:\t0.00\tAverage Score:\t0.0009\ttime:\t0:00:00.181518\tactions:\t15\tNoise:\t0.23889\t15436\n",
      "Score (max over agents) from episode\t464:\t0.10\tAverage Score:\t0.0019\ttime:\t0:00:00.230386\tactions:\t33\tNoise:\t0.23699\t15586\n",
      "Score (max over agents) from episode\t470:\t0.09\tAverage Score:\t0.0028\ttime:\t0:00:00.270280\tactions:\t30\tNoise:\t0.23416\t15800\n",
      "Score (max over agents) from episode\t471:\t0.09\tAverage Score:\t0.0037\ttime:\t0:00:00.305187\tactions:\t43\tNoise:\t0.23369\t15886\n",
      "Score (max over agents) from episode\t472:\t0.09\tAverage Score:\t0.0046\ttime:\t0:00:00.251008\tactions:\t30\tNoise:\t0.23322\t15946\n",
      "Score (max over agents) from episode\t478:\t0.10\tAverage Score:\t0.0056\ttime:\t0:00:00.245812\tactions:\t28\tNoise:\t0.23044\t16144\n",
      "Score (max over agents) from episode\t480:\t0.00\tAverage Score:\t0.0056\ttime:\t0:00:00.187499\tactions:\t14\tNoise:\t0.22951\t16202\n",
      "Score (max over agents) from episode\t481:\t0.10\tAverage Score:\t0.0066\ttime:\t0:00:00.242879\tactions:\t29\tNoise:\t0.22906\t16260\n",
      "Score (max over agents) from episode\t487:\t0.10\tAverage Score:\t0.0076\ttime:\t0:00:00.266845\tactions:\t30\tNoise:\t0.22632\t16462\n",
      "Score (max over agents) from episode\t489:\t0.09\tAverage Score:\t0.0085\ttime:\t0:00:00.248316\tactions:\t29\tNoise:\t0.22542\t16550\n",
      "Score (max over agents) from episode\t490:\t0.00\tAverage Score:\t0.0085\ttime:\t0:00:00.204700\tactions:\t14\tNoise:\t0.22497\t16578\n",
      "Score (max over agents) from episode\t492:\t0.09\tAverage Score:\t0.0094\ttime:\t0:00:00.269818\tactions:\t30\tNoise:\t0.22407\t16668\n",
      "Score (max over agents) from episode\t493:\t0.10\tAverage Score:\t0.0104\ttime:\t0:00:00.276268\tactions:\t31\tNoise:\t0.22362\t16730\n",
      "Score (max over agents) from episode\t494:\t0.09\tAverage Score:\t0.0113\ttime:\t0:00:00.265293\tactions:\t30\tNoise:\t0.22317\t16790\n",
      "Score (max over agents) from episode\t495:\t0.10\tAverage Score:\t0.0123\ttime:\t0:00:00.248341\tactions:\t31\tNoise:\t0.22273\t16852\n",
      "Score (max over agents) from episode\t500:\t0.10\tAverage Score:\t0.0133\ttime:\t0:00:00.250482\tactions:\t25\tNoise:\t0.22051\t17018\n",
      "Score (max over agents) from episode\t503:\t0.10\tAverage Score:\t0.0143\ttime:\t0:00:00.241426\tactions:\t30\tNoise:\t0.21919\t17138\n",
      "Score (max over agents) from episode\t510:\t0.09\tAverage Score:\t0.0152\ttime:\t0:00:00.267288\tactions:\t30\tNoise:\t0.21614\t17370\n",
      "Score (max over agents) from episode\t511:\t0.09\tAverage Score:\t0.0161\ttime:\t0:00:00.286239\tactions:\t31\tNoise:\t0.21570\t17432\n",
      "Score (max over agents) from episode\t514:\t0.10\tAverage Score:\t0.0171\ttime:\t0:00:00.274993\tactions:\t30\tNoise:\t0.21441\t17550\n",
      "Score (max over agents) from episode\t516:\t0.09\tAverage Score:\t0.0180\ttime:\t0:00:00.245724\tactions:\t29\tNoise:\t0.21356\t17636\n",
      "Score (max over agents) from episode\t520:\t0.10\tAverage Score:\t0.0190\ttime:\t0:00:00.272760\tactions:\t37\tNoise:\t0.21185\t17814\n",
      "Score (max over agents) from episode\t529:\t0.09\tAverage Score:\t0.0199\ttime:\t0:00:00.270286\tactions:\t30\tNoise:\t0.20807\t18108\n",
      "Score (max over agents) from episode\t530:\t0.00\tAverage Score:\t0.0199\ttime:\t0:00:00.237885\tactions:\t16\tNoise:\t0.20765\t18140\n",
      "Score (max over agents) from episode\t531:\t0.09\tAverage Score:\t0.0208\ttime:\t0:00:00.280254\tactions:\t29\tNoise:\t0.20724\t18198\n",
      "Score (max over agents) from episode\t533:\t0.09\tAverage Score:\t0.0217\ttime:\t0:00:00.261683\tactions:\t30\tNoise:\t0.20641\t18290\n",
      "Score (max over agents) from episode\t534:\t0.09\tAverage Score:\t0.0226\ttime:\t0:00:00.268798\tactions:\t30\tNoise:\t0.20600\t18350\n",
      "Score (max over agents) from episode\t536:\t0.10\tAverage Score:\t0.0236\ttime:\t0:00:00.302765\tactions:\t30\tNoise:\t0.20517\t18438\n",
      "Score (max over agents) from episode\t537:\t0.09\tAverage Score:\t0.0245\ttime:\t0:00:00.257315\tactions:\t29\tNoise:\t0.20476\t18496\n",
      "Score (max over agents) from episode\t538:\t0.09\tAverage Score:\t0.0254\ttime:\t0:00:00.277301\tactions:\t31\tNoise:\t0.20435\t18558\n",
      "Score (max over agents) from episode\t539:\t0.10\tAverage Score:\t0.0264\ttime:\t0:00:00.287236\tactions:\t32\tNoise:\t0.20394\t18622\n",
      "Score (max over agents) from episode\t540:\t0.00\tAverage Score:\t0.0264\ttime:\t0:00:00.208992\tactions:\t14\tNoise:\t0.20354\t18650\n",
      "Score (max over agents) from episode\t541:\t0.10\tAverage Score:\t0.0274\ttime:\t0:00:00.305534\tactions:\t32\tNoise:\t0.20313\t18714\n",
      "Score (max over agents) from episode\t542:\t0.10\tAverage Score:\t0.0284\ttime:\t0:00:00.274020\tactions:\t31\tNoise:\t0.20272\t18776\n",
      "Score (max over agents) from episode\t544:\t0.10\tAverage Score:\t0.0294\ttime:\t0:00:00.246740\tactions:\t31\tNoise:\t0.20191\t18866\n",
      "Score (max over agents) from episode\t546:\t0.10\tAverage Score:\t0.0304\ttime:\t0:00:00.266290\tactions:\t30\tNoise:\t0.20111\t18958\n",
      "Score (max over agents) from episode\t547:\t0.09\tAverage Score:\t0.0313\ttime:\t0:00:00.285241\tactions:\t29\tNoise:\t0.20070\t19016\n",
      "Score (max over agents) from episode\t550:\t0.00\tAverage Score:\t0.0304\ttime:\t0:00:00.244349\tactions:\t16\tNoise:\t0.19950\t19106\n",
      "Score (max over agents) from episode\t552:\t0.09\tAverage Score:\t0.0313\ttime:\t0:00:00.244258\tactions:\t31\tNoise:\t0.19871\t19196\n",
      "Score (max over agents) from episode\t553:\t0.09\tAverage Score:\t0.0322\ttime:\t0:00:00.278279\tactions:\t30\tNoise:\t0.19831\t19256\n",
      "Score (max over agents) from episode\t554:\t0.10\tAverage Score:\t0.0332\ttime:\t0:00:00.259121\tactions:\t31\tNoise:\t0.19791\t19318\n",
      "Score (max over agents) from episode\t557:\t0.09\tAverage Score:\t0.0341\ttime:\t0:00:00.310684\tactions:\t29\tNoise:\t0.19673\t19440\n",
      "Score (max over agents) from episode\t558:\t0.10\tAverage Score:\t0.0351\ttime:\t0:00:00.357557\tactions:\t32\tNoise:\t0.19633\t19504\n",
      "Score (max over agents) from episode\t559:\t0.09\tAverage Score:\t0.0360\ttime:\t0:00:00.301198\tactions:\t31\tNoise:\t0.19594\t19566\n",
      "Score (max over agents) from episode\t560:\t0.00\tAverage Score:\t0.0360\ttime:\t0:00:00.198472\tactions:\t15\tNoise:\t0.19555\t19596\n",
      "Score (max over agents) from episode\t566:\t0.10\tAverage Score:\t0.0360\ttime:\t0:00:00.249337\tactions:\t31\tNoise:\t0.19321\t19800\n",
      "Score (max over agents) from episode\t567:\t0.19\tAverage Score:\t0.0379\ttime:\t0:00:00.356559\tactions:\t65\tNoise:\t0.19283\t19930\n",
      "Score (max over agents) from episode\t570:\t0.00\tAverage Score:\t0.0370\ttime:\t0:00:00.184509\tactions:\t14\tNoise:\t0.19167\t20014\n",
      "Score (max over agents) from episode\t571:\t0.10\tAverage Score:\t0.0371\ttime:\t0:00:00.278768\tactions:\t33\tNoise:\t0.19129\t20080\n",
      "Score (max over agents) from episode\t572:\t0.09\tAverage Score:\t0.0371\ttime:\t0:00:00.255270\tactions:\t29\tNoise:\t0.19091\t20138\n",
      "Score (max over agents) from episode\t574:\t0.10\tAverage Score:\t0.0381\ttime:\t0:00:00.273716\tactions:\t31\tNoise:\t0.19014\t20228\n",
      "Score (max over agents) from episode\t575:\t0.10\tAverage Score:\t0.0391\ttime:\t0:00:00.264112\tactions:\t31\tNoise:\t0.18976\t20290\n",
      "Score (max over agents) from episode\t578:\t0.09\tAverage Score:\t0.0390\ttime:\t0:00:00.271787\tactions:\t30\tNoise:\t0.18863\t20408\n",
      "Score (max over agents) from episode\t579:\t0.10\tAverage Score:\t0.0400\ttime:\t0:00:00.245860\tactions:\t29\tNoise:\t0.18825\t20466\n",
      "Score (max over agents) from episode\t580:\t0.09\tAverage Score:\t0.0409\ttime:\t0:00:00.287241\tactions:\t31\tNoise:\t0.18787\t20528\n",
      "Score (max over agents) from episode\t581:\t0.10\tAverage Score:\t0.0409\ttime:\t0:00:00.256455\tactions:\t29\tNoise:\t0.18750\t20586\n",
      "Score (max over agents) from episode\t582:\t0.09\tAverage Score:\t0.0418\ttime:\t0:00:00.261791\tactions:\t30\tNoise:\t0.18712\t20646\n",
      "Score (max over agents) from episode\t583:\t0.10\tAverage Score:\t0.0428\ttime:\t0:00:00.290253\tactions:\t29\tNoise:\t0.18675\t20704\n",
      "Score (max over agents) from episode\t585:\t0.09\tAverage Score:\t0.0437\ttime:\t0:00:00.247871\tactions:\t30\tNoise:\t0.18600\t20792\n",
      "Score (max over agents) from episode\t586:\t0.10\tAverage Score:\t0.0447\ttime:\t0:00:00.271785\tactions:\t31\tNoise:\t0.18563\t20854\n",
      "Score (max over agents) from episode\t587:\t0.10\tAverage Score:\t0.0447\ttime:\t0:00:00.257315\tactions:\t31\tNoise:\t0.18526\t20916\n",
      "Score (max over agents) from episode\t589:\t0.09\tAverage Score:\t0.0447\ttime:\t0:00:00.242998\tactions:\t30\tNoise:\t0.18452\t21054\n",
      "Score (max over agents) from episode\t590:\t0.00\tAverage Score:\t0.0447\ttime:\t0:00:00.183627\tactions:\t14\tNoise:\t0.18415\t21082\n",
      "Score (max over agents) from episode\t591:\t0.09\tAverage Score:\t0.0456\ttime:\t0:00:00.242863\tactions:\t29\tNoise:\t0.18378\t21140\n",
      "Score (max over agents) from episode\t594:\t0.10\tAverage Score:\t0.0438\ttime:\t0:00:00.251586\tactions:\t31\tNoise:\t0.18268\t21262\n",
      "Score (max over agents) from episode\t598:\t0.10\tAverage Score:\t0.0438\ttime:\t0:00:00.298991\tactions:\t50\tNoise:\t0.18122\t21448\n",
      "Score (max over agents) from episode\t599:\t0.09\tAverage Score:\t0.0447\ttime:\t0:00:00.228411\tactions:\t29\tNoise:\t0.18086\t21506\n",
      "Score (max over agents) from episode\t600:\t0.10\tAverage Score:\t0.0447\ttime:\t0:00:00.265293\tactions:\t30\tNoise:\t0.18050\t21566\n",
      "Score (max over agents) from episode\t603:\t0.09\tAverage Score:\t0.0446\ttime:\t0:00:00.244350\tactions:\t30\tNoise:\t0.17942\t21682\n",
      "Score (max over agents) from episode\t604:\t0.09\tAverage Score:\t0.0455\ttime:\t0:00:00.266311\tactions:\t31\tNoise:\t0.17906\t21744\n",
      "Score (max over agents) from episode\t605:\t0.09\tAverage Score:\t0.0464\ttime:\t0:00:00.244350\tactions:\t30\tNoise:\t0.17870\t21804\n",
      "Score (max over agents) from episode\t606:\t0.10\tAverage Score:\t0.0474\ttime:\t0:00:00.251330\tactions:\t30\tNoise:\t0.17834\t21864\n",
      "Score (max over agents) from episode\t607:\t0.09\tAverage Score:\t0.0483\ttime:\t0:00:00.258794\tactions:\t31\tNoise:\t0.17799\t21926\n",
      "Score (max over agents) from episode\t608:\t0.09\tAverage Score:\t0.0492\ttime:\t0:00:00.239589\tactions:\t30\tNoise:\t0.17763\t21986\n",
      "Score (max over agents) from episode\t610:\t0.09\tAverage Score:\t0.0492\ttime:\t0:00:00.242863\tactions:\t31\tNoise:\t0.17692\t22078\n",
      "Score (max over agents) from episode\t611:\t0.09\tAverage Score:\t0.0492\ttime:\t0:00:00.252328\tactions:\t32\tNoise:\t0.17657\t22142\n",
      "Score (max over agents) from episode\t612:\t0.09\tAverage Score:\t0.0501\ttime:\t0:00:00.284243\tactions:\t30\tNoise:\t0.17621\t22202\n",
      "Score (max over agents) from episode\t613:\t0.10\tAverage Score:\t0.0511\ttime:\t0:00:00.258336\tactions:\t30\tNoise:\t0.17586\t22262\n",
      "Score (max over agents) from episode\t614:\t0.09\tAverage Score:\t0.0510\ttime:\t0:00:00.247342\tactions:\t30\tNoise:\t0.17551\t22322\n",
      "Score (max over agents) from episode\t615:\t0.09\tAverage Score:\t0.0519\ttime:\t0:00:00.247340\tactions:\t31\tNoise:\t0.17516\t22384\n",
      "Score (max over agents) from episode\t616:\t0.10\tAverage Score:\t0.0520\ttime:\t0:00:00.248340\tactions:\t29\tNoise:\t0.17481\t22442\n",
      "Score (max over agents) from episode\t617:\t0.09\tAverage Score:\t0.0529\ttime:\t0:00:00.281195\tactions:\t30\tNoise:\t0.17446\t22502\n",
      "Score (max over agents) from episode\t618:\t0.10\tAverage Score:\t0.0539\ttime:\t0:00:00.336981\tactions:\t52\tNoise:\t0.17411\t22606\n",
      "Score (max over agents) from episode\t620:\t0.10\tAverage Score:\t0.0539\ttime:\t0:00:00.254322\tactions:\t30\tNoise:\t0.17342\t22694\n",
      "Score (max over agents) from episode\t621:\t0.10\tAverage Score:\t0.0549\ttime:\t0:00:00.266344\tactions:\t30\tNoise:\t0.17307\t22754\n",
      "Score (max over agents) from episode\t622:\t0.10\tAverage Score:\t0.0559\ttime:\t0:00:00.256693\tactions:\t30\tNoise:\t0.17272\t22814\n",
      "Score (max over agents) from episode\t623:\t0.10\tAverage Score:\t0.0569\ttime:\t0:00:00.297209\tactions:\t32\tNoise:\t0.17238\t22878\n",
      "Score (max over agents) from episode\t624:\t0.10\tAverage Score:\t0.0579\ttime:\t0:00:00.263299\tactions:\t29\tNoise:\t0.17203\t22936\n",
      "Score (max over agents) from episode\t625:\t0.09\tAverage Score:\t0.0588\ttime:\t0:00:00.257123\tactions:\t30\tNoise:\t0.17169\t22996\n",
      "Score (max over agents) from episode\t626:\t0.10\tAverage Score:\t0.0598\ttime:\t0:00:00.260331\tactions:\t29\tNoise:\t0.17134\t23054\n",
      "Score (max over agents) from episode\t628:\t0.10\tAverage Score:\t0.0608\ttime:\t0:00:00.284243\tactions:\t30\tNoise:\t0.17066\t23142\n",
      "Score (max over agents) from episode\t629:\t0.09\tAverage Score:\t0.0608\ttime:\t0:00:00.286749\tactions:\t30\tNoise:\t0.17032\t23202\n",
      "Score (max over agents) from episode\t630:\t0.00\tAverage Score:\t0.0608\ttime:\t0:00:00.206450\tactions:\t14\tNoise:\t0.16998\t23230\n",
      "Score (max over agents) from episode\t632:\t0.09\tAverage Score:\t0.0608\ttime:\t0:00:00.277272\tactions:\t30\tNoise:\t0.16930\t23318\n",
      "Score (max over agents) from episode\t636:\t0.10\tAverage Score:\t0.0590\ttime:\t0:00:00.270339\tactions:\t31\tNoise:\t0.16795\t23464\n",
      "Score (max over agents) from episode\t637:\t0.10\tAverage Score:\t0.0591\ttime:\t0:00:00.292262\tactions:\t31\tNoise:\t0.16761\t23526\n",
      "Score (max over agents) from episode\t638:\t0.10\tAverage Score:\t0.0592\ttime:\t0:00:00.289737\tactions:\t29\tNoise:\t0.16728\t23584\n",
      "Score (max over agents) from episode\t639:\t0.10\tAverage Score:\t0.0592\ttime:\t0:00:00.309685\tactions:\t31\tNoise:\t0.16694\t23646\n",
      "Score (max over agents) from episode\t640:\t0.00\tAverage Score:\t0.0592\ttime:\t0:00:00.231891\tactions:\t14\tNoise:\t0.16661\t23674\n",
      "Score (max over agents) from episode\t641:\t0.10\tAverage Score:\t0.0592\ttime:\t0:00:00.319151\tactions:\t30\tNoise:\t0.16628\t23734\n",
      "Score (max over agents) from episode\t650:\t0.20\tAverage Score:\t0.0573\ttime:\t0:00:00.439372\tactions:\t71\tNoise:\t0.16331\t24098\n",
      "Score (max over agents) from episode\t651:\t0.09\tAverage Score:\t0.0582\ttime:\t0:00:00.324137\tactions:\t31\tNoise:\t0.16298\t24160\n",
      "Score (max over agents) from episode\t655:\t0.10\tAverage Score:\t0.0564\ttime:\t0:00:00.258694\tactions:\t31\tNoise:\t0.16168\t24304\n",
      "Score (max over agents) from episode\t660:\t0.00\tAverage Score:\t0.0536\ttime:\t0:00:00.207977\tactions:\t14\tNoise:\t0.16007\t24442\n",
      "Score (max over agents) from episode\t668:\t0.10\tAverage Score:\t0.0517\ttime:\t0:00:00.254361\tactions:\t28\tNoise:\t0.15753\t24690\n",
      "Score (max over agents) from episode\t669:\t0.10\tAverage Score:\t0.0527\ttime:\t0:00:00.273006\tactions:\t31\tNoise:\t0.15721\t24752\n",
      "Score (max over agents) from episode\t670:\t0.10\tAverage Score:\t0.0537\ttime:\t0:00:00.282974\tactions:\t31\tNoise:\t0.15690\t24814\n",
      "Score (max over agents) from episode\t671:\t0.09\tAverage Score:\t0.0536\ttime:\t0:00:00.249834\tactions:\t30\tNoise:\t0.15658\t24874\n",
      "Score (max over agents) from episode\t672:\t0.10\tAverage Score:\t0.0537\ttime:\t0:00:00.256318\tactions:\t32\tNoise:\t0.15627\t24938\n",
      "Score (max over agents) from episode\t674:\t0.10\tAverage Score:\t0.0537\ttime:\t0:00:00.252346\tactions:\t31\tNoise:\t0.15565\t25026\n",
      "Score (max over agents) from episode\t675:\t0.09\tAverage Score:\t0.0536\ttime:\t0:00:00.254323\tactions:\t30\tNoise:\t0.15533\t25086\n",
      "Score (max over agents) from episode\t676:\t0.09\tAverage Score:\t0.0545\ttime:\t0:00:00.263299\tactions:\t31\tNoise:\t0.15502\t25148\n",
      "Score (max over agents) from episode\t678:\t0.09\tAverage Score:\t0.0545\ttime:\t0:00:00.243351\tactions:\t31\tNoise:\t0.15440\t25236\n",
      "Score (max over agents) from episode\t679:\t0.09\tAverage Score:\t0.0544\ttime:\t0:00:00.234381\tactions:\t30\tNoise:\t0.15410\t25296\n",
      "Score (max over agents) from episode\t680:\t0.10\tAverage Score:\t0.0545\ttime:\t0:00:00.246814\tactions:\t30\tNoise:\t0.15379\t25356\n",
      "Score (max over agents) from episode\t681:\t0.10\tAverage Score:\t0.0545\ttime:\t0:00:00.344956\tactions:\t52\tNoise:\t0.15348\t25460\n",
      "Score (max over agents) from episode\t682:\t0.09\tAverage Score:\t0.0545\ttime:\t0:00:00.246851\tactions:\t31\tNoise:\t0.15317\t25522\n",
      "Score (max over agents) from episode\t684:\t0.09\tAverage Score:\t0.0544\ttime:\t0:00:00.249195\tactions:\t31\tNoise:\t0.15256\t25612\n",
      "Score (max over agents) from episode\t685:\t0.10\tAverage Score:\t0.0545\ttime:\t0:00:00.242862\tactions:\t31\tNoise:\t0.15226\t25674\n",
      "Score (max over agents) from episode\t686:\t0.09\tAverage Score:\t0.0544\ttime:\t0:00:00.272885\tactions:\t32\tNoise:\t0.15195\t25738\n",
      "Score (max over agents) from episode\t687:\t0.10\tAverage Score:\t0.0544\ttime:\t0:00:00.255829\tactions:\t30\tNoise:\t0.15165\t25798\n",
      "Score (max over agents) from episode\t688:\t0.10\tAverage Score:\t0.0554\ttime:\t0:00:00.254384\tactions:\t31\tNoise:\t0.15134\t25860\n",
      "Score (max over agents) from episode\t689:\t0.10\tAverage Score:\t0.0555\ttime:\t0:00:00.246840\tactions:\t31\tNoise:\t0.15104\t25922\n",
      "Score (max over agents) from episode\t690:\t0.10\tAverage Score:\t0.0565\ttime:\t0:00:00.256318\tactions:\t32\tNoise:\t0.15074\t25986\n",
      "Score (max over agents) from episode\t691:\t0.10\tAverage Score:\t0.0566\ttime:\t0:00:00.240359\tactions:\t30\tNoise:\t0.15044\t26046\n",
      "Score (max over agents) from episode\t692:\t0.09\tAverage Score:\t0.0575\ttime:\t0:00:00.267796\tactions:\t30\tNoise:\t0.15014\t26106\n",
      "Score (max over agents) from episode\t695:\t0.10\tAverage Score:\t0.0575\ttime:\t0:00:00.251838\tactions:\t32\tNoise:\t0.14924\t26224\n",
      "Score (max over agents) from episode\t697:\t0.09\tAverage Score:\t0.0584\ttime:\t0:00:00.253325\tactions:\t31\tNoise:\t0.14864\t26314\n",
      "Score (max over agents) from episode\t698:\t0.10\tAverage Score:\t0.0584\ttime:\t0:00:00.250997\tactions:\t30\tNoise:\t0.14834\t26374\n",
      "Score (max over agents) from episode\t699:\t0.10\tAverage Score:\t0.0585\ttime:\t0:00:00.264804\tactions:\t30\tNoise:\t0.14805\t26434\n",
      "Score (max over agents) from episode\t700:\t0.10\tAverage Score:\t0.0585\ttime:\t0:00:00.251918\tactions:\t30\tNoise:\t0.14775\t26494\n",
      "Score (max over agents) from episode\t702:\t0.09\tAverage Score:\t0.0594\ttime:\t0:00:00.242354\tactions:\t30\tNoise:\t0.14716\t26582\n",
      "Score (max over agents) from episode\t704:\t0.09\tAverage Score:\t0.0585\ttime:\t0:00:00.258312\tactions:\t30\tNoise:\t0.14657\t26672\n",
      "Score (max over agents) from episode\t706:\t0.09\tAverage Score:\t0.0575\ttime:\t0:00:00.251339\tactions:\t30\tNoise:\t0.14599\t26762\n",
      "Score (max over agents) from episode\t707:\t0.09\tAverage Score:\t0.0575\ttime:\t0:00:00.236370\tactions:\t31\tNoise:\t0.14569\t26824\n",
      "Score (max over agents) from episode\t708:\t0.09\tAverage Score:\t0.0575\ttime:\t0:00:00.243352\tactions:\t31\tNoise:\t0.14540\t26886\n",
      "Score (max over agents) from episode\t709:\t0.09\tAverage Score:\t0.0584\ttime:\t0:00:00.248359\tactions:\t31\tNoise:\t0.14511\t26948\n",
      "Score (max over agents) from episode\t710:\t0.09\tAverage Score:\t0.0584\ttime:\t0:00:00.273273\tactions:\t31\tNoise:\t0.14482\t27010\n",
      "Score (max over agents) from episode\t712:\t0.10\tAverage Score:\t0.0576\ttime:\t0:00:00.257822\tactions:\t32\tNoise:\t0.14424\t27102\n",
      "Score (max over agents) from episode\t713:\t0.10\tAverage Score:\t0.0576\ttime:\t0:00:00.236370\tactions:\t29\tNoise:\t0.14396\t27160\n",
      "Score (max over agents) from episode\t719:\t0.10\tAverage Score:\t0.0539\ttime:\t0:00:00.250332\tactions:\t32\tNoise:\t0.14224\t27362\n",
      "Score (max over agents) from episode\t720:\t0.00\tAverage Score:\t0.0529\ttime:\t0:00:00.188498\tactions:\t14\tNoise:\t0.14195\t27390\n",
      "Score (max over agents) from episode\t721:\t0.10\tAverage Score:\t0.0529\ttime:\t0:00:00.248858\tactions:\t28\tNoise:\t0.14167\t27446\n",
      "Score (max over agents) from episode\t722:\t0.10\tAverage Score:\t0.0529\ttime:\t0:00:00.245887\tactions:\t31\tNoise:\t0.14138\t27508\n",
      "Score (max over agents) from episode\t724:\t0.10\tAverage Score:\t0.0519\ttime:\t0:00:00.324455\tactions:\t52\tNoise:\t0.14082\t27640\n",
      "Score (max over agents) from episode\t726:\t0.10\tAverage Score:\t0.0510\ttime:\t0:00:00.249845\tactions:\t31\tNoise:\t0.14026\t27730\n",
      "Score (max over agents) from episode\t730:\t0.00\tAverage Score:\t0.0491\ttime:\t0:00:00.203458\tactions:\t14\tNoise:\t0.13914\t27844\n",
      "Score (max over agents) from episode\t733:\t0.09\tAverage Score:\t0.0491\ttime:\t0:00:00.236371\tactions:\t31\tNoise:\t0.13831\t27962\n",
      "Score (max over agents) from episode\t737:\t0.10\tAverage Score:\t0.0481\ttime:\t0:00:00.260325\tactions:\t30\tNoise:\t0.13720\t28106\n",
      "Score (max over agents) from episode\t738:\t0.10\tAverage Score:\t0.0481\ttime:\t0:00:00.271278\tactions:\t31\tNoise:\t0.13693\t28168\n",
      "Score (max over agents) from episode\t739:\t0.10\tAverage Score:\t0.0481\ttime:\t0:00:00.245977\tactions:\t31\tNoise:\t0.13665\t28230\n",
      "Score (max over agents) from episode\t740:\t0.09\tAverage Score:\t0.0490\ttime:\t0:00:00.242374\tactions:\t30\tNoise:\t0.13638\t28290\n",
      "Score (max over agents) from episode\t741:\t0.09\tAverage Score:\t0.0489\ttime:\t0:00:00.258311\tactions:\t32\tNoise:\t0.13611\t28354\n",
      "Score (max over agents) from episode\t745:\t0.09\tAverage Score:\t0.0498\ttime:\t0:00:00.230386\tactions:\t30\tNoise:\t0.13502\t28498\n",
      "Score (max over agents) from episode\t746:\t0.09\tAverage Score:\t0.0507\ttime:\t0:00:00.244348\tactions:\t32\tNoise:\t0.13475\t28562\n",
      "Score (max over agents) from episode\t747:\t0.09\tAverage Score:\t0.0516\ttime:\t0:00:00.248885\tactions:\t31\tNoise:\t0.13448\t28624\n",
      "Score (max over agents) from episode\t749:\t0.09\tAverage Score:\t0.0525\ttime:\t0:00:00.264296\tactions:\t31\tNoise:\t0.13395\t28714\n",
      "Score (max over agents) from episode\t750:\t0.10\tAverage Score:\t0.0515\ttime:\t0:00:00.321334\tactions:\t50\tNoise:\t0.13368\t28814\n",
      "Score (max over agents) from episode\t751:\t0.10\tAverage Score:\t0.0516\ttime:\t0:00:00.248169\tactions:\t31\tNoise:\t0.13341\t28876\n",
      "Score (max over agents) from episode\t753:\t0.10\tAverage Score:\t0.0526\ttime:\t0:00:00.254323\tactions:\t32\tNoise:\t0.13288\t28970\n",
      "Score (max over agents) from episode\t754:\t0.10\tAverage Score:\t0.0536\ttime:\t0:00:00.245346\tactions:\t32\tNoise:\t0.13261\t29034\n",
      "Score (max over agents) from episode\t755:\t0.10\tAverage Score:\t0.0536\ttime:\t0:00:00.269284\tactions:\t32\tNoise:\t0.13235\t29098\n",
      "Score (max over agents) from episode\t759:\t0.10\tAverage Score:\t0.0546\ttime:\t0:00:00.259310\tactions:\t31\tNoise:\t0.13129\t29244\n",
      "Score (max over agents) from episode\t760:\t0.10\tAverage Score:\t0.0556\ttime:\t0:00:00.268286\tactions:\t30\tNoise:\t0.13103\t29304\n",
      "Score (max over agents) from episode\t761:\t0.10\tAverage Score:\t0.0566\ttime:\t0:00:00.273780\tactions:\t30\tNoise:\t0.13077\t29364\n",
      "Score (max over agents) from episode\t763:\t0.10\tAverage Score:\t0.0576\ttime:\t0:00:00.323139\tactions:\t53\tNoise:\t0.13024\t29498\n",
      "Score (max over agents) from episode\t764:\t0.10\tAverage Score:\t0.0586\ttime:\t0:00:00.237369\tactions:\t30\tNoise:\t0.12998\t29558\n",
      "Score (max over agents) from episode\t767:\t0.20\tAverage Score:\t0.0606\ttime:\t0:00:00.375998\tactions:\t71\tNoise:\t0.12920\t29756\n",
      "Score (max over agents) from episode\t768:\t0.10\tAverage Score:\t0.0606\ttime:\t0:00:00.232808\tactions:\t30\tNoise:\t0.12895\t29816\n",
      "Score (max over agents) from episode\t769:\t0.10\tAverage Score:\t0.0606\ttime:\t0:00:00.250842\tactions:\t31\tNoise:\t0.12869\t29878\n",
      "Score (max over agents) from episode\t770:\t0.20\tAverage Score:\t0.0616\ttime:\t0:00:00.435840\tactions:\t89\tNoise:\t0.12843\t30056\n",
      "Score (max over agents) from episode\t771:\t0.20\tAverage Score:\t0.0627\ttime:\t0:00:00.394973\tactions:\t72\tNoise:\t0.12817\t30200\n",
      "Score (max over agents) from episode\t772:\t0.10\tAverage Score:\t0.0627\ttime:\t0:00:00.318153\tactions:\t52\tNoise:\t0.12792\t30304\n",
      "Score (max over agents) from episode\t773:\t0.10\tAverage Score:\t0.0637\ttime:\t0:00:00.260307\tactions:\t32\tNoise:\t0.12766\t30368\n",
      "Score (max over agents) from episode\t774:\t0.10\tAverage Score:\t0.0637\ttime:\t0:00:00.267921\tactions:\t31\tNoise:\t0.12741\t30430\n",
      "Score (max over agents) from episode\t777:\t0.10\tAverage Score:\t0.0629\ttime:\t0:00:00.250842\tactions:\t30\tNoise:\t0.12664\t30546\n",
      "Score (max over agents) from episode\t780:\t0.10\tAverage Score:\t0.0611\ttime:\t0:00:00.241825\tactions:\t31\tNoise:\t0.12588\t30662\n",
      "Score (max over agents) from episode\t781:\t0.10\tAverage Score:\t0.0611\ttime:\t0:00:00.238365\tactions:\t30\tNoise:\t0.12563\t30722\n",
      "Score (max over agents) from episode\t785:\t0.10\tAverage Score:\t0.0593\ttime:\t0:00:00.305187\tactions:\t53\tNoise:\t0.12463\t30912\n",
      "Score (max over agents) from episode\t786:\t0.10\tAverage Score:\t0.0594\ttime:\t0:00:00.224911\tactions:\t27\tNoise:\t0.12438\t30966\n",
      "Score (max over agents) from episode\t788:\t0.10\tAverage Score:\t0.0584\ttime:\t0:00:00.343113\tactions:\t50\tNoise:\t0.12388\t31094\n",
      "Score (max over agents) from episode\t790:\t0.09\tAverage Score:\t0.0573\ttime:\t0:00:00.251330\tactions:\t32\tNoise:\t0.12339\t31186\n",
      "Score (max over agents) from episode\t791:\t0.09\tAverage Score:\t0.0572\ttime:\t0:00:00.239869\tactions:\t31\tNoise:\t0.12314\t31248\n",
      "Score (max over agents) from episode\t792:\t0.10\tAverage Score:\t0.0573\ttime:\t0:00:00.318153\tactions:\t50\tNoise:\t0.12290\t31348\n",
      "Score (max over agents) from episode\t793:\t0.09\tAverage Score:\t0.0582\ttime:\t0:00:00.258313\tactions:\t31\tNoise:\t0.12265\t31410\n",
      "Score (max over agents) from episode\t794:\t0.10\tAverage Score:\t0.0592\ttime:\t0:00:00.273786\tactions:\t32\tNoise:\t0.12241\t31474\n",
      "Score (max over agents) from episode\t796:\t0.10\tAverage Score:\t0.0592\ttime:\t0:00:00.316707\tactions:\t51\tNoise:\t0.12192\t31604\n",
      "Score (max over agents) from episode\t798:\t0.10\tAverage Score:\t0.0583\ttime:\t0:00:00.326157\tactions:\t50\tNoise:\t0.12143\t31732\n",
      "Score (max over agents) from episode\t799:\t0.10\tAverage Score:\t0.0583\ttime:\t0:00:00.378056\tactions:\t51\tNoise:\t0.12119\t31834\n",
      "Score (max over agents) from episode\t800:\t0.09\tAverage Score:\t0.0582\ttime:\t0:00:00.270974\tactions:\t31\tNoise:\t0.12094\t31896\n",
      "Score (max over agents) from episode\t801:\t0.20\tAverage Score:\t0.0602\ttime:\t0:00:00.460304\tactions:\t90\tNoise:\t0.12070\t32076\n",
      "Score (max over agents) from episode\t803:\t0.10\tAverage Score:\t0.0603\ttime:\t0:00:00.336125\tactions:\t51\tNoise:\t0.12022\t32206\n",
      "Score (max over agents) from episode\t805:\t0.10\tAverage Score:\t0.0604\ttime:\t0:00:00.323649\tactions:\t53\tNoise:\t0.11974\t32342\n",
      "Score (max over agents) from episode\t807:\t0.10\tAverage Score:\t0.0596\ttime:\t0:00:00.256317\tactions:\t33\tNoise:\t0.11926\t32436\n",
      "Score (max over agents) from episode\t809:\t0.10\tAverage Score:\t0.0588\ttime:\t0:00:00.266800\tactions:\t32\tNoise:\t0.11878\t32528\n",
      "Score (max over agents) from episode\t810:\t0.00\tAverage Score:\t0.0579\ttime:\t0:00:00.260834\tactions:\t33\tNoise:\t0.11855\t32594\n",
      "Score (max over agents) from episode\t813:\t0.09\tAverage Score:\t0.0568\ttime:\t0:00:00.247412\tactions:\t31\tNoise:\t0.11784\t32722\n",
      "Score (max over agents) from episode\t814:\t0.20\tAverage Score:\t0.0588\ttime:\t0:00:00.373176\tactions:\t70\tNoise:\t0.11760\t32862\n",
      "Score (max over agents) from episode\t815:\t0.09\tAverage Score:\t0.0597\ttime:\t0:00:00.268286\tactions:\t32\tNoise:\t0.11737\t32926\n",
      "Score (max over agents) from episode\t816:\t0.10\tAverage Score:\t0.0607\ttime:\t0:00:00.331118\tactions:\t52\tNoise:\t0.11713\t33030\n",
      "Score (max over agents) from episode\t817:\t0.19\tAverage Score:\t0.0626\ttime:\t0:00:00.381004\tactions:\t63\tNoise:\t0.11690\t33156\n",
      "Score (max over agents) from episode\t819:\t0.10\tAverage Score:\t0.0626\ttime:\t0:00:00.345081\tactions:\t56\tNoise:\t0.11643\t33296\n",
      "Score (max over agents) from episode\t820:\t0.10\tAverage Score:\t0.0636\ttime:\t0:00:00.340779\tactions:\t54\tNoise:\t0.11620\t33404\n",
      "Score (max over agents) from episode\t830:\t0.00\tAverage Score:\t0.0596\ttime:\t0:00:00.181515\tactions:\t14\tNoise:\t0.11389\t33688\n",
      "Score (max over agents) from episode\t833:\t0.10\tAverage Score:\t0.0597\ttime:\t0:00:00.338648\tactions:\t54\tNoise:\t0.11321\t33852\n",
      "Score (max over agents) from episode\t835:\t0.10\tAverage Score:\t0.0607\ttime:\t0:00:00.294910\tactions:\t45\tNoise:\t0.11276\t33968\n",
      "Score (max over agents) from episode\t836:\t0.10\tAverage Score:\t0.0617\ttime:\t0:00:00.245364\tactions:\t32\tNoise:\t0.11253\t34032\n",
      "Score (max over agents) from episode\t840:\t0.00\tAverage Score:\t0.0578\ttime:\t0:00:00.198469\tactions:\t14\tNoise:\t0.11164\t34142\n",
      "Score (max over agents) from episode\t842:\t0.10\tAverage Score:\t0.0579\ttime:\t0:00:00.255320\tactions:\t31\tNoise:\t0.11119\t34232\n",
      "Score (max over agents) from episode\t843:\t0.10\tAverage Score:\t0.0589\ttime:\t0:00:00.239363\tactions:\t30\tNoise:\t0.11097\t34292\n",
      "Score (max over agents) from episode\t844:\t0.10\tAverage Score:\t0.0599\ttime:\t0:00:00.255320\tactions:\t31\tNoise:\t0.11075\t34354\n",
      "Score (max over agents) from episode\t850:\t0.09\tAverage Score:\t0.0562\ttime:\t0:00:00.242373\tactions:\t31\tNoise:\t0.10942\t34552\n",
      "Score (max over agents) from episode\t853:\t0.09\tAverage Score:\t0.0551\ttime:\t0:00:00.261305\tactions:\t31\tNoise:\t0.10877\t34668\n",
      "Score (max over agents) from episode\t854:\t0.10\tAverage Score:\t0.0551\ttime:\t0:00:00.245345\tactions:\t31\tNoise:\t0.10855\t34730\n",
      "Score (max over agents) from episode\t855:\t0.10\tAverage Score:\t0.0551\ttime:\t0:00:00.310174\tactions:\t49\tNoise:\t0.10833\t34828\n",
      "Score (max over agents) from episode\t856:\t0.10\tAverage Score:\t0.0561\ttime:\t0:00:00.244854\tactions:\t30\tNoise:\t0.10812\t34888\n",
      "Score (max over agents) from episode\t857:\t0.09\tAverage Score:\t0.0570\ttime:\t0:00:00.253834\tactions:\t31\tNoise:\t0.10790\t34950\n",
      "Score (max over agents) from episode\t858:\t0.10\tAverage Score:\t0.0580\ttime:\t0:00:00.272275\tactions:\t30\tNoise:\t0.10769\t35010\n",
      "Score (max over agents) from episode\t859:\t0.10\tAverage Score:\t0.0580\ttime:\t0:00:00.267817\tactions:\t30\tNoise:\t0.10747\t35070\n",
      "Score (max over agents) from episode\t860:\t0.09\tAverage Score:\t0.0579\ttime:\t0:00:00.249798\tactions:\t31\tNoise:\t0.10725\t35132\n",
      "Score (max over agents) from episode\t861:\t0.09\tAverage Score:\t0.0578\ttime:\t0:00:00.270309\tactions:\t30\tNoise:\t0.10704\t35192\n",
      "Score (max over agents) from episode\t862:\t0.09\tAverage Score:\t0.0587\ttime:\t0:00:00.247338\tactions:\t30\tNoise:\t0.10683\t35252\n",
      "Score (max over agents) from episode\t863:\t0.09\tAverage Score:\t0.0586\ttime:\t0:00:00.261323\tactions:\t31\tNoise:\t0.10661\t35314\n",
      "Score (max over agents) from episode\t864:\t0.10\tAverage Score:\t0.0586\ttime:\t0:00:00.281766\tactions:\t31\tNoise:\t0.10640\t35376\n",
      "Score (max over agents) from episode\t865:\t0.09\tAverage Score:\t0.0595\ttime:\t0:00:00.242054\tactions:\t29\tNoise:\t0.10619\t35434\n",
      "Score (max over agents) from episode\t868:\t0.70\tAverage Score:\t0.0635\ttime:\t0:00:00.949330\tactions:\t262\tNoise:\t0.10555\t36016\n",
      "Score (max over agents) from episode\t870:\t0.00\tAverage Score:\t0.0605\ttime:\t0:00:00.202461\tactions:\t14\tNoise:\t0.10513\t36072\n",
      "Score (max over agents) from episode\t871:\t0.10\tAverage Score:\t0.0595\ttime:\t0:00:00.321654\tactions:\t53\tNoise:\t0.10492\t36178\n",
      "Score (max over agents) from episode\t873:\t0.10\tAverage Score:\t0.0585\ttime:\t0:00:00.349089\tactions:\t53\tNoise:\t0.10450\t36312\n",
      "Score (max over agents) from episode\t874:\t0.10\tAverage Score:\t0.0585\ttime:\t0:00:00.247086\tactions:\t32\tNoise:\t0.10429\t36376\n",
      "Score (max over agents) from episode\t878:\t0.10\tAverage Score:\t0.0585\ttime:\t0:00:00.314183\tactions:\t52\tNoise:\t0.10346\t36566\n",
      "Score (max over agents) from episode\t880:\t0.10\tAverage Score:\t0.0585\ttime:\t0:00:00.323140\tactions:\t52\tNoise:\t0.10305\t36698\n",
      "Score (max over agents) from episode\t881:\t0.20\tAverage Score:\t0.0595\ttime:\t0:00:00.418885\tactions:\t71\tNoise:\t0.10284\t36840\n",
      "Score (max over agents) from episode\t882:\t0.10\tAverage Score:\t0.0605\ttime:\t0:00:00.329632\tactions:\t55\tNoise:\t0.10263\t36950\n",
      "Score (max over agents) from episode\t884:\t0.10\tAverage Score:\t0.0615\ttime:\t0:00:00.325644\tactions:\t52\tNoise:\t0.10222\t37082\n",
      "Score (max over agents) from episode\t885:\t0.09\tAverage Score:\t0.0614\ttime:\t0:00:00.245857\tactions:\t32\tNoise:\t0.10202\t37146\n",
      "Score (max over agents) from episode\t887:\t0.10\tAverage Score:\t0.0614\ttime:\t0:00:00.248358\tactions:\t30\tNoise:\t0.10161\t37234\n",
      "Score (max over agents) from episode\t890:\t0.00\tAverage Score:\t0.0595\ttime:\t0:00:00.193485\tactions:\t13\tNoise:\t0.10100\t37316\n",
      "Score (max over agents) from episode\t893:\t0.10\tAverage Score:\t0.0577\ttime:\t0:00:00.236543\tactions:\t31\tNoise:\t0.10040\t37472\n",
      "Score (max over agents) from episode\t894:\t0.20\tAverage Score:\t0.0587\ttime:\t0:00:00.444836\tactions:\t90\tNoise:\t0.10020\t37652\n",
      "Score (max over agents) from episode\t896:\t0.10\tAverage Score:\t0.0587\ttime:\t0:00:00.320183\tactions:\t52\tNoise:\t0.09980\t37784\n",
      "Score (max over agents) from episode\t897:\t0.10\tAverage Score:\t0.0597\ttime:\t0:00:00.245874\tactions:\t31\tNoise:\t0.09960\t37846\n",
      "Score (max over agents) from episode\t898:\t0.09\tAverage Score:\t0.0596\ttime:\t0:00:00.282756\tactions:\t30\tNoise:\t0.09940\t37906\n",
      "Score (max over agents) from episode\t899:\t0.10\tAverage Score:\t0.0596\ttime:\t0:00:00.338607\tactions:\t52\tNoise:\t0.09920\t38010\n",
      "Score (max over agents) from episode\t900:\t0.09\tAverage Score:\t0.0596\ttime:\t0:00:00.252328\tactions:\t30\tNoise:\t0.09900\t38070\n",
      "Score (max over agents) from episode\t901:\t0.09\tAverage Score:\t0.0585\ttime:\t0:00:00.258263\tactions:\t31\tNoise:\t0.09880\t38132\n",
      "Score (max over agents) from episode\t902:\t0.10\tAverage Score:\t0.0595\ttime:\t0:00:00.317667\tactions:\t48\tNoise:\t0.09861\t38228\n",
      "Score (max over agents) from episode\t905:\t0.09\tAverage Score:\t0.0584\ttime:\t0:00:00.260324\tactions:\t30\tNoise:\t0.09801\t38344\n",
      "Score (max over agents) from episode\t906:\t0.09\tAverage Score:\t0.0593\ttime:\t0:00:00.256375\tactions:\t32\tNoise:\t0.09782\t38408\n",
      "Score (max over agents) from episode\t907:\t0.09\tAverage Score:\t0.0592\ttime:\t0:00:00.249355\tactions:\t30\tNoise:\t0.09762\t38468\n",
      "Score (max over agents) from episode\t908:\t0.10\tAverage Score:\t0.0602\ttime:\t0:00:00.269176\tactions:\t31\tNoise:\t0.09743\t38530\n",
      "Score (max over agents) from episode\t909:\t0.10\tAverage Score:\t0.0602\ttime:\t0:00:00.342088\tactions:\t52\tNoise:\t0.09723\t38634\n",
      "Score (max over agents) from episode\t910:\t0.10\tAverage Score:\t0.0612\ttime:\t0:00:00.337102\tactions:\t52\tNoise:\t0.09704\t38738\n",
      "Score (max over agents) from episode\t911:\t0.09\tAverage Score:\t0.0621\ttime:\t0:00:00.244348\tactions:\t30\tNoise:\t0.09684\t38798\n",
      "Score (max over agents) from episode\t912:\t0.20\tAverage Score:\t0.0641\ttime:\t0:00:00.396504\tactions:\t72\tNoise:\t0.09665\t38942\n",
      "Score (max over agents) from episode\t913:\t0.10\tAverage Score:\t0.0642\ttime:\t0:00:00.235374\tactions:\t30\tNoise:\t0.09646\t39002\n",
      "Score (max over agents) from episode\t914:\t0.10\tAverage Score:\t0.0632\ttime:\t0:00:00.253833\tactions:\t30\tNoise:\t0.09626\t39062\n",
      "Score (max over agents) from episode\t915:\t0.09\tAverage Score:\t0.0632\ttime:\t0:00:00.275804\tactions:\t32\tNoise:\t0.09607\t39126\n",
      "Score (max over agents) from episode\t916:\t0.09\tAverage Score:\t0.0631\ttime:\t0:00:00.255829\tactions:\t30\tNoise:\t0.09588\t39186\n",
      "Score (max over agents) from episode\t917:\t0.10\tAverage Score:\t0.0622\ttime:\t0:00:00.252315\tactions:\t30\tNoise:\t0.09569\t39246\n",
      "Score (max over agents) from episode\t918:\t0.10\tAverage Score:\t0.0632\ttime:\t0:00:00.251063\tactions:\t31\tNoise:\t0.09550\t39308\n",
      "Score (max over agents) from episode\t919:\t0.10\tAverage Score:\t0.0632\ttime:\t0:00:00.336105\tactions:\t52\tNoise:\t0.09531\t39412\n",
      "Score (max over agents) from episode\t920:\t0.09\tAverage Score:\t0.0631\ttime:\t0:00:00.261304\tactions:\t31\tNoise:\t0.09512\t39474\n",
      "Score (max over agents) from episode\t921:\t0.10\tAverage Score:\t0.0641\ttime:\t0:00:00.258312\tactions:\t30\tNoise:\t0.09492\t39534\n",
      "Score (max over agents) from episode\t922:\t0.10\tAverage Score:\t0.0651\ttime:\t0:00:00.260307\tactions:\t31\tNoise:\t0.09473\t39596\n",
      "Score (max over agents) from episode\t923:\t0.10\tAverage Score:\t0.0661\ttime:\t0:00:00.251331\tactions:\t30\tNoise:\t0.09455\t39656\n",
      "Score (max over agents) from episode\t924:\t0.09\tAverage Score:\t0.0670\ttime:\t0:00:00.253325\tactions:\t31\tNoise:\t0.09436\t39718\n",
      "Score (max over agents) from episode\t925:\t0.09\tAverage Score:\t0.0679\ttime:\t0:00:00.256339\tactions:\t29\tNoise:\t0.09417\t39776\n",
      "Score (max over agents) from episode\t926:\t0.20\tAverage Score:\t0.0699\ttime:\t0:00:00.405431\tactions:\t71\tNoise:\t0.09398\t39918\n",
      "Score (max over agents) from episode\t927:\t0.10\tAverage Score:\t0.0709\ttime:\t0:00:00.245352\tactions:\t31\tNoise:\t0.09379\t39980\n",
      "Score (max over agents) from episode\t928:\t0.20\tAverage Score:\t0.0729\ttime:\t0:00:00.384684\tactions:\t71\tNoise:\t0.09360\t40122\n",
      "Score (max over agents) from episode\t929:\t0.09\tAverage Score:\t0.0738\ttime:\t0:00:00.237286\tactions:\t30\tNoise:\t0.09342\t40182\n",
      "Score (max over agents) from episode\t930:\t0.10\tAverage Score:\t0.0748\ttime:\t0:00:00.269283\tactions:\t30\tNoise:\t0.09323\t40242\n",
      "Score (max over agents) from episode\t931:\t0.10\tAverage Score:\t0.0758\ttime:\t0:00:00.261340\tactions:\t30\tNoise:\t0.09304\t40302\n",
      "Score (max over agents) from episode\t932:\t0.10\tAverage Score:\t0.0768\ttime:\t0:00:00.245611\tactions:\t30\tNoise:\t0.09286\t40362\n",
      "Score (max over agents) from episode\t933:\t0.10\tAverage Score:\t0.0768\ttime:\t0:00:00.249337\tactions:\t31\tNoise:\t0.09267\t40424\n",
      "Score (max over agents) from episode\t935:\t0.10\tAverage Score:\t0.0768\ttime:\t0:00:00.274270\tactions:\t32\tNoise:\t0.09230\t40516\n",
      "Score (max over agents) from episode\t936:\t0.09\tAverage Score:\t0.0767\ttime:\t0:00:00.261303\tactions:\t31\tNoise:\t0.09212\t40578\n",
      "Score (max over agents) from episode\t938:\t0.09\tAverage Score:\t0.0776\ttime:\t0:00:00.256572\tactions:\t32\tNoise:\t0.09175\t40670\n",
      "Score (max over agents) from episode\t939:\t0.09\tAverage Score:\t0.0785\ttime:\t0:00:00.240397\tactions:\t30\tNoise:\t0.09157\t40730\n",
      "Score (max over agents) from episode\t940:\t0.00\tAverage Score:\t0.0785\ttime:\t0:00:00.197016\tactions:\t14\tNoise:\t0.09138\t40758\n",
      "Score (max over agents) from episode\t942:\t0.10\tAverage Score:\t0.0785\ttime:\t0:00:00.343631\tactions:\t52\tNoise:\t0.09102\t40892\n",
      "Score (max over agents) from episode\t943:\t0.09\tAverage Score:\t0.0784\ttime:\t0:00:00.244134\tactions:\t29\tNoise:\t0.09083\t40950\n",
      "Score (max over agents) from episode\t944:\t0.10\tAverage Score:\t0.0784\ttime:\t0:00:00.256338\tactions:\t30\tNoise:\t0.09065\t41010\n",
      "Score (max over agents) from episode\t945:\t0.10\tAverage Score:\t0.0794\ttime:\t0:00:00.326131\tactions:\t52\tNoise:\t0.09047\t41114\n",
      "Score (max over agents) from episode\t946:\t0.10\tAverage Score:\t0.0804\ttime:\t0:00:00.328125\tactions:\t52\tNoise:\t0.09029\t41218\n",
      "Score (max over agents) from episode\t947:\t0.09\tAverage Score:\t0.0813\ttime:\t0:00:00.269282\tactions:\t32\tNoise:\t0.09011\t41282\n",
      "Score (max over agents) from episode\t948:\t0.09\tAverage Score:\t0.0822\ttime:\t0:00:00.261813\tactions:\t31\tNoise:\t0.08993\t41344\n",
      "Score (max over agents) from episode\t949:\t0.10\tAverage Score:\t0.0832\ttime:\t0:00:00.338401\tactions:\t52\tNoise:\t0.08975\t41448\n",
      "Score (max over agents) from episode\t950:\t0.09\tAverage Score:\t0.0832\ttime:\t0:00:00.248744\tactions:\t31\tNoise:\t0.08957\t41510\n",
      "Score (max over agents) from episode\t952:\t0.09\tAverage Score:\t0.0841\ttime:\t0:00:00.301198\tactions:\t32\tNoise:\t0.08921\t41602\n",
      "Score (max over agents) from episode\t953:\t0.09\tAverage Score:\t0.0841\ttime:\t0:00:00.262327\tactions:\t32\tNoise:\t0.08903\t41666\n",
      "Score (max over agents) from episode\t955:\t0.10\tAverage Score:\t0.0831\ttime:\t0:00:00.332215\tactions:\t53\tNoise:\t0.08868\t41800\n",
      "Score (max over agents) from episode\t956:\t0.09\tAverage Score:\t0.0830\ttime:\t0:00:00.241357\tactions:\t31\tNoise:\t0.08850\t41862\n",
      "Score (max over agents) from episode\t957:\t0.20\tAverage Score:\t0.0841\ttime:\t0:00:00.471787\tactions:\t90\tNoise:\t0.08832\t42042\n",
      "Score (max over agents) from episode\t958:\t0.20\tAverage Score:\t0.0851\ttime:\t0:00:00.375999\tactions:\t72\tNoise:\t0.08815\t42186\n",
      "Score (max over agents) from episode\t959:\t0.09\tAverage Score:\t0.0850\ttime:\t0:00:00.239363\tactions:\t31\tNoise:\t0.08797\t42248\n",
      "Score (max over agents) from episode\t960:\t0.10\tAverage Score:\t0.0851\ttime:\t0:00:00.334892\tactions:\t52\tNoise:\t0.08780\t42352\n",
      "Score (max over agents) from episode\t961:\t0.20\tAverage Score:\t0.0862\ttime:\t0:00:00.462794\tactions:\t90\tNoise:\t0.08762\t42532\n",
      "Score (max over agents) from episode\t962:\t0.10\tAverage Score:\t0.0863\ttime:\t0:00:00.322498\tactions:\t52\tNoise:\t0.08744\t42636\n",
      "Score (max over agents) from episode\t963:\t0.10\tAverage Score:\t0.0864\ttime:\t0:00:00.306763\tactions:\t45\tNoise:\t0.08727\t42726\n",
      "Score (max over agents) from episode\t964:\t0.09\tAverage Score:\t0.0863\ttime:\t0:00:00.243373\tactions:\t30\tNoise:\t0.08709\t42786\n",
      "Score (max over agents) from episode\t965:\t0.10\tAverage Score:\t0.0864\ttime:\t0:00:00.328659\tactions:\t52\tNoise:\t0.08692\t42890\n",
      "Score (max over agents) from episode\t966:\t0.30\tAverage Score:\t0.0894\ttime:\t0:00:00.563508\tactions:\t126\tNoise:\t0.08675\t43142\n",
      "Score (max over agents) from episode\t967:\t1.40\tAverage Score:\t0.1034\ttime:\t0:00:01.780737\tactions:\t551\tNoise:\t0.08657\t44244\n",
      "Score (max over agents) from episode\t968:\t0.30\tAverage Score:\t0.0994\ttime:\t0:00:00.562503\tactions:\t130\tNoise:\t0.08640\t44504\n",
      "Score (max over agents) from episode\t969:\t0.10\tAverage Score:\t0.1004\ttime:\t0:00:00.262494\tactions:\t30\tNoise:\t0.08623\t44564\n",
      "Score (max over agents) from episode\t970:\t0.10\tAverage Score:\t0.1014\ttime:\t0:00:00.251332\tactions:\t31\tNoise:\t0.08606\t44626\n",
      "Score (max over agents) from episode\t971:\t0.10\tAverage Score:\t0.1014\ttime:\t0:00:00.259263\tactions:\t31\tNoise:\t0.08588\t44688\n",
      "Score (max over agents) from episode\t972:\t0.09\tAverage Score:\t0.1023\ttime:\t0:00:00.261012\tactions:\t30\tNoise:\t0.08571\t44748\n",
      "Score (max over agents) from episode\t973:\t0.19\tAverage Score:\t0.1032\ttime:\t0:00:00.405429\tactions:\t70\tNoise:\t0.08554\t44888\n",
      "Score (max over agents) from episode\t974:\t0.09\tAverage Score:\t0.1031\ttime:\t0:00:00.254850\tactions:\t30\tNoise:\t0.08537\t44948\n",
      "Score (max over agents) from episode\t975:\t0.09\tAverage Score:\t0.1040\ttime:\t0:00:00.247124\tactions:\t30\tNoise:\t0.08520\t45008\n",
      "Score (max over agents) from episode\t978:\t0.09\tAverage Score:\t0.1039\ttime:\t0:00:00.243860\tactions:\t30\tNoise:\t0.08469\t45126\n",
      "Score (max over agents) from episode\t980:\t0.10\tAverage Score:\t0.1039\ttime:\t0:00:00.262392\tactions:\t30\tNoise:\t0.08435\t45214\n",
      "Score (max over agents) from episode\t981:\t0.09\tAverage Score:\t0.1028\ttime:\t0:00:00.249782\tactions:\t31\tNoise:\t0.08418\t45276\n",
      "Score (max over agents) from episode\t982:\t0.10\tAverage Score:\t0.1028\ttime:\t0:00:00.243879\tactions:\t29\tNoise:\t0.08401\t45334\n",
      "Score (max over agents) from episode\t983:\t0.20\tAverage Score:\t0.1048\ttime:\t0:00:00.375999\tactions:\t69\tNoise:\t0.08384\t45472\n",
      "Score (max over agents) from episode\t984:\t0.10\tAverage Score:\t0.1048\ttime:\t0:00:00.285747\tactions:\t31\tNoise:\t0.08368\t45534\n",
      "Score (max over agents) from episode\t985:\t0.09\tAverage Score:\t0.1048\ttime:\t0:00:00.277280\tactions:\t31\tNoise:\t0.08351\t45596\n",
      "Score (max over agents) from episode\t986:\t1.80\tAverage Score:\t0.1228\ttime:\t0:00:02.104758\tactions:\t678\tNoise:\t0.08334\t46952\n",
      "Score (max over agents) from episode\t987:\t2.30\tAverage Score:\t0.1448\ttime:\t0:00:02.881178\tactions:\t891\tNoise:\t0.08318\t48734\n",
      "Score (max over agents) from episode\t988:\t0.20\tAverage Score:\t0.1468\ttime:\t0:00:00.471706\tactions:\t90\tNoise:\t0.08301\t48914\n",
      "Score (max over agents) from episode\t989:\t1.00\tAverage Score:\t0.1568\ttime:\t0:00:01.515346\tactions:\t395\tNoise:\t0.08284\t49704\n",
      "Score (max over agents) from episode\t990:\t0.10\tAverage Score:\t0.1578\ttime:\t0:00:00.322596\tactions:\t51\tNoise:\t0.08268\t49806\n",
      "Score (max over agents) from episode\t991:\t1.10\tAverage Score:\t0.1688\ttime:\t0:00:01.444792\tactions:\t433\tNoise:\t0.08251\t50000\n",
      "Score (max over agents) from episode\t992:\t0.10\tAverage Score:\t0.1698\ttime:\t0:00:00.315669\tactions:\t53\tNoise:\t0.08235\t50000\n",
      "Score (max over agents) from episode\t993:\t0.30\tAverage Score:\t0.1718\ttime:\t0:00:00.508227\tactions:\t107\tNoise:\t0.08218\t50000\n",
      "Score (max over agents) from episode\t994:\t0.10\tAverage Score:\t0.1708\ttime:\t0:00:00.394791\tactions:\t51\tNoise:\t0.08202\t50000\n",
      "Score (max over agents) from episode\t995:\t0.10\tAverage Score:\t0.1718\ttime:\t0:00:00.351066\tactions:\t52\tNoise:\t0.08185\t50000\n",
      "Score (max over agents) from episode\t997:\t0.09\tAverage Score:\t0.1707\ttime:\t0:00:00.253771\tactions:\t31\tNoise:\t0.08153\t50000\n",
      "Score (max over agents) from episode\t998:\t0.09\tAverage Score:\t0.1707\ttime:\t0:00:00.250483\tactions:\t32\tNoise:\t0.08136\t50000\n",
      "Score (max over agents) from episode\t999:\t0.30\tAverage Score:\t0.1727\ttime:\t0:00:00.517131\tactions:\t105\tNoise:\t0.08120\t50000\n",
      "Score (max over agents) from episode\t1000:\t0.00\tAverage Score:\t0.1718\ttime:\t0:00:00.176043\tactions:\t13\tNoise:\t0.08104\t50000\n",
      "Score (max over agents) from episode\t1001:\t0.20\tAverage Score:\t0.1729\ttime:\t0:00:00.420906\tactions:\t89\tNoise:\t0.08088\t50000\n",
      "Score (max over agents) from episode\t1002:\t0.20\tAverage Score:\t0.1739\ttime:\t0:00:00.434352\tactions:\t88\tNoise:\t0.08071\t50000\n",
      "Score (max over agents) from episode\t1004:\t0.10\tAverage Score:\t0.1749\ttime:\t0:00:00.279263\tactions:\t31\tNoise:\t0.08039\t50000\n",
      "Score (max over agents) from episode\t1007:\t0.10\tAverage Score:\t0.1732\ttime:\t0:00:00.459800\tactions:\t56\tNoise:\t0.07991\t50000\n",
      "Score (max over agents) from episode\t1009:\t0.10\tAverage Score:\t0.1722\ttime:\t0:00:00.269977\tactions:\t31\tNoise:\t0.07959\t50000\n",
      "Score (max over agents) from episode\t1010:\t0.10\tAverage Score:\t0.1722\ttime:\t0:00:00.241866\tactions:\t31\tNoise:\t0.07943\t50000\n",
      "Score (max over agents) from episode\t1011:\t0.10\tAverage Score:\t0.1723\ttime:\t0:00:00.236270\tactions:\t30\tNoise:\t0.07927\t50000\n",
      "Score (max over agents) from episode\t1012:\t0.09\tAverage Score:\t0.1712\ttime:\t0:00:00.241904\tactions:\t29\tNoise:\t0.07912\t50000\n",
      "Score (max over agents) from episode\t1015:\t0.10\tAverage Score:\t0.1693\ttime:\t0:00:00.235373\tactions:\t29\tNoise:\t0.07864\t50000\n",
      "Score (max over agents) from episode\t1016:\t0.09\tAverage Score:\t0.1693\ttime:\t0:00:00.245346\tactions:\t30\tNoise:\t0.07848\t50000\n",
      "Score (max over agents) from episode\t1020:\t0.00\tAverage Score:\t0.1654\ttime:\t0:00:00.252857\tactions:\t32\tNoise:\t0.07786\t50000\n",
      "Score (max over agents) from episode\t1021:\t0.09\tAverage Score:\t0.1653\ttime:\t0:00:00.252598\tactions:\t30\tNoise:\t0.07770\t50000\n",
      "Score (max over agents) from episode\t1022:\t0.09\tAverage Score:\t0.1652\ttime:\t0:00:00.242000\tactions:\t30\tNoise:\t0.07755\t50000\n",
      "Score (max over agents) from episode\t1023:\t0.09\tAverage Score:\t0.1651\ttime:\t0:00:00.248339\tactions:\t32\tNoise:\t0.07739\t50000\n",
      "Score (max over agents) from episode\t1025:\t0.09\tAverage Score:\t0.1642\ttime:\t0:00:00.238873\tactions:\t30\tNoise:\t0.07708\t50000\n",
      "Score (max over agents) from episode\t1028:\t0.09\tAverage Score:\t0.1601\ttime:\t0:00:00.247343\tactions:\t30\tNoise:\t0.07662\t50000\n",
      "Score (max over agents) from episode\t1030:\t0.09\tAverage Score:\t0.1591\ttime:\t0:00:00.244857\tactions:\t31\tNoise:\t0.07631\t50000\n",
      "Score (max over agents) from episode\t1033:\t0.09\tAverage Score:\t0.1570\ttime:\t0:00:00.252329\tactions:\t30\tNoise:\t0.07586\t50000\n",
      "Score (max over agents) from episode\t1036:\t0.09\tAverage Score:\t0.1560\ttime:\t0:00:00.240359\tactions:\t31\tNoise:\t0.07540\t50000\n",
      "Score (max over agents) from episode\t1037:\t0.09\tAverage Score:\t0.1569\ttime:\t0:00:00.238366\tactions:\t31\tNoise:\t0.07525\t50000\n",
      "Score (max over agents) from episode\t1038:\t0.10\tAverage Score:\t0.1570\ttime:\t0:00:00.237876\tactions:\t29\tNoise:\t0.07510\t50000\n",
      "Score (max over agents) from episode\t1040:\t0.00\tAverage Score:\t0.1561\ttime:\t0:00:00.211437\tactions:\t14\tNoise:\t0.07480\t50000\n",
      "Score (max over agents) from episode\t1041:\t0.30\tAverage Score:\t0.1591\ttime:\t0:00:00.523116\tactions:\t127\tNoise:\t0.07465\t50000\n",
      "Score (max over agents) from episode\t1043:\t0.10\tAverage Score:\t0.1582\ttime:\t0:00:00.237368\tactions:\t30\tNoise:\t0.07435\t50000\n",
      "Score (max over agents) from episode\t1044:\t0.50\tAverage Score:\t0.1622\ttime:\t0:00:00.772273\tactions:\t203\tNoise:\t0.07421\t50000\n",
      "Score (max over agents) from episode\t1045:\t0.10\tAverage Score:\t0.1622\ttime:\t0:00:00.320658\tactions:\t54\tNoise:\t0.07406\t50000\n",
      "Score (max over agents) from episode\t1046:\t0.10\tAverage Score:\t0.1622\ttime:\t0:00:00.306184\tactions:\t51\tNoise:\t0.07391\t50000\n",
      "Score (max over agents) from episode\t1047:\t0.10\tAverage Score:\t0.1623\ttime:\t0:00:00.246344\tactions:\t31\tNoise:\t0.07376\t50000\n",
      "Score (max over agents) from episode\t1048:\t0.10\tAverage Score:\t0.1624\ttime:\t0:00:00.329187\tactions:\t50\tNoise:\t0.07361\t50000\n",
      "Score (max over agents) from episode\t1049:\t0.40\tAverage Score:\t0.1654\ttime:\t0:00:00.590621\tactions:\t146\tNoise:\t0.07347\t50000\n",
      "Score (max over agents) from episode\t1050:\t0.40\tAverage Score:\t0.1685\ttime:\t0:00:00.657761\tactions:\t170\tNoise:\t0.07332\t50000\n",
      "Score (max over agents) from episode\t1051:\t0.09\tAverage Score:\t0.1694\ttime:\t0:00:00.256834\tactions:\t32\tNoise:\t0.07317\t50000\n",
      "Score (max over agents) from episode\t1052:\t0.20\tAverage Score:\t0.1705\ttime:\t0:00:00.416891\tactions:\t90\tNoise:\t0.07303\t50000\n",
      "Score (max over agents) from episode\t1053:\t0.09\tAverage Score:\t0.1705\ttime:\t0:00:00.249335\tactions:\t32\tNoise:\t0.07288\t50000\n",
      "Score (max over agents) from episode\t1054:\t0.20\tAverage Score:\t0.1725\ttime:\t0:00:00.378521\tactions:\t71\tNoise:\t0.07273\t50000\n",
      "Score (max over agents) from episode\t1056:\t0.09\tAverage Score:\t0.1715\ttime:\t0:00:00.244857\tactions:\t31\tNoise:\t0.07244\t50000\n",
      "Score (max over agents) from episode\t1057:\t0.09\tAverage Score:\t0.1704\ttime:\t0:00:00.243860\tactions:\t31\tNoise:\t0.07230\t50000\n",
      "Score (max over agents) from episode\t1058:\t0.09\tAverage Score:\t0.1693\ttime:\t0:00:00.248339\tactions:\t32\tNoise:\t0.07215\t50000\n",
      "Score (max over agents) from episode\t1059:\t0.09\tAverage Score:\t0.1693\ttime:\t0:00:00.247343\tactions:\t31\tNoise:\t0.07201\t50000\n",
      "Score (max over agents) from episode\t1060:\t0.20\tAverage Score:\t0.1703\ttime:\t0:00:00.433863\tactions:\t87\tNoise:\t0.07187\t50000\n",
      "Score (max over agents) from episode\t1061:\t0.09\tAverage Score:\t0.1692\ttime:\t0:00:00.246343\tactions:\t31\tNoise:\t0.07172\t50000\n",
      "Score (max over agents) from episode\t1062:\t0.09\tAverage Score:\t0.1691\ttime:\t0:00:00.244859\tactions:\t31\tNoise:\t0.07158\t50000\n",
      "Score (max over agents) from episode\t1063:\t0.09\tAverage Score:\t0.1690\ttime:\t0:00:00.258311\tactions:\t32\tNoise:\t0.07144\t50000\n",
      "Score (max over agents) from episode\t1064:\t0.40\tAverage Score:\t0.1721\ttime:\t0:00:00.675202\tactions:\t158\tNoise:\t0.07129\t50000\n",
      "Score (max over agents) from episode\t1065:\t0.10\tAverage Score:\t0.1721\ttime:\t0:00:00.255829\tactions:\t31\tNoise:\t0.07115\t50000\n",
      "Score (max over agents) from episode\t1066:\t0.09\tAverage Score:\t0.1700\ttime:\t0:00:00.259445\tactions:\t31\tNoise:\t0.07101\t50000\n",
      "Score (max over agents) from episode\t1068:\t0.10\tAverage Score:\t0.1540\ttime:\t0:00:00.245346\tactions:\t31\tNoise:\t0.07072\t50000\n",
      "Score (max over agents) from episode\t1069:\t0.39\tAverage Score:\t0.1569\ttime:\t0:00:00.661984\tactions:\t144\tNoise:\t0.07058\t50000\n",
      "Score (max over agents) from episode\t1070:\t0.40\tAverage Score:\t0.1599\ttime:\t0:00:00.601475\tactions:\t144\tNoise:\t0.07044\t50000\n",
      "Score (max over agents) from episode\t1071:\t0.30\tAverage Score:\t0.1619\ttime:\t0:00:00.520614\tactions:\t107\tNoise:\t0.07030\t50000\n",
      "Score (max over agents) from episode\t1072:\t0.09\tAverage Score:\t0.1619\ttime:\t0:00:00.254829\tactions:\t32\tNoise:\t0.07016\t50000\n",
      "Score (max over agents) from episode\t1073:\t0.09\tAverage Score:\t0.1609\ttime:\t0:00:00.250333\tactions:\t31\tNoise:\t0.07002\t50000\n",
      "Score (max over agents) from episode\t1074:\t0.40\tAverage Score:\t0.1640\ttime:\t0:00:00.602442\tactions:\t142\tNoise:\t0.06988\t50000\n",
      "Score (max over agents) from episode\t1075:\t0.09\tAverage Score:\t0.1640\ttime:\t0:00:00.262301\tactions:\t30\tNoise:\t0.06974\t50000\n",
      "Score (max over agents) from episode\t1076:\t0.20\tAverage Score:\t0.1660\ttime:\t0:00:00.418883\tactions:\t89\tNoise:\t0.06960\t50000\n",
      "Score (max over agents) from episode\t1077:\t0.10\tAverage Score:\t0.1670\ttime:\t0:00:00.247341\tactions:\t31\tNoise:\t0.06946\t50000\n",
      "Score (max over agents) from episode\t1078:\t1.00\tAverage Score:\t0.1761\ttime:\t0:00:01.310341\tactions:\t394\tNoise:\t0.06932\t50000\n",
      "Score (max over agents) from episode\t1079:\t1.20\tAverage Score:\t0.1881\ttime:\t0:00:01.489844\tactions:\t448\tNoise:\t0.06918\t50000\n",
      "Score (max over agents) from episode\t1080:\t0.70\tAverage Score:\t0.1941\ttime:\t0:00:00.944938\tactions:\t259\tNoise:\t0.06905\t50000\n",
      "Score (max over agents) from episode\t1081:\t0.30\tAverage Score:\t0.1962\ttime:\t0:00:00.466250\tactions:\t108\tNoise:\t0.06891\t50000\n",
      "Score (max over agents) from episode\t1082:\t0.49\tAverage Score:\t0.2001\ttime:\t0:00:00.857715\tactions:\t212\tNoise:\t0.06877\t50000\n",
      "Score (max over agents) from episode\t1083:\t0.10\tAverage Score:\t0.1991\ttime:\t0:00:00.249341\tactions:\t32\tNoise:\t0.06863\t50000\n",
      "Score (max over agents) from episode\t1084:\t0.19\tAverage Score:\t0.2000\ttime:\t0:00:00.352801\tactions:\t65\tNoise:\t0.06849\t50000\n",
      "Score (max over agents) from episode\t1085:\t0.09\tAverage Score:\t0.2000\ttime:\t0:00:00.244858\tactions:\t30\tNoise:\t0.06836\t50000\n",
      "Score (max over agents) from episode\t1086:\t0.10\tAverage Score:\t0.1830\ttime:\t0:00:00.253343\tactions:\t31\tNoise:\t0.06822\t50000\n",
      "Score (max over agents) from episode\t1087:\t0.09\tAverage Score:\t0.1609\ttime:\t0:00:00.258312\tactions:\t30\tNoise:\t0.06808\t50000\n",
      "Score (max over agents) from episode\t1088:\t0.09\tAverage Score:\t0.1598\ttime:\t0:00:00.238875\tactions:\t30\tNoise:\t0.06795\t50000\n",
      "Score (max over agents) from episode\t1089:\t0.10\tAverage Score:\t0.1508\ttime:\t0:00:00.247340\tactions:\t31\tNoise:\t0.06781\t50000\n",
      "Score (max over agents) from episode\t1090:\t0.09\tAverage Score:\t0.1507\ttime:\t0:00:00.240941\tactions:\t31\tNoise:\t0.06768\t50000\n",
      "Score (max over agents) from episode\t1091:\t0.09\tAverage Score:\t0.1406\ttime:\t0:00:00.243352\tactions:\t31\tNoise:\t0.06754\t50000\n",
      "Score (max over agents) from episode\t1092:\t0.10\tAverage Score:\t0.1406\ttime:\t0:00:00.328258\tactions:\t51\tNoise:\t0.06741\t50000\n",
      "Score (max over agents) from episode\t1093:\t0.09\tAverage Score:\t0.1385\ttime:\t0:00:00.257974\tactions:\t31\tNoise:\t0.06727\t50000\n",
      "Score (max over agents) from episode\t1094:\t0.20\tAverage Score:\t0.1395\ttime:\t0:00:00.372333\tactions:\t67\tNoise:\t0.06714\t50000\n",
      "Score (max over agents) from episode\t1095:\t0.09\tAverage Score:\t0.1394\ttime:\t0:00:00.256317\tactions:\t32\tNoise:\t0.06700\t50000\n",
      "Score (max over agents) from episode\t1096:\t0.20\tAverage Score:\t0.1414\ttime:\t0:00:00.419392\tactions:\t67\tNoise:\t0.06687\t50000\n",
      "Score (max over agents) from episode\t1097:\t0.20\tAverage Score:\t0.1425\ttime:\t0:00:00.390554\tactions:\t67\tNoise:\t0.06674\t50000\n",
      "Score (max over agents) from episode\t1098:\t0.20\tAverage Score:\t0.1436\ttime:\t0:00:00.425381\tactions:\t68\tNoise:\t0.06660\t50000\n",
      "Score (max over agents) from episode\t1099:\t0.09\tAverage Score:\t0.1415\ttime:\t0:00:00.258820\tactions:\t30\tNoise:\t0.06647\t50000\n",
      "Score (max over agents) from episode\t1100:\t0.09\tAverage Score:\t0.1424\ttime:\t0:00:00.251350\tactions:\t31\tNoise:\t0.06634\t50000\n",
      "Score (max over agents) from episode\t1101:\t0.20\tAverage Score:\t0.1424\ttime:\t0:00:00.421392\tactions:\t83\tNoise:\t0.06620\t50000\n",
      "Score (max over agents) from episode\t1102:\t0.09\tAverage Score:\t0.1413\ttime:\t0:00:00.246343\tactions:\t32\tNoise:\t0.06607\t50000\n",
      "Score (max over agents) from episode\t1103:\t0.09\tAverage Score:\t0.1422\ttime:\t0:00:00.240931\tactions:\t31\tNoise:\t0.06594\t50000\n",
      "Score (max over agents) from episode\t1104:\t0.10\tAverage Score:\t0.1422\ttime:\t0:00:00.310174\tactions:\t52\tNoise:\t0.06581\t50000\n",
      "Score (max over agents) from episode\t1105:\t0.09\tAverage Score:\t0.1431\ttime:\t0:00:00.260308\tactions:\t32\tNoise:\t0.06567\t50000\n",
      "Score (max over agents) from episode\t1106:\t0.09\tAverage Score:\t0.1440\ttime:\t0:00:00.260965\tactions:\t31\tNoise:\t0.06554\t50000\n",
      "Score (max over agents) from episode\t1107:\t0.09\tAverage Score:\t0.1439\ttime:\t0:00:00.243453\tactions:\t31\tNoise:\t0.06541\t50000\n",
      "Score (max over agents) from episode\t1108:\t0.10\tAverage Score:\t0.1449\ttime:\t0:00:00.310174\tactions:\t52\tNoise:\t0.06528\t50000\n",
      "Score (max over agents) from episode\t1109:\t0.10\tAverage Score:\t0.1449\ttime:\t0:00:00.311170\tactions:\t52\tNoise:\t0.06515\t50000\n",
      "Score (max over agents) from episode\t1110:\t0.09\tAverage Score:\t0.1448\ttime:\t0:00:00.265833\tactions:\t32\tNoise:\t0.06502\t50000\n",
      "Score (max over agents) from episode\t1111:\t0.09\tAverage Score:\t0.1447\ttime:\t0:00:00.265073\tactions:\t31\tNoise:\t0.06489\t50000\n",
      "Score (max over agents) from episode\t1112:\t0.09\tAverage Score:\t0.1447\ttime:\t0:00:00.244104\tactions:\t30\tNoise:\t0.06476\t50000\n",
      "Score (max over agents) from episode\t1113:\t0.09\tAverage Score:\t0.1456\ttime:\t0:00:00.244350\tactions:\t31\tNoise:\t0.06463\t50000\n",
      "Score (max over agents) from episode\t1114:\t0.10\tAverage Score:\t0.1466\ttime:\t0:00:00.237386\tactions:\t31\tNoise:\t0.06450\t50000\n",
      "Score (max over agents) from episode\t1115:\t0.09\tAverage Score:\t0.1465\ttime:\t0:00:00.234056\tactions:\t29\tNoise:\t0.06437\t50000\n",
      "Score (max over agents) from episode\t1116:\t0.10\tAverage Score:\t0.1466\ttime:\t0:00:00.258341\tactions:\t31\tNoise:\t0.06424\t50000\n",
      "Score (max over agents) from episode\t1117:\t0.09\tAverage Score:\t0.1475\ttime:\t0:00:00.252328\tactions:\t31\tNoise:\t0.06412\t50000\n",
      "Score (max over agents) from episode\t1118:\t0.10\tAverage Score:\t0.1485\ttime:\t0:00:00.237368\tactions:\t30\tNoise:\t0.06399\t50000\n",
      "Score (max over agents) from episode\t1119:\t0.10\tAverage Score:\t0.1495\ttime:\t0:00:00.243352\tactions:\t32\tNoise:\t0.06386\t50000\n",
      "Score (max over agents) from episode\t1120:\t0.09\tAverage Score:\t0.1504\ttime:\t0:00:00.235372\tactions:\t30\tNoise:\t0.06373\t50000\n",
      "Score (max over agents) from episode\t1122:\t0.10\tAverage Score:\t0.1496\ttime:\t0:00:00.268791\tactions:\t31\tNoise:\t0.06348\t50000\n",
      "Score (max over agents) from episode\t1123:\t0.10\tAverage Score:\t0.1497\ttime:\t0:00:00.251575\tactions:\t31\tNoise:\t0.06335\t50000\n",
      "Score (max over agents) from episode\t1124:\t0.09\tAverage Score:\t0.1506\ttime:\t0:00:00.239894\tactions:\t30\tNoise:\t0.06322\t50000\n",
      "Score (max over agents) from episode\t1125:\t0.10\tAverage Score:\t0.1507\ttime:\t0:00:00.246344\tactions:\t26\tNoise:\t0.06310\t50000\n",
      "Score (max over agents) from episode\t1126:\t0.10\tAverage Score:\t0.1517\ttime:\t0:00:00.291983\tactions:\t31\tNoise:\t0.06297\t50000\n",
      "Score (max over agents) from episode\t1127:\t0.10\tAverage Score:\t0.1527\ttime:\t0:00:00.265292\tactions:\t30\tNoise:\t0.06285\t50000\n",
      "Score (max over agents) from episode\t1128:\t0.10\tAverage Score:\t0.1528\ttime:\t0:00:00.332624\tactions:\t53\tNoise:\t0.06272\t50000\n",
      "Score (max over agents) from episode\t1129:\t0.10\tAverage Score:\t0.1538\ttime:\t0:00:00.245346\tactions:\t30\tNoise:\t0.06259\t50000\n",
      "Score (max over agents) from episode\t1130:\t0.09\tAverage Score:\t0.1538\ttime:\t0:00:00.242354\tactions:\t31\tNoise:\t0.06247\t50000\n",
      "Score (max over agents) from episode\t1131:\t0.10\tAverage Score:\t0.1548\ttime:\t0:00:00.244349\tactions:\t30\tNoise:\t0.06234\t50000\n",
      "Score (max over agents) from episode\t1132:\t0.10\tAverage Score:\t0.1558\ttime:\t0:00:00.237367\tactions:\t30\tNoise:\t0.06222\t50000\n",
      "Score (max over agents) from episode\t1133:\t0.10\tAverage Score:\t0.1559\ttime:\t0:00:00.263152\tactions:\t31\tNoise:\t0.06209\t50000\n",
      "Score (max over agents) from episode\t1134:\t0.09\tAverage Score:\t0.1568\ttime:\t0:00:00.246829\tactions:\t32\tNoise:\t0.06197\t50000\n",
      "Score (max over agents) from episode\t1135:\t0.09\tAverage Score:\t0.1577\ttime:\t0:00:00.241867\tactions:\t30\tNoise:\t0.06185\t50000\n",
      "Score (max over agents) from episode\t1136:\t0.10\tAverage Score:\t0.1578\ttime:\t0:00:00.240109\tactions:\t30\tNoise:\t0.06172\t50000\n",
      "Score (max over agents) from episode\t1137:\t0.09\tAverage Score:\t0.1578\ttime:\t0:00:00.240361\tactions:\t31\tNoise:\t0.06160\t50000\n",
      "Score (max over agents) from episode\t1138:\t0.09\tAverage Score:\t0.1577\ttime:\t0:00:00.238365\tactions:\t30\tNoise:\t0.06148\t50000\n",
      "Score (max over agents) from episode\t1139:\t0.09\tAverage Score:\t0.1586\ttime:\t0:00:00.261310\tactions:\t30\tNoise:\t0.06135\t50000\n",
      "Score (max over agents) from episode\t1140:\t0.10\tAverage Score:\t0.1596\ttime:\t0:00:00.243541\tactions:\t30\tNoise:\t0.06123\t50000\n",
      "Score (max over agents) from episode\t1141:\t0.10\tAverage Score:\t0.1576\ttime:\t0:00:00.238385\tactions:\t30\tNoise:\t0.06111\t50000\n",
      "Score (max over agents) from episode\t1142:\t0.10\tAverage Score:\t0.1586\ttime:\t0:00:00.240500\tactions:\t31\tNoise:\t0.06099\t50000\n",
      "Score (max over agents) from episode\t1143:\t0.09\tAverage Score:\t0.1585\ttime:\t0:00:00.238366\tactions:\t31\tNoise:\t0.06086\t50000\n",
      "Score (max over agents) from episode\t1144:\t0.10\tAverage Score:\t0.1545\ttime:\t0:00:00.257333\tactions:\t31\tNoise:\t0.06074\t50000\n",
      "Score (max over agents) from episode\t1145:\t0.10\tAverage Score:\t0.1545\ttime:\t0:00:00.263297\tactions:\t30\tNoise:\t0.06062\t50000\n",
      "Score (max over agents) from episode\t1146:\t0.09\tAverage Score:\t0.1544\ttime:\t0:00:00.245371\tactions:\t31\tNoise:\t0.06050\t50000\n",
      "Score (max over agents) from episode\t1147:\t0.10\tAverage Score:\t0.1544\ttime:\t0:00:00.237368\tactions:\t30\tNoise:\t0.06038\t50000\n",
      "Score (max over agents) from episode\t1148:\t0.10\tAverage Score:\t0.1544\ttime:\t0:00:00.238366\tactions:\t30\tNoise:\t0.06026\t50000\n",
      "Score (max over agents) from episode\t1149:\t0.10\tAverage Score:\t0.1514\ttime:\t0:00:00.247341\tactions:\t31\tNoise:\t0.06014\t50000\n",
      "Score (max over agents) from episode\t1150:\t0.10\tAverage Score:\t0.1484\ttime:\t0:00:00.266291\tactions:\t30\tNoise:\t0.06002\t50000\n",
      "Score (max over agents) from episode\t1151:\t0.09\tAverage Score:\t0.1484\ttime:\t0:00:00.246071\tactions:\t31\tNoise:\t0.05990\t50000\n",
      "Score (max over agents) from episode\t1152:\t0.10\tAverage Score:\t0.1474\ttime:\t0:00:00.230388\tactions:\t30\tNoise:\t0.05978\t50000\n",
      "Score (max over agents) from episode\t1153:\t0.09\tAverage Score:\t0.1474\ttime:\t0:00:00.239386\tactions:\t30\tNoise:\t0.05966\t50000\n",
      "Score (max over agents) from episode\t1154:\t0.10\tAverage Score:\t0.1464\ttime:\t0:00:00.245345\tactions:\t31\tNoise:\t0.05954\t50000\n",
      "Score (max over agents) from episode\t1155:\t0.10\tAverage Score:\t0.1474\ttime:\t0:00:00.237369\tactions:\t30\tNoise:\t0.05942\t50000\n",
      "Score (max over agents) from episode\t1156:\t0.10\tAverage Score:\t0.1475\ttime:\t0:00:00.338101\tactions:\t53\tNoise:\t0.05930\t50000\n",
      "Score (max over agents) from episode\t1157:\t0.10\tAverage Score:\t0.1476\ttime:\t0:00:00.245346\tactions:\t32\tNoise:\t0.05918\t50000\n",
      "Score (max over agents) from episode\t1158:\t0.10\tAverage Score:\t0.1477\ttime:\t0:00:00.317173\tactions:\t53\tNoise:\t0.05906\t50000\n",
      "Score (max over agents) from episode\t1159:\t0.09\tAverage Score:\t0.1477\ttime:\t0:00:00.233345\tactions:\t30\tNoise:\t0.05895\t50000\n",
      "Score (max over agents) from episode\t1160:\t0.10\tAverage Score:\t0.1467\ttime:\t0:00:00.244371\tactions:\t31\tNoise:\t0.05883\t50000\n",
      "Score (max over agents) from episode\t1161:\t0.10\tAverage Score:\t0.1468\ttime:\t0:00:00.270787\tactions:\t31\tNoise:\t0.05871\t50000\n",
      "Score (max over agents) from episode\t1162:\t0.10\tAverage Score:\t0.1469\ttime:\t0:00:00.239890\tactions:\t31\tNoise:\t0.05859\t50000\n",
      "Score (max over agents) from episode\t1163:\t0.10\tAverage Score:\t0.1470\ttime:\t0:00:00.311191\tactions:\t52\tNoise:\t0.05848\t50000\n",
      "Score (max over agents) from episode\t1164:\t0.09\tAverage Score:\t0.1439\ttime:\t0:00:00.237367\tactions:\t30\tNoise:\t0.05836\t50000\n",
      "Score (max over agents) from episode\t1165:\t0.09\tAverage Score:\t0.1438\ttime:\t0:00:00.236370\tactions:\t30\tNoise:\t0.05824\t50000\n",
      "Score (max over agents) from episode\t1166:\t0.10\tAverage Score:\t0.1439\ttime:\t0:00:00.268365\tactions:\t32\tNoise:\t0.05812\t50000\n",
      "Score (max over agents) from episode\t1167:\t0.20\tAverage Score:\t0.1459\ttime:\t0:00:00.416314\tactions:\t87\tNoise:\t0.05801\t50000\n",
      "Score (max over agents) from episode\t1168:\t0.09\tAverage Score:\t0.1458\ttime:\t0:00:00.239363\tactions:\t30\tNoise:\t0.05789\t50000\n",
      "Score (max over agents) from episode\t1169:\t0.10\tAverage Score:\t0.1429\ttime:\t0:00:00.309704\tactions:\t52\tNoise:\t0.05778\t50000\n",
      "Score (max over agents) from episode\t1170:\t0.09\tAverage Score:\t0.1398\ttime:\t0:00:00.238365\tactions:\t30\tNoise:\t0.05766\t50000\n",
      "Score (max over agents) from episode\t1171:\t0.10\tAverage Score:\t0.1378\ttime:\t0:00:00.278286\tactions:\t31\tNoise:\t0.05755\t50000\n",
      "Score (max over agents) from episode\t1172:\t0.09\tAverage Score:\t0.1378\ttime:\t0:00:00.255320\tactions:\t31\tNoise:\t0.05743\t50000\n",
      "Score (max over agents) from episode\t1173:\t0.09\tAverage Score:\t0.1378\ttime:\t0:00:00.238363\tactions:\t31\tNoise:\t0.05732\t50000\n",
      "Score (max over agents) from episode\t1174:\t0.10\tAverage Score:\t0.1348\ttime:\t0:00:00.308713\tactions:\t52\tNoise:\t0.05720\t50000\n",
      "Score (max over agents) from episode\t1175:\t0.10\tAverage Score:\t0.1349\ttime:\t0:00:00.241356\tactions:\t30\tNoise:\t0.05709\t50000\n",
      "Score (max over agents) from episode\t1176:\t0.09\tAverage Score:\t0.1338\ttime:\t0:00:00.260019\tactions:\t31\tNoise:\t0.05697\t50000\n",
      "Score (max over agents) from episode\t1177:\t0.09\tAverage Score:\t0.1337\ttime:\t0:00:00.257692\tactions:\t31\tNoise:\t0.05686\t50000\n",
      "Score (max over agents) from episode\t1178:\t0.10\tAverage Score:\t0.1247\ttime:\t0:00:00.238321\tactions:\t31\tNoise:\t0.05675\t50000\n",
      "Score (max over agents) from episode\t1179:\t0.10\tAverage Score:\t0.1137\ttime:\t0:00:00.241895\tactions:\t32\tNoise:\t0.05663\t50000\n",
      "Score (max over agents) from episode\t1180:\t0.19\tAverage Score:\t0.1086\ttime:\t0:00:00.340094\tactions:\t62\tNoise:\t0.05652\t50000\n",
      "Score (max over agents) from episode\t1181:\t0.10\tAverage Score:\t0.1066\ttime:\t0:00:00.325159\tactions:\t52\tNoise:\t0.05641\t50000\n",
      "Score (max over agents) from episode\t1182:\t0.10\tAverage Score:\t0.1027\ttime:\t0:00:00.328634\tactions:\t51\tNoise:\t0.05629\t50000\n",
      "Score (max over agents) from episode\t1183:\t0.10\tAverage Score:\t0.1027\ttime:\t0:00:00.245857\tactions:\t31\tNoise:\t0.05618\t50000\n",
      "Score (max over agents) from episode\t1184:\t0.09\tAverage Score:\t0.1017\ttime:\t0:00:00.241358\tactions:\t30\tNoise:\t0.05607\t50000\n",
      "Score (max over agents) from episode\t1185:\t0.09\tAverage Score:\t0.1017\ttime:\t0:00:00.240377\tactions:\t30\tNoise:\t0.05596\t50000\n",
      "Score (max over agents) from episode\t1186:\t0.09\tAverage Score:\t0.1016\ttime:\t0:00:00.246345\tactions:\t30\tNoise:\t0.05584\t50000\n",
      "Score (max over agents) from episode\t1187:\t0.10\tAverage Score:\t0.1017\ttime:\t0:00:00.264295\tactions:\t31\tNoise:\t0.05573\t50000\n",
      "Score (max over agents) from episode\t1188:\t0.09\tAverage Score:\t0.1017\ttime:\t0:00:00.242355\tactions:\t30\tNoise:\t0.05562\t50000\n",
      "Score (max over agents) from episode\t1189:\t0.10\tAverage Score:\t0.1017\ttime:\t0:00:00.236371\tactions:\t30\tNoise:\t0.05551\t50000\n",
      "Score (max over agents) from episode\t1190:\t0.10\tAverage Score:\t0.1018\ttime:\t0:00:00.238365\tactions:\t30\tNoise:\t0.05540\t50000\n",
      "Score (max over agents) from episode\t1191:\t0.09\tAverage Score:\t0.1018\ttime:\t0:00:00.236049\tactions:\t31\tNoise:\t0.05529\t50000\n",
      "Score (max over agents) from episode\t1192:\t0.10\tAverage Score:\t0.1018\ttime:\t0:00:00.264805\tactions:\t31\tNoise:\t0.05518\t50000\n",
      "Score (max over agents) from episode\t1193:\t0.10\tAverage Score:\t0.1019\ttime:\t0:00:00.249588\tactions:\t31\tNoise:\t0.05507\t50000\n",
      "Score (max over agents) from episode\t1194:\t0.10\tAverage Score:\t0.1009\ttime:\t0:00:00.241082\tactions:\t30\tNoise:\t0.05496\t50000\n",
      "Score (max over agents) from episode\t1195:\t0.10\tAverage Score:\t0.1010\ttime:\t0:00:00.306185\tactions:\t52\tNoise:\t0.05485\t50000\n",
      "Score (max over agents) from episode\t1196:\t0.10\tAverage Score:\t0.1000\ttime:\t0:00:00.239362\tactions:\t30\tNoise:\t0.05474\t50000\n",
      "Score (max over agents) from episode\t1197:\t0.10\tAverage Score:\t0.0990\ttime:\t0:00:00.249336\tactions:\t31\tNoise:\t0.05463\t50000\n",
      "Score (max over agents) from episode\t1198:\t0.19\tAverage Score:\t0.0989\ttime:\t0:00:00.413374\tactions:\t67\tNoise:\t0.05452\t50000\n",
      "Score (max over agents) from episode\t1199:\t0.10\tAverage Score:\t0.0990\ttime:\t0:00:00.276267\tactions:\t30\tNoise:\t0.05441\t50000\n",
      "Score (max over agents) from episode\t1200:\t0.10\tAverage Score:\t0.0991\ttime:\t0:00:00.344079\tactions:\t52\tNoise:\t0.05430\t50000\n",
      "Score (max over agents) from episode\t1201:\t0.10\tAverage Score:\t0.0981\ttime:\t0:00:00.324823\tactions:\t53\tNoise:\t0.05419\t50000\n",
      "Score (max over agents) from episode\t1202:\t0.10\tAverage Score:\t0.0982\ttime:\t0:00:00.347093\tactions:\t51\tNoise:\t0.05408\t50000\n",
      "Score (max over agents) from episode\t1203:\t0.20\tAverage Score:\t0.0993\ttime:\t0:00:00.415891\tactions:\t90\tNoise:\t0.05397\t50000\n",
      "Score (max over agents) from episode\t1204:\t0.50\tAverage Score:\t0.1033\ttime:\t0:00:00.729057\tactions:\t202\tNoise:\t0.05387\t50000\n",
      "Score (max over agents) from episode\t1205:\t0.10\tAverage Score:\t0.1034\ttime:\t0:00:00.329124\tactions:\t53\tNoise:\t0.05376\t50000\n",
      "Score (max over agents) from episode\t1206:\t0.30\tAverage Score:\t0.1055\ttime:\t0:00:00.478593\tactions:\t107\tNoise:\t0.05365\t50000\n",
      "Score (max over agents) from episode\t1207:\t0.20\tAverage Score:\t0.1066\ttime:\t0:00:00.411920\tactions:\t90\tNoise:\t0.05354\t50000\n",
      "Score (max over agents) from episode\t1208:\t0.10\tAverage Score:\t0.1066\ttime:\t0:00:00.321146\tactions:\t51\tNoise:\t0.05344\t50000\n",
      "Score (max over agents) from episode\t1209:\t0.10\tAverage Score:\t0.1066\ttime:\t0:00:00.322143\tactions:\t52\tNoise:\t0.05333\t50000\n",
      "Score (max over agents) from episode\t1210:\t0.10\tAverage Score:\t0.1067\ttime:\t0:00:00.303194\tactions:\t52\tNoise:\t0.05322\t50000\n",
      "Score (max over agents) from episode\t1211:\t0.10\tAverage Score:\t0.1068\ttime:\t0:00:00.317664\tactions:\t52\tNoise:\t0.05312\t50000\n",
      "Score (max over agents) from episode\t1212:\t0.10\tAverage Score:\t0.1069\ttime:\t0:00:00.324154\tactions:\t52\tNoise:\t0.05301\t50000\n",
      "Score (max over agents) from episode\t1213:\t0.09\tAverage Score:\t0.1069\ttime:\t0:00:00.262810\tactions:\t32\tNoise:\t0.05291\t50000\n",
      "Score (max over agents) from episode\t1214:\t0.09\tAverage Score:\t0.1068\ttime:\t0:00:00.247359\tactions:\t31\tNoise:\t0.05280\t50000\n",
      "Score (max over agents) from episode\t1215:\t0.09\tAverage Score:\t0.1068\ttime:\t0:00:00.238366\tactions:\t30\tNoise:\t0.05269\t50000\n",
      "Score (max over agents) from episode\t1216:\t0.09\tAverage Score:\t0.1067\ttime:\t0:00:00.242355\tactions:\t31\tNoise:\t0.05259\t50000\n",
      "Score (max over agents) from episode\t1217:\t0.09\tAverage Score:\t0.1067\ttime:\t0:00:00.247339\tactions:\t31\tNoise:\t0.05248\t50000\n",
      "Score (max over agents) from episode\t1218:\t0.10\tAverage Score:\t0.1067\ttime:\t0:00:00.261869\tactions:\t30\tNoise:\t0.05238\t50000\n",
      "Score (max over agents) from episode\t1219:\t0.10\tAverage Score:\t0.1067\ttime:\t0:00:00.325972\tactions:\t52\tNoise:\t0.05227\t50000\n",
      "Score (max over agents) from episode\t1220:\t0.10\tAverage Score:\t0.1068\ttime:\t0:00:00.311171\tactions:\t52\tNoise:\t0.05217\t50000\n",
      "Score (max over agents) from episode\t1221:\t0.09\tAverage Score:\t0.1077\ttime:\t0:00:00.240495\tactions:\t30\tNoise:\t0.05206\t50000\n",
      "Score (max over agents) from episode\t1222:\t0.10\tAverage Score:\t0.1077\ttime:\t0:00:00.317688\tactions:\t52\tNoise:\t0.05196\t50000\n",
      "Score (max over agents) from episode\t1223:\t0.09\tAverage Score:\t0.1076\ttime:\t0:00:00.265800\tactions:\t30\tNoise:\t0.05186\t50000\n",
      "Score (max over agents) from episode\t1224:\t0.10\tAverage Score:\t0.1077\ttime:\t0:00:00.320645\tactions:\t52\tNoise:\t0.05175\t50000\n",
      "Score (max over agents) from episode\t1225:\t0.10\tAverage Score:\t0.1077\ttime:\t0:00:00.311116\tactions:\t52\tNoise:\t0.05165\t50000\n",
      "Score (max over agents) from episode\t1226:\t0.09\tAverage Score:\t0.1076\ttime:\t0:00:00.244236\tactions:\t31\tNoise:\t0.05155\t50000\n",
      "Score (max over agents) from episode\t1227:\t0.10\tAverage Score:\t0.1076\ttime:\t0:00:00.338098\tactions:\t62\tNoise:\t0.05144\t50000\n",
      "Score (max over agents) from episode\t1228:\t0.09\tAverage Score:\t0.1075\ttime:\t0:00:00.260306\tactions:\t31\tNoise:\t0.05134\t50000\n",
      "Score (max over agents) from episode\t1229:\t0.50\tAverage Score:\t0.1115\ttime:\t0:00:00.696147\tactions:\t185\tNoise:\t0.05124\t50000\n",
      "Score (max over agents) from episode\t1230:\t0.19\tAverage Score:\t0.1125\ttime:\t0:00:00.350254\tactions:\t69\tNoise:\t0.05113\t50000\n",
      "Score (max over agents) from episode\t1231:\t0.29\tAverage Score:\t0.1144\ttime:\t0:00:00.503679\tactions:\t107\tNoise:\t0.05103\t50000\n",
      "Score (max over agents) from episode\t1232:\t0.09\tAverage Score:\t0.1143\ttime:\t0:00:00.240360\tactions:\t30\tNoise:\t0.05093\t50000\n",
      "Score (max over agents) from episode\t1233:\t0.20\tAverage Score:\t0.1153\ttime:\t0:00:00.367023\tactions:\t69\tNoise:\t0.05083\t50000\n",
      "Score (max over agents) from episode\t1234:\t0.20\tAverage Score:\t0.1164\ttime:\t0:00:00.367312\tactions:\t69\tNoise:\t0.05073\t50000\n",
      "Score (max over agents) from episode\t1235:\t0.09\tAverage Score:\t0.1164\ttime:\t0:00:00.274777\tactions:\t31\tNoise:\t0.05063\t50000\n",
      "Score (max over agents) from episode\t1236:\t0.10\tAverage Score:\t0.1164\ttime:\t0:00:00.257315\tactions:\t31\tNoise:\t0.05052\t50000\n",
      "Score (max over agents) from episode\t1237:\t0.10\tAverage Score:\t0.1165\ttime:\t0:00:00.315422\tactions:\t51\tNoise:\t0.05042\t50000\n",
      "Score (max over agents) from episode\t1238:\t0.10\tAverage Score:\t0.1166\ttime:\t0:00:00.315161\tactions:\t52\tNoise:\t0.05032\t50000\n",
      "Score (max over agents) from episode\t1239:\t0.10\tAverage Score:\t0.1167\ttime:\t0:00:00.252328\tactions:\t31\tNoise:\t0.05022\t50000\n",
      "Score (max over agents) from episode\t1240:\t0.10\tAverage Score:\t0.1167\ttime:\t0:00:00.347586\tactions:\t52\tNoise:\t0.05012\t50000\n",
      "Score (max over agents) from episode\t1241:\t0.10\tAverage Score:\t0.1167\ttime:\t0:00:00.252838\tactions:\t30\tNoise:\t0.05002\t50000\n",
      "Score (max over agents) from episode\t1242:\t0.20\tAverage Score:\t0.1177\ttime:\t0:00:00.421877\tactions:\t90\tNoise:\t0.04992\t50000\n",
      "Score (max over agents) from episode\t1243:\t0.10\tAverage Score:\t0.1178\ttime:\t0:00:00.318293\tactions:\t51\tNoise:\t0.04982\t50000\n",
      "Score (max over agents) from episode\t1244:\t0.09\tAverage Score:\t0.1177\ttime:\t0:00:00.254322\tactions:\t31\tNoise:\t0.04972\t50000\n",
      "Score (max over agents) from episode\t1245:\t0.09\tAverage Score:\t0.1176\ttime:\t0:00:00.264295\tactions:\t30\tNoise:\t0.04962\t50000\n",
      "Score (max over agents) from episode\t1246:\t1.50\tAverage Score:\t0.1317\ttime:\t0:00:01.877232\tactions:\t583\tNoise:\t0.04952\t50000\n",
      "Score (max over agents) from episode\t1247:\t2.60\tAverage Score:\t0.1567\ttime:\t0:00:03.116246\tactions:\t1001\tNoise:\t0.04942\t50000\n",
      "Score (max over agents) from episode\t1248:\t2.70\tAverage Score:\t0.1827\ttime:\t0:00:03.058009\tactions:\t1001\tNoise:\t0.04932\t50000\n",
      "Score (max over agents) from episode\t1249:\t0.50\tAverage Score:\t0.1867\ttime:\t0:00:00.705651\tactions:\t179\tNoise:\t0.04923\t50000\n",
      "Score (max over agents) from episode\t1250:\t0.10\tAverage Score:\t0.1867\ttime:\t0:00:00.238364\tactions:\t31\tNoise:\t0.04913\t50000\n",
      "Score (max over agents) from episode\t1251:\t0.10\tAverage Score:\t0.1868\ttime:\t0:00:00.236370\tactions:\t31\tNoise:\t0.04903\t50000\n",
      "Score (max over agents) from episode\t1252:\t0.40\tAverage Score:\t0.1898\ttime:\t0:00:00.666123\tactions:\t164\tNoise:\t0.04893\t50000\n",
      "Score (max over agents) from episode\t1253:\t0.30\tAverage Score:\t0.1919\ttime:\t0:00:00.466756\tactions:\t108\tNoise:\t0.04883\t50000\n",
      "Score (max over agents) from episode\t1254:\t0.09\tAverage Score:\t0.1918\ttime:\t0:00:00.239363\tactions:\t31\tNoise:\t0.04874\t50000\n",
      "Score (max over agents) from episode\t1255:\t0.50\tAverage Score:\t0.1958\ttime:\t0:00:00.770019\tactions:\t203\tNoise:\t0.04864\t50000\n",
      "Score (max over agents) from episode\t1256:\t0.20\tAverage Score:\t0.1968\ttime:\t0:00:00.424399\tactions:\t89\tNoise:\t0.04854\t50000\n",
      "Score (max over agents) from episode\t1257:\t1.60\tAverage Score:\t0.2118\ttime:\t0:00:01.934402\tactions:\t622\tNoise:\t0.04844\t50000\n",
      "Score (max over agents) from episode\t1258:\t0.10\tAverage Score:\t0.2118\ttime:\t0:00:00.265293\tactions:\t30\tNoise:\t0.04835\t50000\n",
      "Score (max over agents) from episode\t1259:\t1.00\tAverage Score:\t0.2209\ttime:\t0:00:01.236013\tactions:\t375\tNoise:\t0.04825\t50000\n",
      "Score (max over agents) from episode\t1260:\t0.09\tAverage Score:\t0.2208\ttime:\t0:00:00.252404\tactions:\t30\tNoise:\t0.04815\t50000\n",
      "Score (max over agents) from episode\t1261:\t0.10\tAverage Score:\t0.2208\ttime:\t0:00:00.247343\tactions:\t31\tNoise:\t0.04806\t50000\n",
      "Score (max over agents) from episode\t1262:\t1.80\tAverage Score:\t0.2378\ttime:\t0:00:02.108137\tactions:\t676\tNoise:\t0.04796\t50000\n",
      "Score (max over agents) from episode\t1263:\t0.40\tAverage Score:\t0.2408\ttime:\t0:00:00.611371\tactions:\t147\tNoise:\t0.04787\t50000\n",
      "Score (max over agents) from episode\t1265:\t0.10\tAverage Score:\t0.2400\ttime:\t0:00:00.251331\tactions:\t31\tNoise:\t0.04767\t50000\n",
      "Score (max over agents) from episode\t1266:\t0.10\tAverage Score:\t0.2400\ttime:\t0:00:00.241242\tactions:\t31\tNoise:\t0.04758\t50000\n",
      "Score (max over agents) from episode\t1267:\t0.30\tAverage Score:\t0.2410\ttime:\t0:00:00.559018\tactions:\t126\tNoise:\t0.04748\t50000\n",
      "Score (max over agents) from episode\t1268:\t0.10\tAverage Score:\t0.2411\ttime:\t0:00:00.248339\tactions:\t31\tNoise:\t0.04739\t50000\n",
      "Score (max over agents) from episode\t1269:\t0.10\tAverage Score:\t0.2411\ttime:\t0:00:00.245854\tactions:\t31\tNoise:\t0.04729\t50000\n",
      "Score (max over agents) from episode\t1270:\t0.30\tAverage Score:\t0.2432\ttime:\t0:00:00.533317\tactions:\t127\tNoise:\t0.04720\t50000\n",
      "Score (max over agents) from episode\t1271:\t1.00\tAverage Score:\t0.2522\ttime:\t0:00:01.284616\tactions:\t393\tNoise:\t0.04711\t50000\n",
      "Score (max over agents) from episode\t1272:\t0.10\tAverage Score:\t0.2523\ttime:\t0:00:00.257313\tactions:\t31\tNoise:\t0.04701\t50000\n",
      "Score (max over agents) from episode\t1273:\t0.10\tAverage Score:\t0.2524\ttime:\t0:00:00.329016\tactions:\t52\tNoise:\t0.04692\t50000\n",
      "Score (max over agents) from episode\t1274:\t0.70\tAverage Score:\t0.2584\ttime:\t0:00:00.954267\tactions:\t279\tNoise:\t0.04682\t50000\n",
      "Score (max over agents) from episode\t1275:\t0.10\tAverage Score:\t0.2584\ttime:\t0:00:00.258312\tactions:\t31\tNoise:\t0.04673\t50000\n",
      "Score (max over agents) from episode\t1276:\t0.09\tAverage Score:\t0.2584\ttime:\t0:00:00.251331\tactions:\t30\tNoise:\t0.04664\t50000\n",
      "Score (max over agents) from episode\t1277:\t0.10\tAverage Score:\t0.2585\ttime:\t0:00:00.236880\tactions:\t30\tNoise:\t0.04654\t50000\n",
      "Score (max over agents) from episode\t1278:\t0.30\tAverage Score:\t0.2605\ttime:\t0:00:00.537579\tactions:\t127\tNoise:\t0.04645\t50000\n",
      "Score (max over agents) from episode\t1279:\t0.90\tAverage Score:\t0.2685\ttime:\t0:00:01.197378\tactions:\t355\tNoise:\t0.04636\t50000\n",
      "Score (max over agents) from episode\t1280:\t1.30\tAverage Score:\t0.2796\ttime:\t0:00:01.622902\tactions:\t507\tNoise:\t0.04626\t50000\n",
      "Score (max over agents) from episode\t1281:\t1.90\tAverage Score:\t0.2976\ttime:\t0:00:02.284488\tactions:\t735\tNoise:\t0.04617\t50000\n",
      "Score (max over agents) from episode\t1282:\t2.60\tAverage Score:\t0.3226\ttime:\t0:00:03.034756\tactions:\t1001\tNoise:\t0.04608\t50000\n",
      "Score (max over agents) from episode\t1283:\t0.50\tAverage Score:\t0.3266\ttime:\t0:00:00.698140\tactions:\t190\tNoise:\t0.04599\t50000\n",
      "Score (max over agents) from episode\t1284:\t0.10\tAverage Score:\t0.3267\ttime:\t0:00:00.257915\tactions:\t30\tNoise:\t0.04590\t50000\n",
      "Score (max over agents) from episode\t1285:\t0.20\tAverage Score:\t0.3278\ttime:\t0:00:00.457781\tactions:\t88\tNoise:\t0.04580\t50000\n",
      "Score (max over agents) from episode\t1286:\t0.10\tAverage Score:\t0.3279\ttime:\t0:00:00.244217\tactions:\t31\tNoise:\t0.04571\t50000\n",
      "Score (max over agents) from episode\t1287:\t0.10\tAverage Score:\t0.3279\ttime:\t0:00:00.248626\tactions:\t31\tNoise:\t0.04562\t50000\n",
      "Score (max over agents) from episode\t1288:\t2.60\tAverage Score:\t0.3530\ttime:\t0:00:03.076227\tactions:\t1001\tNoise:\t0.04553\t50000\n",
      "Score (max over agents) from episode\t1289:\t2.70\tAverage Score:\t0.3790\ttime:\t0:00:03.058620\tactions:\t1001\tNoise:\t0.04544\t50000\n",
      "Score (max over agents) from episode\t1290:\t2.60\tAverage Score:\t0.4040\ttime:\t0:00:03.029228\tactions:\t1001\tNoise:\t0.04535\t50000\n",
      "Score (max over agents) from episode\t1291:\t1.90\tAverage Score:\t0.4221\ttime:\t0:00:02.376486\tactions:\t721\tNoise:\t0.04526\t50000\n",
      "Score (max over agents) from episode\t1292:\t0.79\tAverage Score:\t0.4290\ttime:\t0:00:01.011820\tactions:\t300\tNoise:\t0.04517\t50000\n",
      "Score (max over agents) from episode\t1293:\t0.10\tAverage Score:\t0.4290\ttime:\t0:00:00.238873\tactions:\t30\tNoise:\t0.04508\t50000\n",
      "Score (max over agents) from episode\t1294:\t0.10\tAverage Score:\t0.4290\ttime:\t0:00:00.256318\tactions:\t30\tNoise:\t0.04499\t50000\n",
      "Score (max over agents) from episode\t1297:\t0.10\tAverage Score:\t0.4270\ttime:\t0:00:00.232269\tactions:\t30\tNoise:\t0.04472\t50000\n",
      "Score (max over agents) from episode\t1298:\t0.10\tAverage Score:\t0.4261\ttime:\t0:00:00.243881\tactions:\t30\tNoise:\t0.04463\t50000\n",
      "Score (max over agents) from episode\t1300:\t0.00\tAverage Score:\t0.4241\ttime:\t0:00:00.205453\tactions:\t15\tNoise:\t0.04445\t50000\n",
      "Score (max over agents) from episode\t1301:\t0.10\tAverage Score:\t0.4241\ttime:\t0:00:00.261304\tactions:\t31\tNoise:\t0.04436\t50000\n",
      "Score (max over agents) from episode\t1302:\t0.20\tAverage Score:\t0.4251\ttime:\t0:00:00.358048\tactions:\t67\tNoise:\t0.04427\t50000\n",
      "Score (max over agents) from episode\t1303:\t0.80\tAverage Score:\t0.4311\ttime:\t0:00:01.028956\tactions:\t298\tNoise:\t0.04418\t50000\n",
      "Score (max over agents) from episode\t1304:\t2.10\tAverage Score:\t0.4471\ttime:\t0:00:02.463023\tactions:\t792\tNoise:\t0.04409\t50000\n",
      "Score (max over agents) from episode\t1305:\t0.10\tAverage Score:\t0.4471\ttime:\t0:00:00.276264\tactions:\t30\tNoise:\t0.04401\t50000\n",
      "Score (max over agents) from episode\t1306:\t2.60\tAverage Score:\t0.4701\ttime:\t0:00:03.350736\tactions:\t1001\tNoise:\t0.04392\t50000\n",
      "Score (max over agents) from episode\t1307:\t0.60\tAverage Score:\t0.4741\ttime:\t0:00:00.847372\tactions:\t231\tNoise:\t0.04383\t50000\n",
      "Score (max over agents) from episode\t1308:\t1.20\tAverage Score:\t0.4851\ttime:\t0:00:01.592184\tactions:\t471\tNoise:\t0.04374\t50000\n",
      "Score (max over agents) from episode\t1309:\t1.40\tAverage Score:\t0.4981\ttime:\t0:00:01.703263\tactions:\t528\tNoise:\t0.04365\t50000\n",
      "Score (max over agents) from episode\t1310:\t0.10\tAverage Score:\t0.4981\ttime:\t0:00:00.312170\tactions:\t51\tNoise:\t0.04357\t50000\n",
      "Score (max over agents) from episode\t1311:\t0.20\tAverage Score:\t0.4991\ttime:\t0:00:00.422873\tactions:\t90\tNoise:\t0.04348\t50000\n",
      "Score (max over agents) from episode\t1312:\t0.10\tAverage Score:\t0.4991\ttime:\t0:00:00.324137\tactions:\t51\tNoise:\t0.04339\t50000\n",
      "Score (max over agents) from episode\t1313:\t0.10\tAverage Score:\t0.4992\ttime:\t0:00:00.318926\tactions:\t52\tNoise:\t0.04331\t50000\n",
      "Score (max over agents) from episode\t1314:\t1.40\tAverage Score:\t0.5123\ttime:\t0:00:01.682350\tactions:\t527\tNoise:\t0.04322\t50000\n",
      "Solved in episode 1314\n",
      "Score (max over agents) from episode\t1315:\t0.20\tAverage Score:\t0.5134\ttime:\t0:00:00.361143\tactions:\t70\tNoise:\t0.04313\t50000\n",
      "Score (max over agents) from episode\t1316:\t0.30\tAverage Score:\t0.5155\ttime:\t0:00:00.572474\tactions:\t128\tNoise:\t0.04305\t50000\n",
      "Score (max over agents) from episode\t1317:\t0.40\tAverage Score:\t0.5186\ttime:\t0:00:00.579513\tactions:\t147\tNoise:\t0.04296\t50000\n",
      "Score (max over agents) from episode\t1318:\t0.50\tAverage Score:\t0.5226\ttime:\t0:00:00.717090\tactions:\t184\tNoise:\t0.04288\t50000\n",
      "Score (max over agents) from episode\t1319:\t0.10\tAverage Score:\t0.5226\ttime:\t0:00:00.315159\tactions:\t52\tNoise:\t0.04279\t50000\n",
      "Score (max over agents) from episode\t1320:\t1.60\tAverage Score:\t0.5376\ttime:\t0:00:01.929170\tactions:\t604\tNoise:\t0.04270\t50000\n",
      "Score (max over agents) from episode\t1321:\t0.10\tAverage Score:\t0.5377\ttime:\t0:00:00.301329\tactions:\t51\tNoise:\t0.04262\t50000\n",
      "Score (max over agents) from episode\t1322:\t0.10\tAverage Score:\t0.5377\ttime:\t0:00:00.333619\tactions:\t52\tNoise:\t0.04253\t50000\n",
      "Score (max over agents) from episode\t1323:\t2.60\tAverage Score:\t0.5628\ttime:\t0:00:03.058844\tactions:\t1001\tNoise:\t0.04245\t50000\n",
      "Score (max over agents) from episode\t1324:\t2.70\tAverage Score:\t0.5888\ttime:\t0:00:03.055920\tactions:\t1001\tNoise:\t0.04236\t50000\n",
      "Score (max over agents) from episode\t1325:\t2.60\tAverage Score:\t0.6138\ttime:\t0:00:03.041746\tactions:\t1001\tNoise:\t0.04228\t50000\n",
      "Score (max over agents) from episode\t1326:\t1.20\tAverage Score:\t0.6249\ttime:\t0:00:01.445257\tactions:\t439\tNoise:\t0.04219\t50000\n",
      "Score (max over agents) from episode\t1327:\t2.60\tAverage Score:\t0.6499\ttime:\t0:00:03.045005\tactions:\t1001\tNoise:\t0.04211\t50000\n",
      "Score (max over agents) from episode\t1328:\t2.70\tAverage Score:\t0.6760\ttime:\t0:00:03.078810\tactions:\t1001\tNoise:\t0.04203\t50000\n",
      "Score (max over agents) from episode\t1329:\t2.60\tAverage Score:\t0.6970\ttime:\t0:00:03.038645\tactions:\t1001\tNoise:\t0.04194\t50000\n",
      "Score (max over agents) from episode\t1330:\t2.00\tAverage Score:\t0.7151\ttime:\t0:00:02.297375\tactions:\t744\tNoise:\t0.04186\t50000\n",
      "Score (max over agents) from episode\t1331:\t2.60\tAverage Score:\t0.7382\ttime:\t0:00:03.092911\tactions:\t1001\tNoise:\t0.04177\t50000\n",
      "Score (max over agents) from episode\t1332:\t2.70\tAverage Score:\t0.7643\ttime:\t0:00:03.061534\tactions:\t1001\tNoise:\t0.04169\t50000\n",
      "Score (max over agents) from episode\t1333:\t1.10\tAverage Score:\t0.7733\ttime:\t0:00:01.444615\tactions:\t428\tNoise:\t0.04161\t50000\n",
      "Score (max over agents) from episode\t1334:\t2.60\tAverage Score:\t0.7973\ttime:\t0:00:03.093458\tactions:\t1001\tNoise:\t0.04152\t50000\n",
      "Score (max over agents) from episode\t1335:\t2.70\tAverage Score:\t0.8234\ttime:\t0:00:03.060175\tactions:\t1001\tNoise:\t0.04144\t50000\n",
      "Score (max over agents) from episode\t1336:\t2.60\tAverage Score:\t0.8484\ttime:\t0:00:03.231757\tactions:\t1001\tNoise:\t0.04136\t50000\n",
      "Score (max over agents) from episode\t1337:\t2.70\tAverage Score:\t0.8744\ttime:\t0:00:03.298186\tactions:\t1001\tNoise:\t0.04127\t50000\n",
      "Score (max over agents) from episode\t1339:\t0.10\tAverage Score:\t0.8734\ttime:\t0:00:00.326214\tactions:\t51\tNoise:\t0.04111\t50000\n",
      "Score (max over agents) from episode\t1340:\t2.60\tAverage Score:\t0.8984\ttime:\t0:00:03.057925\tactions:\t1001\tNoise:\t0.04103\t50000\n",
      "Score (max over agents) from episode\t1341:\t2.70\tAverage Score:\t0.9244\ttime:\t0:00:03.071966\tactions:\t1001\tNoise:\t0.04095\t50000\n",
      "Score (max over agents) from episode\t1342:\t2.60\tAverage Score:\t0.9484\ttime:\t0:00:03.065022\tactions:\t1001\tNoise:\t0.04086\t50000\n",
      "Score (max over agents) from episode\t1343:\t2.70\tAverage Score:\t0.9744\ttime:\t0:00:03.021671\tactions:\t1001\tNoise:\t0.04078\t50000\n",
      "Score (max over agents) from episode\t1344:\t2.70\tAverage Score:\t1.0005\ttime:\t0:00:03.083497\tactions:\t1001\tNoise:\t0.04070\t50000\n",
      "Score (max over agents) from episode\t1345:\t2.60\tAverage Score:\t1.0256\ttime:\t0:00:03.091493\tactions:\t1001\tNoise:\t0.04062\t50000\n",
      "Score (max over agents) from episode\t1346:\t2.70\tAverage Score:\t1.0376\ttime:\t0:00:03.057809\tactions:\t1001\tNoise:\t0.04054\t50000\n",
      "Score (max over agents) from episode\t1348:\t2.60\tAverage Score:\t1.0106\ttime:\t0:00:03.088795\tactions:\t1001\tNoise:\t0.04038\t50000\n",
      "Score (max over agents) from episode\t1349:\t2.70\tAverage Score:\t1.0326\ttime:\t0:00:03.389889\tactions:\t1001\tNoise:\t0.04030\t50000\n",
      "Score (max over agents) from episode\t1350:\t2.60\tAverage Score:\t1.0576\ttime:\t0:00:03.423516\tactions:\t1001\tNoise:\t0.04021\t50000\n",
      "Score (max over agents) from episode\t1351:\t2.70\tAverage Score:\t1.0836\ttime:\t0:00:03.047378\tactions:\t1001\tNoise:\t0.04013\t50000\n",
      "Score (max over agents) from episode\t1354:\t2.60\tAverage Score:\t1.1017\ttime:\t0:00:03.041997\tactions:\t1001\tNoise:\t0.03989\t50000\n",
      "Score (max over agents) from episode\t1355:\t2.70\tAverage Score:\t1.1237\ttime:\t0:00:03.051572\tactions:\t1001\tNoise:\t0.03981\t50000\n",
      "Score (max over agents) from episode\t1356:\t2.70\tAverage Score:\t1.1487\ttime:\t0:00:03.077739\tactions:\t1001\tNoise:\t0.03973\t50000\n",
      "Score (max over agents) from episode\t1357:\t2.60\tAverage Score:\t1.1587\ttime:\t0:00:03.089333\tactions:\t1001\tNoise:\t0.03965\t50000\n",
      "Score (max over agents) from episode\t1358:\t2.70\tAverage Score:\t1.1847\ttime:\t0:00:03.040931\tactions:\t1001\tNoise:\t0.03958\t50000\n",
      "Score (max over agents) from episode\t1360:\t0.10\tAverage Score:\t1.1748\ttime:\t0:00:00.268092\tactions:\t32\tNoise:\t0.03942\t50000\n",
      "Score (max over agents) from episode\t1361:\t2.60\tAverage Score:\t1.1998\ttime:\t0:00:03.292791\tactions:\t1001\tNoise:\t0.03934\t50000\n",
      "Score (max over agents) from episode\t1362:\t2.70\tAverage Score:\t1.2088\ttime:\t0:00:03.220122\tactions:\t1001\tNoise:\t0.03926\t50000\n",
      "Score (max over agents) from episode\t1363:\t2.60\tAverage Score:\t1.2308\ttime:\t0:00:03.132969\tactions:\t1001\tNoise:\t0.03918\t50000\n",
      "Score (max over agents) from episode\t1364:\t0.30\tAverage Score:\t1.2338\ttime:\t0:00:00.511637\tactions:\t109\tNoise:\t0.03910\t50000\n",
      "Score (max over agents) from episode\t1365:\t2.60\tAverage Score:\t1.2588\ttime:\t0:00:03.266402\tactions:\t1001\tNoise:\t0.03902\t50000\n",
      "Score (max over agents) from episode\t1366:\t2.70\tAverage Score:\t1.2848\ttime:\t0:00:03.419618\tactions:\t1001\tNoise:\t0.03895\t50000\n",
      "Score (max over agents) from episode\t1367:\t2.60\tAverage Score:\t1.3078\ttime:\t0:00:03.581816\tactions:\t1001\tNoise:\t0.03887\t50000\n",
      "Score (max over agents) from episode\t1368:\t0.30\tAverage Score:\t1.3098\ttime:\t0:00:00.557080\tactions:\t112\tNoise:\t0.03879\t50000\n",
      "Score (max over agents) from episode\t1369:\t1.20\tAverage Score:\t1.3208\ttime:\t0:00:01.745524\tactions:\t472\tNoise:\t0.03871\t50000\n",
      "Score (max over agents) from episode\t1370:\t2.60\tAverage Score:\t1.3438\ttime:\t0:00:03.098579\tactions:\t1001\tNoise:\t0.03864\t50000\n",
      "Score (max over agents) from episode\t1371:\t2.60\tAverage Score:\t1.3598\ttime:\t0:00:03.298758\tactions:\t992\tNoise:\t0.03856\t50000\n",
      "Score (max over agents) from episode\t1372:\t2.60\tAverage Score:\t1.3848\ttime:\t0:00:03.090760\tactions:\t1001\tNoise:\t0.03848\t50000\n",
      "Score (max over agents) from episode\t1373:\t2.70\tAverage Score:\t1.4108\ttime:\t0:00:03.132453\tactions:\t1001\tNoise:\t0.03840\t50000\n",
      "Score (max over agents) from episode\t1375:\t0.80\tAverage Score:\t1.4108\ttime:\t0:00:01.123052\tactions:\t317\tNoise:\t0.03825\t50000\n",
      "Score (max over agents) from episode\t1376:\t0.10\tAverage Score:\t1.4109\ttime:\t0:00:00.320063\tactions:\t52\tNoise:\t0.03817\t50000\n",
      "Score (max over agents) from episode\t1377:\t0.60\tAverage Score:\t1.4159\ttime:\t0:00:00.933026\tactions:\t241\tNoise:\t0.03810\t50000\n",
      "Score (max over agents) from episode\t1378:\t0.80\tAverage Score:\t1.4209\ttime:\t0:00:01.159910\tactions:\t318\tNoise:\t0.03802\t50000\n",
      "Score (max over agents) from episode\t1379:\t0.10\tAverage Score:\t1.4129\ttime:\t0:00:00.321143\tactions:\t52\tNoise:\t0.03795\t50000\n",
      "Score (max over agents) from episode\t1380:\t0.60\tAverage Score:\t1.4059\ttime:\t0:00:00.846131\tactions:\t223\tNoise:\t0.03787\t50000\n",
      "Score (max over agents) from episode\t1381:\t0.20\tAverage Score:\t1.3889\ttime:\t0:00:00.458289\tactions:\t89\tNoise:\t0.03779\t50000\n",
      "Score (max over agents) from episode\t1382:\t1.70\tAverage Score:\t1.3799\ttime:\t0:00:02.339782\tactions:\t643\tNoise:\t0.03772\t50000\n",
      "Score (max over agents) from episode\t1383:\t0.10\tAverage Score:\t1.3759\ttime:\t0:00:00.378990\tactions:\t52\tNoise:\t0.03764\t50000\n",
      "Score (max over agents) from episode\t1384:\t2.60\tAverage Score:\t1.4009\ttime:\t0:00:03.345183\tactions:\t1001\tNoise:\t0.03757\t50000\n",
      "Score (max over agents) from episode\t1386:\t1.80\tAverage Score:\t1.4159\ttime:\t0:00:02.473292\tactions:\t700\tNoise:\t0.03742\t50000\n",
      "Score (max over agents) from episode\t1387:\t0.80\tAverage Score:\t1.4229\ttime:\t0:00:01.062049\tactions:\t300\tNoise:\t0.03734\t50000\n",
      "Score (max over agents) from episode\t1388:\t1.10\tAverage Score:\t1.4079\ttime:\t0:00:01.550873\tactions:\t434\tNoise:\t0.03727\t50000\n",
      "Score (max over agents) from episode\t1389:\t0.20\tAverage Score:\t1.3829\ttime:\t0:00:00.459774\tactions:\t90\tNoise:\t0.03719\t50000\n",
      "Score (max over agents) from episode\t1390:\t0.00\tAverage Score:\t1.3569\ttime:\t0:00:00.199982\tactions:\t13\tNoise:\t0.03712\t50000\n",
      "Score (max over agents) from episode\t1391:\t0.70\tAverage Score:\t1.3449\ttime:\t0:00:01.046498\tactions:\t272\tNoise:\t0.03705\t50000\n",
      "Score (max over agents) from episode\t1392:\t0.10\tAverage Score:\t1.3380\ttime:\t0:00:00.258312\tactions:\t33\tNoise:\t0.03697\t50000\n",
      "Score (max over agents) from episode\t1393:\t2.60\tAverage Score:\t1.3630\ttime:\t0:00:03.167575\tactions:\t1001\tNoise:\t0.03690\t50000\n",
      "Score (max over agents) from episode\t1394:\t0.10\tAverage Score:\t1.3630\ttime:\t0:00:00.204456\tactions:\t20\tNoise:\t0.03682\t50000\n",
      "Score (max over agents) from episode\t1395:\t0.60\tAverage Score:\t1.3690\ttime:\t0:00:00.951066\tactions:\t240\tNoise:\t0.03675\t50000\n",
      "Score (max over agents) from episode\t1396:\t0.10\tAverage Score:\t1.3700\ttime:\t0:00:00.357557\tactions:\t52\tNoise:\t0.03668\t50000\n",
      "Score (max over agents) from episode\t1397:\t0.09\tAverage Score:\t1.3699\ttime:\t0:00:00.266291\tactions:\t30\tNoise:\t0.03660\t50000\n",
      "Score (max over agents) from episode\t1398:\t2.60\tAverage Score:\t1.3949\ttime:\t0:00:03.071044\tactions:\t1001\tNoise:\t0.03653\t50000\n",
      "Score (max over agents) from episode\t1400:\t1.10\tAverage Score:\t1.4059\ttime:\t0:00:01.472952\tactions:\t447\tNoise:\t0.03638\t50000\n",
      "Score (max over agents) from episode\t1401:\t0.20\tAverage Score:\t1.4069\ttime:\t0:00:00.378989\tactions:\t69\tNoise:\t0.03631\t50000\n",
      "Score (max over agents) from episode\t1402:\t2.60\tAverage Score:\t1.4309\ttime:\t0:00:03.238780\tactions:\t1001\tNoise:\t0.03624\t50000\n",
      "Score (max over agents) from episode\t1403:\t0.40\tAverage Score:\t1.4269\ttime:\t0:00:00.637591\tactions:\t143\tNoise:\t0.03617\t50000\n",
      "Score (max over agents) from episode\t1404:\t0.10\tAverage Score:\t1.4069\ttime:\t0:00:00.324137\tactions:\t52\tNoise:\t0.03609\t50000\n",
      "Score (max over agents) from episode\t1405:\t0.70\tAverage Score:\t1.4129\ttime:\t0:00:01.051707\tactions:\t274\tNoise:\t0.03602\t50000\n",
      "Score (max over agents) from episode\t1406:\t2.60\tAverage Score:\t1.4129\ttime:\t0:00:03.055537\tactions:\t1001\tNoise:\t0.03595\t50000\n",
      "Score (max over agents) from episode\t1407:\t2.70\tAverage Score:\t1.4339\ttime:\t0:00:03.074735\tactions:\t1001\tNoise:\t0.03588\t50000\n",
      "Score (max over agents) from episode\t1408:\t2.60\tAverage Score:\t1.4479\ttime:\t0:00:03.112945\tactions:\t1001\tNoise:\t0.03581\t50000\n",
      "Score (max over agents) from episode\t1410:\t2.60\tAverage Score:\t1.4589\ttime:\t0:00:03.077306\tactions:\t1001\tNoise:\t0.03566\t50000\n",
      "Score (max over agents) from episode\t1412:\t1.30\tAverage Score:\t1.4689\ttime:\t0:00:01.648137\tactions:\t508\tNoise:\t0.03552\t50000\n",
      "Score (max over agents) from episode\t1413:\t0.10\tAverage Score:\t1.4689\ttime:\t0:00:00.239362\tactions:\t30\tNoise:\t0.03545\t50000\n",
      "Score (max over agents) from episode\t1414:\t1.00\tAverage Score:\t1.4649\ttime:\t0:00:01.358253\tactions:\t395\tNoise:\t0.03538\t50000\n",
      "Score (max over agents) from episode\t1415:\t1.30\tAverage Score:\t1.4759\ttime:\t0:00:01.626934\tactions:\t489\tNoise:\t0.03531\t50000\n",
      "Score (max over agents) from episode\t1416:\t1.30\tAverage Score:\t1.4859\ttime:\t0:00:01.866024\tactions:\t489\tNoise:\t0.03524\t50000\n",
      "Score (max over agents) from episode\t1417:\t1.60\tAverage Score:\t1.4979\ttime:\t0:00:02.313015\tactions:\t603\tNoise:\t0.03517\t50000\n",
      "Score (max over agents) from episode\t1418:\t2.40\tAverage Score:\t1.5169\ttime:\t0:00:02.946100\tactions:\t926\tNoise:\t0.03510\t50000\n",
      "Score (max over agents) from episode\t1419:\t0.40\tAverage Score:\t1.5199\ttime:\t0:00:00.605921\tactions:\t146\tNoise:\t0.03503\t50000\n",
      "Score (max over agents) from episode\t1420:\t0.10\tAverage Score:\t1.5049\ttime:\t0:00:00.338099\tactions:\t52\tNoise:\t0.03496\t50000\n",
      "Score (max over agents) from episode\t1421:\t0.40\tAverage Score:\t1.5079\ttime:\t0:00:00.721077\tactions:\t166\tNoise:\t0.03489\t50000\n",
      "Score (max over agents) from episode\t1422:\t1.50\tAverage Score:\t1.5219\ttime:\t0:00:01.980392\tactions:\t582\tNoise:\t0.03482\t50000\n",
      "Score (max over agents) from episode\t1423:\t2.60\tAverage Score:\t1.5219\ttime:\t0:00:03.463235\tactions:\t984\tNoise:\t0.03475\t50000\n",
      "Score (max over agents) from episode\t1424:\t0.10\tAverage Score:\t1.4959\ttime:\t0:00:00.237366\tactions:\t30\tNoise:\t0.03468\t50000\n",
      "Score (max over agents) from episode\t1425:\t0.10\tAverage Score:\t1.4709\ttime:\t0:00:00.333113\tactions:\t52\tNoise:\t0.03461\t50000\n",
      "Score (max over agents) from episode\t1426:\t2.60\tAverage Score:\t1.4849\ttime:\t0:00:03.226161\tactions:\t1001\tNoise:\t0.03454\t50000\n",
      "Score (max over agents) from episode\t1427:\t2.70\tAverage Score:\t1.4859\ttime:\t0:00:03.234854\tactions:\t1001\tNoise:\t0.03447\t50000\n",
      "Score (max over agents) from episode\t1428:\t2.60\tAverage Score:\t1.4849\ttime:\t0:00:03.320815\tactions:\t1001\tNoise:\t0.03440\t50000\n",
      "Score (max over agents) from episode\t1429:\t0.80\tAverage Score:\t1.4669\ttime:\t0:00:01.070875\tactions:\t282\tNoise:\t0.03433\t50000\n",
      "Score (max over agents) from episode\t1430:\t2.60\tAverage Score:\t1.4729\ttime:\t0:00:03.474200\tactions:\t1001\tNoise:\t0.03426\t50000\n",
      "Score (max over agents) from episode\t1432:\t0.10\tAverage Score:\t1.4209\ttime:\t0:00:00.388473\tactions:\t51\tNoise:\t0.03413\t50000\n",
      "Score (max over agents) from episode\t1433:\t1.70\tAverage Score:\t1.4269\ttime:\t0:00:02.224987\tactions:\t641\tNoise:\t0.03406\t50000\n",
      "Score (max over agents) from episode\t1434:\t1.10\tAverage Score:\t1.4119\ttime:\t0:00:01.571288\tactions:\t432\tNoise:\t0.03399\t50000\n",
      "Score (max over agents) from episode\t1435:\t2.60\tAverage Score:\t1.4109\ttime:\t0:00:03.186125\tactions:\t1001\tNoise:\t0.03392\t50000\n",
      "Score (max over agents) from episode\t1436:\t0.60\tAverage Score:\t1.3909\ttime:\t0:00:00.877221\tactions:\t229\tNoise:\t0.03385\t50000\n",
      "Score (max over agents) from episode\t1437:\t1.50\tAverage Score:\t1.3789\ttime:\t0:00:02.176575\tactions:\t584\tNoise:\t0.03379\t50000\n",
      "Score (max over agents) from episode\t1438:\t2.20\tAverage Score:\t1.4009\ttime:\t0:00:02.676123\tactions:\t849\tNoise:\t0.03372\t50000\n",
      "Score (max over agents) from episode\t1439:\t0.50\tAverage Score:\t1.4049\ttime:\t0:00:00.797497\tactions:\t204\tNoise:\t0.03365\t50000\n",
      "Score (max over agents) from episode\t1440:\t2.50\tAverage Score:\t1.4039\ttime:\t0:00:03.003604\tactions:\t964\tNoise:\t0.03358\t50000\n",
      "Score (max over agents) from episode\t1441:\t0.80\tAverage Score:\t1.3849\ttime:\t0:00:01.209995\tactions:\t319\tNoise:\t0.03352\t50000\n",
      "Score (max over agents) from episode\t1442:\t0.10\tAverage Score:\t1.3599\ttime:\t0:00:00.340608\tactions:\t51\tNoise:\t0.03345\t50000\n",
      "Score (max over agents) from episode\t1443:\t1.70\tAverage Score:\t1.3499\ttime:\t0:00:02.087673\tactions:\t642\tNoise:\t0.03338\t50000\n",
      "Score (max over agents) from episode\t1444:\t0.10\tAverage Score:\t1.3239\ttime:\t0:00:00.242354\tactions:\t30\tNoise:\t0.03332\t50000\n",
      "Score (max over agents) from episode\t1445:\t1.20\tAverage Score:\t1.3099\ttime:\t0:00:01.650186\tactions:\t451\tNoise:\t0.03325\t50000\n",
      "Score (max over agents) from episode\t1446:\t2.60\tAverage Score:\t1.3089\ttime:\t0:00:03.155434\tactions:\t1001\tNoise:\t0.03318\t50000\n",
      "Score (max over agents) from episode\t1447:\t2.20\tAverage Score:\t1.3309\ttime:\t0:00:02.632037\tactions:\t847\tNoise:\t0.03312\t50000\n",
      "Score (max over agents) from episode\t1448:\t0.90\tAverage Score:\t1.3139\ttime:\t0:00:01.257907\tactions:\t356\tNoise:\t0.03305\t50000\n",
      "Score (max over agents) from episode\t1449:\t2.60\tAverage Score:\t1.3129\ttime:\t0:00:03.127127\tactions:\t1001\tNoise:\t0.03298\t50000\n",
      "Score (max over agents) from episode\t1450:\t2.60\tAverage Score:\t1.3129\ttime:\t0:00:03.057114\tactions:\t1001\tNoise:\t0.03292\t50000\n",
      "Score (max over agents) from episode\t1451:\t2.70\tAverage Score:\t1.3129\ttime:\t0:00:03.068407\tactions:\t1001\tNoise:\t0.03285\t50000\n",
      "Score (max over agents) from episode\t1453:\t2.60\tAverage Score:\t1.3389\ttime:\t0:00:03.099880\tactions:\t1001\tNoise:\t0.03272\t50000\n",
      "Score (max over agents) from episode\t1454:\t2.70\tAverage Score:\t1.3399\ttime:\t0:00:03.063999\tactions:\t1001\tNoise:\t0.03266\t50000\n",
      "Score (max over agents) from episode\t1455:\t2.60\tAverage Score:\t1.3389\ttime:\t0:00:03.086629\tactions:\t1001\tNoise:\t0.03259\t50000\n",
      "Score (max over agents) from episode\t1456:\t2.70\tAverage Score:\t1.3389\ttime:\t0:00:03.056498\tactions:\t1001\tNoise:\t0.03253\t50000\n",
      "Score (max over agents) from episode\t1457:\t2.60\tAverage Score:\t1.3389\ttime:\t0:00:03.073948\tactions:\t1001\tNoise:\t0.03246\t50000\n",
      "Score (max over agents) from episode\t1458:\t2.70\tAverage Score:\t1.3389\ttime:\t0:00:03.077194\tactions:\t1001\tNoise:\t0.03240\t50000\n",
      "Score (max over agents) from episode\t1459:\t2.60\tAverage Score:\t1.3649\ttime:\t0:00:03.058389\tactions:\t1001\tNoise:\t0.03233\t50000\n",
      "Score (max over agents) from episode\t1460:\t2.70\tAverage Score:\t1.3909\ttime:\t0:00:03.081235\tactions:\t1001\tNoise:\t0.03227\t50000\n",
      "Score (max over agents) from episode\t1461:\t0.70\tAverage Score:\t1.3719\ttime:\t0:00:00.910289\tactions:\t255\tNoise:\t0.03220\t50000\n",
      "Score (max over agents) from episode\t1462:\t2.60\tAverage Score:\t1.3709\ttime:\t0:00:03.114213\tactions:\t1001\tNoise:\t0.03214\t50000\n",
      "Score (max over agents) from episode\t1463:\t2.60\tAverage Score:\t1.3709\ttime:\t0:00:03.055189\tactions:\t1001\tNoise:\t0.03207\t50000\n",
      "Score (max over agents) from episode\t1464:\t2.70\tAverage Score:\t1.3949\ttime:\t0:00:03.188295\tactions:\t1001\tNoise:\t0.03201\t50000\n",
      "Score (max over agents) from episode\t1466:\t0.10\tAverage Score:\t1.3429\ttime:\t0:00:00.260813\tactions:\t31\tNoise:\t0.03188\t50000\n",
      "Score (max over agents) from episode\t1467:\t2.60\tAverage Score:\t1.3429\ttime:\t0:00:03.068108\tactions:\t1001\tNoise:\t0.03182\t50000\n",
      "Score (max over agents) from episode\t1469:\t2.60\tAverage Score:\t1.3539\ttime:\t0:00:03.264874\tactions:\t1001\tNoise:\t0.03169\t50000\n",
      "Score (max over agents) from episode\t1470:\t2.70\tAverage Score:\t1.3549\ttime:\t0:00:03.085612\tactions:\t1001\tNoise:\t0.03163\t50000\n",
      "Score (max over agents) from episode\t1471:\t2.60\tAverage Score:\t1.3549\ttime:\t0:00:03.050550\tactions:\t1001\tNoise:\t0.03156\t50000\n",
      "Score (max over agents) from episode\t1472:\t2.70\tAverage Score:\t1.3559\ttime:\t0:00:03.055644\tactions:\t1001\tNoise:\t0.03150\t50000\n",
      "Score (max over agents) from episode\t1473:\t2.60\tAverage Score:\t1.3549\ttime:\t0:00:03.116189\tactions:\t1001\tNoise:\t0.03144\t50000\n",
      "Score (max over agents) from episode\t1474:\t1.30\tAverage Score:\t1.3679\ttime:\t0:00:01.545861\tactions:\t473\tNoise:\t0.03137\t50000\n",
      "Score (max over agents) from episode\t1475:\t0.10\tAverage Score:\t1.3609\ttime:\t0:00:00.239871\tactions:\t31\tNoise:\t0.03131\t50000\n",
      "Score (max over agents) from episode\t1476:\t2.60\tAverage Score:\t1.3859\ttime:\t0:00:03.086067\tactions:\t1001\tNoise:\t0.03125\t50000\n",
      "Score (max over agents) from episode\t1477:\t1.00\tAverage Score:\t1.3899\ttime:\t0:00:01.289874\tactions:\t382\tNoise:\t0.03119\t50000\n",
      "Score (max over agents) from episode\t1478:\t2.60\tAverage Score:\t1.4079\ttime:\t0:00:03.047446\tactions:\t1001\tNoise:\t0.03112\t50000\n",
      "Score (max over agents) from episode\t1479:\t0.90\tAverage Score:\t1.4159\ttime:\t0:00:01.134484\tactions:\t325\tNoise:\t0.03106\t50000\n",
      "Score (max over agents) from episode\t1480:\t2.60\tAverage Score:\t1.4359\ttime:\t0:00:03.045641\tactions:\t1001\tNoise:\t0.03100\t50000\n",
      "Score (max over agents) from episode\t1481:\t2.70\tAverage Score:\t1.4609\ttime:\t0:00:03.021568\tactions:\t1001\tNoise:\t0.03094\t50000\n",
      "Score (max over agents) from episode\t1482:\t0.80\tAverage Score:\t1.4519\ttime:\t0:00:01.066012\tactions:\t295\tNoise:\t0.03088\t50000\n",
      "Score (max over agents) from episode\t1483:\t2.60\tAverage Score:\t1.4769\ttime:\t0:00:03.064648\tactions:\t1001\tNoise:\t0.03081\t50000\n",
      "Score (max over agents) from episode\t1484:\t0.30\tAverage Score:\t1.4539\ttime:\t0:00:00.540559\tactions:\t115\tNoise:\t0.03075\t50000\n",
      "Score (max over agents) from episode\t1485:\t2.60\tAverage Score:\t1.4799\ttime:\t0:00:03.283663\tactions:\t1001\tNoise:\t0.03069\t50000\n",
      "Score (max over agents) from episode\t1486:\t2.70\tAverage Score:\t1.4889\ttime:\t0:00:03.049786\tactions:\t1001\tNoise:\t0.03063\t50000\n",
      "Score (max over agents) from episode\t1487:\t2.60\tAverage Score:\t1.5069\ttime:\t0:00:03.128664\tactions:\t1001\tNoise:\t0.03057\t50000\n",
      "Score (max over agents) from episode\t1488:\t2.70\tAverage Score:\t1.5229\ttime:\t0:00:03.358091\tactions:\t1001\tNoise:\t0.03051\t50000\n",
      "Score (max over agents) from episode\t1489:\t2.60\tAverage Score:\t1.5469\ttime:\t0:00:03.191555\tactions:\t1001\tNoise:\t0.03045\t50000\n",
      "Score (max over agents) from episode\t1490:\t2.60\tAverage Score:\t1.5729\ttime:\t0:00:03.424002\tactions:\t1001\tNoise:\t0.03038\t50000\n",
      "Score (max over agents) from episode\t1491:\t0.80\tAverage Score:\t1.5739\ttime:\t0:00:01.049204\tactions:\t288\tNoise:\t0.03032\t50000\n",
      "Score (max over agents) from episode\t1492:\t2.60\tAverage Score:\t1.5989\ttime:\t0:00:03.073097\tactions:\t1001\tNoise:\t0.03026\t50000\n",
      "Score (max over agents) from episode\t1493:\t2.70\tAverage Score:\t1.5999\ttime:\t0:00:03.079920\tactions:\t1001\tNoise:\t0.03020\t50000\n",
      "Score (max over agents) from episode\t1494:\t2.60\tAverage Score:\t1.6249\ttime:\t0:00:03.140499\tactions:\t1001\tNoise:\t0.03014\t50000\n",
      "Score (max over agents) from episode\t1495:\t2.70\tAverage Score:\t1.6459\ttime:\t0:00:03.118730\tactions:\t1001\tNoise:\t0.03008\t50000\n",
      "Score (max over agents) from episode\t1496:\t2.60\tAverage Score:\t1.6709\ttime:\t0:00:03.043233\tactions:\t1001\tNoise:\t0.03002\t50000\n",
      "Score (max over agents) from episode\t1497:\t2.70\tAverage Score:\t1.6970\ttime:\t0:00:03.106981\tactions:\t1001\tNoise:\t0.02996\t50000\n",
      "Score (max over agents) from episode\t1498:\t2.60\tAverage Score:\t1.6970\ttime:\t0:00:03.060394\tactions:\t1001\tNoise:\t0.02990\t50000\n",
      "Score (max over agents) from episode\t1499:\t2.70\tAverage Score:\t1.7240\ttime:\t0:00:03.056199\tactions:\t1001\tNoise:\t0.02984\t50000\n",
      "Score (max over agents) from episode\t1500:\t0.00\tAverage Score:\t1.7130\ttime:\t0:00:00.160081\tactions:\t6\tNoise:\t0.02978\t50000\n",
      "Score (max over agents) from episode\t1501:\t2.60\tAverage Score:\t1.7370\ttime:\t0:00:03.074400\tactions:\t1001\tNoise:\t0.02972\t50000\n",
      "Score (max over agents) from episode\t1502:\t2.70\tAverage Score:\t1.7380\ttime:\t0:00:03.046150\tactions:\t1001\tNoise:\t0.02966\t50000\n",
      "Score (max over agents) from episode\t1503:\t2.60\tAverage Score:\t1.7600\ttime:\t0:00:03.094065\tactions:\t1001\tNoise:\t0.02960\t50000\n",
      "Score (max over agents) from episode\t1504:\t2.70\tAverage Score:\t1.7860\ttime:\t0:00:03.283566\tactions:\t1001\tNoise:\t0.02955\t50000\n",
      "Score (max over agents) from episode\t1505:\t2.60\tAverage Score:\t1.8050\ttime:\t0:00:03.450759\tactions:\t1001\tNoise:\t0.02949\t50000\n",
      "Score (max over agents) from episode\t1506:\t0.10\tAverage Score:\t1.7800\ttime:\t0:00:00.222425\tactions:\t19\tNoise:\t0.02943\t50000\n",
      "Score (max over agents) from episode\t1507:\t2.00\tAverage Score:\t1.7730\ttime:\t0:00:02.448724\tactions:\t757\tNoise:\t0.02937\t50000\n",
      "Score (max over agents) from episode\t1510:\t0.40\tAverage Score:\t1.7250\ttime:\t0:00:00.647487\tactions:\t166\tNoise:\t0.02919\t50000\n",
      "Score (max over agents) from episode\t1511:\t0.10\tAverage Score:\t1.7260\ttime:\t0:00:00.321651\tactions:\t51\tNoise:\t0.02913\t50000\n",
      "Score (max over agents) from episode\t1512:\t0.40\tAverage Score:\t1.7170\ttime:\t0:00:00.707115\tactions:\t165\tNoise:\t0.02908\t50000\n",
      "Score (max over agents) from episode\t1515:\t1.50\tAverage Score:\t1.7080\ttime:\t0:00:01.837505\tactions:\t568\tNoise:\t0.02890\t50000\n",
      "Score (max over agents) from episode\t1516:\t2.60\tAverage Score:\t1.7210\ttime:\t0:00:03.096491\tactions:\t1001\tNoise:\t0.02884\t50000\n",
      "Score (max over agents) from episode\t1517:\t0.40\tAverage Score:\t1.7090\ttime:\t0:00:00.588341\tactions:\t139\tNoise:\t0.02879\t50000\n",
      "Score (max over agents) from episode\t1518:\t2.60\tAverage Score:\t1.7110\ttime:\t0:00:03.081496\tactions:\t1001\tNoise:\t0.02873\t50000\n",
      "Score (max over agents) from episode\t1519:\t0.10\tAverage Score:\t1.7080\ttime:\t0:00:00.251348\tactions:\t24\tNoise:\t0.02867\t50000\n",
      "Score (max over agents) from episode\t1520:\t2.60\tAverage Score:\t1.7330\ttime:\t0:00:03.782062\tactions:\t1001\tNoise:\t0.02861\t50000\n",
      "Score (max over agents) from episode\t1521:\t0.90\tAverage Score:\t1.7380\ttime:\t0:00:01.174993\tactions:\t332\tNoise:\t0.02856\t50000\n",
      "Score (max over agents) from episode\t1522:\t0.60\tAverage Score:\t1.7290\ttime:\t0:00:00.823496\tactions:\t224\tNoise:\t0.02850\t50000\n",
      "Score (max over agents) from episode\t1523:\t0.60\tAverage Score:\t1.7090\ttime:\t0:00:00.909114\tactions:\t242\tNoise:\t0.02844\t50000\n",
      "Score (max over agents) from episode\t1524:\t0.50\tAverage Score:\t1.7130\ttime:\t0:00:00.775204\tactions:\t203\tNoise:\t0.02839\t50000\n",
      "Score (max over agents) from episode\t1525:\t0.90\tAverage Score:\t1.7210\ttime:\t0:00:01.223206\tactions:\t357\tNoise:\t0.02833\t50000\n",
      "Score (max over agents) from episode\t1526:\t0.10\tAverage Score:\t1.6960\ttime:\t0:00:00.255320\tactions:\t30\tNoise:\t0.02827\t50000\n",
      "Score (max over agents) from episode\t1527:\t1.50\tAverage Score:\t1.6840\ttime:\t0:00:01.910120\tactions:\t586\tNoise:\t0.02822\t50000\n",
      "Score (max over agents) from episode\t1528:\t0.19\tAverage Score:\t1.6599\ttime:\t0:00:00.377994\tactions:\t71\tNoise:\t0.02816\t50000\n",
      "Score (max over agents) from episode\t1529:\t2.30\tAverage Score:\t1.6749\ttime:\t0:00:02.800401\tactions:\t890\tNoise:\t0.02810\t50000\n",
      "Score (max over agents) from episode\t1530:\t2.60\tAverage Score:\t1.6749\ttime:\t0:00:03.037030\tactions:\t1001\tNoise:\t0.02805\t50000\n",
      "Score (max over agents) from episode\t1532:\t0.10\tAverage Score:\t1.6749\ttime:\t0:00:00.280253\tactions:\t33\tNoise:\t0.02793\t50000\n",
      "Score (max over agents) from episode\t1533:\t2.60\tAverage Score:\t1.6839\ttime:\t0:00:03.091445\tactions:\t1001\tNoise:\t0.02788\t50000\n",
      "Score (max over agents) from episode\t1534:\t2.00\tAverage Score:\t1.6929\ttime:\t0:00:02.338320\tactions:\t747\tNoise:\t0.02782\t50000\n",
      "Score (max over agents) from episode\t1535:\t2.60\tAverage Score:\t1.6929\ttime:\t0:00:03.073785\tactions:\t1001\tNoise:\t0.02777\t50000\n",
      "Score (max over agents) from episode\t1536:\t2.70\tAverage Score:\t1.7139\ttime:\t0:00:03.067854\tactions:\t1001\tNoise:\t0.02771\t50000\n",
      "Score (max over agents) from episode\t1537:\t1.70\tAverage Score:\t1.7159\ttime:\t0:00:02.145893\tactions:\t677\tNoise:\t0.02766\t50000\n",
      "Score (max over agents) from episode\t1538:\t2.60\tAverage Score:\t1.7199\ttime:\t0:00:03.040389\tactions:\t1001\tNoise:\t0.02760\t50000\n",
      "Score (max over agents) from episode\t1540:\t2.60\tAverage Score:\t1.7159\ttime:\t0:00:03.035444\tactions:\t1001\tNoise:\t0.02749\t50000\n",
      "Score (max over agents) from episode\t1542:\t2.60\tAverage Score:\t1.7329\ttime:\t0:00:03.051636\tactions:\t1001\tNoise:\t0.02738\t50000\n",
      "Score (max over agents) from episode\t1543:\t2.70\tAverage Score:\t1.7429\ttime:\t0:00:03.053391\tactions:\t1001\tNoise:\t0.02733\t50000\n",
      "Score (max over agents) from episode\t1544:\t2.60\tAverage Score:\t1.7679\ttime:\t0:00:03.034502\tactions:\t1001\tNoise:\t0.02727\t50000\n",
      "Score (max over agents) from episode\t1545:\t2.70\tAverage Score:\t1.7829\ttime:\t0:00:03.098306\tactions:\t1001\tNoise:\t0.02722\t50000\n",
      "Score (max over agents) from episode\t1546:\t2.60\tAverage Score:\t1.7829\ttime:\t0:00:03.068760\tactions:\t1001\tNoise:\t0.02716\t50000\n",
      "Score (max over agents) from episode\t1547:\t0.70\tAverage Score:\t1.7679\ttime:\t0:00:00.909090\tactions:\t246\tNoise:\t0.02711\t50000\n",
      "Score (max over agents) from episode\t1548:\t2.60\tAverage Score:\t1.7849\ttime:\t0:00:03.029940\tactions:\t1001\tNoise:\t0.02705\t50000\n",
      "Score (max over agents) from episode\t1549:\t2.70\tAverage Score:\t1.7859\ttime:\t0:00:03.057749\tactions:\t1001\tNoise:\t0.02700\t50000\n",
      "Score (max over agents) from episode\t1550:\t0.60\tAverage Score:\t1.7659\ttime:\t0:00:00.846193\tactions:\t221\tNoise:\t0.02695\t50000\n",
      "Score (max over agents) from episode\t1551:\t2.60\tAverage Score:\t1.7649\ttime:\t0:00:03.086054\tactions:\t1001\tNoise:\t0.02689\t50000\n",
      "Score (max over agents) from episode\t1552:\t1.70\tAverage Score:\t1.7819\ttime:\t0:00:02.262070\tactions:\t670\tNoise:\t0.02684\t50000\n",
      "Score (max over agents) from episode\t1554:\t1.50\tAverage Score:\t1.7439\ttime:\t0:00:01.882188\tactions:\t585\tNoise:\t0.02673\t50000\n",
      "Score (max over agents) from episode\t1555:\t0.70\tAverage Score:\t1.7249\ttime:\t0:00:01.015724\tactions:\t280\tNoise:\t0.02668\t50000\n",
      "Score (max over agents) from episode\t1556:\t1.00\tAverage Score:\t1.7079\ttime:\t0:00:01.348984\tactions:\t395\tNoise:\t0.02662\t50000\n",
      "Score (max over agents) from episode\t1557:\t2.60\tAverage Score:\t1.7079\ttime:\t0:00:03.066745\tactions:\t1001\tNoise:\t0.02657\t50000\n",
      "Score (max over agents) from episode\t1558:\t2.70\tAverage Score:\t1.7079\ttime:\t0:00:03.055407\tactions:\t1001\tNoise:\t0.02652\t50000\n",
      "Score (max over agents) from episode\t1559:\t2.60\tAverage Score:\t1.7079\ttime:\t0:00:03.073615\tactions:\t1001\tNoise:\t0.02646\t50000\n",
      "Score (max over agents) from episode\t1560:\t0.60\tAverage Score:\t1.6869\ttime:\t0:00:00.884171\tactions:\t224\tNoise:\t0.02641\t50000\n",
      "Score (max over agents) from episode\t1561:\t0.10\tAverage Score:\t1.6809\ttime:\t0:00:00.240359\tactions:\t31\tNoise:\t0.02636\t50000\n",
      "Score (max over agents) from episode\t1562:\t0.09\tAverage Score:\t1.6558\ttime:\t0:00:00.248703\tactions:\t29\tNoise:\t0.02631\t50000\n",
      "Score (max over agents) from episode\t1563:\t0.10\tAverage Score:\t1.6308\ttime:\t0:00:00.264989\tactions:\t30\tNoise:\t0.02625\t50000\n",
      "Score (max over agents) from episode\t1564:\t0.20\tAverage Score:\t1.6058\ttime:\t0:00:00.493169\tactions:\t90\tNoise:\t0.02620\t50000\n",
      "Score (max over agents) from episode\t1565:\t0.30\tAverage Score:\t1.6088\ttime:\t0:00:00.579434\tactions:\t128\tNoise:\t0.02615\t50000\n",
      "Score (max over agents) from episode\t1566:\t0.40\tAverage Score:\t1.6118\ttime:\t0:00:00.721605\tactions:\t166\tNoise:\t0.02610\t50000\n",
      "Score (max over agents) from episode\t1567:\t0.10\tAverage Score:\t1.5868\ttime:\t0:00:00.245347\tactions:\t31\tNoise:\t0.02604\t50000\n",
      "Score (max over agents) from episode\t1568:\t0.20\tAverage Score:\t1.5888\ttime:\t0:00:00.455435\tactions:\t89\tNoise:\t0.02599\t50000\n",
      "Score (max over agents) from episode\t1569:\t0.70\tAverage Score:\t1.5698\ttime:\t0:00:01.031516\tactions:\t280\tNoise:\t0.02594\t50000\n",
      "Score (max over agents) from episode\t1570:\t0.50\tAverage Score:\t1.5478\ttime:\t0:00:00.779021\tactions:\t204\tNoise:\t0.02589\t50000\n",
      "Score (max over agents) from episode\t1571:\t0.10\tAverage Score:\t1.5228\ttime:\t0:00:00.262300\tactions:\t31\tNoise:\t0.02584\t50000\n",
      "Score (max over agents) from episode\t1572:\t0.10\tAverage Score:\t1.4968\ttime:\t0:00:00.398936\tactions:\t71\tNoise:\t0.02578\t50000\n",
      "Score (max over agents) from episode\t1573:\t0.20\tAverage Score:\t1.4728\ttime:\t0:00:00.457653\tactions:\t89\tNoise:\t0.02573\t50000\n",
      "Score (max over agents) from episode\t1574:\t0.90\tAverage Score:\t1.4688\ttime:\t0:00:01.253153\tactions:\t355\tNoise:\t0.02568\t50000\n",
      "Score (max over agents) from episode\t1575:\t0.10\tAverage Score:\t1.4688\ttime:\t0:00:00.312678\tactions:\t50\tNoise:\t0.02563\t50000\n",
      "Score (max over agents) from episode\t1576:\t0.20\tAverage Score:\t1.4448\ttime:\t0:00:00.478373\tactions:\t88\tNoise:\t0.02558\t50000\n",
      "Score (max over agents) from episode\t1577:\t0.10\tAverage Score:\t1.4358\ttime:\t0:00:00.254321\tactions:\t31\tNoise:\t0.02553\t50000\n",
      "Score (max over agents) from episode\t1578:\t0.60\tAverage Score:\t1.4158\ttime:\t0:00:00.909085\tactions:\t242\tNoise:\t0.02548\t50000\n",
      "Score (max over agents) from episode\t1579:\t1.00\tAverage Score:\t1.4168\ttime:\t0:00:01.280946\tactions:\t376\tNoise:\t0.02543\t50000\n",
      "Score (max over agents) from episode\t1580:\t0.30\tAverage Score:\t1.3938\ttime:\t0:00:00.525632\tactions:\t109\tNoise:\t0.02538\t50000\n",
      "Score (max over agents) from episode\t1581:\t0.30\tAverage Score:\t1.3698\ttime:\t0:00:00.511148\tactions:\t109\tNoise:\t0.02532\t50000\n",
      "Score (max over agents) from episode\t1582:\t2.00\tAverage Score:\t1.3818\ttime:\t0:00:02.405001\tactions:\t758\tNoise:\t0.02527\t50000\n",
      "Score (max over agents) from episode\t1583:\t0.10\tAverage Score:\t1.3568\ttime:\t0:00:00.246342\tactions:\t32\tNoise:\t0.02522\t50000\n",
      "Score (max over agents) from episode\t1584:\t1.40\tAverage Score:\t1.3678\ttime:\t0:00:01.827301\tactions:\t561\tNoise:\t0.02517\t50000\n",
      "Score (max over agents) from episode\t1585:\t0.40\tAverage Score:\t1.3458\ttime:\t0:00:00.694381\tactions:\t166\tNoise:\t0.02512\t50000\n",
      "Score (max over agents) from episode\t1586:\t1.90\tAverage Score:\t1.3378\ttime:\t0:00:02.264141\tactions:\t718\tNoise:\t0.02507\t50000\n",
      "Score (max over agents) from episode\t1589:\t0.10\tAverage Score:\t1.2598\ttime:\t0:00:00.262146\tactions:\t31\tNoise:\t0.02492\t50000\n",
      "Score (max over agents) from episode\t1590:\t2.60\tAverage Score:\t1.2598\ttime:\t0:00:03.057765\tactions:\t1001\tNoise:\t0.02487\t50000\n",
      "Score (max over agents) from episode\t1591:\t0.80\tAverage Score:\t1.2598\ttime:\t0:00:01.059804\tactions:\t291\tNoise:\t0.02482\t50000\n",
      "Score (max over agents) from episode\t1592:\t0.10\tAverage Score:\t1.2348\ttime:\t0:00:00.241138\tactions:\t31\tNoise:\t0.02477\t50000\n",
      "Score (max over agents) from episode\t1593:\t1.90\tAverage Score:\t1.2268\ttime:\t0:00:02.273916\tactions:\t720\tNoise:\t0.02472\t50000\n",
      "Score (max over agents) from episode\t1594:\t0.20\tAverage Score:\t1.2028\ttime:\t0:00:00.391956\tactions:\t71\tNoise:\t0.02467\t50000\n",
      "Score (max over agents) from episode\t1595:\t0.30\tAverage Score:\t1.1788\ttime:\t0:00:00.576463\tactions:\t128\tNoise:\t0.02462\t50000\n",
      "Score (max over agents) from episode\t1597:\t0.20\tAverage Score:\t1.1278\ttime:\t0:00:00.412899\tactions:\t69\tNoise:\t0.02453\t50000\n",
      "Score (max over agents) from episode\t1598:\t2.60\tAverage Score:\t1.1278\ttime:\t0:00:03.065725\tactions:\t1001\tNoise:\t0.02448\t50000\n",
      "Score (max over agents) from episode\t1599:\t2.70\tAverage Score:\t1.1278\ttime:\t0:00:03.110716\tactions:\t1001\tNoise:\t0.02443\t50000\n",
      "Score (max over agents) from episode\t1600:\t1.30\tAverage Score:\t1.1408\ttime:\t0:00:01.615907\tactions:\t491\tNoise:\t0.02438\t50000\n",
      "Score (max over agents) from episode\t1601:\t2.60\tAverage Score:\t1.1408\ttime:\t0:00:03.063274\tactions:\t1001\tNoise:\t0.02433\t50000\n",
      "Score (max over agents) from episode\t1602:\t2.70\tAverage Score:\t1.1408\ttime:\t0:00:03.052897\tactions:\t1001\tNoise:\t0.02428\t50000\n",
      "Score (max over agents) from episode\t1604:\t0.10\tAverage Score:\t1.0888\ttime:\t0:00:00.269790\tactions:\t31\tNoise:\t0.02418\t50000\n",
      "Score (max over agents) from episode\t1605:\t0.60\tAverage Score:\t1.0688\ttime:\t0:00:00.898990\tactions:\t240\tNoise:\t0.02414\t50000\n",
      "Score (max over agents) from episode\t1606:\t0.10\tAverage Score:\t1.0688\ttime:\t0:00:00.335615\tactions:\t52\tNoise:\t0.02409\t50000\n",
      "Score (max over agents) from episode\t1608:\t2.60\tAverage Score:\t1.0748\ttime:\t0:00:03.260122\tactions:\t1001\tNoise:\t0.02399\t50000\n",
      "Score (max over agents) from episode\t1609:\t0.10\tAverage Score:\t1.0758\ttime:\t0:00:00.290703\tactions:\t33\tNoise:\t0.02394\t50000\n",
      "Score (max over agents) from episode\t1610:\t2.60\tAverage Score:\t1.0978\ttime:\t0:00:03.114634\tactions:\t1001\tNoise:\t0.02390\t50000\n",
      "Score (max over agents) from episode\t1611:\t0.10\tAverage Score:\t1.0978\ttime:\t0:00:00.248344\tactions:\t22\tNoise:\t0.02385\t50000\n",
      "Score (max over agents) from episode\t1612:\t2.60\tAverage Score:\t1.1198\ttime:\t0:00:03.358153\tactions:\t1001\tNoise:\t0.02380\t50000\n",
      "Score (max over agents) from episode\t1613:\t2.70\tAverage Score:\t1.1468\ttime:\t0:00:03.065295\tactions:\t1001\tNoise:\t0.02375\t50000\n",
      "Score (max over agents) from episode\t1614:\t2.60\tAverage Score:\t1.1728\ttime:\t0:00:03.072982\tactions:\t1001\tNoise:\t0.02371\t50000\n",
      "Score (max over agents) from episode\t1615:\t1.30\tAverage Score:\t1.1708\ttime:\t0:00:01.555208\tactions:\t477\tNoise:\t0.02366\t50000\n",
      "Score (max over agents) from episode\t1616:\t2.60\tAverage Score:\t1.1708\ttime:\t0:00:03.131049\tactions:\t1001\tNoise:\t0.02361\t50000\n",
      "Score (max over agents) from episode\t1617:\t2.00\tAverage Score:\t1.1868\ttime:\t0:00:02.366650\tactions:\t765\tNoise:\t0.02356\t50000\n",
      "Score (max over agents) from episode\t1618:\t1.90\tAverage Score:\t1.1798\ttime:\t0:00:02.340703\tactions:\t737\tNoise:\t0.02352\t50000\n",
      "Score (max over agents) from episode\t1619:\t1.20\tAverage Score:\t1.1908\ttime:\t0:00:01.479377\tactions:\t451\tNoise:\t0.02347\t50000\n",
      "Score (max over agents) from episode\t1620:\t1.20\tAverage Score:\t1.1768\ttime:\t0:00:01.542044\tactions:\t470\tNoise:\t0.02342\t50000\n",
      "Score (max over agents) from episode\t1621:\t0.19\tAverage Score:\t1.1697\ttime:\t0:00:00.357049\tactions:\t66\tNoise:\t0.02338\t50000\n",
      "Score (max over agents) from episode\t1622:\t0.10\tAverage Score:\t1.1647\ttime:\t0:00:00.279255\tactions:\t31\tNoise:\t0.02333\t50000\n",
      "Score (max over agents) from episode\t1623:\t0.10\tAverage Score:\t1.1597\ttime:\t0:00:00.274269\tactions:\t30\tNoise:\t0.02328\t50000\n",
      "Score (max over agents) from episode\t1624:\t0.10\tAverage Score:\t1.1557\ttime:\t0:00:00.336612\tactions:\t51\tNoise:\t0.02324\t50000\n",
      "Score (max over agents) from episode\t1625:\t0.10\tAverage Score:\t1.1477\ttime:\t0:00:00.266311\tactions:\t30\tNoise:\t0.02319\t50000\n",
      "Score (max over agents) from episode\t1626:\t0.50\tAverage Score:\t1.1517\ttime:\t0:00:00.781606\tactions:\t185\tNoise:\t0.02314\t50000\n",
      "Score (max over agents) from episode\t1627:\t0.10\tAverage Score:\t1.1377\ttime:\t0:00:00.319148\tactions:\t52\tNoise:\t0.02310\t50000\n",
      "Score (max over agents) from episode\t1628:\t0.10\tAverage Score:\t1.1368\ttime:\t0:00:00.262915\tactions:\t31\tNoise:\t0.02305\t50000\n",
      "Score (max over agents) from episode\t1629:\t0.10\tAverage Score:\t1.1148\ttime:\t0:00:00.268011\tactions:\t32\tNoise:\t0.02300\t50000\n",
      "Score (max over agents) from episode\t1630:\t0.10\tAverage Score:\t1.0898\ttime:\t0:00:00.270011\tactions:\t31\tNoise:\t0.02296\t50000\n",
      "Score (max over agents) from episode\t1631:\t0.09\tAverage Score:\t1.0907\ttime:\t0:00:00.277008\tactions:\t30\tNoise:\t0.02291\t50000\n",
      "Score (max over agents) from episode\t1632:\t0.09\tAverage Score:\t1.0906\ttime:\t0:00:00.258421\tactions:\t30\tNoise:\t0.02287\t50000\n",
      "Score (max over agents) from episode\t1633:\t0.10\tAverage Score:\t1.0656\ttime:\t0:00:00.273565\tactions:\t31\tNoise:\t0.02282\t50000\n",
      "Score (max over agents) from episode\t1634:\t0.20\tAverage Score:\t1.0476\ttime:\t0:00:00.464156\tactions:\t88\tNoise:\t0.02277\t50000\n",
      "Score (max over agents) from episode\t1635:\t0.09\tAverage Score:\t1.0225\ttime:\t0:00:00.288759\tactions:\t31\tNoise:\t0.02273\t50000\n",
      "Score (max over agents) from episode\t1636:\t0.09\tAverage Score:\t0.9964\ttime:\t0:00:00.258311\tactions:\t30\tNoise:\t0.02268\t50000\n",
      "Score (max over agents) from episode\t1637:\t0.09\tAverage Score:\t0.9803\ttime:\t0:00:00.258835\tactions:\t30\tNoise:\t0.02264\t50000\n",
      "Score (max over agents) from episode\t1638:\t0.10\tAverage Score:\t0.9553\ttime:\t0:00:00.340986\tactions:\t51\tNoise:\t0.02259\t50000\n",
      "Score (max over agents) from episode\t1639:\t0.09\tAverage Score:\t0.9562\ttime:\t0:00:00.270023\tactions:\t30\tNoise:\t0.02255\t50000\n",
      "Score (max over agents) from episode\t1640:\t0.10\tAverage Score:\t0.9312\ttime:\t0:00:00.291995\tactions:\t30\tNoise:\t0.02250\t50000\n",
      "Score (max over agents) from episode\t1641:\t0.09\tAverage Score:\t0.9321\ttime:\t0:00:00.271039\tactions:\t32\tNoise:\t0.02246\t50000\n",
      "Score (max over agents) from episode\t1642:\t0.09\tAverage Score:\t0.9070\ttime:\t0:00:00.280971\tactions:\t32\tNoise:\t0.02241\t50000\n",
      "Score (max over agents) from episode\t1643:\t0.19\tAverage Score:\t0.8819\ttime:\t0:00:00.415171\tactions:\t70\tNoise:\t0.02237\t50000\n",
      "Score (max over agents) from episode\t1644:\t0.09\tAverage Score:\t0.8568\ttime:\t0:00:00.275267\tactions:\t30\tNoise:\t0.02232\t50000\n",
      "Score (max over agents) from episode\t1645:\t0.09\tAverage Score:\t0.8307\ttime:\t0:00:00.275589\tactions:\t30\tNoise:\t0.02228\t50000\n",
      "Score (max over agents) from episode\t1646:\t0.10\tAverage Score:\t0.8057\ttime:\t0:00:00.266984\tactions:\t31\tNoise:\t0.02223\t50000\n",
      "Score (max over agents) from episode\t1647:\t0.10\tAverage Score:\t0.7997\ttime:\t0:00:00.289979\tactions:\t38\tNoise:\t0.02219\t50000\n",
      "Score (max over agents) from episode\t1648:\t0.10\tAverage Score:\t0.7747\ttime:\t0:00:00.341001\tactions:\t53\tNoise:\t0.02215\t50000\n",
      "Score (max over agents) from episode\t1649:\t0.10\tAverage Score:\t0.7487\ttime:\t0:00:00.281006\tactions:\t31\tNoise:\t0.02210\t50000\n",
      "Score (max over agents) from episode\t1650:\t0.09\tAverage Score:\t0.7436\ttime:\t0:00:00.277019\tactions:\t30\tNoise:\t0.02206\t50000\n",
      "Score (max over agents) from episode\t1651:\t0.50\tAverage Score:\t0.7226\ttime:\t0:00:00.810601\tactions:\t204\tNoise:\t0.02201\t50000\n",
      "Score (max over agents) from episode\t1652:\t0.20\tAverage Score:\t0.7076\ttime:\t0:00:00.425391\tactions:\t75\tNoise:\t0.02197\t50000\n",
      "Score (max over agents) from episode\t1653:\t0.10\tAverage Score:\t0.7086\ttime:\t0:00:00.263922\tactions:\t32\tNoise:\t0.02192\t50000\n",
      "Score (max over agents) from episode\t1654:\t0.10\tAverage Score:\t0.6946\ttime:\t0:00:00.261334\tactions:\t30\tNoise:\t0.02188\t50000\n",
      "Score (max over agents) from episode\t1655:\t0.10\tAverage Score:\t0.6886\ttime:\t0:00:00.386967\tactions:\t68\tNoise:\t0.02184\t50000\n",
      "Score (max over agents) from episode\t1656:\t0.10\tAverage Score:\t0.6796\ttime:\t0:00:00.280253\tactions:\t32\tNoise:\t0.02179\t50000\n",
      "Score (max over agents) from episode\t1657:\t0.30\tAverage Score:\t0.6566\ttime:\t0:00:00.617082\tactions:\t134\tNoise:\t0.02175\t50000\n",
      "Score (max over agents) from episode\t1658:\t0.30\tAverage Score:\t0.6326\ttime:\t0:00:00.502068\tactions:\t108\tNoise:\t0.02171\t50000\n",
      "Score (max over agents) from episode\t1659:\t0.50\tAverage Score:\t0.6116\ttime:\t0:00:00.813513\tactions:\t204\tNoise:\t0.02166\t50000\n",
      "Score (max over agents) from episode\t1660:\t0.10\tAverage Score:\t0.6066\ttime:\t0:00:00.323645\tactions:\t52\tNoise:\t0.02162\t50000\n",
      "Score (max over agents) from episode\t1661:\t0.50\tAverage Score:\t0.6106\ttime:\t0:00:00.863697\tactions:\t204\tNoise:\t0.02158\t50000\n",
      "Score (max over agents) from episode\t1662:\t0.10\tAverage Score:\t0.6107\ttime:\t0:00:00.244347\tactions:\t31\tNoise:\t0.02153\t50000\n",
      "Score (max over agents) from episode\t1663:\t0.10\tAverage Score:\t0.6107\ttime:\t0:00:00.270788\tactions:\t32\tNoise:\t0.02149\t50000\n",
      "Score (max over agents) from episode\t1664:\t0.70\tAverage Score:\t0.6157\ttime:\t0:00:01.063929\tactions:\t280\tNoise:\t0.02145\t50000\n",
      "Score (max over agents) from episode\t1665:\t0.10\tAverage Score:\t0.6137\ttime:\t0:00:00.322647\tactions:\t52\tNoise:\t0.02140\t50000\n",
      "Score (max over agents) from episode\t1666:\t2.60\tAverage Score:\t0.6357\ttime:\t0:00:03.108073\tactions:\t1001\tNoise:\t0.02136\t50000\n",
      "Score (max over agents) from episode\t1667:\t2.60\tAverage Score:\t0.6607\ttime:\t0:00:03.308751\tactions:\t1001\tNoise:\t0.02132\t50000\n",
      "Score (max over agents) from episode\t1668:\t2.70\tAverage Score:\t0.6857\ttime:\t0:00:03.097405\tactions:\t1001\tNoise:\t0.02128\t50000\n",
      "Score (max over agents) from episode\t1669:\t2.60\tAverage Score:\t0.7047\ttime:\t0:00:03.066486\tactions:\t1001\tNoise:\t0.02123\t50000\n",
      "Score (max over agents) from episode\t1670:\t2.70\tAverage Score:\t0.7267\ttime:\t0:00:03.131181\tactions:\t1001\tNoise:\t0.02119\t50000\n",
      "Score (max over agents) from episode\t1671:\t2.60\tAverage Score:\t0.7517\ttime:\t0:00:03.138633\tactions:\t1001\tNoise:\t0.02115\t50000\n",
      "Score (max over agents) from episode\t1672:\t2.70\tAverage Score:\t0.7777\ttime:\t0:00:03.061213\tactions:\t1001\tNoise:\t0.02111\t50000\n",
      "Score (max over agents) from episode\t1673:\t2.60\tAverage Score:\t0.8017\ttime:\t0:00:03.055443\tactions:\t1001\tNoise:\t0.02106\t50000\n",
      "Score (max over agents) from episode\t1674:\t2.70\tAverage Score:\t0.8197\ttime:\t0:00:03.162005\tactions:\t1001\tNoise:\t0.02102\t50000\n",
      "Score (max over agents) from episode\t1675:\t2.60\tAverage Score:\t0.8447\ttime:\t0:00:03.311166\tactions:\t1001\tNoise:\t0.02098\t50000\n",
      "Score (max over agents) from episode\t1676:\t2.70\tAverage Score:\t0.8697\ttime:\t0:00:03.196569\tactions:\t1001\tNoise:\t0.02094\t50000\n",
      "Score (max over agents) from episode\t1677:\t2.60\tAverage Score:\t0.8947\ttime:\t0:00:03.163305\tactions:\t1001\tNoise:\t0.02090\t50000\n",
      "Score (max over agents) from episode\t1678:\t2.70\tAverage Score:\t0.9157\ttime:\t0:00:03.096993\tactions:\t1001\tNoise:\t0.02085\t50000\n",
      "Score (max over agents) from episode\t1680:\t2.60\tAverage Score:\t0.9287\ttime:\t0:00:03.048397\tactions:\t1001\tNoise:\t0.02077\t50000\n",
      "Score (max over agents) from episode\t1681:\t2.70\tAverage Score:\t0.9527\ttime:\t0:00:03.063283\tactions:\t1001\tNoise:\t0.02073\t50000\n",
      "Score (max over agents) from episode\t1682:\t2.60\tAverage Score:\t0.9587\ttime:\t0:00:03.072945\tactions:\t1001\tNoise:\t0.02069\t50000\n",
      "Score (max over agents) from episode\t1683:\t2.70\tAverage Score:\t0.9847\ttime:\t0:00:03.053757\tactions:\t1001\tNoise:\t0.02065\t50000\n",
      "Score (max over agents) from episode\t1684:\t2.60\tAverage Score:\t0.9967\ttime:\t0:00:03.048063\tactions:\t1001\tNoise:\t0.02061\t50000\n",
      "Score (max over agents) from episode\t1685:\t1.80\tAverage Score:\t1.0107\ttime:\t0:00:02.155701\tactions:\t683\tNoise:\t0.02056\t50000\n",
      "Score (max over agents) from episode\t1686:\t2.60\tAverage Score:\t1.0177\ttime:\t0:00:03.394773\tactions:\t1001\tNoise:\t0.02052\t50000\n",
      "Score (max over agents) from episode\t1687:\t2.60\tAverage Score:\t1.0437\ttime:\t0:00:03.200763\tactions:\t1001\tNoise:\t0.02048\t50000\n",
      "Score (max over agents) from episode\t1688:\t2.60\tAverage Score:\t1.0697\ttime:\t0:00:03.411288\tactions:\t1001\tNoise:\t0.02044\t50000\n",
      "Score (max over agents) from episode\t1689:\t2.70\tAverage Score:\t1.0957\ttime:\t0:00:03.568682\tactions:\t1001\tNoise:\t0.02040\t50000\n",
      "Score (max over agents) from episode\t1690:\t2.60\tAverage Score:\t1.0957\ttime:\t0:00:03.348209\tactions:\t1001\tNoise:\t0.02036\t50000\n",
      "Score (max over agents) from episode\t1691:\t0.60\tAverage Score:\t1.0937\ttime:\t0:00:00.830294\tactions:\t227\tNoise:\t0.02032\t50000\n",
      "Score (max over agents) from episode\t1692:\t0.20\tAverage Score:\t1.0947\ttime:\t0:00:00.458679\tactions:\t70\tNoise:\t0.02028\t50000\n",
      "Score (max over agents) from episode\t1693:\t0.10\tAverage Score:\t1.0767\ttime:\t0:00:00.289751\tactions:\t30\tNoise:\t0.02024\t50000\n",
      "Score (max over agents) from episode\t1694:\t0.10\tAverage Score:\t1.0757\ttime:\t0:00:00.286145\tactions:\t31\tNoise:\t0.02020\t50000\n",
      "Score (max over agents) from episode\t1695:\t2.00\tAverage Score:\t1.0927\ttime:\t0:00:02.497559\tactions:\t773\tNoise:\t0.02016\t50000\n",
      "Score (max over agents) from episode\t1696:\t0.10\tAverage Score:\t1.0937\ttime:\t0:00:00.358044\tactions:\t67\tNoise:\t0.02012\t50000\n",
      "Score (max over agents) from episode\t1697:\t2.60\tAverage Score:\t1.1177\ttime:\t0:00:03.210653\tactions:\t1001\tNoise:\t0.02008\t50000\n",
      "Score (max over agents) from episode\t1698:\t2.70\tAverage Score:\t1.1187\ttime:\t0:00:03.109787\tactions:\t1001\tNoise:\t0.02004\t50000\n",
      "Score (max over agents) from episode\t1699:\t2.60\tAverage Score:\t1.1177\ttime:\t0:00:03.063103\tactions:\t1001\tNoise:\t0.02000\t50000\n",
      "Score (max over agents) from episode\t1700:\t2.70\tAverage Score:\t1.1317\ttime:\t0:00:03.085089\tactions:\t1001\tNoise:\t0.01996\t50000\n",
      "Score (max over agents) from episode\t1701:\t2.60\tAverage Score:\t1.1317\ttime:\t0:00:03.059220\tactions:\t1001\tNoise:\t0.01992\t50000\n",
      "Score (max over agents) from episode\t1702:\t2.70\tAverage Score:\t1.1317\ttime:\t0:00:03.333264\tactions:\t1001\tNoise:\t0.01988\t50000\n",
      "Score (max over agents) from episode\t1703:\t0.30\tAverage Score:\t1.1347\ttime:\t0:00:00.509416\tactions:\t120\tNoise:\t0.01984\t50000\n",
      "Score (max over agents) from episode\t1704:\t2.60\tAverage Score:\t1.1597\ttime:\t0:00:03.485877\tactions:\t1001\tNoise:\t0.01980\t50000\n",
      "Score (max over agents) from episode\t1705:\t2.70\tAverage Score:\t1.1807\ttime:\t0:00:03.381266\tactions:\t1001\tNoise:\t0.01976\t50000\n",
      "Score (max over agents) from episode\t1706:\t2.60\tAverage Score:\t1.2057\ttime:\t0:00:03.092338\tactions:\t1001\tNoise:\t0.01972\t50000\n",
      "Score (max over agents) from episode\t1707:\t2.70\tAverage Score:\t1.2327\ttime:\t0:00:03.134058\tactions:\t1001\tNoise:\t0.01968\t50000\n",
      "Score (max over agents) from episode\t1708:\t0.10\tAverage Score:\t1.2077\ttime:\t0:00:00.228391\tactions:\t27\tNoise:\t0.01964\t50000\n",
      "Score (max over agents) from episode\t1709:\t0.10\tAverage Score:\t1.2077\ttime:\t0:00:00.254322\tactions:\t31\tNoise:\t0.01960\t50000\n",
      "Score (max over agents) from episode\t1710:\t0.10\tAverage Score:\t1.1827\ttime:\t0:00:00.359067\tactions:\t52\tNoise:\t0.01956\t50000\n",
      "Score (max over agents) from episode\t1711:\t0.10\tAverage Score:\t1.1827\ttime:\t0:00:00.266314\tactions:\t30\tNoise:\t0.01952\t50000\n",
      "Score (max over agents) from episode\t1712:\t0.10\tAverage Score:\t1.1577\ttime:\t0:00:00.265802\tactions:\t30\tNoise:\t0.01948\t50000\n",
      "Score (max over agents) from episode\t1713:\t0.10\tAverage Score:\t1.1317\ttime:\t0:00:00.291243\tactions:\t32\tNoise:\t0.01944\t50000\n",
      "Score (max over agents) from episode\t1714:\t0.20\tAverage Score:\t1.1077\ttime:\t0:00:00.493727\tactions:\t90\tNoise:\t0.01940\t50000\n",
      "Score (max over agents) from episode\t1715:\t0.19\tAverage Score:\t1.0966\ttime:\t0:00:00.485018\tactions:\t82\tNoise:\t0.01937\t50000\n",
      "Score (max over agents) from episode\t1716:\t0.10\tAverage Score:\t1.0716\ttime:\t0:00:00.255948\tactions:\t31\tNoise:\t0.01933\t50000\n",
      "Score (max over agents) from episode\t1717:\t0.10\tAverage Score:\t1.0526\ttime:\t0:00:00.262301\tactions:\t30\tNoise:\t0.01929\t50000\n",
      "Score (max over agents) from episode\t1718:\t0.10\tAverage Score:\t1.0346\ttime:\t0:00:00.272576\tactions:\t30\tNoise:\t0.01925\t50000\n",
      "Score (max over agents) from episode\t1719:\t0.10\tAverage Score:\t1.0236\ttime:\t0:00:00.284003\tactions:\t31\tNoise:\t0.01921\t50000\n",
      "Score (max over agents) from episode\t1720:\t0.10\tAverage Score:\t1.0126\ttime:\t0:00:00.266008\tactions:\t30\tNoise:\t0.01917\t50000\n",
      "Score (max over agents) from episode\t1721:\t0.20\tAverage Score:\t1.0127\ttime:\t0:00:00.521484\tactions:\t107\tNoise:\t0.01913\t50000\n",
      "Score (max over agents) from episode\t1722:\t0.20\tAverage Score:\t1.0137\ttime:\t0:00:00.420723\tactions:\t69\tNoise:\t0.01910\t50000\n",
      "Score (max over agents) from episode\t1723:\t0.10\tAverage Score:\t1.0137\ttime:\t0:00:00.271276\tactions:\t30\tNoise:\t0.01906\t50000\n",
      "Score (max over agents) from episode\t1724:\t0.09\tAverage Score:\t1.0136\ttime:\t0:00:00.260815\tactions:\t30\tNoise:\t0.01902\t50000\n",
      "Score (max over agents) from episode\t1725:\t0.10\tAverage Score:\t1.0136\ttime:\t0:00:00.260307\tactions:\t30\tNoise:\t0.01898\t50000\n",
      "Score (max over agents) from episode\t1726:\t1.40\tAverage Score:\t1.0226\ttime:\t0:00:01.790893\tactions:\t527\tNoise:\t0.01894\t50000\n",
      "Score (max over agents) from episode\t1727:\t0.10\tAverage Score:\t1.0226\ttime:\t0:00:00.255827\tactions:\t30\tNoise:\t0.01891\t50000\n",
      "Score (max over agents) from episode\t1728:\t2.60\tAverage Score:\t1.0476\ttime:\t0:00:03.362464\tactions:\t1001\tNoise:\t0.01887\t50000\n",
      "Score (max over agents) from episode\t1729:\t2.70\tAverage Score:\t1.0736\ttime:\t0:00:03.790881\tactions:\t1001\tNoise:\t0.01883\t50000\n",
      "Score (max over agents) from episode\t1730:\t1.30\tAverage Score:\t1.0856\ttime:\t0:00:01.773672\tactions:\t495\tNoise:\t0.01879\t50000\n",
      "Score (max over agents) from episode\t1731:\t1.60\tAverage Score:\t1.1007\ttime:\t0:00:02.112890\tactions:\t622\tNoise:\t0.01876\t50000\n",
      "Score (max over agents) from episode\t1732:\t2.60\tAverage Score:\t1.1258\ttime:\t0:00:03.321705\tactions:\t1001\tNoise:\t0.01872\t50000\n",
      "Score (max over agents) from episode\t1733:\t0.10\tAverage Score:\t1.1258\ttime:\t0:00:00.245346\tactions:\t22\tNoise:\t0.01868\t50000\n",
      "Score (max over agents) from episode\t1734:\t0.10\tAverage Score:\t1.1248\ttime:\t0:00:00.259309\tactions:\t30\tNoise:\t0.01864\t50000\n",
      "Score (max over agents) from episode\t1735:\t2.60\tAverage Score:\t1.1499\ttime:\t0:00:03.534616\tactions:\t1001\tNoise:\t0.01861\t50000\n",
      "Score (max over agents) from episode\t1736:\t2.70\tAverage Score:\t1.1760\ttime:\t0:00:03.145405\tactions:\t1001\tNoise:\t0.01857\t50000\n",
      "Score (max over agents) from episode\t1738:\t2.20\tAverage Score:\t1.1961\ttime:\t0:00:02.625293\tactions:\t852\tNoise:\t0.01849\t50000\n",
      "Score (max over agents) from episode\t1739:\t0.10\tAverage Score:\t1.1962\ttime:\t0:00:00.284260\tactions:\t37\tNoise:\t0.01846\t50000\n",
      "Score (max over agents) from episode\t1740:\t0.10\tAverage Score:\t1.1962\ttime:\t0:00:00.277768\tactions:\t30\tNoise:\t0.01842\t50000\n",
      "Score (max over agents) from episode\t1741:\t2.60\tAverage Score:\t1.2213\ttime:\t0:00:03.160160\tactions:\t1001\tNoise:\t0.01838\t50000\n",
      "Score (max over agents) from episode\t1742:\t0.90\tAverage Score:\t1.2294\ttime:\t0:00:01.204434\tactions:\t327\tNoise:\t0.01835\t50000\n",
      "Score (max over agents) from episode\t1743:\t0.50\tAverage Score:\t1.2325\ttime:\t0:00:00.718085\tactions:\t185\tNoise:\t0.01831\t50000\n",
      "Score (max over agents) from episode\t1744:\t2.40\tAverage Score:\t1.2556\ttime:\t0:00:02.927023\tactions:\t929\tNoise:\t0.01827\t50000\n",
      "Score (max over agents) from episode\t1745:\t2.20\tAverage Score:\t1.2767\ttime:\t0:00:02.660067\tactions:\t853\tNoise:\t0.01824\t50000\n",
      "Score (max over agents) from episode\t1746:\t2.60\tAverage Score:\t1.3017\ttime:\t0:00:03.091790\tactions:\t1001\tNoise:\t0.01820\t50000\n",
      "Score (max over agents) from episode\t1747:\t2.70\tAverage Score:\t1.3277\ttime:\t0:00:03.090473\tactions:\t1001\tNoise:\t0.01816\t50000\n",
      "Score (max over agents) from episode\t1748:\t2.60\tAverage Score:\t1.3527\ttime:\t0:00:03.064197\tactions:\t1001\tNoise:\t0.01813\t50000\n",
      "Score (max over agents) from episode\t1749:\t0.10\tAverage Score:\t1.3527\ttime:\t0:00:00.332114\tactions:\t58\tNoise:\t0.01809\t50000\n",
      "Score (max over agents) from episode\t1750:\t0.10\tAverage Score:\t1.3528\ttime:\t0:00:00.258311\tactions:\t30\tNoise:\t0.01806\t50000\n",
      "Score (max over agents) from episode\t1751:\t0.10\tAverage Score:\t1.3488\ttime:\t0:00:00.268285\tactions:\t30\tNoise:\t0.01802\t50000\n",
      "Score (max over agents) from episode\t1752:\t0.50\tAverage Score:\t1.3518\ttime:\t0:00:00.793883\tactions:\t184\tNoise:\t0.01798\t50000\n",
      "Score (max over agents) from episode\t1753:\t0.10\tAverage Score:\t1.3518\ttime:\t0:00:00.249336\tactions:\t31\tNoise:\t0.01795\t50000\n",
      "Score (max over agents) from episode\t1754:\t0.30\tAverage Score:\t1.3538\ttime:\t0:00:00.626022\tactions:\t128\tNoise:\t0.01791\t50000\n",
      "Score (max over agents) from episode\t1755:\t0.19\tAverage Score:\t1.3547\ttime:\t0:00:00.388984\tactions:\t71\tNoise:\t0.01788\t50000\n",
      "Score (max over agents) from episode\t1756:\t0.09\tAverage Score:\t1.3546\ttime:\t0:00:00.256340\tactions:\t30\tNoise:\t0.01784\t50000\n",
      "Score (max over agents) from episode\t1757:\t0.10\tAverage Score:\t1.3526\ttime:\t0:00:00.252352\tactions:\t29\tNoise:\t0.01780\t50000\n",
      "Score (max over agents) from episode\t1758:\t0.30\tAverage Score:\t1.3526\ttime:\t0:00:00.555185\tactions:\t110\tNoise:\t0.01777\t50000\n",
      "Score (max over agents) from episode\t1760:\t0.30\tAverage Score:\t1.3496\ttime:\t0:00:00.570480\tactions:\t127\tNoise:\t0.01770\t50000\n",
      "Score (max over agents) from episode\t1761:\t0.10\tAverage Score:\t1.3456\ttime:\t0:00:00.245345\tactions:\t31\tNoise:\t0.01766\t50000\n",
      "Score (max over agents) from episode\t1762:\t0.10\tAverage Score:\t1.3456\ttime:\t0:00:00.273272\tactions:\t30\tNoise:\t0.01763\t50000\n",
      "Score (max over agents) from episode\t1763:\t0.10\tAverage Score:\t1.3456\ttime:\t0:00:00.269282\tactions:\t31\tNoise:\t0.01759\t50000\n",
      "Score (max over agents) from episode\t1764:\t0.30\tAverage Score:\t1.3416\ttime:\t0:00:00.523604\tactions:\t109\tNoise:\t0.01756\t50000\n",
      "Score (max over agents) from episode\t1765:\t0.10\tAverage Score:\t1.3416\ttime:\t0:00:00.263807\tactions:\t30\tNoise:\t0.01752\t50000\n",
      "Score (max over agents) from episode\t1766:\t0.60\tAverage Score:\t1.3216\ttime:\t0:00:00.954653\tactions:\t242\tNoise:\t0.01749\t50000\n",
      "Score (max over agents) from episode\t1767:\t0.10\tAverage Score:\t1.2966\ttime:\t0:00:00.240866\tactions:\t30\tNoise:\t0.01745\t50000\n",
      "Score (max over agents) from episode\t1768:\t0.10\tAverage Score:\t1.2706\ttime:\t0:00:00.254831\tactions:\t29\tNoise:\t0.01742\t50000\n",
      "Score (max over agents) from episode\t1769:\t0.10\tAverage Score:\t1.2456\ttime:\t0:00:00.359043\tactions:\t52\tNoise:\t0.01738\t50000\n",
      "Score (max over agents) from episode\t1770:\t0.10\tAverage Score:\t1.2196\ttime:\t0:00:00.267287\tactions:\t31\tNoise:\t0.01735\t50000\n",
      "Score (max over agents) from episode\t1771:\t0.40\tAverage Score:\t1.1976\ttime:\t0:00:00.664796\tactions:\t148\tNoise:\t0.01731\t50000\n",
      "Score (max over agents) from episode\t1772:\t0.10\tAverage Score:\t1.1716\ttime:\t0:00:00.378390\tactions:\t56\tNoise:\t0.01728\t50000\n",
      "Score (max over agents) from episode\t1773:\t0.40\tAverage Score:\t1.1496\ttime:\t0:00:00.712741\tactions:\t167\tNoise:\t0.01724\t50000\n",
      "Score (max over agents) from episode\t1774:\t0.30\tAverage Score:\t1.1256\ttime:\t0:00:00.530585\tactions:\t116\tNoise:\t0.01721\t50000\n",
      "Score (max over agents) from episode\t1775:\t0.10\tAverage Score:\t1.1006\ttime:\t0:00:00.272276\tactions:\t31\tNoise:\t0.01717\t50000\n",
      "Score (max over agents) from episode\t1776:\t0.10\tAverage Score:\t1.0746\ttime:\t0:00:00.266819\tactions:\t32\tNoise:\t0.01714\t50000\n",
      "Score (max over agents) from episode\t1777:\t0.10\tAverage Score:\t1.0496\ttime:\t0:00:00.260815\tactions:\t31\tNoise:\t0.01711\t50000\n",
      "Score (max over agents) from episode\t1778:\t0.39\tAverage Score:\t1.0265\ttime:\t0:00:00.726425\tactions:\t164\tNoise:\t0.01707\t50000\n",
      "Score (max over agents) from episode\t1779:\t0.10\tAverage Score:\t1.0275\ttime:\t0:00:00.350066\tactions:\t56\tNoise:\t0.01704\t50000\n",
      "Score (max over agents) from episode\t1780:\t0.20\tAverage Score:\t1.0035\ttime:\t0:00:00.401050\tactions:\t71\tNoise:\t0.01700\t50000\n",
      "Score (max over agents) from episode\t1781:\t0.20\tAverage Score:\t0.9785\ttime:\t0:00:00.392692\tactions:\t71\tNoise:\t0.01697\t50000\n",
      "Score (max over agents) from episode\t1782:\t0.20\tAverage Score:\t0.9545\ttime:\t0:00:00.413897\tactions:\t70\tNoise:\t0.01693\t50000\n",
      "Score (max over agents) from episode\t1783:\t0.10\tAverage Score:\t0.9285\ttime:\t0:00:00.343086\tactions:\t52\tNoise:\t0.01690\t50000\n",
      "Score (max over agents) from episode\t1784:\t0.10\tAverage Score:\t0.9035\ttime:\t0:00:00.263297\tactions:\t32\tNoise:\t0.01687\t50000\n",
      "Score (max over agents) from episode\t1785:\t0.10\tAverage Score:\t0.8865\ttime:\t0:00:00.256318\tactions:\t30\tNoise:\t0.01683\t50000\n",
      "Score (max over agents) from episode\t1786:\t0.40\tAverage Score:\t0.8645\ttime:\t0:00:00.743624\tactions:\t166\tNoise:\t0.01680\t50000\n",
      "Score (max over agents) from episode\t1787:\t0.30\tAverage Score:\t0.8415\ttime:\t0:00:00.557520\tactions:\t127\tNoise:\t0.01677\t50000\n",
      "Score (max over agents) from episode\t1788:\t0.20\tAverage Score:\t0.8175\ttime:\t0:00:00.443748\tactions:\t89\tNoise:\t0.01673\t50000\n",
      "Score (max over agents) from episode\t1789:\t0.30\tAverage Score:\t0.7935\ttime:\t0:00:00.588649\tactions:\t128\tNoise:\t0.01670\t50000\n",
      "Score (max over agents) from episode\t1790:\t0.10\tAverage Score:\t0.7685\ttime:\t0:00:00.246344\tactions:\t31\tNoise:\t0.01667\t50000\n",
      "Score (max over agents) from episode\t1791:\t0.10\tAverage Score:\t0.7635\ttime:\t0:00:00.260306\tactions:\t31\tNoise:\t0.01663\t50000\n",
      "Score (max over agents) from episode\t1792:\t0.20\tAverage Score:\t0.7635\ttime:\t0:00:00.487700\tactions:\t91\tNoise:\t0.01660\t50000\n",
      "Score (max over agents) from episode\t1793:\t0.10\tAverage Score:\t0.7635\ttime:\t0:00:00.268285\tactions:\t31\tNoise:\t0.01657\t50000\n",
      "Score (max over agents) from episode\t1794:\t0.20\tAverage Score:\t0.7645\ttime:\t0:00:00.474734\tactions:\t89\tNoise:\t0.01653\t50000\n",
      "Score (max over agents) from episode\t1795:\t0.20\tAverage Score:\t0.7465\ttime:\t0:00:00.407425\tactions:\t71\tNoise:\t0.01650\t50000\n",
      "Score (max over agents) from episode\t1796:\t0.10\tAverage Score:\t0.7465\ttime:\t0:00:00.278758\tactions:\t31\tNoise:\t0.01647\t50000\n",
      "Score (max over agents) from episode\t1797:\t0.50\tAverage Score:\t0.7255\ttime:\t0:00:00.814422\tactions:\t205\tNoise:\t0.01643\t50000\n",
      "Score (max over agents) from episode\t1798:\t1.10\tAverage Score:\t0.7095\ttime:\t0:00:01.403298\tactions:\t415\tNoise:\t0.01640\t50000\n",
      "Score (max over agents) from episode\t1799:\t2.60\tAverage Score:\t0.7095\ttime:\t0:00:03.135302\tactions:\t1001\tNoise:\t0.01637\t50000\n",
      "Score (max over agents) from episode\t1800:\t0.10\tAverage Score:\t0.6835\ttime:\t0:00:00.325133\tactions:\t40\tNoise:\t0.01634\t50000\n",
      "Score (max over agents) from episode\t1801:\t2.60\tAverage Score:\t0.6835\ttime:\t0:00:03.427405\tactions:\t1001\tNoise:\t0.01630\t50000\n",
      "Score (max over agents) from episode\t1802:\t1.10\tAverage Score:\t0.6675\ttime:\t0:00:01.476671\tactions:\t439\tNoise:\t0.01627\t50000\n",
      "Score (max over agents) from episode\t1803:\t2.60\tAverage Score:\t0.6905\ttime:\t0:00:03.244315\tactions:\t1001\tNoise:\t0.01624\t50000\n",
      "Score (max over agents) from episode\t1805:\t0.30\tAverage Score:\t0.6405\ttime:\t0:00:00.617863\tactions:\t128\tNoise:\t0.01617\t50000\n",
      "Score (max over agents) from episode\t1806:\t1.30\tAverage Score:\t0.6275\ttime:\t0:00:01.706699\tactions:\t509\tNoise:\t0.01614\t50000\n",
      "Score (max over agents) from episode\t1807:\t0.70\tAverage Score:\t0.6075\ttime:\t0:00:01.044905\tactions:\t281\tNoise:\t0.01611\t50000\n",
      "Score (max over agents) from episode\t1808:\t0.10\tAverage Score:\t0.6075\ttime:\t0:00:00.254339\tactions:\t32\tNoise:\t0.01608\t50000\n",
      "Score (max over agents) from episode\t1809:\t0.40\tAverage Score:\t0.6105\ttime:\t0:00:00.690696\tactions:\t163\tNoise:\t0.01604\t50000\n",
      "Score (max over agents) from episode\t1810:\t1.10\tAverage Score:\t0.6205\ttime:\t0:00:01.389613\tactions:\t414\tNoise:\t0.01601\t50000\n",
      "Score (max over agents) from episode\t1811:\t0.50\tAverage Score:\t0.6245\ttime:\t0:00:00.821338\tactions:\t209\tNoise:\t0.01598\t50000\n",
      "Score (max over agents) from episode\t1812:\t1.50\tAverage Score:\t0.6385\ttime:\t0:00:01.867937\tactions:\t585\tNoise:\t0.01595\t50000\n",
      "Score (max over agents) from episode\t1813:\t0.09\tAverage Score:\t0.6384\ttime:\t0:00:00.250376\tactions:\t32\tNoise:\t0.01592\t50000\n",
      "Score (max over agents) from episode\t1814:\t0.09\tAverage Score:\t0.6373\ttime:\t0:00:00.278766\tactions:\t32\tNoise:\t0.01588\t50000\n",
      "Score (max over agents) from episode\t1815:\t0.40\tAverage Score:\t0.6394\ttime:\t0:00:00.717924\tactions:\t166\tNoise:\t0.01585\t50000\n",
      "Score (max over agents) from episode\t1816:\t0.20\tAverage Score:\t0.6404\ttime:\t0:00:00.432353\tactions:\t85\tNoise:\t0.01582\t50000\n",
      "Score (max over agents) from episode\t1817:\t0.10\tAverage Score:\t0.6404\ttime:\t0:00:00.274288\tactions:\t30\tNoise:\t0.01579\t50000\n",
      "Score (max over agents) from episode\t1818:\t0.60\tAverage Score:\t0.6454\ttime:\t0:00:00.866861\tactions:\t223\tNoise:\t0.01576\t50000\n",
      "Score (max over agents) from episode\t1819:\t0.80\tAverage Score:\t0.6524\ttime:\t0:00:01.130272\tactions:\t318\tNoise:\t0.01573\t50000\n",
      "Score (max over agents) from episode\t1820:\t0.60\tAverage Score:\t0.6574\ttime:\t0:00:00.924375\tactions:\t242\tNoise:\t0.01569\t50000\n",
      "Score (max over agents) from episode\t1821:\t0.20\tAverage Score:\t0.6574\ttime:\t0:00:00.435349\tactions:\t90\tNoise:\t0.01566\t50000\n",
      "Score (max over agents) from episode\t1822:\t0.10\tAverage Score:\t0.6564\ttime:\t0:00:00.299387\tactions:\t32\tNoise:\t0.01563\t50000\n",
      "Score (max over agents) from episode\t1823:\t0.10\tAverage Score:\t0.6564\ttime:\t0:00:00.269139\tactions:\t32\tNoise:\t0.01560\t50000\n",
      "Score (max over agents) from episode\t1824:\t0.20\tAverage Score:\t0.6575\ttime:\t0:00:00.484422\tactions:\t90\tNoise:\t0.01557\t50000\n",
      "Score (max over agents) from episode\t1825:\t0.30\tAverage Score:\t0.6595\ttime:\t0:00:00.584468\tactions:\t128\tNoise:\t0.01554\t50000\n",
      "Score (max over agents) from episode\t1826:\t0.40\tAverage Score:\t0.6495\ttime:\t0:00:00.725583\tactions:\t167\tNoise:\t0.01551\t50000\n",
      "Score (max over agents) from episode\t1827:\t2.49\tAverage Score:\t0.6734\ttime:\t0:00:02.970274\tactions:\t962\tNoise:\t0.01548\t50000\n",
      "Score (max over agents) from episode\t1828:\t2.60\tAverage Score:\t0.6734\ttime:\t0:00:03.079023\tactions:\t1001\tNoise:\t0.01544\t50000\n",
      "Score (max over agents) from episode\t1830:\t2.00\tAverage Score:\t0.6534\ttime:\t0:00:02.400081\tactions:\t759\tNoise:\t0.01538\t50000\n",
      "Score (max over agents) from episode\t1831:\t0.10\tAverage Score:\t0.6384\ttime:\t0:00:00.250333\tactions:\t32\tNoise:\t0.01535\t50000\n",
      "Score (max over agents) from episode\t1832:\t2.60\tAverage Score:\t0.6384\ttime:\t0:00:03.102512\tactions:\t1001\tNoise:\t0.01532\t50000\n",
      "Score (max over agents) from episode\t1833:\t0.10\tAverage Score:\t0.6384\ttime:\t0:00:00.213084\tactions:\t24\tNoise:\t0.01529\t50000\n",
      "Score (max over agents) from episode\t1834:\t0.20\tAverage Score:\t0.6394\ttime:\t0:00:00.404098\tactions:\t71\tNoise:\t0.01526\t50000\n",
      "Score (max over agents) from episode\t1835:\t1.00\tAverage Score:\t0.6234\ttime:\t0:00:01.358928\tactions:\t388\tNoise:\t0.01523\t50000\n",
      "Score (max over agents) from episode\t1836:\t2.60\tAverage Score:\t0.6224\ttime:\t0:00:03.094956\tactions:\t1001\tNoise:\t0.01520\t50000\n",
      "Score (max over agents) from episode\t1837:\t2.40\tAverage Score:\t0.6464\ttime:\t0:00:02.786879\tactions:\t903\tNoise:\t0.01517\t50000\n",
      "Score (max over agents) from episode\t1838:\t0.90\tAverage Score:\t0.6334\ttime:\t0:00:01.209284\tactions:\t358\tNoise:\t0.01514\t50000\n",
      "Score (max over agents) from episode\t1840:\t2.60\tAverage Score:\t0.6574\ttime:\t0:00:03.181594\tactions:\t1001\tNoise:\t0.01508\t50000\n",
      "Score (max over agents) from episode\t1841:\t0.90\tAverage Score:\t0.6404\ttime:\t0:00:01.359198\tactions:\t322\tNoise:\t0.01505\t50000\n",
      "Score (max over agents) from episode\t1842:\t1.50\tAverage Score:\t0.6464\ttime:\t0:00:01.958608\tactions:\t583\tNoise:\t0.01502\t50000\n",
      "Score (max over agents) from episode\t1845:\t0.29\tAverage Score:\t0.5983\ttime:\t0:00:00.495992\tactions:\t104\tNoise:\t0.01493\t50000\n",
      "Score (max over agents) from episode\t1847:\t2.60\tAverage Score:\t0.5713\ttime:\t0:00:03.037131\tactions:\t989\tNoise:\t0.01487\t50000\n",
      "Score (max over agents) from episode\t1848:\t1.10\tAverage Score:\t0.5563\ttime:\t0:00:01.400655\tactions:\t415\tNoise:\t0.01484\t50000\n",
      "Score (max over agents) from episode\t1849:\t2.60\tAverage Score:\t0.5813\ttime:\t0:00:03.081700\tactions:\t1001\tNoise:\t0.01481\t50000\n",
      "Score (max over agents) from episode\t1850:\t2.70\tAverage Score:\t0.6073\ttime:\t0:00:03.063847\tactions:\t1001\tNoise:\t0.01478\t50000\n",
      "Score (max over agents) from episode\t1852:\t2.60\tAverage Score:\t0.6273\ttime:\t0:00:03.088389\tactions:\t1001\tNoise:\t0.01472\t50000\n",
      "Score (max over agents) from episode\t1854:\t2.60\tAverage Score:\t0.6493\ttime:\t0:00:03.279705\tactions:\t1001\tNoise:\t0.01466\t50000\n",
      "Score (max over agents) from episode\t1856:\t2.60\tAverage Score:\t0.6725\ttime:\t0:00:03.303391\tactions:\t1001\tNoise:\t0.01460\t50000\n",
      "Score (max over agents) from episode\t1857:\t2.60\tAverage Score:\t0.6975\ttime:\t0:00:03.136450\tactions:\t1001\tNoise:\t0.01457\t50000\n",
      "Score (max over agents) from episode\t1858:\t2.70\tAverage Score:\t0.7215\ttime:\t0:00:03.659101\tactions:\t1001\tNoise:\t0.01454\t50000\n",
      "Score (max over agents) from episode\t1860:\t2.60\tAverage Score:\t0.7445\ttime:\t0:00:04.111705\tactions:\t1001\tNoise:\t0.01449\t50000\n",
      "Score (max over agents) from episode\t1861:\t2.60\tAverage Score:\t0.7695\ttime:\t0:00:03.181682\tactions:\t1001\tNoise:\t0.01446\t50000\n",
      "Score (max over agents) from episode\t1862:\t2.70\tAverage Score:\t0.7955\ttime:\t0:00:03.193101\tactions:\t1001\tNoise:\t0.01443\t50000\n",
      "Score (max over agents) from episode\t1863:\t2.70\tAverage Score:\t0.8215\ttime:\t0:00:02.931868\tactions:\t1001\tNoise:\t0.01440\t50000\n",
      "Score (max over agents) from episode\t1864:\t2.60\tAverage Score:\t0.8445\ttime:\t0:00:02.952261\tactions:\t1001\tNoise:\t0.01437\t50000\n",
      "Score (max over agents) from episode\t1865:\t1.00\tAverage Score:\t0.8535\ttime:\t0:00:01.207741\tactions:\t359\tNoise:\t0.01434\t50000\n",
      "Score (max over agents) from episode\t1866:\t0.20\tAverage Score:\t0.8495\ttime:\t0:00:00.366024\tactions:\t69\tNoise:\t0.01431\t50000\n",
      "Score (max over agents) from episode\t1867:\t2.60\tAverage Score:\t0.8745\ttime:\t0:00:02.976115\tactions:\t1001\tNoise:\t0.01428\t50000\n",
      "Score (max over agents) from episode\t1868:\t0.90\tAverage Score:\t0.8825\ttime:\t0:00:01.158173\tactions:\t344\tNoise:\t0.01426\t50000\n",
      "Score (max over agents) from episode\t1869:\t0.30\tAverage Score:\t0.8845\ttime:\t0:00:00.542681\tactions:\t126\tNoise:\t0.01423\t50000\n",
      "Score (max over agents) from episode\t1870:\t0.50\tAverage Score:\t0.8885\ttime:\t0:00:00.716787\tactions:\t182\tNoise:\t0.01420\t50000\n",
      "Score (max over agents) from episode\t1871:\t0.10\tAverage Score:\t0.8855\ttime:\t0:00:00.240378\tactions:\t31\tNoise:\t0.01417\t50000\n",
      "Score (max over agents) from episode\t1872:\t2.60\tAverage Score:\t0.9105\ttime:\t0:00:02.984800\tactions:\t1001\tNoise:\t0.01414\t50000\n",
      "Score (max over agents) from episode\t1873:\t2.70\tAverage Score:\t0.9335\ttime:\t0:00:02.969437\tactions:\t1001\tNoise:\t0.01411\t50000\n",
      "Score (max over agents) from episode\t1874:\t2.60\tAverage Score:\t0.9565\ttime:\t0:00:02.944736\tactions:\t1001\tNoise:\t0.01409\t50000\n",
      "Score (max over agents) from episode\t1875:\t2.70\tAverage Score:\t0.9825\ttime:\t0:00:02.993126\tactions:\t1001\tNoise:\t0.01406\t50000\n",
      "Score (max over agents) from episode\t1876:\t2.60\tAverage Score:\t1.0075\ttime:\t0:00:02.994099\tactions:\t1001\tNoise:\t0.01403\t50000\n",
      "Score (max over agents) from episode\t1877:\t2.70\tAverage Score:\t1.0335\ttime:\t0:00:03.074874\tactions:\t1001\tNoise:\t0.01400\t50000\n",
      "Score (max over agents) from episode\t1878:\t2.60\tAverage Score:\t1.0556\ttime:\t0:00:03.131270\tactions:\t1001\tNoise:\t0.01397\t50000\n",
      "Score (max over agents) from episode\t1879:\t0.10\tAverage Score:\t1.0556\ttime:\t0:00:00.271301\tactions:\t39\tNoise:\t0.01395\t50000\n",
      "Score (max over agents) from episode\t1880:\t0.10\tAverage Score:\t1.0546\ttime:\t0:00:00.242228\tactions:\t31\tNoise:\t0.01392\t50000\n",
      "Score (max over agents) from episode\t1881:\t2.60\tAverage Score:\t1.0786\ttime:\t0:00:02.956353\tactions:\t1001\tNoise:\t0.01389\t50000\n",
      "Score (max over agents) from episode\t1882:\t2.70\tAverage Score:\t1.1036\ttime:\t0:00:03.085280\tactions:\t1001\tNoise:\t0.01386\t50000\n",
      "Score (max over agents) from episode\t1883:\t2.60\tAverage Score:\t1.1286\ttime:\t0:00:02.919769\tactions:\t1001\tNoise:\t0.01383\t50000\n",
      "Score (max over agents) from episode\t1885:\t2.60\tAverage Score:\t1.1526\ttime:\t0:00:02.894839\tactions:\t1001\tNoise:\t0.01378\t50000\n",
      "Score (max over agents) from episode\t1887:\t1.70\tAverage Score:\t1.1626\ttime:\t0:00:01.933742\tactions:\t644\tNoise:\t0.01372\t50000\n",
      "Score (max over agents) from episode\t1888:\t1.90\tAverage Score:\t1.1796\ttime:\t0:00:02.202744\tactions:\t739\tNoise:\t0.01370\t50000\n",
      "Score (max over agents) from episode\t1889:\t0.19\tAverage Score:\t1.1785\ttime:\t0:00:00.380985\tactions:\t72\tNoise:\t0.01367\t50000\n",
      "Score (max over agents) from episode\t1890:\t2.60\tAverage Score:\t1.2035\ttime:\t0:00:03.129078\tactions:\t1001\tNoise:\t0.01364\t50000\n",
      "Score (max over agents) from episode\t1892:\t0.90\tAverage Score:\t1.2095\ttime:\t0:00:01.185243\tactions:\t358\tNoise:\t0.01359\t50000\n",
      "Score (max over agents) from episode\t1893:\t0.30\tAverage Score:\t1.2115\ttime:\t0:00:00.551529\tactions:\t128\tNoise:\t0.01356\t50000\n",
      "Score (max over agents) from episode\t1894:\t1.50\tAverage Score:\t1.2245\ttime:\t0:00:01.837210\tactions:\t585\tNoise:\t0.01353\t50000\n",
      "Score (max over agents) from episode\t1895:\t0.10\tAverage Score:\t1.2235\ttime:\t0:00:00.239269\tactions:\t30\tNoise:\t0.01351\t50000\n",
      "Score (max over agents) from episode\t1896:\t0.10\tAverage Score:\t1.2235\ttime:\t0:00:00.331625\tactions:\t52\tNoise:\t0.01348\t50000\n",
      "Score (max over agents) from episode\t1897:\t0.50\tAverage Score:\t1.2235\ttime:\t0:00:00.769694\tactions:\t192\tNoise:\t0.01345\t50000\n",
      "Score (max over agents) from episode\t1898:\t0.10\tAverage Score:\t1.2135\ttime:\t0:00:00.318152\tactions:\t52\tNoise:\t0.01343\t50000\n",
      "Score (max over agents) from episode\t1899:\t0.40\tAverage Score:\t1.1915\ttime:\t0:00:00.682414\tactions:\t166\tNoise:\t0.01340\t50000\n",
      "Score (max over agents) from episode\t1900:\t0.10\tAverage Score:\t1.1915\ttime:\t0:00:00.231383\tactions:\t30\tNoise:\t0.01337\t50000\n",
      "Score (max over agents) from episode\t1901:\t0.50\tAverage Score:\t1.1705\ttime:\t0:00:00.738442\tactions:\t183\tNoise:\t0.01334\t50000\n",
      "Score (max over agents) from episode\t1902:\t0.10\tAverage Score:\t1.1605\ttime:\t0:00:00.239361\tactions:\t30\tNoise:\t0.01332\t50000\n",
      "Score (max over agents) from episode\t1903:\t1.00\tAverage Score:\t1.1445\ttime:\t0:00:01.277507\tactions:\t376\tNoise:\t0.01329\t50000\n",
      "Score (max over agents) from episode\t1904:\t0.70\tAverage Score:\t1.1515\ttime:\t0:00:00.983884\tactions:\t278\tNoise:\t0.01326\t50000\n",
      "Score (max over agents) from episode\t1905:\t0.40\tAverage Score:\t1.1525\ttime:\t0:00:00.671210\tactions:\t166\tNoise:\t0.01324\t50000\n",
      "Score (max over agents) from episode\t1906:\t1.20\tAverage Score:\t1.1515\ttime:\t0:00:01.483288\tactions:\t467\tNoise:\t0.01321\t50000\n",
      "Score (max over agents) from episode\t1907:\t2.60\tAverage Score:\t1.1705\ttime:\t0:00:02.951349\tactions:\t1001\tNoise:\t0.01319\t50000\n",
      "Score (max over agents) from episode\t1908:\t2.70\tAverage Score:\t1.1965\ttime:\t0:00:02.934068\tactions:\t1001\tNoise:\t0.01316\t50000\n",
      "Score (max over agents) from episode\t1909:\t2.60\tAverage Score:\t1.2185\ttime:\t0:00:02.954056\tactions:\t1001\tNoise:\t0.01313\t50000\n",
      "Score (max over agents) from episode\t1910:\t2.70\tAverage Score:\t1.2345\ttime:\t0:00:03.014221\tactions:\t1001\tNoise:\t0.01311\t50000\n",
      "Score (max over agents) from episode\t1911:\t2.60\tAverage Score:\t1.2555\ttime:\t0:00:02.965578\tactions:\t1001\tNoise:\t0.01308\t50000\n",
      "Score (max over agents) from episode\t1912:\t2.70\tAverage Score:\t1.2675\ttime:\t0:00:02.961228\tactions:\t1001\tNoise:\t0.01305\t50000\n",
      "Score (max over agents) from episode\t1913:\t2.30\tAverage Score:\t1.2896\ttime:\t0:00:02.694917\tactions:\t875\tNoise:\t0.01303\t50000\n",
      "Score (max over agents) from episode\t1914:\t2.60\tAverage Score:\t1.3147\ttime:\t0:00:03.003403\tactions:\t1001\tNoise:\t0.01300\t50000\n",
      "Score (max over agents) from episode\t1915:\t2.70\tAverage Score:\t1.3377\ttime:\t0:00:02.928691\tactions:\t1001\tNoise:\t0.01298\t50000\n",
      "Score (max over agents) from episode\t1916:\t0.90\tAverage Score:\t1.3447\ttime:\t0:00:01.209141\tactions:\t364\tNoise:\t0.01295\t50000\n",
      "Score (max over agents) from episode\t1917:\t2.10\tAverage Score:\t1.3647\ttime:\t0:00:02.377636\tactions:\t793\tNoise:\t0.01292\t50000\n",
      "Score (max over agents) from episode\t1918:\t2.60\tAverage Score:\t1.3847\ttime:\t0:00:03.260682\tactions:\t1001\tNoise:\t0.01290\t50000\n",
      "Score (max over agents) from episode\t1919:\t2.70\tAverage Score:\t1.4037\ttime:\t0:00:03.311823\tactions:\t1001\tNoise:\t0.01287\t50000\n",
      "Score (max over agents) from episode\t1920:\t2.60\tAverage Score:\t1.4237\ttime:\t0:00:03.339371\tactions:\t1001\tNoise:\t0.01285\t50000\n",
      "Score (max over agents) from episode\t1921:\t2.70\tAverage Score:\t1.4487\ttime:\t0:00:03.291620\tactions:\t1001\tNoise:\t0.01282\t50000\n",
      "Score (max over agents) from episode\t1922:\t0.70\tAverage Score:\t1.4547\ttime:\t0:00:00.974857\tactions:\t275\tNoise:\t0.01280\t50000\n",
      "Score (max over agents) from episode\t1923:\t2.60\tAverage Score:\t1.4797\ttime:\t0:00:02.930154\tactions:\t1001\tNoise:\t0.01277\t50000\n",
      "Score (max over agents) from episode\t1924:\t2.70\tAverage Score:\t1.5047\ttime:\t0:00:03.134119\tactions:\t1001\tNoise:\t0.01274\t50000\n",
      "Score (max over agents) from episode\t1925:\t0.90\tAverage Score:\t1.5107\ttime:\t0:00:01.328883\tactions:\t352\tNoise:\t0.01272\t50000\n",
      "Score (max over agents) from episode\t1926:\t2.60\tAverage Score:\t1.5327\ttime:\t0:00:03.419672\tactions:\t1001\tNoise:\t0.01269\t50000\n",
      "Score (max over agents) from episode\t1928:\t2.60\tAverage Score:\t1.5078\ttime:\t0:00:03.284881\tactions:\t1001\tNoise:\t0.01264\t50000\n",
      "Score (max over agents) from episode\t1929:\t2.70\tAverage Score:\t1.5348\ttime:\t0:00:03.284390\tactions:\t1001\tNoise:\t0.01262\t50000\n",
      "Score (max over agents) from episode\t1930:\t2.60\tAverage Score:\t1.5408\ttime:\t0:00:03.218728\tactions:\t1001\tNoise:\t0.01259\t50000\n",
      "Score (max over agents) from episode\t1932:\t2.60\tAverage Score:\t1.5398\ttime:\t0:00:03.492381\tactions:\t1001\tNoise:\t0.01254\t50000\n",
      "Score (max over agents) from episode\t1934:\t2.60\tAverage Score:\t1.5628\ttime:\t0:00:03.655961\tactions:\t1001\tNoise:\t0.01249\t50000\n",
      "Score (max over agents) from episode\t1935:\t2.70\tAverage Score:\t1.5798\ttime:\t0:00:03.026705\tactions:\t1001\tNoise:\t0.01247\t50000\n",
      "Score (max over agents) from episode\t1936:\t2.60\tAverage Score:\t1.5798\ttime:\t0:00:03.031989\tactions:\t1001\tNoise:\t0.01244\t50000\n",
      "Score (max over agents) from episode\t1937:\t2.70\tAverage Score:\t1.5828\ttime:\t0:00:03.005767\tactions:\t1001\tNoise:\t0.01242\t50000\n",
      "Score (max over agents) from episode\t1938:\t2.60\tAverage Score:\t1.5998\ttime:\t0:00:03.012934\tactions:\t1001\tNoise:\t0.01239\t50000\n",
      "Score (max over agents) from episode\t1939:\t2.70\tAverage Score:\t1.6268\ttime:\t0:00:03.287874\tactions:\t1001\tNoise:\t0.01237\t50000\n",
      "Score (max over agents) from episode\t1940:\t2.60\tAverage Score:\t1.6268\ttime:\t0:00:03.389938\tactions:\t1001\tNoise:\t0.01234\t50000\n",
      "Score (max over agents) from episode\t1941:\t2.60\tAverage Score:\t1.6438\ttime:\t0:00:03.255159\tactions:\t1001\tNoise:\t0.01232\t50000\n",
      "Score (max over agents) from episode\t1943:\t2.60\tAverage Score:\t1.6548\ttime:\t0:00:03.017528\tactions:\t1001\tNoise:\t0.01227\t50000\n",
      "Score (max over agents) from episode\t1944:\t2.70\tAverage Score:\t1.6818\ttime:\t0:00:02.994444\tactions:\t1001\tNoise:\t0.01224\t50000\n",
      "Score (max over agents) from episode\t1945:\t2.60\tAverage Score:\t1.7049\ttime:\t0:00:03.053438\tactions:\t1001\tNoise:\t0.01222\t50000\n",
      "Score (max over agents) from episode\t1946:\t2.60\tAverage Score:\t1.7309\ttime:\t0:00:02.959391\tactions:\t1001\tNoise:\t0.01220\t50000\n",
      "Score (max over agents) from episode\t1947:\t2.60\tAverage Score:\t1.7309\ttime:\t0:00:03.026675\tactions:\t1001\tNoise:\t0.01217\t50000\n",
      "Score (max over agents) from episode\t1948:\t1.40\tAverage Score:\t1.7339\ttime:\t0:00:01.677985\tactions:\t526\tNoise:\t0.01215\t50000\n",
      "Score (max over agents) from episode\t1949:\t2.60\tAverage Score:\t1.7339\ttime:\t0:00:02.997441\tactions:\t1001\tNoise:\t0.01212\t50000\n",
      "Score (max over agents) from episode\t1950:\t0.60\tAverage Score:\t1.7129\ttime:\t0:00:00.808458\tactions:\t235\tNoise:\t0.01210\t50000\n",
      "Score (max over agents) from episode\t1951:\t0.80\tAverage Score:\t1.7209\ttime:\t0:00:01.032988\tactions:\t316\tNoise:\t0.01207\t50000\n",
      "Score (max over agents) from episode\t1952:\t0.80\tAverage Score:\t1.7029\ttime:\t0:00:01.040052\tactions:\t316\tNoise:\t0.01205\t50000\n",
      "Score (max over agents) from episode\t1953:\t0.40\tAverage Score:\t1.7069\ttime:\t0:00:00.565492\tactions:\t146\tNoise:\t0.01203\t50000\n",
      "Score (max over agents) from episode\t1954:\t0.40\tAverage Score:\t1.6849\ttime:\t0:00:00.576918\tactions:\t145\tNoise:\t0.01200\t50000\n",
      "Score (max over agents) from episode\t1955:\t0.50\tAverage Score:\t1.6899\ttime:\t0:00:00.723579\tactions:\t202\tNoise:\t0.01198\t50000\n",
      "Score (max over agents) from episode\t1956:\t0.40\tAverage Score:\t1.6679\ttime:\t0:00:00.572064\tactions:\t145\tNoise:\t0.01195\t50000\n",
      "Score (max over agents) from episode\t1957:\t0.50\tAverage Score:\t1.6469\ttime:\t0:00:00.708111\tactions:\t196\tNoise:\t0.01193\t50000\n",
      "Score (max over agents) from episode\t1958:\t0.40\tAverage Score:\t1.6239\ttime:\t0:00:00.567559\tactions:\t147\tNoise:\t0.01191\t50000\n",
      "Score (max over agents) from episode\t1959:\t1.20\tAverage Score:\t1.6359\ttime:\t0:00:01.406768\tactions:\t453\tNoise:\t0.01188\t50000\n",
      "Score (max over agents) from episode\t1960:\t0.20\tAverage Score:\t1.6119\ttime:\t0:00:00.474912\tactions:\t92\tNoise:\t0.01186\t50000\n",
      "Score (max over agents) from episode\t1961:\t0.70\tAverage Score:\t1.5929\ttime:\t0:00:01.075221\tactions:\t259\tNoise:\t0.01183\t50000\n",
      "Score (max over agents) from episode\t1962:\t0.10\tAverage Score:\t1.5669\ttime:\t0:00:00.264296\tactions:\t31\tNoise:\t0.01181\t50000\n",
      "Score (max over agents) from episode\t1963:\t0.10\tAverage Score:\t1.5409\ttime:\t0:00:00.366023\tactions:\t61\tNoise:\t0.01179\t50000\n",
      "Score (max over agents) from episode\t1964:\t0.10\tAverage Score:\t1.5159\ttime:\t0:00:00.265801\tactions:\t32\tNoise:\t0.01176\t50000\n",
      "Score (max over agents) from episode\t1965:\t0.60\tAverage Score:\t1.5119\ttime:\t0:00:00.957466\tactions:\t244\tNoise:\t0.01174\t50000\n",
      "Score (max over agents) from episode\t1966:\t0.10\tAverage Score:\t1.5109\ttime:\t0:00:00.278278\tactions:\t31\tNoise:\t0.01172\t50000\n",
      "Score (max over agents) from episode\t1967:\t0.30\tAverage Score:\t1.4879\ttime:\t0:00:00.591244\tactions:\t127\tNoise:\t0.01169\t50000\n",
      "Score (max over agents) from episode\t1968:\t0.10\tAverage Score:\t1.4799\ttime:\t0:00:00.361046\tactions:\t52\tNoise:\t0.01167\t50000\n",
      "Score (max over agents) from episode\t1969:\t0.20\tAverage Score:\t1.4789\ttime:\t0:00:00.470436\tactions:\t90\tNoise:\t0.01165\t50000\n",
      "Score (max over agents) from episode\t1970:\t0.10\tAverage Score:\t1.4749\ttime:\t0:00:00.276262\tactions:\t31\tNoise:\t0.01162\t50000\n",
      "Score (max over agents) from episode\t1971:\t0.10\tAverage Score:\t1.4749\ttime:\t0:00:00.341091\tactions:\t52\tNoise:\t0.01160\t50000\n",
      "Score (max over agents) from episode\t1972:\t0.10\tAverage Score:\t1.4499\ttime:\t0:00:00.265293\tactions:\t31\tNoise:\t0.01158\t50000\n",
      "Score (max over agents) from episode\t1973:\t0.10\tAverage Score:\t1.4239\ttime:\t0:00:00.276855\tactions:\t31\tNoise:\t0.01155\t50000\n",
      "Score (max over agents) from episode\t1974:\t0.10\tAverage Score:\t1.3989\ttime:\t0:00:00.269006\tactions:\t30\tNoise:\t0.01153\t50000\n",
      "Score (max over agents) from episode\t1975:\t0.10\tAverage Score:\t1.3729\ttime:\t0:00:00.270962\tactions:\t31\tNoise:\t0.01151\t50000\n",
      "Score (max over agents) from episode\t1976:\t0.10\tAverage Score:\t1.3479\ttime:\t0:00:00.348995\tactions:\t52\tNoise:\t0.01148\t50000\n",
      "Score (max over agents) from episode\t1977:\t0.20\tAverage Score:\t1.3229\ttime:\t0:00:00.403952\tactions:\t71\tNoise:\t0.01146\t50000\n",
      "Score (max over agents) from episode\t1978:\t0.10\tAverage Score:\t1.2979\ttime:\t0:00:00.345080\tactions:\t52\tNoise:\t0.01144\t50000\n",
      "Score (max over agents) from episode\t1979:\t0.10\tAverage Score:\t1.2979\ttime:\t0:00:00.292730\tactions:\t31\tNoise:\t0.01142\t50000\n",
      "Score (max over agents) from episode\t1980:\t0.10\tAverage Score:\t1.2979\ttime:\t0:00:00.267316\tactions:\t31\tNoise:\t0.01139\t50000\n",
      "Score (max over agents) from episode\t1981:\t0.10\tAverage Score:\t1.2729\ttime:\t0:00:00.260033\tactions:\t30\tNoise:\t0.01137\t50000\n",
      "Score (max over agents) from episode\t1982:\t0.20\tAverage Score:\t1.2479\ttime:\t0:00:00.397659\tactions:\t70\tNoise:\t0.01135\t50000\n",
      "Score (max over agents) from episode\t1983:\t0.10\tAverage Score:\t1.2229\ttime:\t0:00:00.271277\tactions:\t30\tNoise:\t0.01132\t50000\n",
      "Score (max over agents) from episode\t1984:\t0.09\tAverage Score:\t1.2238\ttime:\t0:00:00.286906\tactions:\t32\tNoise:\t0.01130\t50000\n",
      "Score (max over agents) from episode\t1985:\t0.09\tAverage Score:\t1.1987\ttime:\t0:00:00.266290\tactions:\t30\tNoise:\t0.01128\t50000\n",
      "Score (max over agents) from episode\t1986:\t0.10\tAverage Score:\t1.1997\ttime:\t0:00:00.351178\tactions:\t53\tNoise:\t0.01126\t50000\n",
      "Score (max over agents) from episode\t1987:\t0.10\tAverage Score:\t1.1837\ttime:\t0:00:00.280704\tactions:\t31\tNoise:\t0.01123\t50000\n",
      "Score (max over agents) from episode\t1988:\t0.09\tAverage Score:\t1.1656\ttime:\t0:00:00.283998\tactions:\t32\tNoise:\t0.01121\t50000\n",
      "Score (max over agents) from episode\t1989:\t0.20\tAverage Score:\t1.1657\ttime:\t0:00:00.398000\tactions:\t69\tNoise:\t0.01119\t50000\n",
      "Score (max over agents) from episode\t1990:\t0.09\tAverage Score:\t1.1406\ttime:\t0:00:00.269282\tactions:\t32\tNoise:\t0.01117\t50000\n",
      "Score (max over agents) from episode\t1991:\t0.30\tAverage Score:\t1.1436\ttime:\t0:00:00.613799\tactions:\t135\tNoise:\t0.01114\t50000\n",
      "Score (max over agents) from episode\t1992:\t0.09\tAverage Score:\t1.1355\ttime:\t0:00:00.271277\tactions:\t31\tNoise:\t0.01112\t50000\n",
      "Score (max over agents) from episode\t1993:\t0.10\tAverage Score:\t1.1335\ttime:\t0:00:00.277768\tactions:\t32\tNoise:\t0.01110\t50000\n",
      "Score (max over agents) from episode\t1994:\t0.10\tAverage Score:\t1.1195\ttime:\t0:00:00.352115\tactions:\t52\tNoise:\t0.01108\t50000\n",
      "Score (max over agents) from episode\t1995:\t0.70\tAverage Score:\t1.1255\ttime:\t0:00:01.094429\tactions:\t281\tNoise:\t0.01106\t50000\n",
      "Score (max over agents) from episode\t1996:\t0.10\tAverage Score:\t1.1255\ttime:\t0:00:00.267288\tactions:\t31\tNoise:\t0.01103\t50000\n",
      "Score (max over agents) from episode\t1997:\t0.10\tAverage Score:\t1.1215\ttime:\t0:00:00.279280\tactions:\t31\tNoise:\t0.01101\t50000\n",
      "Score (max over agents) from episode\t1998:\t0.30\tAverage Score:\t1.1235\ttime:\t0:00:00.543550\tactions:\t109\tNoise:\t0.01099\t50000\n",
      "Score (max over agents) from episode\t1999:\t0.20\tAverage Score:\t1.1215\ttime:\t0:00:00.420878\tactions:\t71\tNoise:\t0.01097\t50000\n",
      "Score (max over agents) from episode\t2000:\t1.70\tAverage Score:\t1.1375\ttime:\t0:00:02.275361\tactions:\t662\tNoise:\t0.01095\t50000\n",
      "Solved in episode 1314\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "[None, None]"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#runtime config\n",
    "episodes = 2000\n",
    "expected_score = 0.5\n",
    "seeding(config['seed']['agent'])\n",
    "actor_loss = []\n",
    "critic_loss = []\n",
    "for i in range(100):\n",
    "    scores_window.append(0)\n",
    "for episode in range(1, episodes+1):                                    # play game for n episodes\n",
    "    start = datetime.datetime.now()\n",
    "    ep_scores = np.zeros(num_agents)                          # initialize the score (for each agent)\n",
    "    count = 0\n",
    "    \n",
    "    env_info = env.reset(train_mode=True)[brain_name]     # reset the environment    \n",
    "    states = env_info.vector_observations                  # get the current state (for each agent)\n",
    "    states = concatStates(env_info.vector_observations)\n",
    "    \n",
    "    maddpg.resetNoise()\n",
    "    while True:        \n",
    "        count += 1\n",
    "        actions = maddpg.act(states, noise=noise)                       # select an action (for each agent)\n",
    "        env_info = env.step(actions)[brain_name]           # send all actions to tne environment\n",
    "        next_states = concatStates(env_info.vector_observations)         # get next state (for each agent)\n",
    "        \n",
    "        rewards = env_info.rewards                         # get reward (for each agent)\n",
    "        dones = env_info.local_done                        # see if episode finished\n",
    "        ep_scores += env_info.rewards                         # update the score (for each agent)\n",
    "        \n",
    "        [buffer.add(states[i], actions[i], sum(rewards), next_states[i], dones[i]) for i in range(num_agents)]\n",
    "        \n",
    "        \n",
    "        states = next_states                               # roll over states to next time step\n",
    "        if np.any(dones):                                  # exit loop if episode finished\n",
    "            break\n",
    "    \n",
    "    for i in range(config['train_per_episode']):         \n",
    "        if (config['BATCH_SIZE'] <= len(buffer)):\n",
    "            aloss=[]\n",
    "            closs=[]\n",
    "            for i in range(num_agents):\n",
    "                loss = maddpg.update(buffer.sample(), i)\n",
    "                aloss.append(loss[0])   \n",
    "                closs.append(loss[1])\n",
    "            actor_loss.append(aloss)\n",
    "            critic_loss.append(closs)\n",
    "        \n",
    "    noise *= noise_decay\n",
    "    \n",
    "    took = datetime.datetime.now() -start    \n",
    "    ep_score = np.max(ep_scores)\n",
    "    scores.append(ep_score)\n",
    "    scores_window.append(ep_score)\n",
    "    avg_score = np.mean(scores_window)\n",
    "    avg_scores.append(avg_score)    \n",
    "    game_length.append(count)\n",
    "    game_length_window.append(count)\n",
    "    avg_game_length.append(np.mean(game_length_window))\n",
    "    if (ep_score > 0 or episode%10 == 0):\n",
    "        print('Score (max over agents) from episode\\t{}:\\t{:.2f}\\tAverage Score:\\t{:.4f}\\ttime:\\t{:s}\\tactions:\\t{}\\tNoise:\\t{:.5f}\\t{:d}'.format(episode, ep_score, avg_score, str(took), count, noise, len(buffer)))\n",
    "    if (solved_episode < 0 and avg_score >= expected_score):\n",
    "        print('Solved in episode {:d}'.format(episode))\n",
    "        solved_episode = episode\n",
    "        [torch.save(actor.state_dict(), 'solved_{:d}_actor{}_local.pth'.format(episode,i))for i, actor in enumerate(maddpg.get_actors())]\n",
    "        [torch.save(critic.state_dict(), 'solved_{:d}_critic{}_local.pth'.format(episode,i))for i, critic in enumerate(maddpg.get_critics())]        \n",
    "\n",
    "print('Solved in episode {}'.format(solved_episode))\n",
    "\n",
    "[torch.save(actor.state_dict(), 'end_actor{}_local.pth'.format(i))for i, actor in enumerate(maddpg.get_actors())]\n",
    "[torch.save(critic.state_dict(), 'end_critic{}_local.pth'.format(i))for i, critic in enumerate(maddpg.get_critics())] "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "When finished, you can close the environment."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "env.close()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYIAAAEGCAYAAABo25JHAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjEsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+j8jraAAAgAElEQVR4nO2deZxcRbX4v6e7Z59JJrMkGQIhIYEQkCUQwyIgIjsoICqogPp88vDpU36uqE/EHfWJqGyCC6ICLqAiqxj2PQshC9kXsmcmM5kts/VSvz/u7Z7et+nby/T5fj7zme66deuee7u7TtWpU+eIMQZFURSlfHEVWgBFURSlsKgiUBRFKXNUESiKopQ5qggURVHKHFUEiqIoZY6n0AJkSktLi5kxY0ahxVAURSkplixZstcY0xrvWMkpghkzZrB48eJCi6EoilJSiMhbiY6paUhRFKXMUUWgKIpS5qgiUBRFKXNUESiKopQ5qggURVHKHFUEiqIoZY4qAkVRlDKn5PYRKIqSPnv7h1m8ZR/nvm1qRHkgYPjrku1cctw0Ktyj48Gn17bz+5ffYvn2bvb2jwBwcHMtLfVVXHBUG1MmVHPB0W2h+j5/gAeX7uDS4w9EgL8u2c7F86ZR6XGxrWuAc29+jv0jfj57xmw6+od515zJ3PX8Jt7qHKC9b5jPnjGbz589J9Tepo5+Fm3p4jcvbOHrF8xld88Qlx5/IG6XRMj/q+c3Mam2kqkTqzmgsYaZLXVx739n9yAn3/gUAEceMIErTzyYjr5hfvLkOr590ZFcddIM/AHDA0u2A3DSrGbe3NXLOUdOjdteKpa81cXe/hEWrt7D5Qumc+39yzh5VjOfftdsDmqqBeAn/1rLLU9voKHKw/lHtVHpcfHI8l1875KjYj6nfCGllo9g/vz5RjeUKUp6nP+z53lzVy8rv3UO9VWj474/L97Gl/+6nC+fO4f/Pn12qHzGdY+kbPPVr72bKROqAfj1C5v5zsNv8p2L30Z9lZv/96c3+H9nHsbnzjw0rbYA1n/vvJAyinfOD953FB9aMD30fv+wjyO/+UREnS03XhC37VQybLnxAu59dStf+9uKhDJlQqLrVbpdrPveeSll2vj982OUXq4QkSXGmPnxjqlpSFHGMZv29gMQ3bV0D1ij/U571J8J4WPHzv5hq739I3QPeK2y/cMZtefzJx+M7huIlHHYF8io/VR09MXKm0qmTBnxWzIHAsnb9fpze2/poopAUcYxwQ4tepQptmrIZuzpcY+eJTL6P1iaaZveQPLOT6Ja9KWonyn+OO2lkilbUrXrS6EonEIVgaKMYxJ1LAZj/88cT5hSCc4OjBltK9M2U42+TVSLuR6te+M8o1xfI912fTojUBTFKXK5FBg9Qh8rmZpDcm0+8cYxNTlloknV7ogqAkVR8kU801Aq+3WQ8BF6TkxDKTq/WNNQbkfr8dpzThGkmhGoaUhRlDwRXIA1wLDPz/5hX9p28SFvgMERPx19w+zuGQ6VDXj9AHT0D2dk4tg/7Gft7j6Gff64x8MVjzEmqwXuZMRbc0jUIXv9Adbu7otQFHv7h9ndMxR30TmcwRF/yvWN3iFvGhLnHt1HoChlxqMrdnHbMxtD79/7ixdZu6ePVd86J63zT/zBwpiyW57eENb+bh5d8Vja8pxz83Np173tmY38+Im1MeU9g14m1lSk3U448Tr9RDOCQ79u3VdjbQXLrj+b9Xv6OOun6ck/9/rHef7L70pa59ybn0/oCuskOiNQlDIgfFT90sa9EcfW7umz6xQn4aahJ1btjlunZyD+SPqQ1vgbzcLJZv0k6CobfHbpUqzbtlQRKEqZEd4ZFWvHlCnRnkVBPC7hvBS7dWUMa9/+Arl75hpVBIpSZpRy1+XMntvsSbX4G00ihVVoVBEoShlTrB1TPhnLjKBQfv+5xjFFICIHicjTIrJaRFaJyOfi1DldRHpEZJn9d71T8ihKOZOOOajU4o6lQzq3FK9Ouk8iU1fWYn3ETnoN+YAvGGOWikgDsEREnjTGvBlV73ljzIUOyqEoSgKKtWPKlGT3MZYRfyp0RpACY8wuY8xS+3UfsBqY5tT1FEVJl9Lq/Z3syMfafqFiA+WavKwRiMgMYB7wapzDJ4nIGyLymIgcmeD8q0VksYgs7ujocFBSRSkvSsEcFCFigl67UHeRsWnIITnGiuOKQETqgQeAa40xvVGHlwIHG2OOAX4B/D1eG8aYO40x840x81tbW50VWFHGIeEdUMI1grxI4gy5VmjpNlcCejQtHFUEIlKBpQT+aIx5MPq4MabXGNNvv34UqBCRFidlUpRyp9Q6r7GYbkrsVguGk15DAvwaWG2MuSlBnal2PURkgS1Pp1MyKYoSFbungHKkS1qeP0mO5TpaakTbGTZdrKY4J72G3gFcCawQkWV22deA6QDGmDuA9wOfEhEfMAhcbor1SSnKOER/bTCWbWrj5fk5pgiMMS+Q4gkbY24BbnFKBkVRLMLHVxF7CkpgThA+6i62ncWZUqxPW3cWK0qZkagzKuXRba5lLwUFmUtUEShKmTEeg84lQi3N6aGKQFHKmPHTTSbbWpw/KVJRrHpJFYGilBmlbPZwYpex0zuXSwFVBIpSBpgEb4p1hJoppXMfxSmoKgJFKTMSdkXF2UelRcIF8GzbK+FnkQ2qCBSlrBn/PZ5aflKjikBRxsie3qFCi5A142XkWyr3UaxyqiJQlDGwaEsXJ3x/If9YtqPQoiQl0mU0/uayYkUSvFZyhyoCRRkDq3dZAXUXb9lXYEnSpwT6/giclleViyoCRRkTpTCiTpdSditNSJa35NTnWqxPWBWBouSAUvJFL7lYQ2nUSXYfUkofToFQRaAo5YCJ+7IkZjTpiFgK9wHFK6cqAkUpMyIWiwsoRzbo6N4ZVBEoyhgYT0HNivVW0jINFSj6aCmY1tJBFYGi5IBSGqeWmmloLBTb7RWr4lBFoChlgEm0SDBOSLpY7OB1nUyDmU9UEShKmRGZs3gcaoUM0WUHVQSKMiZKvhstsRsotj47U0VarKY4VQSKkgPGgzdLkfZRaZHzxeJSfhhZoIpAUcqAROkpx3t/V2xeXUUmTghVBIpSZiQKQDdecXKypovFiqKUPKWmBhJ16mPRZ2PpzMfLYrsqAkUZA6U4oC61zmscLL+EKNZnr4pAUcqAdDaRFauZKB2xirWDLRVUEShKGVOkfX/OKLbbK9bnrYpAUcoMk+B1sTJW09A4siw5hmOKQEQOEpGnRWS1iKwSkc/FqSMi8nMR2SAiy0XkOKfkURQnKIWONJpS8xoKFzHRwu6YFotVU+BxsG0f8AVjzFIRaQCWiMiTxpg3w+qcBxxq/50A3G7/VxQlh0R2+PF7zeJXCYkZi+zxlEgJ6Mec4tiMwBizyxiz1H7dB6wGpkVVuwi4x1i8AjSKSJtTMimKEkkp9HfBEfv+YR97+4fj1kk0s3G6Qx8vCiMvawQiMgOYB7wadWgasC3s/XZilQUicrWILBaRxR0dHU6JqShZU0rmhVLtvM7/+fNs2rs/7rFAkntKFf6jlD47p3BcEYhIPfAAcK0xpjf6cJxTYj5SY8ydxpj5xpj5ra2tToipKFlRCjb2aEzCN8XNW50DCY/5k2kCB8lUiRTr18VRRSAiFVhK4I/GmAfjVNkOHBT2/kBgp5MyKUo5ErmPYPyFofb6A1mfqxMCZ72GBPg1sNoYc1OCag8BV9neQycCPcaYXU7JpChKYop1tJoOY1EE8W477VSVGT6zYlW8TnoNvQO4ElghIsvssq8B0wGMMXcAjwLnAxuAAeDjDsqjKI5RqsHHSrnzD8fnT+QJNU5u0GEcUwTGmBdIMesy1hz1007JoChKLOMxZ3GyGUEqFV2aKjy36M5iRSkzxkvnH45XF4vHhCoCRSkDEgaaGyemE98Y1gjGQrF27JmiikBRckAp+aIn6ruKVSmks/6S6wnBeOng00UVgaKMgVLsMCLcR0tA/nQUVKF2FmdKkYkTQhWBopQxxdoxZUrS+0gxoUi187gcUEWgKGVAolF1sY2Y45GWa24J3AcU7050VQSKkgNKaUyZsC8qzj6qIGsXRfooHEMVgaKMgWJdYE1GKcqcivF4T/lEFYGilAG9gz5ufXoDgYCJmhEUrgNdIKvZUv1hJrMvab10TEOJ8zBnI5lzFJk4IZwMMaEoSpHw7Yff5Ll1HcyZ0hBRXsiO8uOexwE4wbWafwZODpULAa7z3IcfNz/yXZZWW8luo1TDf+QTVQSKkgOK3fGkf8gLwEjUxqtCjlD9uAGoxBdRfqprBf/leQSAXaYJOCLfopUdahpSlDIg3EUy8S7j/OKzu58W6YkoP1D2hl4f69qYVlu5ntk45d1TbKaqIKoIFKXMCF9YLaQ7Yx1W2smz3EtwESCoiqZIV6hOl2mId2oMulg8NlQRKEoZkHDnbZ7lCOco1yYAZsoullVdzdc89wIwlX3sNpPYHJhCW5hSSEaxjrRjiS+oBx8/qbidT7gfzbM8FqoIFGUMlE4HZGFMcch8lGxiqljeQs3SxwQZ4GrPIxwrG7jM8wy1DLHTtNAmnemFmEhyrNjXbwCOks1c6n6eb1T8Afy+1CfkGFUEilIGRKwRhJUXSimc4FoNwD5TH1H+96rrAZggg+yimeNd62ntXemoLMWgKJokLJ37+ifi1nl6TTsb2vsdub4qAkUpN4rA53627ADgguHvs9A/L+b4+4ev52/+dwDQ1r00dYM5Ft6pR5FIzCbpG33z8m1x6/zX75fwwNLtDkil7qOKkhNKJXBZtJmlUFaiCvEDsJMWPuH9ElXeEdZWfwyAv/tPZrE5HIxhv6midrgjZXsJo2YUgx0sDZoJmxG89ULer6+KQFHGQGl0M1Ghp4vAa6iZXpYFDgm9H6Yy9Pou3wX2K2GPmZSeIkhyG8WkohOJ2SR9DJpK2k0jB7dOSHCuc5+VmoYUpcwohkFys/TQaSZGlPmNsCpwMKvMzFBZO5OoS0MRlDoHyx56qeXlwBEwnHgdwCmlpjMCRSkDgqYrY4ojQ1mz9LImMD2ibO7w3QSiuro9ZhJzR7ambC/XM5v8KkvDOe7FAHTTAP27YbgPqtLbQ5ELdEagKDmgmMwPxY+hmV46iZwRjFCBL2psapmG9qbsmYtgkpMW8W6jJWx94BTXCuvF099P69xcoYpAUcZAMZhZ0iEyPWVhU1U2MEiV+Nhr4tvCw+kzNVQEhmBdfJfKIMUSNiMbpsseAG7wXsUN3quswokHxq3rlE+CKgJFKQOWbu0OvY7YRxD27rcvbsmLLEHX0b1RawTxWG5m2S/+lPX1UnWehY5OerCtCJ4PHMUyM9sqTLJO4ASqCBSljIgeIQfCgpHe+dymvMgwx7UNgNeDnV4Sng0cY71Y9WDSeqUw8of4axkLXGsIGGGbmWyZxmomwf7YBXIn71EVgaLkAl0kSJs26cRvhO2mNa36Xlc1SPKuKvdusPlTLe9yL6OTCYxQYRXUTYb97XHrOjV7UUWgKGOgFKNehveZhZD/ADppZ1IoH0EqVrddDJX586Bxkuin7SJAK93c73/XaGFdK+zfSz5RRaAoZYQxkV1/oAB6rE067YQz6TFY2QzDPVQxkvG1in0x/0LXy7jFsMdMGi2sa4lvGnLwZhxTBCLyGxFpF5G4EaNE5HQR6RGRZfbf9U7JoihKGJFTglw1yizZwQT2p6zZJl3sNM1ptzxQadVtle6EdZLvLE5uTilUdJAjZAs/r7wVgDcCs0YP1LXGVQRQml5DdwPnpqjzvDHmWPvv2w7KoiiOUmjPk2zJlWnov9wPs7DqS9xd+cOUVzxAOtlpWtJue7+tCCaTRBGUiIkuXGEFN5EBrDCj4Taoa4XBfTAQmYuhJBeLjTHPAelllVCUEqXYTQ/xcELkaz0PAHCca0PSeo30UyMjmZmGKqy6ERE6o8h9qsrUdf68aFvG7bb3DYVeC5bL1jP+YyIrzTzN+r/mkZjznRpupK0IRKRGRObk+PonicgbIvKYiByZ5NpXi8hiEVnc0TH+444oipNEWIZy1IFuNZNDr5vpSVhvmnQCZGQaGqy07OcRMfuLgC8/sDzjc67907LQ6xp7zePT3s9GVjrw7eDyQFd6+ZpzQVqKQETeAywDHrffHysiD43x2kuBg40xxwC/AP6eqKIx5k5jzHxjzPzW1vRczhRFiU+4GSWQA03QTA9zXKNx8u+v/G7CundV/h9ARqahoYpGAOZK4phDxRA/KR3CH3ebdLIx0MZ+aiIruT3Qchi8fCt4h+Kem2vSnRHcACwAy0hnjFkGzBjLhY0xvcaYfvv1o0CFiKT/7VCUIqJE0hHEkIu+5cUqa0S7MjADgENdOxLWPcDOQZzJjMDrqgFPNSe7ViWsk3SxOOXO4sLQJl3sTmQiO/Qs8I/Avi2R5Q590dJVBD5jTOL5XhaIyFSxQyKKyAJbls5cXkNRlFhyaRqqYoRq8QJwyci3eS0wh44EMYQaGAi97iR1nKEIjv0IM2QPiVTXWEb+hZozTJUudpNAEcw6w/o/kJ/9BOmGoV4pIh8G3CJyKPBZ4KVkJ4jIfcDpQIuIbAe+CdbWOWPMHcD7gU+JiA8YBC43pZJOSFFKmFx6j95YcVfotRcPqwIzWOBZG7fuAWJ1arf4LiLjcfjkuVSJl1Z66KAx5vBYeo545zrdEbkIMIV9iRfNa23jSJ42lqWrCP4H+DowDNwLPAEkNgQCxpgPpTh+C3BLmtdXFCUHxOQjyKgHNVzreYDTXcs41rWJc4Zv5BL3iwBc7/0oAPNc6wFYIKt5zcyNOPsAe6H43/7jMxd8wjQAjnJt4qnAcZmfn4RcrJNkSivdeCTArkQmsjpbEUTNCArmNSQibuAhY8zXjTFvt//+1xgzlOpcRRmPGGN4Y1t3xE7PEl0iyGjk+3nPX7jW8yDHuqzgdJe5nwkde8h/MgA3+T4AwJ+rvkM1wxHnT7NnBDsyWB8I0Wo5LB4pWzI6LZ0+vqN/OHWlhO1np0Ta7LWSxDMC+xntz4+1PKUiMMb4gQERSR0zVlHKgIfe2MlFt77IP5fvKpnk6InIRPxDZFfE+//wPA7Anb4LrMxawHOBUZ/401zLqcDHluoP82LV/zBN9jJi3Owli66k6RAGTSUTZCDu4WSfQ6r11UeW70pewQHa7NlRwsVidwVUTwzNCJz+nqVrGhoCVojIkzC6h9wY89nEpyjK+GRjh/UT2NTRj8dVWnMBg0mYyD4V+01N3PLv+z4St3yqdHGOaxFg7R84Vjay0UzDZLOPVYQaGeGTnkf5nu+KmMOF2FBmiZXd59+WwHtqWmPYM66NjTnklHdauorgEftPUZRxRCYdaIv0sCpwMH3UcqJrNQDP+o+OqXfNyLXcUXkzbdJFV5gH0UnuN7OUMVLIKXSxJ5G3Ta5weATeJp0MmQq6qY8o97jDevq6lrwtFqelmo0xvwPuA5bYf/faZYqiUML7CDLo71qlm3bTyOUj3wiV/d5/Vky9xwML2BpoZap0USOR9vf1gWlZyxrk7a5Yr6RcdduHyTa2VH+YBfccAne9G4aS72YeyxqBtT6Q5ItT2wIDnfZ1srpM2qS7s/h0YD1wK3AbsE5ETnNQLkVRHMCY7N1HW6WHDhPpuvlUYF7curto5iLXS/y44s6I8vNGfpDBFSM5f9hK6O7BH3MsVzmLj3etG32zYzE88IkMW0iPA2RvYo+hIHXNMTMCp4Ibpmsa+glwtjFmLYCIHIY1Q8jCD0xRlEISvi6Q7ohWCNBMDx32Qu+lw9/kZNcqAgnGks304hKr7Uf9C1gWmMXCwHFWKsYsectMAWCy7Is5lnytI/3OsxlrBrDoijW8/cFToGd7ijOyY7q082QgRfcZnBEEAjjtl5bup1IRVAIAxph1IlLhkEyKojhINmaG6dJOpfhDo9glZg5L/IljUPrDFMR3vVewk+yjxwTl3U81A6aKVslpkIMImqWXXlNLwFUJcy+E1Q/n/Bp1DNIivWy1FVs4EZ9NXQsYPwx1Y6onxdTNJeku3y8WkV/byWROF5G7sNYKFKWsKXHv0bTlX+BaA8DrgUPTqv8F7zUA3Ox7HzvJYt9AXIR208jkOAlqsv0comdELdLD3uACd91ke0Qea4oaC1NDHkMpFryDu4vXPhoqKrTX0KeAT2OFlhDgOay1AkVRKJ3ENNE7i9PdVRs0mWwyU9Oqv9IcwoyhezMVLyXtNMZNUJMw+miGCqKZ3tE4SHWtVssDnVA/Oel5mRBUZO2kGOUH4w11rC2afQQe4GfGmJsgtNu4yjGpFEVxjMh9BOnRJH0MmCoGqXZGqDTpMBM5SjbHHhjDhrJwmqWXzabN6qLr7ZD3/e05VQRTsNY4IvIUx6O+1QqtMTC6u7jQiWkWQkTQ7Brg37kXR1EUpwnvMtMdaTZLD50Jooo6TbiEXWYC010dzEmSm2AsNEtvmGnIVgQ5jgA6RRIrgphF79rmhPmLc0m6iqA6mDsAwH5d64xIilI6lNoSQbbyttBLpx1GopA8Hng7AHMkMk1kLj4HFwGa6KOTiVZ7QUWQ401dU2QffaYmNiFNPOpaYf/ePERDTY/9IhIK+Sci87FCRyuKQoltKMtiH8Es1046Upky8sCywGxgNERDkExN6D/y/JIt1R+OOG+G7MYlhg5jx0IKKYJcjMgNl7qe41jZwGTZR7uJDaUdl9pm2Lk09LbQi8XXAn8RkZ1Y350DgMucEUlRlHyRTgdaxQgHyl7+HDjdcXniES7jfmroNTUhz5tQnSTJKuPxQc+z9uFAqOxw29z0emA2FwJUN4K4c6IIjpLN/KTyDgAWBQ5LuD4Q83kEfNb/PmcD4yWdEYjI20VkqjFmEXA48CfAh5W7OM6KjaIo6TDs8/Ptf75Jz6A379fOdI2g1fZy2eV0fJ802W2aYmYEK3ckDgWRdBC98/XQyzPd1sg7uHENlytlvJ90ZyJf8dwXej1TdrMngcfQsC/At/65it4h+3tx5CXW/x1L49bPFalMQ78ERuzXJwFfwwozsQ+4M9FJilIuZOvV97elO/jNi5v5yb/iZ/PKF+mIf7HLSj6TSZ5hJ+kwjbTYm8qa6WFL9Yf5YN892TW2e3noZTAncj+1o59rbW4Cv8127Qy9bpHehDOCjr5hfvviFm5+0krww5QjAZBO63220U5TkUoRuI0xQdV7GXCnMeYBY8w3gNmOSKQoJUimP09vwOpp/IH8LjcbExWGOo3Lf7HiLwDsMNnvDs4lnUygyd7XcHflDwG4YN/vM2rDa9wASLsVEXUC/UyVffzWd05kxbrYUNDhpNMvVzHCVNnHlsDoTuL2FOst/oBtsmqeBVUTkQ5nBwwpFYGIBNcR3g08FXYs+6AhilLmBDvjQiwyR5iGMvBHeStOSIR8EC1jp5lAi1iK4EAJG62P7CcdXARwYXW0ZsiaWcwWa8Qec491rWNeI5ghuwG4z39GqCzlHoJwaptwrX98TDKkIpUiuA94VkT+geUl9DyAiMwGnAv4oSjjnOBI3JVnTWCInAWkMyPoN9X82ndedgllHKDLNDBBBjhO1tFnaugI+v3fd3lM3Xj310g/bjsgnvTvAawNcwCLA4dFVq5rjdjQlU770fw/zwMALAkLz7HNtKY+MUj9FGSomxmyC3cg+7SayUj6yRpjvgd8AbgbOMWMzildWAntFaWsyWREHU4wtEO+FUE0qTqyWoaol6FRl8oioNOOgPpg1Q00SR8P+0+yDmx+Pm796Ed8ljssTFp/OwAHifW/K3rTXF0LDPeCN/sU7TPtFJ9LzWH8yHsZD/hPZbk5JP0G2qzkP89UfYETN92atRzJSCdn8SvGmL8ZY8JTVK4zxji7jK0opUSGHXohg9VloryCHkNp+73ngY2BA0Kvg0rq6QnvBXdlygcrBPhhxV2AFR4be0ZwrttKqRmMMxR6RnX2ukiC3cXpfOzBhe0ALm7zX8QXvJ8io1WlM0YTAfVXO2OeK465nqKUOBva+zKqH+yu8j4hiE5Mk6LjDAZ466BwiiBaxFfNXL7jHc2T3MlE9nrawD8Mw8k/h0Ps0fmffKezJjAdGeyiAh/1DLLbTGKYysgTcrCpzI+bv/rHkMeregK+kz7HXjOB9VPOy76dJKgiUJQc8OiK3RnVN8ViGkpxPGgyKaYZAcCWsCio3aaOPrct38anEpwB82Q9C6u+BMAjgRNCSXZa6OEgaecJ//zYk0KKIP46QeqZnaGRvoxNa9Fuor4zvsn84TsYrHRmL4cqAkUZA9maeIJrBIVQA6kWi79z0ZGh1zfZu2GLTRF0hnWsrwbmsrH6COvN9kUR9cJv7zDXaLaxJYHDQmk357i2MUEG2WzaYi8UNA1lOSNoYJBK8RcsYF+6qAuoohSAkNeQq9AzglhNEG/TUjf1+RAnbcLdL7upZ49nKkycHnfzVzBXRBOW2Wihfx77qQkpt6NlE4CdTD6KMZqGgusDuVIEhc5ZrChKDgnuIyvIPoIMNpTtN1Xc5z+joK6j8UTcFZH1zH6I9ZNDi7/xaJJeBkwVn/Ba5qHttgtnMGF9R/isJ3jRynrwVCdUBKk+v4+6n7DaHuMai9POBaoIFKUABEfi+c5sFj0DSNa/nOVaTJ0MR5hhiom7fWeH7dA1UD8Fut9KWL9JeukKC6XdRQOmoo7jjaUI4m7yEkkaZiJVB12H5Xb6cuCI5BXTxKmBg2NqXkR+IyLtIrIywXERkZ+LyAYRWR4e5lpRSoVsB2qmgDOCeHLE467KmwDYV2RmoSA3+D7Gbf6LRgvqW5PPCOijy4TnVBBonE69WJ11wlG7CcAb2aXdbJZelgdm4sed1fn5wsn53t3AuUmOnwccav9dDdzuoCyKUlSMeg0V4Npx5Eh0HGDAFDgrbRp2EWOwZgT794LfF1Y+eu5U2Rdp/gFMi7WTeK+ZwAgV8RufNCNjkYM0S29O1gey3biYLo4pAmPMc0BXkioXAfcYi1eARhGJs2yvKOOP0BpBnk1DX3lgBbt6RnfJJutegkHSFgYKP1nfP+xLXal+MqFk82GIQAU+ZskO1pqDIo75T/0SP/VeyodHvh5RHvFcDrMD0aUZyyicZmIYkMIAACAASURBVOkN7YTOBYXOWewE04DwfHPb7bIYRORqEVksIos7OpzP36koihWc7e/+k9NLqegwe3qTh3iwUkvaCebjmIdmyw4qxc+bgYMjD0w5kp/5L2VdlIKIoC4siX1GGFroGc2BXMQUUhHEU25xByjGmDuNMfONMfNbWzMI1qQoRUrwy+/0lD8VyXYWt0gve4t0oTgu9Xb4hf2xHXZwY9yWbCKo1tsKJsO8BHUMUS3e3JiGHP6aFFIRbAfC1fCBwM4EdRWlOMnyFxpcJC5kzCFIbBqqYYhaGS4KRZDOIzLGWIvFAKsfjjl3iuwDYE/UXoG0nn9oU1lmM4ImO1R2LjeTlZzXUBo8BFxlew+dCPQYY5xNzKkoRYJTmaYyJRAvMY4xoxuhKA6zRlr6stE2+/giQzULMFW68Bo3e7O5n5DJKTNF0GInz+kqkmeYDCfdR+8DXgbmiMh2EfmEiFwjItfYVR4FNgEbgLuA/3ZKFkVR4pOog221040UU/jpZBgAlxsa2uK6ek6VfbTTmPbGuIiZQmh3cWamoWZ7RpCLNQKnJ46ObSgzxnwoxXEDfNqp6ytKKVBgy1B8AUTCOrHiUASpTDih45NmQN+umIOXuuPnKkgLTyVUT7RNQ+lvDGsOmYZy6TVUmJzFiqIkoeAd+RhJ4J0RFiOn8IrAGLjvta3pVT70bOv/yECoqCqQudtnDHWTMzYNNduzqvDdzMWKKgJFKQBFs1icQIAWimuN4NcvbE56PHQXIQ8fq9M2Buq91nam73k/HOe8ND+A+skZm4a+XPFngNgcB8DHTp6R9NzoJaRUeSPGiioCRSkAwSl+wd1HE5R/zvMgXuNOvNu2WAkt7I7uN6r3Wx5Dq83B8c5Is92WuF5DiddYrIQ+cSOaAlecmJ0s49FrSFGUAhN3oGkMHgmwrwRMGkFCI+b62E1lwRlBJusdMQq6bnJGoajnuqzgd1/1fiLtcwqJKgJFKSSFNg3FEcDjt+zrv/I5kxYxUzKaNUWZhgDqfNaMYEwL33WtMLgPD5GhLhIN0L/k+RMA28zkuMczHdk7/TVRRaAoBaBIthHEnRFUj1gdZyn4v8cQCgcRZhryduE3EnfRNm3Tu71ZrdneG5CKncbahLbRHBD3eJF8/CFUESjKGMh2DW80xERhiSd/ZVARmNIxDYVwV0DNpLDFYkOdr4suGgiMpbuz1x5aJFIRJN6ZPczrgdnkqssfzyEmFKVsGfUaKrQqiKXaG1QExTEjSOcRRdSpnxLh6lnv7crYLBRzTXumEXSrDfLGtu6457dKd9LNeKl2lifaL+DUjnRVBIpSxsSzvwdNQ50ltFgcQV1rhCKo82WuCGKwTUNBt9ogC9fE31vQKj0xuQ/CUdOQoighCj0hiHf9mmHLvt4eL3VjjvjnZ07JaXsRCq1+csRicb1339j3Q9imoeaoGUE8PPhooo+OHOYhcNqGqIpAUcZAtvsA8p2QJhGBOJqgdqidblMXdyNUSVA3OWKxOCczgso68NTwtYr7qCV5boQm+nCJSapIs7XwjMfENIpS9hR6hSBe8NHa4XZ2J9gIVQjSC0Md9qZ+Moz0wcgA1QxRGRgauyIQgUNOB+A01/KkVSfbIa+TrhEUyUAgiCoCRSkAxRJiIh61Q+20J7Fv5wJH3WftPMTsWhaK97M3QzNN3I/lwp8CcIRrS9JzWyUYuTV3z7BkcxYrilKa1Ax3OD4jyLUCjGiv9XDr/763RhVBLoLnTWhjj2lkCvE9hYKc5HoTSDEjyNY0pCEmFKX4GGuHVuhYQ9G4CFAz0skenFsodpyJdurzZX+k2e60c5VXYZdp5jz3a0nrBMNP76Z4zGupUEWglCX/WrWbGdc9wua9OQhRnAXFkqEsmmZ6cBk/exz0GMqU25/ZmLJOhEKtqAHA17OLOntPRKJ0kZkq8n5TzQQZoJG+hHWa6GV5YCZ+3Jk1HsZvXoyMtnrmTc9m3VY6qCJQypJ/LreSlyzfnnya7zTFtkYwWazn4fQaQa6JeY6nfhF392am20nrO3Pkyvl84GgAXqr6bKhsAv0RdZqlN2WeYhH42eXHpn3dvf0j1nlpn5EZqggUpQAU53xgdKEzl5nJWuqrYsocnxC1HY0YP/Nda+k2dXgzTMaYaMd38LnUipUX+TTXGyyvvpqzXItDdZqlN2WcJhFhbltx7NwGVQSKMiayHdAXa4iJ1uCMgNzNCOJ1+jlfLI4uqJ8KwOGyNadK7Z+BkwDoMBOYLdu5p/KHANxVeRNbqj/MVDqZJp30mtqcXTMfqCJQlAJQrDOCFnKfq7gg92qHhKiXoYxdR5MxQgUP+0+kVXr5ZcVPY46/Uv0/AJgUd53tM9FYQ4qiOE6L9DDirmOIWHNOURMTJG40D0AypZaN11Zw/WSWaxdf9n6SNYGDYuo84j8haRvF5iugikBRCkhxGYYs09BQZem4PSakqj70cijHoTKCHlWP+9/On/3v4n0j34qps8rMyOk1nUYVgaKMgazzEdhDwiJbIqCFHgarmgstRsbEG9kP11lJYZ72p++dM9oePLuug18sXB9zbJNpA2BhYB4AA1Qzc+gPPOQ/KVQn1YwqnRATAyO+mDLdUKYo45Bi21DWKj0MVrbktM1CmUHeOP8fHDd0B48ETszq/I/+5jV+8uS6mPInA8dz4tAv+Iv/9FCZwRUyQT2VhuJJ55n87fUdacs6VlQRKEoBKDZvoSAt0sNgCZqG4j1OX3WTQ+k2hd3EzpqCimC3g5vxdB+BoowjilENVOBjkvQzWJXbGUExk0t9vNVOVD9T9qSsW2RrxaoIFKWQFNPEYIodPjnXM4J83GPOL5FFg88GjmGPaeRn/velrlxkmsBRRSAi54rIWhHZICLXxTl+uoj0iMgy++96J+VRlFyTrY2/mBRAkI+4/w3AQHVbTtstNldJp+ijlhOGb+OVwBHOXcShh5nZvusMEBE3cCtwFrAdWCQiDxlj3oyq+rwx5kKn5FCUYqZY9EENQ5zqWkHACDuaTwTW5qztfCRhKdY1l0QUW2IaxxQBsADYYIzZBCAi9wMXAdGKIC9s6dnCc9ufK8SllSJkm38HFU09vNixiZ5Vme08XdXfQUVTByv71+D1B6ho6gTgnlWdcevvH/HR2T/C9KbRsANLuruoaNrNxuFJ3LPq9exvxGbdnj5mtdbjdgm+QIDNe/dz6OQGKprS+7ld4HqRpa5OrvefwwE9D1PRtHvMMgXxVlVQ4fFGlD26dQcVTZtydo2V/XDrkrU0VFtd2oaOftbs6qOiaV/S8+5b20FF05qY8j+vW0dFk2XrD/9c032eqfjL+j0Mev1UNCWOrPpa1wb8qyZFXHfbAMDBOZEhHHFKk4rI+4FzjTH/ab+/EjjBGPOZsDqnAw9gzRh2Al80xqyK09bVwNUA06dPP/6tt97KWJ4ntjzBF5/9YhZ3oiiKUhyc0PR+fvWeb2Z1rogsMcbMj3fMyRlBvLlPtNZZChxsjOkXkfOBvwOHxpxkzJ3AnQDz58/PSnOdMf0MXvrQS9mcqoxDvvzX5Ty2cjc/vPQozj8qM5v4rU9v4I5nN/Hfpx/C4EiA3760BYAVN5wdt/5RN/wr5vg9L2/hx0+sS3peujyxajdf/Mtyzj5iMj/54LH81+8X89LGLm7/yDw+9cfUs42L3c/zHc/dXD7yDVaZGVx37hxufDx3pqHJDZW0941ElP3p6hO57M5XcnaNICtuOJsVO3r48F2vplX/la+ewYk/eCplm0GCn+VYWfj5d9I75OWS2xL3Sd+4cC4fnH9QxHVPufDonFw/GicVwXYgPAjHgVij/hDGmN6w14+KyG0i0mKM2ZtrYSpcFVRUVuS6WaVE8UgtBKqpdtfRUNmQ0bmVrjoIVFPpqsPn8kOgGiBxO3GOV9ltJD0vTardfRCoxiO1NFQ24KYWAgPUeOpD10jGO1wbCQRqWOM/FHBT5a5L67x0EVMFgUi/lNo0ZcuUhsoG6iv8abddX9mQsm7E55MjmWsr6vD7fUnbi/hu2vU8rtyGywjipNfQIuBQEZkpIpXA5cBD4RVEZKrYe+1FZIEtT3xDq6IUIcWwSBkUIbgAGQpfkeb5Z7hfZ6M5YEwZtZKR74XRYluIjUf2oUlyK0cQx2YExhifiHwGeAJwA78xxqwSkWvs43cA7wc+JSI+YBC43BTDL0tR0iTbb6sj33KJ+JeSSfTSLL00Sx9rwyJolvovsBTcVYvtETtpGsIY8yjwaFTZHWGvbwFucVIGRXGS8B+0MSbtePG5jDGUbUu/rvw/jnNtAOAB/2k5k6fQZKIICjXuLLbxrqOKQFHGO5n8noe8fqo8Lrx+w4gvkHNZYvq/pLIZ3iab6TG1/M5/Ng9nGZgtHfIdWC/XpiGvP4DHJfgDOVTe2ZqGHDJ7qSJQlBxhTPLR6Jk3Pcv5R7Vx53O585+PRygNZpIOuIFBKsXPj7yX8Cv/BY7Kk29cOV75PPTrj/H2GZNYtCX5noRMqKl0M+j156y9saKxhhRlDATChnapBnnb9w3yO9vVNJdkY2ZotpPUdxrnE6iPh8XiXCoBgJb6+PkKPvvuGO/5vKCKQFHGCZnks23BUgTx8vkWl/U6c0phsTgRV5w4PelxTUyjKEVOsSwABvuKZOI0i7WFJx8zgvyvEaRPcXxiYRRIIFUEijIGiqXzDyedmUGrbRrqiJPYvYQH1CVPqm+TJqZRlCLEJHidVxlCG8rSo4oRvuq5F4B9xO5qLj7Vlhk5dO4pG1QRKMoYKKYJQfREIJFsh8tW6mSYhf55+PLgOJjvxeJiywOdCYX6PqkiUJQsMSay0/nQna8w7EvuEujEYl9Qhn8ss0J5pbrEdGkH4Ebfh3IvTBGQSWdaTIo8mpc3WtF2tnYOhMp6h7yJqo8JVQSKkiUikR3J4rf28ca2nqTn5KPjCfqn/+qF+PsVDrIVwTbT6rwwxI7QrzvvcEevFyjm3j0F4c/q4eW7APjuI6M5EO5ftM2R66oiUJQxEN3lZDriD09Wkyu69lshn1/Z1BX3+CzXLvaYRoaI78ueiIuPPWDMsgFc885ZOWknEenogUm1pRmJ2Ckdp4pAUcZA9A8zWg+k8irKhT07+hLJRsQfcD/Dpe7nWR44JOPrZLJPQcmOVB29U7MdDTGhKGMi+Q8z2oMl3QXdjCSIUQSxddz4udz9NN+r+A0Ad/oSpwlPpLyydZXN+2JxGmKWqvEol/GOwtEZgaLkkOiOPnoElw/zdSBOZ3Gma0lICXx85EssMs7a6QtJRqPmItMIqcRx6vujMwJFGQOBmCCikZog1Q/XiR92vI7w5orbAJg3dAf7yG43cbamoXy7c6ZztVI1cjllGtIZQQ4Y8vp5ePlOnl/fwZ7eoUKLU/S09w7x3LqOMbezamcPX31wOd0Do/lw9/QO8fz6Dnb1DPLihtQZT4d9AR5evpPBET+PrrC8NN7q3M/iLV109A3zhT+/EREyeslb+/j5wvWh929s745ob/u+gYj30T/c4bC2DpbdvMf3L+5/dTOX/fJlNrT3p5R3+fZu1u/piyiL7hr8UdecQhc1MsKWwJSslQCURuf5xrbutExYQaX24OvbnRYpI6Jl/+WzG/nXm3tC750yDemMIAfc+Nga7rajSh4wsZqXvvruwgqUR0Z8Aa7/x0quPfMwpk5ML5/r++94ma1dA2y5cWzhjy/4+QsANFRX8LXz5wJw0S0vsrt3iMbaCroHvDz9xdOZ2VKXsI0bH1tD1/4RpjfVsrVrgH98+h1cdOuLEXUmT6jiK+dappRLbx9NNn7zv9cTzefuX8ZFx04LvU/UJ1UzzLNVnwcffOgfTbwaOJIzb3o25TN57y2WbN+5+G201ldy9hFTueGhVRF1fP7Ri9YwxPcqfg3Adb5PJm07JSWgCS669UUOnVyfsl6ww/3WP99MUTO/NNdFenL94LE1Ee8/evIMR66riiAH7OweHH3dU14zgqfXtnP/om107R/hzqvmp3XO1i5r1OwPGNyusfcu4c9/tz0j6x6wNt585t6lPPLZUxOeG3S1DMo0MBK7IWz7vsGYsnAq8XKuaxGHu7biIgArh2HmO6GuOTQjqMDHea5X8eHGg5/OsJH5LNnJyxyZzq2G+MbfVwLw78+fRv+wL+LY+46bxq1PbwTgw+6nONP9Onf7zuaVwNyMrhFDkSVTScT6NGZWxUpNZfK80Rce3ebIdVURKGMiOFV1ZWE/9voDuF3OJEwPkqlY8RSTz588m9hXPffycc8TowV/fRjEDW1H4z76Sr7jeZR3ut5guivSHBYwgksMs2RnbKMBP2xfDO2rrLaOuRw86fn9V3tGn+lU6WLAVHGD72NpnesExRjyoVRdYbP5naWDKgJlTARHvNmM7H1FGB0s3m14/cnkNFzkfpFVgYP52MiX6aWOtZ85CNY9ASv/SvXjn+dK+1f2Te9H2WFa+FXlTwD4ru8KLnS/zMc9T7AkcBge/PDCeti4ENrXwP720css/DbMfjff9nTxfOAongwknn2FP9Ym6aUrTmC5cqc01QC4cjCDjocqAmVMBGcEmQxUgqEZUo20c0GsV09y4v3Q/EkaaaOLJunnJt8H6GCSVXjgfOvvXV+jb/tqPnTbQlabg/FjjdTfO/wdOkwju2jmANnLca4N3FL5C+vcfwNNs2DmaXDYuTD9RFjzMCz5Hax/kqs8XVzFkzzqX8AXvdfEXYMIH4E300eXUUUQTfENQdLDrTMCpRjJZkbgFsFnDCN5UASZ/uDj/dCSzVxmuixPo40mTvgFEXxNs1lpNkcULzejIRZ+7LuM3aaJISpZHjiEh75xBdQ2RbZz4qesP+Ad193N9yt+zfnu13jUfwJe/1kxlzUGDpQOFshqZslO1pkDE8qfCaXaeY4ncp2POYgqgjCGvH4CxuD1GyZUe2LsiIGAob1vGINhQnUF1RVuugdGYpJQ7+wepLWhikGvn0q3iyqPi0GvH5cIw74AE2sqGPL6cbuECreLQMDQN+Rj0OunvtpDfZWHrv0jVLiFhmrnY6IEZTEG9g/7qPC46B/yUeEWJtZUhFwe66o8DHn9bOsaYFJdJRVuF31D1kLl7p4htuzdj8ctTKqtpH/YR02lG68vQNf+EURgWmMtu3oGQ8pjcMTPkNfP9n0DNNZW0j/kCymUAxpr6Bn0IsC+gREObq6jo2+Y1oYqduwbjPhB7OgeZFvXQNzRfP+wF68/QEffMC4RWhuq2NTRT2f/cNxn0d4XW76pYz97+4cZGLY+ZyHA5e6n8eHmA+5nrTqB0UW83T1DtNRX4nG7Ylw5oxmmMiJ5/G5vLT27+0LPaEJNBV39I7hc1qLrDlr5D++XWOa6mkvdz7Fz2bEcKp2c5FrF8a71DP3xXs7ZtoPPVS7DJVYb93nflVQGp8n3YvF4RtcIHGLVzh4m1lRw4KRaDv/G46Hyb190JFedNCOi7lceWM5flqT2Oz75xqci3h83vZGlW0f9zU+f08oza62Fwy03XsAPHlvNXc+Pjhq/c/HbQl4hP7v82Ah3xFyy5K0uZjTXcfx3/51W/f88ZSa/emFz3GOvbu7i9P97JqPrv/PHzzCh2kPvkC915SS8vrWbU3/0dNxj27oGOfTrj6Xd1ifvWRxTtqN7kPmhZ2R4v/s5fmC7ZAJsDLSxJ2gWAk78wUIAjjlwIm9sTx6NNJrgucnw4+a3/nP4rOfv8NonONNeQ+42dWxd2wh4eMScwM9976PDTKQ7wzWCyRPScwNOl3BTVaKk7WOh0u3KeHZ5+NQGXrLDPJcSVR5npgRlrwiCvujR/tuPr9wdowjSUQLxCFcCQEgJBHlg6Y6I90ElAPDUmnbHFMGlt7+c1Mc+mkRKYCyMVQk4zZGyhdNcy5kmHRzvWs9M2UW1WK6pHxi+nl00scs0E2/5MVMlkAk3+T7Iw/6TaJZeTmjaz5yD2vjc8umMJF3YHuWad85i1c4enl9vbbr70jlzmN5US++Ql/PfNpXPxjknlfnvjiuO45o/LAXgD584gSt+/SoQua/hyf93WsLzD2mtY1PH/rjHvnb+4TRUV/DVB1fEHFv09TP5xVPrY76fV5w4ndpKD585YzZH3/AvAF687gyeWr2H9x9/EM+sbWdr1wA/eGxNxGAtfCD28XfMoMLtYsqEahqqPOzsGYzYP/Klc+bw4yfWxpX5n585hQqPcO7Nz4fKLj72AL5x4REJnwHAc196Fz/99zrmtjXw4NIdrNltbSB833HTHLMQlL0iCFLI3LNHtE3ghTR2weaS4P1u3hv/h5drDpNtNDDAHibRaSYwRCUGF3WVbvaH+e4LAVroJYAwQgV91JDIx2MqnZzqXsEk+ngjMJvNZirN0kurdLPZTGWubKUaL7tMEzUyzC7TzE7TzDAVTJd2znC9zouBt9Eo/QSMi91MopZh2qSTX55ZgbtzLa5VDwLWaHudOZDf+c/mkFlzOOPs97LoF5bb58P/cwoX/uKFjJ5HpcfFuu+ex1CYWXHYG8DlgqPsTmvD985jwOtnQtiPP7x+wBhqKtwhE+ZZ7w9Y5sWq0Z/1sC9AlcfFwIifI79pubgGBz23PbMhpAiuOPFgJtYk72Qq3MkVwblvGzWPnTSrmcOnNrBmdx/esNH6pLrKuOdObqjiiLYJMYqgvsrDym+dE3ofTxFMrK3gfy88gi+eM4eAMfgDhvqqWNMuwLTGGq60B3jnHWXJ+1/vnMWwz8+c/32cCrdw5YkHhxTBN98Tu78jqAjWfvdcPC5XQkXQWFvBQVFhxm++fF7cuuFMb67lp5cdC8DVp81iyOunyuNy1OVVFYFNoVwZjTGOZK1KhVP3O5F+/Liowss81wZOdL3Jya43OcL1VkzdrYFWdslkqioHqWeIRumnRXoj6uwwzbwWOJw1gekYoE6GmC07OER2M9e1NWP5/EZwSxr3/hxQUceLU6/kU1tOpZfR3aqfapvFWdMOByxFUJnFdL3KbZ1TXTHq8x/+GsDjdjHBHdl2dJ3o+g0J6qf6jlW6U9+DJ4OVyvDZQ7rfNV+c2UwmP41kz8YJqjxux0I+hJOP+1JFYOPNuQeLoZoRpkoXbdJFCz1U4mOYCkbwMEgVNQzj2zGNen9v6uZyzFjvt4leZsoujnVtZKp0MUX2cZhs53BXZAalYeNhaeAwvu29kk1mKq3Sw2zZwRTZRx3DHCK76aOKteZAugMN9FHLHtOIFw8NDHKKawUnud7kEvdo2IedpokNgWk87P0gzwSOoYd6ZslOZslOAggGwY+LvWYiW81kWqSHGoY5UPYyUfoxuOg2dXjx0G9q6MYyj02RbrpNHX3Ucu83/xsq63n6kdX0bkluEvM45NudTzwpRvuQ3V4RiN/BR2MAXxw33XwPz3K5sF1Ke9YcVQQici7wM8AN/MoYc2PUcbGPnw8MAB8zxix1UqZEJN80lJrJ7OMM9+uc7FrFca71HChpmnp+9VNuB3ZUNbM2cBBbzWS2m1YaZIA+U8vs7qmwcpPlW948G6pSx1FJB68v/fttpI+pso+J7Odk9youdL3MLNttEsBr3Gw3Lew2zdzovRyD4MPNGnMQrwXm4k3yNYs2DUVzu/+9ANQzQAAXXjxx29tuWnmWY+I3ks1HW5V4gTUnOQTG3kRGBDu4REorHWWWbcfmTWMzhzFj/w0q2eOYIhARN3ArcBawHVgkIg8ZY8KjPJ0HHGr/nQDcbv/PO8HNTUKARvpp9XmhcyOYgLXd3/iZK29RzyBHurYwz7WBg6SdegaZKvuYIFasmh2mmTcDM3jAnMqQqaLdNLKbSbSbSQxRQSU+qhmhniH8CL+7bBZPPL0QT9d6jnetYwFrqJeweEW7gb/ar10VUNcKDVNh0gyongjuSks5tMyBKUdA3WSoa4EUoRuivSwq8Nkj9S4OlL2c6FrNTNlFm3TSJKOxWwJGeDlwBH/2ns56M40VgUPYRz0+hyeX/eQ+pWM5EfTcSTTyT8f+nK0CTO88E3dGUEKD6pLGyV/vAmCDMWYTgIjcD1wEhCuCi4B7jLVy+YqINIpImzFmV2xzY2P5Mw8w8blvIgRwYRBj/X+hyo9gCPwEllYNj3Z6e4BfRLbxWJjnW7tpZG3gQNqZxEuBI9lpmnk1MJc3zCwy+fq+5991bNp7LnAuYHXIDQzQQx0NDFCFl+OavUwJtDPHv57moS6aBvYxbdcLVDGCx/ioZdAKTxBGt0zAILgIIIAY+z8GwVCP4c0qEzruwRdhO99jGlkVmMHrgdlsNZPZZiazn2pWBmbSNYZQxtEkmw0UivDBcTz7f2VUZ5rNIl6q4GK5JmjLDvc6SWddIJxMXReDtm2PS2LWCaKXGyY3VMddg6jO03MKzpiqK3Lnnpnqe1FMFkUnFcE0INxgvJ3Y0X68OtOACEUgIlcDVwNMnz49K2Eq6yayt/YQjKUGMGL939kzTHVlBRNqq9jSNcxeJtJj6mibOpUKj8dSG+IigItBn2HpziFWBQ6mg0aOmtbIih2jLoIHTKwGO/rorNY6NtoeEC6Jnz4Q4PC2BuZMbeCxlbsB8OKhiwm4XUJ3oIEz505BPEI70E7sLlIAT2CEVu8Opo5spcG/jwZ/Nw3+fYx2+9YfIoSrg417B2htqKZzwMewH9YEprPTNLPLNLO/ejK93uSdtMclNNVVhjZhXXB0G48sH/3oLn/7QZxyaAvLt/fw5s7ekGfUzJY6Nu/dT2tDFQtmNPFW1358fsMl86axYkcPD9ttVLglwlzQUl9JY20lG9r7aaj20Dfk438vmMt3H1kdV76Dm2stJed2RZzzvUvexgGNNXz8t4si6k+o9vDB+Qdx6mGtobJPv2s2tz2zkakTqvn82Ydx85PruOZ0a2fwf54yk6fWtjOjuZYfXnoUX3kg1qMlyP994BgEa6Pcsm3dnH3klIR1f/GheUxI4cGTKQ3VFXzl3MM5J+y6F8+bd4Q81wAACfBJREFUxi+f28T5b5saU/+XVx7P3v5h/rZ0B7VVHs46YgqXzLPcmE+fM5mfLVzHe445gL4hH29s6+aAxhoAHvjUyaF8Cbd95Dj+tGgb7z/+QC669UX+8InRn/8RbRP43LsPZdDr569LtnPjpUcxdUI1d7+0hb8u2c63LzqSzXsHIuQF+O7Fb2NH9yADwz5e2tjJ/6ZwxQzy08uOYUqS/RGVHhdfPe9w3j3Xut69/3lC3M2FAD//0Dwa7c/H7RK+fv5cDmqq5VN/XBKa/bzvuGlWfwDcddV8PnnPYm54T6Sss1rrufDoNh5evovvXvy2GA+jfCJOuU2KyAeAc4wx/2m/vxJYYIz5n7A6jwA/MMa8YL9fCHzZGLMkUbvz5883ixfHbvpRFEVREiMiS4wxcaMVOpmhbDtwUNj7Awn622VWR1EURXEQJxXBIuBQEZkpIpXA5cBDUXUeAq4SixOBHifWBxRFUZTEOLZGYIzxichngCew3Ed/Y4xZJSLX2MfvAB7Fch3dgOU++nGn5FEURVHi46jPnzHmUazOPrzsjrDXBvi0kzIoiqIoyXHSNKQoiqKUAKoIFEVRyhxVBIqiKGWOKgJFUZQyx7ENZU4hIh1AbEzj9GgB8hv4Pz2KVS4oXtlUrsxQuTJjPMp1sDGmNd6BklMEY0FEFifaWVdIilUuKF7ZVK7MULkyo9zkUtOQoihKmaOKQFEUpcwpN0VwZ6EFSECxygXFK5vKlRkqV2aUlVxltUagKIqixFJuMwJFURQlClUEiqIoZU7ZKAIROVdE1orIBhG5Ls/XPkhEnhaR1SKySkQ+Z5ffICI7RGSZ/Xd+2DlftWVdKyLnOCjbFhFZYV9/sV3WJCJPish6+/+kfMolInPCnskyEekVkWsL8bxE5Dci0i4iK8PKMn4+InK8/Zw3iMjPJZv8lqnl+rGIrBGR5SLyNxFptMtniMhg2HO7I+ycfMiV8eeWJ7n+FCbTFhFZZpfn83kl6hvy+x0zxoz7P6ww2BuBQ4BK4A3giDxevw04zn7dAKwDjgBuAL4Yp/4RtoxVwExbdrdDsm0BWqLKfgRcZ7++DvhhvuWK+ux2AwcX4nkBpwHHASvH8nyA14CTsBJaPwac54BcZwMe+/UPw+SaEV4vqp18yJXx55YPuaKO/wS4vgDPK1HfkNfvWLnMCBYAG4wxm4wxI8D9wEX5urgxZpcxZqn9ug9YjZWbOREXAfcbY4aNMZux8jUscF7SiOv/zn79O+DiAsr1bmCjMSbZbnLH5DLGPAd0xble2s9HRNqACcaYl431i70n7JycyWWM+Zcxxme/fQUr419C8iVXEgr6vILYI+cPAvcla8MhuRL1DXn9jpWLIpgGbAt7v53kHbFjiMgMYB7wql30GXsq/5uw6V8+5TXAv0RkiYhcbZdNMXamOPv/5ALIFeRyIn+ghX5ekPnzmWa/zpd8AP+BNSoMMlNEXheRZ0XkVLssn3Jl8rnl+3mdCuwxxqwPK8v784rqG/L6HSsXRRDPVpZ3v1kRqQceAK41xvQCtwOzgGOBXVjTU8ivvO8wxhwHnAd8WkROS1I3r89RrBSn7wX+YhcVw/NKRiI58v3cvg74gD/aRbuA6caYecDngXtFZEIe5cr0c8v35/khIgcbeX9ecfqGhFUTyDAm2cpFEWwHDgp7fyCwM58CiEgF1gf9R2PMgwDGmD3GGL8xJgDcxag5I2/yGmN22v/bgb/ZMuyxp5rB6XB7vuWyOQ9YaozZY8tY8Odlk+nz2U6kmcYx+UTko8CFwEdsEwG2GaHTfr0Ey658WL7kyuJzy+fz8gDvA/4UJm9en1e8voE8f8fKRREsAg4VkZn2KPNy4KF8Xdy2Qf4aWG2MuSmsvC2s2iVA0KPhIeByEakSkZnAoVgLQbmWq05EGoKvsRYbV9rX/6hd7aPAP/IpVxgRI7VCP68wMno+9tS+T0ROtL8LV4WdkzNE5FzgK8B7jTEDYeWtIuK2Xx9iy7Upj3Jl9LnlSy6bM4E1xpiQWSWfzytR30C+v2NjWfEupT/gfKwV+Y3A1/N87VOwpmnLgWX23/nA74EVdvlDQFvYOV+3ZV3LGD0Tksh1CJYHwhvAquBzAZqBhcB6+39TPuWyr1MLdAITw8ry/rywFNEuwIs16vpENs8HmI/VAW4EbsHe1Z9juTZg2Y+D37E77LqX2p/vG8BS4D15livjzy0fctnldwPXRNXN5/NK1Dfk9TumISYURVHKnHIxDSmKoigJUEWgKIpS5qgiUBRFKXNUESiKopQ5qggURVHKHFUESkkhIn6JjEyaNJKsiFwjIlfl4LpbRKRlrO3kQI4bROSLhZZDGV94Ci2AomTIoDHm2HQrG2PuSF2rPLA3GomxdvgqSgidESjjAnvE/kMRec3+m22Xh0bQIvJZEXnTDn52v13WJCJ/t8teEZGj7fJmEfmXHXjsl4TFchGRK+xrLBORXwZ3ocaR51sislSsGPGHR8tjv18pVvz7GWLlEviVXfZHETlTRF4UKyZ9eDTVY0TkKbv8k2FtfUlEFtn38i27bIZYse5vw9ocFR6eQFEAVQRK6VETZRq6LOxYrzFmAdauypvjnHsdMM8YczRwjV32LeB1u+xrWOF7Ab4JvGCswGMPAdMBRGQucBlWsL5jAT/wkQSy7jVWQL/bgXTMObOBnwFHA4cDH8baefpFW7YgRwMXYMWev15EDhCRs7HCDSzACu52vIwGEJwD3GOMmWeSh/NWyhQ1DSmlRjLT0H1h/38a5/hy4I8i8nfg73bZKVghBTDGPGXPBCZiJTJ5n13+iIjss+u/GzgeWGRZWqhhNCBYNMEAYkuCbaVgszFmBYCIrAIWGmOMiKzASpYS5B/GmEFgUESexur8T8GKFfW6XaceSzFsBd4yxrySxvWVMkUVgTKeMAleB7kAq4N/L/ANETmS5OF747UhwO+MMV9NQ55h+7+f0d+aj8iZeHWc+gCBsPcBIn+r0XIFwxD/wBjzywhhrRj3+9OQVSlj1DSkjCcuC/v/cvgBEXEBBxljnga+DDRijZqfwzbtiMjpWOac3qjy84BgMpWFwPtFZLJ9rElEDs5Axi1YKRMRkeOw0g1mykUiUi0izcDpWNF1nwD+Q6y49ojItKCMipIKnREopUaN2EnGbR43xgRdSKtE5FWsAc6Hos5zA3+wzT4C/NQY0y0iNwC/FZHlwACjoX+/BdwnIkuBZ7FMLBhj3hSR/8XK6ubCimb5aSBd2/sDwFX2PSzCioibKa8Bj2CtW3zHWDkldtrrFy/bJqt+4Aqs2YiiJEWjjyrjAhHZAsw3xuwttCyKUmqoaUhRFKXM0RmBoihKmaMzAkVRlDJHFYGiKEqZo4pAURSlzFFFoCiKUuaoIlAURSlz/j9VN1pBZO/nvQAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "import matplotlib.pyplot as plt\n",
    "\n",
    "fig = plt.figure()\n",
    "ax = fig.add_subplot(111)\n",
    "plt.plot(np.arange(len(scores)), scores)\n",
    "plt.plot(np.arange(len(avg_scores)), avg_scores)\n",
    "plt.plot(np.arange(len(scores)), expected_score*np.ones(len(scores)))\n",
    "plt.xlabel('Episode number')\n",
    "plt.ylabel('Score')\n",
    "plt.savefig('graph_trained_{:d}_episodes_{:d}_{:d}.png'.format(len(scores),config['seed']['environment'],config['seed']['agent']), format='png')\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAZAAAAEGCAYAAABLgMOSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjEsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+j8jraAAAgAElEQVR4nO3dd3gU1frA8e+7uyn0ovQW4FIEVJCIIIqIgKAo6lUvYAFFseO1o6g/rKBYrx0VQVTsAlJEmhQBKQLSe+gl9Jq65/fHTJIN2U02W7Ip7+d58uzMmZkzb5aw756ZM+eIMQallFIqvxyRDkAppVTRpAlEKaVUQDSBKKWUCogmEKWUUgHRBKKUUiogrkgHUJDOPvtsExcXF+kwlFKqSFm6dOkBY0yVM8tLVAKJi4tjyZIlkQ5DKaWKFBHZ5q1cL2EppZQKiCYQpZRSAdEEopRSKiCaQJRSSgVEE4hSSqmAaAJRSikVEE0gSimlAqIJRBUpxhh+XLqTpNT0SIeiVImnCUQVKXM2HuDxH1YwbMq6SIeiVImnCUQVKcdOpwKQeDw5wpEopTSBqLA4ejqVuEGTGL98V0jrzZw/U7KXd3h9Fhe9Oj2k51JK5U4TiAqLB7/5G4BP527x+5iUNLfPexsj520lbtAkpq/ZB1j5wxjDd4u3M+DLJWw/dIp9x7RVolRB0gSiQu5kchpzNx4AQDyaCpv2HuH4Eav8wIlk3p+5EWNM5k/712bS9LnfvNb5/qxNAExYsRuAymn7WbV9P0/9tJLf7aSilCpYJWo0XlUwnvzxn8xlsfPH0m2H2fFZH/7lnM+8WzZz6+d/AdC2wVnc+PECrm9VK/O+xo0fzWfUnW0oG2P9ea7dc4xDJ1My64whhRe39GO/+1qgV8H8UkqpHDSBqNA6tocTezcBZYCsWxX//mg+CbHzAbj98wWAgw6OFZTbtB+owuLly7nMsZvZ7vNZsu0ws9cn8u3i7fy15RAp6e5spyhDEgCVds/GWwJZt/cY2w+eomvz6uH5HZVSgCYQFYz0VDi+FyrWySp7qymjgcaMJoUoktPcvDfxr2yHNZEdrDX1+DL6NZgHCbFZ2+KSvgHgpW+mYRBKE4WbUgxxjea9tOvZR2WisXpiJaULNTnAYcpyGquSjfuO0+2duQDc2rYu8zcdZObjHcP2FihVkmkCUYGbOhgWfQJPbGF3amlmrN3Lbfam4VGf8HDqgzj3reShI89wU0ylzMOmxDzNWncd73UCbWQt38e8lLmeYpxESzrV5RB3pT7Bp9FvWuVp6cyPHchid2NuShkCQJe352Qe99XC7QB8uSCB29vFZZYnpaaT5jaZl8iUUoGJyE10EaksItNEZKP9WsnHft1EZL2IbBKRQV62Py4iRkTODn/UytNvq/Zyav0Ma+Xkfm4fuYjTkwZnbr/YsRoHbu50TQGguhzOdvw5jh1e640mNVvyAIgWq2dWxuWwcx0JAJTlNAAXOjZ4resu5yRudU7j+fGrAWg0eDIDvlxC0+d+o8X/TWXmun10evMPUs+4RKaU8k+kemENAmYYYxoBM+z1bETECXwAdAeaAb1FpJnH9jpAF2B7gUSssrn3q6VsPWxdSmL1OLbuP8oA16Rs+zzp+o5/O+fmq94NsX19bnOf8fBHjKRlW7/FOZ3ezhmZ689Gfc3LUV8A8OemA6Smm2w9tgb/sootiSe9PpSYlu7m7+2Hc5QrpbJEKoH0BEbby6OB67zs0wbYZIzZYoxJAb61j8vwNvAkHs+WqfBJTksnJS37N3WT8YE+exhPuL7Pts2Bm3tdv4Y0hhj73ocvr0SNZGjU51ThCI+4fsy27ZbP/sqxvznjL+dEchrDp64jNd3NvwZP4YYP57NMk4hSPkUqgVQzxuwBsF+retmnFuB5nWOnXYaIXAvsMsasyOtEIjJARJaIyJLExMTgIy+hznnuN9q/NhOA/qMWA9lbBGcmi7PkeMhj6OBcSSfH3163jYl6NXN5cez9POz62WOrlSliSCGKNNo5VpMQ24fqx1fxZ8xDbP3zBxhSgYPvXcEHszbTaPCUzCPv/nIJl7/xB7+t2hPy30epoi5sdxFFZDrgrR/lYC9lXqvwUmZEpLRdR1d/KjHGjABGAMTHx2trJUBukzX+1Ix1+6kj+3BR8PcORka/4bX8Uucqn8d8H/0iY9M68Xb0R9nKx8U8D4BZ9AII1DuxnHNlC2Oih1KGJBolj+HAiRQOnEjh3q/+JmHY1aH7RZQqBsKWQIwxnX1tE5F9IlLDGLNHRGoA+73sthPw7KpTG9gNNATqAyvEekqtNvC3iLQxxuwN2S9Qwm1JPEGZGBfVylvdYy9xrGSruzrr/ppKBU4wN+aRCEfovzaO9bSJXu/Xvr/GPJvr9mfHreSrhdvZ9Ep3XE4dyEGVbJHqxzgB6AsMs1/He9lnMdBIROoDu7CeGOtjjFmNxyUvEUkA4o0xB8IddEnR+qVpHLSf/E4YdjW/rtjNV9FDrY1T4J2o8yMYXWRldA1+7IcVvNurVYSjUSqyIvUVahjQRUQ2YvWkGgYgIjVFZDKAMSYNeBCYCqwFvreThwojY0xm8gCYvSGRYWN/z7bP5c48bz0VC19EvZZtffvBU5nL45fvzlz+dtF24gZN4ujp3G/yK1XcRKQFYow5CFzhpXw3cJXH+mRgch51xYU6vpIsNd26TSS4MQh9Ry4iIfbhsJ1vTvq5dHCuDFv9wbjcuQLPjl8dhs/KvsO+1VCxHp/P2wrA3qNJVCgVVYARKhVZehFXZZMx7tTW2FtJiL2FLo4lYT1fIhXCWr8/aktuVz8NlzhWkhDbh8aS1SnQgRs+uhi+7YPb7g/s8NbtQ6liTBOIyrTn6GmufX9etrJPo98K2/k+SLsWRyF/jOdB57jM+z+XOrJGGXZm9EDbOpv9x6wn4kUEYww/LNmR45kZpYojTSAlWFJqOm/+vp6klFT+/PUL2g2dwZbEkwV2/jXNHmF9LmNiFQbXO7MS6nNRX2cuOzy6MN+WZj1z4nQIE//ZwxM//pM5f4lSxZkmkBLs83lbeW/mJv4c+xrtl/6XG53WQIS1xVuv6uCk3rsA2j6Qreyd/7Tkvvsf935Ar29CHkMoeSaQcx3WPRCHwOFTVgeEwydT2HP0NHuOno5IfEoVBB2OtAS6eOgMWsdVpm7lUlTlMA02fwkOuNU5nTIkhey+R/2kr3jO9RULq97MJ9XOgSbdYeEHmdujnA4q1GoE//kKju2GivWgSmMoUxV2Lspe2W3jYIy3EW/Cq6Ej+xPoZTjNSUplu/SWcTnLIUK6O+t+SLuh1pP7+gCiKq40gZRAu48msdueGnZG9MvUd1gDDLZ0bKalY3NAdZ5oP4iyfw7LXJ+R3gqDg4QLn2NEzxZ2qf2hW+N86Ocx8OI51+Ss0OHxp/nwCqgUl3OfiwfC/P9lL6t7MWyfH9Dv4I/Vsf1pljQy6x4IVmvkUdf31PlfH5wdrFacw+OOerrb4NQ77KoY0ktYJc3mmZThNK1lPd9Hv5DjG3agynbKfilqhvsCAJ7ufk7OnaPLQUy53Cus1z5rubSP0fpjyucs6zsBrnkXgG1ub0OsBW9N7J2IRwuklhxkoGscAGOmLQRgccKhzO3vz9T7Iap40hZICXLqwHZKj7med6Ja08W5NLSVe7YYbvmRHbPLwaaDODy/omQMfyt+fBt3OGHIUd/be30DDa+AxZ/BCY8RbJxRVisESMPpf/z5VEOyEsQ5jqwZBabFPElc0jes2nUss+yfnUfCFodSkaQtkBJExt8PEHzyaNYzZ5lnUmjUhRG3X8iMxy4jxuXxIX5WQ+u1xQ2BnbdcTeu1/3RoejVExcJj6+C2X7Lv57Qe5qtetSonrxsV2Lny8FtMjilsfDpiP6G+JfEE17w3j6On9Il1VTxoC6QEKbUjf5M75fD0LogqDQ4HjOoBCXZ99jd+arQElzX4YqloJw2rlM1+fIXa8Ox+cEYHdv4Bs+DgZqhzYVaZCDTslH2/SnFw5VDKNL8OyteEcf0CO1+ALnOsYLY7a7ywpdsO88qkNXw61+qtNW3tPm5sXbtAY1IqHLQFUsQN/mUlQyZYQ4TtOXqauEGTGGkPreFp2/aE4E4UWxFiypJ5TarfROhrzwEidtk9s6H/1NzrccX4dwnLm3LVIa69920Dl8Pt9picItDufit5RMDo6Nc4c56zL+eupwrWpayk1PQIRKVU6GkCKeK+/ms7o+YnMH75Lr5auA2AFyeuydzea8QC4gZNot7IIEbQrdnK6gl1photoVwN6JT7EOgFonJ9aNDR+7ZSlQC4MnkY9P62QMJ5zvUVCbF9Mte/iHqdxbHWJURNIKq40ARSTDz87XI+mJWzC+7CLYe87J1P5WpAqYo5y2PLW/cg6rUL/hzhNHAZbZPeY72pC026c+S6MWE/ZX9XxqyGVkvkYmdWUp+7UWceUMWDJpBixkk6CbF9eHNwf46Nf4rynAi+0rb3B19HJJWqRPlq9ahU2rq5XrHltVC/g8/d02Mrh+zU3sb6mr1Bp1ZWxYPeRC+CklLTafrcb7SJy/lBNzHamjH4sagfYRn8EwuvpvYO/GSPbYBy1QI/vpD4/ZHLshfc/CW8Fud1X2fcxbBuYkjOG0MKp4kNSV1KFTbaAimCMiZ8WpSQ8/KU5zMJGZ6JGhvE2Qr3aLkBK1UJKtTNXhbfP2u5arOQnGZt7J20dWRdvqrCYV53fUJKktXh4QMddFEVYZpAiqDl28P0YNp98+HCu6weTRl8PQVeHDTpnn29/qXWqziyenSFwLfRL2cu/xXzIDe7ZrN30Y8AfDw7sKFjlCoMIpJARKSyiEwTkY32ayUf+3UTkfUisklEBp2x7SF722oReb1gIo+cwydTcLsN7k8788d32efoqMhxeynI1kK15nD1m1aPpp4fwPl9wFmMr3Je+Wr2hyIr2i2SWhdA2aq4n9nr/bggOMT6N6o780E+jxrO6aSkkJ9DqYISqRbIIGCGMaYRMMNez0ZEnMAHQHegGdBbRJrZ2y4HegLnGWOaA28UVOCRsPXASVq9NI2PZm/GsWsxw6NGEEMKCbF9SIjtw/LYezhPNnOz8w+/6jP+tCpa3QrXfxRc4IWd02XdC8lQq7XVCrvYmsLXEV0q2+6XJL8b0tNf4VxGnIQ+SSlVUCKVQHoCo+3l0YC3cbrbAJuMMVuMMSnAt/ZxAPcBw4wxyQDGmNBPYBFhqeluVu2yxoKaNfoFEmL78M7U1Znb18f2y7b/iOi3eD3qU7/qlv+MgYf/gT4/wGVPhSzmYqFac7IN4HXPnMzFnaZKyE+nY/SqoixSCaSaMWYPgP3qbdjUWsAOj/WddhlAY+BSEflLRGaLyIU5jraJyAARWSIiSxITC3/3yW8Xbef7JTt4ZdJaerw3j9W7j3LzMSvXnoXvwQWry+H8nahSPWjcFS5/pnjf5whWjewPYP5RqktIq2/l2MjuYfFMnf47x5OsMbI+/GMT45fvCul5lAqHsF3gFpHpQHUvmwb7W4WXsoyL/C6gEtAWuBD4XkQaGGNy3AQwxowARgDEx8cX2i5FB7csY/vuvQya6KYyxyhV0eo6e/X/5vFPjJXnuzkXB36CAbNhhN2V9cy3aeDfkKoz5+VlzYtXEnWkMXw4LauwUn0+SmzBfa5fA6rz9ahPIQlk7j3838FfeOs/LXn9t/UA9GxZK4+jlYqssCUQY0xnX9tEZJ+I1DDG7BGRGoC3S1A7Ac8Js2sDuz22/WwnjEUi4gbOBgp/E8OHs77syFnANY4HeS/6fXode5YT1KWaHKa8nAJgSNSXudaRQ493YOJ/oWy1zOE8LGckkNgK1k9JFpPL73/nVNi9nNLRLqjaKPu2Fv/mtWkX0NWxhARTnSucywI6vRvh52W72HH4VEDHKxUJkepiMwHoCwyzX731mVwMNBKR+sAuoBeQMbjQOKAT8IeINAaigSI3PkSrF3+nTuXSTHjwksyyixxrgexdPwPWpLuVQIyxRsLNUEFHgs3msQ3WII++1G1r/WS4+UvY9Tf8+Q5UqMXt7eqxrcls6kcdhTE+r6bmytgN7sUJ+bwUqVQERSqBDMO67NQf2A7cBCAiNYHPjDFXGWPSRORBYCrgBEYaYzLuIo8ERorIKiAF6Ovt8lVh9Mf6/bw8aS0VS0Vx+FQqh08dpe9LH2b2KLjWGY7pWI01QdPzh+FkYrF4sjyk8vt+NOsJ51xrzZr4r868GG/fSjye+2G5cRu9na6KnogkEGPMQeAKL+W7gas81icDk73slwLcGs4YQ2nT/uN0fmsOEx+6hH5fZL+PIbjplDwz81+ivAR+LyItugKuFPtGe6OuEF0maxms3kWaPEJDxOqE4MkR+H+ndH2mVxVBxfgpscjadyyJGWv30+eiusxYux8n6Xz6xQigGb9EP888dwuaSwKdnMtJNCG4//DkVlzOaBjZDfattIZYjylnddctVyP4+lXeHIFPoVteThFDCq0dG5jvbhHCoJQKH00gYXLPmKUs33GEo6dTWfv7SDbHvg9pcHNUc1o5NtHKkTUGUhXJZe5vfzy5FUrbAytmfojZl0Qq1QuubhUazW+A1T/73HyWHOc51xhudc2gX8oT/OFuxfq9x0lKTef8Ol6G0leqENB2c5jsPmJdinrtt3X8L/r9zPL2ztW+Dsm351P7Qocns5IHwE1fwEX3QTX9FlvgYivAxQ9539bhiTwP/7fTmiJ4VPRwGsouZr1/L70+mAHrp8CQCnBkRx41KFWwNIGEwYETyRw4fponXN9SR/aF7Tydru8Pnc54rKZyA+g+LPvT1KpgiEDXl61nbs5ULe/RfUtJSubymOih3OuayNrYO1n2tT3j4x4vs0IqFUH6KeOHBZ89xoaX4v3b+dQhHBP/y+3O33nANYG5MY+ELa6O8UFMU6vCp2ZL67XauRBVJrAqJGuo/ozLnXeN+ZtdR/SBT1V46D0QPziSDlE1fY9/O79en8rAkKgwBXPHFPiiuzVqriq87p1nje4bwgc0z5JjDHjtc3568T5iowK/Ya9UqGgLxA9GnDhw+95hxXewL3T3NrJ57kDW3BQX3Qv1LoYhR615O1ThVf3cnMmjRnAtxteiPmVSzGD2H0sOqh6lQkUTiD8cTpwmK4EYYzJHygXglwHw0cX5r7eU12lQstwzF5xRUP8y6DUWur6S/3OowuPKoZmLz6X2C7iagd8u4+ZPFnA6JT0EQSkVOE0g/hAH4jF+1JiF2+jx3jzG/rUNlnyRWZ46JOcc5bm6+k1odKX3bc/uhxrn2ecXaHpV8Z7cqSSIaw93/s5ntV5iTHrXvPf3YfmOIyzaeogl23JOaaxUQdJPJD8YceD0uITlXj+VDo6DjB23md4xz2WWR5H3N8LhMQ/wREs3XPGc9aS4OGHj1Jw75jY2kyq66l5E/7vacJcIDAmuKtHZRFSEaQLxh8c9kNR0N/0SnqRfNHyT1sm/4++ayZhPhjI0tTcLnroWSnncYW9+HTQ7Ai/YD4td/RZccHuIfwFVmIgE98F/uWMZs9ytQhSNUoHTS1j+cDgzWyDTZ2S1Fvq4Zvo85OGU+wFIIhpqt+aWF35g1as3UKGUl+5ZItDlJfjP13Bhf+u+hyr2dle7HIBZ6fm7uf5F9HBeco3kgW/+ZuDYZfy4dGc4wlMqT5pA/CFOHGLYMH8c3ef38uuQpaYxrZI+5uC9qwBwOASHI5dvnu0Hwjk9QhGtKiIWnfcyP6VfwlsVn873sbe5pnP0dCoxq77hxl+bw4liN6uzKgI0gfjDHl+q8e99/T6kQ7M6DL+9E7Wq6+i3yrvYCmfxWOr9dGhRn50m/9MKl+MUw6NGWCsHN+W+s1JhoAnEDyL5f2jr1Zvb0rmZJg/l25XNq/PGTefz8BWNGZ+e/27gK2M9ngU6Eb4hc5TyRROIP8S/t+n7tMuyVmLKhikYVVyICDe2rk20KwT/DX/oF3wdSuWTJhB/+Dkw4ebzHyetXC24e1aYA1LFTWyFqpnLgVzOUioSIpJARKSyiEwTkY32q9dHskWkm4isF5FNIjLIo7yliCwUkeUiskRE2oQ1YD8mCkqr0Zqnb+qA67E1UOuCsIajip/+9z2VubzBHdic9UdPp4YqHKX8EqkWyCBghjGmETDDXs9GrBsPHwDdgWZAbxHJGBP7deAFY0xL4Hl7PXx83AP5x13fWrjkEVz9xoc1BFXMla3K2PqvsqBMZwal3h1QFTe8+AWknApxYEr5FqkE0hMYbS+PBq7zsk8bYJMxZos9B/q39nEABihvL1cAdocxVsTHJawhqX25J+436DzEmj5WqSD07vsAbR//kb5XtiUu6Zt8Hz8j5gmS3mvHOc/9xh/rPbr1HtgEb58Lx/VGuwqtSCWQasaYPQD2a1Uv+9QCPKdg22mXAfwXGC4iO4A3AJ8d6UVkgH2Za0liYmJAwYox2Qtu+4X0UmexwjTktvaNAqpTKW9EhPs7NuTBy/9FYo/RnLrm43wdH3s8gfKpibwzfWNW4cIP4eh2Nr3VhYQDJ0McsSrJwjaUiYhMB6p72TTYS5nXKryUZXyS3wc8Yoz5SURuBj4HOnurxBgzAhgBEB8fb7ztkxfjzhrj6pLkd5jXsBPOp7awOZDKlMqDiPD4lU2AJgD8cLAmN82/1u/j/4p9kLX76rBj9uPUOfQXRMUC8C+zjZcXbuPZHnnPjqiUP8KWQIwxXj/QAURkn4jUMMbsEZEagLfHaHcCdTzWa5N1qaov8LC9/APwWQhC9s1kJZD7u54X1lMpdaabunSAxK6w8Xe/jznHsQNm2f9FWt+RfePG6dZIzw6XNaCnDtypAhSpS1gTsJIA9qu3O9CLgUYiUl9EooFe9nFgJZKMhy46ARu9HB8yni2Qm9o1DeeplMpJBG78Iu/9fDh9PGvYd8ENX/8bRl8Dr9eHr28KRYSqhIpUAhkGdBGRjUAXex0RqSkikwGMMWnAg8BUYC3wvTEmY9q/u4E3RWQF8CowIKzReiQQV3SpsJ5KKa9iysKjawM6tNSGrO9nFZPtqZkT11mvW2cHG5kqwSIynLsx5iBwhZfy3cBVHuuTgcle9psHtA5njNlPmDUXiK8eWUqFXfmaQVfxwMobQxCIUhb9NPSH3QKZX1vnIVfF0PgHIx2BKqI0gfjDboGIn2NiKVWkLBsT6QhUEaWfiP6we2EZP4Y0USqs7sqaxCzb4J1KRYAmED8Yt90C0QSiIq121q2/QWmBDXnijdttwNg/SvlJE4gfxG6B6CUsVRjsueUP7kp5DLfXZ20Dc+Pgd9j91qXwQsWQ1amKv3x9IoqIQ0TK571n8WIyemFpC0QVAmlnNWG6uzXeB2sIzM8xQ6h5fKW1MvPlkNWrirc8E4iIfCMi5UWkDLAGWC8iT4Q/tMKjTifrUkGDS/2bD12pcKpSznpy/O5L63Nh0gehP8Gc4eB2572fKvH8aYE0M8YcwxoxdzJQF7gtrFEVMrWbtIYhR6laT59CV5EXG+UkYdjV9G5Tl0QqcXfKoyE/x4hXH+BEclrI61XFiz8JJEpEorASyHhjTCpZgxoqpSKkanlrkMQVZdpnlk1Jv5A2IWiVDEj7hn92HskqMAaSjgVdrype/EkgnwAJQBlgjojUA/QvSakIKxvjImHY1Qzo0CCz7LnUO9mP1wk+863/p7M5sn6OtTL3TRhWB054G/dUlVR5JhBjzP+MMbWMMVcZyzbg8gKITSnlh9va1ctc7t/tIgCaJ31Ow6TgHhBcG3snFcdeA5tnwepxVuHxvUHVqYoXf26iP2zfRBcR+VxE/sYaAVcpVQjEuJxw5avQfzr3dWwIwElKkY6TT9KuDv4ER3eiV62VN/5cwrrTvoneFagC3IE9eq5SqpBo9wDUuRCAdS91yywemnZL8HVvmcX2Q/ZMhhK6rsOq6PMngWT8xVwFfGGMWUEoO6ArpUIqNsr780pz0s8NrMJVP3Eqs0eW/tdXWfxJIEtF5HesBDJVRMoB2klcqSKgVsVSHDZlAdhsAh8Ovqljh7WgLRDlwZ/5QPoDLYEtxphTInIW1mUspVQhN/3Ry4h//l1cpHOaGO5wTQ2yRk0gKkueCcQY4xaR2kAfsb59zDbG/Br2yJRSAZv2SAcOnUyhVLSTk+ScRTPRlKeKWL3xn0ntz6tRn/tXsbZAlAd/emENAx7GGsZkDTBQRIYGc1IRqSwi00Rko/3qteO6iIwUkf0isiqQ45UqqRpVK8dFDc7yub1j8tt8k2b1xt9hquSr7tR0tzV671+fwJEdQcWpijZ/7oFcBXQxxow0xowEugHB9g0cBMwwxjQCZtjr3oyyzxfo8Uop2+LBnTOXT1KKZ9P60yLpM+a6z+OG5CF+1XE8KZVGg6fw4KdTYcqT8NW/wxStKgr8HY3Xc4znCiE4b09gtL08GmuYlByMMXOAQ4Eer5SCF3s258NbLsgchBHg0kZn48ZBXK3qAPxtGtMkaRSXJL+Ta13fjXgVB25a7bD/+506GLa4VeHnz030ocAyEZmFdQetA/B0kOetZozZA2CM2SMiVQv4eKVKjNvbxWWt3DQa9q7k7Yta8uuK3ZSJdvHkT//QoEoZtiTCTlOVbsnD+C3Ge6P+LtcUThHD3a7JVoHRDpklmT9DmYwF2gI/2z/tgK15HSci00VklZefnkFHnQ8iMkBElojIksTExII8tVKFT/Pr4IrnOLtsDHe0r595T7xlnayLDM/ccWOuVQx0jcta0QRSovnTAsH+tj8hY11EFmEN657bMZ19bRORfSJSw2491ADyO0Kb38cbY0YAIwDi4+N1PAalfFjxf13ZcegULWrl5yq1/pcqyQKdozXYvnwTgL72cl9gfAEfr5QCKpSKAqBK2RgqlIrKTB6zr13AvSn/zfN443Yzct5WktPSwxqnKpwCTSDBfu0YBnQRkY1AF3sdEakpIpMzdhKRscACoImI7BSR/rkdr5TKny7NqjH8xvN4tGvjbOXVatb268n1tPQ0Xpm4kg9nbgxXiKoQ83kJS0R+xXuiEMB3B3M/GGMOAld4Kd+N1W04Y713fo5XSuWPiHBTfJ0c5U2rlye5dA3Io2EhJp3NsbexYfXF0HVKmLptNlQAABxxSURBVKJUhVVu90DeCHCbUqoYeOb6NiT9EMVCdzM6Old43cflTgGg8dH5BRmaKiR8JhBjzOyCDEQpVbg4HULTZOt5jwRnnwhHowqjQO+BKKWKOWOyrmCvdMflfUBqUviCUYWSJhCllFfn1c56NuSGlBdpmvQF5yWN8Ll/ymQdUaikyTWBiIhTRIYXVDBKqcKjeoVY3uvdCoBUXCQRwzHK+tz/9J51BRWaKiRyTSDGmHSgtYiO4axUSeTIx399pzs1jJGowsifJ9GXAeNF5AfgZEahMebnsEWllCoU/lXVanG0bVCZhVu8jWuaxWE0gZQ0/twDqQwcBDoB19g/PcIZlFKqcGhSvRxLnu3M2LvbZiYTXzfUE/YdYdeR0wUYnYo0f2Yk1OlrlSrBzi5rDQM//dHLSDyezIWvWOUJsdm79kaTym+r9tL/kvoFHaKKEH9mJKwtIr/YMwPuE5Gf7ClulVIlTJVyMXRsYs1geF7Sp9m2RZHGSxPXRCIsFSH+XML6AmvwwppALeBXu0wpVQI57RvrxyiTrbyeYz9VOBKJkFSE+JNAqhhjvjDGpNk/o4D8TaKslCoRFsferw8UliD+JJADInKr/UyIU0RuxbqprpQqga6/oBYAz/do5n2HNE0gJYU/CeRO4GZgL7AHuBHQG+tKlVA9zqtJwrCraV6zPC+n3pJj+7ETpyIQlYoEfxJIHWPMtcaYKsaYqsaY64Cc4z8rpUoUt4E0nDnKkz/uWPDBqIjwJ4G852eZUqoEcQj85T4nR3mV9H0RiEZFQm4TSrUDLgaqiMijHpvKg5evHUqpEuXCuMqsNfXY4q5OA8feSIejIiC3Fkg0UBYryZTz+DmGdR9EKVWCORxWd15vrRBVMuQ1odRsERlljNkWypOKSGXgOyAOSABuNsYc9rLfSKxhU/YbY1p4lA/HGlIlBdgM3GGM0Q7oShWwH+9tx8aFibBuVvYNqUkQFRuZoFSB8eceyGcikjkxgIhUEpGpQZ53EDDDGNMImGGvezMK6OalfBrQwhhzHrABeDrIeJRSAYiPq0zvXv1okfRZ9g2zh0UmIFWg/EkgZ3t+u7dbClWDPG9PYLS9PBq4zttOxpg5QI4hQI0xvxtj0uzVhYAOraJUBH1we9vsBfPehvQ07zurYsOfBOIWkboZKyJSDzC57O+PasaYPQD2azAJ6U5giq+NIjJARJaIyJLExMQgTqOU8sUt0TkLZwwp8DhUwfIngQwG5onIGBEZA8zBj0tGIjJdRFZ5+ekZbNAe5xgMpAFf+9rHGDPCGBNvjImvUkVHYFEqHIxA75TB2QvnvwcHN0cmIFUg/BnO/TcRuQBoCwjwiDHmgB/Hdfa1zR7Vt4YxZo+I1AD25ydou46+WDfYrzDGBNsiUkoFIcrp4IjxMt1tqvVU+t6jSSxeMItrOl0G0aULODoVLv60QADSsT7kjwLNRKRDkOedAPS1l/sC4/NzsIh0A54CrjXG6LgJSkVY+4ZnY/A+/e3uI6f5/qP/45qFvTj9/V0wpIL1s3tZAUepQs2f+UDuwrpsNRV4wX4dEuR5hwFdRGQj0MVeR0Rqishkj3OPBRYATURkp4j0tze9j/VMyjQRWS4iHwcZj1IqCA6HcE6N8jk3fHwJlwybzsAk679oqU2TsrZNfqKAolPh4s+c6A8DFwILjTGXi0hTrEQSMGPMQeAKL+W7gas81nv7OP5fwZxfKRV66T6+j5bFxzS3OxeHMRpVEPy5hJVkjEkCEJEYY8w6oEl4w1JKFTXplRvzcVqPHOWPun7wecyoWas4kazdfYsqfxLITvtBwnFYl4zGA7vDG5ZSqqgZeuN5xHZ/OUd5P9fvPo/pN7s9L4xfFc6wVBj50wvrentxiIjMAioAv4U1KqVUkVM+Nop+7etb40Tkw+MbesORqVCxbt47q0LF315YgDU+ljFmgjEmJVwBKaVKlmppu+GdcyMdhgpAvhKIUkrlZVu7VwI7cEgF+L5v3vupQkMTiFIqpOqd7eWBQn+tGQcrfwS3O3QBqbDRBKKUCq06F+UoGp9+sf/H/9QfVowNYUAqXDSBKKVCq2K9HEXfpXfMXx0n7Glx962G/Wvht2fAnR58bCqk/HmQUCml/CdZ30uvTX6JanKY+e4W3J8ykNeiPqWcWA8Wdkp+g5kxj3uvY8YL1o+nc3pAPR8tmeQTEBPEpTMVEG2BKKVCy5H1vfTZAbcyzR0PwGR3W85N/pyjpa0WSut/1cpfvckn4NVasP6M2Rt2LYWhtWDtr0GFrfJPWyBKqdByuuCO36BCLdpUrJxZvObFK0lzG8odbwSrfmR4x+7sfbEq1Y2fg3F/c5P1OvUZaNLdGozRVQp2LrXKt/wB51wT2t9F5UpbIEqp0KvXLseDgaWinJSPjUKqNIbLnwERfqjp4xJWbg5tgXWTYERH+PAiSLInTBX9OCto+o4rpcLqyzvb0OO8GojkHO79ztv7ezkib6kzh2atzLKfOxFnQHWpwOklLKVUWHVoXIUOjb3PBlomxkWasxSudB8j9voQtX9lzsKjOwIJTwVBWyBKqYhy9XgjNBWtmwifX2ndbFcFQhOIUiqyWt0Kzx8OTV07Flo9svavZcycNcxYszc09SqvNIEopSLP4WBjxUtDV9+HbbltZjvmfZ1zeHkVOhFJICJSWUSmichG+7WSj/1Gish+EfE6YYCIPC4iRkTODm/ESqlwOxxbO+R1Puz6Gf75nh2HTtHwmcl8OmdLyM9RkkWqBTIImGGMaQTMsNe9GQV087ZBROpgzae+PRwBKqUKVqVrQ99aqCgn4ee7+XXmbNLdhlcmr8XtNiE/T0kVqQTSExhtL48GrvO2kzFmDnDIRx1vA08C+tegVDHQqObZ0O5B6PJiyOv+ean1PfMsjvLlggTiBk3iz00HMEY/PoIRqQRSzRizB8B+rZqfg0XkWmCXMWaFH/sOEJElIrIkMTExsGiVUgXjyleg/cNQtXmOTQ+mPMTL1d6hW/KwfFdbiRP0dMxjaex9NJ96M2C45bO/+OLPBD6evZnDJ1N0bvYAhO05EBGZDlT3smlwkPWWtuvo6s/+xpgRwAiA+Ph4/bqhVFHgsL7bPpZyL4tME8ZeFcPESRUZ1KwpTSsd4+NV13Cvy/+xr36IyWrVXOjYQJzsJcHU4MWJawAYNmUdAIueuYIjp1NpXK0cq3YdJd1tOL9OxRD+YsVL2BKIMaazr20isk9Eahhj9ohIDcDPwXAAaAjUB1bYT7bWBv4WkTbGGO2zp1RxUKk+7F3JA7168t/aLalduTQzm56g/tllSEp1c8c/53MvgQ+eOMA5iWfS+gPZn47v/u5cDp5MIWHY1fR4bx4ACcOuDuY3KdYidQlrApAxd2VfYLy/BxpjVhpjqhpj4owxccBO4AJNHkoVI11fgksfp0GLi6hTuTQADaqURUQoFe3k21ef4FSPD7MdEpf0DcvdDf2qvo9rJu9GfZCj/ODJFKuuQZOC/AVKhkglkGFAFxHZiNWTahiAiNQUkckZO4nIWGAB0EREdopIYAPnKKWKlkpxcMVz4PA9vlXpC3phLs9+Rfy2lKfpnPy6X6fo6ZzPN1H6nEgwIjIWljHmIHCFl/LdwFUe6739qCsupMEppYoGhxO57EmY/x4kHwPgOKU5bkr7XcXFzjWQ6t++QyasZtT8BL2k5UGfRFdKFW2PrILHN2aulo3J3/diB+7M5c6OpZTlVLbtu45YAz2Omp8AoF1/PehovEqpoi22AgAzH7sMgOs++DNfh2+JvZUxaZ3p6lxCNTnCb+kXcm/qIwxw/sohynP5cAcbXumeuX+a2xDlzDk0fUmkLRClVLHQoEpZGlQpy/PXNOe+lIfzdextrulUE2tiqnqyD4BnosbyRtQnpKS7+XXF7sx9U9LcXusoibQFopQqVm5sXZuyMfeRXLUvMVumMSaxIbctvdHv489xbGdtTL9sZQ+NXZa5nJLmpkxMqKIt2jSBKKWKnW4talgLVRtyG8BSIT+jHpWSlOz1ORbR2rGBV9Ju5a+tB7PqL+H0EpZSqvhr8e+gDv84+h3udllPGNz71d+MX76LDfuOhyKyIk0TiFKq+LtqOFz2FDx/CHq8k69DY0nOUfbwt8vp+vacUEVXZOklLKVU8Ve6Mlz+jLVs99ry12tRn/rc9s70DRw5lUq18rF0a1Gd+meXCSbKIkdKUp/m+Ph4s2TJkkiHoZSKJGPghYwBEvN3b6Rh0hjS8f10/HM9mtH/kvrBxVcIichSY0z8meV6CUspVbKIQPPrreWLH8rXobc6p1OG0z63v2SP7nvwRDJLEqypjE4mp5GUmh5YrIWcJhClVMlTqrL1WrEunNfL78NeiBrN1Jin6OmY53OfjfuOc/MnC7jx4wW43Ybm/zeVq/83N9iICyVNIEqpkiemrPXqigGxPwab9oCr38zz0NpygHejPyQhtg9dHDkviXd5ew6bE08C0O1d60Z7xnpxozfRlVIlz2VPQXRZOL83NO5uXda6+k1wxsCkx/yu5n7XBKal5Lg1kGnDvhNey+dsSCTh4EmmrdnH4KvPoWn18vn+FQoDbYEopUqe6DJw2ZPgjIKyVeC6DyGqVOZMiP5q5dhEeU4SJ3vy3PezuVvYdtBqidw+chHPj1/N3I0HGDJhdUC/QmGgvbCUUsrTif1wbDeMuCxfh12c9D8GuCYyNK0PyUT73O+a82tmG1srw6vXn0udyqW4tFGVfIccbr56YeklLKWU8lS2qvWTT/NjBwJwjNJMTb+Q1cZ7d15vyQPgmV9WAjCyXzydmlbL9/kjQS9hKaWUN30nWjfW+03Oe18PA13jmBQzmD7OGdzrnEANDubYpwLe740A7DmalO9QIyUiCUREKovINBHZaL9W8rHfSBHZLyKrvGx7SETWi8hqEfFvDkullPJX/Uuh19cQ1x6qn5vvw1+N+pxBUd+yIDb7syYzoh9jRewAn12B3UXorkKkWiCDgBnGmEbADHvdm1FAtzMLReRyoCdwnjGmOfBGmOJUSim41/dzH/74NCqre3BDh3XDvYPzH8pyik+j3qAqhzO3L9p6iMbPTmHq6r1BnbMgRCqB9ARG28ujgeu87WSMmQMc8rLpPmCYMSbZ3m9/OIJUSqlM138CN3wKA5flve8ZujiXsjnmFl50fZFZdpFjHTc459LF+TeLYh/gSsdiwLpHkpLmZvjU9SELPVwi0gtLRI4YYyp6rB82xvi6jBUHTDTGtPAoWw6Mx2qdJAGPG2MW+zh+ADAAoG7duq23bdsWql9DKVVSvdkUjufddTe/4pK+ybaeMOzqkJ8jEAU+FpaITBeRVV5+eoagehdQCWgLPAF8LyJeJyk2xowwxsQbY+KrVCl83eOUUkXQbeOgUdeQVzvA+Wu29aFT1ob8HKEUtgRijOlsjGnh5Wc8sE9EagDYr/m9BLUT+NlYFgFu4OzQ/gZKKeVD1abQ+ztrMMZ+k0JW7TNRY6nMscz1T2Zv4c9NB0JWf6hF6h7IBKCvvdwX63JUfowDOgGISGMgGii877JSqvhxOKDryxB3CdTvELpqzxhe/pbP/spcPp6USqc3/6DJs1NCdr5gRCqBDAO6iMhGoIu9jojUFJHMTtciMhZYADQRkZ0i0t/eNBJoYHfv/Rboa0rSI/VKqcLlP19nLXcfHlRVY6Jfpb7swXOeEmMMWw+c5OJhM9mSeJLkNHdQ5wgVHcpEKaVCYYg90+Hzh+FFr32C8uXl1Fv4LN33TfSCvMGuE0oppVQ4/ftzqNHSurT12HprnpFH1wVc3UWO3I9N9+OJwzELErhrdPi+NGsCUUqpUDj3RrhntrVcrjrc8AmUrwFNAmspOMl9FsOGz0xmwordJBw4yab93odGeW78aqav3RfQ+f2hgykqpVQ49f4Gts6F0T3ydVg0qQB0dCxjhbshh8k5Z8jAsVkPNc598nLqVC5Nz/fnceR0Kq3qVMyxf6hpC0QppcKt/qXQ8WlrucOTfh1yiXM130a/xKjo4YyIfivP/S99fRYPjV3Gip1H2XbwFOOWex/1N5Q0gSilVEFo0t16bXrGJa0eb/s8pK3DepCwrliPypXhNG1kLTc5/2BC9OAc+/saKj5cNIEopVRBqHE+DDkKNVtCg8vBFWutx98JT2zO9dBqcgSAd6I+5PuYlxgeNYLzHFtJiO3Dfc4JeZ761clrCUePW00gSilV0G4fB8963Nwu489AGoYuzqU5Sh93fZfnkSPmbAnLPCOaQJRSqgho51jjtdxtf4xX5TAOfD9gmJauLRCllCqRxka/4rU8StJZGnMPi2If4BHXj7hIy9xWV/bRXBIASEkP/dPr2o1XKaUKg5tGwQ/9Ajr0LDkOwEOucTzkGsd3aR05RQx3uKYC1jDxqWFIINoCUUqpwqD59RBdLiRV/cf1R2byyKAJRCmlirPH1kGr26DdgyGtdkr0IE0gSilVrMWUhZ7vQ0xoWiIZznFsJzk196FRAqEJRCmlCpu298P5feCJLVC1eUiqLL81dBNfZdAEopRShU1sebj+IyhzFtw/HwZth0r1g6qyaenjIQouiyYQpZQq7GIrwENL4YLbrfV+k3Pf3wtX+RohDkoTiFJKFQ0OJ1z7njX8SVx7eHwTNO0BZzf27/haF4Q+pJDX6AcRqSwi00Rko/3qdfouERkpIvvtqWs9y1uKyEIRWS4iS0SkTcFErpRShUTZKtDra3hwsX/7O6JCHkKkWiCDgBnGmEbADHvdm1FANy/lrwMvGGNaAs/b60opVTI9tiH7gIyNrsy5jzM65KeNVALpCYy2l0cD13nbyRgzBzjkbRNkzq5SASjYMYyVUqowKVfNGpBRnNb6f77KuY8z9C2QSA1lUs0YswfAGLNHRKrm8/j/AlNF5A2sJHhxqANUSqkip/q5sGe5db/kTK6YkJ8ubAlERKYD1b1syjkLSv7dBzxijPlJRG4GPgc6+4hjADAAoG7duiE4tVJKFVK3/QL711gJxBkD6clZ26LLhPx0Eo5JRvI8qch6oKPd+qgB/GGMaeJj3zhgojGmhUfZUaCiMcaIiABHjTE5Jww+Q3x8vFmyZElIfgellCrUju2Bt5pay8/sDiqBiMhSY0z8meWRugcyAehrL/cFxufz+N3AZfZyJ2BjiOJSSqnioVx16PQsDFwWltYHRC6BDAO6iMhGoIu9jojUFJHMJ2REZCywAGgiIjtFpL+96W7gTRFZAbyKfYlKKaWUTQQ6PAGVG4TtFBG5iW6MOQhc4aV8N3CVx3pvH8fPA1qHLUCllFJ50ifRlVJKBUQTiFJKqYBoAlFKKRUQTSBKKaUCoglEKaVUQDSBKKWUCogmEKWUUgGJyFAmkSIiicC2AA8/GzgQwnBCpbDGBYU3No0rfzSu/CussQUaVz1jTJUzC0tUAgmGiCzxNhZMpBXWuKDwxqZx5Y/GlX+FNbZQx6WXsJRSSgVEE4hSSqmAaALx34hIB+BDYY0LCm9sGlf+aFz5V1hjC2lceg9EKaVUQLQFopRSKiCaQJRSSgVEE4gfRKSbiKwXkU0iMigC508QkZUislxElthllUVkmohstF8reez/tB3rehG5MoRxjBSR/SKyyqMs33GISGv799kkIv+zpyUOdVxDRGSX/Z4tF5GrPLYVVFx1RGSWiKwVkdUi8rBdHtH3LJe4IvqeiUisiCwSkRV2XC/Y5YXhb8xXbBH/O7PrdIrIMhGZaK8XzHtmjNGfXH4AJ7AZaABEAyuAZgUcQwJw9hllrwOD7OVBwGv2cjM7xhigvh27M0RxdAAuAFYFEwewCGgHCDAF6B6GuIYAj3vZtyDjqgFcYC+XAzbY54/oe5ZLXBF9z+w6ytrLUcBfQNtIv195xBbxvzO7zkeBb4CJBfn/UlsgeWsDbDLGbDHGpADfAj0jHBNYMYy2l0cD13mUf2uMSTbGbAU2Yf0OQTPGzAEOBROHiNQAyhtjFhjrr/ZLj2NCGZcvBRnXHmPM3/bycWAtUIsIv2e5xOVLQcVljDEn7NUo+8dQOP7GfMXmS4HFJiK1gauBz844f9jfM00geasF7PBY30nu/9nCwQC/i8hSEcmY/72aMWYPWB8IQFW7vKDjzW8ctezlgojvQRH5x77EldGEj0hcIhIHtML65lpo3rMz4oIIv2f2pZjlwH5gmjGm0LxfPmKDyP+dvQM8Cbg9ygrkPdMEkjdv1wELuu9ze2PMBUB34AER6ZDLvoUhXvAdR0HF9xHQEGgJ7AHejFRcIlIW+An4rzHmWG67FmRsXuKK+HtmjEk3xrQEamN9M26Ry+4F+n75iC2i75mI9AD2G2OW+ntIKOPSBJK3nUAdj/XawO6CDMAYs9t+3Q/8gnVJap/d7MR+3W/vXtDx5jeOnfZyWOMzxuyz/8O7gU/JuoxXoHGJSBTWh/TXxpif7eKIv2fe4ios75kdyxHgD6AbheD98hVbIXjP2gPXikgC1uX1TiLyFQX0nmkCydtioJGI1BeRaKAXMKGgTi4iZUSkXMYy0BVYZcfQ196tLzDeXp4A9BKRGBGpDzTCujkWLvmKw25OHxeRtnYvj9s9jgmZjP88tuux3rMCjcuu53NgrTHmLY9NEX3PfMUV6fdMRKqISEV7uRTQGVhHIfgb8xVbpN8zY8zTxpjaxpg4rM+mmcaYWymo9yw/d/pL6g9wFVZPlc3A4AI+dwOsXhMrgNUZ5wfOAmYAG+3Xyh7HDLZjXU8Ienh41DsWq5meivWNpX8gcQDxWP/RNgPvY4+IEOK4xgArgX/s/zQ1IhDXJViXAf4Blts/V0X6Pcslroi+Z8B5wDL7/KuA5wP9Ww/Dv6Wv2CL+d+ZRb0eyemEVyHumQ5kopZQKiF7CUkopFRBNIEoppQKiCUQppVRANIEopZQKiCYQpZRSAdEEopQfRORE3nuFPYY4EekT6TiUyqAJRKkCJCLOIA6PAzSBqEJDE4hS+SQiT4jIYnsAvRc8ysfZA16u9hj0EhE5ISIvishfQDt7/RWx5pZYKCLVvJzjMsmaY2KZPRrBMOBSu+wRe3C/4R6x3GMf21FE5ojILyKyRkQ+FhH9v65CTv+olMoHEemKNfxDG6wB9Fp7DG55pzGmNdYTvQNF5Cy7vAzWXCUXGWPm2esLjTHnA3OAu72c6nHgAWMN3ncpcBprXoe5xpiWxpi3sZ64P2qMuRC4ELjbHp4CO77HgHOxBvu7IXTvglIWTSBK5U9X+2cZ8DfQFCuhgJU0VgALsQasyyhPxxq4MEMKMNFeXop1aepMfwJvichAoKIxJs1HLLfbQ4z/hTV8RcY5FxlrDpt0rKFeLsnn76lUnlyRDkCpIkaAocaYT7IVinTEGmCvnTHmlIj8AcTam5PsD/IMqSZrDKF0vPw/NMYME5FJWGNULRSRzj5iecgYM9VLLGeOUaRjFqmQ0xaIUvkzFbjTnksDEaklIlWBCsBhO3k0xZruNGAi0tAYs9IY8xqwBKulcxxrClrPWO6zh2ZHRBrbIzaDNV9Fffvex3+AecHEo5Q32gJRKh+MMb+LyDnAAmvUa04AtwK/AfeKyD9Yo5wuDPJU/xWRy7FaKGuw5qh2A2n2ZbJRwLtYl7/+tofgTiRrGtIFWDfdz8W6z/JLkPEolYOOxqtUMWNfwnrcGNMj0rGo4k0vYSmllAqItkCUUkoFRFsgSimlAqIJRCmlVEA0gSillAqIJhCllFIB0QSilFIqIP8PCMkuuTNgnZEAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "fig = plt.figure()\n",
    "ax = fig.add_subplot(111)\n",
    "plt.plot(np.arange(len(actor_loss)), actor_loss)\n",
    "plt.xlabel('learn step')\n",
    "plt.ylabel('actor Loss')\n",
    "plt.savefig('graph_actor_loss_{:d}_episodes_{:d}_{:d}.png'.format(len(scores),config['seed']['environment'],config['seed']['agent']), format='png')\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAZUAAAEGCAYAAACtqQjWAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjEsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+j8jraAAAgAElEQVR4nO2dd5wURfbAv29mk+SMSHARUcSEgqhnzhjx9MxZTw/j4an3Qz0VwxnPM5yKep4Bc1ZO8RRRMIKCkoMggoCEJcdNM/X7o3t3J/TM9ISesPu+n8/udFdXeNMzU6+r6tV7YoxBURRFUTKBL9cCKIqiKI0HVSqKoihKxlCloiiKomQMVSqKoihKxlCloiiKomSMolwLkEs6dOhgysvLcy2GoihKQTF58uRVxpiOTteatFIpLy9n0qRJuRZDURSloBCRRbGu6fSXoiiKkjFUqSiKoigZQ5WKoiiKkjFUqSiKoigZQ5WKoiiKkjFUqSiKoigZQ5WKoiiKkjFUqSiKooQSDMAPL0KgNteSFCSqVBRFUUKZ/DyMugomPplrSQoSVSqKoiihbF0T/qokhSoVRVEUJWOoUlEURVEyhioVRVEUJ4zJtQQFiSoVRVGUMCTXAhQ0qlQURVGUjKFKRVEURckYqlQURVEc0TWVVFCloiiKomQMVSqKoiiO6IJ9KqhSURRFUTKGp0pFRAaJyFwRmS8iwxyui4g8al+fJiJ7JyorIqeJyEwRCYrIgIj6brTzzxWRY7x8b4rSVFm+vpI5yzfkWgwlT/FMqYiIH3gcOBboC5wlIn0jsh0L9Lb/LgNGuCg7AzgF+CKivb7AmcCuwCDgCbseRclvqjZC5fpcS+Ga/e4Zy6CHv8y1GFlAF+pTwcuRykBgvjFmgTGmGngNGByRZzAw0lhMANqISJd4ZY0xs40xcx3aGwy8ZoypMsb8Asy361GU/Oae7nBvj1xL0bQxpmEHvehaSjp4qVS6AotDzpfYaW7yuCmbSnuIyGUiMklEJlVUVCSoUlGygT4R55ynDobb2+RaikaBl0rFSd1H/npi5XFTNpX2MMY8bYwZYIwZ0LFjxwRVKorSJFg+LdcSNBqKPKx7CdA95Lwb8JvLPCUuyqbSnqIoijvUoWRKeDlS+R7oLSI9RaQEaxF9VESeUcD5thXYfsB6Y8wyl2UjGQWcKSKlItITa/H/u0y+IUVRFCU+nikVY0wtcBXwMTAbeMMYM1NEhojIEDvbaGAB1qL6v4Er4pUFEJHfi8gSYH/gQxH52C4zE3gDmAX8D7jSGBPw6v0pSl5iDEx4Eqo25VqSwkcX7FPCy+kvjDGjsRRHaNqTIccGuNJtWTv9XeDdGGX+Dvw9DZEVpbCZ9wn87/9g5Sw46dFcS6M0QXRHvaI0Jqo3W6+V63IrR2NA11RSQpWKoiiZobYaxt7RCKbedNorHVSpKEq+EQwW5lPyjy/Clw/C+PtyLYmSQ1SpKEq+cUdb+PAvaVaSg6ftQHX4q9IkUaWiKPnIpGdzLYGipIQqFUVpVCSYNtu4Al47x3JimfGmU5iyW7sIVs7JvCwZoQCnIPMAVSqK0pQYfy/M+QCmve5hI0lMvT2yBzyxr3eipILuT0kLVSqK0ohZtn4r3/2ypiHBCwOAT26BF0/JfL25ohCNJPIIVSqK0hixn7aPeHA8pz/1rVOGzLX1zaPw89jM1Zc36IglFVSpKEojZku1eipKHR2xpIIqFUVpUnjZUTaSTljXVNJClYqi5CnTloS7Wpm7fCPrtiTYA+J2PSBOx/nYZ/P48de17upJsm6l8aNKRVHylKlLwuPWH/PwFwx+/GvP2/3HJz/x+ye+8bwdpXGiSkVR8hWHUcei1VsyXqcSA71XKaFKRVEaJYmmoHSKKjZ6b9JBlYqiFBiL12xhc1VtWnXc9O70DEmjKOGoUlGUDLK5qhbj8bTJQfd/zjnPTHSVtwPrWVh2Nvww0k4xIf8zTKOZLmos7yM3qFJRlAyxcmMlu972MSPG/5zReh/5dB6jpv4WljZlsXMQrqm2xVh1bQA2LGN7WW5d+PGlsHzGYYpn/spNVGysyoDEOn3UlPE0nLCiNCVWrLc65NHTl3HFoTtmrN6HPv3Jdd4xs1awJ1Ay932Y+z6d5M/hGWKNJoIBjvzneIr9qhBUKaaHjlQUpRHTXjY4poeNVFbNgzvacZxvAjUBnfpR0kOViqLkKbeOmsnFz3/vfUPLpgIwyJ+FtpRGjyoVRckwaa1XhxQ2Bj6bszKp4hJrkXnxRJjxNvEWofvIr7Sm0OPLK7lGlYqi5BG/fPAP13l/mjuD/34/Lywt7ubIty6uPwxTLbYi28m3lHdKbnPdfjT5OXU2bu5Kvpm/KoWS+fl+8h1dqFeUDJOq66u1m6vpOfku1/l3evUA1gb7wD7uzIvd0Mu3LP1K8sz314XPWdN6C+893l2BPJO/0NCRiqK4YeMKuK8nLJ+R2XprGxxErtoUbs7bVxaS6Gl5X98ca6HdLU7VZboTbTT7VZRUUKWiKG6Y9zFsXQMTRyTMmlSf+u1j9YdnPj0h7NLo0ptYWHYOC8vOZmHZ2WxDpXMdTx5YfxhzTSVSxlDrL1UC4aR4P96YtJil67ZmWJjCQ5WKoiRDhvrfqtqA5dq+umFhfPXm+G7tby562flCbQxlk2UmLFhtHTTB6aPKmgB/fWsaZzhG2WxaqFJRFFe47yjd9KnDR83ipMe+Zv3WGtf1tpWNMa+t3lTFX96YEpUevXPerVY0sDm5xe1PZydnqZa3pKAUg/boZvWmBPFumgCeKhURGSQic0VkvogMc7guIvKofX2aiOydqKyItBORMSIyz35ta6cXi8gLIjJdRGaLyI1evjelqZKZocr0pZY7laqaoOsy8bq6b16+k3d+WJqaMA6d6EX+/8EDvWDVfPfVuLg3d34wi6cy7MZGsXhz0mIWr0kzNEIG8EypiIgfeBw4FugLnCUifSOyHQv0tv8uA0a4KDsMGGuM6Q2Mtc8BTgNKjTG7A/2BP4lIuSdvDthS7b3jQKUwycXX4sRl/3KVz0R2/EsnOwp8iG+adbD2l3RFC+M/X/3CPR/NAWDR6s0ZrbspY4zhhrem8fsnvA/ilggvRyoDgfnGmAXGmGrgNWBwRJ7BwEhjMQFoIyJdEpQdDLxgH78AnGwfG6C5iBQB2wDVgLOPijRZsmodY+48kffGfulF9YriiIlzVkf0ZFdESqgCmfU+/PtwmPpKnEa905CHPDDOs7ozQh4/NI7/qYL5K6M3qq7Kg+k3L5VKV2BxyPkSO81NnnhlOxtjlgHYr53s9LeAzcAy4FfgH8aYNZFCichlIjJJRCZVVFSk8r5YO2s8g/3f0Pv7W1IqrxQgScyzJzUln0TmbaUhbrxbK69IzFYrRLFBYLU9teVgkpy/3Wk2yH9Dgwue/Y4j/zk+12I44qVScfpkIr+rsfK4KRvJQCAAbAf0BK4TkR2iKjHmaWPMAGPMgI4dOyaoMhZN+yfXpMn002sS9fX3WZ1/D1nBWf7Po66f5/8kYR2+n0aHNF3XdrxONLZ881duonzYhwnbVJoWXiqVJUD3kPNuwG8u88Qru8KeIsN+rTM5ORv4nzGmxhizEvgaGJCB9xGH/H+iUTKF+8/ajZ5wynN90euu6n+/5BbuLv5PVPof/aOj0uKJ8tzXv7jIFZt8fVJWcouXSuV7oLeI9BSREuBMYFREnlHA+bYV2H7AentKK17ZUcAF9vEFwPv28a/A4XZdzYH9gDlevDEdpyhOpLQ9I6TQVUXvx8nYQFtxdvqYzJSYMdIw/75+cfzMLonX/tfzV+mopongme8vY0ytiFwFfAz4gWeNMTNFZIh9/UlgNHAcMB/YAlwUr6xd9b3AGyJyCZYiOc1Ofxx4DpiB9Vj5nDFmmkdvzpNqlcImpa9FBr9LPXwVPFzyRFhaqmNpp8iQ6fDit4syWp8STj51SZ46lDTGjMZSHKFpT4YcG+BKt2Xt9NXAEQ7pm2hQMIriCeN/Wsmlf/uIn+46NmYeNyOWnWrnMpvOlK1zH9UxFWL1NYP83zEl6CI6ZUhvNXr6Mq54+Yc4bel0sKI76lOibvdsU3RH0WSxP+tVm6qoro3YsPj+lTC8deyyXz0MP4csrC/+joc2XMc9Rc/QalHixXUvOMofWzk4YgxrPvo72xF7l32qFmlK40KViqIkhUPH+eNL4TkMsGUNjLsPgkH49DZ48WT4xnYeucHa+X6AP8Mej71k9XzO3fIiT5f8M3HeJviwlU/TT7lGlUoq6DdIATZU1rChMobvrg+vg3F3w89jG9I+uTk7goWQ6pRU9KZJa3RWRu431yn5jQbpSoGm9xymOLHHcGvqamFZeLoIUGP7YArWZrTN/X0zE2fKJOPvg+XToe9JCbM2mt9FCiOtrA7O1izAR5BgyJggnx5zdaSSAnX+k3RhsimR5Gdtj2Y3V2VWqRzsS86gsQT3XpDr+Kr0Gvbx2db4v/0An7uPRql4zJpf4NG9uK7ojVxLEhNVKilQv06fWzGUHODmMw+dHa2MXNT/6qGwaI9ec0fxCzGvxVpY7yaraCURwabsN7WjL3L/cjTzHHxSKRli0wrAjviZp6hSSYl8Gmwq+ULYFEis+ZBPh8PXD2dDHM94rPhRurA65vWxcypYHREaOco7ciGga6cpoUolFUzdi45VlAbC+iD7xDE8QnVhP8mf4J/AzcUxolDaBIJNq0N2pX+MgVfOhHljXNVZEwjGDK+Rz+bbqlRSIH8/TsUzIkYelTUBV1kd+4RC/AI9eWDYqY/o4GLxOjopxAcwL1bff/oIXv6Dq6y9b/6IW963zM4Xr9nCgLs+ZcXGqgSlco8qlTRogub4TZ66jvPbBbGnfxI+tUp4XclQmsLCe2wxkmg/GN7ucf7v4tbc1MhIX7DwK3juOAg0GHe8NOFXAN6YtJhVm6oY/5MVriPys8ungIGqVFLB1D2lNb0fT9Ml8Wft2LFk+Mnj4qL/ZbS+dDjM9yPOw67otKaypnKlvAkz30utvXeHwKKvYWNiY4h8RpVKCpiIV0UB2Oo0JebUMTWSL85zJQ9wqq8xRj9N/UHgKt9b8OYFiTPGw4Uyy+f1XFUqKVBaXAyA3697R5UGTnvyWyDx4KQhNFZutUsvF+bBidhWooKr4tQpF+SaSqZxOy/qglx/d+KhSiUFOvXZD4At3Q/JsSRKthEMh/p+pHTLsqhrC8vOBmDG0g1srLLWIP4xZm5Uvs3VsRf5s0lH1qddR/52balxz+jZjulrNlezfMF0qHD2Kp3ZJQ0TZ40k/5WzKpWUqPtgoy1glEZA9WbL63Do3HjI8OP5kgfo/4mzBY8fS2GstgNgVWzMX19Z5b7lGa0vX7q71ZuqKB/2IZ/OWpF02ae+WOCYvu/dn7LtyAPh8X3iWv6lRRI3MCrroq8pIrPeG1JFlUoKiJp9NU4e2wfeugTWWRY3jLsnKkvdJ1+6dWXUNYC3S24DYO0Wa6TSUaJHA80qV4TVlSu6SmwLtkyTzYX6Wcs2APD8NwvTrKlB5ppAw/Eut0YbS2S0S0h22LP0B4pGnsANLsNRe40qlXTIIzM+JQOs+glmvNVwnsLn28+3AD8B1my2Rij3Ff87Ko/PWE+UXRzXIwqXurs1pOi/tPzk2pzKkg518ZKCMT7/1H/2DgUnPQcz3rFP3GumsJo2W2bGfyrKj3DNqlRSQUcqjZy6zze13uPuov/k9UJqZhGHI9hmxisRubL/m3EaHQWD8dYrLH5cvA6AWcs2eiJX2J36YCi8dVHEdYMx0E0qmFZ6CayaH6+GvCMppSIibUVkD6+EKRhspSI6UmmcOG84cV38jKJxtJbNmZNHSYp4CmyHm0Zz7etT4pbfYnuWjrV24ln4gYjv3Um+byzHnlNCg8DlszqxSKhURGSciLQSkXbAVOA5EXER/q0xY32wOy18McdyKJ7i8NDgdgTS3zcv09IUHFPtJ37I7ppKorbem+LWlNq5nldL/g4z3g7b+Z7c86WV+dQR38S4XNgPq25GKq2NMRuAU4DnjDH9gSO9FSu/qXsSalmVvHWJUgiETH8tGAcVc+ufIk/yf1ufq4/8mn3R8phIhTv48a9zJEk4fgK0Jgknnm6mt9+6GL79V+pCAZMXrY1sGICNLmLw5PP0qhulUiQiXYDTgQ88lqcw0DWVpsPIwfD4QMdL/ysdlmVhFDdETn/dXvQ8U8sug5qtMUqkyMYkTbJdjkBO+NdXKZXLF9wolTuAj4H5xpjvRWQHoGmP7VWnKAoQ7i4knuuQrC7UBwOMLL6HnSunA3Bi3eiyttKzJpN7zoyfWbyaLFwwHjZ6P7uS0M+IMeZN4M2Q8wXAqV4Klf+oVmnU1PUQBfaEmGsip2Sa0dCJZ3NNpbRyBfv4p7Pr2nuBS1OuR7L98cfSTCL1yzvBdPqekSdBmx4wdHrqdbjAzUL9/fZCfbGIjBWRVSJyrqdSKUpO0YeGTFC3EdSJ8mEe7Kn4dQI8f0LYAnoquHXWuHjtFsqHfci8FcmZHmfOAxhsqU7yva7zfh3QzfTX0fZC/QnAEmAn4AZPpcpzdEd9U0FHKumwi29xRur5fM5KLn9pcuKM710OC7+kbPOSjLSbiEWrLbPx6AX3WNRFA411PUa/ElIgdLIRoO+tH1ORZ4G73LjZLbZfjwNeNcas0U61qb//Ro7T93v2f7MvR8HhTeTHi57/Pqn86XdPbh8mpD53JmdKBYMJBjm7aGx92pE/30NZUQDLCDecFRsr6Zi55tPGzUjlvyIyBxgAjBWRjoB3K16FQJNXqo2MT26xHEjWUbMlOs+sFAMvNXIa81jOJPiZ1xuep3ATNjmZDYf0K7LwS7rJqvr0PVe8y5VFoxxaD2d/30xY6expOVskVCrGmGHA/sAAY0wNsBkY7KZyERkkInNFZL6IRNlfisWj9vVpIrJ3orIi0k5ExojIPPu1bci1PUTkWxGZKSLTRaTMjZzJoiO1RsY3j4afv3eF9aoL9UkS+3eRi8iP7QOr0irv9leeynvb7baP47RroCbEI0PI93D60joHpXE2Zj6xX9LyZBI3C/XFwHnA6yLyFnAJkNC9qYj4gceBY4G+wFki0jci27FAb/vvMmCEi7LDgLHGmN7AWPscESkCXgKGGGN2BQ6FDAb0Dn933lSr5AfLp1mva3/JrRwFR+Ep4R9/Xcv8lZEL7R79vjPwkNKgVBrItwBobqa/RgD9gSfsv73ttEQMxNrbssAYUw28RvQIZzAw0lhMANrYGy3jlR0MvGAfvwCcbB8fDUwzxkwFMMasNsZ4EvhARyqNgMXfwYfX6WgkTfIxrO3aLeExbOJJ+PsnvuHIf34RlpbsVyLp/MlldyT0PeViFBgPN0plH2PMBcaYz+y/i4B9XJTrCoSafyyx09zkiVe2szFmGYD92slO3wkwIvKxiPwgIn91EkpELhORSSIyqaKiwsXbcKwlxXJK3vDsMfD9M2A00Fo2CH2a7sg6ekjmN+EFglbn+sQ450Bbe9z+SVL1hfouc6J+O1NStTr3Hhsra8KuhNUpoen53/e4USoBEelVd2LvqHczAnB695H3P1YeN2UjKQIOBM6xX38vIkdEVWLM08aYAcaYAR07pmgzoSOVwqfu8bJiTm7laCKEPk1/X3YFX5RmPt5KrA4i1ef4RP616gN3mQRjhTmjLUOQLbFXDXYf/gmBmG8g1KQ4v0YlTrhRKjcAn9veiscDnwHXuSi3BOgect4NiHQPGitPvLIr7Cky7Ne6EHxLgPHGmFXGmC3AaKypuoyjOqUxYP84R/wut2IUOBnr4gI1UJte6OXFaxys9lLC3Q98QYXlpDKhA8gJT1ivK2O7zD/J9w2+db/YrZuk5tQSrqlMfQ02LHNdX7q4sf4ai7WQfo39tzPQzkXd3wO9RaSniJQAZwKjIvKMAs63rcD2A9bbU1rxyo4CLrCPLwDet48/BvYQkWb2ov0hwCwXcqaAahVFccPi+/dn03oXYYvv7AB35dNuC/fc/7+57jLG0ROPljyGBBPvjnea/oqrfrauhXf/BC9lz7OWqyBdxpgqY8w0Y8xUY0wV8JCLMrXAVVid/WzgDWPMTBEZIiJD7GyjgQXAfODfwBXxytpl7gWOEpF5wFH2OcaYtcA/sRTSFOAHY4wn8TVFNGCmogDcVPxq/bHTo1b3LbP44r8jM26htLU64LzXw4G6li/yxzbjDcfbdTY3bloSrZ2ET4PFqTFor1RsStKjchq42VHvhKtviDFmNJbiCE17MuTYAFe6LWunrwai1krsay9hmRV7jI5UFItjfN/lWoS8Z8Ivq6EcBspsbi5+OSN1Drz7UzZW1rLw3uNdl7m2+G0eCRS2L1wnZVOIJsVO5P9qkaJkgadKHs61CHnPxq21GAx3F/+HPX3OllmOrFsMw1vTT6JjtG+sdO9IMdnOKmMWVnM/gtkfYOz1kZqgNQJKVHu8xfiUF+qzaDofc6QiItNx/jwE6OyZRIWAL7+eDBQl31m1KYVF+AWfA3CW/zOm1O6YYYkyx31FT+OfvRXYJvzCq2cCUNFuHzoBH079rX5TXbZ48JO5XAcEa6tSHkEkS7zprxOyJEPhoeM0RYnihuI3Yl5bvr4yZ3ssvG71jKJx8N444BXH67X2/pkt1db6RjrdR7L38JWJi7iuDHyhbl88JqZSMcYsypoUBUZQd2Erivc0st+Z253v1hRX4b53NWNKgbq5UaVASTa2uJI2S9dlOD58IWEPLpaudX8P5q3YFPd6d6mgFfHzQG524KtSSYESv962gmZdZoJHKcnR27c07PxY38T4BUJ2GW/HKswdHWBF+AbCYNAwfUm0k8VQvFqoT7bDnrVsA+BmoR4eHPNTjDYt2somxpQ6eqKKqCv7Ix43XoqbS8jGDBHxiUgzb8XKb9o0K8m1CIpSUOwo0dEYR5Q8Er9QyPTXUf7JSLAGJj8fXsf4nznxsa+YvGhNfVq2OlK37Wy3dlIKdSems6zDR5Ala5PzJDBhgYvNqGng5pF7LBCqRJoBn3ojjqIojZGhRe+kXDa06x4/eRoMb81hvh8BmG0//Z864tuY5ZOeAMrAWs65zziNwkzI/9jEU1ZH+cPDKl/m/4DVm2NE+Li9LdcXRRtPnPn0BIJB7xSvG6VSZoypn7yzj5v0SEVRFPf08f3KCf4JadVR19H2qrX2rJzjt55rncJQpLuOkInu9qv5qQcIi6dU/lz0bth5N6mInd8EOavoc8dLL3y7MEXpEuNmR/1mEdnbGPMDgIj0B5rwqpvFrNI9IBgkMuqYUggUrmVNIVKUptuTgb451Ab9jtc82TIWoqg2VNbQqqzYg0biNB+Vkvnv668Zc74ZjRulMhR4U0TqvAR3Ac7wTKKCwfLQoxQgjcxUNd8JJGMP9MOLUNIcdjulPmkH33J28IVb7NWNRpx0SuSTe9IL9SEF/vL6FJ65wE34KA/5OsHaUwp4+RNIqFSMMd+LSB8s78QCzLFj1TdpDIJo31R4bF4Fzx6daymaFJcVJeHXddRVAJS/VMqfms/mxgTZ3URhTWcwsyQJM+DMyZFcx+I43fez87RXNojnpuVwY8xnInJKxKXeIoIxJvWVt0aDapWCY8n3uZZAccn6yhpIMPPkHM0vOTWyZ5RvMWPXbZizfGMG47S4QzBcVfSey7wxlNUnf8ukSEkRb6RyCFZArhMdrhmgaSsVkYKIwqaEsGxavT8mJf9x9shr6o/A3UglEe+X3hq33YPuz+5TvwD9fD8nUSK/+qF4blpusw/vMMb8EnpNRHp6KlVBoGsqBccq5w1lSn7i5qHNSadk62Ev2RGRW7kK/WHVzQra2w5pb2VakMJDdL1XUXJE+Hgls8xZvtFVvpZsoS0bkq4/uQBc3mA87LxiKhUR6SMipwKtReSUkL8LgTLPJCoUpPCfKBotz58A02J7zFUKl8jfnNNIJV6nfW1R4ufhio1Vjm1FclrRF/xYNsTxWt3mzFAeLn4iYdtWu8mSbAnDwJVvQmXyCtEN8UYqO2O5v2+Dta5S97c3cKkn0hQQu26dzC4Bl7Gpleyy8Et4J+QrunG5mhEXGANkDoN930Slbydrws6TjXo4xD8qLbnc8lzJA1FprcRa8E+krJJ9WC0NJHYsGcoBvhkcv/RhGH1DUuXcEm9N5X3gfRHZ3xgT2weCouQzFXPh8YFwzD3QolOupVFc8lbpHa7yJbumkkyHnbv4L8kplVN+uS0qraomQGmM/GXYAdO2rk1SMnfEMyn+qzHmfuBsETkr8rox5hpPJCo0jHH+Ziu5YeFXYadVcz+1fly/jKei/EQ65kSoJNn+QFj0VeJ8iv70YhAv5pPXyjLe9Nds+3USMNnhTwEIBnItgRLK88c3HP/8OaWf3gTA+q013PnB7BiF8oyOO3tW9a01F/Bq7WGe1Z8tGjrGzPv+8hq/GCRN1zV1dJeVjukSTCF8c4aIqVSMMf8VET+wmzHmhci/LMqY3wRrcy2BEouQdZX5KzdROCbglpw/NR+QXjX9L4LLw2euRwaO4cbawl8SrXfT4qA/hvj/m5E2vDTEudofe3NjMu0e7J/umF62foGL0t68v7gmxcaYANDfk5YbC0ZHKnnL5or6w/5VCQJC5QslLWGnQQAsarZbenX5i6Fzg8vT8krnGOqFiGAYWvQW4yb+EHXtEP+0lOstpjYrjx7H+WN/HwvdqtTNPpUfRWSUiJwXalrsuWSFgo5UlEwy5EvY6Ri4ZRVLy3rnWpq8ZUdZytCidxhR8nBG651Xdn5Umo8gtxc9l9F24pHfk3eJcaNU2gGrgcNpMCs+wUuhCgo1Vc0fquKbVj5a8niWBEmNym0HQDvbWYU/A+7WI76b71zxu/TrzBN89ppEKcn5tk2lw+4n87mgaEwKJWPTnMqY17weqXi95uTGS/FFnkpQ8KhSyRu++meuJUgLr79Je/doG/f6zpXPM7fsQo+lyAx1HWMf32L8BAjgHG+FyS/U7w8BKJYAZVS5aqOu6z3DPy4NSZ3p7quIea3Rj1RE5AURaRNy3lZEnvVWrMLBBDNjxaEkYFMFrPs1fp5AYUdkMEURAVVT6F0Cu57acOIvibrevMTPvqgkOgQAACAASURBVD3bRaV/EdidKqLzFwIX+D+JfXHKy1FJR/smc8K/vqQm4O63e0bRuBQlSw3JVkwNj2ZZ3Ex/7WGMWdcgh1kL7OWJNAXIhq25M91rUvxjR3h4d8dLgx7+gv53ZnZ6ItvcX3M6K458NCwtlSdW/8A/NpzsdW7U9Zl3DOL1P+0fnnjSvxhSc20KreWO0Cmi1rIZSC7C5IylG3jk03lx83jdtbdnvWO699NfFrOWZd9NS30eEakfN4tIO9xFjGwSzPrN+YuhpMmPLzvv+K2KdvY3Z/lGVm+uppCnIp8InEygWYewtON375JepZ1dBrvuuAtbCtidX92nHm9KKZRWspm95Sd+W5fbqOiflP41p+179Wtxo1QeBL4RkTtF5A7gG+B+N5WLyCARmSsi80VkmMN1EZFH7evTRGTvRGVFpJ2IjBGRefZr24g6e4jIJhG53o2MSh6ycg68fwW8c1n0tbcudixSLssgUNiWeO2bhzvW6NAyTkf/l5CNnH+eCme/aR132sU5/zbRU16NCV8So5S7ip/jndLhSILtAF6vbbQXZ2/Ie0UFDfMGr95fQqVijBkJnAqsACqAU4wxLyYqZ2+cfBw4FugLnCUikY9OxwK97b/LgBEuyg4DxhpjegNj7fNQHgI+SiRfpsjUzlglhFr7CXLTiuhry2dEJXWlgnGl18HEER4Llj6Tg85mwrPvGETb5hFrGvHmvFttF36+09EwfD1s47AYf80UuLrxOsEwRlhQFj3VZxG769xSHaAV0RaDud6R/9fi17PSjlfTbK6msYwxs4BZSdY9EJhvjFkAICKvAYMj6hkMjDSWc/8JItJGRLoA5XHKDgYOtcu/AIwD/s/OdzKwANicpKxpULhTLnmPU6daEx3atYMUzhTkjGA5/X3Rc/nblMSwXopgfGAPJgb78FeANj0SGy9Ag5lyI+V3/pkxr22orKFVzGu1vFry97h1tyS7oYSzwdE+6wHD79HGbTfTX6nSFVgccr7ETnOTJ17ZzsaYZQD2aycAEWmOpVxujyeUiFwmIpNEZFJFhbs52Hg0d9kZKMkQ50mxch0sCnGJvnmV9+LkiggfJOdX/x8X1AzjicDJGW6oQXnPD24XJ1/+EDqa2Nc3J2a+uStiB9yatmApu/oWxW3nn8X5P/pNlrOLPgOgWTB3C/Wp4tQzRD56xsrjpmwktwMPGWPi7oAzxjxtjBlgjBnQsWPqPmvn7GhZ2bRQpZJ5nj7EenWa/gJ47lj46ROYPxYe6MVh/inZky1N0plY+dufond7Z5pnAsd53kY22ccXO4T0Mf7vE5aP5bBRiY2XSmUJ0D3kvBvwm8s88cqusKfIsF/rPvV9gftFZCEwFLhJRK5K/204U9myBwBidE3FMzatgOGtodJhemvDElhqDeP3lvimofnEMtO+/rjCtI6fuXX3sNOdOrf0QqQw1pkWjumm2z6et51tKk38fTmCadST25srvTFs8VKpfA/0FpGeIlICnAlEhl0bBZxvW4HtB6y3p7TilR0FXGAfXwC8D2CMOcgYU26MKQceBu42xjzm3dure+ZszF+7PGHjcodEoe4zKCQHfNNMw/pGFQlcsXTZA66aBCXOHX3GaL8jPdpZGy//F3RWHsGLC3sfkBJNTTCHC/WpYIyptUcKHwN+4FljzEwRGWJffxIYDRwHzAe2ABfFK2tXfS/whohcAvwKnObVe4iP1aEZ9f3lPbHusdS9FM5nkPT0V4feiUul8h08+UlouS30smKrjLv+UH5auZFBD3/pmL3QXYekggl5cGmM5NT6K1WMMaOxFEdo2pMhxwa40m1ZO301cESCdoenIG5S+AjYben0V1IMbw39L4QTH0miUKwvv4T8LzzWmRZ0kzQMDc5+EyY9C222T75sv/Bgrj6f0GfbVjx74QB4LTp7Y4ywmGvT4Vzj1fv3cvqrUdN90bsANFv8RY4lKUAmP5+Zeuye7oA4JqX5wKJgJ8f0FwJHJ1mTMO76Q3nmfDt4V6c+cNz94Iv4Ge92Kgxw3iSaiMP7dA5P6GM5JJdGqFUSPamfXzSGXXwuTLZtPiv5S7oiZRWvPlF1t5Iiv/S+kLYTh1LVdsdci9K4qHFwneFkBfbBUO9lyRDLaM/2RFsR1Rq3loMNnV95h+aUd2geP/sf0vT3euV38PhA63jQvXBmtFPGxkwRqe3f2MHntPaXx3ikVXSkkiI1pbbbiwJ3DZJ3OLlhGTk4+3JkmInBPkD40/GdJ6cZ2dErOu4MrbrZJ4WzXpUsdY4oI7mtOKHDkEbBrrLQk3pVqaSI8dmDvAJ3t54VVs2HTS7t/ReM81SUXOE0f+3L5ymlOtlCjQDaN65R+d+LNYKHF6hSSZGgzzYHDapSSchj/eHBnXMtRc4wRggY66d21WFpdMxZVUIOJvOXjKHqkvFxS20yhevtWMkMqlRSpMZejtqwufH5BvKEJmwl927wAK6vGcLztUez76En1qcX+10qicNvsV6LtvFAuhhsu1t0m83a4d9uj7jF7q89w0OhlEJAlUqKvDZ5GQBPfTY3x5I0AoIBWP1zrqVwZMfKkWnX8UbgMJbRno2H3Q2+BtuYYr/98+uRIHb8fkMsD8T+LNrVnPI0XDgaWoZbgxX5fQSvmRazWFM301VUqaTMejvMdaqWIkoIn98N/9rbUiw53kx6f83pYee1FLFb5TNJ13NM9X2s7TgAEN678gC+vfFwrj4iwu198w5w3U9w3jtpSOwRpS2h/ADHS74WVjCxLaY06tomk8XRlJKXqFJJkVqxnhqLRa2/0mbR1wDMmDuXmmBup8lGBE6KSttEM74LJl4Tmme61R8/eOVZtL1yLAxfR7/ubejS2u5sQ9dFdjzSGgkUN56OeE1MR/OZpZDCHTQ1VKmkSMBeUynWkUp6bFwOv34LwJ3/nUVNnt5OXwzT2jvb3MXOlc8z+ZyZ9L7lh/p0v68xTwNZ720DzfhTdXhs+1nBHlmRoJXkNhSwEhtVKilySF8r7kQRHoxUqrfA2vhxHhoN711Rf/h66Z00k6qciTIusGfMNYFY4WqnlvanihKCxc2gqGE6aIeOCTYoFvLaQ0kzOO4fnF59K2sjvBpX4BB5UmlSqFJJkSN3tWKGeTJSefUMeCS+lU2jYPXP8PPYXEtRz2/G2tBaZaIXxJNVAaVFMXbLi/2TOypuLLn8Z+Cl/Go6Rynh3bpmZ/pLyV/UTUuK9O1mLVbut70HMS5+aSL+xF6IXr/ILZZX2p2rRrKw7OyIK87TX0mbFYhYllyNgHHXH0rRklJ4ryHt3SsOgDtzJ5OSe3Skkip+a/Oj3+hCfUrcv4MVaKtAqJv+Osd3b1h63V6TRr2EEoPyDs3p1rZZWFqx3wedd8+RREo+oEolVez9BqI76l0zampI4M8tq3MnSAyc1lNGXmw5ViyylUow4ifz0Bn9uOzgHdiru72WcPUPMHSGt4LmE2UO0Svz2f2M4jmqVFJFhEpK8Acqcy1JwTDljbtzLUJCHjxtz7Dz1ttYI1KxlcqhfbqEXe/SehtuOm4XfHVDlfa9oE14GOBGTeddo9NUqTRpVKmkwWaaURxw9nSaERpZVMlbC8D766n9u4Wd14XZ9dtK5dKDe7FP5RNZl6ugEO1WmjL66afBFmlGaYaVytNfhLgr8VKp1FbDlFcaneJKB6c70bZ5CdCgVHz+Iipok0WpCodPA3vZRzpSacqoUkmDainGl+E1lbtHzwk587DDH38fvHc5zHrfuzYKhAds1yyx9qicsldXVhz1mBUFsV0v2jQrzqZ4BcMfa26wDnSkUhAs8KUQhtoF+umnQRB/5pRKxU/RaSGefRev2UL5sA/5dJZDFMRUqIumWOmxeWu1h9ODGWID1hTX4X2cw/7+84x+/O6gI60IiP4iJt18ZDbFKzxUqRQEW8Ub90D66adBUPyIycDmxxlvw+P7wNyPwtNDpqamLF4HwLtTlqbfnlV5yiU/mr6Mz+e6DLo1wtkpYT5Ri7VRsWt7B0smB4r8+rNx4uU/7msdqFJp0uinnwZBKcKXiX0qy2xX4itnR1xw1/GP/6mC8mEfMuu3Dcm3nYKlzuUv/8BFz33fkLBlDYz+q/OoZO0vycuUZd4OHAz7XwWH3ZRrUQqaA3a0NgSz3+UAvFl7MBdW35BDiZR4eLXypUolDYLix5eJkUrdNFdkB+9yEX3MrOUATP35V5j6uss2I85rq2H0DbB5lbvyoXwwFL57Cu7eLvmyWeJftScDYC74L/ODDXIuCnaimmI45u9QZrkYefSsvRzrUFyy68kwfD031A5hXFDvZb7iVewbVSppEJAigrWZWFOxe/jIaYNFX8F3/3YsUbfGMnnRmvpY5wdMuxnevQzGP9CQseIn2LouvPCmCpjykn1if7Fmj4LvnoaPb05e/Jr89xj7YO3plFe+gvQ8mCOr/1Gf7jvndZ69cEBYXrVdSpITH4ErJuRaCiVJdKSSh/irN7BrYDbjv/8xvYrqRiRLJoWnv3QqjL4+LOnDaVbEya/mr6KUas595jtGfmt5NO60zpbj87sA+HJehbVW8+yg8Hrfv9JBBnu0FCxstzNXVF/jah/JlwErXG73jm05vE94dENXM4LnvWvtnleg/4XQaZdcS6EkyfyiXp7Uq0olDXZlAQAtJj6UXkV1SmX2KPaU+dHXN0ZbfLVdP5u5ZRdycOBbxyoXrtrMef/5zjqpmM3f3pvODW9Otc5rttTnC9ptr93SONzNGMTVPpKra67mz9VXQLueUdf8brRKr8Ot3fOKUqBUSZkn9apSyQAlgS2JM8UjxHS4s6yNvr5mQdQSSLv1ln+pQ31TOdH3Da+X3BG2BnPoP8aF5X9pwq+MmzzDsjTbuKw+/a0fLGuy20bNtBIq5jYUCgao/uCvLFuyIIH8IdLNGwOrHBRjnrGOlrwfPNDxmnoZUZoCsTxvp4u6vs8AJm0TyoYP17E/C+nluslKGN6azl0G1Zf8V8ljAFSGhHItpZoqSurPp5b+kdayBd4Kr3rxwjoFYLexYjq1gaBlNrvoa0omPcW8id/Q5c6vouXasgY2RZgWv/wHAOYOWcLkRWs5O7qUJ/wvsA+D/N9HLT7unkJ8+c6tyqgyxUzvejoDEmdXlILEq4cnT0cqIjJIROaKyHwRGeZwXUTkUfv6NBHZO1FZEWknImNEZJ792tZOP0pEJovIdPv1cC/fW9j7MOnFVa9KFEN34zI6rrSmufbzWWbH2y/7X7QcIcppbtmFYddai/No6rrit6LSPp0dPt1WFCsQ2b8Pgyf2dbw0/NERjHrfpSVaBqh773V3YPNu51FlithIMzbSzLHMcxft45i+V4+2zLh4Hv0uecwLURWlUeOZUhERP/A4cCzQFzhLRPpGZDsW6G3/XQaMcFF2GDDWGNMbGGufA6wCTjTG7A5cAGTNe6EvjeiP43+q4LXvFtafl+KwtvHmhez/9cUAdCZ8eqxUGvKn7MZr3L1hA+Fg3Yk9AvNLpNI0DCt6FdYuJBaX+0fRnhT2zaTIemOF760bna078gF2rhoZt8xhOzvvoAfov31b3eSYaXYalDhPE2eFyZ5fuUK0/hoIzDfGLDDGVAOvAYMj8gwGRhqLCUAbEemSoOxg4AX7+AXgZABjzI/GmLqAHTOBMhFpCBruIU4jlcqaADe9O501m6vjlp20cE3Yh/tA8VMEjfPH/X9Fr3JD8Rthaaf6G6alygIb3Qsdyrh7ws9NAJ46BL58EIiee92GKoYU/TdulT6C9U4Ys8EdtedxZ825jAtaruuNOsrMP04ekWsJ8prra/7EiVV/z1p7fo8iy3mpVLoCi0POl9hpbvLEK9vZGLMMwH51etw8FfjRGFMVeUFELhORSSIyqaKiIom3kxyjpvzGKxN/5b6P5iTM6wvpfENHHpFcnqAjzxSlVWtg2RT4+TMABvrmwvrY7mGCDh24D1MfgyQbbKIZ/wkch9vnr7P37eGtQIqSJG8FDmElbbPWXlmxN92/l0rF6dcd2fvEyuOmrHOjIrsC9wF/crpujHnaGDPAGDOgY8eObqqMyV015wAwZk34PgcWfcsRX59FCTWYOGLXBoJsrQ7kxWa7oUVv1x+/PenX6AwP9YWvLNPpyMVw38+fRmX3SxCfl16WE7BtqzJ+16u947WF9x7P3b/XkLdZp1k7V9neChzssSD5zTnVN2alnU4tvZnI8VKpLAFCQ+B1A35zmSde2RX2FBn2a735kYh0A94FzjfGhAQm8Yb/BvYHYFmgZfiFD4bSft10ymV53PJXvzSB3hNupJOE73j3SWY640G+71zn7eVrMDN+aPmFzpk+He66Ph+5VSpFfh+vXLofC+89nm9vzJrNhpIBrq8ZkmsRcsrXwd15tNs/OK7K20ipfbu0SpwpBbxUKt8DvUWkp4iUAGcCoyLyjALOt63A9gPW21Na8cqOwlqIx359H0BE2gAfAjcaY7728H3V06zMWhSOto4S+3/8TrV47gecUTSOo/yTvRCPJ0seTqlcvCk4wJWyMAg7+jLlUdmZKuMc1+TJc/uHnXdp7Y2LbyVN9rvCMfn/BvXJsiD5xwVnX8jxRx/DI7W/B2BqcIeMt1FaVGDTX8aYWuAq4GNgNvCGMWamiAwRkbpHkdHAAmA+8G/ginhl7TL3AkeJyDzgKPscO/+OwC0iMsX+i23ek4n3aN++zrKWUS8+wvqF9o5122pKiLDI+mhYar618gw3m6YG+uZ6sgZ0TfVVCfM0L/VnvF3FA3o5jyAvP7RpeyoYemRvWjcr5srDdqTuAfXzYL/MN+TzZpuip5sfjTGjsRRHaNqTIccGcHBE5VzWTl8NHOGQfhdwV5oiJ0VQ/GDg6qL34Of34Gdg+Pr6XUW+yIXqibb1yzGWhYdXO1q9ZOsLf6CT5M40tGOP3hB/VpED61ywKzmlQ4sSVm2KYf3Yqht0H8gaWtMOjwPFFRh792hYrK+37s90I6Wt4KDrMl0roDvq08LYSiWUdVuqaVM//RV712ogWHgKBWCbX8bweemYnLV/y5ALYfif7TPneyjqZyUvGH3NQfyyajNsGAFdLFNvznvPclra+6jcCpeHHNS7A1/OWxWxZ6xuMilz/UX/yhFMHu6drwvd3ZUGQYmeZrn/rXGwqs5/lqGyxtmsdsS4+Xlh9VVILDfh5pZbyco2JCVFOrUqY98d2kO/s6HzrlZir8PCFMrfiq5lVnB7ll8eGaBOgdCRSmaUyqjA/qzGXYTTVFGlkgbGQancveA0CFhD/g9Lb2bUVMtobem68JgjP63Y5L2AjYzIzVqLjGXKvfT4lxIG1nrkzH58PLRpm6rmI5N9u3Nc9T1Q5s7cuDHTsYX1kLRNcUO/YkJmPV6rPTSlehcFO7HKtOK9wO+4qeaSdMVMiCqVNAi6uH17iGXZ/MTn0Z57j/dPzLhMjZnlMewuum63HSftGT/q5OB+Xdl525Zx8yjZJ1nHB1XG/Yz9F4HC2YtkuuzJHSfvxj2n7M4+5Q0j8mXG2mu13LTjttoLeS/wu5h13F9zhmP61XIjA6qeZGjNVWyK4Qcvk6hSSQM3SmVU6S0sXBUdu91najwzJS5U7q85Pea1P1UP5R/tbgNgxU7n8FztMWw0tqmwR1YsSvaIWgYrdu78vgu6NzcuJEMYQWhRWsRZA3uErQm+HTyIP1ZfxyuBw6mihKE1V9G7ciT/V3NpVB11Looi2T/GJmCvUKWSBiPOc+cY/acVG6N+NKK+qaJ4LXA4h1Y9WB+VMZSPgwOpLrGmSDqf/QRvd76aoTVXsfWQ22DbPbItqpIhYv4KrgqPgjqgcgQDKkdwXc3lnstUR7ypovEB99+5s6pdbCOIaVwifBrsX799AaCGIj4KhHvYfniv0cwy5Y5+A687eifXsmYCVSpp0H97d356Vr06hBUbwt2QqcPDaDaxDQtNFzZEDNHrhvWW3b7FCxcN5J7zj2Cbw/5S/4P844E9efmPzq74lfxGAP4yB66fZyW0DncTuIrWrKI125fvwAbjbjPrr6Yzm0xy0Q03mm3qp9juPLU/4477PCpPZdf9mW3S9x1XE7aOlJzZzgZahO24Ly2y1mFqHbr0kghv2+9deUBSbSWLKpUscHbR56z8bWH9+drN1Vl1tpivrDUtuLbaevL8LNCPaor511l7Re2AfyIwmC9uOIwDezfsP2nfopSj+ob7XPvbCX05QPeoFBRhz1atukAL53WzOj9ur166X5TvuVhrJ3fUnke/qqeZEnS3mfLEqrs4vOofPFJ7CgC+Vl04dA+nskIJtQnrmxPsHna+ONiRG1vfV3++qs+5Ces4f//tY17buV+DcujQwvLuMSbY3zHvvadY92jiTUfQr7u37vVVqaTJhOAurvJdVP1q/XFw6WQemn+sVyIVBPtX/ou9qp5mTLA/84JdebD2NI7u25kT99yOvXuEf+lvOaEvPdp7v8Co5AJbq8R7UB86g5EXD2TOnYMo8vt4oDZ8Qbrm7AZnqBx4LQDLTDuqKKGWIgIuu7mqTntQQVueDJzEWdU3Izs67/j3HfwXV+s1f6y5npeaX8CvQUtRbqGUe/58GQAVphUr9r62IfORtznWccfg3Vh47/Ec3ida2d576u5UGMs8uNj2F1jrtPXQGM4c2IOF9x5P51bexKUPRZVKmjxX6253+cnBBk++zX78j1fiFAzLsJ48N9GMc0ofZabp2RAcLKKHueTAntkVTskap+zdDYAWpXGMLVp3o8jvo8w2tX0pcBTlla/UXz5il5ARqz30ebG2YS+MqwX7Vt04bz9rVBDEx7dBe19NaYjTxTY9YPh6SnY+iuZH/43ZwfhTYEtMR95qdgZL6cB9NWdycfUN4PNxkG8k+1Y9YblzqgtFXn5Q3LqevXAfpt56dFhaaZG/fur3uN27JH6PWUKVSpo4zWEmwgRTjxTZGPmXvcdk29a6mbGpMWxQH2befgzNSuIoFbceEjrvDj5L8VRSwvgbDg27/IeqW5kfjDY93/iXhXD1ZM7dr2Gq6bGz92po+3fXWMcDGhbutxa14o7a8xKKZK2dCiMCJ7H3npZ11s7bb0cQnxXP5Jy3YOfjG5RLHErt+Ce9O7Vg7HWHAA17W0r8wpn7dI9ZNpuoLWaauDErjqTZ3Hc8kCR/6V05kh9K/8SzgWP5c1H4e+/cqpR9d2jPo2ftxdERayRK48fnE5rHGqX0+B38+k1UcptmxazbEuFJ+6pJ1nqM+Hj68zm8HDiCW9tbIaaH11zAA81fYnrlDtQSvWG5ZSvL4EaAMdceTIuyohierRtGPDWBoHPob5ul2x0DCxoW0MvbN6t/eHrwtH58Mms5fbZtBRwBO0a5MnSkrNjPN8MOp0OLUkrqPQzXKVyDMTSY2ceQOxvoSCVNjts1vUBfqfJU7fGu8242uRsBLDXtqaGI3av+w6vNzuVIeZp9Kx+rv/7AH6ynt5P23K5+esP1k6nSuDnnDbg8Wqk40qE3lLWG0pbcXXsOVZTUX5pmevHXNv8MS4tF784toxVKb3vaqbzBI8MJe2zHhublACwIbhuev9cRbDzpGQAuPrAnQ4/szQsXD6y/3LpZMacNSG1UsV2bbUIUCrCtbaRQVIbBcHftOTxcewqV2x8Wc6+P1+hIJU1MbfwY9F4xz3RznXfvqqeYW3ahd8LEITTWjN8nXHrc/vzf29Pr03xOCmTQfVDSHH58KRsiKvlKacsGn2EZIuyZ/bQXLOeWieh5kOV9PIRtW5fxzs3nQOB0ghWb4Ul76uymZVDSjD7A3LsGUVrkZ9Bu20bXmSlOew6WTbOjai5mC2VM6HEZQy/aH758EMbeAS2yOwOgI5U02atbblx/1LnVjxWoKpRYT2h9Kp9z3d77cdxDRBK6MWy5abDFD41zcnifTgw5pJfzbt+WnWHw467bU5oWqWzxiirS71zoOxh2/0N6wviL2XHbEGvFkobRQd3Ul6eUtoRyy7S47r6cspf9wHngX+DmFa7DOGcKVSpp0rtDbqIKFtlKZbaJP4xe1jzcrUWo1UxlEl5+/1zjGPYGgPUmfJh9fc0QLq+23NNfWn0dz124D2cN7MGT5/anezsr74E7dmDYsX2inERGUbdIqig2ieLljLrqAJ6/aB/HazfWXArbHwgnPNToplmjjCdFoNh7E+JIVKmkS47iQqwx1ghpYnAXJob4Qwoa4aGaU+vPQ93BTApa7hp+DjaYH1Yb56epe7o+EZEi9K8cwTO18ffX3FxzMRW04aPgvpRXvsJK2tKrYwvuOWV3dujYgt/16sAHVx/IRQeUJ36Tw9fD0Xcmzqc0KR48fc966ycn9ujWhkN3dt5EOcXsCBd9CEWJ11cKjXxx0qFKJV08HloOq/kj83pEex+dHuzJ1W0e5/7aM7mi+s/8N7AfAJ8G9+arYIPvrG22sxTOlPNnc2b13wD4Q/VtnFI1HID+VU8xsPJxltreUDnpMRi+nhsvPSeqzV127MV9tWdFpYfucB4fbJj62qbYz5hrD47auLhb19YaSEtJmbJiP706tkiqzJ2Do/3JNTY6t7JmHto2y63CVKWSCXZLc142Dp8F9mLSbn+LWihcSkda9NiDAH5W05ouB54PWBu9Jpud4ZbVcN67tD59BAvvPZ5+O2zHNzcfw5w7B7HHTr34wVijlo00o1PX7QluZzvHLIm2GBlUdS8AL/1xX36656R6BXZrzQX8p/ZYzqi+BU57Hoqb8dUdDUrnw2sOpHdndTeveMQVE+Gyca6y7tm9DRcf4OEm2u0P9K5ulww9ciceObMfR+7iPErLFmr9lQmOvQ9mvJXRKkfWHsX5RWPYTMicaNuesPaX+tN2zRueSAbs1AO+hTXG3gHsL4Je4W4mOrW06nrh4oFsrqrlx1/Xce5/JjJg+3Z0r2oGyyKEOONl2PAbz+58His2VAJWqN4T99gOZkJ59+7csfAYK++uq4kLFgAACsVJREFUx8Ouvw8rvkOST5OKkhSd3LvBB7j1xL7cemJfb2Q5922o2uBN3S4pKfIxuF/XxBk9RpVKJmjegbGBvTjC/2Na1QSNMDa4F5WUcHvt+azY689s/n4DxXVeRnc5Ab75F2A5mvvzETtR5PNR3qEZlHeFkx7j9jeaMcCF9+TmpUUc2LsDT5yzt+VXaMMtsGllg01+XXvAdlj28fX0OR5mvsNFp5zAHf9ckNZ7VhQv2b1ra6YvXZ84Y7oUl+VkUTwfUaWSIRb87j6OmHh04oxx+DzYj0trrq8/v/yE/SlqtYCT+9muJQ690VIqRWXcYc8RX3tUSKyEvc/jmz7VDZsIXVDvM6h9L7hotLtCu/8B+hyPFG8DqFJR8pdXLt2XlRurEmdUMoYqlQxx6ZF7QprRgSNdvrQoLQpXGnXmHXH8BLXJ1iJdsTVymf/3Y6kJhJud7NmtNYN2yx8Hd0rTpWVZMS3LEu/lUjKHKpVMUZS+K5Qq++M4qHcH7v69Q4yIkuaw3xWwR+ywu9mmyO8jco/X+1flftFSUZTcoNZfmUKE5Se/xdtd/y/lKrbYUeq6td2mfpNgZBsMuge22yvlNhRFUbxElUoG2bbfUZx66U1w65r6zYmJGNX+Iiov+JjXi07irlprb8j2tndVRVGUQkOVihf4/Lx66Dh2qXyWF4+ObxH2yy5XUtZzP8Z0v4YNtOD8/bfn0oN2yJKgiqIomUXXVDzi0oN2oLTIx1n7llMzZXeKV06PyrNw26O56vAdAbjxuF3YUh1w5w9LURQlTxHjocMYERkEPAL4gWeMMfdGXBf7+nHAFuBCY8wP8cqKSDvgdaAcWAicboxZa1+7EbgECADXGGM+jiffgAEDzKRJkzLyXuNiDCz9ATrtAj+PxWxYhvS/sFH6H1IUpfEjIpONMQOcrnk2/SUifuBx4FigL3CWiERuZz0W6G3/XQaMcFF2GDDWGNMbGGufY18/E9gVGAQ8YdeTe0SgW3/LBcouJyL7XqYKRVGURomXayoDgfnGmAXGmGrgNWBwRJ7BwEhjMQFoIyJdEpQdDLxgH78AnByS/poxpsoY8wsw365HURRFyRJeKpWuwOKQ8yV2mps88cp2NsYsA7Bf67ynuWlPURRF8RAvlYrTanPkAk6sPG7KptIeInKZiEwSkUkVFRUJqlQURVGSwUulsgQIDUvYDfjNZZ54ZVfYU2TYryuTaA9jzNPGmAHGmAEdO3ZM6g0piqIo8fFSqXwP9BaRniJSgrWIPioizyjgfLHYD1hvT2nFKzsKuMA+vgB4PyT9TBEpFZGeWIv/33n15hRFUZRoPNunYoypFZGrgI+xzIKfNcbMFJEh9vUngdFY5sTzsUyKL4pX1q76XuANEbkE+BU4zS4zU0TeAGYBtcCVxpiAV+9PURRFicbTfSr5Ttb2qSiKojQicrJPRVEURWl6NOmRiohUAIvSqKIDsCpD4mQSlSs5VK7kyVfZVK7kSFWu7Y0xjpZOTVqppIuITIo1BMwlKldyqFzJk6+yqVzJ4YVcOv2lKIqiZAxVKoqiKErGUKWSHk/nWoAYqFzJoXIlT77KpnIlR8bl0jUVRVEUJWPoSEVRFEXJGKpUFEVRlIyhSiUFRGSQiMwVkfkiMiwH7S8UkekiMkVEJtlp7URkjIjMs1/bhuS/0ZZ1rogck0E5nhWRlSIyIyQtaTlEpL/9fuaLyKN2RFAvZBsuIkvt+zZFRI7Lpmwi0l1EPheR2SIyU0T+bKfn/J7FkS3X96xMRL4Tkam2XLfb6Tm9Z3Hkyun9CqnTLyI/isgH9nn27pcxRv+S+MPyRfYzsANQAkwF+mZZhoVAh4i0+4Fh9vEw4D77uK8tYynQ05bdnyE5Dgb2BmakIweW48/9scIXfAQc65Fsw4HrHfJmRTagC7C3fdwS+MluO+f3LI5sub5nArSwj4uBicB+ub5nceTK6f0Kae8vwCvAB9n+XepIJXncRLTMBVmPiGmM+QJYk44cYoUvaGWM+dZY3+SRIWUyLVsssiKbMWaZMeYH+3gjMBsrkFzO71kc2WKRrXtmjDGb7NNi+8+Q43sWR65YZO2zFJFuwPHAMxHtZ+V+qVJJnnyIMGmAT0RksohcZqflS0TMZOXoah9nS76rRGSaPT1WNwWQddlEpBzYC+sJN6/uWYRskON7Zk/lTMGKnTTGGJMX9yyGXJD779jDwF+BYEha1u6XKpXkSSUqZaY5wBizN3AscKWIHBwnbz7IC5mN8pkqI4BeQD9gGfCgnZ5V2USkBfA2MNQYsyFe1mzKFUO2nN8zY0zAGNMPK/DeQBHZLU72XMuV0/slIicAK40xk90WybRcqlSSx1WESS8xxvxmv64E3sWazkorImYGSVaOJfax5/IZY1bYHUEQ+DcN04BZk01EirE67ZeNMe/YyXlxz5xky4d7VocxZh0wDhhEntyzSLny4H4dAJwkIguxpuYPF5GXyOL9UqWSPG4iWnqGiDQXkZZ1x8DRwAzyJyJmUnLYQ/GNIrKfbV1yfkiZjFL3o7L5PdZ9y5psdh3/AWYbY/4Zcinn9yyWbHlwzzqKSBv7eBvgSGAOOb5nseTK9f0yxtxojOlmjCnH6ps+M8acSzbvl1trAv0Ls6w4Dss65mfg5iy3vQOWtcZUYGZd+0B7YCwwz35tF1LmZlvWuWTAsiSk3lexhvg1WE82l6QiBzAA68f3M/AYtqcHD2R7EZgOTLN/TF2yKRtwINYUwjRgiv13XD7csziy5fqe7QH8aLc/A7g11e97luTK6f2KkPFQGqy/sna/1E2LoiiKkjF0+ktRFEXJGKpUFEVRlIyhSkVRFEXJGKpUFEVRlIyhSkVRFEXJGKpUFCVFRGRT4lyey1AuImfnWg5FqUOViqLkGBHxp1G8HFClouQNqlQUJQOIyA0i8r3tSPD2kPT3bMefM0OcfyIim0TkDhGZCOxvn/9drPgcE0Sks0Mbh0hDnI4fbc8K9wIH2WnX2k4OHwiR5U922UNF5AsReVdEZonIkyKiv38l4+iXSlHSRESOxnJvMRDLkWD/ECefFxtj+mPtTr5GRNrb6c2xYr3sa4z5yj6fYIzZE/gCuNShqeuBK43lxPAgYCtWbIwvjTH9jDEPYXkOWG+M2QfYB7jUdr+BLd91wO5YTg9PydxdUBQLVSqKkj5H238/Aj8AfbCUDFiKZCowActxX116AMt5Yx3VwAf28WSsaa1Ivgb+KSLXAG2MMbUxZDnfdsk+Ecs9R12b3xkrDlAAy43NgUm+T0VJSFGuBVCURoAA9xhjngpLFDkUy9Hg/saYLSIyDiizL1fanXsdNabBZ1IAh9+mMeZeEfkQyyfXBBE5MoYsVxtjPnaQJdInk/poUjKOjlQUJX0+Bi62Y5EgIl1FpBPQGlhrK5Q+WOFmU0ZEehljphtj7gMmYY2INmKF/w2V5XLbjT0ispPtzRqsmB897bWUM4Cv0pFHUZzQkYqipIkx5hMR2QX41vISzibgXOB/wBARmYblAXZCmk0NFZHDsEYys7DihgeBWnuK7XngEaypsx9sl+UVNISB/RZrYX93rHWbd9OUR1GiUC/FitIEsKe/rjfGnJBrWZTGjU5/KYqiKBlDRyqKoihKxtCRiqIoipIxVKkoiqIoGUOViqIoipIxVKkoiqIoGUOViqIoipIx/h+JXHtRjeMl2wAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "fig = plt.figure()\n",
    "ax = fig.add_subplot(111)\n",
    "plt.plot(np.arange(len(critic_loss)), critic_loss)\n",
    "plt.xlabel('learn step')\n",
    "plt.ylabel('critic Loss')\n",
    "plt.savefig('graph_critic_loss_{:d}_episodes_{:d}_{:d}.png'.format(len(scores),config['seed']['environment'],config['seed']['agent']), format='png')\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYsAAAEGCAYAAACUzrmNAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjEsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+j8jraAAAgAElEQVR4nOydZ5gcxbWw3zMzm4O0STkLARIgEAiZYJIxIAMGLsHgBBdj89nX+TqBuTbpYnDAxgnbGGyDSRcDJpookYOFJIJyRFnanMPshPp+dM/s7E6enaTd8z7PPtNdXd11uma2TtU5VafEGIOiKIqixMKRawEURVGU/EeVhaIoihIXVRaKoihKXFRZKIqiKHFRZaEoiqLExZVrATJFbW2tmTFjRq7FUBRF2a9YsWJFkzGmbmj6iFUWM2bMYPny5bkWQ1EUZb9CRLZHSlczlKIoihIXVRaKoihKXFRZKIqiKHFRZaEoiqLERZWFoiiKEpeMKQsR+YuINIjI6pC0ahF5QUQ22Z9VIdeuFpHNIrJBRM4IST9KRFbZ134jIpIpmRVFUZTIZHJk8Tdg8ZC0q4Alxpg5wBL7HBGZB1wCHGLfc7uIOO17/gBcCcyx/4Y+U1EURckwGVtnYYx5VURmDEk+FzjZPr4beBn4gZ3+oDHGDXwoIpuBRSKyDag0xrwFICL3AOcBz2RKbkUZbRhjuO/fOzjpwDqmVpcG01fuaOWtLc3Mritj8aET+ee7uzh93gSautx86Z7lbKzvYsG0sVQWF9DQ6aauooj1ezvo9/l5+MvHsXJ7K5PGlvDUB3to7/VgDPzhc0eyZF0Dty3ZyNdOmUOhS7j+ybXMm1jJsg9brGfs6wRg4fQq6iqK6On38f3FB3Hzv9Zz7OwaAH7+3AYACpzC5cfP5CMzqzl17vig7G9sbqKpy83db26j2+2jvrOPR75yHLPrysPev8vt5e43t9HT7+W5NfVUFLs45/BJrNrVjtvn5/pzDqG2vIjn1uzjhifXctb8iXh8fi48agqHTBoTsU6/89D7lBU5ueHcQwHYVN/J7S9vwRjDhUdN5bK/LsPnNxw7q4YZtWX09HtZvbuds+ZP4usfO4Ctjd3c/vJm+z36AThudg2tPR7qKor4y2ULcTmz60WQTO5nYSuLp4wxh9rnbcaYsSHXW40xVSLyO+BtY8y9dvpdWAphG3CLMebjdvoJwA+MMWdHKe9KrFEI06ZNO2r79ohrSxRFCWFvey/H3ryU42bXcP+Xjgmmz7jq6eDxI185lgv+8BYXHjWFth4PL66rT6ms33/mSL56/8qk7yspcNLr8cXMs+2Ws4LHobJHyxPg2dX7+PK9K6I+98bzDuXzx0wPe+aMmlJe/t4pYfn3tPVy3C1LAVh13elUFBdElScS3zntQLa39PDwil1R81xz5ly+dOKshJ+ZDCKywhizcGh6vji4I/khTIz0iBhj7jDGLDTGLKyrC1utrihKBHx+619qg92jj0SX22qo6zv6aOjsS7msjj5PSvfFUxTDwW93mKeFjKoGXfdHbnK2NfdETHd7/SH3Ji9Pc3d/1DIDtPT0J//gYZJtZVEvIhMB7M8GO30XMDUk3xRgj50+JUK6oihpQjfLzD/y8SvJtrJ4ArjMPr4MeDwk/RIRKRKRmViO7GXGmL1Ap4gcY8+CujTkHkVR0kg25hk++f7I7+tlY6vqXEwJzZiDW0QewHJm14rILuBa4BbgIRG5AtgBXARgjFkjIg8BawEv8FVjTGDc+RWsmVUlWH4MdW4rSgZItI0bTkP15pbmYdy9H5KhVj0XI49Mzob6dJRLp0bJfxNwU4T05cChaRRNURQlSDwlmY2RQj6UGY98cXAripJjdLnr/kMuvipVFooyysnDTmxOSFZZOkaZclVloSiKkgKZjDyUj/pblYWiKHEZZZ3ohEikTkaSaU+VhaKMckwC/dh87Ommi3jvH+1qIoogUya+XCghVRaKotiMoG5wFpAM1lf8GVoZKzoqqiwUZZSTSMMzqFkcSbaVEJJ+qyg3hFbnSKoqVRaKoigpkMnZUPH0t5qhFEVR9hP6PClECdyPUWWhKKOckey8ToR89A/kI6osFEVR8gwN96EoSt6Rjw1TLsjkIruRgCoLRVGAxJ2m2qTGJlT3ZqquMjltNxqqLBRllJPsuELHIZknH+tYlYWiKMDoHTHEa5iTbbhHqjVLlYWiZIGnP9jL/72zI9dixCTRRnGEtoVpIy0uoDwcWmRs8yNFUQb46v0rAbj46Gk5liQc9W9b7E9KUBflKYqSMxJpf1Sx5AcaG0pRlBwwyqPOxml5hzO1OJXpuCKJRQLONqosFEWJS6DBHKnO20yRiqJJKLCjmqEURclHRmokVSVxVFkoyignmc7viPZZpE0JDr+S8jFelSoLRVGAOCOGkawklIRQZaEoo5xE9EA+OlxzTYEzM/a4fDXzqbJQFCUuAbNHvjZkueCYWTVx86SiYo3JT3OfKgtFURImHxux0UguRnqqLBRllJOIAshGJNVck673SodCzUeznyoLRVHiYqIcK6MHVRaKMspJpBc7kjdIyrdpqvnqF1JloSgKEHtDnUGL8jIvyoghFUWTiINb11koiqIoeUlOlIWIfFtE1ojIahF5QESKRaRaRF4QkU32Z1VI/qtFZLOIbBCRM3Ihs6KMVJJ1cI9UdA/u2GRdWYjIZOAbwEJjzKGAE7gEuApYYoyZAyyxzxGRefb1Q4DFwO0i4sy23IoyuhkF2iJNDLemrKiz+UeuzFAuoEREXEApsAc4F7jbvn43cJ59fC7woDHGbYz5ENgMLMqyvIoyYhntI4t4Dv58nMaaC4myriyMMbuBXwA7gL1AuzHmeWC8MWavnWcvMM6+ZTKwM+QRu+y0METkShFZLiLLGxsbM/UKijIiiWWF8edfe5m3DKrGDDm4c0EuzFBVWKOFmcAkoExEPhfrlghpEavSGHOHMWahMWZhXV3d8IVVlFFErAbq1uc3ANDl9qpt3yZaPeRhO58WcmGG+jjwoTGm0RjjAR4FjgPqRWQigP3ZYOffBUwNuX8KltlKUZQ0kIiZZWtTNwAdfZ5Mi5Mz9icVOFqmzu4AjhGRUrFU86nAOuAJ4DI7z2XA4/bxE8AlIlIkIjOBOcCyLMusKCOehAYMI7XbnAKZWqhofQ/5V9GubBdojPm3iDwMrAS8wLvAHUA58JCIXIGlUC6y868RkYeAtXb+rxpjfNmWW1FGKkm1eftT9ztB8nEBXD6SdWUBYIy5Frh2SLIba5QRKf9NwE2ZlktRRjMjUA9klER8N6nMpMpX5aQruBVFAfLR8DF6iTva0RDliqIow+PVjalNm0/XJK98HRkMF1UWiqIAiZuh8jkC7cb6Ti79y/49/yVfZyarslCUUU4et/1J09Gb/NTe+Caf7JOPX4kqC0VREiZPO715S6ohyuNnSv65w0WVhaKMcvIx9lGqjJQ3yUdTnyoLRVEADdEda/MnRZWFoihJYMjv3vtIaO7zVWerslCUUU4eWjxSJpVXiXdPLuonrkxZkWIwqiwURUmYPO305i0pKa88Vd6qLBRllJOnbVNK5IMyG0kTBkJRZaEoikL++ApE8nN0ocpCUZSEMeRnQxYgj0VLK7mYWqvKQlFGOck0PHnS+U4r8d4/F2alfFR6qiwURQkjHxeFJUI2lVlCe0WlUI/5WvWqLBRllBOpbcqnBmsSTVTRkVDePBJ7xJGTzY8URclvYjW62W6Q3yz+Bp2mhMPcd2W55NhEq4fhKlrLwR3HNKaxoRRFySVdbi99Hl/emaEqpDcs7XLnM2wr/gwXOl/JgUSjD1UWijLKCdULh177HKfe+kremHOK6I967dqCvwPwi4I/DauMoe9aU1Y4+HqUyojms8iXKbjpRpWFoijAQCO3u603egOZ5ZawlvbgsQtvjJz5ot7yy9+TTlRZKMqoJ7x1y5dVyFOkKXh8mHzIQbIDgGLcg/KNpSurciVKJmqxlL6oz/1gVxt/feNDvD5/2stVZaEoShgxe8dZ7Dqf43wzePzPomt5rugqJtHEOGkD4EXfAgAmSgswvKmzyY6aMlkL0ar4B64HWFv8BSZ3rY54/bVNTVz/5Fp8GfiOVFkoipIw2XZ8f9a1JCxtSdF3WVL4XQDe9c8BYKbsBdLTgOezz+FC56sAfGH9l7JetioLRRnlJNP+52qDpCZTGTwukX4KxAfAB2YWALcU/Dn1h+eHxS0hOk1JzspWZaEoCjC4R50PTtoKegB42reI/+i/nvf8swddv9t7Gq/55/OefzYl9OeH0Gkims+oXPoGTvqiL1TMxK5/qiwUZZQTcQV3HnS364J+iaPYacZzXv+N/Nl7ZvD6Td7PAfC47zhrpNHbmqaSh9fQhuqs9OovQxWdA6d7Vqbz4XFRZaEoShixGrlsqZEaO8RHE2OCaROlGYB3/QfQTwEADabKuti5d1jlJasiMuW/ifbYSnooEB8P+060EnrbsiYTqLJQFCUCuR9XQLVYyqI5xF9xv+9UAL7a/41gWr0Zax107suecBkmUps/yVaUG/xTrITuxqj3Z8K1pMpCUUY5gYZpZ0tvSFru1UVtBGXxpv9QZvTdzx5qg2kNBEYWqSmLeCa3fKgLgDsKbgWgydgjrVd+ltXyVVkoihJGtOYxm3Ohqm0zVAuVMfM1BEYWXekZWeTr1NlpDmskscOMsxK6G8LyZFKv5URZiMhYEXlYRNaLyDoROVZEqkXkBRHZZH9WheS/WkQ2i8gGETkjFzIrykglUs85HzrTE6WFDlOCJ05w7D6KrIMlN2RBquRIdaJApPp/0zePVlPOCnMQ/Y7imPdnQt/lamTxa+BZY8zBwOHAOuAqYIkxZg6wxD5HROYBlwCHAIuB20XEmROpFWW0EMvBnSVFcppzBR2UJXWP+D0pl5euEUWmZpJNlUZe8c8H4M1xnwEE/L6MlBWJrCsLEakETgTuAjDG9Btj2oBzgbvtbHcD59nH5wIPGmPcxpgPgc3AouxKrSiji2gNnt8YVu1uj3gt3bjwscU/KaG8v/VazUXFvn9nUqSsMbT+62hjqqOR7WY8AN0FVYCBnpYh92WOXIwsZgGNwF9F5F0RuVNEyoDxxpi9APanbZhjMrAz5P5ddpqiKGkgmQYmW6OKIvqpki6W+Q9OKP8S35EAuHqb4uQMZ+g7DR1gJPvOw10QF8ks+HHnCgCW+w8CoNtlW+mjzIjKxEr7XCgLF3Ak8AdjzAKgG9vkFIVIbx3x6xORK0VkuYgsb2yMPq1MUZTY5NpnMcEODLjPVCeUf6uZAEBBX3PGZEqUTJihxksrfiO86T8EgB6X7dTvSV45pkoulMUuYJcxJjBefBhLedSLyEQA+7MhJP/UkPunAHsiPdgYc4cxZqExZmFdXV1GhFeUkUYkxZBr/3ZgTcEeahLK30EZOAsp6M1eJzERhdrW48HvT642u9y+Qc924uNbrkfppAQflrs22shiRM2GMsbsA3aKyEF20qnAWuAJ4DI77TLgcfv4CeASESkSkZnAHGBZFkVWlFFHtLUFw22LinFzsL0nRSwmkNzIAgTKxw9LWWRiyuzpv3qV3yzdlNQ9j6zcNeh8S/HnAdhkpgTTLJ8F0B15ZJGJ2VCx56Rljq8D94lIIbAVuBxLcT0kIlcAO4CLAIwxa0TkISyF4gW+aozJ3hQARRnhRDKbZCiQBeuLLwfgFPetfGgmRs0ZCOuxN2FlAZTVpWVkkW6l8fya+rQ85/ueK4PHvc5KEAc0bUzLsxMhJ8rCGPMesDDCpVOj5L8JuCmjQimKEiQT5oxxDMQymiAtcZRFC62mfGANRSKU1eFq3hU/3xDivWouTHKRygyu3AaMOGD68bDhGTjr1pD7NDaUoihZJFqjM5zQF/Mc24LHVzqfipl3grQkYYKyKavF1dcSP99+RClWSPIXfQsGrTkxxsCME6BjN3j6wu7T2FCKoqSfyDHKE86aKJ90vhU8PsX5PiWEN3IAs2U3pzlXcqDsjHg9KqU1FPXsDdufO1NEV6hpeTgwMCvsKd+x4XnqDrQ+3/ptGgqMjyoLRVHCiNbepdoQVtPBBc7XB6WFKo9Qvu16GACnJFlYnTVn5nTHiuQFZGB9RLo3DhpOL3+8WHt01FMVfvHgT1qf+1YFk3I6G0pEfiYilSJSICJLRKRJRD6XOZEUZWSwfl8H6/dF380sX4g4sIg6skitNbqm4D4AHvMdx5nunwDgNgUR857ttGbVv+Kbn1whh/wHAFMkPMDe/spEYjj6nS6YdmzYKm7I3aK8040xHcDZWGseDgS+l3ZJFGWEsfi211h822u5FiPn1NLOBU6rHn7i+Sy7jRVefIpEnvb5gu8oAP7T8/3kCiosw1NcE/W50YjXG8/FAsWAUp5gjyyG+m+CIpXWQE92FiImoiwC6v9M4AFjzMjyICmKEsbw7PGGMxzL+KTjTY5zrObGgr8ErzQxhg5KAfhewUMR754ozSzxLcCkYCX3O4v4jGtp0vflKxOkhTZTFn1WWGnNoLUWmdRriUydfVJE1gO9wH+JSB1E8UwpirLfEXEFdzQzVAKt0d8LbuYE5+qw9A3+KfiHKIAzHW/zL/8xAIyhiw5KmSRNvOefHb+gCEgwCqsh1aVpiVpwsjHimCAtsdeaBEYWxmR8I464qtsYcxVwLLDQGOPBiuV0bkalUhQlp6TeDpqIigLgu54vB4/v8n4CgNsLfwPAta67eb/4Sq52PUC1dLHH1EZ8Rjz2zftPAEpTmBGVT5semZDZUPWxlEVZLRgf9IXvx51uEh3nzQUuFpFLgQuB0zMnkqIo2STiCu4o3ebdbb0R0wNUEPn6H7yfZJWZFTzfYgaHHr/c9RwAV7qeBmBDSGiLpHBYVvNznG+mdn8U3N7cBI2YIK0RRxbBr6fUjp0VcHJncLiTyGyovwO/AD4KHG3/RVp9rSjKCCHVNqdWIu918Zr/sEHnj/mODx4X0R+WP7BvQ9L4vQDcUnBnwrfE3YMbw5Pv701NnmFQgJda2iNOm51dZy/QK7VHYCF+i0yNkBIZWSwEjjfG/Jcx5uv23zcyI46iKPsztVjK4uv9X+NF34Jg+hr/jEH5eijmO/2WWWqCtNBoBu+zvTtlM9QVKd0XSqS21j9Ee5bQx3T3JugIVyJh+2Ok0HgbYBytOMSw14RH3h1Tas87KguMLDIfqjwRZbEamJBpQRRFyQ3JOLjjUSeW7XyTmcId3rMBaDBjaac8LO9eLPPK0sLvUCcD61HOc99AL7H3mI6Kw0WzqaDbJBFTKgUeLbyWm5u+Br88GF74cUbKCC7IMxEW5AUImqGs6bO5ng1VC6wVkWUw4DUyxpyTMakURckpqS6+C5ihmswY9tnmk7u9kV2cgbUDgZXa57uvo1x6ec8ckFLZAR73Hc9FzleSvi+ZAcBcR0gokjd+DYd9CiYcmnSZ0TDGMNEO9RHbZxHBDJU2KQaTiLK4LkNlK4qSBySzgjsetdKOzwgtVODHwfy+P9NFScS8oQvN7vd+jJXmwLR0jRvMWCqklxL6Uh+hxMCBH78R/lnxaS645Aq481Ro2RJUFkMVbarhQxLaLbCwFFwlWVmYF1NZiIgD+L0xJn0qU1GUEcvhspVdpi64niI0UupQeijmdd8h1EgHv/embzZ+o7G2HK2TdnaY+Moi3McgMa9X0YlDDJ2OsTDGnrUVZS/s4TBBWug1hbTHqEPAMkWtewLOuCmjaz9iKgtjjF9E3heRacaY+NtbKYoyIki1zTnYsYM3/In3LT/nuSbFkiIjAo1Y+z7U0cYOkphVlaAnulo6AWh3jhnwGUTZsS5VDIEw7VXENSwVFEPzZvB5gMzEhYLEHNwTgTV2EMEnAn8ZkUZRlKwTaU1FavtWGKroTG53uzRjzOCRRfj14Xe9A36ZDscYcBZASdWgkUW6eveWsoi8B/mgMj5iL3aMEFAwnSTis7g+oxIoipJ3pNLeVdJDofhoGTINNts02MrictezPNu/KO3Pr8YeWTisciirg670R7qdQCvLOTB+xpAZUanE00qUuMrCGJP8tAJFUfYb0uXgrranvzbnWFk0U0mvKQyu+QglHSGUAu/Z6bC3OS2tTb+D2e9nvLSwz5/AKK3MnhHV0wSMy9hsqERWcHeKSIf91yciPhHJ/yD9iqIMg+S1RaDH3UJFuoVJEuHvvtOYJM0MfY8kNgUEwIU3zHRVKx34jdDpsJViWW3MyK/JKKcxdLFI1jHGtFEovsS2lh2y1iJTJBJIsMIYU2n/FQMXAL/LqFSKouSUVEYWcx3WHJik987OAHtNNSXST5WtwAK8vTV6gzq0TR9DF5uLL+XIPQ8MSp8m9bRSjg+nlVBWm7YV1DcV3MVDRTfyyZ7HgOh1OejrCay1WPt4bnbKE5GIJipjzGPAxzImkaIo2SXSCu4UHjNVGuk3TjamGgQwjTQby0QUmLkUoNvtTfgZgUVxR+4drCzmyXbeDw2hXlZnOZf9wws2WIw7uEvg0f3LAOzZUHEoHzfoNBexoZZZBcv5IX8XisgtZHZVuaIoOSaVHmqdtNJAAlM9s0CzbQqrwbKYX+R8mXsKbqbYFd8BHGhsK+m2Pt37gtec+DjIsWtwoMPSWsAEZyOlOuNqgWNz8HiazxqlRYoLFVHg8gmw5p8plZsoibjOP4m1perZWKHJOwAN9aEoI4SIIcqT7A868XGB8/WcO7cDhI4sBD8/L7iDE52rGOPeE545SuNeE8E1e6bD6vkPCnQYcDAPc2HeaY4V1mPsuFZe46DJXjMylO/+430W3fTiQMJEe79yk/jIKVliKYtxIvLfWIEE19h/G7B2yft8xiRSFCXIWb95jfnXPZf1cpPtHJ/uWA7A4Y6tGZAmeZqNNbKolXYWysZgek3r+wk/I1RZOH3WPh1n2WaiB32nDGQcNBspdcZKFwB/850BQCvlYTsLhtLQGbLB08FW0Maa3u0phxeJRyxl4QTKI/xV2H+KomSYNXs66OjLXG8xXTjskcgNnvzoR7aGmKEC0VsBprz0DfBFrs+htv6ACQug2G05xgN7b3RROjD2KquzPu2RRao2+vOdrwOw01g+iMooG0lFpGo6AJO61qRYenxirbPYa4y5IWMlK8ooxBiTsXAMqZKOEOWTxWooH/GdkAaJho/Xbtq+XfAIr/ms8CO7TQ2TpRnqV8GkBVHvDXw91RKqLJoAB1XSxSu++YNvCEZ+TX3qakAJ9ZiioJ/iEd9HE3/A5KMA+Pi2X3C4/A/4Pm6tLk8jsUYW+fWLVpQRwF/f2JZrERIiWZ/FFGmi1ZRH3Lci1wT2BL+0/yorYec7ce9x4eV054rgeZE9sqiiM3wdSWk1IFHNUIk0pIfINgBu9n6aV/zz+eaY2/ih94sJ3GlTaNV7gd/NP1w/Al/47oPDJZayODXtpSnKKOfRd3flWoQw0jGyqJH2vHFuB7jQPbApUasp50MzEYOEOaIjveolzpeYKC287DscsMxQlXQz3dFAvxnSY3c4LYURMEOlYIeaYo/M1vqnA8Jm5wEk1V8XgfkXD5wXxolUmwJRlYUxJrNRqRRF2a+59NjpweNa6aCZ/FIWy83BbPJPBqCPQvw48BVXJTRr6SiH5RT/vudKwDJDHSzWdNa1Znr4DWV1w4o8G3CmbzUTU34GZ/yEhpLZfNf31dSfEYPMRZ1SFGW/JZHe8aGTBqZ11tJOU56NLICgAvMaa7W1v6AcVvw14gsG+vHf6f8T/+F8g/X+qTRQRa+rkmJ3M7Mc1n7bS/xHWhlDH1FaG11ZJOCjqpZOfEZos814KS3VKKvlrvn38aTJjN8oZ8pCRJwi8q6IPGWfV4vICyKyyf6sCsl7tYhsFpENInJGrmRWlJFI5HhJibdWc2U7sx17mRAy6yhfKLF3gn7afwwAvTWHWBd6o8t6nvdZANxY5qbughqK3c3MlL24jYs9kRbKldWE+CwG193Olp64ctbQQQsVwaix+bjqOZcji28C60LOrwKWGGPmAEvsc0RkHnAJcAiwGLhdRJxZllVRRhUJ9WztDvOhjg8Bgvb9XDJ09fQ4aQNghz0dtWPmmdaFBExRd3qtvD0F1RS7m5goLew1NZHXPoSYoYbWXXuvJ25Zn3EtpSeBXf3ikovYUJlERKYAZwF3hiSfC9xtH98NnBeS/qAxxm2M+RDYDKQ/SL2ijFIibn6UxP2VWD3ne3ynp0mi1Ij0Hr/zWs3IBr8Vr8pbYk9zDdl/IvS2wBTWn3ku5kn/cQB0Fo2npHcfdbQHd+ELo7QWelvA5026vR5rBzt0yUBsqeFs0pSL2FCZ5Dbg+4A/JG28MWYvgP0ZiI41GdgZkm+XnRaGiFwpIstFZHljY/r3xFWU4ZLJqKDppLUn8amXV7qeAqCD0kyJkzBD17Dc5zuVU90/Z4U5CABPQFl0R96sKBBmPdRZ3140iZK+BiZJU3BjJRhiqgus4u5tSWEmmeXc/qnn08ndmGWyrixE5GygwRizIm5m+5YIaRG/DmPMHcaYhcaYhXV1dSnLqCiZYlN9V65FCCPSP9Plf42/FgEDNbQz3jb1ZHKXtkQJ75ELW8xA39JbYrcLXeGdSREJRqltNQPrRTqKJuLAz3RHAw3RosAGlMW+VWEyxBslBFaKN6chMEYm+yK5+HaPB84RkW3Ag8DHROReoF5EJgLYnwHVvwuYGnL/FCBCNDBFyX88fn/8TPsRQ0OA5zveojEgzqgji8D+2i1moOFuL5o0cEyU9Qs1B1ifTRuTbrBrgjsMDpi4hjMCzUVsqIxgjLnaGDPFGDMDy3G91BjzOeAJ4DI722XA4/bxE8AlIlIkIjOBOdjh0xVFySEy0Lh+4J+ZY2ECW6bGaSjFYe9sF9lMPUesRZNbzYCCaCibQ7/LUh4P+06K/Nxx8wCB3taUzVDNIQoq2RX02SD348YBbgFOE5FNwGn2OcaYNcBDwFrgWeCrxpjh7TKiKEqQ4fRiAyaU73i+kiZphscT7++Oed0YoGzcIDNUqJlormM7jVJNS4jPos9VwWNnvMGMvvvZZaKYtx1Oa3vT7sakG/pAHbaGmKE2pmiuHI5jPB6xAglmHGPMy8DL9nEzUUKMGGNuAvtepLkAACAASURBVG7KmmCKoiREYGSRLwvy7n17R/xM5XVRzVAzZR87JMJOfxLerw5rl8vqLGWRZHtdLR20mbJg8MPhMtJmQymKkjek2Bs1lgkldOVxvmPAatR3rwgLVS7AeGml0ZHA7nSRKLNWcadihsq3uFqRUGWhKErK1NJOC5X5MRMq0YyBIHtd+wYli/EzjjaaJVVlUZeiGaozbXG1Mjk1O/ffsKKMIkZU3H+xAgg2mSgL1bJMImtDjDEwy97lbvtbg65VmA4KxEeTVKcmQFkddKVmhoo2svj43PER02ORqd+YKgtFySL5N8dleL3RWsmfAII3PLk2sYyT7UCAPdYeFYHXn+6xwpY0OQYri4Trp6wO3O3gc8fPG4KaoRRFGfHU0E5TtBAYWcbji7+GxQBUTLIc1j2Dd7a7tu2HAPRQklB5YTrEXphX0Jf4jnkO/GkN7z7SFuUpipJHpNzAGHsfizzpFSc8AnA4oKQ6bGe71YXWdqlrnXNTE8Dei9vVl/hWQGc7LFNY2IZKwyBT2/aqslAUJSVKevdRKu688Vkk4lgOKpTSmrCRRZ+UsNY/HbcUpSaArSwKkxhZnOx8H4DHfMenVmYWUWWhKEpKTN1r7fuw3STvhM0ESYW5KKuF7sGNeqW/bXj+l6AZavCIJVZP/3zn62zxT2Q36Yllp7OhFGWEkI+zoVJtYIr6rQ2EnvHnx44BSU1ZLa0ecHDbt431t0X0vyT8VHtkUZCgGaqUPgBm2zvwpQudDaUoSl5R7G5mt6khX1RgYkrPzlRaO8RnYRjja7NMagm+TlhojaIKcBaFObh9/siC1dnRen/m+VRiBeYYVRaKMspJNWhdsbspb/wVSVNaAz0tYEcBLqOPItyWGSpVU44IlNVR6E7MZ1GLFSpllZmVYoHhZDIAoSoLRVFSotjdTON+piyCg4GyWjA+6LN695HChKdEWW3CU2frgnG10lyHGhtKUZR8Yr8eWYyxt8hp2ggM9PKHvWYkmZGFrSwaQ3bfy2dUWSjKKCcVB7fgp6i/hUbyp6FL5DWCeWoPtD7bd2EY0ssf0jOPVj8Rk8vqKEzQwV0nbfiM0JKGHfKCMulsKEVR8okqunAYX16NLJJqKAPboHZbTu6AGWpYPgv7udbIIv5D6mijhUr8aW6GdTaUoigZIZW2ccCEkj/KIpGFy0GFUjxmUMiPgBlq2GE3Kifh9PdzlevBuFnrpGO/MUGBKgtFySqZCsWQbQLTPvfbkYXDae2Y17IFsJRfp1QMfwOiwy4C4CTHe3Gz1skwFwFmGVUWipJFMrntZTaps3vimfRZjC1NLl7Si+vq4+YZVP+TjoDGDdz/7+3USDvtDvtdhqPPy2rZMeMi5shuXHhjZDQc4diS1vpbu6eDv725jY6+WOWmjioLRRnlpKLAajM17TOEjOvVysnQsJYtjd3USgftTrvhHlJutLUL0eRrrToMl1gbKUVjEpb5y21ij2RKCp0xr4fyysbG+JmGgSoLRckiI8kM5XUU0ZlgOO98YVD7Xj4OjJ8DZBe1tNPuqEpLGb0lEwD4iGNd1DwBh/pL/gUxn3XjuYekRaZ0oMpCUWLQ0NlHe48n12LkHbXSjrsos6E+Mq5XD/oEAEc7NlAn7XQ40mMSahs7D4ArXU9FzVMtnQBxw7uPLS1Mi0zpQJWFosRg0U1LOPonL+ZajLyjjnb6impzLUbSDDIdTZgPxWM5yrGJSulJj88CcBdaO+3NdexkLJZSuML5L77sfCKYpxprZDHcNRbZ9IEN0/WvKCOffm/8HdhGG3XSTl/R7IyWkfF2UASqZ3FYz1aAqD6L4VAn7VTTyY8K7gVgr6mmiTFBn0/LMGdDrd/XydyJ2ZlRpcpCUUY5qTTKtdJOR1FN+oXJMGHO6vJxHORYCRDdZ2GIqECiVZsx8DvvuXzN9TjjpZWbXXcGr/268HarLFMKQAelyYgfk0wGEQQ1QymKkiQO/FTTgbsws8oiK3MBygY2HQqOLJJk/b6OQaNPg+FR3wkA3Ft4M1Md4bOUxkiPfTS8l3x+TfzpwulClYWijHKS7ZFW0YlTDH374cgi7FXLxwUPU3Fw72zpYfFtr/G/T68dKMJAQ8jK7Dd8hzCr796we5f7D0y6vKH86sWNw35GoqiyUBQlKQLTPvtsR+5+TdGAgzmVqbNt9ky5lTtag2nGQFfIlOKve76OHwenun/OX71nBNP/6ftoKhLnDFUWijLKSdZnEXDOuoszO7LIhIM77JFzzsBnhCd9x+B2FMe4L3FhrJzC2/65vOM/kBY73tQWM5nbvecE820xkxJ+Zj6gDm5FUZIiEHTPMkN15VaY4TJ+HrPd9wFwTJQsUdVEFG0WmM76mf5rwq61hkyVXeuflqiUeYGOLBRlPyCfYkoF9n7o2w8d3LGqUQLO5mGWGyjCjyMs/HhooMLONM6EygaqLBQli6TaDmVSV6Rihuo3Tjyu/SdiajIMW0clWJ9mP2t+sy6tiEwVkZdEZJ2IrBGRb9rp1SLygohssj+rQu65WkQ2i8gGETkj+tMVJb9Jtc1/aPnOtMoxHObKDpoZk6W5reklEd/DcON3xSvj+L5fc777umGVkQtyodq8wHeMMXOxzIRfFZF5wFXAEmPMHGCJfY597RLgEGAxcLuIJB6KUVH2E+59ezs7W3oiXtsRJT0Zdrf1smFfZ1h6MgqsAC8nO9+nw5RmMixUVnjqgz185s9vh6VHeq1kRl/x8u6mjpVm+NNms03WlYUxZq8xZqV93AmsAyYD5wJ329nuBs6zj88FHjTGuI0xHwKbgUXZlVpRMkuX28v/PLaaT0dovCA9ESiOv2UpZ9z26rCecZbDku9+36lpkCj7hDbkX7v/Xd7c0hyWZ+jAIpq/KOoK7hRlGy6Zdmvl1GgmIjOABcC/gfHGmL1gKRQgsFpmMhA6Bt9lp0V63pUislxEljc2Zja2u6KkQrSGx2+nt+VxhNsxdHFb4e2s9U/nQd8puWsVM4QE/dvDNEONsHoJkDNlISLlwCPAt4wxHbGyRkiL+HUYY+4wxiw0xiysq6uLlEVR8ppozVRmHdyJPfyWgj8D8FffGbjJn9DZyZDImw7XFZPpGE3RyLQLKSfKQkQKsBTFfcaYR+3kehGZaF+fCDTY6buAqSG3TwH2ZEtWRUkn8ZqRbDYzh137HF+5d0XC+Q+RbSz3H8g/fCdlUKoBMqEgL/vLMjr60jN6+2BXO7vbwn1JOrJIE2JNNbgLWGeM+WXIpSeAy+zjy4DHQ9IvEZEiEZkJzAGWZUteRckGufAVd7q9PLN6X0IKagLNTHM08qLvSEjTeoRcsa+9L+b1SLOhotXR3W9uD8+bI22R6WJzsYL7eODzwCoRec9O+yFwC/CQiFwB7AAuAjDGrBGRh4C1WDOpvmqM8WVfbEUZPvtrr/MQxzYA1pvsrTrOlFkl3ncwtNhkv7P99CuOS9aVhTHmdaL3SSJOsTDG3ATclDGhFCXHBBqYLreXfyzfyUULpw65nrsmaJrUc5zDiqq61UwcuDDCWsWggzsFJbV6dwct3f109nlG7GZZGhtKUfKA0N7rwyt2hSmLzBYe/dKxjjU8UGj10xrMWHaY8VkSKnekOqI58sYX0ipHTVl+TSJQZaEo+UBIg13ocvD7lzZz0oG5n9E3X6wtR//u/Tgv+Y/IsTTZYbhTZ9PF3V/Ir+VkqiwUJQ/whwwtilwOfv7cBn7+3IaslB3LxFUjHfSaQn7kvZww63F+tKlJE8+kF2lkkQtfU5Erv2JH5Zc0ijJKCW2LCiM1EjnyD9RIB81UElEzjDCfRYAwB3dOpMi/0FuqLBQlDwidbuly5M+/ZQ0dNJmRGV12KAMhyvOslc4T8udXqSijmNDea0QzSCbLjvHwGmmn2YzJYOnRydU04/xRFZEluebMuRHTMz0LS5WFouQBoQ1jpEYyVwu9aqSD5lEysgiQzMAiF1Oay4sju5p/vWRTRstVZaEoecCett7gcbabn2jlTZV6JklLcA/pMDLcBc+VNShyMLrItfT21pYMSpJfTiFVFoqSB1z0p7eCx/myheoPXP8HwLv+AyJnyA8xkybuCu4hWipXX0ei5Xp92VkEqMpCUfKAUHtzvrTB02Ufb/nm8Zz/6FyLkhVkPw15la3fiyoLRck3sqwtovVgp0ojW0LDe2SZ42bX5KTcfJkMlejPwOfPzg9GlYWiZJk+T+w4mJl2mvoTaFwq6GGsdLPTjIubNxPc/tkj+eWncrNiPHQFd0WR5Ux+ZMWurMuRqBnKnyU7mSoLRcky5/7ujZjXI/3vHzo5fdNXh24lGkk5HedYA8BmMyn6gzLYA59ZW0ZxgTMjz47btkZ4r5U72jIiSywS7TRkaWChykJRss2G+s6Y1zPdUexye2NeP1S28qfCXwHwXjTnNuSPcyXNhK/gzu8XVTOUomSQfe19KS1iau5y0x2nsQVYvy/WTsGx6XSH7+SWTgXi9g42g7V09QePL3K+zD8LrwXgv/q/QTMjb0FeUrGhBOo7Ym+WlCkSNkOpshh5LLjheb549zu5FmPUcc7vXmfxba8Gz/s8Po65eQlXPfJB0s866n9f5IyQZ0Xi6Q/2svi212Lm8cSY7vjG5uawtGR6t519Hn767PqoZbiHKMlbX9gIgODn5wV3UCA+rvNcyr/8xyRc5v7EWb95nW1N3VGvh/os/H7Dv1bty4ZYYcRSFmfPH5h4cP+yHVmQRpVFVmnt8fDiuob4GZW08sGudtbvGzD9BBrLF9bWp/S8Xa29Ma+v2dMe9xkdvYnuA234mGMlxd17WLung8W3vUpnnD2kb31+I394eQuPvbs72iMj8hXnkwD81nsef/MtTlC+/ZM/vrIloXyebDkEkuT8IycHj5dvy+TCwAFUWSijj8D/f4YctEWu+I5ZX4I2hk85X+Yvhb9g4cqrufX5Dazf18m/46waDsy28kZp6KLNnpnvsPauuN17TkKy7XcLEuIQqJbQOI7Z8gdEItZoMnT0o+ssRjDbm6MPgZUBlq6vp6nLPaxnRFoNHfgnFGBbU3eYDT8Sy7e1sLmhK3ju8xtufmYd9R193PHqFp5fM2CqKCoY/G/V3hM+EvBHsUIdLDu4yPkyZzreppZ2TncsB6C8e8DUEK9xiKeHIrV//8/5JIud7/Ck7xh6KY5TQoKC5DENndF/V4PMUDlcTR+z6BBF/erGRl7b1JhxeXTzoxxw0s9fZv2NizM2NTAfaevpp9fjY+KYkoTy93v9fOFvyzlofAXPffvElMuNZG8O9Ba73F5O/sXLnL9gMr+8OPac/gv/+Nag8+XbWvjTK1tZu6eD1zY1AbDtlrMAcDkGd7kPv+F5BD9Xux7gSMcmDpMPcf2xAiYeDlUzYPJRnO7YwldcT3KofEiBhCuvEncDb6zfCRQl+uqDWLF9YDQS3gAa/tv1MI1mDD/yXJ7S89NNpmcgLV0fbg4OdiJCvr48ibwSE7+Bz9+1LOPl6MgiR/RnKZ5LvnDcLUs59ualCecPNGibG7vi5IxNa8/ATJ/ArJGACSjQw340mm0/BoFn9PaHN+xDYwsBHC0buNL1NLNlD4/4PkrvzDOgtwVWPwpPfI07Cn/FAsdmVpo5fK7/arrNgFL4o/dsABY6NoYL0t8DDetg94qwlq2lu59rH1+N2+vjgj+ExJ5isIO9gl6KxMMfvWfTRkVS9TCSCFSf05H/9rVcSKgjiwzw0oYGZteWM62mNGqebE13yxd6IjSqsQj0/odrM3aENNzd/V4qigsimoACjWeBM7n+UyS/QKS25qPOVQCc4r6VNipwzZzPpz41Ffw+aFjH53/zJPWmio1mKgCnu3/GRa5XuNN7JqW4+bLrKf5W8FOe9S9iwasFsLQeelqgp5mgPWjSAvjUPYix6vpXL2zE6zfhC/qM4cUQ536VWM7/VjN6FQUMKIvA5lMXHjWFh3OwcnuoPJEINYlmCx1ZZIDL//oOJ//ipeB5l9vLQ+/sHJTH4zMJ2cpHMlsbu2i3ZwXd+dpWXrfNORC5EW7t7ufqRz+I2Jt//L3dPP7ewAhhT1svDR19/PCfq4Jp/1i+ixlXPc0NT60Ju/9Hj61mzjXP8OhKq3Hw+Pwxo3k+sMz6Pt/bObCy9+2tzcy46mmuf3JtWP7Zsoet/gnBnvv3A9N2HU6YcCiv+ecHFQXAbuq4zXshXZTSQBX3ek+ljXLmynYa9uyge8wcOmd9gt/6L6Lh1Ntg7ietEcZth3HT6lNYWvjfLOZNwNDc3T9Ilh89voav3LcyeF6DtSakJdlRRf53wFOiwGm9WLaiuUYjlikuXsiYTKAjiwwR2tb9+LHVYaaOf6zYyc+e3cBL3z2ZmbVlCT93/b4O6jvcnHRgXbpEzRkfu/UVZtWVsfQ7J/O/T68DBuz+kUZev3xhIw8s28mhk8fw2Y9MH3Ttmw++B8C5R1hTCo+7JdzkdcNTViMeyY8R8Dv8/e3tnH/kFA7+0bMxv5cn398TlnbJHW8POhf8ODD4cDJT6tlmJkR9Xjz+x3sF/+O9Inj+hbEzqSot4Nb+jfR2z+b7F1+OqV/Lb377M+bKDk5yfMDvCn/LAu9mlu34btTnVtHBIsd6AJqS2BHvxAPr8iaUerooK7J8iC57dBltNlk+EMnUmWlUWWSBSDMvnnx/LwAb9nUkpSwCi70CjWo22VjfyZm/fo2l3zk5poktHn6/odfuGW1tjDwzLNI/asCPkQkTXqDhe9eOAeTzm2EP9f9U8CtOd66g1ZRTJV287Y28HWYqWKPSgsFp1QfxK+9FAJTQxwOF/8u5zjd4zfPtYJ4rFo3jjXeWM1ka+ZzzRU5yfIBDDB2mhA8TiDB7w7mHcOmxMwC49+3taXufoeRGD1kNcGCCgteXW2URqw5yERlXlUWOGDrE7ezzUFroymvn2kPv7MTrNzy3Zh9fOnFW2PV73tpGVWkhnzw8RvA54BfPb+D2l2Mvioo0ZTHwD5K//T3DJJqZ79jKYY6tnO5cAcAzvqOpkw4e9X00jSWF4/YM/KZ6KeYB36n8tODP/Ff9dcxzTqVSevjiqudwFQ2YpR7ynsRj/uNZ5Z9FN4nNVAuQyzUImSSoLKLNb84SsWo3F8pUlUUCdPR5eHj5Li4/fgb7Ovp4cV0D/1y5i36fn6e+fsKgvKH/QDOuehqRyF/sJrvXunZPB1++17IfT6su5bLjZrBiewsVRQW09fbz3Jp6Xvv+KUytLh0UKuSmp9fy/06azZJ19YyvLObkgzITSnpPWy+vb25ienUpd77+IWDN5Fq1q51fL9nE3IkVHDOrhmdW7+Xet621AB82dfNLO4TESQfW8crGgTngM656OqyM0LTL/7qM9fs6GVc5MNe/z+Pj2JuX0GqvV/jx42v48eNrqCkrxO31D1IsX7pneVIrsyvo4QTHB5T6ymlw+HDi5+rbdjNVXIyhm9Ody2k35XhwMld20MgYKuilnTJqaaeLUqZIA8c41lGCmzIZGEX+238w13suZa2ZEbHsC//wJsu3t1JamPwU6vv/PbDu4vaXt7B8WyvLhqzkfcJ3LJ90vMn8vndZVPAmALvGLOTmhuPYa6rZaKbQReojxHw20wwHl+2z8OR8ZBG9/FhxzQpdmXFFq7JIgOueWMOjK3dz0IQKbnxq7aDQEUMZGo8nXg/gN0s3B493tPRw41PhztETfvYSW35y5qBQIX9+7UOWrm9gi23GyZRZ6tK/LGNzQxcfPaA2mPbz5zbw8+c2APDiunp+G/IOQFBRAIMURSQEP9V0Ml3qmSn7qNjcwziK6O0sZLyjkB6K+f09zdT29jJJPJTgpkT6KcFNf28BvaaIHoqop4pOSliydi/l9FFGH2XSx0Rp5lDZxqGODynGQ6OppFg8zJI9HCi7KQ007l6g0BaqjYjLGbpMMeXSh8c4KRAfXaaYYvpppYJX/IfTbsrYaepY4T+QvaaaRqoG3V9R7KKzbyAI4fLtrUDyM8UiMVRRgDW6+JznGgDG0EWdtPH7T13M07+JHSI9FgumDryTb5g9b5dDoiqcWXWJm2bTwffOOChogpxVWw7AWYdNjPv7TQflRa6IkYAnV0Uf6Z23YDK/XrIp4rUbzjkkbbKFosoiAVrs2SR9Hl/MlZ8Qb2huqKONGVLPAY7dTJBWSnBTTi+V0kMFPRTgxU0BXpz4cOLFQR9FeJ99g884+9hp6mgwY+kyJTQ2dlOGAy9OSytlwJC5r92KuNmbxOyLIvqZLvVMkUZqpINxtFEnbZTRR6n0MUlamCxNlNE7qCcelZ3wndTWog08wl9HL4Uc4diMmwJ2+MfxoP8Umk0l//YfTGlJMb29ffhwUCG9TJAWpk+ZwqqdLew2tTSaseylmiI8uCmgik5u+syJHD2jhq1N3XxniHMbYMP/LuaLdy8POs9PnzeBR1YmNhXzl586nPOPnEK/148IdLu9VBYX0O/zU+B0cPIvXmJnixWj6u2rT8XlFDw+Py6Hg6ICB26Pn5JCJyUFTva291Ja6KKsyEmRy8n6GxfT5/FRXuTCb/9sPD4/JQVOZl79LwDe/dFpFLocFLoczLnmGQAWzajmsCkDTvBIDX2hyxGz13vIpEp+dfERnP6rV5lSVcLz3z6JA//nmUF5PrjudEoLk2uanvvWicyuK8PldPCHl7fw02fXh+VZd8NiHA7odvvw+vwUuZy4nEKZvcHRF++2VstPryll3Q2LKSl00tzdz6y6MhZMG8u6vZ1c9hdr8duHN5/J397cxvVPrmXOuHLu/eJHGF9ZTJ/HR3GBk6se+YAH39nJzecfxgVHTgl7x1BWX38Gb2xu4rN3/huA2vIiXv/BKREX7ZYWOvnYweMYX1kc7CD2eXx09nmpLivMqBlblcUQVj93F5tb/UwcN46W7n78QO/G7Zzm6Gbdi6v5aG8H4vBTKF5c+HjvsY34/LC5oZuufh8Hjq/gc84dTJJmxksLY+imXPqopIfx0kKNDB6V9Jgiuimiw5TRSSkenJTRhwvLJOLCR5n04XznLX5SED2AnO+GArqlFArK8LlK8LpK8ThL8DhK8TqL8bnK6HcU43WV4nOV4LbT/a4yCorL6fQ5MX4/Dvw4jA9j/Oxs7uR4TxNOhx/nTj9THH4qpJcxdFMibqrpZLy0Ui69VNBLtXRQgpsKenHI4Iak3ZTSRQm9poh6U8VS/xF0Uko3xbSaCnaaOraaibSZcorpp1TclOCmFDel4mYMXfRQTA9F9JlC3BRSgJcScVNGHxOkhXJ6KcJDD0V0U0KXKaaZStb4Z8RfbNYTcmyL/vXZB/DM9sGjJrc9/GilkslVZdRVFlNXGTk8RpHLybiKgWuxIs1GuhcGTApjS61yix1W+rGzatjZsoufXnAYE8ZEKD8kaUrVYFNTcYEzrCEaur6kvNgVllbgGtwQRXIAFzljKwunQ4LrUJwOSdpk8vJ3T+bkX7wcln7QhIHvt7c/vJd+3OwaSmxzXyKxuwJ5v3Ly7GBaTdlAj0VEqKuwzg8cX8F4+zcQqNeAaVRI3ixU5HJEje6w9obwAI+Rvs9MsN8oCxFZDPwacAJ3GmNuSXcZHq+X6rd/xnlmH4R0TM4K/EaaGTBVBLBmbHJU4LwFTigAj3HSwFhaTQXdFLPb1LLGP501ZgbbzAQ2m8nsMTX4E1zqIviZJg1MliZbAfVSSQ9OfLjwU2GPTEo8bspwU0ofpdJGKfWU0keF3fiW0RfWkMfiiqHva+M1DtooZ5+pposS9phqVvln0kMR7ZSx1T+JnaaORsbQZMbQl2yYChPlOFa+NHPAuPKY16vLolROCItmVgVHE4HGJRaHTR7Dqt3tcZ89f8pYHlq+ixk16TXXHDurhre2NkdcnHjUtMFmtUgji6ICB7EG3xJyn8uRvG190tj4TvjKkoKwtG+eOifpsoYytNc+rdpSwvOnhE85DlSNI1829E4D+4WyEBEn8HvgNGAX8I6IPGGMCTfwD4MCl4vSb77F0mWvUerw09HnweFw4DeGJreLssqxuBxCUWEBezp9bG5yc/SMKhwCu1t72LCvgyOmjsXjF/pK6tjV5uaIqWPpdnvZ1dpLWaGT7vY+LjiwjrZeD0UuB16f4ZnVe+no8/KtU+fg9vpo6fbQ1OVmX0cfh08Zg9vrp9DpoKzIMiU0dLjZ3dbL+Mpi2ns9GGMoLymgudtDdXkh/Q6h0f61OkWs0BTG4HQ4MMaPePso9Pfi8vXi9HRT5vDg6e/F4XDiM4JBEGcB3R4/TocT43DicDhp7/Mzc2IdH7QWUlRcxFHTqzDAyq3NVBYXsHJ7K8WFTj6zaBr9Pj9tPf34/Faj+ovnNnDyQXXMm1TJhMpiOvo8bKzv4oBx5Rw9o5rmLjc9/T5e2djI6t3tHDmtio31nby+uYlTDh7H5LEl7Gzp4YQ5dRw0oYK739zGx+eNZ0pVCU9/sJctjV0cOnkMS9c1cOlx0/H5DZPGlrCpvouxpQU4RHjsvd3Mm1jJ7Lpy/MbQ0NnH1KpS9rT30d7Tz5o9HVSXFbKpoYt+r58zD5vIlKpSXlxXT1mhk9JCF8UFTk6YU0tLdz9Tqwd67MuuOZVXNzZx2tzxrNvXwew6S9Gcf+QU6iqKWDSzBpfDClF3z9vbufKEWRw2ZQxen+G9na0cMbWK4gIHx82u5fm1+zhmVnXM3+pnPzKNRTOrOXB8eldd3/WfC2nuGryI782rPsbWxm6Om10zKD2SxaMwgRXwgRFJMiaTH589j4/Mqg7rpd/+2SM5bMgK9c8fO53KkgIWTB3L0vUNjCkp4COzBsseiUljrdFBRXG4sgnw60uO4C57osf8KWN58b9PDPo4Qgn4Kofqiqe/8VF+u2Qzz66JvkdGvuoX2R8W1ojIscB1xpgz7POrAYwxN0e7Z+HChWb58uVZklBRRh89/V5++fxG3t/VxjvbLGf9369YREevl+ZuNz9+fA3/C47o5QAAChtJREFU76RZ1JUX8Y/lu9hQ38k3T53DxUdP5bhblnLlibP44ZlzeXtrM5PHlnDCz6yoBx9cdzqVdoN9z1vbeHVjE3detjBYbujsuTev+lhCo41E6PP4eGFtfdyp34nw97e386PHVvPIV47lqOnVfOFv77B0fUPQzxB4h59ecBgXHz2Nt7Y08+k/W36vTy+axs3nHxZ8Vuj7ZmN9lYisMMYsDEvfT5TFhcBiY8wX7fPPAx8xxnxtSL4rgSsBpk2bdtT27ZlbNKQoSmy2N3czeWxJcEX0h03dTK8uxeEQdjT3MLmqZNDoYmtjF8+tqR/kJ4hEQ0cfpUUuyovy1zBijGFbc09wwW2fx0dzdz+TbcV241Nr2dvey+2ftQzYfr/hly9s5GNzx3HY5DGDzIDv7Wzje/94n998egFzJ1ZmXPb9XVlcBJwxRFksMsZ8Pdo9OrJQFEVJnmjKYn8JJLgLmBpyPgUID86jKIqiZIT9RVm8A8wRkZkiUghcAjyRY5kURVFGDflr9AvBGOMVka8Bz2FNnf2LMSY8zrSiKIqSEfYLZQFgjPkX8K9cy6EoijIa2V/MUIqiKEoOUWWhKIqixEWVhaIoihIXVRaKoihKXPaLRXmpICKNQKpLuGuBpjSKky5UruRQuZJD5UqOkSrXdGNM3dDEEasshoOILI+0gjHXqFzJoXIlh8qVHKNNLjVDKYqiKHFRZaEoiqLERZVFZO7ItQBRULmSQ+VKDpUrOUaVXOqzUBRFUeKiIwtFURQlLqosFEVRlLiosghBRBaLyAYR2SwiV2W57Kki8pKIrBORNSLyTTv9OhHZLSLv2X9nhtxztS3rBhE5I4OybRORVXb5y+20ahF5QUQ22Z9V2ZRLRA4KqZP3RKRDRL6Vq/oSkb+ISIOIrA5JS7qOROQou643i8hvRIa3I3MUuX4uIutF5AMR+aeIjLXTZ4hIb0jd/THLciX93WVJrv8LkWmbiLxnp2elvmK0Ddn9fRlj9M/y2ziBLcAsoBB4H5iXxfInAkfaxxXARmAecB3w3Qj559kyFgEzbdmdGZJtG1A7JO1nwFX28VXAT7Mt15Dvbh8wPVf1BZwIHAmsHk4dAcuAYwEBngE+kQG5Tgdc9vFPQ+SaEZpvyHOyIVfS31025Bpy/Vbgx9msL6K3DVn9fenIYoBFwGZjzFZjTD/wIHButgo3xuw1xqy0jzuBdcDkGLecCzxojHEbYz4ENmO9Q7Y4F7jbPr4bOC+Hcp0KbDHGxFqxn1G5jDGvAi0Ryky4jkRkIlBpjHnLWP/Z94Tckza5jDHPG2O89unbWDtPRiVbcsUgp/UVwO6Ffwp4INYz0i1XjLYhq78vVRYDTAZ2hpzvInZjnTFEZAawAPi3nfQ122Twl5ChZjblNcDzIrJCRK6008YbY/aC9WMGxuVArgCXMPgfONf1FSDZOppsH2dTxi9g9TADzBSRd0XkFRE5wU7LplzJfHfZrq8TgHpjzKaQtKzW15C2Iau/L1UWA0Sy3WV9XrGIlAOPAN8yxnQAfwBmA0cAe7GGwZBdeY83xhwJfAL4qoicGCNvVutRrG12zwH+YSflQ33FI5os2a67awAvcJ+dtBeYZoxZAPw3cL+IVGZRrmS/u2x/p59mcKckq/UVoW2ImjVK+cOSS5XFALuAqSHnU4A92RRARAqwfgz3GWMeBTDG1BtjfMYYP/BnBkwnWZPXGLPH/mwA/mnLUG8PawPD7oZsy2XzCWClMabeljHn9RVCsnW0i8EmoYzJKCKXAWcDn7VNEthmi2b7eAWWrfvAbMmVwneXzfpyAecD/xcib9bqK1LbQJZ/X6osBngHmCMiM+3e6iXAE9kq3LaH3gWsM8b8MiR9Yki2/wACszSeAC4RkSIRmQnMwXJepVuuMhGpCBxjOUdX2+VfZme7DHg8m3KFMKi3l+v6GkJSdWSbEjpF5Bj793BpyD1pQ0QWAz8AzjHG9ISk14mI0z6eZcu1NYtyJfXdZUsum48D640xQTNOtuorWttAtn9fqXroR+IfcCbWTIMtwDVZLvujWEPCD4D37L8zgb8Dq+z0J4CJIfdcY8u6gWHOAokh1yysmRXvA2sC9QLUAEuATfZndTblssspBZqBMSFpOakvLIW1F/Bg9eCuSKWOgIVYjeQW4HfYURbSLNdmLJt24Hf2RzvvBfZ3/D6wEvhkluVK+rvLhlx2+t+ALw/Jm5X6InrbkNXfl4b7UBRFUeKiZihFURQlLqosFEVRlLioslAURVHiospCURRFiYsqC0VRFCUuqiyUEYmI+GRwVNqYUYRF5Msicmkayt0mIrXDfU4a5LhORL6bazmUkYMr1wIoSoboNcYckWhmY8wf4+caHdgLtsRYK6kVBdCRhTLKsHv+PxWRZfbfAXZ6sCcuIt8QkbV2QLsH7bRqEXnMTntbRObb6TUi8rwdTO5PhMTfEZHP2WW8JyJ/Cqz2jSDP9SKyUqx9Bg4eKo99vlqs/RNmiLUXxZ122n0i8nEReUOsfQ1CI+keLiJL7fQvhTzreyLyjv0u19tpM8TaL+F2rAVmoeEiFEWVhTJiKRlihro45FqHMWYR1grW2yLcexWwwBgzH/iynXY98K6d9kOs8M4A1wKvGyuY3BPANAARmQtcjBWE8QjAB3w2iqxNxgrU+AcgEdPRAcCvgfnAwcBnsFb5fteWLcB84Cys/Qt+LCKTROR0rPAPi7AC9h0lA4EhDwLuMcYsMLHDvSujEDVDKSOVWGaoB0I+fxXh+gfAfSLyGPCYnfZRrPAOGGOW2iOKMVib5Zxvpz8tIq12/lOBo4B3LKsOJQwEehtKIDDcisCz4vChMWYVgIisAZYYY4yIrMLakCfA48aY/9/e3bvEEQdhHP8+ptCARUjARkL+ADuxtLg2BGIjhEBIYWsvCAlEUqS0tpJAIFXKgBYipjFGMGJhrRZWFkF8QdCbFLOLd4e6d1WI+3yavb29l7limf3NHjPnwLmkVTJBjJP9vX4Xrxkkk8cBsB8RP7v4fqshJwuro7jlcekFmQReAu8ljXB3e+ebPkPA54iY7SKei2J7xfU5eUn7yn/ghtcDNFv2m7Sf051xlW2qP0XEQluwOSfhtItYraZchrI6etWyXW89IKkPeBoRq8AM8Ii8+v5BUUaS1CBLR8cdzz8HyoE9K8CkpKHi2GNJz3qIcY8c74mkUXI8Zq8mJA1IegI0yM7Ky8CUcjYCkobLGM3u4pWF3VcPJW237C9FRPn32X5JG+TF0uuO9z0AvhQlJgHzEfFH0gdgUdIOcMZ1a+g54KukLWCNLOcQEbuS3pETBvvILqbTQLf3Ar4Bb4vfsEl2Q+7VL+A7eR/lY+RcksPifsp6UR47Ad6QqxqzW7nrrNWKpD1gLCKO/nUsZv8Tl6HMzKySVxZmZlbJKwszM6vkZGFmZpWcLMzMrJKThZmZVXKyMDOzSn8B4Nj4S0CYyX0AAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "fig = plt.figure()\n",
    "ax = fig.add_subplot(111)\n",
    "plt.plot(np.arange(len(game_length)), game_length)\n",
    "plt.plot(np.arange(len(avg_game_length)), avg_game_length)\n",
    "plt.xlabel('Episode number')\n",
    "plt.ylabel('Turns')\n",
    "plt.savefig('graph_gamelength_{:d}_episodes_{:d}_{:d}.png'.format(len(scores),config['seed']['environment'],config['seed']['agent']), format='png')\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "drlnd",
   "language": "python",
   "name": "drlnd"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.10"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}