{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Example on Hartmann6\n", "\n", "The Ax Service API is designed to allow the user to control scheduling of trials and data computation while having an easy to use interface with Ax.\n", "\n", "The user iteratively:\n", "- Queries Ax for candidates\n", "- Schedules / deploys them however they choose\n", "- Computes data and logs to Ax\n", "- Repeat" ] }, { "cell_type": "code", "execution_count": 1, "metadata": {}, "outputs": [ { "data": { "text/html": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:23] ax.utils.notebook.plotting: Injecting Plotly library into cell. Do not overwrite or delete cell.\n" ] }, { "data": { "text/html": [ " \n", " " ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "from ax.service.ax_client import AxClient\n", "from ax.utils.measurement.synthetic_functions import hartmann6\n", "from ax.utils.notebook.plotting import render, init_notebook_plotting\n", "\n", "init_notebook_plotting()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 1. Initialize client\n", "\n", "Create a client object to interface with Ax APIs. By default this runs locally without storage." ] }, { "cell_type": "code", "execution_count": 2, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:23] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "ax_client = AxClient()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 2. Set up experiment\n", "An experiment consists of a **search space** (parameters and parameter constraints) and **optimization configuration** (objective name, minimization setting, and outcome constraints). Note that:\n", "- Only `name`, `parameters`, and `objective_name` arguments are required.\n", "- Dictionaries in `parameters` have the following required keys: \"name\" - parameter name, \"type\" - parameter type (\"range\", \"choice\" or \"fixed\"), \"bounds\" for range parameters, \"values\" for choice parameters, and \"value\" for fixed parameters.\n", "- Dictionaries in `parameters` can optionally include \"value_type\" (\"int\", \"float\", \"bool\" or \"str\"), \"log_scale\" flag for range parameters, and \"is_ordered\" flag for choice parameters.\n", "- `parameter_constraints` should be a list of strings of form \"p1 >= p2\" or \"p1 + p2 <= some_bound\".\n", "- `outcome_constraints` should be a list of strings of form \"constrained_metric <= some_bound\"." ] }, { "cell_type": "code", "execution_count": 3, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:23] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x2. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:23] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x3. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:23] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x4. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:23] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x5. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:23] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x6. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:23] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x1', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x2', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x3', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x4', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x5', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x6', parameter_type=FLOAT, range=[0.0, 1.0])], parameter_constraints=[ParameterConstraint(1.0*x1 + 1.0*x2 <= 2.0)]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:23] ax.modelbridge.dispatch_utils: Using Bayesian optimization since there are more ordered parameters than there are categories for the unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:23] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 12 trials, GPEI for subsequent trials]). Iterations after 12 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client.create_experiment(\n", " name=\"hartmann_test_experiment\",\n", " parameters=[\n", " {\n", " \"name\": \"x1\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " \"value_type\": \"float\", # Optional, defaults to inference from type of \"bounds\".\n", " \"log_scale\": False, # Optional, defaults to False.\n", " },\n", " {\n", " \"name\": \"x2\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x3\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x4\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x5\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x6\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " ],\n", " objective_name=\"hartmann6\",\n", " minimize=True, # Optional, defaults to False.\n", " parameter_constraints=[\"x1 + x2 <= 2.0\"], # Optional.\n", " outcome_constraints=[\"l2norm <= 1.25\"], # Optional.\n", ")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 3. Define how to evaluate trials\n", "When using Ax a service, evaluation of parameterizations suggested by Ax is done either locally or, more commonly, using an external scheduler. Below is a dummy evaluation function that outputs data for two metrics \"hartmann6\" and \"l2norm\". Note that all returned metrics correspond to either the `objective_name` set on experiment creation or the metric names mentioned in `outcome_constraints`." ] }, { "cell_type": "code", "execution_count": 4, "metadata": { "collapsed": true }, "outputs": [], "source": [ "import numpy as np\n", "def evaluate(parameters):\n", " x = np.array([parameters.get(f\"x{i+1}\") for i in range(6)])\n", " # In our case, standard error is 0, since we are computing a synthetic function.\n", " return {\"hartmann6\": (hartmann6(x), 0.0), \"l2norm\": (np.sqrt((x ** 2).sum()), 0.0)}" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Result of the evaluation should generally be a mapping of the format: `{metric_name -> (mean, SEM)}`. If there is only one metric in the experiment – the objective – then evaluation function can return a single tuple of mean and SEM, in which case Ax will assume that evaluation corresponds to the objective. _It can also return only the mean as a float, in which case Ax will treat SEM as unknown and use a model that can infer it._ \n", "\n", "For more details on evaluation function, refer to the \"Trial Evaluation\" section in the Ax docs at [ax.dev](https://ax.dev/)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 4. Run optimization loop\n", "With the experiment set up, we can start the optimization loop.\n", "\n", "At each step, the user queries the client for a new trial then submits the evaluation of that trial back to the client.\n", "\n", "Note that Ax auto-selects an appropriate optimization algorithm based on the search space. For more advance use cases that require a specific optimization algorithm, pass a `generation_strategy` argument into the `AxClient` constructor. Note that when Bayesian Optimization is used, generating new trials may take a few minutes." ] }, { "cell_type": "code", "execution_count": 5, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:23] ax.service.ax_client: Generated new trial 0 with parameters {'x1': 0.390009, 'x2': 0.484777, 'x3': 0.620187, 'x4': 0.372901, 'x5': 0.968942, 'x6': 0.270128}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:23] ax.service.ax_client: Completed trial 0 with data: {'hartmann6': (-0.357682, 0.0), 'l2norm': (1.386586, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:23] ax.service.ax_client: Generated new trial 1 with parameters {'x1': 0.68776, 'x2': 0.615438, 'x3': 0.689196, 'x4': 0.417482, 'x5': 0.915375, 'x6': 0.676682}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:23] ax.service.ax_client: Completed trial 1 with data: {'hartmann6': (-0.012338, 0.0), 'l2norm': (1.672384, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:24] ax.service.ax_client: Generated new trial 2 with parameters {'x1': 0.95764, 'x2': 0.167751, 'x3': 0.496014, 'x4': 0.642918, 'x5': 0.30651, 'x6': 0.92583}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:24] ax.service.ax_client: Completed trial 2 with data: {'hartmann6': (-0.161943, 0.0), 'l2norm': (1.598655, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:24] ax.service.ax_client: Generated new trial 3 with parameters {'x1': 0.092678, 'x2': 0.332059, 'x3': 0.058578, 'x4': 0.047174, 'x5': 0.010761, 'x6': 0.887374}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:24] ax.service.ax_client: Completed trial 3 with data: {'hartmann6': (-0.189115, 0.0), 'l2norm': (0.955017, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:24] ax.service.ax_client: Generated new trial 4 with parameters {'x1': 0.26073, 'x2': 0.286949, 'x3': 0.275763, 'x4': 0.888628, 'x5': 0.232173, 'x6': 0.882619}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:24] ax.service.ax_client: Completed trial 4 with data: {'hartmann6': (-0.054838, 0.0), 'l2norm': (1.35976, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:24] ax.service.ax_client: Generated new trial 5 with parameters {'x1': 0.639662, 'x2': 0.842044, 'x3': 0.622089, 'x4': 0.520951, 'x5': 0.121692, 'x6': 0.388392}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:24] ax.service.ax_client: Completed trial 5 with data: {'hartmann6': (-0.270411, 0.0), 'l2norm': (1.393646, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:24] ax.service.ax_client: Generated new trial 6 with parameters {'x1': 0.994613, 'x2': 0.196109, 'x3': 0.520917, 'x4': 0.268871, 'x5': 0.039209, 'x6': 0.100654}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:24] ax.service.ax_client: Completed trial 6 with data: {'hartmann6': (-0.011885, 0.0), 'l2norm': (1.176022, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:24] ax.service.ax_client: Generated new trial 7 with parameters {'x1': 0.206567, 'x2': 0.986012, 'x3': 0.304217, 'x4': 0.470113, 'x5': 0.607818, 'x6': 0.098815}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:24] ax.service.ax_client: Completed trial 7 with data: {'hartmann6': (-1.238585, 0.0), 'l2norm': (1.306771, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:24] ax.service.ax_client: Generated new trial 8 with parameters {'x1': 0.357994, 'x2': 0.705235, 'x3': 0.162171, 'x4': 0.689849, 'x5': 0.276761, 'x6': 0.458443}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:24] ax.service.ax_client: Completed trial 8 with data: {'hartmann6': (-0.299425, 0.0), 'l2norm': (1.189316, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:24] ax.service.ax_client: Generated new trial 9 with parameters {'x1': 0.485334, 'x2': 0.337206, 'x3': 0.485432, 'x4': 0.916801, 'x5': 0.145307, 'x6': 0.881819}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:24] ax.service.ax_client: Completed trial 9 with data: {'hartmann6': (-0.138516, 0.0), 'l2norm': (1.491356, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:24] ax.service.ax_client: Generated new trial 10 with parameters {'x1': 0.006479, 'x2': 0.599803, 'x3': 0.508827, 'x4': 0.141854, 'x5': 0.236467, 'x6': 0.164607}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:24] ax.service.ax_client: Completed trial 10 with data: {'hartmann6': (-0.192243, 0.0), 'l2norm': (0.849615, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:24] ax.service.ax_client: Generated new trial 11 with parameters {'x1': 0.459401, 'x2': 0.898029, 'x3': 0.99714, 'x4': 0.650145, 'x5': 0.22863, 'x6': 0.988373}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:24] ax.service.ax_client: Completed trial 11 with data: {'hartmann6': (-0.080694, 0.0), 'l2norm': (1.861085, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:30] ax.service.ax_client: Generated new trial 12 with parameters {'x1': 0.148654, 'x2': 0.890722, 'x3': 0.322065, 'x4': 0.396069, 'x5': 0.512522, 'x6': 0.110999}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:30] ax.service.ax_client: Completed trial 12 with data: {'hartmann6': (-0.709042, 0.0), 'l2norm': (1.162359, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:36] ax.service.ax_client: Generated new trial 13 with parameters {'x1': 0.173257, 'x2': 0.938148, 'x3': 0.315384, 'x4': 0.421139, 'x5': 0.551775, 'x6': 0.104992}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:36] ax.service.ax_client: Completed trial 13 with data: {'hartmann6': (-0.913483, 0.0), 'l2norm': (1.225742, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:42] ax.service.ax_client: Generated new trial 14 with parameters {'x1': 0.156095, 'x2': 0.903943, 'x3': 0.303977, 'x4': 0.495681, 'x5': 0.558742, 'x6': 0.109725}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:42] ax.service.ax_client: Completed trial 14 with data: {'hartmann6': (-0.952027, 0.0), 'l2norm': (1.2263, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:48] ax.service.ax_client: Generated new trial 15 with parameters {'x1': 0.138462, 'x2': 0.887222, 'x3': 0.315214, 'x4': 0.440501, 'x5': 0.631318, 'x6': 0.101687}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:48] ax.service.ax_client: Completed trial 15 with data: {'hartmann6': (-0.73597, 0.0), 'l2norm': (1.228267, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:55] ax.service.ax_client: Generated new trial 16 with parameters {'x1': 0.213419, 'x2': 0.931309, 'x3': 0.302199, 'x4': 0.493319, 'x5': 0.476509, 'x6': 0.119136}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:20:55] ax.service.ax_client: Completed trial 16 with data: {'hartmann6': (-1.413892, 0.0), 'l2norm': (1.220175, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:01] ax.service.ax_client: Generated new trial 17 with parameters {'x1': 0.23707, 'x2': 0.931752, 'x3': 0.29827, 'x4': 0.526668, 'x5': 0.457952, 'x6': 0.121935}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:01] ax.service.ax_client: Completed trial 17 with data: {'hartmann6': (-1.691203, 0.0), 'l2norm': (1.230974, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:08] ax.service.ax_client: Generated new trial 18 with parameters {'x1': 0.277411, 'x2': 0.909669, 'x3': 0.289103, 'x4': 0.577296, 'x5': 0.408704, 'x6': 0.122599}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:08] ax.service.ax_client: Completed trial 18 with data: {'hartmann6': (-2.144523, 0.0), 'l2norm': (1.226122, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:15] ax.service.ax_client: Generated new trial 19 with parameters {'x1': 0.330297, 'x2': 0.877442, 'x3': 0.27184, 'x4': 0.634409, 'x5': 0.351309, 'x6': 0.110301}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:15] ax.service.ax_client: Completed trial 19 with data: {'hartmann6': (-2.561152, 0.0), 'l2norm': (1.221047, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:21] ax.service.ax_client: Generated new trial 20 with parameters {'x1': 0.373742, 'x2': 0.86826, 'x3': 0.257991, 'x4': 0.670804, 'x5': 0.327703, 'x6': 0.0954}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:21] ax.service.ax_client: Completed trial 20 with data: {'hartmann6': (-2.679002, 0.0), 'l2norm': (1.235551, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:28] ax.service.ax_client: Generated new trial 21 with parameters {'x1': 0.380542, 'x2': 0.867854, 'x3': 0.183501, 'x4': 0.637279, 'x5': 0.294266, 'x6': 0.102488}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:28] ax.service.ax_client: Completed trial 21 with data: {'hartmann6': (-2.80175, 0.0), 'l2norm': (1.197863, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:34] ax.service.ax_client: Generated new trial 22 with parameters {'x1': 0.379637, 'x2': 0.900776, 'x3': 0.133906, 'x4': 0.683591, 'x5': 0.28126, 'x6': 0.118635}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:34] ax.service.ax_client: Completed trial 22 with data: {'hartmann6': (-2.489526, 0.0), 'l2norm': (1.238519, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:40] ax.service.ax_client: Generated new trial 23 with parameters {'x1': 0.3988, 'x2': 0.863998, 'x3': 0.204404, 'x4': 0.557786, 'x5': 0.329601, 'x6': 0.089002}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:40] ax.service.ax_client: Completed trial 23 with data: {'hartmann6': (-2.999863, 0.0), 'l2norm': (1.172603, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:45] ax.service.ax_client: Generated new trial 24 with parameters {'x1': 0.414158, 'x2': 0.810508, 'x3': 0.191155, 'x4': 0.530853, 'x5': 0.300015, 'x6': 0.048709}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:45] ax.service.ax_client: Completed trial 24 with data: {'hartmann6': (-2.937605, 0.0), 'l2norm': (1.113183, 0.0)}.\n" ] } ], "source": [ "for i in range(25):\n", " parameters, trial_index = ax_client.get_next_trial()\n", " # Local evaluation here can be replaced with deployment to external system.\n", " ax_client.complete_trial(trial_index=trial_index, raw_data=evaluate(parameters))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How many trials can run in parallel?\n", "By default, Ax restricts number of trials that can run in parallel for some optimization stages, in order to improve the optimization performance and reduce the number of trials that the optimization will require. To check the maximum parallelism for each optimization stage:" ] }, { "cell_type": "code", "execution_count": 6, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "[(12, 12), (-1, 3)]" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The output of this function is a list of tuples of form (number of trials, max parallelism), so the example above means \"the max parallelism is 12 for the first 12 trials and 3 for all subsequent trials.\" This is because the first 12 trials are produced quasi-randomly and can all be evaluated at once, and subsequent trials are produced via Bayesian optimization, which converges on optimal point in fewer trials when parallelism is limited. `MaxParallelismReachedException` indicates that the parallelism limit has been reached –– refer to the 'Service API Exceptions Meaning and Handling' section at the end of the tutorial for handling." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How to view all existing trials during optimization?" ] }, { "cell_type": "code", "execution_count": 7, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:45] ax.modelbridge.generation_strategy: Note that parameter values in dataframe are rounded to 2 decimal points; the values in the dataframe are thus not the exact ones suggested by Ax in trials.\n" ] }, { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
Generation StepGeneration ModelTrial IndexTrial StatusArm Parameterizations
00Sobol0COMPLETED{'0_0': {'x1': 0.39, 'x2': 0.48, 'x3': 0.62, '...
10Sobol1COMPLETED{'1_0': {'x1': 0.69, 'x2': 0.62, 'x3': 0.69, '...
20Sobol2COMPLETED{'2_0': {'x1': 0.96, 'x2': 0.17, 'x3': 0.5, 'x...
30Sobol3COMPLETED{'3_0': {'x1': 0.09, 'x2': 0.33, 'x3': 0.06, '...
40Sobol4COMPLETED{'4_0': {'x1': 0.26, 'x2': 0.29, 'x3': 0.28, '...
50Sobol5COMPLETED{'5_0': {'x1': 0.64, 'x2': 0.84, 'x3': 0.62, '...
60Sobol6COMPLETED{'6_0': {'x1': 0.99, 'x2': 0.2, 'x3': 0.52, 'x...
70Sobol7COMPLETED{'7_0': {'x1': 0.21, 'x2': 0.99, 'x3': 0.3, 'x...
80Sobol8COMPLETED{'8_0': {'x1': 0.36, 'x2': 0.71, 'x3': 0.16, '...
90Sobol9COMPLETED{'9_0': {'x1': 0.49, 'x2': 0.34, 'x3': 0.49, '...
100Sobol10COMPLETED{'10_0': {'x1': 0.01, 'x2': 0.6, 'x3': 0.51, '...
110Sobol11COMPLETED{'11_0': {'x1': 0.46, 'x2': 0.9, 'x3': 1.0, 'x...
121GPEI12COMPLETED{'12_0': {'x1': 0.15, 'x2': 0.89, 'x3': 0.32, ...
131GPEI13COMPLETED{'13_0': {'x1': 0.17, 'x2': 0.94, 'x3': 0.32, ...
141GPEI14COMPLETED{'14_0': {'x1': 0.16, 'x2': 0.9, 'x3': 0.3, 'x...
151GPEI15COMPLETED{'15_0': {'x1': 0.14, 'x2': 0.89, 'x3': 0.32, ...
161GPEI16COMPLETED{'16_0': {'x1': 0.21, 'x2': 0.93, 'x3': 0.3, '...
171GPEI17COMPLETED{'17_0': {'x1': 0.24, 'x2': 0.93, 'x3': 0.3, '...
181GPEI18COMPLETED{'18_0': {'x1': 0.28, 'x2': 0.91, 'x3': 0.29, ...
191GPEI19COMPLETED{'19_0': {'x1': 0.33, 'x2': 0.88, 'x3': 0.27, ...
201GPEI20COMPLETED{'20_0': {'x1': 0.37, 'x2': 0.87, 'x3': 0.26, ...
211GPEI21COMPLETED{'21_0': {'x1': 0.38, 'x2': 0.87, 'x3': 0.18, ...
221GPEI22COMPLETED{'22_0': {'x1': 0.38, 'x2': 0.9, 'x3': 0.13, '...
231GPEI23COMPLETED{'23_0': {'x1': 0.4, 'x2': 0.86, 'x3': 0.2, 'x...
241GPEI24COMPLETED{'24_0': {'x1': 0.41, 'x2': 0.81, 'x3': 0.19, ...
\n", "
" ], "text/plain": [ " Generation Step Generation Model Trial Index Trial Status \\\n", "0 0 Sobol 0 COMPLETED \n", "1 0 Sobol 1 COMPLETED \n", "2 0 Sobol 2 COMPLETED \n", "3 0 Sobol 3 COMPLETED \n", "4 0 Sobol 4 COMPLETED \n", "5 0 Sobol 5 COMPLETED \n", "6 0 Sobol 6 COMPLETED \n", "7 0 Sobol 7 COMPLETED \n", "8 0 Sobol 8 COMPLETED \n", "9 0 Sobol 9 COMPLETED \n", "10 0 Sobol 10 COMPLETED \n", "11 0 Sobol 11 COMPLETED \n", "12 1 GPEI 12 COMPLETED \n", "13 1 GPEI 13 COMPLETED \n", "14 1 GPEI 14 COMPLETED \n", "15 1 GPEI 15 COMPLETED \n", "16 1 GPEI 16 COMPLETED \n", "17 1 GPEI 17 COMPLETED \n", "18 1 GPEI 18 COMPLETED \n", "19 1 GPEI 19 COMPLETED \n", "20 1 GPEI 20 COMPLETED \n", "21 1 GPEI 21 COMPLETED \n", "22 1 GPEI 22 COMPLETED \n", "23 1 GPEI 23 COMPLETED \n", "24 1 GPEI 24 COMPLETED \n", "\n", " Arm Parameterizations \n", "0 {'0_0': {'x1': 0.39, 'x2': 0.48, 'x3': 0.62, '... \n", "1 {'1_0': {'x1': 0.69, 'x2': 0.62, 'x3': 0.69, '... \n", "2 {'2_0': {'x1': 0.96, 'x2': 0.17, 'x3': 0.5, 'x... \n", "3 {'3_0': {'x1': 0.09, 'x2': 0.33, 'x3': 0.06, '... \n", "4 {'4_0': {'x1': 0.26, 'x2': 0.29, 'x3': 0.28, '... \n", "5 {'5_0': {'x1': 0.64, 'x2': 0.84, 'x3': 0.62, '... \n", "6 {'6_0': {'x1': 0.99, 'x2': 0.2, 'x3': 0.52, 'x... \n", "7 {'7_0': {'x1': 0.21, 'x2': 0.99, 'x3': 0.3, 'x... \n", "8 {'8_0': {'x1': 0.36, 'x2': 0.71, 'x3': 0.16, '... \n", "9 {'9_0': {'x1': 0.49, 'x2': 0.34, 'x3': 0.49, '... \n", "10 {'10_0': {'x1': 0.01, 'x2': 0.6, 'x3': 0.51, '... \n", "11 {'11_0': {'x1': 0.46, 'x2': 0.9, 'x3': 1.0, 'x... \n", "12 {'12_0': {'x1': 0.15, 'x2': 0.89, 'x3': 0.32, ... \n", "13 {'13_0': {'x1': 0.17, 'x2': 0.94, 'x3': 0.32, ... \n", "14 {'14_0': {'x1': 0.16, 'x2': 0.9, 'x3': 0.3, 'x... \n", "15 {'15_0': {'x1': 0.14, 'x2': 0.89, 'x3': 0.32, ... \n", "16 {'16_0': {'x1': 0.21, 'x2': 0.93, 'x3': 0.3, '... \n", "17 {'17_0': {'x1': 0.24, 'x2': 0.93, 'x3': 0.3, '... \n", "18 {'18_0': {'x1': 0.28, 'x2': 0.91, 'x3': 0.29, ... \n", "19 {'19_0': {'x1': 0.33, 'x2': 0.88, 'x3': 0.27, ... \n", "20 {'20_0': {'x1': 0.37, 'x2': 0.87, 'x3': 0.26, ... \n", "21 {'21_0': {'x1': 0.38, 'x2': 0.87, 'x3': 0.18, ... \n", "22 {'22_0': {'x1': 0.38, 'x2': 0.9, 'x3': 0.13, '... \n", "23 {'23_0': {'x1': 0.4, 'x2': 0.86, 'x3': 0.2, 'x... \n", "24 {'24_0': {'x1': 0.41, 'x2': 0.81, 'x3': 0.19, ... " ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.generation_strategy.trials_as_df" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 5. Retrieve best parameters\n", "\n", "Once it's complete, we can access the best parameters found, as well as the corresponding metric values." ] }, { "cell_type": "code", "execution_count": 8, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "{'x1': 0.398799983715681,\n", " 'x2': 0.8639979152227888,\n", " 'x3': 0.20440419827708106,\n", " 'x4': 0.5577861302848721,\n", " 'x5': 0.32960121633237277,\n", " 'x6': 0.08900174955572689}" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "best_parameters, values = ax_client.get_best_parameters()\n", "best_parameters" ] }, { "cell_type": "code", "execution_count": 9, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "{'l2norm': 1.1726023636499632, 'hartmann6': -2.999851331444785}" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "means, covariances = values\n", "means " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "For comparison, Hartmann6 minimum:" ] }, { "cell_type": "code", "execution_count": 10, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "-3.32237" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "hartmann6.fmin" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 6. Plot the response surface and optimization trace\n", "Here we arbitrarily select \"x1\" and \"x2\" as the two parameters to plot for both metrics, \"hartmann6\" and \"l2norm\"." ] }, { "cell_type": "code", "execution_count": 11, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:45] ax.service.ax_client: Retrieving contour plot with parameter 'x1' on X-axis and 'x2' on Y-axis, for metric 'hartmann6'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ -0.2966426747249179, -0.3037569931570969, -0.3116869635223909, -0.3203984365801491, -0.32983772803752043, -0.3399308572080797, -0.3505834068078889, -0.36168108153375356, -0.3730910118095304, -0.38466381111089365, -0.3962363532875347, -0.40763519367945744, -0.41868051825482144, -0.4291904719971238, -0.43898569422723654, -0.4478938763463606, -0.4557541573010506, -0.46242118335018345, -0.46776867986679926, -0.47169241163645514, -0.47411244179745005, -0.47497463562027176, -0.4742513914445582, -0.4719416153888819, -0.4680699874344313, -0.4626855930023638, -0.4558600152868907, -0.44768499865829514, -0.43826980190319753, -0.42773836167698354, -0.41622638140233037, -0.4038784494646146, -0.39084527387165213, -0.37728109990835623, -0.3633413543935119, -0.34918053679713557, -0.3349503556089174, -0.32079808975721846, -0.30686514110423524, -0.2932857362391853, -0.28018573461184704, -0.2676815055562053, -0.25587884835248287, -0.2448719458813936, -0.2347423616941019, -0.22555810997159986, -0.21737284508414068, -0.21022522952907363, -0.20413854364099848, -0.19912059626986967 ], [ -0.2952366839447327, -0.3027032900094183, -0.3110423227141541, -0.3202194016650367, -0.3301792216539463, -0.3408446714637552, -0.3521166243912588, -0.363874488620646, -0.375977571314129, -0.3882672682750664, -0.4005700443012882, -0.4127011217119845, -0.4244687501976523, -0.4356788941334695, -0.44614014712298744, -0.4556686699586795, -0.46409294815396174, -0.4712581780592453, -0.477030114470016, -0.48129824491082573, -0.4839781934318317, -0.48501329685066286, -0.4843753363404455, -0.48206444502372947, -0.4781082461779407, -0.4725603055649199, -0.46549800430839916, -0.45701995490854697, -0.44724309186636635, -0.43629956974007056, -0.4243335953948786, -0.4114983083135588, -0.3979528041648639, -0.3838593738803099, -0.36938100511081307, -0.35467916716749825, -0.33991187647261034, -0.32523201909631483, -0.3107858917784909, -0.29671191414579257, -0.28313946330487316, -0.2701877876619354, -0.25796496903126376, -0.24656691947576914, -0.23607641981053207, -0.22656222767380851, -0.21807830158455954, -0.21066320055597698, -0.20433972420887625, -0.19911485447888166 ], [ -0.293723057118197, -0.3015519482274588, -0.31031318086876947, -0.31997228895659346, -0.3304724079337469, -0.3417332591993264, -0.35365086033701476, -0.3660980610759902, -0.3789259673969314, -0.3919662697518883, -0.40503443936916117, -0.41793370339269176, -0.4304596599405687, -0.4424053526643882, -0.453566594846709, -0.4637473179580107, -0.4727647197565894, -0.4804540016696538, -0.48667251218293595, -0.491303149218265, -0.4942569165518035, -0.49547457389382477, -0.4949273644406612, -0.49261684523711724, -0.48857388282921155, -0.4828569081489269, -0.47554954935361105, -0.46675777865748935, -0.45660671847999623, -0.44523725323923236, -0.43280258599567967, -0.419464864559311, -0.4053919807994171, -0.39075462141181216, -0.3757236203420877, -0.3604676346807484, -0.3451511393972537, -0.3299327138562086, -0.3149635764122326, -0.3003863137826601, -0.2863337500297094, -0.2729279058509225, -0.260279011751509, -0.24848455707841355, -0.23762837864872344, -0.22777981504128886, -0.21899297244640215, -0.2113061622337522, -0.2047415765682402, -0.19930526494651157 ], [ -0.2920965110025936, -0.3002973391407566, -0.3094936549515631, -0.31965107067438425, -0.3307112395489432, -0.3425906899406247, -0.35518044299107154, -0.3683465269816557, -0.38193146056623983, -0.3957567257245028, -0.4096261934657638, -0.42333040586740744, -0.4366515624056657, -0.44936901199927737, -0.461265019092146, -0.47213055527867154, -0.4817708683806322, -0.4900105975831588, -0.496698233714957, -0.5017097644655422, -0.5049513913250494, -0.5063612545413078, -0.5059101512052459, -0.5036012771990737, -0.4994690643259151, -0.4935772181267297, -0.486016088639723, -0.4768995248510721, -0.46636137323818483, -0.45455178136114394, -0.44163345911125507, -0.42777803372820855, -0.413162611383147, -0.3979666298551743, -0.38236905585926584, -0.36654594937661256, -0.3506683883536045, -0.3349007226231283, -0.31939910772231284, -0.3043102587593739, -0.28977036229844944, -0.27590409034248764, -0.2628236740886233, -0.25062801461916406, -0.23940183075761878, -0.22921486805648528, -0.22012121405079899, -0.21215878031928037, -0.2053490188917252, -0.19969693752150608 ], [ -0.2903518902512605, -0.2989338953330004, -0.3085778490850454, -0.3192496257295222, -0.33088949031173964, -0.3434107651096928, -0.3566993410643666, -0.37061416228667865, -0.384988766885613, -0.399633910733302, -0.41434123652018595, -0.42888788407936573, -0.44304187567062203, -0.45656805774020837, -0.46923434360593874, -0.48081798279911525, -0.4911115835018707, -0.49992863354098105, -0.5071082998093428, -0.5125193316832799, -0.5160629464682357, -0.5176746298672825, -0.5173248383469868, -0.5150186403413612, -0.510794377518723, -0.5047214644218264, -0.49689747360449377, -0.48744467308052075, -0.47650619286629636, -0.46424199738295713, -0.4508248307320952, -0.4364362832273726, -0.42126310155146296, -0.4054938335870142, -0.38931586483462366, -0.3729128690810213, -0.35646266428861173, -0.34013543796166046, -0.32409228647456156, -0.3084840013957588, -0.29345003337398534, -0.2791175705664055, -0.2656006829689621, -0.25299950464369225, -0.24139945026901788, -0.23087048761443507, -0.22146651007577023, -0.21322486997997814, -0.20616614122095456, -0.20029417724703602 ], [ -0.2884842277984835, -0.29745616835171784, -0.3075599080194008, -0.3187617873255313, -0.3310007952616931, -0.3441870489967167, -0.35820118398644507, -0.3728947991902082, -0.38809205323124296, -0.4035924448892314, -0.419174739934291, -0.4346019322324658, -0.4496270573238689, -0.4639996181919066, -0.47747234143306794, -0.4898079612150771, -0.5007857294895194, -0.5102073725886674, -0.5179022531769585, -0.5237315478087808, -0.5275913088888012, -0.5294143408042523, -0.5291708794122328, -0.5268681189412276, -0.522548678616071, -0.5162881414735832, -0.5081918288013674, -0.49839099453320457, -0.4870386341453946, -0.47430510187277575, -0.46037371870284327, -0.44543653258868643, -0.42969036333001276, -0.4133332299139757, -0.3965612205383161, -0.37956582801688643, -0.36253173869303135, -0.34563503395345896, -0.329041742024215, -0.31290666535223477, -0.29737240617173033, -0.2825685196395721, -0.26861073916862754, -0.2556002404387556, -0.24362293641603183, -0.23274882236062344, -0.22303141372822954, -0.21450733762521013, -0.20719614720919144, -0.20110042640478032 ], [ -0.2864888113742676, -0.2958588929832937, -0.30643407747930573, -0.31818139759405994, -0.3310386977708577, -0.34491290654166296, -0.35967928866176946, -0.375181840324031, -0.39123493756237326, -0.40762627915310434, -0.4241210860915007, -0.44046743708069014, -0.45640254143808356, -0.4716596852873661, -0.4859755404298307, -0.4990975021342672, -0.5107907236164602, -0.5208445396427506, -0.5290780155221263, -0.5353444152780044, -0.5395344480860679, -0.5415782196567198, -0.5414458806915686, -0.5391470246157004, -0.5347289392772275, -0.5282738607081661, -0.5198954102395829, -0.509734418368759, -0.4979543491466596, -0.48473653725674715, -0.4702754367606976, -0.45477405680754523, -0.43843972733020886, -0.42148029945442056, -0.4041008440591315, -0.3865008708935258, -0.36887205301887693, -0.3513964098825819, -0.3342448792361097, -0.31757619482011124, -0.3015359838580003, -0.28625600564039955, -0.2718534686810944, -0.25843038707087496, -0.24607296398446266, -0.23485101845584788, -0.22481749687020813, -0.21600812957015947, -0.20844130260351879, -0.2021182131727043 ], [ -0.2843612561571742, -0.29413705819144953, -0.30519477157915076, -0.3175023695519186, -0.33099670404415527, -0.34558154838631616, -0.36112669316236623, -0.37746827932838645, -0.3944104948447218, -0.41172868535339646, -0.42917384154879057, -0.4464783337469078, -0.4633626768694107, -0.4795430356381948, -0.4947391277564741, -0.5086821571127221, -0.5211224111260717, -0.5318361844201247, -0.5406317404567172, -0.5473540872677092, -0.5518884162057079, -0.5541621275054908, -0.5541454384740467, -0.5518506358001747, -0.5473300904827374, -0.5406732006922218, -0.5320024633824537, -0.5214688987575792, -0.5092470621231608, -0.49552987499654744, -0.4805234920695627, -0.4644423939764988, -0.44750485994197464, -0.4299289321189669, -0.4119289381274971, -0.3937125935106214, -0.3754786649429732, -0.35741514102995375, -0.3396978327210678, -0.3224893111907978, -0.3059380880555055, -0.2901779505912149, -0.2753273818708246, -0.2614890202676019, -0.2487491416409766, -0.237177177226782, -0.22682530701017467, -0.21772818851007192, -0.20990289144430752, -0.20334910786545357 ], [ -0.28209758346777536, -0.29228598471616896, -0.3038366474052686, -0.31671875658287363, -0.33086834532240783, -0.3461860836031696, -0.36253619785372804, -0.3797467283971526, -0.3976112692692114, -0.4158922516379283, -0.43432573464836466, -0.45262756483894573, -0.4705006676752105, -0.48764315252460244, -0.503756854187458, -0.5185559054978812, -0.5317749382544152, -0.5431765416704639, -0.5525576632925201, -0.5597547096345792, -0.5646471848561438, -0.5671597886749655, -0.5672629738798609, -0.5649720355034868, -0.5603448655231904, -0.5534785573471233, -0.5445050822043909, -0.5335862839892886, -0.520908449457428, -0.5066767067510984, -0.4911094875851094, -0.47443325849898377, -0.4568776867504223, -0.4386713598533625, -0.42003812813959285, -0.40119409091301417, -0.3823452024554759, -0.3636854375060361, -0.34539542927714906, -0.32764147806262756, -0.31057482549521587, -0.29433109797838797, -0.2790298412415483, -0.26477409397549667, -0.2516499789817209, -0.23972632155671536, -0.22905433302337042, -0.2196674186743406, -0.21158118085094624, -0.20479368761821715 ], [ -0.27969430528075423, -0.29030140920865866, -0.30235468674894905, -0.31582482954300484, -0.33064724800432055, -0.3467195804330122, -0.36390041439536114, -0.382009453334077, -0.40082929339659157, -0.42010888406689906, -0.4395686383220232, -0.45890704369208213, -0.47780851652919276, -0.49595214975049984, -0.5130209392116287, -0.5287110421006608, -0.5427406242850582, -0.5548578898497822, -0.5648479489161526, -0.5725382608254708, -0.5778024800319597, -0.5805626236772317, -0.5807895667478098, -0.57850194886872, -0.5737636436750508, -0.5666799958159989, -0.5573930709042658, -0.5460761892352741, -0.5329280242168516, -0.5181665410252757, -0.5020230306895848, -0.4847364612463799, -0.466548323456384, -0.4476980973363285, -0.4284194114880776, -0.4089369141184436, -0.38946382671905067, -0.37020011200043657, -0.35133115935877923, -0.33302687536467723, -0.31544106386252957, -0.29871098953812536, -0.28295703853709075, -0.26828241731053293, -0.2547728630203001, -0.24249637174129557, -0.23150298033194128, -0.22182466039468607, -0.21347539512703373, -0.2064515102401585 ], [ -0.27714851418956166, -0.28817957463504484, -0.300744284836298, -0.31481516146000543, -0.3303272117886281, -0.34717513526511423, -0.3652118229799194, -0.3842484166075545, -0.40405611482998904, -0.4243698150533649, -0.4448935588881646, -0.4653076226229882, -0.4852769720977481, -0.5044606984029396, -0.5225219780365106, -0.5391380658874401, -0.5540098339071815, -0.5668704095886569, -0.5774925391847789, -0.5856943912813024, -0.5913436167473606, -0.5943595823088416, -0.5947137903148563, -0.5924285823229192, -0.5875742963741959, -0.5802651058006729, -0.5706538100766606, -0.5589258747291903, -0.5452930270222202, -0.5299867069337942, -0.5132516496321555, -0.4953398380905605, -0.4765050156223982, -0.4569978918410167, -0.43706211629697556, -0.41693103641050455, -0.3968252045946933, -0.3769505572596482, -0.3574971583132701, -0.3386383832793499, -0.32053041747555244, -0.3033119519145857, -0.28710398176159646, -0.27200964147714957, -0.2581140446874566, -0.24548413138192693, -0.23416855611934484, -0.22419767466299068, -0.2155836997588867, -0.2083210978053044 ], [ -0.2744579782931177, -0.28591732651599855, -0.2990013457389299, -0.3136847196427549, -0.3299022957964567, -0.3475459499701844, -0.36646283807278524, -0.38645532881480715, -0.4072828309690203, -0.42866561933956426, -0.4502906316559687, -0.47181906712814436, -0.49289548142304784, -0.5131579576704707, -0.5322488517588201, -0.5498255710616887, -0.5655708513549011, -0.5792020435408352, -0.5904790015337115, -0.5992102641253465, -0.6052573352604869, -0.6085369788573411, -0.6090215487029511, -0.606737466367473, -0.6017620379509009, -0.5942188624182785, -0.5842721293503641, -0.5721201313089639, -0.5579883250841846, -0.5421222668266861, -0.5247807193975267, -0.5062291883005678, -0.4867340885932794, -0.4665576834693328, -0.4459538706342072, -0.42516483014262196, -0.4044184916636444, -0.38392673401972477, -0.3638841980240135, -0.3444675765310736, -0.32583524330620384, -0.30812709365867696, -0.29146449255763396, -0.27595025707502085, -0.2616686357501893, -0.24868528371873644, -0.23704726497837292, -0.22678313807652373, -0.2179031957027161, -0.21039993037164562 ], [ -0.27162124028964274, -0.2835122143810892, -0.2971223839618694, -0.3124289648362628, -0.3293669124645059, -0.3478254175442278, -0.36764588278448174, -0.3886217088638816, -0.41050013232782856, -0.4329862381604841, -0.4557491241509488, -0.47843003699741105, -0.5006521484349017, -0.5220315109898073, -0.5421886421154888, -0.5607601420924009, -0.5774097580251396, -0.59183835944523, -0.6037923807567518, -0.613070399212782, -0.6195276410649517, -0.6230783316721273, -0.6236959195205323, -0.6214113043405031, -0.6163092832507373, -0.6085234948634068, -0.5982301887106324, -0.5856411754391042, -0.5709963214038077, -0.5545559396298823, -0.5365933986989843, -0.5173882243331686, -0.4972199089513646, -0.4763625769515487, -0.45508058323346345, -0.433625054934875, -0.41223132649133576, -0.3911171700199436, -0.3704816894836701, -0.3505047294790422, -0.3313466477133902, -0.3131483128835093, -0.29603121421858747, -0.28009760204187206, -0.2654306163797553, -0.2520943986206874, -0.24013421520322853, -0.22957664837676328, -0.22042992416367047, -0.2126844500286167 ], [ -0.2686377198588218, -0.2809625976054537, -0.2951046314918646, -0.3110439568476545, -0.3287159288005347, -0.3480072158389592, -0.3687534718487804, -0.3907389530511747, -0.413698354802442, -0.43732101218679986, -0.4612574477576339, -0.4851280753379231, -0.5085336997815552, -0.5310673089020717, -0.5523265523836146, -0.5719262544402244, -0.5895103155008833, -0.6047624184942859, -0.6174150562043856, -0.6272565229194401, -0.6341356511347205, -0.6379642096643724, -0.6387170041882048, -0.6364298297689006, -0.6311955147291366, -0.6231583653963315, -0.6125073709233777, -0.599468555997769, -0.5842968762619669, -0.5672680368458465, -0.548670579847569, -0.5287985345689535, -0.5079448588576005, -0.48639582616719856, -0.46442643669632033, -0.4422968580635003, -0.4202498367789149, -0.39850897060725754, -0.37727769669060274, -0.35673883230973535, -0.3370545041045234, -0.31836631572975715, -0.30079563044007074, -0.28444388030096934, -0.26939285341136665, -0.25570495025793216, -0.2434234357393853, -0.2325727405887964, -0.22315888187027044, -0.21517007527524024 ], [ -0.2655078181919027, -0.2782677545635084, -0.2929461493506953, -0.30952646583116294, -0.3279447743628874, -0.348085408940214, -0.3697783029880026, -0.3927984130505995, -0.41686754114708346, -0.44165872375485626, -0.46680317853574627, -0.49189960651183484, -0.5165254592271091, -0.5402496201061966, -0.5626458361511657, -0.5833061829295603, -0.6018538561432708, -0.6179546513713774, -0.6313266069399699, -0.6417474263596947, -0.6490594492282313, -0.6531720886186516, -0.6540617889048951, -0.6517696752146837, -0.6463971618673887, -0.6380998614048073, -0.6270801876692056, -0.6135790752633407, -0.5978672432323324, -0.580236413229887, -0.5609908532825199, -0.54043956054492, -0.5188893245982924, -0.49663883248503804, -0.47397389406429125, -0.45116378774227595, -0.42845865793098037, -0.40608784131076836, -0.38425896211970334, -0.36315761847280215, -0.3429474815805066, -0.3237706456249353, -0.30574809473842046, -0.2889801909984542, -0.2735471291488002, -0.2595093452869305, -0.24690790360660952, -0.23576491356786256, -0.22608404664722392, -0.2178512255326469 ], [ -0.26223302329269205, -0.27542799378208316, -0.2906459424357224, -0.30787408815473283, -0.3270495550654152, -0.34805455550883957, -0.3707133562221324, -0.39479148263590835, -0.4199975117625392, -0.4459876487788723, -0.4723730879030451, -0.4987299439808547, -0.5246113319067968, -0.5495609922946358, -0.5731277358298925, -0.5948799199125663, -0.6144191836559605, -0.6313927445949274, -0.6455036876955711, -0.6565188350413277, -0.6642739533814728, -0.6686762205181773, -0.6697040194753401, -0.6674042558011445, -0.6618874960071492, -0.6533213034989523, -0.6419222021661279, -0.6279467266631904, -0.6116820220379096, -0.5934364342020273, -0.5735304885545768, -0.552288590206897, -0.5300317006002662, -0.5070711579378424, -0.4837037195479327, -0.4602078198756381, -0.43684096443547515, -0.41383812262205877, -0.39141094386666486, -0.36974760334456147, -0.34901308445373236, -0.3293497231491689, -0.3108778702874505, -0.29369656803362687, -0.2778841803804981, -0.26349896118822014, -0.2505795814170473, -0.2391456665646411, -0.2291984128948109, -0.22072135540200377 ], [ -0.2588160144244507, -0.2724447655068083, -0.28820407614665533, -0.3060853654801081, -0.32602717161947936, -0.3479098231194748, -0.37155200041971903, -0.3967096927292707, -0.4230779447100659, -0.4502956185979028, -0.4779531837882317, -0.5056033090178271, -0.5327737997579023, -0.55898222444212, -0.583751432923996, -0.6066251055650158, -0.6271824862643514, -0.6450515400825365, -0.6599199187709315, -0.6715432932824026, -0.679750799040592, -0.6844475193984849, -0.6856140935140131, -0.6833036708702481, -0.6776365439305216, -0.6687928727872667, -0.657003971203605, -0.6425426519455703, -0.6257131306248359, -0.6068409620664252, -0.5862634335282089, -0.5643207686471554, -0.5413484100918118, -0.5176705541402788, -0.49359501407516493, -0.46940939872547527, -0.44537851430414355, -0.42174283706283044, -0.3987178644053849, -0.3764941339402098, -0.35523770236220653, -0.3350908961506994, -0.3161731797523095, -0.2985820294100121, -0.28239374709549936, -0.26766419421599175, -0.2544294644277111, -0.2427065452375501, -0.23249403640038524, -0.22377299809855433 ], [ -0.25526076382383656, -0.26932077181593916, -0.2856217929974767, -0.3041599053754189, -0.32487544110834354, -0.347647107322985, -0.37228810609671525, -0.3985448141061625, -0.42609846464099266, -0.45457009183531083, -0.4835287627386593, -0.5125028611882164, -0.5409939294504402, -0.5684923522880627, -0.5944940121984861, -0.6185169728392648, -0.6401172653846221, -0.6589029511179848, -0.6745457933143838, -0.6867900670236728, -0.695458241593609, -0.7004534675415386, -0.7017589738144423, -0.699434627463736, -0.6936110237135729, -0.6844815606372907, -0.672293009618343, -0.657335120495695, -0.6399297988420385, -0.620420363083964, -0.599161333506602, -0.5765091277001397, -0.5528139434703885, -0.5284130077235206, -0.503625266173612, -0.47874749177754905, -0.4540517066610914, -0.4297837484580449, -0.4061627707342662, -0.38338144933209206, -0.36160667053970763, -0.340980499591376, -0.321621264536205, -0.30362463577134924, -0.28706463022305195, -0.2719945162532861, -0.2584476364008069, -0.2464381963745813, -0.2359620877428651, -0.22699781733009916 ], [ -0.25157263354997816, -0.2660600731314102, -0.2829016271020458, -0.30209850145012795, -0.32359321985065903, -0.3472631538216149, -0.37291616314681664, -0.40028896679085124, -0.4290487400748869, -0.458798236140887, -0.48908447331824845, -0.5194107414194746, -0.5492513941243964, -0.5780686488031627, -0.6053304420050818, -0.6305283097708743, -0.6531942828768844, -0.672915898159945, -0.6893486057043332, -0.7022250689600809, -0.7113610823472941, -0.7166580460922214, -0.7181021269149779, -0.7157603895249909, -0.709774306541216, -0.700351144335937, -0.6877537803040494, -0.6722895335305964, -0.6542985860840633, -0.6341425373729586, -0.6121935718793938, -0.5888246356393287, -0.5644009152887328, -0.5392728028979346, -0.5137704185317896, -0.4881996589207249, -0.4628396523946159, -0.4379414331631949, -0.4137276055217557, -0.3903927512706272, -0.36810433964552347, -0.3470039244498988, -0.3272084527062227, -0.30881155733924925, -0.2918847575737217, -0.27647853972146663, -0.26262333340097865, -0.250330430443807, -0.23959291340927413, -0.23038666674883201 ], [ -0.2477584650929303, -0.26266818869637654, -0.28004751410888595, -0.2999032506638617, -0.3221805253557388, -0.3467556817877181, -0.3734314018376359, -0.40193473485036113, -0.4319185881696157, -0.4629670194451839, -0.4946043909498268, -0.5263081283616194, -0.5575245101958544, -0.5876866414564511, -0.6162335731150377, -0.6426294419853175, -0.6663815301745007, -0.6870562681640977, -0.7042924050036525, -0.7178108101747371, -0.7274206222467894, -0.7330216944090384, -0.7346034910886636, -0.732240756873398, -0.7260864082781511, -0.7163621921206303, -0.7033477128527998, -0.6873684558649491, -0.6687834251694518, -0.6479729734919478, -0.6253273337437634, -0.6012362680479464, -0.5760801405874637, -0.5502226015648368, -0.5240049503926513, -0.49774213586407146, -0.47172025760594494, -0.4461953628213491, -0.4213932886978252, -0.39751028435016356, -0.37471415441162914, -0.3531456948723155, -0.33292023473231913, -0.31412914834189887, -0.2968412570360346, -0.2811040895715835, -0.2669450145396347, -0.25437229097466585, -0.24337610362731277, -0.2339296559926306 ], [ -0.24382665914128798, -0.25915218832207987, -0.27706489385571864, -0.29757766512327244, -0.3206386548127198, -0.3461235059850697, -0.3738299150379183, -0.4034752849434702, -0.43469808580796543, -0.4670633100838876, -0.5000721041429134, -0.5331753085961319, -0.5657902904194625, -0.5973201480950302, -0.6271741584708647, -0.6547882383716848, -0.6796442227481279, -0.7012869012887799, -0.7193379776741258, -0.733506382674281, -0.7435946478369215, -0.7495013026348633, -0.7512194781209228, -0.7488320780929294, -0.7425040146301671, -0.7324721010401154, -0.7190332538637223, -0.702531677833016, -0.6833456945813319, -0.6618748293821713, -0.6385276937508801, -0.6137111007240326, -0.5878207310839205, -0.5612335411808956, -0.5343019757218995, -0.507349931516316, -0.4806703194010128, -0.45452399805252797, -0.4291398087797762, -0.40471542491771917, -0.38141874023357303, -0.3593895526387386, -0.3387413460622243, -0.31956302791912616, -0.3019205359843732, -0.28585828129124846, -0.27140043858583607, -0.25855212968413965, -0.24730056583218651, -0.23761622224828594 ], [ -0.23978724271538832, -0.25552077246702654, -0.2739608027297642, -0.2951267753570379, -0.31897029720053816, -0.3453666549770935, -0.3741087792610076, -0.4049044866118324, -0.4373776854831435, -0.4710739848501502, -0.5054708118035622, -0.5399917610709536, -0.5740245142852135, -0.6069413332094062, -0.6381208962943632, -0.6669701429710491, -0.6929448234860762, -0.7155676090040323, -0.7344428638984157, -0.7492674773791588, -0.7598374540981653, -0.7660502420744142, -0.7679030132967067, -0.7654873014857466, -0.7589805436873651, -0.7486351710105053, -0.7347659518145138, -0.7177363097712559, -0.6979443209840974, -0.6758090411114068, -0.651757729179934, -0.6262144252254577, -0.5995902114751487, -0.5722753503362767, -0.544633356865446, -0.5169969388421027, -0.48966563338139824, -0.4629048923085811, -0.4369463230713375, -0.41198877779184284, -0.38819999671719685, -0.3657185479153393, -0.3446558554668747, -0.325098166410697, -0.30710836578288303, -0.2907276037954942, -0.27597674530247873, -0.26285768620436645, -0.2513546026308162, -0.24143520621593095 ], [ -0.2356519207236153, -0.2517843375125616, -0.2707439524708495, -0.2925572217634854, -0.31717963577060226, -0.3444864823426568, -0.37426617173138055, -0.4062170319236016, -0.43994833410742673, -0.4749860437099893, -0.5107834310497514, -0.5467362559262496, -0.5822018166803142, -0.6165207862757309, -0.6490404989671782, -0.679138236156015, -0.7062430986374065, -0.7298552277087151, -0.7495614119444571, -0.7650464421963741, -0.77609990883665, -0.782618437972624, -0.7846036179795135, -0.7821560681515911, -0.7754662495003163, -0.7648027182440835, -0.7504985791621496, -0.7329369112041557, -0.7125359136448202, -0.6897344605623897, -0.6649786589401594, -0.6387098873641929, -0.6113546558295302, -0.583316481743356, -0.554969833169598, -0.5266560584946132, -0.49868111200252785, -0.4713148049652479, -0.4447912657376005, -0.4193102797450353, -0.39503919709950197, -0.3721151351838434, -0.3506472580283444, -0.330718975883339, -0.3123899702277583, -0.2956980060345594, -0.28066054033602894, -0.26727617124147596, -0.2555259931022288, -0.245374931331085 ], [ -0.23143410890948357, -0.24795502295690552, -0.2674247919581344, -0.28987733067600274, -0.3152724373568725, -0.3434857674843489, -0.3743014803199677, -0.40740855170913093, -0.44240159250522215, -0.478786729577787, -0.5159927146576082, -0.5533869676288284, -0.5902957955574399, -0.6260276237347231, -0.6598977900206948, -0.6912533281400313, -0.7194962099532727, -0.7441037119596646, -0.7646448750001468, -0.780792384773156, -0.7923295632435394, -0.7991524891798064, -0.8012675390072682, -0.7987848510463456, -0.7919083700854616, -0.7809232309327797, -0.7661812940112747, -0.7480856565258807, -0.7270749320267873, -0.7036080228471957, -0.6781500088484897, -0.6511596486240515, -0.6230788437310824, -0.5943242620517881, -0.5652811637889883, -0.5362993343094695, -0.50769091278627, -0.47972982257405794, -0.4526524626386974, -0.42665930860974643, -0.4019170923910971, -0.3785612731889987, -0.3566985716060086, -0.3364094037283857, -0.3177501167565102, -0.3007549861452309, -0.28543798248728636, -0.2717943519983622, -0.25980207627816543, -0.24942328510705447 ], [ -0.2271489451416978, -0.24404673718224612, -0.2640155483968345, -0.2870971713086792, -0.31325612472957043, -0.3423688023269992, -0.37421540286920074, -0.40847572528066123, -0.44472975299785267, -0.48246365120571144, -0.5210813769466119, -0.5599216020535809, -0.5982791391155311, -0.6354296159766412, -0.6706558314212301, -0.7032740877330248, -0.7326588465544475, -0.7582642713076917, -0.7796415547793134, -0.7964513243716824, -0.8084708130389664, -0.8155958389415123, -0.817837928832409, -0.8153171435286222, -0.808251322871451, -0.7969425696528611, -0.7817618432537432, -0.7631325385275822, -0.7415138873837244, -0.7173849438047875, -0.6912298031303548, -0.663524570107357, -0.6347264355085833, -0.6052650576142473, -0.5755362836577237, -0.5458980995368767, -0.516668575206777, -0.48812548706524783, -0.4605072517065062, -0.4340147967979654, -0.40881401904205505, -0.3850385277188927, -0.3627924356076072, -0.34215302816584003, -0.32317320926682913, -0.3058836819940969, -0.29029487221782957, -0.2763986387249321, -0.2641698356807092, -0.25356780149370706 ], [ -0.22281327607419965, -0.24007515847465666, -0.2605302442892523, -0.2842285897506337, -0.3111398280522466, -0.34114145998889156, -0.37401003216297335, -0.4094163802238887, -0.4469259521599561, -0.48600490690567943, -0.5260322265836433, -0.5663175368404146, -0.6061237727144511, -0.6446933404429852, -0.6812760830988328, -0.7151572090335896, -0.7456833998246819, -0.7722855544905136, -0.794496995925172, -0.8119663969891603, -0.8244651142519241, -0.8318890006371262, -0.8342550798728416, -0.8316937004030425, -0.8244369500688977, -0.8128042144118589, -0.7971858085345268, -0.7780256105823999, -0.7558035786679858, -0.7310189474562945, -0.7041747816492553, -0.6757644182207794, -0.646260165536507, -0.6161044550334502, -0.5857034713564225, -0.5554231324946681, -0.5255871649191198, -0.4964769295838195, -0.46833260757490136, -0.44135534798063425, -0.4157100089140924, -0.3915281760345549, -0.3689112109095076, -0.3479331545210894, -0.32864338142793936, -0.3110689620085484, -0.2952167402993976, -0.28107517131514126, -0.2686159838510306, -0.2577957432058232 ], [ -0.21844561638323434, -0.23605770811278826, -0.2569846866560854, -0.28128521619625024, -0.3089344114529231, -0.3398112413909917, -0.37368892261564945, -0.4102295786128316, -0.44898427554707665, -0.4893992065116858, -0.5308283044570105, -0.5725519740189594, -0.6138010254074422, -0.6537843616182989, -0.691718596327197, -0.726857618395358, -0.758520184254434, -0.7861138843233851, -0.8091542347840665, -0.8272781173434887, -0.8402512571311941, -0.8479698416863126, -0.8504567158949612, -0.8478528337953917, -0.8404048157596384, -0.8284495595755069, -0.8123968957346456, -0.7927112676683602, -0.7698933624784012, -0.7444625227583384, -0.7169406418957156, -0.6878380908981168, -0.6576420522459686, -0.6268074550345963, -0.5957505273803667, -0.564844820152119, -0.5344194238762697, -0.5047590085595483, -0.4761052691288703, -0.4486593556578966, -0.4225849003510802, -0.3980113117936084, -0.3750370798140946, -0.35373291119577943, -0.33414458943134895, -0.3162955152618331, -0.30018893558828386, -0.28580990494746505, -0.2731270458814462, -0.2620941830516561 ], [ -0.2140660780875686, -0.232013492605599, -0.2533964251896881, -0.27828244175345374, -0.3066524708047528, -0.33838729577840243, -0.37325713468619415, -0.4109156858573625, -0.45089985098487817, -0.49263598872278525, -0.5354530244554038, -0.5786021035365742, -0.6212818155834765, -0.6626674382602205, -0.7019422421011621, -0.7383287235031841, -0.7711177066094081, -0.7996935460235877, -0.8235541054587804, -0.8423247006223066, -0.8557657009057109, -0.8637739280216273, -0.8663783424002653, -0.8637307653341018, -0.8560925556492789, -0.8438182570876667, -0.8273372678817142, -0.8071345656880291, -0.783731456121445, -0.7576672084184648, -0.7294823042691838, -0.6997038627401296, -0.668833623142937, -0.6373386779386612, -0.6056449611116719, -0.5741333280109465, -0.5431379247877425, -0.5129464505626393, -0.48380186862421737, -0.45590512236607383, -0.4294184491771911, -0.4044689493673643, -0.3811521449999168, -0.3595353443319236, -0.3396607032127873, -0.32154793986845087, -0.3051967110000482, -0.2905886938603134, -0.2776894410580001, -0.2664500833859279 ], [ -0.2096962678870412, -0.22796321256676855, -0.2497846763900199, -0.2752373614863286, -0.30430829905621926, -0.33688041129148816, -0.37272125309732285, -0.4114764183737233, -0.45266892689828553, -0.495705530765007, -0.539890314699083, -0.5844452759566143, -0.628536854765665, -0.6713067576944289, -0.7119049750614375, -0.749522705721256, -0.7834229850469936, -0.8129671308759088, -0.8376356051477086, -0.8570424459241315, -0.8709429710911728, -0.8792349304697306, -0.8819536569185652, -0.8792620350556088, -0.8714362794052697, -0.8588486074317174, -0.8419479205090616, -0.8212395777423742, -0.7972652721542888, -0.7705839039317395, -0.7417541986808345, -0.7113196470414752, -0.6797961528102392, -0.6476625787724506, -0.6153541846303634, -0.5832587745436323, -0.5517152283184618, -0.5210139924838644, -0.49139906104986353, -0.4630709783130742, -0.43619043851700434, -0.41088212652995915, -0.38723852650978263, -0.3653235102653182, -0.3451755952792752, -0.32681082885176915, -0.3102253068674553, -0.29539737246211206, -0.28228956182825693, -0.2708503729170305 ], [ -0.2053591510206645, -0.22392903627478955, -0.2461702112712867, -0.272168680841291, -0.30191781587892463, -0.33530297206856174, -0.37208937518470775, -0.41191486640156194, -0.45428893217171573, -0.49859904719762393, -0.5441247565297677, -0.5900591822247125, -0.6355368681153043, -0.6796661963792126, -0.7215641327715752, -0.7603908560121804, -0.7953819188284335, -0.8258759360684191, -0.8513363196093132, -0.8713661820832242, -0.88571611975548, -0.8942850930796657, -0.8971150188169003, -0.8943799661969399, -0.8863710243159584, -0.8734779966858379, -0.8561690974968588, -0.8349697851485129, -0.8104417820356125, -0.783163204379354, -0.7537105700065869, -0.7226432722872456, -0.690490911582528, -0.657743669851712, -0.6248457113747039, -0.5921914083866787, -0.5601240414136768, -0.528936523604036, -0.4988736524597911, -0.4701353983101251, -0.44288078642292705, -0.4172320045994018, -0.39327845593015043, -0.3710805649770136, -0.350673226390816, -0.3320688527628881, -0.3152600309821898, -0.30022183309296646, -0.2869138494247465, -0.2752820202114099 ], [ -0.20107888085020997, -0.2199344366884537, -0.24257520494286988, -0.26909658329188824, -0.2994984590313865, -0.33366887891065156, -0.3713710661430416, -0.4122354886035894, -0.4557585141959176, -0.5013087746901298, -0.5481417183920361, -0.59542203804563, -0.6422528296517709, -0.6877096052223566, -0.7308767692539198, -0.7708839536623948, -0.8069397080614163, -0.8383604201860704, -0.8645929081471059, -0.8852297750537635, -0.9000172476027386, -0.9088557618841366, -0.9117939767184591, -0.909017183596945, -0.9008312576675277, -0.8876433768135861, -0.8699407443615017, -0.8482685000763208, -0.8232079057487488, -0.7953557559170005, -0.765305799444614, -0.7336327703510487, -0.7008794223416406, -0.6675467485242559, -0.6340873575874593, -0.6009017864728343, -0.5683373751680827, -0.5366892261834808, -0.5062027260909686, -0.4770771159724715, -0.4494696504097929, -0.4234999652305207, -0.39925436703820927, -0.37678984987593744, -0.35613772747083994, -0.33730683845405485, -0.32028633474430834, -0.3050480998767149, -0.29154886559422444, -0.27973210335490306 ], [ -0.19688059421333637, -0.2160039915656038, -0.23902304726382873, -0.2660425579231992, -0.2970690356816511, -0.3319934313077636, -0.37057727859456757, -0.4124440755990987, -0.45707755209705214, -0.5038280397345448, -0.5519274816539697, -0.600512770089887, -0.6486562096294912, -0.6954011173198189, -0.7398000206436575, -0.7809526857861675, -0.8180413214560016, -0.8503607122436062, -0.87734164579022, -0.8985666942395986, -0.9137780849240426, -0.9228779707932342, -0.9259218499090538, -0.9231061818203411, -0.9147514237702421, -0.9012817850307974, -0.8832029948382493, -0.8610793157412184, -0.8355109235039547, -0.8071126282923969, -0.7764947383969869, -0.744246673326868, -0.710923722694504, -0.6770371276683717, -0.6430474444669729, -0.6093609513241283, -0.5763287007348795, -0.5442477133065524, -0.5133637652044452, -0.48387523429157986, -0.4559375281302045, -0.42966770319418257, -0.4051489823264349, -0.3824349733772602, -0.3615534772489225, -0.34250984353713765, -0.32528988496829825, -0.3098623982247565, -0.296181360002747, -0.2841878753474093 ], [ -0.1927901735488664, -0.21216314735766728, -0.23553811483843734, -0.26302918675869935, -0.2946495329908967, -0.3302931696214608, -0.3697202347924763, -0.4125476803148579, -0.45824714267769917, -0.5061513065534535, -0.5554693554389587, -0.6053112009780592, -0.6547192309339894, -0.702705474898873, -0.7482914996400476, -0.7905481041344835, -0.8286320084043639, -0.8618171702889921, -0.8895190183721646, -0.9113106331201613, -0.9269306264240853, -0.936283079334272, -0.9394303582273088, -0.9365799373842734, -0.9280665300104604, -0.9143308967358337, -0.8958966854592119, -0.8733465791586056, -0.8472989048969759, -0.818385700187833, -0.7872330511168091, -0.7544443156898695, -0.7205866296749265, -0.6861808665127092, -0.6516949989815795, -0.6175406058159978, -0.5840721018908562, -0.5515881628551365, -0.5203347717344579, -0.49050933183112166, -0.4622653535719593, -0.43571731462080776, -0.4109453949530708, -0.38799988787504225, -0.3669051752688268, -0.34766322618341505, -0.33025663101711744, -0.3146512196723942, -0.3007983330028746, -0.288636824920284 ], [ -0.188833977853334, -0.20843794870207377, -0.232145505841292, -0.2600798928940026, -0.2922608885222191, -0.32858567743295874, -0.3688132708840124, -0.41255451399028376, -0.45926955733632757, -0.5082742029310999, -0.5587557776924521, -0.6097982297938666, -0.6604151307954488, -0.7095883713177882, -0.7563097141545874, -0.7996221141433932, -0.8386578498424069, -0.8726709835591482, -0.9010623640346083, -0.923396177294395, -0.9394078127220277, -0.9490034548237257, -0.9522522929455157, -0.9493725576602581, -0.9407127647113839, -0.9267296051279934, -0.9079638917036121, -0.88501588057217, -0.8585211502253219, -0.8291280527042968, -0.7974775620535488, -0.7641861383151463, -0.7298320040579729, -0.6949449993772251, -0.6599999514005592, -0.6254132838571678, -0.5915424230306064, -0.5586874466518249, -0.5270943799979956, -0.4969595639617995, -0.46843458831406015, -0.44163138033289595, -0.4166271458056091, -0.3934689618389946, -0.37217791002029044, -0.3527527100413944, -0.33517286705194227, -0.319401381841381, -0.3053870935590376, -0.2930667325723182 ], [ -0.1850385456509579, -0.2048547365763871, -0.22887074050169431, -0.2572186519119306, -0.28992472247516565, -0.326889345475292, -0.36787064397829805, -0.4124738078365139, -0.4601481691673057, -0.5101935223374021, -0.5617763999996426, -0.6139560047767116, -0.6657184236016832, -0.7160168030403575, -0.7638145042271958, -0.8081279894776277, -0.8480663403859717, -0.8828648099949301, -0.9119105523833151, -0.9347595107251749, -0.9511442490261744, -0.9609731893695641, -0.9643222191290953, -0.9614199572169414, -0.9526281380172369, -0.9384186193232004, -0.9193484782346754, -0.8960345528483302, -0.8691286380675581, -0.8392943659060739, -0.8071866036004178, -0.7734339907917811, -0.7386250113902368, -0.703297760026069, -0.6679333277368114, -0.6329525156013135, -0.5987154115469457, -0.5655232539982374, -0.5336219648951733, -0.5032067587173285, -0.4744273075329415, -0.4473930440345407, -0.42217829549702224, -0.3988270468891425, -0.3773572220697985, -0.3577644441606651, -0.3400252892923594, -0.3241000834258352, -0.309935312227547, -0.29746572171780716 ], [ -0.1814302743072368, -0.20143981946725686, -0.22573943149143005, -0.2544696705640327, -0.2876630353109385, -0.325223100129606, -0.3669073042540347, -0.4123156416909688, -0.4608873505577684, -0.5119072015240325, -0.5645221541078972, -0.6177680848602407, -0.6706051601585763, -0.7219594256183469, -0.7707674899709848, -0.8160209036410929, -0.8568069922497583, -0.8923434387252072, -0.9220046902082506, -0.9453391486274597, -0.9620769492046675, -0.9721288399594338, -0.9755771980109711, -0.9726605506477632, -0.9637531355474455, -0.9493410715688351, -0.9299966547860896, -0.9063521734187778, -0.879074472738733, -0.8488413130424346, -0.8163203598038157, -0.7821514284515045, -0.746932376914418, -0.7112087994623668, -0.6754674354739347, -0.6401329860018468, -0.6055678537527005, -0.572074209024669, -0.5398977442085416, -0.5092325070161492, -0.4802262805973808, -0.45298608525883033, -0.4275834912356504, -0.4040595398139071, -0.3824291621700747, -0.3626850579088261, -0.3448010482766559, -0.3287349541904614, -0.31443106917692654, -0.30182230492698825 ], [ -0.17803508114003397, -0.19821912318857704, -0.22277692988743236, -0.2518570382518144, -0.28549787596084464, -0.3236061011158847, -0.36593863594375164, -0.41209074248021726, -0.4614923428513563, -0.5134142737242281, -0.5669852986850094, -0.6212195868703703, -0.6750531784318681, -0.7273869069382979, -0.7771325220953362, -0.8232584686375255, -0.8648319495703511, -0.9010544650388397, -0.9312888404848179, -0.9550766832410527, -0.9721460913510767, -0.9824101779164612, -0.9859575161450717, -0.983035949390678, -0.9740313732815, -0.9594431231264244, -0.9398575284709588, -0.915921060787195, -0.8883143248685594, -0.8577279468666086, -0.824841201536852, -0.790304000579412, -0.7547226316906258, -0.7186493951666344, -0.6825760411467423, -0.6469306857240376, -0.6120777036956428, -0.5783199814499439, -0.5459028747745116, -0.5150192471404442, -0.4858150462208024, -0.4583949870899626, -0.432828028614036, -0.4091524395925291, -0.3873803444168308, -0.3675017109525641, -0.3494877961925352, -0.33329410004827786, -0.31886289731061634, -0.3061254253139414 ], [ -0.17487805282466296, -0.19521782619188421, -0.2200079537489673, -0.24940435834794195, -0.28345098741964236, -0.32205741466518356, -0.36498017266552196, -0.41181025683271033, -0.4619691009841007, -0.514714798642455, -0.5691594455424562, -0.6242973154808363, -0.6790423406444888, -0.7322722703838638, -0.7828761255365047, -0.8298012692868935, -0.8720966001002513, -0.9089489635262981, -0.9397107394516626, -0.9639175268166035, -0.9812957691214055, -0.9917609323354478, -0.9954074066313431, -0.9924916487974464, -0.983410241116458, -0.9686745575986795, -0.9488836427058548, -0.9246967572271846, -0.8968068581257053, -0.8659160723869159, -0.8327140086625744, -0.7978595263780088, -0.7619663473736112, -0.7255926499667956, -0.689234538540461, -0.653323053620595, -0.6182242043967534, -0.5842413905104265, -0.5516195424405816, -0.5205503434859469, -0.4911779822455864, -0.46360499876967876, -0.4378979084447532, -0.4140923995582886, -0.392197994591751, -0.372202138441066, -0.35407372941351023, -0.3377661433485487, -0.3232198206167316, -0.3103644931889532 ], [ -0.1719830904911136, -0.19245998827748756, -0.21745620757724482, -0.24713436777444042, -0.2815434380200781, -0.3205956700249326, -0.3640472941425653, -0.41148550367998893, -0.46232411733724943, -0.5158097715194349, -0.5710395653388839, -0.6269898734433444, -0.682554751626818, -0.7365912201930008, -0.7879679259874863, -0.8356133807557824, -0.8785601699582779, -0.9159821436437172, -0.9472224950733307, -0.9718116346799746, -0.9894747217482421, -1.000129510884853, -1.0038757466531936, -1.000977690848878, -0.9918415218687231, -0.9769893499873781, -0.957031492615992, -0.9326384891137033, -0.9045141350452329, -0.8733706004126602, -0.8399064748102162, -0.8047883554007544, -0.7686363572766135, -0.7320136789082323, -0.6954201064499452, -0.6592891101393119, -0.6239880011858963, -0.5898205019409786, -0.5570310458267644, -0.5258101596842711, -0.4963003702088459, -0.4686021933625574, -0.442779888829119, -0.41886677489211754, -0.39686999388107336, -0.3767746915788176, -0.3585476264245693, -0.3421402585540244, -0.3274913879181224, -0.3145294181411846 ], [ -0.1693725586115693, -0.1899681814649442, -0.21514400192960137, -0.2450685544061303, -0.27979524796105826, -0.3192387085117586, -0.3631549127465853, -0.4111277140460151, -0.462564230304951, -0.5167010146301471, -0.5726219736072626, -0.6292877501474777, -0.6855749535421249, -0.7403224412031517, -0.7923810487491871, -0.8406628562557185, -0.8841862863467563, -0.9221139710785908, -0.9537812492948042, -0.9787141903748579, -0.996637024858118, -1.0074696806999048, -1.0113167150446691, -1.008449287528715, -0.9992819722397763, -0.9843461996336001, -0.9642620067504643, -0.9397095963710604, -0.9114019950151626, -0.880059876396339, -0.8463893905502434, -0.81106360934266, -0.7747079615208302, -0.7378897826484634, -0.7011118550780742, -0.6648095811481666, -0.6293512469045546, -0.5950407179669137, -0.5621218739698997, -0.5307841262473875, -0.5011684548783416, -0.47337352068827343, -0.4474615326752148, -0.4234636656655788, -0.4013849181885638, -0.3812083738052071, -0.36289888135236226, -0.34640620351963347, -0.3316677022305826, -0.3186106367534478 ], [ -0.1670669462190677, -0.18776313234759612, -0.2130918831593639, -0.24322678269932985, -0.27822502161536455, -0.3180032353761083, -0.3623171594083262, -0.4107477663397334, -0.46269642414223433, -0.5173910555368887, -0.5739042987629458, -0.6311833871954969, -0.6880900925406389, -0.7434478654146677, -0.7960924793907679, -0.844922171795051, -0.8889434929898579, -0.9273097381012887, -0.9593497863069564, -0.984586234739535, -1.0027427241438196, -1.0137411920996502, -1.0176903936946675, -1.0148673900315093, -1.0056938524853734, -0.9907090154497279, -0.9705409852137044, -0.9458779228002887, -0.9174403977466798, -0.8859559793205859, -0.8521369009721383, -0.8166614022608466, -0.7801591142204523, -0.7432006060182639, -0.7062909602388291, -0.6698670117227736, -0.6342976987831745, -0.5998868602877854, -0.5668777779402616, -0.535458802888151, -0.5057694989487022, -0.4779068557302374, -0.45193125088456265, -0.4278719556577951, -0.40573207327054583, -0.3854928728106116, -0.36711753333071695, -0.35055434660346496, -0.335739445958406, -0.3225991361746028 ], [ -0.16508454913619286, -0.1858633854795122, -0.21131828357446425, -0.24162693837446425, -0.27684959667807785, -0.31690448537596505, -0.3615470791506198, -0.41035592622988726, -0.46272762744302154, -0.5178829971930982, -0.5748854344872301, -0.6326712203620826, -0.6900900535235261, -0.7459528983801755, -0.7990833762498759, -0.8483686153995675, -0.8928057035861557, -0.9315405666544679, -0.9638970696526232, -0.9893952214330594, -1.0077583946482134, -1.0189103285997092, -1.0229632973502059, -1.020199189728739, -1.011045392247677, -0.9960473425228692, -0.9758394849224592, -0.9511161595724129, -0.9226037259902471, -0.8910349857290107, -0.8571267339361655, -0.8215610364892864, -0.7849705907786602, -0.7479282804621215, -0.7109407845591666, -0.6744458694388578, -0.638812806777911, -0.6043452459993031, -0.5712858364805771, -0.5398219356317556, -0.510091833052541, -0.4821910427000934, -0.45617834140335667, -0.43208134715417656, -0.4099015259103225, -0.38961858861415233, -0.3711942919330147, -0.35457568984607735, -0.33969790216562257, -0.32648647378755213 ], [ -0.1634411816933118, -0.18428499718122893, -0.2098392021993435, -0.2402846029411253, -0.2756837212582417, -0.31595591308877236, -0.36085634672606426, -0.4099616005032708, -0.46266451801374364, -0.518180385501098, -0.5755654794805977, -0.6337476980047808, -0.6915675599969517, -0.7478265993379637, -0.8013393258317875, -0.8509846093648665, -0.8957525798305216, -0.9347838292949929, -0.9673986924443917, -0.993115482917375, -1.01165760992338, -1.02295036817917, -1.027108817810921, -1.024418538157387, -1.0153111812311533, -1.0003367202496563, -0.9801341436224373, -0.9554021349372761, -0.9268710418626789, -0.8952771944512512, -0.8613403955846857, -0.8257451717085478, -0.7891261334703513, -0.7520575490974157, -0.7150469848475293, -0.6785326366520141, -0.6428837930724468, -0.6084037563136193, -0.5753345156328196, -0.5438625087548254, -0.5141249011727071, -0.486215934880018, -0.46019302428760067, -0.43608239189846754, -0.4138841313222207, -0.39357665790924967, -0.3751205588907601, -0.35846188844779203, -0.3435349721597243, -0.33026479321337665 ], [ -0.16214992586406185, -0.18304126858130865, -0.20866792575559412, -0.2392127683072246, -0.27473976951699874, -0.3151689185668306, -0.3602550125228028, -0.4095731141249793, -0.4625133418923193, -0.518287080108831, -0.5759456679883518, -0.6344112766513335, -0.6925182369275862, -0.7490618102179836, -0.8028505336516759, -0.852757955843528, -0.8977698225198123, -0.9370234752328697, -0.9698372272070709, -0.995728593192178, -1.0144213076034398, -1.0258419429589973, -1.0301075705770306, -1.0275062751928357, -1.018472475095213, -1.0035589636274325, -0.9834074355258107, -0.958719044186132, -0.9302262919100389, -0.8986673081217222, -0.8647633300622313, -0.8291999648394102, -0.7926125735721856, -0.7555758731250803, -0.71859760472807, -0.682115891140977, -0.6464997223268889, -0.6120518978112508, -0.5790137221974221, -0.5475707914801127, -0.5178593014475279, -0.4899724302855195, -0.463966472866581, -0.43986651831778456, -0.41767155693496605, -0.39735897485223914, -0.37888844629486995, -0.3622052667575204, -0.3472431896141732, -0.3339268368862911 ], [ -0.16122092484695727, -0.18214252573758927, -0.20781479844745077, -0.23842160065582674, -0.2740275054056478, -0.3145526179468955, -0.35975128801769085, -0.40919751900644985, -0.4622797537855886, -0.5182071340531925, -0.5760282946806821, -0.6346623950725097, -0.6929406355255612, -0.7496552301036525, -0.8036119449417723, -0.8536819983284025, -0.8988493668312882, -0.9382502515200531, -0.9712024648071385, -0.9972236165741069, -1.016038040878889, -1.0275732872721506, -1.0319476346422565, -1.0294504569519987, -1.0205174090396403, -1.0057023611281437, -0.9856478529235603, -0.9610556150965271, -0.9326584569357502, -0.9011945682367558, -0.8673850408132195, -0.8319151786621344, -0.7954199283873017, -0.7584735183047702, -0.7215831515489718, -0.6851863743587976, -0.649651562105815, -0.6152808558062675, -0.5823148507268233, -0.550938379226706, -0.5212868222501905, -0.49345250309817534, -0.46749084101225324, -0.44342605507798416, -0.42125630265427905, -0.40095820842998364, -0.3824907914456379, -0.36579883096333177, -0.3508157314385224, -0.3374659554215702 ], [ -0.16066122690507767, -0.18159595333537215, -0.20728704768052397, -0.23791826123649396, -0.2735539024890492, -0.31411366708881105, -0.35935137863075406, -0.4088404417624282, -0.46196868526941937, -0.517944687318192, -0.5758166374024, -0.6345034286187137, -0.6928362199246245, -0.7496074333556446, -0.8036232918182604, -0.8537556942539057, -0.8989894759196067, -0.9384618127841551, -0.9714915354377206, -0.997597235360726, -1.0165041088388365, -1.0281403674172382, -1.0326246791900417, -1.030246477737672, -1.0214411139851318, -1.006761784649882, -0.9868500098349016, -0.9624062054467507, -0.934161643655516, -0.9028528412329777, -0.8691991713104172, -0.8338842573381046, -0.7975414716239718, -0.7607436202007003, -0.7239966564872549, -0.687737046404084, -0.6523322327643183, -0.618083539250059, -0.5852308236071679, -0.553958229082249, -0.5244004733072917, -0.4966492307193008, -0.4707592864402175, -0.4467542509594664, -0.4246317176499518, -0.4043678164983575, -0.38592116848194336, -0.36923627864666264, -0.3542464255826612, -0.3408761139811538 ], [ -0.1604746837898322, -0.18140548679727886, -0.2070886710208052, -0.23770678977314175, -0.27332302582731727, -0.3138561443157524, -0.3590593699408523, -0.40850597606519656, -0.46158424576535795, -0.5175038785061602, -0.5753148810012167, -0.6339386259333606, -0.6922093167471539, -0.7489228313068598, -0.8028890658501513, -0.8529835968497869, -0.898194730344909, -0.937662716590312, -0.9707089084954571, -0.9968537531278457, -1.0158235624695253, -1.0275468900159417, -1.032141974302558, -1.0298970833493541, -1.0212457328918159, -1.0067387092912388, -0.9870146656164102, -0.9627708306726663, -0.9347351163780342, -0.9036406538952089, -0.8702035436237414, -0.8351043673454628, -0.7989737757488725, -0.7623822269382015, -0.7258337167197718, -0.6897631267190281, -0.6545366459389198, -0.6204546164591094, -0.5877561236465059, -0.5566246890395533, -0.5271945115121828, -0.4995568162015709, -0.4737659898886374, -0.4498452909774091, -0.4277920136579336, -0.4075820565383085, -0.389173896883087, -0.3725120053315425, -0.3575297559364853, -0.3441518958210201 ], [ -0.16066190638911426, -0.18157176574146972, -0.20722038760811057, -0.23778805394053515, -0.273335979543756, -0.3137814959759063, -0.3588771709733941, -0.40819662318916283, -0.4611296596644857, -0.5168887776831985, -0.5745280449283242, -0.6329740303476135, -0.6910670294838421, -0.747609579127356, -0.8014184173604733, -0.8513757473771884, -0.8964759143236543, -0.9358643053330682, -0.9688662721916887, -0.9950049744549727, -1.0140080870512065, -1.0258041896452195, -1.0305102862546727, -1.0284122762009142, -1.0199403374907676, -1.0056411430283396, -0.9861486683936597, -0.962155121302504, -0.9343832681241478, -0.9035611773036547, -0.8704001538712608, -0.8355764027494564, -0.7997167251682179, -0.7633883183113124, -0.7270925185372212, -0.6912621194679438, -0.6562617307028422, -0.6223905408493074, -0.5898868184820181, -0.5589335204392024, -0.52966446099708, -0.5021706057348665, -0.476506169951767, -0.4526943086110341, -0.43073227473762854, -0.41059599313370676, -0.39224404690067294, -0.37562110812964344, -0.360660864460455, -0.34728850318241233 ], [ -0.16122027843758313, -0.1820921496902249, -0.2076796549883705, -0.23815976593563992, -0.2735909211696762, -0.31388854598927884, -0.35880451581410566, -0.4079132821187146, -0.4606072411314519, -0.516103342145125, -0.5734619166326944, -0.6316173883162635, -0.6894191204417188, -0.7456794310436106, -0.7992249850826251, -0.8489474817806539, -0.8938498031819848, -0.9330844792869095, -0.9659822976542621, -0.9920699658292471, -1.0110767655632356, -1.0229310000880287, -1.0277476613607146, -1.0258091157478084, -1.017540748399614, -1.0034834686916116, -0.9842648201206884, -0.9605702113903378, -0.9331155318522913, -0.902622159490065, -0.8697951242983888, -0.8353049542183602, -0.7997734994078964, -0.7637638002666443, -0.727773840365477, -0.6922338225698815, -0.6575064464213455, -0.6238895658100743, -0.5916205760571882, -0.5608819129942861, -0.5318071269640885, -0.5044871008032659, -0.4789760932911964, -0.4552973939589071, -0.4334484633827729, -0.4134055021384516, -0.39512744194575855, -0.37855938655372834, -0.36363555065752207, -0.35028175566707975 ], [ -0.1621440272986352, -0.18296079486777994, -0.208460750048581, -0.23881656471093426, -0.27408314128398725, -0.314173567948694, -0.35883902230341636, -0.40765528832319753, -0.46001840622569934, -0.5151513954629824, -0.5721229920057459, -0.6298780471918608, -0.687277863689192, -0.7431475484978705, -0.7963266618666202, -0.8457191584387059, -0.8903388594965276, -0.9293473688685054, -0.9620822958795923, -0.9880747061267996, -1.0070557312827528, -1.018953116950772, -1.023879105501004, -1.0221114205892248, -1.0140692641299962, -1.000286202839008, -0.9813816669392552, -0.9580325607183396, -0.9309462337143368, -0.9008358079657721, -0.8683986124946773, -0.8342982417642228, -0.7991505258711521, -0.7635134740675398, -0.7278810348376918, -0.6926803194639066, -0.6582717813948558, -0.6249517478675187, -0.5929566704124241, -0.5624684917521494, -0.5336206027464845, -0.5065039645980637, -0.48117307991521785, -0.4576515976055412, -0.43593742285414694, -0.4160072714722337, -0.39782065793042576, -0.38132334054794703, -0.36645026847478934, -0.35312808621630243 ] ], "zauto": true, "zmax": 1.0326246791900417, "zmin": -1.0326246791900417 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.6490894443631541, 0.647124453248742, 0.6451896962327301, 0.6432812268737454, 0.6413948008015349, 0.6395271975684031, 0.6376776171902431, 0.6358490161560109, 0.634049237297024, 0.632291790972026, 0.6305961628106909, 0.6289875560092281, 0.6274960228390469, 0.6261549979030547, 0.6249993100242279, 0.6240628136151147, 0.6233758353626278, 0.6229626688584434, 0.6228393603713165, 0.6230120085510078, 0.6234757498580762, 0.6242145262407748, 0.6252016435288642, 0.6264010425844052, 0.6277691345007435, 0.6292570065883626, 0.6308127923295903, 0.6323840144485565, 0.6339197490166503, 0.6353725102520793, 0.6366998098162373, 0.6378653917587493, 0.6388401783144316, 0.6396029792348847, 0.6401410180658923, 0.6404503151186433, 0.6405359429853537, 0.6404121415257454, 0.6401022509022496, 0.6396383989254815, 0.6390608675395224, 0.6384170665279837, 0.6377600626982579, 0.6371466500051232, 0.6366349976882335, 0.6362819738040542, 0.6361403018382457, 0.6362557576422337, 0.6366646417931526, 0.6373917600155847 ], [ 0.6463784526767292, 0.6442798140007806, 0.6422140078835287, 0.6401765697659999, 0.6381626243691875, 0.6361683326156665, 0.634192429522128, 0.6322377046178237, 0.6303122640748429, 0.6284304161219894, 0.6266130399603962, 0.6248873337383714, 0.6232858882295005, 0.6218450969050504, 0.6206029849949685, 0.6195966122563304, 0.61885926673723, 0.618417709164835, 0.6182897402254156, 0.6184823402177105, 0.6189905726097144, 0.6197973571729476, 0.6208741180140613, 0.6221822137851539, 0.6236749779598547, 0.6253001483405382, 0.6270024521179642, 0.6287261336731275, 0.6304172587160863, 0.6320256886876509, 0.6335066814286887, 0.6348221275742731, 0.635941469843649, 0.6368423710182968, 0.6375111960754959, 0.6379433576067612, 0.6381435461310283, 0.638125834077907, 0.6379136102348044, 0.6375392762135745, 0.6370436231427539, 0.6364748092939421, 0.6358868799993683, 0.635337810062774, 0.634887103124902, 0.6345930461015582, 0.6345097807226447, 0.6346844070341965, 0.6351543638881796, 0.6359453297662664 ], [ 0.643552169960164, 0.6413128936167005, 0.6391092268505, 0.6369361616035323, 0.6347881485716872, 0.6326606769209737, 0.6305519636189927, 0.6284645898084462, 0.6264069070028446, 0.6243940373768143, 0.6224483118306482, 0.6205990274982888, 0.6188814621450944, 0.6173351536409531, 0.6160015329175309, 0.6149210800533896, 0.614130244268507, 0.6136584172955057, 0.6135252646778206, 0.6137386941316326, 0.6142936742897168, 0.6151720192759341, 0.6163431402708797, 0.6177656541477032, 0.6193896503266241, 0.6211593639414913, 0.6230159918159575, 0.6249004145526579, 0.6267556433148296, 0.628528879967959, 0.6301731501472295, 0.6316485288787516, 0.6329230198852636, 0.6339731692833043, 0.6347844926025034, 0.6353517745457768, 0.6356792692674657, 0.63578079177633, 0.6356796551520527, 0.635408379935768, 0.6350080867407832, 0.6345274849207668, 0.6340213913284103, 0.6335487537512434, 0.6331702105428166, 0.6329452849487143, 0.6329293800750674, 0.6331707964795311, 0.633708026788807, 0.6345675808740469 ], [ 0.6406118380895804, 0.6382247646472474, 0.6358762584623457, 0.633560746684645, 0.6312719654051921, 0.6290046797583274, 0.6267565348875723, 0.6245298601692085, 0.6223332318308948, 0.6201825994480328, 0.6181018018343197, 0.6161223385186816, 0.6142823237337753, 0.6126246278151144, 0.611194300280397, 0.6100354602494829, 0.6091879206722195, 0.6086838687666961, 0.608544943022922, 0.6087800188126107, 0.6093839399304042, 0.6103373218940381, 0.6116074227794844, 0.6131499516599452, 0.6149115853082879, 0.6168329063261387, 0.6188514661912008, 0.6209047106669143, 0.6229325705681524, 0.6248796020000329, 0.6266966408405121, 0.628342003409267, 0.6297823106339275, 0.6309930332945879, 0.6319588522188635, 0.6326739040381526, 0.6331419467905636, 0.6333764376867426, 0.6334004751828726, 0.6332465259293782, 0.6329558398662342, 0.63257745789092, 0.6321667383800594, 0.6317833712012167, 0.6314889074896806, 0.6313439037321233, 0.6314048495875404, 0.6317211079905739, 0.6323321306865207, 0.6332652122852365 ], [ 0.6375594933852232, 0.6350173120979135, 0.6325168364067789, 0.6300519125467944, 0.6276155250556865, 0.6252016646034805, 0.622807350791947, 0.6204346163917018, 0.6180922392457069, 0.6157970069697436, 0.6135743200649008, 0.6114579824240336, 0.609489094157974, 0.6077140474405629, 0.606181725479934, 0.6049401074185474, 0.6040325736661389, 0.6034942703739331, 0.603348913066169, 0.6036063779244262, 0.6042613444456874, 0.6052931262474656, 0.6066666789318619, 0.6083346318484938, 0.610240079721226, 0.6123198081355918, 0.6145076199781689, 0.6167374724260876, 0.6189462114852998, 0.6210757846284434, 0.6230749034727717, 0.6249002032020421, 0.6265169946855004, 0.6278997258630505, 0.6290322627516866, 0.6299080727565711, 0.6305303513342108, 0.630912085782417, 0.6310760051763353, 0.6310543305025034, 0.6308882197772095, 0.6306268035742617, 0.6303257290568505, 0.6300451748903366, 0.6298473618050414, 0.6297936570828275, 0.6299414454443492, 0.6303410008561773, 0.6310326304438199, 0.6320443624293094 ], [ 0.6343980331735819, 0.631693303733999, 0.6290335964044607, 0.6264121667209422, 0.6238212155603616, 0.6212539116587034, 0.6187065963262137, 0.6161809600335356, 0.6136859569040318, 0.6112392202601205, 0.6088677630836061, 0.6066077932762378, 0.6045035450019841, 0.6026051215508371, 0.600965455566343, 0.5996366077365035, 0.5986657290065389, 0.5980910849894168, 0.5979385664638273, 0.5982190747799295, 0.5989270748463665, 0.6000404639231907, 0.6015217364898052, 0.6033202651183603, 0.6053753939222811, 0.6076199747815363, 0.6099839734433576, 0.6123978252870096, 0.6147953115555689, 0.6171158343463617, 0.6193060717929916, 0.6213210776777063, 0.6231249427823399, 0.6246911558030842, 0.6260027922602374, 0.6270526270001264, 0.6278432182411172, 0.6283869579915006, 0.6287060339861892, 0.6288322098033322, 0.628806308642905, 0.6286772865426273, 0.6285008044963247, 0.6283372553116932, 0.6282492662553693, 0.6282987752219791, 0.628543855530211, 0.6290355292271176, 0.6298148473576975, 0.6309105171457811 ], [ 0.6311312808502938, 0.6282564593833214, 0.6254301493659018, 0.6226450134292943, 0.6198924428393019, 0.6171647411378197, 0.614457520601911, 0.6117720835736014, 0.6091175332091685, 0.6065123531193253, 0.6039852160347812, 0.6015748302428781, 0.5993287096096418, 0.5973008561498008, 0.5955484665278832, 0.5941279030684271, 0.5930902875784058, 0.5924771605956939, 0.5923166784172286, 0.5926207812554202, 0.5933836568691673, 0.5945816597589085, 0.5961746554242121, 0.5981085785083329, 0.6003188567702525, 0.6027342822597179, 0.6052809130337286, 0.6078856534979603, 0.6104792680420017, 0.6129987056795345, 0.6153887293354974, 0.6176029346752857, 0.6196043001112886, 0.6213654294862523, 0.6228686355730642, 0.624105973682947, 0.6250792802441665, 0.6258002116440601, 0.6262902236673211, 0.6265803897532015, 0.6267109333024518, 0.6267303494419756, 0.6266940166285452, 0.6266622471421042, 0.6266977936368204, 0.6268629087361791, 0.6272161350146076, 0.6278090699956046, 0.6286833910922222, 0.6298684275987141 ], [ 0.6277640483300392, 0.6247115181666787, 0.6217111530145047, 0.6187550292665429, 0.6158337101933027, 0.6129385964573782, 0.610064523737233, 0.6072123611244719, 0.6043913320683847, 0.6016207719121317, 0.5989310563418695, 0.5963634861436501, 0.5939689966041707, 0.5918056726520629, 0.5899351863694562, 0.5884184181344237, 0.5873106558121863, 0.5866568628423384, 0.5864875410275733, 0.5868156704481309, 0.5876350853940157, 0.5889204585531379, 0.5906288496496697, 0.5927025714818472, 0.5950729748676198, 0.5976646796135509, 0.6003997871744136, 0.6032016896084613, 0.605998213745841, 0.6087239798011761, 0.6113219834265696, 0.6137445102439772, 0.6159535520546989, 0.6179209124614762, 0.6196281714076429, 0.6210666323185574, 0.622237313458681, 0.6231509784606807, 0.6238281403798555, 0.6242989278121094, 0.6246026769627171, 0.624787113910626, 0.6249070178993054, 0.6250223077108995, 0.6251955643215058, 0.6254890859316261, 0.6259616546200271, 0.6266652634076707, 0.6276420943112139, 0.6289220407550228 ], [ 0.624302194638467, 0.6210643024494925, 0.6178823808189101, 0.6147479367629473, 0.6116506962208409, 0.6085811263360209, 0.6055332430896547, 0.6025074388715596, 0.5995130277171413, 0.5965701950272826, 0.5937110580748434, 0.5909795969609848, 0.5884303046711211, 0.5861255278922373, 0.5841316200651386, 0.5825141898398548, 0.5813328785237372, 0.5806362102389448, 0.5804570994487236, 0.5808095522494534, 0.5816869578734322, 0.5830621548981055, 0.5848892120497013, 0.5871066352753608, 0.5896415457573773, 0.5924142958963088, 0.5953430072497446, 0.5983476099652922, 0.6013531076411226, 0.6042919509370175, 0.6071055478911077, 0.6097450479927496, 0.6121716002712686, 0.6143563020685148, 0.616280031027886, 0.6179332989698555, 0.6193161956648652, 0.6204384160756625, 0.6213192980213198, 0.6219877476459279, 0.6224819039799727, 0.6228483947931848, 0.6231410645407437, 0.623419109304937, 0.6237446279498581, 0.6241796846376754, 0.624783063600738, 0.6256069685661299, 0.626693962263541, 0.628074444729471 ], [ 0.6207526792717531, 0.6173217771692409, 0.6139507869318535, 0.6106306745761532, 0.6073503299512681, 0.6040992646438739, 0.6008706377086716, 0.5976643241382533, 0.5944896985191975, 0.5913677916215927, 0.5883324958884404, 0.5854305512020436, 0.5827201374799464, 0.5802680345706673, 0.5781454752500992, 0.5764229976397773, 0.5751647730587898, 0.5744230108851117, 0.5742330897682622, 0.5746100108081122, 0.5755466098120965, 0.5770137252630185, 0.5789622420398067, 0.5813266752019046, 0.5840297746509111, 0.5869875514061822, 0.5901141537494244, 0.5933261363807876, 0.5965458327542628, 0.5997037210985813, 0.6027398351280014, 0.6056043887609615, 0.608257849928608, 0.610670711893233, 0.6128231792889957, 0.6147049229984046, 0.6163149776918881, 0.6176617728884256, 0.6187632153773215, 0.6196466875059331, 0.6203487985855074, 0.6209147285914268, 0.6213970344420191, 0.6218538464985878, 0.6223464606096384, 0.6229364199563303, 0.623682269076015, 0.6246362355943221, 0.62584113918566, 0.6273278309156984 ], [ 0.6171236088250538, 0.6134921030547476, 0.6099245656822238, 0.6064114628979836, 0.6029408618216675, 0.5995013066656573, 0.5960850696985864, 0.5926914717802986, 0.5893299184458161, 0.5860222783404949, 0.582804247203574, 0.5797253977619641, 0.5768477173730762, 0.5742425807487683, 0.5719862872570698, 0.5701544935437429, 0.5688160633587421, 0.5680269993758753, 0.5678251772906977, 0.5682265426111229, 0.569223251103045, 0.5707839612434829, 0.5728561747278067, 0.5753702351472322, 0.5782443941310808, 0.5813902728638555, 0.5847180874803467, 0.5881411440955283, 0.5915793016095039, 0.594961303630534, 0.5982260581641735, 0.601323071300296, 0.6042123088156205, 0.6068637687928765, 0.6092570087683712, 0.6113807972629157, 0.6132329684970613, 0.6148204667846683, 0.6161594872961557, 0.6172755628149924, 0.6182034180697512, 0.6189864167207282, 0.6196754602749108, 0.6203272592766327, 0.6210019784006827, 0.621760348995066, 0.6226604328887434, 0.6237542957488384, 0.6250848929008584, 0.6266834743409965 ], [ 0.6134242752758737, 0.609584682118244, 0.6058132040140161, 0.6020998624934321, 0.5984319289412273, 0.5947969802438816, 0.5911863809704917, 0.5875988663882256, 0.5840438446987583, 0.5805440124537186, 0.5771368910367012, 0.5738749506564976, 0.5708240961565219, 0.5680604467008223, 0.5656655417870382, 0.5637203300452618, 0.5622985122397798, 0.5614599721972318, 0.5612450935785795, 0.5616706936034326, 0.5627281017371695, 0.5643836026260721, 0.5665811104922904, 0.5692466232885222, 0.5722937860991084, 0.5756298120563985, 0.5791610656234722, 0.5827977760541388, 0.5864575694669493, 0.5900677359641482, 0.5935663431950098, 0.5969024445396816, 0.6000356989209824, 0.6029357230493151, 0.6055814474788461, 0.6079606621800848, 0.6100698342619266, 0.6119141779627589, 0.6135078700535338, 0.614874243084009, 0.6160457605388515, 0.617063583711558, 0.6179765780728982, 0.618839672235705, 0.6197115677778735, 0.6206518930920382, 0.6217179866141581, 0.6229615702109187, 0.6244256184308442, 0.6261417331216608 ], [ 0.6096651842068913, 0.6056101936730507, 0.6016275251129838, 0.5977068256132972, 0.5938346128899278, 0.5899975100514417, 0.5861859636262559, 0.5823980985213338, 0.5786432996674539, 0.5749450795513376, 0.5713428015693149, 0.5678918886606887, 0.5646622609765387, 0.5617349170632273, 0.5591967931240331, 0.557134283869747, 0.5556260497803459, 0.5547359195281037, 0.5545067702139335, 0.5549561933857425, 0.5560745250407445, 0.5578254685816784, 0.5601491434968293, 0.5629670377979066, 0.566188105001719, 0.5697151672714038, 0.573450862241522, 0.5773025633572778, 0.5811859554329619, 0.5850272018210497, 0.5887638529610868, 0.5923447918291411, 0.595729580863901, 0.5988875719789172, 0.6017970803990362, 0.604444823765901, 0.6068257114985559, 0.6089429557399906, 0.6108083806821376, 0.6124427428617679, 0.6138758469095398, 0.615146250020544, 0.6163003909606671, 0.6173910496219464, 0.6184751325112502, 0.619610877465497, 0.6208546647462476, 0.6222576976746678, 0.6238628608170967, 0.6257020672800384 ], [ 0.6058580711704257, 0.6015806190133495, 0.5973797213126526, 0.593244736841755, 0.5891614880891819, 0.5851156730065104, 0.5810968219550712, 0.5771024329095576, 0.5731418450990475, 0.5692393736093085, 0.565436234189059, 0.5617908475051007, 0.5583772328577568, 0.5552813857903155, 0.5525957753516115, 0.550412372965737, 0.5488148952313053, 0.5478711508794342, 0.5476264667597807, 0.5480990840595877, 0.5492781561469056, 0.5511245848826521, 0.5535744872756011, 0.556544690950854, 0.5599394010718812, 0.5636571065770374, 0.567596892602471, 0.5716635515303223, 0.5757711713082149, 0.5798451628950775, 0.5838229210838589, 0.5876534673127732, 0.5912964912932155, 0.594721197029317, 0.5979052847268724, 0.6008342854163199, 0.6035013337708093, 0.6059073387974857, 0.6080614095997917, 0.6099813259572362, 0.6116938163218658, 0.6132344186072334, 0.6146467471997595, 0.6159810654075354, 0.6172921565230025, 0.6186365876168769, 0.6200695554668302, 0.6216415802129168, 0.6233953567049727, 0.6253630765423589 ], [ 0.6020159043396968, 0.5975092527933755, 0.5930833742307049, 0.5887274417596035, 0.5844266585637885, 0.5801658425890241, 0.575933623736409, 0.5717268662413708, 0.5675548460114452, 0.5634426668549413, 0.5594334013249519, 0.5555885018411936, 0.5519861550071311, 0.5487174509241998, 0.5458805034982972, 0.5435729636089792, 0.5418836692890998, 0.5408844114165234, 0.54062288981685, 0.5411178407156364, 0.5423570228571893, 0.5442983045225012, 0.5468735950506114, 0.5499949296278354, 0.5535617419272889, 0.5574682916513088, 0.5616103403597533, 0.5658904319432561, 0.5702214577401357, 0.574528499739009, 0.5787491971707152, 0.5828330442507741, 0.5867400930178011, 0.5904395140147729, 0.5939083783578338, 0.5971308927568934, 0.6000981711838128, 0.6028084878520378, 0.605267845383546, 0.6074906216729178, 0.6095000336356804, 0.6113281739049735, 0.6130154311725102, 0.6146091870470203, 0.6161617812794751, 0.6177278412152593, 0.6193611677823295, 0.6211114462679326, 0.6230210936033671, 0.6251225560987863 ], [ 0.5981528715672353, 0.59341069906828, 0.5887534599609093, 0.584170261128609, 0.5796457806922477, 0.5751640195518604, 0.5707127382362213, 0.5662881718108027, 0.561899521498002, 0.5575726664454032, 0.5533525349454044, 0.549303633695884, 0.545508367457206, 0.5420629956152936, 0.5390713609295086, 0.5366368638440397, 0.5348534928990327, 0.5337969851195817, 0.5335172993744552, 0.5340334798746564, 0.5353316553867941, 0.5373664184906413, 0.5400652718586725, 0.5433353496627469, 0.547071330380405, 0.5511634004113661, 0.5555042862057475, 0.5599946773091685, 0.564546726845927, 0.5690856611793377, 0.5735498020855335, 0.5778894746798633, 0.5820653371811846, 0.586046635671404, 0.5898097805999692, 0.5933374903856319, 0.596618581277981, 0.5996483292191073, 0.6024292100095128, 0.6049717512593045, 0.607295207147339, 0.6094277912823557, 0.6114062653886396, 0.6132747710070067, 0.6150828958559722, 0.6168830736157997, 0.6187275132239327, 0.6206649290138307, 0.6227373851272763, 0.6249775687045722 ], [ 0.594284349986219, 0.589300849916087, 0.5844063370430936, 0.5795899881405864, 0.574836069324239, 0.5701278462489575, 0.5654522579641129, 0.5608049279329383, 0.5561949791667824, 0.551649054525469, 0.5472139320985968, 0.5429571836013619, 0.5389654640402548, 0.5353402511976872, 0.5321911686202467, 0.5296273987572333, 0.5277480679849316, 0.5266327801387488, 0.5263335978438944, 0.5268696513859947, 0.5282251807058543, 0.530351252710695, 0.5331707748683461, 0.5365859008420663, 0.5404866157092795, 0.5447592461258703, 0.5492938360736705, 0.5539896796625455, 0.5587587099510829, 0.5635268210576014, 0.5682334922466307, 0.5728302592541099, 0.577278636231788, 0.5815480451394593, 0.5856141835547183, 0.5894580887467515, 0.5930659693798773, 0.5964297071556343, 0.5995478023157222, 0.6024264622530959, 0.6050805141304996, 0.607533854570871, 0.6098192210850714, 0.6119771676503406, 0.6140542372759705, 0.6161004346411532, 0.6181661997746278, 0.6202991577982623, 0.6225409599883808, 0.6249245309623317 ], [ 0.5904268563548692, 0.5851968445595361, 0.5800597148648572, 0.5750048661379297, 0.5700162844418227, 0.5650766015397347, 0.560172000941066, 0.5552975266689956, 0.5504622295424315, 0.5456935077703217, 0.5410399793672329, 0.5365722800274977, 0.5323813270695104, 0.5285738374467002, 0.525265231201956, 0.5225704622719459, 0.5205937346448583, 0.5194183908033787, 0.5190983962452212, 0.5196527083709245, 0.5210633962917346, 0.5232777462894097, 0.5262138974505919, 0.529768978588836, 0.5338283949102982, 0.5382748899981536, 0.5429962462894186, 0.5478908885560495, 0.5528711084280882, 0.5578640404323976, 0.5628108311419269, 0.5676646254275995, 0.5723880457531169, 0.5769507782906299, 0.5813277319079725, 0.5854980387008708, 0.5894449558108578, 0.5931565422479002, 0.5966268468547146, 0.5998572678060433, 0.602857731282256, 0.6056473787403648, 0.6082545345172964, 0.6107158325978479, 0.6130744982752362, 0.6153778938051647, 0.617674535234992, 0.6200108599169076, 0.6224280620443917, 0.6249593111749042 ], [ 0.5865979764670647, 0.5811170069599665, 0.575732600127492, 0.5704345441156186, 0.5652066953714727, 0.5600311729923898, 0.5548934899299605, 0.549788159050672, 0.5447241763578203, 0.5397296920703788, 0.5348551516105846, 0.530174242189027, 0.5257821344844691, 0.5217907744545996, 0.5183213539084082, 0.515494539311961, 0.5134194984378371, 0.5121831297767934, 0.5118410510170589, 0.5124117487883977, 0.5138748171111118, 0.5161735052574252, 0.5192210316401473, 0.5229094974784987, 0.527119899600442, 0.5317317433779618, 0.5366310422580428, 0.5417159464015596, 0.5468997448046109, 0.5521114325552745, 0.5572943654247372, 0.5624037113115941, 0.5674034523929213, 0.5722636120048601, 0.5769582080839953, 0.5814642105979805, 0.5857615466379895, 0.5898339924442887, 0.5936706446932206, 0.5972675875588139, 0.6006293666570164, 0.6037699343518999, 0.6067128256263671, 0.6094904413042307, 0.6121424392732451, 0.614713350800655, 0.6172496368874462, 0.6197964696247432, 0.6223945583706347, 0.6250773358150388 ], [ 0.5828162721445533, 0.5770807599765527, 0.5714452190518484, 0.565900007278022, 0.5604290194399179, 0.5550140029231181, 0.5496399048321808, 0.5443007726889735, 0.5390055783085353, 0.5337832276134138, 0.5286859799146465, 0.5237905507895435, 0.5191963336381596, 0.5150204599009178, 0.5113898237968257, 0.5084306913384802, 0.5062570204619563, 0.5049590228540748, 0.5045936638791423, 0.5051786211399878, 0.5066906885923833, 0.5090688249438433, 0.5122212026117485, 0.5160349407456958, 0.5203868632663514, 0.5251536547969242, 0.5302201263053055, 0.5354848169091823, 0.540862710328334, 0.5462853269431156, 0.5516988019598487, 0.5570607515502279, 0.5623367641577343, 0.5674972545573239, 0.5725152188138426, 0.5773651738151332, 0.5820233038761358, 0.5864686126347464, 0.5906847221000324, 0.5946618860789097, 0.5983987892102907, 0.6019037700228895, 0.6051952154244794, 0.6083010032846765, 0.6112570010636268, 0.6141047478219508, 0.6168885440796202, 0.6196522410561648, 0.6224360520900801, 0.6252737014347437 ], [ 0.5791011645985027, 0.5731085143888571, 0.5672189131279278, 0.5614234799718968, 0.5557063319368118, 0.5500490047067088, 0.5444360042894532, 0.5388609974354355, 0.5333329775799692, 0.5278816193126449, 0.5225609833181132, 0.5174507808556413, 0.5126545754262606, 0.5082946049313104, 0.5045033479610057, 0.5014124975045392, 0.4991405620638758, 0.4977807579563009, 0.49739103617161107, 0.4979878857885733, 0.49954495729197906, 0.501996673069002, 0.505246067741583, 0.5091753788873727, 0.5136575624949182, 0.5185669759423193, 0.5237878691898752, 0.5292199014472583, 0.5347805040228548, 0.5404044277033322, 0.5460411810218878, 0.5516512604048537, 0.5572020982161514, 0.5626645332024603, 0.56801037816382, 0.5732113717992845, 0.5782395102267011, 0.5830685079620684, 0.5876759724557125, 0.5920458043797077, 0.5961703516688802, 0.6000519288169119, 0.6037034381877242, 0.6071479722271551, 0.6104174145725672, 0.613550180157016, 0.6165883302293611, 0.6195743616187984, 0.622547996596896, 0.6255432887391346 ], [ 0.5754727933117961, 0.5692215313860185, 0.5630760064483367, 0.5570282984793667, 0.5510629443368474, 0.5451614458171832, 0.5393080124965891, 0.5334960346841291, 0.5277345903396495, 0.5220541473784552, 0.5165105586940953, 0.511186490579753, 0.5061896021602525, 0.501647121479896, 0.4976969409764731, 0.49447594308635706, 0.49210687532864716, 0.4906855790876503, 0.4902705682309226, 0.4908767224449952, 0.4924741899986506, 0.49499262464967875, 0.49832987180277033, 0.5023634494069237, 0.5069628247107613, 0.5120005995182724, 0.5173611785787352, 0.5229461368714283, 0.5286761569543799, 0.534489959931299, 0.5403410395102702, 0.54619320592234, 0.5520159600872738, 0.5577805728477545, 0.5634574809713424, 0.5690152866733409, 0.5744213225862786, 0.5796434753352602, 0.5846527861398343, 0.5894262795888842, 0.5939495021107161, 0.5982183542356201, 0.6022399443892271, 0.606032348131597, 0.6096233039858302, 0.6130480014678031, 0.616346210758973, 0.6195590624438145, 0.6227258078331075, 0.6258808755757131 ], [ 0.5719518500586268, 0.5654417575498145, 0.5590396430360786, 0.5527387514649961, 0.5465242479842154, 0.5403777942531659, 0.5342834673826113, 0.528234506021688, 0.5222401544831027, 0.516331712908836, 0.5105668232245498, 0.5050310601170511, 0.49983608256663487, 0.49511395378219075, 0.49100775364239424, 0.48765924657426357, 0.485195030115237, 0.4837131155361781, 0.4832720937856629, 0.48388477372125066, 0.4855174312920022, 0.4880947390097563, 0.4915093489601284, 0.4956342887657038, 0.5003359938620738, 0.5054859607504087, 0.5109695364815883, 0.5166910669856539, 0.5225753339788554, 0.5285657965138351, 0.5346205565567521, 0.5407071676062255, 0.5467974067004976, 0.5528629584182911, 0.5588726594708612, 0.5647915864479729, 0.5705819077061802, 0.5762051269307922, 0.5816251626299281, 0.58681164746278, 0.5917428793967543, 0.5964079813582752, 0.6008079902606579, 0.6049557676379883, 0.6088747796142403, 0.6125969202804564, 0.6161596435915069, 0.6196027226137532, 0.6229649714215861, 0.626281245732883 ], [ 0.5685593882529353, 0.5617916319182168, 0.5551335931078375, 0.5485798863651375, 0.5421165208981997, 0.5357255254250426, 0.5293910267157872, 0.5231062573179857, 0.5168807303048512, 0.5107466337613706, 0.5047634042965252, 0.4990194746701907, 0.49363038766325207, 0.4887328471548394, 0.48447483535234054, 0.48100261699296315, 0.478446168497773, 0.4769051365956056, 0.4764376392517761, 0.47705391444102785, 0.4787159892502013, 0.4813433687378606, 0.4848235616270351, 0.4890254068358054, 0.4938128445428331, 0.49905699315665786, 0.5046449963421178, 0.5104848783633701, 0.516506403705318, 0.5226585560835026, 0.5289046723045124, 0.5352164684518849, 0.5415681843397435, 0.547931872165337, 0.554274514703659, 0.5605572468756986, 0.5667365525729915, 0.5727669888522182, 0.5786047986155577, 0.5842117221774813, 0.5895583874715463, 0.5946268086618262, 0.5994117099450351, 0.6039205788453609, 0.6081725170538138, 0.612196084424925, 0.6160264190797963, 0.6197019641373454, 0.6232611417098247, 0.6267392906886718 ], [ 0.5653166085066788, 0.5582938654249593, 0.5513820279291359, 0.5445772807203897, 0.537866696065452, 0.5312328872844091, 0.5246602293959931, 0.5181421150730896, 0.511688450515284, 0.5053323867532981, 0.4991351724706641, 0.49318804705071023, 0.4876103021412948, 0.48254304800068504, 0.4781388232919697, 0.4745479338485341, 0.47190317824107164, 0.47030522277477343, 0.46981109839483404, 0.47042793685806783, 0.4721131392991232, 0.47478089053002803, 0.47831366610625264, 0.4825764937422554, 0.4874314343574348, 0.4927500282568227, 0.4984221292926628, 0.5043603898674793, 0.5105004658780947, 0.5167976612529246, 0.5232211690033919, 0.5297472706162194, 0.5363528309958496, 0.543010195833696, 0.5496842131559457, 0.5563316390479661, 0.5629027413672656, 0.5693445676225785, 0.5756051456335253, 0.5816378477015347, 0.5874052435635521, 0.5928819461779081, 0.5980561664079861, 0.6029298971851701, 0.6075178194970791, 0.6118451504887814, 0.6159447365783811, 0.6198537349859328, 0.6236102301224415, 0.6272501017858482 ], [ 0.5622446220816653, 0.5549711938767723, 0.547809263835741, 0.5407567784124385, 0.5338020905821359, 0.5269286225109667, 0.5201212102743314, 0.5133735929632112, 0.506696217212558, 0.5001232934962458, 0.493717914511717, 0.487574076327363, 0.4818146673817319, 0.4765849305666475, 0.4720415532824938, 0.4683383437487991, 0.46561027858627074, 0.4639583460681008, 0.4634378143444177, 0.4640521433018407, 0.4657537373490709, 0.4684513487274289, 0.47202259546966285, 0.47632914913948726, 0.48123188410246126, 0.48660362828967574, 0.49233790814297695, 0.4983529839998576, 0.5045913239735599, 0.5110153447329866, 0.5176007020043071, 0.5243286224732635, 0.5311787312449806, 0.5381235663683421, 0.545125538049271, 0.5521365730527505, 0.5591001903154916, 0.5659553768698019, 0.5726414306169433, 0.5791029151081164, 0.585293995498256, 0.5911816359195301, 0.5967473776159966, 0.6019876392960167, 0.6069126604609276, 0.6115443357723039, 0.6159132652956498, 0.6200553779315398, 0.6240084806381834, 0.6278090507142043 ], [ 0.5593641948253911, 0.5518461066516807, 0.5444394771238596, 0.5371441919922721, 0.5299500963251741, 0.5228416479747773, 0.5158043683300135, 0.5088325481110578, 0.5019373451031914, 0.4951541489706294, 0.48854794539655894, 0.48221544123724003, 0.4762829544495241, 0.47089954834779624, 0.46622558959821087, 0.46241777037480775, 0.45961251433560857, 0.45791035459542273, 0.45736406362091303, 0.45797284028659146, 0.4596837356162801, 0.462400004243685, 0.4659946515689871, 0.4703265249072976, 0.4752560757711282, 0.48065834095089394, 0.4864315171856919, 0.49250046736734077, 0.4988153897000075, 0.5053465896682423, 0.5120767669029026, 0.5189924435071948, 0.5260761105877266, 0.5333003728405994, 0.5406248839343886, 0.5479962874850662, 0.5553508314702075, 0.5626189165075437, 0.569730632879936, 0.5766213404585468, 0.5832365037149433, 0.5895352409556104, 0.5954923149748367, 0.6010985323503112, 0.6063597047057114, 0.6112944507388058, 0.6159311875628579, 0.6203046834145625, 0.6244525306801385, 0.62841185663489 ], [ 0.5566954751717509, 0.5489405544634378, 0.5412963928408562, 0.5337649737760367, 0.526337834472433, 0.5190006934756908, 0.5117399899570374, 0.5045507886672423, 0.49744515247137056, 0.4904597943095984, 0.4836616607584237, 0.477150129781802, 0.47105476838363847, 0.46552811125437105, 0.46073367456514264, 0.45683033819928526, 0.45395515813575704, 0.4522073609388838, 0.4516364408453024, 0.4522367319777112, 0.45394959808059426, 0.45667278468821054, 0.460275000632501, 0.4646128742028496, 0.4695472597106948, 0.4749563658919321, 0.48074407609456715, 0.4868428473024043, 0.49321150550680154, 0.49982898972426265, 0.5066855881857715, 0.5137734326096548, 0.5210779554057277, 0.5285716816748918, 0.5362111828632776, 0.5439373744642757, 0.5516787365411552, 0.559356596996775, 0.566891411493954, 0.5742089984278728, 0.5812458841786401, 0.5879532001396331, 0.5942988716525716, 0.6002680969028747, 0.6058623057202291, 0.6110969105317605, 0.615998223211364, 0.6205999252009089, 0.6249394562164389, 0.6290546387655125 ], [ 0.5542577108282865, 0.5462756408056564, 0.5384029520069458, 0.5306438601090868, 0.5229917781314809, 0.5154339039046771, 0.5079578314476658, 0.5005596368088335, 0.4932525041033022, 0.4860746381688989, 0.47909503435928247, 0.4724157098279768, 0.46616928880896025, 0.46051139371886896, 0.4556081031866738, 0.4516197151598122, 0.44868302599293486, 0.4468950388563951, 0.4463011482188198, 0.4468902162033101, 0.44859761750747534, 0.4513156359773344, 0.45490907076545484, 0.4592330029693485, 0.46414956470874863, 0.46954112447699914, 0.47531826732955296, 0.4814220122943032, 0.48782067142450886, 0.49450251440397097, 0.5014659145312724, 0.5087088851237624, 0.516219844545992, 0.5239710772616163, 0.5319157506102808, 0.5399886302076046, 0.5481099724745078, 0.5561916019861858, 0.5641439778142071, 0.5718831076876532, 0.5793364092251332, 0.5864469463186871, 0.5931757991885755, 0.5995026020588394, 0.605424478825233, 0.6109537247629468, 0.6161146343420699, 0.62093987814576, 0.6254668003940076, 0.6297339537394046 ], [ 0.5520689598147622, 0.5438713030105411, 0.5357809634079858, 0.5278044950958033, 0.519937349510199, 0.5121684114048123, 0.5044866674332444, 0.49688945416032165, 0.48939131349337184, 0.4820321344125698, 0.47488306880051673, 0.4680487494690103, 0.46166465621217867, 0.45588908368455827, 0.4508900333037624, 0.44682838526303814, 0.44383971727904487, 0.4420178396163736, 0.4414032005829372, 0.44197859285966107, 0.4436731423325556, 0.4463737816031762, 0.4499418549086165, 0.4542316245096109, 0.45910740853539245, 0.46445672731390764, 0.4701978588131784, 0.47628130566370064, 0.4826856638782112, 0.4894091660627299, 0.4964587067130248, 0.5038384046979655, 0.5115396792883165, 0.519534405879917, 0.527772042376978, 0.5361808222961136, 0.5446723816577047, 0.5531486838581118, 0.5615099091420981, 0.5696620652438186, 0.5775233644837965, 0.5850287868628512, 0.5921326117060208, 0.5988089925814711, 0.6050508496889314, 0.6108674654467261, 0.6162812103839772, 0.6213238179460714, 0.6260325855521784, 0.630446817540703 ], [ 0.5501458025003452, 0.5417459901553096, 0.5334507477313146, 0.5252690420615103, 0.5171985003575682, 0.5092298867093745, 0.5013538149204058, 0.49356913977357575, 0.48589201503161983, 0.4783642274664769, 0.4710592115878114, 0.4640842001508877, 0.45757731790361295, 0.4516990876146957, 0.44661874758535114, 0.4424968685020511, 0.4394667974705458, 0.43761814663702736, 0.4369855645730369, 0.43754520229143073, 0.4392197292282803, 0.4418909028312526, 0.44541712933462024, 0.44965262358806646, 0.45446481161612245, 0.45974733852362065, 0.46542711743880705, 0.47146498513153356, 0.4778505368528475, 0.4845925174596261, 0.4917067061694736, 0.49920349798403724, 0.5070773003648316, 0.5152994127650178, 0.5238153093424626, 0.5325463666989766, 0.5413952815232633, 0.5502538885227726, 0.559011901202696, 0.567565228466293, 0.5758228613918731, 0.5837117465537182, 0.5911794580859309, 0.5981947884622847, 0.6047465788332207, 0.6108412136462575, 0.616499233954144, 0.6217515033194474, 0.626635308970148, 0.6311907122834645 ], [ 0.5485030621326794, 0.5399163462280259, 0.5314307833527744, 0.5230577929142469, 0.5147972866591887, 0.5066420814201084, 0.49858464544160824, 0.4906256139461198, 0.482783020255144, 0.47510078031654, 0.4676547525655108, 0.46055475981043453, 0.4539413523621588, 0.4479768118772278, 0.44283088949103194, 0.43866291199190816, 0.4356029490359313, 0.43373539483244994, 0.4330882584660612, 0.43363051946509096, 0.4352782453408442, 0.43790826100860314, 0.44137660527356015, 0.44553824354613547, 0.45026462299228037, 0.45545644164045407, 0.4610501143544004, 0.46701756580635057, 0.47336000020895175, 0.4800971227202085, 0.4872538760390602, 0.4948470437232842, 0.5028739840413586, 0.5113052653559235, 0.5200821504815607, 0.5291189105168412, 0.5383090810147406, 0.547534208249084, 0.5566734592893658, 0.5656126454370947, 0.5742516064284149, 0.5825093742325453, 0.5903269636019378, 0.5976679584324144, 0.6045172635170658, 0.6108784860880586, 0.6167704286313234, 0.6222231415771531, 0.6272739231778488, 0.6319635785349421 ], [ 0.5471535419771418, 0.5383969079115489, 0.5297373643819451, 0.521188787235893, 0.5127534505870688, 0.5044263753288133, 0.4962021004639797, 0.4880833040250891, 0.48009017532607356, 0.4722690034130764, 0.4646982222503486, 0.45749023707844527, 0.4507877948541198, 0.4447544455485374, 0.4395597006307491, 0.43536068216449486, 0.43228312247463413, 0.4304051882327933, 0.4297474469357093, 0.43027123765694814, 0.43188595222244186, 0.43446379120343864, 0.4378590392009807, 0.4419282176863324, 0.44654767526791794, 0.4516260193008774, 0.4571099299166392, 0.46298305072389173, 0.4692586762039057, 0.47596780049508164, 0.48314471203847736, 0.49081263302950545, 0.4989718142292697, 0.5075919604036171, 0.5166099583763377, 0.5259328203289758, 0.5354448148868319, 0.5450171643905112, 0.5545185305561183, 0.563824736449342, 0.5728266300168737, 0.5814355160944972, 0.5895860437212488, 0.5972367698751353, 0.6043688191877933, 0.6109831436703594, 0.6170968903223901, 0.6227393390489586, 0.6279478020914793, 0.6327637942696607 ], [ 0.5461077875025364, 0.537199826941293, 0.5283842824800404, 0.5196774541626058, 0.5110840242477558, 0.502601344714673, 0.49422622727072724, 0.4859636506076207, 0.4778362393156367, 0.4698929052947263, 0.46221481329459196, 0.45491694049717335, 0.4481439903868863, 0.44206027321947605, 0.4368342909467266, 0.4326199923902428, 0.42953772458584744, 0.427658455051666, 0.4269945710167415, 0.4274993818916052, 0.4290756103783884, 0.43159120363947656, 0.43489933488377064, 0.43885887402655704, 0.44335189331501534, 0.44829566709882135, 0.45364777447884025, 0.45940406128447614, 0.4655902433275643, 0.47224879590497437, 0.47942342804392224, 0.4871437847689829, 0.49541293423436544, 0.5041996187413397, 0.5134362632923675, 0.5230225809521072, 0.5328336010853483, 0.5427303254902894, 0.552571082947331, 0.5622219319381365, 0.5715649800063265, 0.5805040600690038, 0.5889676940022969, 0.5969096185672976, 0.6043073434627362, 0.6111592844154644, 0.6174810044167595, 0.6233010382536276, 0.6286566946119188, 0.6335901418735543 ], [ 0.5453738819819974, 0.5363346271272093, 0.5273825443304331, 0.5185362907226363, 0.5098029706150438, 0.5011823685975638, 0.4926737537392036, 0.48428465387005704, 0.4760404042619744, 0.46799278717051773, 0.4602258487654577, 0.45285711821242974, 0.44603300167012117, 0.4399180481612834, 0.4346789751449539, 0.43046560268239514, 0.4273918836699116, 0.4255206823833305, 0.4248555570373278, 0.4253414963571743, 0.42687464797581604, 0.4293191347546187, 0.4325276764604478, 0.4363622495452525, 0.44071138932596304, 0.4455016704958671, 0.45070205022361903, 0.4563208893272251, 0.46239648609395084, 0.46898283732910556, 0.47613303044051164, 0.48388304870561755, 0.49223868992486275, 0.5011676789731108, 0.5105979864288399, 0.5204221151838552, 0.5305060313348348, 0.5407007702836958, 0.5508546395109838, 0.5608242747013722, 0.5704833866484192, 0.5797286572726634, 0.5884827612054089, 0.5966948425887352, 0.6043389663104309, 0.6114111239732466, 0.6179253513723575, 0.6239094440789473, 0.6294006676378282, 0.6344417648898124 ], [ 0.5449572833652967, 0.5358080057120538, 0.52674013633889, 0.5177745901205202, 0.5089208769702532, 0.5001812899552043, 0.49155772051920976, 0.48306047984293415, 0.4747178780122134, 0.46658480366076616, 0.4587483207827026, 0.45132847333634696, 0.4444730993739525, 0.43834645571710074, 0.43311270822329834, 0.4289166275091526, 0.4258648307558199, 0.4240112722484972, 0.4233501481482952, 0.42381795047355414, 0.42530443856578687, 0.42767039213336183, 0.4307687355653238, 0.43446525518955237, 0.4386555833693475, 0.44327608154935405, 0.44830738823456084, 0.4537705024045148, 0.45971627978454516, 0.4662101146465322, 0.47331430573063354, 0.48107101907571, 0.4894886854075365, 0.49853400975064427, 0.5081306206371842, 0.518164041399226, 0.528491510276978, 0.5389545093206741, 0.5493917801510743, 0.5596509968188205, 0.5695979079200879, 0.5791224279697853, 0.5881417018129868, 0.596600525545486, 0.6044696907085512, 0.6117428672484827, 0.6184326037412735, 0.6245659415285484, 0.6301800406884264, 0.6353181164058104 ], [ 0.5448607092905299, 0.5356236877128675, 0.526461847088391, 0.5173982323800856, 0.5084447150650301, 0.49960614775398576, 0.4908871878782737, 0.482301145096216, 0.47387954934931775, 0.4656806101851876, 0.45779452109425867, 0.4503437779137811, 0.4434773593543296, 0.4373586937551183, 0.43214864946599213, 0.4279860838201354, 0.42496943167227286, 0.4231430562661649, 0.422491397779646, 0.42294240453461085, 0.42437972989742245, 0.42666133618330326, 0.4296409958467152, 0.43318893517874646, 0.4372083928425766, 0.44164583835365945, 0.44649370281871636, 0.45178554300768553, 0.45758454930238385, 0.4639672162390249, 0.4710047566739871, 0.4787452916956964, 0.48719978203054465, 0.4963339690506117, 0.506067364483226, 0.5162788922211622, 0.5268175636572958, 0.5375158829914267, 0.5482036259877872, 0.558720084011515, 0.5689235657604474, 0.5786976607251572, 0.5879543350585201, 0.5966342949053169, 0.6047052285313064, 0.6121585750766452, 0.6190054179097122, 0.6252720078006009, 0.6309953144987269, 0.6362189011211019 ], [ 0.5450840756474016, 0.5357823402576964, 0.5265491562553558, 0.5174095477537951, 0.5083776800244193, 0.49946099324559445, 0.4906670318692185, 0.48201229545405744, 0.47353175179542395, 0.46528711406972606, 0.45737178138020124, 0.4499106041740832, 0.4430533866912258, 0.4369621915013203, 0.43179387796330276, 0.4276806042577899, 0.42471189690478933, 0.42292199785482504, 0.42228535587806343, 0.4227214677801207, 0.4241082588103035, 0.4263014358350475, 0.42915623457036733, 0.43254786270035195, 0.4363875351388491, 0.44063197334865123, 0.4452853105086171, 0.45039336975528715, 0.456031249970058, 0.46228607164153074, 0.4692375321692855, 0.47693940747829633, 0.485405080685145, 0.4945994470586709, 0.5044382425572955, 0.5147943232791843, 0.5255091406571416, 0.5364069572673299, 0.5473093241219259, 0.5580478420895711, 0.5684739851435971, 0.5784655143792473, 0.5879295982178402, 0.5968031216949359, 0.6050508367311002, 0.6126620300914376, 0.6196463239834358, 0.6260291215792626, 0.631847096039424, 0.6371440132092063 ], [ 0.5456244922327509, 0.5362815517411621, 0.5270001961709816, 0.5178072604382817, 0.5087191167944695, 0.49974580042716615, 0.4908978405876705, 0.4821950901406533, 0.4736761379244407, 0.46540634150645416, 0.4574823356856363, 0.4500311857893366, 0.4432031796951977, 0.43715848047301625, 0.43204927405935145, 0.42800033074082555, 0.4250916853454894, 0.423347099234634, 0.4227309667842061, 0.42315456995444184, 0.4244905761970044, 0.42659302593353704, 0.42931919325897844, 0.43254970858706265, 0.4362039847825242, 0.4402489560913213, 0.4447001630215039, 0.4496151925559887, 0.4550804238589732, 0.46119295372336006, 0.46804040375526834, 0.47568183300211014, 0.48413293475134334, 0.4933579358671789, 0.5032692505396043, 0.5137343455980382, 0.5245879389642357, 0.5356469410578181, 0.5467255524434146, 0.5576484814034547, 0.5682610487517896, 0.578435733019843, 0.5880753122569942, 0.597113128016063, 0.6055111590020661, 0.6132566059974385, 0.6203576172881936, 0.6268386724397133, 0.632736022423817, 0.6380934720919216 ], [ 0.5464763168473714, 0.5371158779976599, 0.5278097891238323, 0.5185865165725482, 0.5094645389042383, 0.5004564760789141, 0.491575916385516, 0.48284619746934004, 0.4743096703523793, 0.4660354264390589, 0.4581233108496292, 0.45070241472093125, 0.44392313910585596, 0.4379432222976336, 0.43290957100341043, 0.42893899219302156, 0.4261016053975989, 0.4244105168630559, 0.42382018337873745, 0.4242340531067594, 0.4255200922157178, 0.4275312812087138, 0.43012745804567803, 0.43319501017974216, 0.4366616190683586, 0.440504211184525, 0.4447492408814368, 0.44946535337808907, 0.4547493867571912, 0.4607075972782429, 0.4674348455665549, 0.47499503316819197, 0.48340604537219584, 0.49263167311702216, 0.5025815668107944, 0.5131186177152302, 0.5240717830332231, 0.5352516503411154, 0.5464660649082509, 0.5575337356544197, 0.5682945802215132, 0.578616384186123, 0.5883979659087432, 0.5975694087716735, 0.6060900780290135, 0.6139451443733637, 0.6211412548706355, 0.6277018731911029, 0.6336626860966734, 0.6390673581869342 ], [ 0.5476312668056242, 0.5382769547999964, 0.5289695600594593, 0.5197389964927055, 0.5106057397613533, 0.5015849697335065, 0.49269338439391347, 0.48395790227977686, 0.4754247293101766, 0.4671667208230077, 0.4592868437501039, 0.4519159716330983, 0.44520421935526294, 0.4393063888858164, 0.4343635706078902, 0.43048415845652577, 0.4277281039300004, 0.4260978749183142, 0.42553828736785987, 0.42594547528354115, 0.4271833369067734, 0.4291044071803988, 0.4315715567641178, 0.4344771551483396, 0.4377570753225532, 0.44139784288211276, 0.445436147113885, 0.4499507988573944, 0.45504809725990947, 0.46084248880273376, 0.4674352736512622, 0.4748946908177927, 0.4832406909705057, 0.4924369070267718, 0.5023908725965178, 0.5129618336212287, 0.5239740857725197, 0.535233043846154, 0.5465412972269551, 0.5577125308997921, 0.5685820684243588, 0.5790136300706462, 0.5889025258348262, 0.5981758736387075, 0.6067905831271809, 0.6147298428836395, 0.6219987601799705, 0.6286196778116837, 0.6346275635587125, 0.6400657505720919 ], [ 0.5490785844264892, 0.5397536730424559, 0.5304681208016739, 0.5212531070958205, 0.5121309920138316, 0.5031194787361762, 0.4942384020830905, 0.4855183193521194, 0.4770093304399769, 0.46878801917530405, 0.46096031733479415, 0.4536585805724274, 0.4470322108905712, 0.4412325817579924, 0.43639450708743993, 0.4326176517444018, 0.4299517218397621, 0.4283887537554772, 0.42786439210924754, 0.4282681037204469, 0.42946041696598536, 0.43129403381147713, 0.4336352653423023, 0.43638258091359705, 0.43947982935869423, 0.44292258518968913, 0.44675692880437545, 0.4510707806191538, 0.45597875046393455, 0.4616023745795112, 0.4680484941223694, 0.4753891227990749, 0.48364613838109294, 0.4927833263736316, 0.502706819278821, 0.5132732396935751, 0.5243034213549903, 0.5355988528803035, 0.5469580510594545, 0.5581907190507992, 0.5691284439859144, 0.5796315404695941, 0.5895922797213882, 0.5989351146820608, 0.6076146575712364, 0.6156121583745118, 0.622931138790817, 0.6295927073734158, 0.6356309496718798, 0.6410886683390088 ], [ 0.5508052508179616, 0.5415324101843689, 0.5322913185810297, 0.5231142462712143, 0.5140253260979327, 0.5050447386925809, 0.4961954593677389, 0.4875117015491711, 0.479047440796313, 0.47088288452320387, 0.46312670143441004, 0.4559123723883902, 0.44938813595024835, 0.4437014702080489, 0.438980535504351, 0.43531608853280535, 0.4327476858001375, 0.4312573203631931, 0.4307720937773812, 0.4311755638269709, 0.4323256373791063, 0.4340757849249054, 0.4362961025421137, 0.4388911761486002, 0.44181249006406614, 0.44506398140647047, 0.44870013949368154, 0.45281680473804925, 0.4575356249611515, 0.46298402131074085, 0.46927339783777033, 0.47647893139143355, 0.4846242736269464, 0.4936736908656404, 0.5035326745521211, 0.5140563079367415, 0.5250632319932846, 0.5363523239367745, 0.5477192716310157, 0.5589708876426276, 0.56993591727591, 0.5804719547042875, 0.5904687179777931, 0.599848304099392, 0.6085631892146327, 0.6165927277908356, 0.6239388076056915, 0.6306211860198062, 0.6366728993236197, 0.6421360171923338 ], [ 0.5527962403197297, 0.5435973091272094, 0.5344225387789012, 0.5253051280184727, 0.5162708753366678, 0.507342385506969, 0.49854575443020077, 0.48991882695928324, 0.4815193764969332, 0.47343105831335264, 0.4657649797962648, 0.4586553367601921, 0.45224873545893013, 0.4466883230689368, 0.4420953160840509, 0.43855151935445535, 0.4360866000174016, 0.4346730617038909, 0.43423022999028493, 0.43463660284077793, 0.4357482482191839, 0.4374199867717639, 0.43952598104905005, 0.441976858304551, 0.4447312910510218, 0.44780078174578813, 0.45124713904860386, 0.4551728347865944, 0.45970519466893583, 0.46497624669116955, 0.4711009232148608, 0.4781569150726997, 0.4861694769097045, 0.4951036855342789, 0.5048651690024978, 0.5153085844108333, 0.5262516846406015, 0.5374920872098738, 0.5488239293527416, 0.5600522542972043, 0.5710038845259088, 0.5815343977752799, 0.5915314582218683, 0.6009151254594755, 0.6096359071440105, 0.6176713091943994, 0.6250215394691475, 0.6317048886644536, 0.6377531779139113, 0.6432075425980402 ], [ 0.5550348064699623, 0.5459305938545906, 0.5368430496043677, 0.5278061543560494, 0.5188472721651257, 0.5099913722267037, 0.5012676273388231, 0.4927174461999223, 0.4844022624130923, 0.4764089338957106, 0.4688506419583342, 0.4618618400058575, 0.4555870221405847, 0.45016460640897965, 0.44570866337410703, 0.4422921318154739, 0.439935199783946, 0.4386015797457811, 0.4382037026483601, 0.4386159239999677, 0.43969327280456755, 0.44129247354248624, 0.44329197547404436, 0.44560829156274934, 0.44820674855021486, 0.451105533741003, 0.45437261175685967, 0.4581157354556143, 0.4624664985274871, 0.46756021840486633, 0.47351429016819874, 0.4804082449357641, 0.48826875018339405, 0.49706200842580067, 0.5066945523759322, 0.5170217214700371, 0.5278616852423388, 0.5390121575245521, 0.5502670108658042, 0.5614306503300313, 0.5723289057133231, 0.5828160537326846, 0.592778215021492, 0.6021337405081411, 0.6108313461403314, 0.618846744424701, 0.6261784245571184, 0.6328431016354418, 0.6388712217797144, 0.6443027905044696 ], [ 0.5575027894085388, 0.5485129100050674, 0.5395323750683112, 0.5305958186099242, 0.5217320784327589, 0.5129684222355152, 0.5043370318874634, 0.495882769479861, 0.48767053287309053, 0.47979007196987244, 0.47235621758103763, 0.4655031851088239, 0.45937287452539666, 0.4540986194543998, 0.44978722965622775, 0.4465029831049664, 0.4442571300254644, 0.4430054086871538, 0.44265432338336963, 0.4430750482380797, 0.44412237356879086, 0.4456554462466206, 0.447557164475229, 0.44974970390079305, 0.4522044464052508, 0.4549453291402617, 0.4580452698109768, 0.46161592787988126, 0.4657917434966292, 0.47071000137903607, 0.476489489253091, 0.483210894704122, 0.49090208857750955, 0.49953068554486646, 0.5090048555553189, 0.5191816913475117, 0.5298810491473795, 0.5409020670253725, 0.5520396193509418, 0.5630985936739041, 0.5739047546047725, 0.5843117968016313, 0.594204815527155, 0.6035007922377029, 0.612146839679625, 0.6201169441545118, 0.6274078493002905, 0.634034597021159, 0.6400261093016624, 0.6454210763643254 ], [ 0.5601809342689361, 0.5513236781303443, 0.5424686821699862, 0.5336511242262498, 0.5249012323329065, 0.5162485000272964, 0.5077280259012625, 0.4993879730005692, 0.4912964525272807, 0.48354573677680196, 0.47625183151228984, 0.46954819138670306, 0.46357364794908945, 0.4584561430204532, 0.4542951946967235, 0.4511467317012193, 0.44901371619076746, 0.4478448195490845, 0.4475416448739816, 0.4479731649877156, 0.44899471577181954, 0.45046834382547335, 0.4522815048060224, 0.45436176028931136, 0.45668590476097903, 0.45928266394379574, 0.46222869950280165, 0.46563821536320377, 0.46964710167349005, 0.474393316976241, 0.47999599318450825, 0.4865362954509624, 0.4940430709254931, 0.5024855924326206, 0.5117743415166536, 0.5217691678525143, 0.5322928174602428, 0.5431471219170705, 0.5541291784246055, 0.565045447040261, 0.5757225381140947, 0.586014278354634, 0.5958052597871382, 0.6050114435276451, 0.6135785411570164, 0.6214788952941555, 0.6287074929869428, 0.6352776209962048, 0.6412165430619547, 0.6465614628852897 ], [ 0.5630492103391359, 0.554341447703918, 0.5456291686415781, 0.5369480038330585, 0.5283294952692964, 0.5198052817471072, 0.5114132614087696, 0.5032047056281129, 0.4952506380651058, 0.4876454335639943, 0.4805057598522701, 0.4739637735527868, 0.4681547814408723, 0.4632010781680031, 0.45919493814557233, 0.4561843430793118, 0.4541647007777336, 0.45307858392562184, 0.4528237482530602, 0.4532679405895376, 0.4542677955657218, 0.4556886907352515, 0.45742269899481697, 0.4594024510412081, 0.4616094888014533, 0.4640763655119091, 0.46688230212660675, 0.47014273034416826, 0.4739936522433262, 0.4785724659190582, 0.48399764487766644, 0.4903501726950843, 0.4976596315255312, 0.5058971495311302, 0.5149761176215434, 0.5247600535684176, 0.5350757013152013, 0.5457287692339907, 0.5565197289414192, 0.5672576533439309, 0.577770879134471, 0.5879140655370301, 0.597571822800442, 0.6066594493457546, 0.6151214720136097, 0.6229286899292601, 0.6300743415963104, 0.6365698959416405, 0.6424408430549375, 0.6477227466421935 ], [ 0.5660871215337501, 0.5575442409109994, 0.5489904388013516, 0.5404617247455785, 0.5319908837113267, 0.5236116096882037, 0.5153644583112139, 0.507303579184667, 0.4995025640446816, 0.4920574305669453, 0.4850849701850377, 0.47871550310755434, 0.47308038302293237, 0.4682960570499631, 0.46444767592423686, 0.4615757501278497, 0.45966892554501515, 0.4586646761467924, 0.4584579647573399, 0.45891626086178283, 0.4598982067526161, 0.46127289245072106, 0.46293702458949837, 0.4648279592273878, 0.4669313171345765, 0.4692825420051212, 0.47196228084603914, 0.4750859505794521, 0.47878841409731815, 0.4832053601217334, 0.4884536682191496, 0.49461351481607396, 0.5017149662902393, 0.509731149781952, 0.5185788735614815, 0.5281261228168904, 0.5382046299650664, 0.5486250545644127, 0.5591923039316523, 0.5697190371657523, 0.580036154456178, 0.5899998253739457, 0.5994951938360621, 0.6084372593227465, 0.6167695945382443, 0.6244615742731953, 0.6315047178641143, 0.6379086357406557, 0.6436969506063915, 0.6489034534047781 ], [ 0.5692739999201899, 0.5609098767423614, 0.5525288568803122, 0.5441672692590142, 0.5358590735613147, 0.5276399176868374, 0.5195528481511117, 0.5116546288266849, 0.5040210393008387, 0.4967492520211371, 0.48995563251785834, 0.48376813857599293, 0.47831377988380697, 0.4737030123892308, 0.47001404710994393, 0.4672804549254584, 0.46548494616945824, 0.4645609004866376, 0.46440151763943344, 0.46487489252738673, 0.46584232874543385, 0.46717695829312694, 0.4687801003842336, 0.4705934778400527, 0.4726061352311384, 0.47485551405171306, 0.4774226280527053, 0.4804217343076768, 0.4839854152092393, 0.48824660739544223, 0.4933197452752423, 0.4992836182033627, 0.5061685222210124, 0.5139496723435409, 0.5225477046858442, 0.531835746306659, 0.5416513746417351, 0.5518111482242937, 0.5621253639999647, 0.5724111586307375, 0.5825027774381253, 0.5922585466323596, 0.6015646473139554, 0.6103361465399106, 0.6185159063484662, 0.6260720155087293, 0.6329943261000519, 0.6392905732451494, 0.6449824423461912, 0.650101841780994 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
hartmann6: -0.357682 (SEM: 0)
x1: 0.390009
x2: 0.484777
x3: 0.620187
x4: 0.372901
x5: 0.968942
x6: 0.270128", "Arm 1_0
hartmann6: -0.0123379 (SEM: 0)
x1: 0.68776
x2: 0.615438
x3: 0.689196
x4: 0.417482
x5: 0.915375
x6: 0.676682", "Arm 2_0
hartmann6: -0.161943 (SEM: 0)
x1: 0.95764
x2: 0.167751
x3: 0.496014
x4: 0.642918
x5: 0.30651
x6: 0.92583", "Arm 3_0
hartmann6: -0.189115 (SEM: 0)
x1: 0.0926778
x2: 0.332059
x3: 0.0585783
x4: 0.0471739
x5: 0.0107612
x6: 0.887374", "Arm 4_0
hartmann6: -0.0548382 (SEM: 0)
x1: 0.26073
x2: 0.286949
x3: 0.275763
x4: 0.888628
x5: 0.232173
x6: 0.882619", "Arm 5_0
hartmann6: -0.270411 (SEM: 0)
x1: 0.639662
x2: 0.842044
x3: 0.622089
x4: 0.520951
x5: 0.121692
x6: 0.388392", "Arm 6_0
hartmann6: -0.0118853 (SEM: 0)
x1: 0.994613
x2: 0.196109
x3: 0.520917
x4: 0.268871
x5: 0.0392088
x6: 0.100654", "Arm 7_0
hartmann6: -1.23858 (SEM: 0)
x1: 0.206567
x2: 0.986012
x3: 0.304217
x4: 0.470113
x5: 0.607818
x6: 0.0988146", "Arm 8_0
hartmann6: -0.299425 (SEM: 0)
x1: 0.357994
x2: 0.705235
x3: 0.162171
x4: 0.689849
x5: 0.276761
x6: 0.458443", "Arm 9_0
hartmann6: -0.138516 (SEM: 0)
x1: 0.485334
x2: 0.337206
x3: 0.485432
x4: 0.916801
x5: 0.145307
x6: 0.881819", "Arm 10_0
hartmann6: -0.192243 (SEM: 0)
x1: 0.00647854
x2: 0.599803
x3: 0.508827
x4: 0.141854
x5: 0.236467
x6: 0.164607", "Arm 11_0
hartmann6: -0.0806938 (SEM: 0)
x1: 0.459401
x2: 0.898029
x3: 0.99714
x4: 0.650145
x5: 0.22863
x6: 0.988373", "Arm 12_0
hartmann6: -0.709042 (SEM: 0)
x1: 0.148654
x2: 0.890722
x3: 0.322065
x4: 0.396069
x5: 0.512522
x6: 0.110999", "Arm 13_0
hartmann6: -0.913483 (SEM: 0)
x1: 0.173257
x2: 0.938148
x3: 0.315384
x4: 0.421139
x5: 0.551775
x6: 0.104992", "Arm 14_0
hartmann6: -0.952027 (SEM: 0)
x1: 0.156095
x2: 0.903943
x3: 0.303977
x4: 0.495681
x5: 0.558742
x6: 0.109725", "Arm 15_0
hartmann6: -0.73597 (SEM: 0)
x1: 0.138462
x2: 0.887222
x3: 0.315214
x4: 0.440501
x5: 0.631318
x6: 0.101687", "Arm 16_0
hartmann6: -1.41389 (SEM: 0)
x1: 0.213419
x2: 0.931309
x3: 0.302199
x4: 0.493319
x5: 0.476509
x6: 0.119136", "Arm 17_0
hartmann6: -1.6912 (SEM: 0)
x1: 0.23707
x2: 0.931752
x3: 0.29827
x4: 0.526668
x5: 0.457952
x6: 0.121935", "Arm 18_0
hartmann6: -2.14452 (SEM: 0)
x1: 0.277411
x2: 0.909669
x3: 0.289103
x4: 0.577296
x5: 0.408704
x6: 0.122599", "Arm 19_0
hartmann6: -2.56115 (SEM: 0)
x1: 0.330297
x2: 0.877442
x3: 0.27184
x4: 0.634409
x5: 0.351309
x6: 0.110301", "Arm 20_0
hartmann6: -2.679 (SEM: 0)
x1: 0.373742
x2: 0.86826
x3: 0.257991
x4: 0.670804
x5: 0.327703
x6: 0.0953997", "Arm 21_0
hartmann6: -2.80175 (SEM: 0)
x1: 0.380542
x2: 0.867854
x3: 0.183501
x4: 0.637279
x5: 0.294266
x6: 0.102488", "Arm 22_0
hartmann6: -2.48953 (SEM: 0)
x1: 0.379637
x2: 0.900776
x3: 0.133906
x4: 0.683591
x5: 0.28126
x6: 0.118635", "Arm 23_0
hartmann6: -2.99986 (SEM: 0)
x1: 0.3988
x2: 0.863998
x3: 0.204404
x4: 0.557786
x5: 0.329601
x6: 0.0890017" ], "type": "scatter", "x": [ 0.39000874757766724, 0.687760048545897, 0.9576395759359002, 0.0926778158172965, 0.2607303876429796, 0.6396621037274599, 0.9946128223091364, 0.20656659547239542, 0.35799355898052454, 0.4853339958935976, 0.00647854246199131, 0.45940114092081785, 0.14865416557074349, 0.17325699289581364, 0.15609532635273107, 0.13846156901837675, 0.21341931425309868, 0.23706991985741568, 0.2774112084230395, 0.33029706062391895, 0.37374210927118157, 0.3805422671622196, 0.3796368658852596, 0.398799983715681 ], "xaxis": "x", "y": [ 0.48477688431739807, 0.6154378708451986, 0.16775123495608568, 0.33205884136259556, 0.2869488541036844, 0.8420444577932358, 0.19610906951129436, 0.9860119735822082, 0.7052349736914039, 0.33720611222088337, 0.5998026626184583, 0.898029220290482, 0.8907215834754846, 0.9381481282078161, 0.9039430771781723, 0.887222090945938, 0.9313088555152559, 0.9317521768838072, 0.9096691710485897, 0.8774421557504858, 0.8682598103138811, 0.8678538093147753, 0.900775599635827, 0.8639979152227888 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
hartmann6: -0.357682 (SEM: 0)
x1: 0.390009
x2: 0.484777
x3: 0.620187
x4: 0.372901
x5: 0.968942
x6: 0.270128", "Arm 1_0
hartmann6: -0.0123379 (SEM: 0)
x1: 0.68776
x2: 0.615438
x3: 0.689196
x4: 0.417482
x5: 0.915375
x6: 0.676682", "Arm 2_0
hartmann6: -0.161943 (SEM: 0)
x1: 0.95764
x2: 0.167751
x3: 0.496014
x4: 0.642918
x5: 0.30651
x6: 0.92583", "Arm 3_0
hartmann6: -0.189115 (SEM: 0)
x1: 0.0926778
x2: 0.332059
x3: 0.0585783
x4: 0.0471739
x5: 0.0107612
x6: 0.887374", "Arm 4_0
hartmann6: -0.0548382 (SEM: 0)
x1: 0.26073
x2: 0.286949
x3: 0.275763
x4: 0.888628
x5: 0.232173
x6: 0.882619", "Arm 5_0
hartmann6: -0.270411 (SEM: 0)
x1: 0.639662
x2: 0.842044
x3: 0.622089
x4: 0.520951
x5: 0.121692
x6: 0.388392", "Arm 6_0
hartmann6: -0.0118853 (SEM: 0)
x1: 0.994613
x2: 0.196109
x3: 0.520917
x4: 0.268871
x5: 0.0392088
x6: 0.100654", "Arm 7_0
hartmann6: -1.23858 (SEM: 0)
x1: 0.206567
x2: 0.986012
x3: 0.304217
x4: 0.470113
x5: 0.607818
x6: 0.0988146", "Arm 8_0
hartmann6: -0.299425 (SEM: 0)
x1: 0.357994
x2: 0.705235
x3: 0.162171
x4: 0.689849
x5: 0.276761
x6: 0.458443", "Arm 9_0
hartmann6: -0.138516 (SEM: 0)
x1: 0.485334
x2: 0.337206
x3: 0.485432
x4: 0.916801
x5: 0.145307
x6: 0.881819", "Arm 10_0
hartmann6: -0.192243 (SEM: 0)
x1: 0.00647854
x2: 0.599803
x3: 0.508827
x4: 0.141854
x5: 0.236467
x6: 0.164607", "Arm 11_0
hartmann6: -0.0806938 (SEM: 0)
x1: 0.459401
x2: 0.898029
x3: 0.99714
x4: 0.650145
x5: 0.22863
x6: 0.988373", "Arm 12_0
hartmann6: -0.709042 (SEM: 0)
x1: 0.148654
x2: 0.890722
x3: 0.322065
x4: 0.396069
x5: 0.512522
x6: 0.110999", "Arm 13_0
hartmann6: -0.913483 (SEM: 0)
x1: 0.173257
x2: 0.938148
x3: 0.315384
x4: 0.421139
x5: 0.551775
x6: 0.104992", "Arm 14_0
hartmann6: -0.952027 (SEM: 0)
x1: 0.156095
x2: 0.903943
x3: 0.303977
x4: 0.495681
x5: 0.558742
x6: 0.109725", "Arm 15_0
hartmann6: -0.73597 (SEM: 0)
x1: 0.138462
x2: 0.887222
x3: 0.315214
x4: 0.440501
x5: 0.631318
x6: 0.101687", "Arm 16_0
hartmann6: -1.41389 (SEM: 0)
x1: 0.213419
x2: 0.931309
x3: 0.302199
x4: 0.493319
x5: 0.476509
x6: 0.119136", "Arm 17_0
hartmann6: -1.6912 (SEM: 0)
x1: 0.23707
x2: 0.931752
x3: 0.29827
x4: 0.526668
x5: 0.457952
x6: 0.121935", "Arm 18_0
hartmann6: -2.14452 (SEM: 0)
x1: 0.277411
x2: 0.909669
x3: 0.289103
x4: 0.577296
x5: 0.408704
x6: 0.122599", "Arm 19_0
hartmann6: -2.56115 (SEM: 0)
x1: 0.330297
x2: 0.877442
x3: 0.27184
x4: 0.634409
x5: 0.351309
x6: 0.110301", "Arm 20_0
hartmann6: -2.679 (SEM: 0)
x1: 0.373742
x2: 0.86826
x3: 0.257991
x4: 0.670804
x5: 0.327703
x6: 0.0953997", "Arm 21_0
hartmann6: -2.80175 (SEM: 0)
x1: 0.380542
x2: 0.867854
x3: 0.183501
x4: 0.637279
x5: 0.294266
x6: 0.102488", "Arm 22_0
hartmann6: -2.48953 (SEM: 0)
x1: 0.379637
x2: 0.900776
x3: 0.133906
x4: 0.683591
x5: 0.28126
x6: 0.118635", "Arm 23_0
hartmann6: -2.99986 (SEM: 0)
x1: 0.3988
x2: 0.863998
x3: 0.204404
x4: 0.557786
x5: 0.329601
x6: 0.0890017" ], "type": "scatter", "x": [ 0.39000874757766724, 0.687760048545897, 0.9576395759359002, 0.0926778158172965, 0.2607303876429796, 0.6396621037274599, 0.9946128223091364, 0.20656659547239542, 0.35799355898052454, 0.4853339958935976, 0.00647854246199131, 0.45940114092081785, 0.14865416557074349, 0.17325699289581364, 0.15609532635273107, 0.13846156901837675, 0.21341931425309868, 0.23706991985741568, 0.2774112084230395, 0.33029706062391895, 0.37374210927118157, 0.3805422671622196, 0.3796368658852596, 0.398799983715681 ], "xaxis": "x2", "y": [ 0.48477688431739807, 0.6154378708451986, 0.16775123495608568, 0.33205884136259556, 0.2869488541036844, 0.8420444577932358, 0.19610906951129436, 0.9860119735822082, 0.7052349736914039, 0.33720611222088337, 0.5998026626184583, 0.898029220290482, 0.8907215834754846, 0.9381481282078161, 0.9039430771781723, 0.887222090945938, 0.9313088555152559, 0.9317521768838072, 0.9096691710485897, 0.8774421557504858, 0.8682598103138811, 0.8678538093147753, 0.900775599635827, 0.8639979152227888 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x2" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot())" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can also retrieve a contour plot for the other metric, \"l2norm\" –– say, we are interested in seeing the response surface for parameters \"x3\" and \"x4\" for this one." ] }, { "cell_type": "code", "execution_count": 12, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:46] ax.service.ax_client: Retrieving contour plot with parameter 'x3' on X-axis and 'x4' on Y-axis, for metric 'l2norm'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ 1.0082175484999478, 1.0058230160377304, 1.003819462903164, 1.0022206140962509, 1.0010388500259046, 1.0002850987590504, 0.9999687449022652, 1.000097556927041, 1.0006776339846701, 1.0017133723621556, 1.0032074507649407, 1.0051608326489967, 1.0075727829530248, 1.0104408958917572, 1.013761130050079, 1.0175278469326359, 1.0217338494132708, 1.0263704171931192, 1.031427337372792, 1.036892929485692, 1.042754065704535, 1.0489961882741885, 1.055603327388059, 1.062558123571951, 1.0698418590606673, 1.077434502589356, 1.085314771473826, 1.0934602138811804, 1.1018473129063837, 1.1104516126174575, 1.1192478647720492, 1.1282101935874982, 1.1373122748834719, 1.1465275251830669, 1.1558292959822003, 1.1651910683618705, 1.1745866433748713, 1.1839903241209764, 1.193377086057369, 1.2027227328033083, 1.2120040354284398, 1.221198853914833, 1.230286240120838, 1.2392465221290552, 1.2480613703226817, 1.2567138459022322, 1.2651884328342482, 1.273471054422361, 1.2815490758209926, 1.2894112938828945 ], [ 1.008090862242524, 1.0057186594124052, 1.0037445096940476, 1.0021825198949816, 1.001045385664899, 1.0003442737562378, 1.0000887224099397, 1.0002865621281867, 1.000943858261401, 1.0020648758367323, 1.0036520659520853, 1.0057060719372541, 1.0082257524434115, 1.0112082177715014, 1.0146488751923108, 1.0185414788296117, 1.0228781799229867, 1.027649573965078, 1.0328447422742988, 1.0384512869233913, 1.0444553594593877, 1.050841685355474, 1.0575935874568414, 1.0646930126614074, 1.0721205665907014, 1.0798555609890454, 1.0878760780395746, 1.096159054769354, 1.1046803893563502, 1.1134150696089007, 1.122337322337834, 1.131420780943242, 1.1406386674172322, 1.1499639841996412, 1.1593697109400565, 1.168829001198292, 1.178315374401184, 1.1878028988929366, 1.1972663625883828, 1.2066814284876897, 1.2160247730728313, 1.2252742063310482, 1.2344087728048547, 1.2434088336319382, 1.2522561300030453, 1.2609338288322611, 1.2694265517079821, 1.277720388384145, 1.285802896191885, 1.2936630868134609 ], [ 1.0082582740464725, 1.0059113798069141, 1.0039695828513064, 1.002447395019119, 1.0013578482663237, 1.000712365655718, 1.000520652000405, 1.0007906069484833, 1.001528262393616, 1.002737744984071, 1.0044212632487586, 1.006579117557812, 1.0092097299022678, 1.0123096894401433, 1.0158738090369959, 1.0198951877302824, 1.024365274233367, 1.0292739272794034, 1.0346094697427926, 1.0403587349604866, 1.046507105353176, 1.0530385451302313, 1.05993563035558, 1.0671795807756304, 1.0747502984281068, 1.0826264180867713, 1.090785374051068, 1.0992034867338598, 1.1078560710703358, 1.1167175671428802, 1.1257616917788362, 1.1349616084049097, 1.1442901112665635, 1.1537198193259177, 1.1632233747617469, 1.17277364098647, 1.1823438954079253, 1.1919080127168962, 1.2014406351895652, 1.2109173272761296, 1.2203147125361824, 1.2296105917269797, 1.238784041517958, 1.247815493875423, 1.25668679662675, 1.2653812560762883, 1.2738836628123276, 1.2821803020273403, 1.2902589497847405, 1.298108856717449 ], [ 1.0087261995425179, 1.0064075091845397, 1.0045009057059942, 1.003021331132507, 1.0019821771160402, 1.0013951432673522, 1.0012701166852511, 1.0016150760805864, 1.0024360229226752, 1.003736940805866, 1.0055197828157452, 1.0077844851733195, 1.0105290039840122, 1.0137493706652736, 1.017439760717715, 1.0215925700648043, 1.026198493296856, 1.031246598838189, 1.0367243972652254, 1.0426179006218554, 1.0489116724324066, 1.0555888699908351, 1.062631282185416, 1.0700193674008731, 1.0777322967707934, 1.0857480081506647, 1.0940432756450318, 1.1025937984312635, 1.1113743111265726, 1.120358716234361, 1.1295202374858586, 1.138831591348199, 1.1482651727436017, 1.1577932502005335, 1.1673881652613693, 1.1770225309739548, 1.186669424630973, 1.1963025705047599, 1.2058965090643254, 1.2154267499722275, 1.2248699069710263, 1.234203813530772, 1.2434076188062286, 1.2524618640261582, 1.2613485399011766, 1.2700511259942628, 1.2785546132573236, 1.2868455111110273, 1.2949118405462683, 1.3027431147683448 ], [ 1.0095008101907854, 1.0072131264213517, 1.0053444356878427, 1.0039101370947234, 1.002924007600345, 1.0023980462030477, 1.002342340859414, 1.0027649622345205, 1.0036718873507602, 1.0050669548490316, 1.0069518519797938, 1.0093261317176156, 1.0121872566938244, 1.0155306651403353, 1.0193498529075922, 1.02363646501139, 1.0283803901789064, 1.0335698525368024, 1.039191495865614, 1.0452304576061708, 1.0516704318490917, 1.0584937226281133, 1.0656812907229258, 1.0732127986317237, 1.081066659229043, 1.0892200937905545, 1.097649204544555, 1.1063290657895841, 1.1152338360607141, 1.1243368920407548, 1.1336109831155194, 1.1430284038616763, 1.1525611804814209, 1.1621812663478142, 1.1718607414214273, 1.1815720103112857, 1.1912879941094405, 1.200982311737731, 1.210629447310298, 1.220204900849197, 1.2296853205201594, 1.2390486153294211, 1.248274047905001, 1.2573423075601444, 1.2662355642970233, 1.2749375047592741, 1.2834333513926806, 1.2917098662373405, 1.2997553408661604, 1.3075595740178796 ], [ 1.0105880392051991, 1.0083340670525953, 1.006505877756891, 1.0051193558545821, 1.0041886912545726, 1.0037262076960922, 1.0037422154379123, 1.004244893080782, 1.0052402023347864, 1.006731838064742, 1.0087212141577535, 1.0112074837867695, 1.014187590665173, 1.0176563461015458, 1.0216065252764233, 1.0260289753556977, 1.0309127279539316, 1.0362451091122453, 1.0420118413098116, 1.0481971339430194, 1.0547837609590311, 1.061753126650714, 1.0690853227261483, 1.0767591814074307, 1.0847523303033295, 1.09304125504318, 1.1016013751584108, 1.110407137553966, 1.1194321303007388, 1.1286492176250404, 1.138030695104024, 1.1475484624061265, 1.157174209597713, 1.1668796121624045, 1.1766365294690087, 1.186417201442779, 1.1961944385666103, 1.2059418009675027, 1.2156337631282343, 1.225245861614697, 1.2347548240512187, 1.2441386783565345, 1.2533768419375055, 1.262450191108827, 1.2713411114614441, 1.280033530244281, 1.2885129320651179, 1.2967663593701964, 1.304782399244384, 1.3125511580979408 ], [ 1.0119935865802767, 1.009775932804927, 1.007990698388693, 1.0066542827409215, 1.0057813181175974, 1.005384480687273, 1.005474327258681, 1.0060591634822562, 1.0071449481999006, 1.008735237010946, 1.0108311661267528, 1.0134314753438542, 1.016532566672099, 1.0201285930439163, 1.0242115698463494, 1.0287715009766496, 1.0337965108795644, 1.0392729746423923, 1.0451856396524983, 1.0515177344015696, 1.0582510624993706, 1.0653660825305358, 1.07284197673494, 1.0806567133349174, 1.0887871084687224, 1.09720889401603, 1.105896797127789, 1.114824636110782, 1.1239654356591473, 1.1332915625089461, 1.1427748806634606, 1.1523869236143787, 1.1620990796280533, 1.171882785268907, 1.181709721913518, 1.191552010030828, 1.201382396386055, 1.2111744299672516, 1.2209026232312596, 1.2305425961257443, 1.2400712011919772, 1.2494666288347516, 1.2587084925273582, 1.2677778942848992, 1.276657471184813, 1.285331424045713, 1.2937855296062521, 1.3020071376895075, 1.3099851549109915, 1.3177100165046967 ], [ 1.0137229217322186, 1.0115440993701035, 1.0098041385288978, 1.0085199835439511, 1.0077067397815342, 1.007377465582014, 1.0075429911891087, 1.0082117715039831, 1.0093897783299128, 1.0110804360391414, 1.0132846023777964, 1.0160005935828038, 1.0192242503385942, 1.0229490386222846, 1.0271661774599068, 1.0318647843031488, 1.0370320283246925, 1.042653282501435, 1.0487122668587765, 1.0551911775060328, 1.0620707988173241, 1.0693305989560205, 1.0769488115483024, 1.0849025083719959, 1.0931676692193935, 1.1017192555110091, 1.1105312937969811, 1.1195769741095132, 1.1288287664323913, 1.1382585565849819, 1.1478378008375918, 1.1575376968072664, 1.1673293667947802, 1.1771840488059606, 1.1870732900733194, 1.1969691379150427, 1.2068443231546822, 1.216672431972517, 1.2264280628619546, 1.2360869662273921, 1.2456261650068736, 1.2550240554806327, 1.2642604881007034, 1.2733168287329373, 1.2821760011371834, 1.2908225118325585, 1.2992424587139972, 1.3074235249200952, 1.3153549595157792, 1.3230275465622368 ], [ 1.015781282024906, 1.0136437205940194, 1.0119512236095107, 1.0107213104149402, 1.0099695911182014, 1.0097095376330756, 1.0099522828835439, 1.0107064561600243, 1.0119780614246805, 1.0137704035036599, 1.0160840646551215, 1.0189169311315205, 1.0222642663147958, 1.0261188241062766, 1.030470993836206, 1.0353089663297255, 1.0406189101556647, 1.0463851475946742, 1.05259032144347, 1.0592155462206585, 1.0662405403315818, 1.073643738890489, 1.081402389788066, 1.0894926378871412, 1.0978896036899315, 1.1065674633376537, 1.1154995364021725, 1.1246583867515225, 1.1340159400418006, 1.1435436193767448, 1.1532124986519188, 1.162993471296528, 1.172857430709631, 1.1827754577525507, 1.192719010221719, 1.2026601092427138, 1.2125715179104881, 1.2224269081467567, 1.2322010125453702, 1.2418697588343062, 1.2514103854224605, 1.2608015372669965, 1.270023341959563, 1.2790574664725372, 1.2878871554280986, 1.296497252061094, 1.3048742032545215, 1.3130060501500262, 1.320882405891037, 1.3284944220585593 ], [ 1.0181736652345623, 1.0160797269929434, 1.0144367684095499, 1.013262913253294, 1.0125743082551741, 1.012384871444323, 1.0127060696298287, 1.013546734298498, 1.0149129240085646, 1.016807839380285, 1.0192317940893678, 1.0221822420405564, 1.0256538574197882, 1.0296386609558423, 1.0341261828602497, 1.0391036509244806, 1.0445561914108443, 1.0504670308069834, 1.0568176881728215, 1.06358815046488, 1.0707570265069244, 1.0783016787398705, 1.0861983350789821, 1.0944221857524863, 1.1029474716361338, 1.1117475712219442, 1.1207950930035968, 1.1300619788844475, 1.139519622461241, 1.1491390039910256, 1.1588908417909871, 1.1687457579875524, 1.1786744550935029, 1.1886478989408389, 1.1986375030484002, 1.2086153095108, 1.2185541618711486, 1.2284278660767378, 1.2382113364061424, 1.2478807241009864, 1.2574135272608573, 1.2667886813113785, 1.2759866300016314, 1.2849893774135126, 1.2937805218719056, 1.302345272938567, 1.3106704528686475, 1.3187444840222446, 1.3265573637711103, 1.3341006284373924 ], [ 1.0209048138326797, 1.0188568162853167, 1.0172653742672866, 1.0161492439197894, 1.015525139987121, 1.0154074596458973, 1.0158080362192234, 1.0167359334637618, 1.0181972899551703, 1.0201952210070788, 1.022729782606359, 1.0257979982286216, 1.0293939454312602, 1.0335088952248135, 1.0381314938569393, 1.0432479742407823, 1.0488423831494043, 1.0548968106389882, 1.0613916099037, 1.0683055986468397, 1.0756162366550646, 1.0832997780776032, 1.0913314004368844, 1.0996853152127972, 1.1083348666741042, 1.1172526263685554, 1.1264104903780663, 1.135779785276436, 1.1453313869578403, 1.1550358544336394, 1.1648635786116366, 1.1747849442177651, 1.1847705015653809, 1.1947911439126742, 1.204818285687455, 1.2148240368528735, 1.2247813690490261, 1.2346642697656032, 1.244447881570881, 1.2541086242471526, 1.2636242984861548, 1.272974170527854, 1.2821390377510158, 1.291101275730609, 1.299844867665582, 1.3083554173596217, 1.3166201471208085, 1.3246278820503081, 1.3323690222307978, 1.3398355043179966 ], [ 1.0239791888552914, 1.0219794334657026, 1.0204414159346147, 1.0193845503395078, 1.0188261494714315, 1.018781122390553, 1.019261702308202, 1.0202772170431829, 1.0218339131965055, 1.0239348429997492, 1.0265798195721931, 1.0297654422786409, 1.0334851893733614, 1.0377295706258594, 1.0424863286891275, 1.0477406751009584, 1.0534755453941869, 1.0596718580241666, 1.0663087636480435, 1.073363874417836, 1.0808134668981006, 1.0886326564146902, 1.0967955445203517, 1.1052753443665455, 1.114044490805084, 1.1230747429023928, 1.1323372863001753, 1.1418028417006842, 1.151441783975943, 1.1612242743121322, 1.1711204056997766, 1.1811003602114951, 1.191134575042044, 1.2011939133086476, 1.2112498351341183, 1.2212745645128722, 1.231241247800698, 1.241124100265438, 1.2508985378797421, 1.260541292333821, 1.2700305080213328, 1.279345820453823, 1.288468416158415, 1.2973810745970324, 1.3060681930140443, 1.3145157953818787, 1.3227115267850211, 1.3306446346776075, 1.3383059384845908, 1.3456877890056653 ], [ 1.0274009311020802, 1.0254517378734813, 1.0239690152353624, 1.0229728573698778, 1.0224812028053842, 1.022509504002258, 1.023070427352637, 1.0241735975472415, 1.0258253992556048, 1.028028846795548, 1.0307835289706584, 1.0340856317514433, 1.037928036371648, 1.0423004852592093, 1.0471898036477323, 1.0525801613185322, 1.058453357165804, 1.0647891093863564, 1.0715653360149715, 1.0787584139224047, 1.0863434087189652, 1.0942942726140563, 1.1025840115414343, 1.1111848262696986, 1.1200682344661215, 1.129205181669097, 1.1385661489366898, 1.1481212638013099, 1.1578404193780198, 1.1676934043754692, 1.1776500446468852, 1.1876803550409987, 1.1977546988372985, 1.2078439510618009, 1.2179196614894674, 1.2279542130959635, 1.2379209720364175, 1.2477944257949634, 1.2575503068592329, 1.2671657000359633, 1.276619132264375, 1.2858906444531826, 1.2949618454362564, 1.303815948599171, 1.3124377920756625, 1.3208138436583148, 1.3289321917256938, 1.3367825235743964, 1.344356092574009, 1.3516456755501594 ], [ 1.0311738074948864, 1.0292775547502833, 1.0278519986801316, 1.026917931243636, 1.0264939409550142, 1.0265960529153542, 1.0272373989330341, 1.0284279335387223, 1.0301742108366274, 1.032479234803363, 1.0353423918642868, 1.0387594695758997, 1.0427227594785824, 1.0472212362933737, 1.0522408003492039, 1.0577645661443866, 1.063773177807131, 1.0702451321934647, 1.0771570923843112, 1.0844841780342422, 1.0922002237608552, 1.1002780018141045, 1.1086894099302305, 1.1174056290081462, 1.1263972577194894, 1.135634432285053, 1.1450869395277037, 1.1547243301967016, 1.1645160377772037, 1.1744315058947312, 1.1844403253075477, 1.1945123795978463, 1.2046179971910642, 1.2147281063349178, 1.2248143891626777, 1.2348494308985032, 1.244806860546986, 1.2546614799390299, 1.26438937867701, 1.2739680332428895, 1.283376389232742, 1.292594926312332, 1.301605706023104, 1.3103924029961078, 1.3189403204539925, 1.3272363911085954, 1.3352691647063502, 1.3430287835517318, 1.3505069473644544, 1.3576968688123043 ], [ 1.0353011406471802, 1.033460308966586, 1.0320938363341825, 1.0312232244915176, 1.0308677315464123, 1.031043981023811, 1.0317656002073778, 1.0330429055785333, 1.03488265249069, 1.0372878638551783, 1.040257748542974, 1.0437877146663652, 1.0478694764114405, 1.052491246379549, 1.0576379993144431, 1.0632917884582707, 1.0694320932222852, 1.0760361766884377, 1.0830794336008895, 1.0905357135231724, 1.0983776090186725, 1.1065767042379357, 1.1151037843917813, 1.1239290106611604, 1.1330220678022802, 1.1423522929655132, 1.1518887941922988, 1.161600565964442, 1.1714566074037236, 1.1814260466140243, 1.1914782725399602, 1.201583073832105, 1.2117107827236293, 1.2218324209158278, 1.2319198439454035, 1.2419458804138863, 1.251884462709223, 1.261710746339025, 1.27140121562073, 1.2809337741477516, 1.2902878191047706, 1.2994442990937047, 1.3083857556285752, 1.3170963488536165, 1.3255618683362396, 1.3337697299944478, 1.3417089603502004, 1.3493701693704014, 1.3567455131792239, 1.3638286479120774 ], [ 1.0397857200769314, 1.0380029389566234, 1.03669755956441, 1.0358917985436145, 1.0356055972829603, 1.035856198766155, 1.0366577523835003, 1.0380209666570877, 1.0399528294214015, 1.042456412643334, 1.0455307746991243, 1.049170966803145, 1.0533681429849595, 1.0581097653856135, 1.0633798896808013, 1.0691595100886429, 1.0754269404108223, 1.082158207240321, 1.0893274337549452, 1.0969071968945292, 1.1048688463856142, 1.1131827801104146, 1.1218186758644082, 1.1307456839709111, 1.1399325881677096, 1.1493479435823328, 1.1589602006276547, 1.1687378225861547, 1.1786494028815218, 1.1886637859311127, 1.198750193355012, 1.2088783554339195, 1.2190186462198775, 1.2291422196872452, 1.2392211437688019, 1.2492285290012595, 1.2591386487174574, 1.2689270481672998, 1.2785706405259814, 1.288047788370741, 1.2973383698110732, 1.3064238289989212, 1.315287211201048, 1.32391318297731, 1.3322880382789588, 1.3403996914691911, 1.3482376583870714, 1.3557930266387612, 1.3630584163195825, 1.3700279323582172 ], [ 1.0446296940541864, 1.04290778945624, 1.0416656558367658, 1.0409262217368562, 1.0407101182579732, 1.0410352227508501, 1.0419162285508976, 1.0433642629942892, 1.0453865758723477, 1.0479863181703235, 1.0511624262753267, 1.0549096200856614, 1.0592185152665936, 1.0640758412588107, 1.0694647487071793, 1.0753651838451437, 1.0817543038796074, 1.0886069069672746, 1.0958958528345826, 1.1035924548773963, 1.1116668307677695, 1.120088205166322, 1.1288251641566602, 1.1378458658021517, 1.1471182144131875, 1.1566100076541965, 1.1662890657033416, 1.1761233506400879, 1.1860810824734376, 1.1961308561196722, 1.2062417615222705, 1.2163835072240787, 1.226526546211459, 1.236642201824462, 1.246702790966281, 1.2566817416960159, 1.2665537024629296, 1.2762946406385431, 1.2858819285268213, 1.2952944156007218, 1.3045124862633801, 1.3135181029237974, 1.3222948345886907, 1.3308278714975736, 1.3391040265699947, 1.3471117246018562, 1.3548409802535832, 1.3622833659285192, 1.3694319706582525, 1.3762813511009622 ], [ 1.0498344418241783, 1.0481764824075217, 1.0469999395183704, 1.0463284412470888, 1.046183306226718, 1.046583053520191, 1.047542936001536, 1.0490745218746158, 1.0511853493147432, 1.0538786770055182, 1.0571533483897644, 1.0610037800204066, 1.0654200752294174, 1.0703882545702226, 1.0758905854758583, 1.0819059865938498, 1.0884104782648327, 1.0953776500375922, 1.1027791187935374, 1.1105849562945653, 1.1187640717291085, 1.1272845419693542, 1.1361138887546016, 1.1452193071601107, 1.1545678531354853, 1.1641265995713392, 1.1738627704998938, 1.183743862020903, 1.193737756787056, 1.2038128367808043, 1.2139380969994769, 1.2240832607845697, 1.234218896039047, 1.2443165305420771, 1.2543487639923558, 1.264289374232655, 1.2741134152439144, 1.283797304846584, 1.2933189005170282, 1.3026575622375718, 1.3117942017925592, 1.3207113183621326, 1.3293930206314795, 1.3378250359208532, 1.3459947070543727, 1.3538909778330068, 1.3615043680697099, 1.3688269391941204, 1.3758522514508849, 1.3825753137082193 ], [ 1.0554004268890689, 1.0538097663844224, 1.052701398671155, 1.0520996285344666, 1.052026450005715, 1.0525010221860767, 1.053539165333474, 1.0551529043762213, 1.0573500878733473, 1.0601341083901232, 1.0635037450183173, 1.0674531406044392, 1.0719719159992904, 1.0770454126363076, 1.0826550445529255, 1.088778733074403, 1.0953913928693435, 1.10246543742293, 1.1099712749307178, 1.1178777713744394, 1.1261526649189422, 1.1347629235004895, 1.1436750444683834, 1.152855300640101, 1.1622699407784727, 1.17188535429565, 1.181668210189787, 1.1915855792236878, 1.2016050466007346, 1.2116948202913311, 1.2218238380494892, 1.2319618742803864, 1.2420796464264385, 1.252148919497925, 1.2621426067788193, 1.272034864532704, 1.2818011786301449, 1.2914184413205334, 1.3008650167862623, 1.310120794569819, 1.3191672304004098, 1.3279873743324677, 1.3365658864273215, 1.3448890404581306, 1.352944716301298, 1.360722381803788, 1.3682130649955984, 1.3754093175595716, 1.3823051704867784, 1.3888960828413204 ], [ 1.0613270331565572, 1.0598073460974073, 1.0587700191029465, 1.0582399992409413, 1.058239932585375, 1.05878960615528, 1.059905406181237, 1.0615998224690402, 1.0638810301112172, 1.06675257798011, 1.0702132079248021, 1.0742568196382276, 1.0788725847202554, 1.0840452010843376, 1.0897552673729476, 1.095979748178597, 1.1026924958398026, 1.109864793876674, 1.1174658904360828, 1.1254634964622536, 1.1338242313517235, 1.1425140071968543, 1.1514983502001208, 1.1607426636759288, 1.1702124409063563, 1.1798734380154445, 1.1896918172680178, 1.1996342702123615, 1.2096681283314112, 1.2197614667646413, 1.2298832045513268, 1.2400032029702603, 1.2500923620585396, 1.2601227143452338, 1.2700675142253142, 1.2799013211679673, 1.2896000750124994, 1.2991411618595348, 1.3085034694255022, 1.3176674311228878, 1.3266150585067342, 1.3353299620593928, 1.3437973605569535, 1.3520040794704586, 1.359938539008274, 1.3675907325110426, 1.3749521959775757, 1.3820159695369425, 1.388776551697246, 1.3952298472008529 ], [ 1.0676123870439267, 1.0661676949279901, 1.065204588443509, 1.0647486100868022, 1.0648230222542534, 1.0654482159770295, 1.0666411313345547, 1.068414721977553, 1.0707774984178229, 1.0737331832440846, 1.077280505658061, 1.0814131529224091, 1.086119883564728, 1.0913847932966045, 1.0971877117248219, 1.1035046980384657, 1.1103085983244914, 1.1175696264836614, 1.125255934457431, 1.1333341444871012, 1.1417698248825041, 1.1505278997507151, 1.1595729910852748, 1.1688696977573079, 1.1783828199684556, 1.1880775396979837, 1.1979195679397094, 1.2078752685368537, 1.2179117666643313, 1.2279970479044058, 1.2381000517546827, 1.2481907615374384, 1.258240291191132, 1.2682209683752454, 1.2781064126981436, 1.2878716076225334, 1.2974929646278879, 1.3069483784181088, 1.3162172722699437, 1.3252806329548446, 1.334121034987685, 1.342722654233309, 1.3510712711263633, 1.3591542639303176, 1.3669605925851822, 1.3744807737775862, 1.3817068479206789, 1.388632338762511, 1.395252206355748, 1.401562794124618 ], [ 1.0742531700150444, 1.0728878549786063, 1.0720024846921252, 1.0716231371333549, 1.0717736419922588, 1.0724749574411974, 1.0737445532379442, 1.075595835269463, 1.0780376497450905, 1.0810739041644906, 1.0847033361926266, 1.0889194508670121, 1.093710632388677, 1.0990604212180357, 1.1049479328114307, 1.1113483833771114, 1.1182336820279095, 1.1255730481327806, 1.1333336169395636, 1.1414810042957402, 1.1499798108066452, 1.158794055374138, 1.1678875364538797, 1.1772241257742626, 1.18676800340398, 1.1964838450674045, 1.2063369728685887, 1.2162934795851819, 1.2263203349266139, 1.2363854800483294, 1.246457914514742, 1.2565077780447655, 1.266506427893719, 1.2764265116784035, 1.2862420348222943, 1.2959284215234979, 1.3054625681407201, 1.3148228880590347, 1.3239893473532864, 1.3329434908491105, 1.3416684584462026, 1.3501489917939173, 1.35837143158712, 1.366323705882844, 1.3739953099323627, 1.381377278086689, 1.388462148374727, 1.3952439203778881, 1.4017180070389128, 1.4078811810484577 ], [ 1.0812444274560924, 1.0799632307283742, 1.0791594554645867, 1.0788596417343863, 1.079088123515641, 1.0798663753467839, 1.0812123593162406, 1.0831399101410508, 1.0856582001967907, 1.088771325797119, 1.0924780498318138, 1.0967717242051696, 1.1016403997951845, 1.1070671143456783, 1.1130303327234543, 1.1195045019354861, 1.1264606768845289, 1.1338671724708824, 1.1416902025530327, 1.1498944748536222, 1.1584437211986116, 1.1673011527005008, 1.1764298382948855, 1.1857930116544817, 1.195354315721595, 1.2050779961111064, 1.2149290548704388, 1.2248733750584606, 1.2348778248279726, 1.2449103475980339, 1.2549400428177744, 1.2649372399821528, 1.2748735670955167, 1.2847220137394186, 1.2944569882683676, 1.3040543683672041, 1.313491544168249, 1.3227474532531236, 1.3318026070726199, 1.3406391085471334, 1.3492406608219423, 1.357592567326291, 1.365681723418862, 1.3734965999978284, 1.3810272195190842, 1.3882651249094495, 1.3952033418899932, 1.4018363352429684, 1.4081599595683427, 1.414171405084764 ], [ 1.0885793811705575, 1.0873873839622623, 1.0866693959481584, 1.086452332481123, 1.0867609545346109, 1.0876171877259913, 1.0890394351144068, 1.0910419240792764, 1.093634132840363, 1.0968203422473792, 1.1005993521193442, 1.1049643887334015, 1.1099032126769406, 1.115398417070093, 1.1214278885252993, 1.1279653901075972, 1.1349812188101849, 1.142442890005663, 1.1503158069736248, 1.1585638830609646, 1.1671500951338951, 1.176036957793701, 1.1851869169744538, 1.1945626683005486, 1.2041274098134154, 1.213845040642884, 1.2236803173787218, 1.233598978837108, 1.2435678481279602, 1.2535549188411934, 1.2635294301081783, 1.2734619334808517, 1.2833243531297078, 1.2930900398371885, 1.3027338186325996, 1.3122320296135714, 1.3215625614390845, 1.3307048770697578, 1.339640031495284, 1.3483506813686268, 1.3568210866282882, 1.3650371043172562, 1.372986174898481, 1.380657301427138, 1.3880410219780215, 1.3951293757497685, 1.4019158632831061, 1.408395401242245, 1.4145642722191312, 1.4204200700313407 ], [ 1.0962492539792625, 1.0951518390642356, 1.0945241352184476, 1.0943933333112437, 1.0947845298635526, 1.0957200215890857, 1.0972185867038338, 1.0992947957086694, 1.101958400878923, 1.1052138545069523, 1.1090599994807084, 1.1134899620376002, 1.1184912573758818, 1.1240460976034665, 1.1301318721759528, 1.1367217568641568, 1.1437854003220198, 1.1512896377083532, 1.1591991872790368, 1.1674772962396018, 1.17608631403723, 1.1849881826229725, 1.1941448426387544, 1.2035185613168111, 1.2130721920648775, 1.2227693775882122, 1.2325747085005354, 1.2424538482690657, 1.2523736335408633, 1.2623021568281199, 1.2722088365026385, 1.2820644772738792, 1.2918413229171597, 1.301513102015914, 1.3110550668601761, 1.3204440253355156, 1.3296583655563174, 1.3386780730556638, 1.347484740467656, 1.356061569772395, 1.3643933672891806, 1.3724665316866396, 1.380269035330532, 1.3877903993171665, 1.3950216625524572, 1.4019553452408677, 1.4085854071514798, 1.414907201033078, 1.42091742155878, 1.4266140501927098 ], [ 1.1042431158119514, 1.1032459088845394, 1.1027132419182544, 1.1026724695259826, 1.1031489188171013, 1.1041651632529936, 1.1057402759865067, 1.1078891075618043, 1.1106216407696943, 1.1139424771233024, 1.1178505028866659, 1.1223387677397227, 1.1273945881433085, 1.1329998642092918, 1.1391315778916764, 1.1457624253049452, 1.1528615289311979, 1.1603951764166167, 1.1683275400050754, 1.1766213419439788, 1.185238443822612, 1.1941403496168366, 1.2032886218331607, 1.212645216978012, 1.2221727506607325, 1.2318347043897637, 1.241595586123278, 1.2514210554773735, 1.261278022692143, 1.2711347284153747, 1.2809608093832614, 1.2907273533519534, 1.3004069452695508, 1.3099737057059901, 1.3194033219507244, 1.3286730718783404, 1.337761840585142, 1.3466501298299536, 1.3553200603990294, 1.3637553676085612, 1.3719413902311521, 1.3798650531759462, 1.3875148442677228, 1.3948807854671372, 1.4019543988618024, 1.4087286677439308, 1.415197993080671, 1.421358145680879, 1.4272062143670736, 1.4327405504743573 ], [ 1.1125477611290309, 1.1116565520424773, 1.1112238611616747, 1.1112770845386808, 1.1118416626155039, 1.1129403378020264, 1.114592384183209, 1.1168128561009278, 1.1196119117546572, 1.1229942705968796, 1.1269588567475215, 1.1314986646638205, 1.1366008603530697, 1.1422471060904074, 1.148414074047517, 1.155074098503797, 1.162195909365537, 1.1697453913238027, 1.1776863212327606, 1.1859810484389497, 1.1945910960591728, 1.203477673377824, 1.2126020992573745, 1.2219261432174935, 1.2314122947685093, 1.2410239731807984, 1.2507256897616188, 1.2604831735014135, 1.2702634691518062, 1.2800350147984574, 1.2897677040716955, 1.2994329364753534, 1.3090036580040987, 1.3184543932855146, 1.3277612698960075, 1.336902035192056, 1.3458560658885157, 1.3546043706211173, 1.3631295857846255, 1.3714159649948359, 1.3794493625581359, 1.3872172113393684, 1.3947084954022524, 1.4019137177654057, 1.4088248635821334, 1.4154353590207187, 1.4217400261004507, 1.4277350337280383, 1.433417845180914, 1.4387871622956467 ], [ 1.121147627375614, 1.120368272544157, 1.1200405947166747, 1.1201919005494259, 1.1208476160748737, 1.1220305329506763, 1.1237600196598712, 1.1260512458982173, 1.128914479315772, 1.1323545174624134, 1.136370311268454, 1.1409548192488734, 1.1460951067116012, 1.1517726769115155, 1.1579639971435125, 1.1646411665458893, 1.1717726657337926, 1.1793241307385736, 1.1872591028518134, 1.1955397188727765, 1.2041273200296685, 1.2129829702510169, 1.222067884193155, 1.231343772056475, 1.2407731119651046, 1.2503193621092497, 1.2599471246253218, 1.2696222719343213, 1.2793120444733588, 1.288985126810577, 1.2986117072873566, 1.3081635247438768, 1.3176139046376696, 1.3269377859764178, 1.3361117399242917, 1.3451139806399706, 1.3539243687854081, 1.3625244081287236, 1.3708972356905733, 1.379027605908001, 1.3869018692922226, 1.3945079460325107, 1.4018352949529236, 1.408874878172925, 1.4156191217671885, 1.422061872672729, 1.428198352057652, 1.4340251053477495, 1.439539949104146, 1.4447419149555403 ], [ 1.1300247633328926, 1.129363071840175, 1.1291454358688138, 1.1293989358083023, 1.1301488474504413, 1.1314178822921388, 1.1332253860670285, 1.1355865447848335, 1.1385116600168663, 1.1420055599620227, 1.1460672063979869, 1.1506895393370309, 1.1558595743629971, 1.1615587384071597, 1.167763404641045, 1.174445570746589, 1.1815736186675045, 1.1891130970980257, 1.1970274778682015, 1.2052788508698615, 1.2138285362659968, 1.222637605219185, 1.231667310013388, 1.2408794308814495, 1.2502365503840138, 1.2597022674373668, 1.26924136275893, 1.278819926211836, 1.2884054547729153, 1.2979669279720296, 1.3074748658901505, 1.3169013733010662, 1.3262201723669702, 1.3354066254614074, 1.3444377491608317, 1.353292220154763, 1.3619503736989487, 1.3703941952032272, 1.3786073055468855, 1.3865749407116437, 1.394283926296506, 1.401722647427296, 1.4088810145037962, 1.4157504251497985, 1.4223237226574537, 1.4285951511552302, 1.4345603076836506, 1.440216091336729, 1.4455606496189315, 1.4505933221752558 ], [ 1.1391588546334657, 1.1386204618352567, 1.1385177687646848, 1.1388774895535958, 1.1397246087656914, 1.1410816214283614, 1.142967725326773, 1.145398015378473, 1.1483827438168344, 1.151926715838301, 1.1560288840861634, 1.1606821859741796, 1.1658736391808744, 1.1715846797757499, 1.177791701569288, 1.1844667389903862, 1.1915782303121252, 1.1990918019868193, 1.2069710253833756, 1.215178111076273, 1.223674520055318, 1.2324214836489669, 1.2413804334066423, 1.250513348394511, 1.2597830306779683, 1.2691533208575898, 1.278589265110791, 1.2880572438915134, 1.2975250707278976, 1.3069620677632878, 1.3163391230217294, 1.325628732970193, 1.3348050328531536, 1.3438438164942372, 1.3527225467608361, 1.3614203576087154, 1.3699180484947127, 1.3781980718986135, 1.3862445146759546, 1.3940430739375462, 1.4015810281018555, 1.408847203692675, 1.4158319383634919, 1.4225270405341963, 1.4289257459356894, 1.4350226712824583, 1.440813765237537, 1.4462962567995918, 1.4514686012284725, 1.4563304236297698 ], [ 1.1485273113620922, 1.1481175448893917, 1.1481344394572777, 1.1486042030534922, 1.1495513862399789, 1.1509981277106418, 1.1529633472015994, 1.1554619355774098, 1.15850400710469, 1.1620942859304126, 1.166231692703978, 1.1709091769580273, 1.1761138105801563, 1.1818271255299757, 1.1880256526988728, 1.1946816029711285, 1.2017636268626668, 1.2092375937685134, 1.2170673428113696, 1.2252153712677964, 1.2336434406722359, 1.2423130928961972, 1.2511860776803239, 1.2602246990470938, 1.2693920911354533, 1.2786524349588824, 1.2879711271174923, 1.297314910206639, 1.3066519730154333, 1.3159520269082519, 1.325186363223247, 1.3343278952121729, 1.3433511870308943, 1.3522324715683829, 1.360949658438055, 1.369482333191331, 1.377811748683549, 1.3859208094637177, 1.3937940500238746, 1.4014176076983722, 1.4087791909348224, 1.4158680435662472, 1.4226749056062982, 1.4291919709781542, 1.435412842484193, 1.4413324842362565, 1.4469471717005438, 1.4522544394689598, 1.4572530268489328, 1.4619428213642927 ], [ 1.1581054196776166, 1.1578291636203224, 1.157969902424627, 1.1585532015335933, 1.1596030366118322, 1.161141050358804, 1.1631857530966179, 1.1657517164297295, 1.1688488254578078, 1.1724816629623314, 1.176649093157233, 1.1813440915386377, 1.186553835850217, 1.192260040156147, 1.1984394878005384, 1.2050647039090139, 1.2121047042502973, 1.2195257625094829, 1.227292149181893, 1.2353668091597299, 1.2437119588995458, 1.252289595883266, 1.2610619219171748, 1.2699916874859953, 1.279042467305124, 1.2881788780748573, 1.297366748948138, 1.3065732539747368, 1.3157670142184354, 1.3249181756493251, 1.3339984674658425, 1.3429812442938662, 1.3518415147788128, 1.360555958425239, 1.3691029321107544, 1.3774624674535474, 1.3856162600836788, 1.3935476518018144, 1.4012416065593094, 1.4086846811334546, 1.4158649912876722, 1.4227721741003336, 1.429397347024852, 1.4357330641205428, 1.4417732697788692, 1.4475132501724828, 1.4529495825797012, 1.4580800826873161, 1.4629037499486226, 1.4674207110697164 ], [ 1.1678665559626036, 1.1677281195379812, 1.1679964422255515, 1.1686963173674256, 1.1698510104863056, 1.1714815328280115, 1.1736058566473049, 1.1762381205144288, 1.1793878897095864, 1.1830595453879826, 1.1872518706316997, 1.191957880053701, 1.1971649074158879, 1.2028549324302353, 1.2090051021595456, 1.2155883881948195, 1.2225743177391144, 1.2299297223497296, 1.2376194592021452, 1.2456070732485713, 1.2538553819630753, 1.2623269756918747, 1.2709846350468985, 1.2797916721661864, 1.288712205424972, 1.2977113779802765, 1.3067555300541842, 1.3158123336812857, 1.3248508971809068, 1.3338418451364504, 1.3427573783326419, 1.3515713169978052, 1.360259129850259, 1.3687979508460435, 1.3771665851342216, 1.385345505495237, 1.3933168404119078, 1.4010643548498514, 1.4085734247643067, 1.4158310062786006, 1.4228256003843598, 1.4295472138969099, 1.4359873172688393, 1.4421387997322492, 1.447995922116992, 1.4535542675861908, 1.4588106904482423, 1.4637632631474475, 1.4684112215035081, 1.4727549082612394 ], [ 1.177782458406979, 1.1777854555070328, 1.178184465503154, 1.1790033900685921, 1.1802646586551306, 1.1819885238161971, 1.1841922979084982, 1.1868895779987068, 1.1900895227232768, 1.1937962537760274, 1.198008449379636, 1.2027191756846698, 1.207915969871353, 1.2135811558312317, 1.219692348379749, 1.226223088643624, 1.2331435508610946, 1.2404212666179661, 1.2480218233775666, 1.255909507118035, 1.2640478715590227, 1.2724002271874035, 1.280930051252392, 1.2896013249926124, 1.2983788069765014, 1.307228252208859, 1.31611658622878, 1.3250120423403757, 1.3338842687713188, 1.3427044112014792, 1.3514451748905807, 1.3600808696332336, 1.3685874400034999, 1.376942482807181, 1.3851252533050429, 1.3931166615568844, 1.4008992601147647, 1.40845722421714, 1.4157763255686637, 1.4228439007102178, 1.4296488148810642, 1.4361814221512235, 1.4424335224655715, 1.4483983161023064, 1.4540703559189831, 1.4594454976468527, 1.464520848405541, 1.4692947135468528, 1.473766541898623, 1.4779368694658566 ], [ 1.1878235474802252, 1.1879707930914087, 1.1885028541147111, 1.1894426337252824, 1.1908116120191135, 1.1926291676178893, 1.1949118419519285, 1.1976725912360966, 1.2009200876939252, 1.2046581403935397, 1.2088853009440101, 1.2135946984245598, 1.218774116603045, 1.2244062946923857, 1.2304694090891894, 1.2369376811079968, 1.2437820537429327, 1.2509708861968234, 1.258470625272278, 1.266246424959473, 1.2742626974586, 1.2824835889324209, 1.2908733807534591, 1.2993968218097602, 1.3080193999299095, 1.3167075612623944, 1.3254288860958143, 1.3341522286414627, 1.3428478270869966, 1.3514873890086254, 1.360044156135986, 1.3684929515644968, 1.3768102118225856, 1.3849740057132613, 1.3929640415291964, 1.4007616640446603, 1.4083498425716203, 1.415713151289087, 1.422837742983073, 1.4297113172490188, 1.4363230841012806, 1.4426637238066617, 1.4487253436188894, 1.4545014319486949, 1.4599868103704798, 1.4651775837496503, 1.4700710886807595, 1.4746658403577442, 1.4789614779546476, 1.482958708576175 ], [ 1.1979592837751887, 1.1982527123555133, 1.1989193661502768, 1.1999810579589905, 1.2014582206623803, 1.2033692589752563, 1.2057298467078656, 1.2085522124383048, 1.2118444721653818, 1.2156100757774857, 1.2198474292151822, 1.2245497343578005, 1.229705059005149, 1.2352966192595223, 1.2413032341617738, 1.2476999007679381, 1.254458436052314, 1.26154813742452, 1.2689364233459581, 1.2765894269355123, 1.2844725265142467, 1.2925508063823716, 1.3007894480823496, 1.3091540569112956, 1.317610930837224, 1.326127279772303, 1.3346714029090947, 1.3432128309964124, 1.3517224393629332, 1.3601725364115345, 1.3685369313337268, 1.3767909839931542, 1.3849116393149958, 1.3928774480838881, 1.4006685757655244, 1.408266800789075, 1.4156555036177707, 1.4228196478571062, 1.429745754575976, 1.4364218709278231, 1.4428375340498347, 1.4489837310894083, 1.4548528560663192, 1.460438664135718, 1.4657362236813796, 1.4707418665491319, 1.4754531366323502, 1.4798687369484855, 1.4839884752976158, 1.4878132085702347 ], [ 1.2081585495249374, 1.208599159044959, 1.209401068414984, 1.210584924715525, 1.2121700332437864, 1.2141737425959769, 1.2166107793671928, 1.219492573000772, 1.2228266257012648, 1.2266159897053472, 1.2308589093821354, 1.2355486672338925, 1.240673645531761, 1.2462175875330097, 1.252160021311039, 1.258476798216477, 1.2651406961477913, 1.2721220427004003, 1.27938932216054, 1.2869097407906647, 1.2946497350226973, 1.302575415784925, 1.3106529486367908, 1.318848873610858, 1.3271303709583846, 1.335465479832194, 1.343823276807168, 1.3521740204561943, 1.360489267280586, 1.3687419633472597, 1.3769065151296853, 1.384958842344537, 1.3928764150365147, 1.400638276779648, 1.4082250556080103, 1.4156189641278958, 1.422803790161143, 1.4297648791932025, 1.4364891098250439, 1.4429648633395404, 1.4491819883842074, 1.455131761644829, 1.4608068452450635, 1.4662012414650052, 1.4713102452361337, 1.4761303947492554, 1.4806594204119283, 1.4848961923152704, 1.4888406663183065, 1.4924938288295992 ], [ 1.2183900389486442, 1.2189778625670395, 1.2199147820022973, 1.2212202207160094, 1.222912294788974, 1.2250072338005484, 1.2275187563754675, 1.2304574383338633, 1.2338301241906213, 1.2376394390344412, 1.241883453142461, 1.24655553502632, 1.2516444040341232, 1.2571343684908003, 1.2630057161265626, 1.2692352131241784, 1.275796666075653, 1.282661505359498, 1.2897993564330974, 1.2971785750299405, 1.3047667315068177, 1.3125310374591626, 1.320438713665514, 1.328457302370267, 1.336554929124718, 1.3447005202876823, 1.3528639822732262, 1.3610163481002437, 1.3691298960315583, 1.3771782442802691, 1.3851364250220781, 1.3929809403385585, 1.4006898022462158, 1.4082425586294938, 1.4156203066710287, 1.4228056952287025, 1.4297829175146675, 1.4365376953589253, 1.4430572562669608, 1.4493303043940633, 1.4553469864527644, 1.46109885344573, 1.4665788189805617, 1.471781114783734, 1.476701243897296, 1.4813359319217319, 1.485683076567153, 1.4897416956961733, 1.4935118739868913, 1.4969947083119712 ], [ 1.2286226426124796, 1.2293567480563166, 1.2304275222082843, 1.231853124691656, 1.2336504398603556, 1.2358345352131108, 1.2384180800889413, 1.2414107597948456, 1.2448187314124557, 1.2486441726489141, 1.252884970619125, 1.2575345826733786, 1.2625820797757425, 1.2680123606253344, 1.2738065072698606, 1.2799422431347036, 1.28639445207177, 1.293135720481246, 1.3001368715521477, 1.307367469138168, 1.3147962771199229, 1.3223916672504044, 1.3301219739294516, 1.3379557980342902, 1.3458622640599056, 1.3538112357490844, 1.3617734954955651, 1.369720892417924, 1.3776264633832167, 1.385464530583223, 1.3932107786382708, 1.400842313678466, 1.4083377064465787, 1.415677021176193, 1.4228418318024878, 1.4298152269363844, 1.4365818049473387, 1.4431276604320609, 1.4494403632763788, 1.45550893143406, 1.4613237984442602, 1.466876776590244, 1.4721610164712275, 1.4771709636246244, 1.481902312705886, 1.4863519596148809, 1.4905179518566793, 1.4943994373451246, 1.4979966117996057, 1.5013106648503631 ], [ 1.238825812184521, 1.2397043270829653, 1.2409069153560706, 1.2424504498525935, 1.2443505593793593, 1.2466211256566675, 1.2492737463661725, 1.2523171965213273, 1.2557569297626567, 1.2595946651824916, 1.263828101062144, 1.2684507840342347, 1.2734521435198174, 1.2788176818199577, 1.284529294643177, 1.2905656876638356, 1.2969028521069694, 1.303514564996827, 1.3103728856725172, 1.3174486276054782, 1.3247117919720497, 1.3321319558688245, 1.339678613029275, 1.3473214683213195, 1.3550306893495507, 1.3627771194508742, 1.3705324565858092, 1.3782694023815103, 1.3859617851051642, 1.3935846597976334, 1.4011143882757064, 1.4085287012693628, 1.4158067446169136, 1.4229291111929099, 1.4298778600757671, 1.4366365243519557, 1.4431901088778494, 1.4495250792581085, 1.455629343233885, 1.4614922255953928, 1.4671044376369757, 1.4724580420599462, 1.4775464141043986, 1.4823641995624466, 1.486907270200293, 1.4911726770012694, 1.49515860154306, 1.498864305741967, 1.502290080138466, 1.5054371908600144 ], [ 1.2489698941403466, 1.2499900540549111, 1.2513215779334395, 1.2529800452377104, 1.2549798229516294, 1.2573336013739584, 1.2600519016962772, 1.2631425846077255, 1.2666103969133689, 1.2704565961645113, 1.2746786893899085, 1.279270310964219, 1.284221248763049, 1.2895176110071305, 1.2951421124406832, 1.3010744500062015, 1.3072917353558895, 1.3137689534018682, 1.3204794210552961, 1.3273952267068196, 1.3344876375210637, 1.3417274673607582, 1.3490854026632602, 1.356532286760623, 1.3640393650920115, 1.371578494753005, 1.3791223221380056, 1.3866444323138936, 1.3941194734168185, 1.4015232589343978, 1.4088328503136143, 1.4160266219712043, 1.4230843104978144, 1.4299870496399856, 1.436717392502909, 1.443259322323458, 1.4495982530975366, 1.4557210212901588, 1.4616158697969432, 1.4672724252526783, 1.4726816696929996, 1.4778359074698924, 1.4827287282050674, 1.487354966443892, 1.4917106585532116, 1.4957929972959298, 1.4996002844186322, 1.5031318815094847, 1.5063881593241364, 1.509370445737394 ], [ 1.2590264238190954, 1.260184638689859, 1.2616414473187747, 1.2634111440741957, 1.2655068436841008, 1.2679400555017086, 1.2707202348897568, 1.2738543379857765, 1.2773464123927496, 1.2811972585219444, 1.2854041927559616, 1.2899609342158918, 1.2948576235457705, 1.3000809678937428, 1.3056144942903072, 1.3114388858997559, 1.3175323726691694, 1.3238711490562332, 1.3304297954997748, 1.3371816857067813, 1.3440993674825052, 1.3511549099045106, 1.3583202137005874, 1.3655672846088, 1.3728684713647232, 1.380196670975127, 1.3875255043334687, 1.3948294652279998, 1.402084045566425, 1.409265839320293, 1.4163526273625338, 1.4233234450806407, 1.4301586344169546, 1.4368398818184676, 1.4433502434633458, 1.4496741590542692, 1.4557974554141127, 1.4617073410712396, 1.4673923929687636, 1.4728425363656676, 1.4780490189159965, 1.483004379814933, 1.487702414792753, 1.4921381376238751, 1.496307738706153, 1.500208541160337, 1.503838954806791, 1.5071984282993955, 1.5102873996373694, 1.5131072452346004 ], [ 1.268968374349211, 1.2702603085928965, 1.271838057644904, 1.2737146522305418, 1.275901978159811, 1.2784103881188327, 1.2812482953952267, 1.2844217729034033, 1.287934185891355, 1.2917858882298614, 1.2959740089951737, 1.3004923481591562, 1.3053313890463771, 1.3104784232377924, 1.3159177732884757, 1.3216310916923701, 1.3275977115462232, 1.333795024924426, 1.3401988680793435, 1.3467838970629287, 1.353523942194042, 1.3603923342310391, 1.3673621987334081, 1.3744067177676038, 1.381499359880006, 1.3886140802795481, 1.3957254936365933, 1.40280902199868, 1.4098410202019418, 1.416798880934457, 1.4236611213618073, 1.4304074530007447, 1.4370188363460927, 1.4434775216229736, 1.4497670769456303, 1.455872405103282, 1.461779750149966, 1.467476694935273, 1.4729521506670673, 1.4781963395387918, 1.4832007713801407, 1.4879582152016353, 1.4924626664047367, 1.496709310324073, 1.5006944826640218, 1.5044156272927343, 1.5078712517685569, 1.5110608808993276, 1.5139850085768696, 1.5166450480875135 ], [ 1.2787703579846519, 1.2801910194927981, 1.2818847584193336, 1.283863374509223, 1.2861375595062703, 1.2887165450398916, 1.2916077366591405, 1.2948163546279225, 1.2983451060476714, 1.302193913882129, 1.3063597256370685, 1.3108364178481453, 1.3156148032871475, 1.3206827377931472, 1.3260253148451655, 1.3316251298494517, 1.3374625931964306, 1.3435162712252862, 1.349763236565993, 1.3561794129652158, 1.362739903764428, 1.3694192970288266, 1.376191943531322, 1.3830322062212967, 1.3899146814681036, 1.3968143933796486, 1.4037069630118464, 1.4105687544604886, 1.4173769997964696, 1.424109904668984, 1.4307467362303479, 1.4372678948719018, 1.443654971125636, 1.4498907889865265, 1.4559594368427629, 1.4618462871562095, 1.4675380060029133, 1.4730225535522472, 1.4782891765251651, 1.4833283936217379, 1.488131974842905, 1.4926929155525728, 1.4970054060364884, 1.5010647972187736, 1.5048675631004842, 1.5084112603925257, 1.5116944857322436, 1.5147168308021142, 1.5174788356124589, 1.51998194016908 ], [ 1.2884087800283863, 1.2899526137064403, 1.2917568769434475, 1.2938321803677175, 1.2961880657420117, 1.298832688141515, 1.3017724878667016, 1.3050118701426445, 1.308552913736817, 1.312395130254217, 1.3165352934005927, 1.3209673520183758, 1.3256824330803625, 1.3306689325254002, 1.3359126843896225, 1.341397193307816, 1.3471039126783388, 1.353012550509141, 1.3591013866435644, 1.3653475879535149, 1.3717275114518066, 1.378216988541958, 1.3847915864295306, 1.391426844900638, 1.398098488217682, 1.4047826128686367, 1.4114558524560188, 1.4180955212531159, 1.4246797380004674, 1.431187531454293, 1.4375989290929592, 1.4438950302772908, 1.450058065067215, 1.4560714398278594, 1.4619197707122782, 1.4675889060782648, 1.4730659388751803, 1.478339210014425, 1.4833983037072604, 1.4882340357116537, 1.4928384353735495, 1.4972047222787428, 1.501327278251428, 1.5052016153493335, 1.5088243404174335, 1.512193116677579, 1.5153066227540548, 1.5181645094683707, 1.520767354682549, 1.5231166164299734 ], [ 1.2978619476007223, 1.299522929722116, 1.3014318281343253, 1.3035981134447987, 1.3060302285756846, 1.3087353031646822, 1.3117188606825607, 1.314984533974061, 1.3185338073079134, 1.3223658033721515, 1.3264771315124761, 1.330861808969559, 1.3355112606148556, 1.3404143958304977, 1.3455577549401203, 1.3509257129354073, 1.3565007256509816, 1.362263603012603, 1.368193795132932, 1.3742696792743245, 1.3804688384406023, 1.3867683251096807, 1.3931449060471526, 1.3995752860834143, 1.406036310157555, 1.4125051438796987, 1.4189594334316586, 1.425377445916181, 1.4317381913729255, 1.4380215276807027, 1.444208249516577, 1.4502801624792012, 1.4562201434272315, 1.4620121880420154, 1.4676414465974643, 1.4730942489050456, 1.4783581193906807, 1.483421783247176, 1.4882751645840253, 1.492909377462847, 1.4973167106595657, 1.5014906069345644, 1.5054256375218238, 1.5091174724712784, 1.512562847399546, 1.5157595271271282, 1.5187062666090543, 1.5214027695039123, 1.5238496446750518, 1.5260483608791429 ], [ 1.307110136982631, 1.3088818673731835, 1.310889177025445, 1.3131404510098468, 1.3156430896136109, 1.3184032527331353, 1.3214255994062092, 1.3247130360765145, 1.3282664890054514, 1.3320847164032403, 1.3361641740126404, 1.3404989441310218, 1.345080732934357, 1.349898935329266, 1.3549407613500128, 1.3601914141110183, 1.3656343069537462, 1.3712513067375494, 1.3770229909525278, 1.3829289080366365, 1.3889478324797842, 1.3950580085822126, 1.4012373788119692, 1.4074637944166946, 1.4137152072367911, 1.4199698425656397, 1.4262063534734084, 1.43240395733591, 1.4385425554660425, 1.4446028367984993, 1.4505663665769442, 1.4564156609702403, 1.462134248519958, 1.4677067193041444, 1.4731187626944215, 1.4783571945813283, 1.483409974942547, 1.4882662166236447, 1.4929161861876452, 1.4973512976643955, 1.5015640999925215, 1.5055482588962452, 1.5092985338786786, 1.512810750946044, 1.5160817716067585, 1.5191094586203073, 1.5218926389060774, 1.5244310639651715, 1.5267253681208366, 1.5287770248461345 ], [ 1.316135624164506, 1.318011413979587, 1.3201106601109922, 1.322440720299318, 1.325008011715283, 1.3278177830364537, 1.3308738835908205, 1.334178541276483, 1.3377321623533907, 1.341533166229047, 1.345577866789967, 1.3498604087459958, 1.3543727632703964, 1.3591047825949396, 1.3640443088888659, 1.3691773293317155, 1.3744881671530982, 1.3799596976334656, 1.3855735784653942, 1.3913104851353382, 1.3971503437224426, 1.4030725553843757, 1.4090562085566658, 1.4150802763809893, 1.4211237980388967, 1.4271660435056768, 1.4331866617999065, 1.4391658131492837, 1.4450842856852923, 1.4509235973730195, 1.4566660839202539, 1.4622949734212496, 1.4677944484938952, 1.4731496966731032, 1.4783469498314399, 1.4833735134079806, 1.4882177862357229, 1.4928692717610133, 1.4973185814432457, 1.5015574311056783, 1.5055786309786732, 1.5093760701354826, 1.5129446959691628, 1.5162804893014634, 1.519380435652651, 1.5222424931401541, 1.5248655574156598, 1.5272494239985577, 1.5293947483199117, 1.5313030037565236 ], [ 1.324922683647328, 1.326895637189269, 1.3290801719683687, 1.3314826788703706, 1.3341086532854554, 1.33696249255738, 1.340047291998809, 1.3433646495212122, 1.3469144899769987, 1.3506949202527312, 1.3547021248192435, 1.3589303089104119, 1.3633716930896491, 1.3680165591790412, 1.3728533439384387, 1.3778687739811326, 1.3830480335111135, 1.3883749556529106, 1.393832228310686, 1.3994016063966914, 1.4050641236171213, 1.4108002985191024, 1.4165903309702705, 1.4224142865238554, 1.4282522671529607, 1.4340845676084797, 1.439891817194609, 1.4456551071088064, 1.4513561037094094, 1.4569771481985543, 1.4625013432769463, 1.4679126273663001, 1.473195837021464, 1.478336758176928, 1.4833221668942733, 1.4881398602982645, 1.4927786784069306, 1.4972285175723894, 1.501480336250775, 1.5055261538104288, 1.5093590430661576, 1.5129731171945928, 1.5163635116436713, 1.5195263615999388, 1.5224587755245071, 1.5251588052147693, 1.5276254127976108, 1.5298584350135327, 1.5318585451113278, 1.5336272126411723 ], [ 1.3334575605876444, 1.3355206501966281, 1.3377837234221048, 1.340252265800929, 1.3429309128565297, 1.3458232706592148, 1.3489317360917124, 1.3522573254160628, 1.3557995205277695, 1.3595561421735376, 1.3635232582826635, 1.367695133483562, 1.3720642230964288, 1.3766212118007641, 1.3813550942115038, 1.38625329214829, 1.391301801706993, 1.3964853624334859, 1.4017876408930359, 1.4071914215514925, 1.412678798911575, 1.4182313660576749, 1.423830395974438, 1.429457013094899, 1.4350923534379234, 1.4407177123937187, 1.446314679725363, 1.4518652617047765, 1.4573519905319354, 1.4627580213324212, 1.4680672171207991, 1.4732642221789018, 1.4783345243429151, 1.4832645067311578, 1.4880414894781855, 1.4926537620713713, 1.4970906069115943, 1.5013423147378888, 1.5054001925647964, 1.5092565647787297, 1.5129047680263774, 1.5163391405035147, 1.5195550062191965, 1.5225486547694018, 1.525317317109776, 1.5278591377706716, 1.53017314391318, 1.5322592115837959, 1.534118029489914, 1.5357510605895 ] ], "zauto": true, "zmax": 1.5357510605895, "zmin": -1.5357510605895 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.10975598882081053, 0.10777730589959073, 0.10586709886648797, 0.10402952614435994, 0.1022682933414354, 0.10058664024292054, 0.09898734315236708, 0.09747273397174651, 0.096044736857377, 0.09470492262394944, 0.09345458030063225, 0.09229480437871591, 0.0912265953356114, 0.09025096998364698, 0.0893690770941391, 0.08858231263034139, 0.0878924278642852, 0.08730162277081434, 0.08681261654625302, 0.08642868707459693, 0.08615367184565915, 0.08599192436288217, 0.08594822252509823, 0.0860276287623617, 0.08623530563393751, 0.08657629478362544, 0.08705527109742274, 0.08767628706802179, 0.08844252422762201, 0.08935606869892491, 0.09041772630616646, 0.09162688943880738, 0.09298146339448686, 0.09447785485893506, 0.09611102018983213, 0.0978745668743197, 0.09976089836727098, 0.10176139070015645, 0.1038665887593457, 0.10606641076775568, 0.10835035095748861, 0.11070767235503524, 0.11312758370584836, 0.11559939659929652, 0.11811266065622829, 0.12065727612323865, 0.12322358435515555, 0.12580243747738162, 0.12838524904483137, 0.13096402780713656 ], [ 0.10726836412229591, 0.10524287655050209, 0.10328989112484165, 0.10141380353852893, 0.0996185027394386, 0.09790735055082127, 0.09628317808467074, 0.09474830075938398, 0.09330455313116615, 0.09195334401143053, 0.09069573148512634, 0.0895325164799684, 0.08846435247251537, 0.08749186776187566, 0.08661579551194616, 0.0858371054964807, 0.08515713025276496, 0.08457767728181077, 0.08410111819808437, 0.08373044553926542, 0.08346928851465331, 0.08332188048285545, 0.08329297350206603, 0.0833876988489891, 0.08361137674035575, 0.08396928321610042, 0.08446638670271976, 0.08510707053464008, 0.08589486006221483, 0.08683217346196967, 0.08792011379742846, 0.08915831639702235, 0.09054486068029574, 0.092076249872255, 0.09374745638832341, 0.09555202577284456, 0.09748222845657535, 0.09952924651723023, 0.10168338206365768, 0.10393427458635279, 0.1062711162664011, 0.10868285641871295, 0.11115838860790843, 0.11368671624109329, 0.11625709443043042, 0.11885914753764429, 0.12148296303981644, 0.12411916321576325, 0.1267589566966278, 0.12939417221506194 ], [ 0.10477144362352271, 0.10269963579021385, 0.10070465975823392, 0.09879117622991689, 0.09696328004001158, 0.09522447092917508, 0.09357764269229427, 0.0920250930305916, 0.09056855577245683, 0.08920925629839778, 0.08794799003363386, 0.0867852227790963, 0.08572121045333567, 0.08475613452437086, 0.08389024803594916, 0.08312402570934709, 0.08245831019987314, 0.08189444532941287, 0.0814343861854289, 0.08108077560453653, 0.08083697699688326, 0.0807070549402301, 0.08069569761653696, 0.08080807896816501, 0.08104966320990606, 0.08142595962793621, 0.08194224082023009, 0.0826032419634955, 0.0834128616152445, 0.08437388541599218, 0.08548775257779981, 0.08675438134330142, 0.08817206416861835, 0.08973743701061514, 0.09144552069697576, 0.09328982677570732, 0.09526251610220576, 0.09735459603340701, 0.09955614144558818, 0.1018565256067387, 0.10424464879986249, 0.10670915505477772, 0.10923862999386993, 0.11182177531899407, 0.1144475576610909, 0.11710533128260978, 0.11978493544634386, 0.1224767681764911, 0.12517183870091525, 0.12786180115018575 ], [ 0.1022672752352129, 0.10014964756374792, 0.09811350106015684, 0.09616379303762511, 0.09430485024022896, 0.09254032902670935, 0.09087319566924981, 0.08930572973594626, 0.08783955278586426, 0.08647568365674467, 0.08521462050287282, 0.08405644848046243, 0.08300097060832295, 0.08204785787083162, 0.0811968130928492, 0.08044774152929503, 0.0798009195376827, 0.07925715125918935, 0.0788179021103255, 0.07848539733371196, 0.0782626741566682, 0.07815357752642653, 0.07816269211195932, 0.0782952073099874, 0.07855671717766878, 0.07895296310392871, 0.07948953296636951, 0.08017153569100836, 0.08100327370815891, 0.08198793709941195, 0.08312734189492657, 0.0844217310766956, 0.08586965089440728, 0.08746790798621215, 0.08921160556773591, 0.09109425060251707, 0.09310791913519137, 0.09524346422597386, 0.09749075016380997, 0.09983889754820519, 0.10227652593383448, 0.10479198350107942, 0.10737355617965892, 0.11000965145616551, 0.11268895451576756, 0.11540055629851316, 0.11813405447692198, 0.12087962932800314, 0.12362809705400965, 0.12637094338621863 ], [ 0.09975800510943335, 0.09759505784900625, 0.09551857619061005, 0.09353385003034707, 0.09164546802263872, 0.08985726510797633, 0.08817229207219399, 0.08659281090528835, 0.08512031889567415, 0.08375560329217735, 0.08249882704271838, 0.08134964463415957, 0.08030734546261736, 0.07937102049243919, 0.07853974623585772, 0.07781277832707807, 0.07718974522576959, 0.07667083097413845, 0.07625693463481964, 0.0759497933159337, 0.0757520558571284, 0.07566729561340141, 0.0756999535608835, 0.0758552072282756, 0.07613876656561619, 0.07655660436028806, 0.07711463549428149, 0.07781836530790284, 0.07867253164078697, 0.07968076694619329, 0.08084530574195876, 0.08216675858170022, 0.08364396724400869, 0.08527394792298099, 0.08705192106247904, 0.088971419267515, 0.09102445932409894, 0.09320176121180529, 0.09549299610458319, 0.09788704637340118, 0.1003722629721721, 0.10293670869842132, 0.10556837913313691, 0.10825539617746029, 0.11098617176832447, 0.11374954145926511, 0.11653486908759043, 0.11933212477116038, 0.12213193907562991, 0.12492563646328095 ], [ 0.09724589642079441, 0.09503811135482938, 0.0929221253511623, 0.09090360181238409, 0.08898742587629094, 0.08717763682690037, 0.0854773846457063, 0.08388891547905356, 0.08241358985487028, 0.08105193617744647, 0.07980374043617165, 0.07866817127468974, 0.07764393766759459, 0.07672947450720294, 0.07592314945029185, 0.07522348243644766, 0.0746293674035589, 0.07414028398185839, 0.07375648551817865, 0.07347914893017293, 0.07331047194875338, 0.07325370462095517, 0.07331310479269648, 0.07349381178824047, 0.07380163852164294, 0.07424278938302352, 0.07482351869853802, 0.07554975138373202, 0.07642669251523221, 0.07745845497127375, 0.07864773342597156, 0.07999554875763511, 0.08150107989593773, 0.08316159136249066, 0.08497245562156858, 0.08692726119726103, 0.08901799136174746, 0.09123525459668101, 0.09356854699414881, 0.09600652789621064, 0.0985372927311481, 0.10114863049081436, 0.10382825699007493, 0.10656401850026323, 0.10934406327792963, 0.1121569807998659, 0.11499191016411443, 0.117838620194651, 0.12068756439913825, 0.12352991418586436 ], [ 0.09473335129020305, 0.09248117131837173, 0.09032648492046935, 0.08827537554343196, 0.08633306465286132, 0.08450382608665535, 0.08279092685950959, 0.0811966004748629, 0.07972205772916251, 0.07836753842887134, 0.0771324054850896, 0.07601528064328776, 0.07501421878950014, 0.07412691546517422, 0.07335093998964959, 0.07268398446116475, 0.07212411690466153, 0.07167002501653064, 0.07132123546522269, 0.07107829279048108, 0.07094288194239544, 0.07091787979109829, 0.07100732384516194, 0.07121629111380468, 0.07155068645228176, 0.07201694742924014, 0.07262168098577268, 0.07337125485751238, 0.07427137269363587, 0.0753266649042203, 0.07654032673407482, 0.077913830728595, 0.07944673316614152, 0.08113658435516838, 0.08297894247814229, 0.0849674814610263, 0.08709417636751537, 0.08934954570810132, 0.09172292885455953, 0.09420277800845364, 0.0967769471523237, 0.09943296431161794, 0.10215827757059034, 0.10494046910202871, 0.10776743468359286, 0.11062752865915187, 0.11350967606952195, 0.11640345481007822, 0.11929915129501677, 0.12218779334683409 ], [ 0.09222293607995694, 0.08992674267266855, 0.08773410784391926, 0.08565158798750806, 0.0836847868345027, 0.08183824822632924, 0.08011537784948795, 0.07851840162607683, 0.07704836723707319, 0.07570519335664762, 0.07448776873186391, 0.07339410045925436, 0.07242150791754966, 0.07156685601169815, 0.07082681879365779, 0.07019816219716014, 0.06967803255556464, 0.06926423577464093, 0.06895549059306919, 0.06875163849023898, 0.06865379282074906, 0.06866441106480267, 0.06878727705744474, 0.06902738493218678, 0.06939072326351899, 0.06988396614390878, 0.07051408691453563, 0.07128791885946377, 0.07221169403266937, 0.07329059521896977, 0.07452835589234415, 0.07592693863606613, 0.07748631434462999, 0.07920435390355769, 0.08107683267461613, 0.08309753778242418, 0.0852584603167044, 0.08755004990236087, 0.0899615077116848, 0.09248109539039226, 0.09509644070110936, 0.0977948250375478, 0.10056344253037443, 0.10338962467409607, 0.10626102791727692, 0.10916578434788379, 0.11209261749043757, 0.11503092641740181, 0.11797084200566754, 0.12090325938479853 ], [ 0.0897174103254416, 0.08737749891333428, 0.08514758764850523, 0.08303476597941958, 0.08104507289421914, 0.07918336388571376, 0.07745320956805275, 0.07585683574275566, 0.07439511333917015, 0.07306760432919504, 0.07187266661505762, 0.07080761731300589, 0.06986895016294654, 0.06905259931149682, 0.06835423866493466, 0.06776960347187064, 0.06729481874395528, 0.0669267174919254, 0.06666313053882919, 0.06650312900203964, 0.0664472006975197, 0.06649734311594183, 0.06665705867121435, 0.06693124293502056, 0.06732596360193262, 0.06784813666386812, 0.06850511595663256, 0.06930422170016588, 0.07025224142872417, 0.07135494132074044, 0.07261662625486923, 0.07403978249813735, 0.07562482824525388, 0.07736998562717211, 0.07927127522418355, 0.0813226225847981, 0.08351605740308027, 0.0858419807525108, 0.0882894742091385, 0.09084662624964575, 0.0935008550252534, 0.09623921144746024, 0.09904865157308101, 0.10191627189826831, 0.10482950499720077, 0.10777627583915596, 0.11074512112064167, 0.1137252751835046, 0.11670672671909743, 0.1196802506458654 ], [ 0.08721975962114978, 0.08483631307591373, 0.08256968656470587, 0.08042757083229007, 0.07841650128412224, 0.07654169406843761, 0.07480691662820994, 0.07321440523104111, 0.07176484046055316, 0.07045738878800258, 0.06928981435937771, 0.06825866046362321, 0.06735949534062759, 0.0665872125705505, 0.06593637263251956, 0.0654015694753232, 0.06497780403734596, 0.06466084540593346, 0.06444755956361091, 0.06433618542804397, 0.06432653836191103, 0.06442012289773544, 0.06462013955944025, 0.06493137576222881, 0.06535997799360221, 0.06591311159317606, 0.06659852474593882, 0.06742404357867039, 0.06839703393018308, 0.06952387079136445, 0.07080945723268323, 0.07225683024113916, 0.07386688168036093, 0.07563820999515437, 0.07756710444067154, 0.07964765082296178, 0.08187193787244368, 0.08423033749634763, 0.086711830400956, 0.08930435030138323, 0.09199512406518717, 0.09477099048790151, 0.09761868595917964, 0.10052509033097634, 0.10347743044579462, 0.10646344189031773, 0.10947149165704699, 0.112490665673464, 0.11551082578186217, 0.11852264090613734 ], [ 0.08473323284884803, 0.08230629334637458, 0.08000336838821304, 0.07783282739704561, 0.07580177280526344, 0.07391583916692125, 0.07217902958877373, 0.0705936054865897, 0.06916004402510412, 0.06787707405905978, 0.06674179622662292, 0.06574988666903658, 0.06489587749262597, 0.06417350138410363, 0.06357608334823134, 0.06309695960159717, 0.06272990209948025, 0.06246952662961344, 0.062311662488950176, 0.0622536622562631, 0.06229463116285324, 0.06243555740487613, 0.06267932795818061, 0.06303061955949744, 0.06349566179950608, 0.06408187862697902, 0.06479742534849076, 0.06565064921358031, 0.06664951122588547, 0.06780101306728306, 0.0691106743880754, 0.07058210139166139, 0.07221667794356479, 0.07401339685500609, 0.07596883387107799, 0.0780772528079507, 0.08033081937285501, 0.08271989469123836, 0.08523337762593762, 0.0878590668944732, 0.09058401855835402, 0.09339488035095077, 0.09627819039733528, 0.09922063337119176, 0.10220925160205799, 0.10523161195858506, 0.10827593155822467, 0.11133116666598078, 0.11438706975619052, 0.11743421982494306 ], [ 0.08226138422322321, 0.07979082396973437, 0.07745183691238304, 0.07525355873534634, 0.07320374040989734, 0.07130850304944221, 0.06957213279813988, 0.06799693627634633, 0.06658317540588346, 0.06532909606042626, 0.06423105823738517, 0.06328376719224227, 0.06248059646175876, 0.06181398622485546, 0.0612758949823657, 0.06085827946962465, 0.06055357682121552, 0.06035516363151138, 0.060257767948020804, 0.060257811870299716, 0.06035366419299691, 0.060545784743175186, 0.06083674532346515, 0.061231117148977776, 0.061735221830808866, 0.06235675236622535, 0.06310428170714899, 0.06398668809631504, 0.06501253671656514, 0.06618946425395597, 0.06752361491136094, 0.06901917219933663, 0.07067802068315658, 0.07249955732369363, 0.07448065565888964, 0.07661577069299291, 0.0788971604030431, 0.08131519263504186, 0.08385870405365034, 0.08651537994505946, 0.08927212869910991, 0.09211543124382472, 0.09503165232411986, 0.09800730644529865, 0.10102927608452368, 0.10408498328136015, 0.1071625180407895, 0.11025072832091298, 0.11333927696995633, 0.11641867104667258 ], [ 0.07980812073133357, 0.07729361229529769, 0.0749185810118154, 0.07269302769101964, 0.07062544587846033, 0.0687225237601999, 0.06698888841560371, 0.06542691876950268, 0.06403665198450006, 0.06281580263584215, 0.06175990514718505, 0.060862578846566075, 0.060115903490650796, 0.059510883196950144, 0.0590379699364179, 0.05868761467097091, 0.05845081446860975, 0.0583196263826252, 0.05828762224076764, 0.058350261769316396, 0.05850516430514163, 0.058752262001718854, 0.0590938206464608, 0.05953431886215409, 0.06008018327914023, 0.06073938649620077, 0.06152092589044672, 0.06243421342152746, 0.0634884176485498, 0.06469180700781439, 0.06605114591540873, 0.06757119120184171, 0.06925432583915607, 0.07110035146755193, 0.07310644360963191, 0.07526725682260946, 0.07757515406592809, 0.08002052682589975, 0.08259217028659609, 0.08527768020494544, 0.08806384364233087, 0.09093700270571398, 0.09388337759262488, 0.09688934158596739, 0.09994164572539917, 0.10302759457003424, 0.1061351768743784, 0.10925315635546831, 0.11237112829656877, 0.11547954775482146 ], [ 0.07737775564678014, 0.07481874299537422, 0.07240742775771372, 0.0701547870479146, 0.06807016531274075, 0.06616091296841985, 0.06443206888872134, 0.06288612060289117, 0.061522874795966145, 0.06033946408507867, 0.059330504358438986, 0.05848840189730701, 0.05780379382995913, 0.05726609223852449, 0.056864093783212014, 0.05658661389922784, 0.056423106741008845, 0.056364237262877905, 0.056402378011576194, 0.05653200873406408, 0.05675000108117752, 0.05705577378812864, 0.057451306689030805, 0.057941005977947393, 0.0585314192939002, 0.05923080799248974, 0.060048595119877646, 0.06099471999376884, 0.062078941979265286, 0.06331014459750274, 0.06469569419336149, 0.06624090351548358, 0.06794863967466312, 0.06981909965636023, 0.0718497577977203, 0.07403547182305896, 0.07636872011342924, 0.07883993460566224, 0.08143789135477777, 0.08415012340938753, 0.08696332660716807, 0.08986373643329265, 0.09283746172222512, 0.09587076772923972, 0.09895030645097877, 0.10206329592155655, 0.10519765268768706, 0.10834208303025913, 0.11148613903736379, 0.11462024560705583 ], [ 0.07497506888792627, 0.0723707407014672, 0.06992260528686975, 0.06764274044243392, 0.06554146600128943, 0.06362690703834116, 0.061904601006157314, 0.060377192297190185, 0.05904425724551174, 0.05790229454314902, 0.05694490059756943, 0.05616312884637614, 0.055546010601877374, 0.055081197256671245, 0.054755673162589426, 0.05455648641768127, 0.05447144987551255, 0.054489773954675996, 0.05460260294065402, 0.054803434936991476, 0.055088411388528796, 0.05545646553519416, 0.055909321581439825, 0.05645133943884599, 0.05708920505280502, 0.05783147436281492, 0.05868798977848946, 0.05966920057697091, 0.06078543080326377, 0.06204614745399894, 0.06345928536011348, 0.06503068151550705, 0.06676366043658798, 0.06865879511258727, 0.0707138483189578, 0.07292388019832237, 0.07528149326092651, 0.07777717721244777, 0.0803997135892648, 0.0831366030502808, 0.08597448457276723, 0.08889952383088975, 0.09189775612334095, 0.09495537631330042, 0.09805897383328033, 0.10119571478773111, 0.10435347571662136, 0.10752093494643286, 0.11068762796002059, 0.11384397314234024 ], [ 0.07260537502814113, 0.06995464248585541, 0.067468817502093, 0.06516121674051482, 0.06304327793795979, 0.0611240334850644, 0.05940962568390864, 0.057902919499626504, 0.0566032696429613, 0.05550648920272978, 0.05460504659767661, 0.05388848959164842, 0.053344065665672465, 0.05295748418977935, 0.05271375284805245, 0.05259802024085021, 0.052596366231849566, 0.0526964966708673, 0.05288831452901727, 0.05316435161070605, 0.05352005247950241, 0.05395390570982653, 0.05446741896882133, 0.05506493602345827, 0.05575329749066047, 0.056541354125811086, 0.05743935173350682, 0.05845821928165909, 0.05960880434907758, 0.060901109799185865, 0.06234358970979736, 0.06394255913443413, 0.06570176090525337, 0.0676221150579286, 0.06970165581779786, 0.07193564134443214, 0.07431680599837738, 0.07683571579137453, 0.079481185235396, 0.08224071692331691, 0.08510093197036935, 0.08804796790920985, 0.09106782910314033, 0.09414668213102839, 0.09727109437837449, 0.10042821815225406, 0.10360592520459193, 0.10679289790371119, 0.10997868376640887, 0.11315371994450002 ], [ 0.07027459970081178, 0.06757608172164249, 0.06505133300139966, 0.0627150611495679, 0.06057998408150117, 0.058656197617803295, 0.05695057887691852, 0.05546629692227879, 0.05420250581535136, 0.05315428397752313, 0.052312856688686835, 0.0516661001424254, 0.051199284916532854, 0.05089598463194196, 0.05073905974721673, 0.050711628805895935, 0.05079795598658135, 0.050984206998388036, 0.05125904768703511, 0.05161407619114666, 0.05204408856320545, 0.05254718072635832, 0.053124689306239314, 0.053780973370110396, 0.05452304094023666, 0.055360029761725625, 0.05630256135420955, 0.05736199971007403, 0.05854965881064696, 0.059876013362188854, 0.06134997173092678, 0.06297826681385635, 0.06476500909156246, 0.06671142803292769, 0.06881580674040746, 0.07107359433364337, 0.07347766464753071, 0.0760186804867803, 0.07868552026404116, 0.08146572719535243, 0.08434594835529723, 0.08731233970368993, 0.09035092196494024, 0.09344787985016412, 0.09658980303184424, 0.09976387143431263, 0.1029579899898434, 0.10616087935323937, 0.10936212951032595, 0.11255222306045218 ], [ 0.06798936489253316, 0.06524138479201198, 0.06267609082654678, 0.06030974683421513, 0.05815653426631288, 0.05622779530308933, 0.0545313004049959, 0.0530706314487856, 0.05184477980608362, 0.05084804603583327, 0.05007029205704645, 0.04949754390816232, 0.049112887206923174, 0.04889755427851375, 0.048832083030946105, 0.048897435089759876, 0.0490759874382185, 0.04935234616253762, 0.04971396199009332, 0.05015154864148027, 0.050659315238501285, 0.05123502555046495, 0.051879893885211935, 0.052598324109767475, 0.053397497766906485, 0.05428682124076687, 0.05527725058973586, 0.05638052473264269, 0.05760835064221432, 0.05897159479516718, 0.060479540068551475, 0.062139264229988875, 0.06395518463981292, 0.06592879544599914, 0.06805860188618149, 0.07034023554031378, 0.07276671819281273, 0.07532883253872356, 0.07801555562987145, 0.08081451449654908, 0.08371243075223793, 0.086695530034996, 0.08974990110194248, 0.09286179713827597, 0.09601787784258103, 0.09920539503960929, 0.10241232716299048, 0.10562746927921234, 0.10884048574295077, 0.11204193239151282 ], [ 0.06575708307059833, 0.06295768175502135, 0.0603498255435602, 0.05795151109737047, 0.055778588382422306, 0.0538438588977007, 0.05215617895444197, 0.05071968362326085, 0.049533262577596195, 0.04859040560940362, 0.0478794883862744, 0.047384496415090585, 0.047086107727885906, 0.046962996839744996, 0.04699320064957717, 0.04715540281349407, 0.04743003469537659, 0.04780014035900391, 0.04825199489513353, 0.048775491727344106, 0.04936432494818292, 0.05001599154942545, 0.05073163164030737, 0.05151571782691955, 0.05237560162427177, 0.053320926943962434, 0.0543629284067927, 0.055513643975868616, 0.05678508444960492, 0.05818841320836202, 0.059733194823138464, 0.06142676827748517, 0.06327378908117842, 0.06527596616841641, 0.06743199771128379, 0.06973768913090084, 0.07218622038798515, 0.07476852026712753, 0.07747370314328443, 0.08028952739658676, 0.08320284214673197, 0.08619999813287721, 0.08926720760339496, 0.0923908458690718, 0.09555769319282288, 0.09875511988044809, 0.10197122002012526, 0.10519490063414529, 0.1084159334104668, 0.11162497598492832 ], [ 0.06358605909462915, 0.06073303121235251, 0.058080213596792905, 0.05564752004072692, 0.053452694809353204, 0.05151024429976122, 0.04983034288813199, 0.048417858458567734, 0.047271670555834734, 0.046384441442053156, 0.04574293843877191, 0.04532890591596245, 0.04512037795474462, 0.045093244912175263, 0.04522286285668798, 0.045485524226360007, 0.0458596708599827, 0.04632679966258359, 0.04687206566237092, 0.04748461814860712, 0.04815771454673008, 0.048888650995417504, 0.04967853667195056, 0.050531927597001924, 0.051456329219339465, 0.05246157735294753, 0.05355911379648604, 0.054761184383517625, 0.05608000026828255, 0.0575269142596633, 0.059111669413170746, 0.06084177440457134, 0.06272204890273435, 0.06475436395952178, 0.06693758089176312, 0.06926767152556695, 0.07173798671112319, 0.07433963084795309, 0.07706189807013475, 0.07989272948392799, 0.0828191583614931, 0.08582771931619286, 0.08890480647300644, 0.09203697338536114, 0.0952111734265619, 0.09841494354521127, 0.10163653683876106, 0.1048650107060615, 0.10809027774074272, 0.11130312633080154 ], [ 0.061485597229009106, 0.05857655801959614, 0.0558760414912294, 0.053406064666593644, 0.051186509736934165, 0.0492338673865547, 0.047559907440608236, 0.04617045791361253, 0.04506451951460237, 0.04423393390745759, 0.04366374358523055, 0.043333243401523676, 0.04321757477051322, 0.04328960919237236, 0.04352184261211303, 0.0438880725857563, 0.04436472287163791, 0.044931774602741774, 0.045573331961339524, 0.04627788446644228, 0.047038333057107626, 0.047851834703513285, 0.04871950171375976, 0.04964597546056088, 0.05063888448288944, 0.051708195336628626, 0.05286547047747547, 0.05412305859417876, 0.05549325583575071, 0.056987487439409734, 0.05861556475894812, 0.06038507017512743, 0.06230091135556598, 0.06436506856828635, 0.06657653775438342, 0.06893145202544342, 0.0714233487733771, 0.07404354073826598, 0.07678154743025366, 0.07962554702232577, 0.08256281621067872, 0.08558013448145133, 0.08866413803249058, 0.09180161619050027, 0.09497974903866194, 0.09818628907120931, 0.10140969223010851, 0.10463920498268162, 0.10786491451021586, 0.11107776889732551 ], [ 0.05946610809330503, 0.056498599786528075, 0.05374739371102951, 0.05123678908322681, 0.048989061335879436, 0.04702299724015466, 0.04535228881287917, 0.043984007960558395, 0.04291745820374818, 0.042143700720295996, 0.04164594884916472, 0.04140083550019052, 0.04138035061940943, 0.041554105857371515, 0.04189156039785285, 0.042363924420283035, 0.0429455905960783, 0.04361507052867624, 0.044355496976494886, 0.045154787592910785, 0.04600556368683679, 0.046904895596814114, 0.04785391951745658, 0.048857348456911205, 0.04992288687094862, 0.05106055527772772, 0.052281936409038936, 0.05359936539441942, 0.05502509944738333, 0.05657051355667726, 0.058245374203682726, 0.06005724079266881, 0.06201103389920642, 0.06410879237111304, 0.06634962117812301, 0.06872981273297403, 0.0712431096320877, 0.07388106835043966, 0.07663348160414493, 0.07948882069623946, 0.08243466627038654, 0.08545810451593211, 0.0885460743771169, 0.09168565867580089, 0.09486431777476134, 0.09807006842398093, 0.10129161293941746, 0.10451842517165202, 0.10774080015724871, 0.11094987419765728 ], [ 0.057539206868275926, 0.05451085398227404, 0.051705853807453954, 0.04915094706341866, 0.04687105883530864, 0.04488761051223401, 0.04321659361764545, 0.04186667194531053, 0.04083769539592669, 0.0401200294626679, 0.03969497492175935, 0.03953629190779269, 0.03961255379846284, 0.03988986827338268, 0.04033448649828443, 0.04091495153947378, 0.04160362719921562, 0.04237761416915009, 0.04321915917081119, 0.04411569422722152, 0.04505962924235782, 0.046047986647209396, 0.04708193046316675, 0.04816621390213888, 0.049308553320877455, 0.05051893178658411, 0.05180884037714631, 0.05319047621352892, 0.054675929141897735, 0.056276399924682495, 0.058001498298628766, 0.05985866714652477, 0.06185276903267345, 0.06398585522070266, 0.06625711830248464, 0.06866301152045402, 0.07119750397314745, 0.07385243298031333, 0.07661791316294075, 0.0794827651781546, 0.0824349337561484, 0.08546187285000703, 0.08855088380796448, 0.09168939951960203, 0.0948652129997181, 0.09806665278027167, 0.10128270995207236, 0.10450312301746893, 0.10771842718818024, 0.11091997466206803 ], [ 0.0557177894178288, 0.052626511552843425, 0.049764705144824464, 0.047161675685559214, 0.04484523909934631, 0.042839804488323745, 0.0411640863934113, 0.039828757282011094, 0.03883453008663545, 0.03817121738364761, 0.03781815647129869, 0.03774603410960883, 0.03791974221033693, 0.038301642554405414, 0.038854616495915796, 0.03954447506668008, 0.04034157007274828, 0.041221659216078496, 0.042166189741877344, 0.043162187156041525, 0.04420190442027744, 0.04528233687968034, 0.04640466088272319, 0.04757361970824209, 0.04879686137759231, 0.050084227531336095, 0.05144699736758969, 0.05289710160437738, 0.054446334318590174, 0.05610560133017706, 0.057884249267603556, 0.0597895176256521, 0.06182614686892904, 0.06399616066382885, 0.0662988227195114, 0.06873075200191227, 0.07128616720215748, 0.07395722396605936, 0.07673440673094216, 0.0796069400913444, 0.08256319080593194, 0.08559103915515283, 0.0886782059544824, 0.09181252818886093, 0.09498218149980953, 0.09817585153530449, 0.10138285860430052, 0.10459324141521806, 0.10779780619964068, 0.1109881474831388 ], [ 0.05401606732746508, 0.050860355150526636, 0.04793910782432966, 0.04528426303648834, 0.042926730531432755, 0.0408942535962552, 0.03920872586063182, 0.037883311627830665, 0.0369199846919516, 0.0363082195378898, 0.036025386610458364, 0.036038922244587115, 0.03630978343703857, 0.03679635562210882, 0.03745800474466489, 0.038257762998870466, 0.03916400134180015, 0.0401512083343396, 0.041200114395744294, 0.04229740508302798, 0.04343521243275336, 0.04461050435005414, 0.04582443300588995, 0.04708166307057868, 0.04838967950977437, 0.04975806902501218, 0.051197774370160105, 0.05272033200808608, 0.05433711647809853, 0.056058625534354624, 0.057893845572884683, 0.059849735407426656, 0.06193085807842745, 0.06413917674834246, 0.0664740146961069, 0.06893216417140871, 0.07150811706926738, 0.07419438355786298, 0.0769818631486005, 0.07986023538624346, 0.08281834292178543, 0.08584454667572487, 0.08892703982038701, 0.09205411353743341, 0.09521437249343573, 0.09839690161044423, 0.10159138809658443, 0.10478820406103534, 0.107978455617336, 0.11115400441132828 ], [ 0.05244953677403652, 0.049228790741821606, 0.046246215212017085, 0.04353637009183202, 0.04113339417141884, 0.0390686723009981, 0.0373677383982188, 0.03604678320243276, 0.03510952076602548, 0.03454538703773873, 0.034329848777650405, 0.03442695881828999, 0.03479351635700752, 0.035383727535158116, 0.03615332477733073, 0.037062538367336896, 0.03807780415404299, 0.03917241790646144, 0.04032646676623201, 0.04152634514149634, 0.042764077628800516, 0.0440365808032289, 0.04534492465993692, 0.04669360928692159, 0.04808985005026564, 0.04954285934815312, 0.05106311886452014, 0.05266164793687788, 0.05434928664003531, 0.056136022780475046, 0.05803039749235558, 0.06003902312330435, 0.06216623972072601, 0.06441392425861323, 0.06678145236669564, 0.06926579859799517, 0.07186175057369582, 0.07456220604801395, 0.0773585202666639, 0.0802408732393936, 0.08319863146608218, 0.08622068489253906, 0.08929574627093598, 0.09241260585755398, 0.09556033906320367, 0.0987284681470658, 0.10190708138363418, 0.1050869145146226, 0.10825939993995079, 0.11141668921330018 ], [ 0.05103485090210079, 0.047749771827773284, 0.04470517829754299, 0.041938145099125954, 0.03948607348669837, 0.03738421358914287, 0.035662160206697914, 0.0343396819074293, 0.033422779489714075, 0.03290124162159793, 0.03274878386069008, 0.03292601698847678, 0.03338542131913709, 0.03407687473292001, 0.03495240376421887, 0.0359694465593136, 0.03709256566758524, 0.038293939582873436, 0.039553071368849516, 0.04085609032452977, 0.04219490106739213, 0.04356631990109749, 0.04497125558110501, 0.04641394239241045, 0.047901210955935906, 0.049441778049428224, 0.051045543700503675, 0.05272289611530882, 0.05448403814876594, 0.056338359570215435, 0.05829388497638856, 0.060356826733463154, 0.06253126602723579, 0.06481897444585806, 0.06721937582803075, 0.0697296359056843, 0.07234485765229914, 0.07505835445124512, 0.07786197147206168, 0.0807464274171857, 0.08370165302693848, 0.08671710823234587, 0.08978206559754202, 0.09288585295990051, 0.09601805253737598, 0.09916865707688999, 0.10232818590034741, 0.10548776510726925, 0.10863917689905492, 0.11177488318364882 ], [ 0.049789563166522964, 0.04644256857481402, 0.0433369719211339, 0.040512144844536635, 0.0380086490582382, 0.035865685777207716, 0.03411722426631744, 0.03278711739462717, 0.031884227525401015, 0.031399173238197096, 0.03130418537136972, 0.03155649211064744, 0.03210420365912674, 0.03289281564831091, 0.03387064972369444, 0.034992408126006624, 0.036220860854491145, 0.03752714056461792, 0.03889020574834181, 0.040295919062991875, 0.04173602358727187, 0.04320716050383208, 0.044709978249317855, 0.04624833130162036, 0.04782854509025521, 0.049458721086900026, 0.051148064507364935, 0.05290623012000706, 0.05474269502211588, 0.056666177805648095, 0.05868412929510974, 0.060802320157023096, 0.06302454547995112, 0.06535245727551546, 0.06778552480244095, 0.07032111187405202, 0.07295465171481826, 0.07567989459533302, 0.07848920167232992, 0.08137385975882748, 0.08432439528333076, 0.08733087046544923, 0.0903831498376352, 0.09347113001007851, 0.09658492960527856, 0.09971503941157144, 0.10285243502251427, 0.10598865564566347, 0.10911585353108509, 0.11222681874570345 ], [ 0.048731712952790926, 0.04532733439480578, 0.042163969951804534, 0.039282958528568154, 0.036727759647518725, 0.03454141712178178, 0.032762397372512804, 0.03141900654765708, 0.030523499364301637, 0.03006785939367395, 0.030023234913429946, 0.0303437057716067, 0.03097313856099099, 0.03185274588688793, 0.032927257210865916, 0.03414875998641744, 0.03547833559845625, 0.03688613506395067, 0.03835058675994864, 0.03985725304685354, 0.04139764236857386, 0.04296811967200428, 0.044568955349796165, 0.046203499742253365, 0.04787745023700995, 0.049598177722713896, 0.051374089116502, 0.05321401657870164, 0.055126637660756296, 0.05711994124945527, 0.05920076013897432, 0.061374391785760055, 0.06364432468086831, 0.06601208006394502, 0.06847716920082715, 0.07103715706823238, 0.07368781564161855, 0.07642334506757571, 0.07923663911957107, 0.08211957217837618, 0.08506328784969977, 0.08805847339190458, 0.09109560859453397, 0.09416518202085297, 0.0972578712210147, 0.10036468645459394, 0.10347707960346926, 0.10658702137783128, 0.10968705073893899, 0.11277030081608877 ], [ 0.04787923801585211, 0.04442443583071578, 0.04120920629026445, 0.0382764303648986, 0.03567203462352271, 0.03344255739797419, 0.03163080539981199, 0.03026965228161709, 0.029375122749828377, 0.028941098699255433, 0.028938193014524966, 0.029317810448443282, 0.03001996275942296, 0.030981905383419158, 0.03214504749707532, 0.03345907014468113, 0.0348834987628732, 0.036387557122140826, 0.03794912822954158, 0.03955340470497548, 0.04119155408072758, 0.04285953795669534, 0.0445571139005123, 0.046286995663610844, 0.04805412952163675, 0.04986504659105107, 0.05172726254287317, 0.05364871083609762, 0.05563720948706916, 0.05769997208165452, 0.059843179927062985, 0.062071633553760844, 0.06438849867150336, 0.06679515530008653, 0.0692911507065292, 0.07187424864336837, 0.07454056059886016, 0.07728474024275064, 0.08010022029984074, 0.08297947150990853, 0.085914265590638, 0.08889592751646702, 0.09191556628962393, 0.09496427717158397, 0.09803331170175315, 0.1011142145645366, 0.10419892842178004, 0.107279869243082, 0.11034997553163425, 0.11340273526809438 ], [ 0.04724922302866135, 0.04375354324193841, 0.04049529571209388, 0.037518415106642916, 0.03487071329264299, 0.03260161752957507, 0.030757768618320285, 0.029376348424621477, 0.028477243054133624, 0.028056671058069787, 0.028085385883812028, 0.028512883752171314, 0.029276058125204944, 0.03030883686028892, 0.03154978999576837, 0.03294651176605391, 0.03445714032280704, 0.036050016513186976, 0.037702431004801355, 0.03939910032072769, 0.041130712016365104, 0.04289267283294281, 0.04468407784121149, 0.04650686572884883, 0.04836510989940432, 0.050264399243824844, 0.05221127542108701, 0.05421270885395909, 0.05627560973178523, 0.05840638105250042, 0.060610527128179305, 0.06289233283195886, 0.06525462667396485, 0.0676986355998466, 0.07022393257968079, 0.07282847102947364, 0.07550869410399137, 0.07825970273324481, 0.08107546427717474, 0.08394904373682119, 0.08687284116910521, 0.08983882174166583, 0.09283872816405457, 0.09586426856528858, 0.09890727591775957, 0.1019598376390804, 0.1050143959618742, 0.10806382105790877, 0.11110145980051832, 0.11412116353552 ], [ 0.04685702861305715, 0.04333253050639002, 0.04004305873601993, 0.03703309186700337, 0.03435163547759781, 0.032050164790205636, 0.030178278062896743, 0.02877675391213745, 0.027869025396654038, 0.027453879717211443, 0.02750296173153272, 0.02796493313337167, 0.0287747066691431, 0.02986387193104686, 0.03116888963149693, 0.032635719646855556, 0.034221327862500345, 0.03589321189739503, 0.0376279955873703, 0.03940978039835265, 0.04122860657705229, 0.043079154430420694, 0.04495969564512267, 0.04687125198830961, 0.04881690493914765, 0.0508012055581167, 0.052829647843935595, 0.05490818459317821, 0.05704277891326052, 0.05923899526015985, 0.06150164041448713, 0.06383446712725493, 0.06623995177680587, 0.06871915322598435, 0.07127165435275401, 0.0738955816864165, 0.07658769328120077, 0.07934352113363895, 0.08215755243612774, 0.08502343372160436, 0.08793418318572048, 0.0908823987203723, 0.0938604519770438, 0.0968606616822554, 0.09987544213937875, 0.10289742517747859, 0.10591955565877655, 0.10893516202032562, 0.11193800424222904, 0.11492230217110994 ], [ 0.04671538411437697, 0.04317629353834919, 0.03986998955238358, 0.03684100166412604, 0.03413878278145401, 0.03181584323339037, 0.029923542327495438, 0.0285051009581689, 0.02758673020260438, 0.027169720875311602, 0.027227342758278823, 0.02770874360399646, 0.02854836972102203, 0.029676820765356, 0.03102943641946087, 0.032551141114736455, 0.03419800479943608, 0.035936732149745236, 0.03774319274960898, 0.039600714627842065, 0.0414985063256457, 0.043430338981245764, 0.04539349531825049, 0.047387939178133644, 0.049415645935972086, 0.051480040476075746, 0.05358550364112196, 0.05573692382510116, 0.057939284347683466, 0.060197287834046605, 0.06251502543558242, 0.06489570141637413, 0.06734142291830653, 0.06985306146119082, 0.07243018798274502, 0.07507107804910688, 0.0777727792000023, 0.08053122889438127, 0.083341409525349, 0.08619752649832728, 0.08909319619475067, 0.09202163241769998, 0.09497582223759714, 0.09794868466262899, 0.10093320796694608, 0.10392256363123004, 0.10691019658523168, 0.109889892760717, 0.1128558258856369, 0.11580258602457223 ], [ 0.046833558134694635, 0.043295650773939494, 0.0399887966965273, 0.036957122906255815, 0.03424978207159589, 0.03191922696525665, 0.03001718544411259, 0.028587846862435814, 0.027659049173397187, 0.027234204424947176, 0.027288813716218746, 0.0277739265398511, 0.028625277128809325, 0.029774093099525344, 0.031155800547844167, 0.032715031344429754, 0.03440731537088337, 0.03619865174465585, 0.03806408265539322, 0.03998600899991578, 0.0419526257099321, 0.043956615689375145, 0.04599411293726472, 0.04806389005397596, 0.0501667108795989, 0.052304794643187984, 0.054481351669559384, 0.056700165917967706, 0.058965213137938864, 0.0612803137211604, 0.0636488259029417, 0.06607338792433236, 0.06855571760989206, 0.07109647531859242, 0.07369519230495696, 0.07635026211434678, 0.079058988542285, 0.08181768050542793, 0.08462178222469048, 0.08746602647009402, 0.09034459911474435, 0.09325130461410933, 0.09617972393931996, 0.09912335863782935, 0.10207575681695144, 0.10503061876590802, 0.10798188154469028, 0.11092378313037025, 0.1138509076263018, 0.11675821363930433 ], [ 0.0472167295714145, 0.04369650890799962, 0.04040628877635474, 0.037389383013323785, 0.03469393628900984, 0.032371271564096075, 0.030472067032005435, 0.029039905286182895, 0.02810291237778555, 0.027665999448177225, 0.02770728988001671, 0.028181032897239448, 0.029026006424090617, 0.030175771018608966, 0.031567167259719885, 0.03314539278376343, 0.03486588663999437, 0.036694099405828136, 0.03860422349404149, 0.040577616730598697, 0.042601307934307386, 0.04466673676410197, 0.04676874911044292, 0.04890481049270787, 0.051074382628165736, 0.05327841186344413, 0.05551889029277214, 0.05779846448668478, 0.06012007946327523, 0.06248665533745557, 0.06490080049213841, 0.06736456822849402, 0.06987926413290745, 0.07244530953307379, 0.07506216320637718, 0.07772829975654351, 0.08044123949791727, 0.08319762181004788, 0.08599331205702208, 0.0888235313950732, 0.09168299902644858, 0.09456607748595132, 0.09746691310282483, 0.10037956559978797, 0.10329812264698778, 0.10621679691331735, 0.1091300046441752, 0.11203242599088507, 0.1149190482122529, 0.11778519348165209 ], [ 0.0478656595090328, 0.044379445760474735, 0.04112283593672908, 0.038137954295152036, 0.035471297456009326, 0.0331720970572762, 0.03128871074857073, 0.02986268310566382, 0.02892115417209321, 0.028469823639424064, 0.028489581111342036, 0.028938855046429762, 0.02976095363676331, 0.030893327882273378, 0.03227553484834591, 0.03385425018898502, 0.0355853608059191, 0.03743402086979033, 0.039373636799957916, 0.04138447988705911, 0.04345231919247578, 0.04556724317035667, 0.04772270752805429, 0.04991478421907807, 0.05214156505829446, 0.05440267363603191, 0.05669884887646066, 0.05903157594016774, 0.06140275169879435, 0.06381438109519885, 0.06626830679486947, 0.06876597768158701, 0.07130826234947851, 0.0738953123924816, 0.07652647768457081, 0.07920027267673356, 0.08191438962590844, 0.08466575208785349, 0.08745060023976178, 0.0902645987555083, 0.09310295798769593, 0.09596055995830091, 0.09883208191010671, 0.10171211170115221, 0.10459525093568375, 0.10747620326289122, 0.11034984663406831, 0.11321128943136831, 0.11605591124650695, 0.11887938970272333 ], [ 0.048776712948658554, 0.045339781277744975, 0.04213251164819041, 0.039195489758351014, 0.03657301375262951, 0.03431144289450873, 0.03245582381627494, 0.031044568696120788, 0.030102835221865614, 0.029636471374732416, 0.02962906156513395, 0.030043761601920946, 0.030829423355686506, 0.031928586725755805, 0.033284642020960646, 0.03484661944016639, 0.03657144941550717, 0.03842434017945793, 0.04037808248884537, 0.04241191563532612, 0.04451033844318295, 0.046662047683850856, 0.04885906007686209, 0.05109600875401067, 0.05336957919609776, 0.05567804573176092, 0.058020876167381, 0.060398382182931414, 0.06281140310962569, 0.06526101883495941, 0.06774829319338295, 0.0702740522527271, 0.07283870270626172, 0.07544209463034633, 0.07808343075971695, 0.08076122176422788, 0.08347328431594768, 0.08621677643003763, 0.08898826291461678, 0.09178380288914845, 0.09459905121035275, 0.09742936616472672, 0.10026991677777128, 0.1031157843661922, 0.10596205434822102, 0.10880389568866122, 0.11163662658851647, 0.1144557660728238, 0.11725707195671431, 0.12003656627671803 ], [ 0.049942213783064945, 0.04656810345818962, 0.043423854410731676, 0.040548196811620627, 0.03798279080636723, 0.03577056597194215, 0.03395261551954708, 0.032563551845954414, 0.031625936901040784, 0.031145300215219253, 0.03110770462680213, 0.03148115407858486, 0.03222051293824682, 0.03327412972179455, 0.0345900352016034, 0.03612035820734219, 0.03782366649734207, 0.039665644795974946, 0.04161874033554111, 0.04366131983623468, 0.04577669614428055, 0.04795221360274186, 0.050178465419133775, 0.05244865098809897, 0.054758051582910375, 0.057103594728719745, 0.059483480507560915, 0.061896850453979704, 0.06434348783872199, 0.06682354509476969, 0.06933729911165858, 0.07188493794938255, 0.07446638340631095, 0.07708115321812956, 0.07972826495981652, 0.08240618147652413, 0.08511279534001581, 0.08784544777966198, 0.09060097601487732, 0.09337578203738929, 0.0961659156618663, 0.09896716500186341, 0.1017751483016449, 0.1045854021097658, 0.10739346196926827, 0.1101949329963252, 0.11298554882966193, 0.115761218395078, 0.11851806071020177, 0.12125242854508793 ], [ 0.05135105784594459, 0.04805112648798828, 0.044981052943575024, 0.04217744279911863, 0.03967900811080903, 0.0375249287208789, 0.03575204976261082, 0.03439092916274273, 0.033461293388811646, 0.03296808694005683, 0.032899564371107116, 0.0332283636037375, 0.03391534429653231, 0.03491490079470016, 0.03618014709862818, 0.037666847507522444, 0.039335730832517075, 0.041153403267064334, 0.04309231258442809, 0.045130202444430355, 0.047249373647467625, 0.04943593748487298, 0.05167914640045443, 0.05397082540870684, 0.056304896282043874, 0.05867697491313509, 0.061084021769387854, 0.06352403000254497, 0.06599574190940956, 0.06849839006693813, 0.07103146365879161, 0.07359450298862952, 0.07618692603064159, 0.07880789039956794, 0.0814561927285693, 0.08413020554495058, 0.08682784971962594, 0.089546598752091, 0.092283509757646, 0.09503527516321002, 0.0977982888126294, 0.10056872037768277, 0.10334259256395298, 0.1061158564656166, 0.10888446143395195, 0.11164441686969175, 0.11439184434202347, 0.11712301931629693, 0.11983440250273476, 0.12252266140537059 ], [ 0.05298947474661268, 0.04977271302121231, 0.046785300554096874, 0.04406151656397894, 0.04163695338845882, 0.03954694277152131, 0.03782408275966333, 0.03649495068645341, 0.035576488082434514, 0.03507295730879643, 0.034974503820125645, 0.03525797606389984, 0.03588986041364517, 0.036830438118574275, 0.038038003616393465, 0.03947225395695905, 0.04109647753001356, 0.04287861391822066, 0.04479148249393302, 0.04681251177236578, 0.048923233962978145, 0.051108715161220925, 0.053357011108097215, 0.05565868364997985, 0.05800638202165293, 0.060394479226223804, 0.06281875044018834, 0.06527608244577887, 0.06776420723175135, 0.07028145713977767, 0.07282654226231505, 0.07539835283345755, 0.07799579008513136, 0.08061762866838715, 0.08326241257170061, 0.08592838484726321, 0.08861344970683861, 0.09131516394064838, 0.09403075333956591, 0.09675714897165141, 0.09949103780861254, 0.10222892228149442, 0.10496718378868387, 0.10770214588109986, 0.11043013370240846, 0.1131475271689338, 0.11585080625499353, 0.11853658754654782, 0.1212016519025562, 0.12384296360118754 ], [ 0.05484182565600973, 0.05171489819488827, 0.04881608983807982, 0.04617723262915029, 0.04383076069730392, 0.04180824285593123, 0.04013824783393601, 0.03884366498213404, 0.03793888518760623, 0.03742750650389201, 0.03730128283700352, 0.03754075420338456, 0.038117462553351036, 0.03899714785580727, 0.040143107127848784, 0.04151904015430661, 0.04309104094893626, 0.04482871679833489, 0.046705611018166, 0.048699164619864364, 0.05079042495578894, 0.05296364880303794, 0.05520588712369455, 0.05750659334102964, 0.05985726860566413, 0.062251142959407264, 0.0646828859919471, 0.06714834053823825, 0.06964427530120416, 0.0721681551804046, 0.07471793053078414, 0.0772918481130137, 0.0798882870309791, 0.08250562259719861, 0.08514212005033027, 0.08779585864121182, 0.09046468507083529, 0.09314619383249288, 0.09583773084901764, 0.09853641600460548, 0.1012391797838503, 0.10394280922774103, 0.10664399873754911, 0.10933940182012367, 0.11202568058233033, 0.11469955056362524, 0.11735781927221871, 0.11999741750743431, 0.12261542317188405, 0.12520907778154802 ], [ 0.05689134541109322, 0.05385879524299877, 0.05105229615645066, 0.04850119609515089, 0.04623484661697326, 0.044281272382863106, 0.04266536506169888, 0.04140673526774221, 0.04051754693315393, 0.04000081394975069, 0.039849648466670856, 0.04004774903790336, 0.04057106239330238, 0.04139021349725995, 0.042473139430354655, 0.043787428821891336, 0.04530207705767845, 0.046988591915997066, 0.048821539310777616, 0.050778684517887564, 0.05284088323593696, 0.054991842606810296, 0.057217830783317374, 0.05950737859008918, 0.061850992729824354, 0.06424088613642745, 0.06667072480138028, 0.06913538884628366, 0.07163074648448339, 0.07415344122882322, 0.0767006943129626, 0.0792701253245825, 0.08185959434487282, 0.08446706849473301, 0.08709051486213445, 0.08972782053504892, 0.0923767391037624, 0.09503486171345991, 0.09769960968589214, 0.10036824497719501, 0.10303789433348454, 0.10570558293592498, 0.10836827354746421, 0.11102290761755022, 0.11366644539387652, 0.11629590275829048, 0.11890838318341743, 0.12150110384675125, 0.12407141550405805, 0.12661681619230744 ], [ 0.05912077086919407, 0.056185318183793465, 0.053472985923091916, 0.05101067706499986, 0.04882482276012244, 0.0469402052094081, 0.045378455469019655, 0.04415635337752839, 0.04328418139965457, 0.04276447277179443, 0.042591482769800224, 0.04275156947432132, 0.04322443735790799, 0.043984973833034964, 0.04500529375955052, 0.046256632909955846, 0.04771085684824626, 0.049341502056111264, 0.0511243828425968, 0.05303785875099968, 0.055062870314233826, 0.05718283548878789, 0.05938347301339208, 0.06165259382898073, 0.06397988267722278, 0.06635667993237201, 0.06877576740336795, 0.07123115943944966, 0.07371790049099244, 0.07623187104521915, 0.07876960474862302, 0.08132812009071484, 0.08390477007389982, 0.08649711282814819, 0.08910280524988025, 0.09171952060775056, 0.09434488983252515, 0.0969764650471282, 0.09961170291675203, 0.10224796468566245, 0.10488252935183398, 0.1075126163086698, 0.11013541392074817, 0.11274811084403497, 0.11534792738765635, 0.11793214478098119, 0.12049813079984543, 0.12304336077278355, 0.12556543349802415, 0.12806208203247155 ], [ 0.061512831182395346, 0.05867570650529922, 0.05605795441960431, 0.05368413303498394, 0.05157797194617397, 0.04976135184822414, 0.04825307200902958, 0.04706751731395542, 0.04621341534375771, 0.045692921699270486, 0.04550125245068358, 0.04562698292786844, 0.04605297943378944, 0.046757784469548355, 0.047717194763289866, 0.048905777489032375, 0.05029814339890748, 0.05186989336677692, 0.053598238786097645, 0.05546234763528839, 0.05744348684999654, 0.05952502798882363, 0.06169236871274254, 0.0639328060317701, 0.06623538334747721, 0.06859072364352835, 0.07099085551237262, 0.07342903603913395, 0.07589957375323332, 0.07839765495221122, 0.08091917703279793, 0.08346059263446509, 0.08601876822749079, 0.08859086022962952, 0.09117421087661207, 0.09376626501650233, 0.09636450787782834, 0.09896642280004697, 0.1015694670119063, 0.10417106286583361, 0.10676860151661133, 0.10935945587030381, 0.11194099969895839, 0.11451063007471696, 0.11706579067115218, 0.11960399395591897, 0.12212284080709844, 0.12462003658392948, 0.12709340313869294, 0.12954088664844068 ], [ 0.06405060181093986, 0.06131187027779759, 0.058788037401742405, 0.05650145947373378, 0.054473413014668966, 0.05272322445280673, 0.0512672691087174, 0.05011793246139298, 0.049282674882396994, 0.0487633648861553, 0.04855602572058344, 0.04865107099997018, 0.04903400521775286, 0.04968646969485676, 0.050587458025474326, 0.05171452233926853, 0.05304483337053048, 0.05455601931594883, 0.056226766694819706, 0.058037206657373455, 0.05996912951925357, 0.06200607324313996, 0.06413332510119006, 0.06633786588988262, 0.06860827668982243, 0.07093462102238807, 0.07330831066358295, 0.07572196089143583, 0.07816923987396342, 0.08064471659162717, 0.08314371162960825, 0.0856621550508384, 0.08819645520928647, 0.09074338174351022, 0.09329996514173852, 0.09586341427653207, 0.09843105227134696, 0.10100027008237202, 0.10356849633883893, 0.10613318134038124, 0.1086917926897352, 0.11124181984547989, 0.11378078489303939, 0.11630625701784826, 0.11881586847850159, 0.12130733027365341, 0.12377844613042537, 0.12622712387631507, 0.12865138366105955, 0.13104936284832397 ], [ 0.06671774005578442, 0.06407659074873341, 0.06164525471965919, 0.059444055060149194, 0.05749207179681533, 0.05580640857680839, 0.054401385332126365, 0.053287731418004476, 0.05247188227210205, 0.05195549312995805, 0.05173526528051296, 0.05180313269716162, 0.05214679148317845, 0.05275049236804366, 0.05359597761797487, 0.05466343779649823, 0.05593238673748786, 0.05738239152345636, 0.058993633467802065, 0.06074730604131249, 0.06262587285803219, 0.0646132147597142, 0.06669469353637622, 0.06885715480211575, 0.0710888868604594, 0.07337954760333998, 0.07572006812757567, 0.07810253973299729, 0.08052008991993863, 0.08296675251308806, 0.08543733675503117, 0.08792729989858622, 0.09043262735511845, 0.09294972378908947, 0.09547531771347675, 0.09800638120046692, 0.10054006535754181, 0.10307365131061086, 0.10560451565069354, 0.1081301086865825, 0.11064794342840456, 0.11315559300945124, 0.11565069422140718, 0.11813095496248223, 0.1205941636424604, 0.12303819891357616, 0.12546103846303516, 0.12786076597801355, 0.13023557574945516, 0.13258377469667837 ], [ 0.069498626730643, 0.0669536152208103, 0.0646128415660143, 0.06249477521607729, 0.06061654908634912, 0.05899334701208431, 0.05763775526601414, 0.05655913621047883, 0.055763098413446496, 0.05525114093896944, 0.05502053464574193, 0.05506447061661214, 0.05537246292878881, 0.055930952290599266, 0.05672403047091267, 0.05773419900542491, 0.05894308774198219, 0.06033208208834656, 0.0618828335430391, 0.06357764950279002, 0.06539977234620467, 0.06733356448196415, 0.06936461732247594, 0.07147980035001172, 0.07366726352386778, 0.07591640345657139, 0.07821780161836225, 0.08056314140238766, 0.08294511004155991, 0.08535729087337118, 0.08779405107867014, 0.09025042961370983, 0.09272202952274693, 0.09520491813584746, 0.09769553784548227, 0.1001906292677915, 0.10268716769530661, 0.10518231290288889, 0.10767337163359791, 0.11015777150663854, 0.11263304467764776, 0.11509681934659446, 0.1175468171392173, 0.11998085446089894, 0.12239684610656337, 0.12479280967265227, 0.12716686962391063, 0.12951726018848386, 0.131842326564365, 0.13414052419947692 ], [ 0.07237843901386949, 0.06992768110857721, 0.06767521247397025, 0.0656378283518719, 0.06383094710322487, 0.06226810137229581, 0.060960417986467515, 0.05991613095535004, 0.05914018071498371, 0.058633952628341486, 0.05839519605611586, 0.05841814291347896, 0.05869381639379693, 0.059210493854730276, 0.05995426970737121, 0.060909658311917185, 0.06206018282182096, 0.06338890969846482, 0.06487890507663423, 0.06651360397300497, 0.06827709409836977, 0.07015432229195646, 0.07213123415371353, 0.07419485761446255, 0.07633334018012584, 0.07853594828124846, 0.08079303601852882, 0.08309598977097798, 0.08543715458835982, 0.08780974790419238, 0.09020776575226795, 0.09262588625089235, 0.09505937458197065, 0.09750399302648208, 0.0999559188473181, 0.10241167198010732, 0.10486805365757478, 0.10732209630825759, 0.10977102438321702, 0.11221222520943507, 0.11464322856545209, 0.11706169342818136, 0.1194654002411098, 0.12185224708438115, 0.12422024826085376, 0.12656753402014634, 0.12889235039576116, 0.1311930584017795, 0.13346813210254593, 0.13571615531327672 ], [ 0.07534317633594735, 0.07298449686932432, 0.07081789078493528, 0.06885865086643893, 0.06712069152678818, 0.06561612733168498, 0.06435485556303636, 0.06334417621363436, 0.06258848716826469, 0.06208909065496971, 0.06184413812487761, 0.061848725404054124, 0.062095131329063295, 0.06257317551503744, 0.06327065851922749, 0.06417384279042031, 0.06526793534779064, 0.06653754102547121, 0.06796706538174771, 0.0695410563130649, 0.07124448132734224, 0.07306294272905486, 0.0749828358947957, 0.07699145703111338, 0.07907706701831932, 0.08122891771418905, 0.08343724675923106, 0.08569324663689744, 0.08798901351366835, 0.09031748116697141, 0.09267234503944968, 0.0950479810861354, 0.09743936358315754, 0.09984198544727234, 0.10225178390181647, 0.10466507355906747, 0.10707848821984293, 0.1094889319664042, 0.11189353948517891, 0.11428964503166845, 0.11667475905893993, 0.11904655127822261, 0.12140283879906605, 0.12374157799193153, 0.12606085880652038, 0.12835890043983156, 0.13063404745367577, 0.13288476566832205, 0.13510963738667747, 0.13730735571530084 ], [ 0.07837965654701114, 0.07611069983607535, 0.07402742517602394, 0.07214378236749072, 0.07047236865156055, 0.06902407979756121, 0.06780777417922629, 0.06682997469949735, 0.06609463526207511, 0.06560299631827364, 0.0653535473415987, 0.06534210361689632, 0.06556199239875453, 0.06600433189292434, 0.06665837805498004, 0.06751191030825815, 0.06855162803527887, 0.06976353401087537, 0.07113328715065308, 0.0726465134218872, 0.07428906936440724, 0.07604725687062451, 0.0779079906628976, 0.07985892156529925, 0.08188851956796596, 0.0839861211493521, 0.08614194557133863, 0.08834708500256777, 0.09059347338595251, 0.0928738389339315, 0.09518164498374744, 0.09751102365666624, 0.09985670633729116, 0.10221395443838574, 0.10457849327398498, 0.1069464511700196, 0.10931430524178089, 0.11167883460393031, 0.11403708118780582, 0.11638631784948615, 0.11872402307673809, 0.12104786134900429, 0.12335566806754429, 0.1256454379405373, 0.1279153157624, 0.1301635886468969, 0.13238867893786188, 0.1345891372086857, 0.13676363495376923, 0.13891095675678042 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
l2norm: 1.38659 (SEM: 0)
x1: 0.390009
x2: 0.484777
x3: 0.620187
x4: 0.372901
x5: 0.968942
x6: 0.270128", "Arm 1_0
l2norm: 1.67238 (SEM: 0)
x1: 0.68776
x2: 0.615438
x3: 0.689196
x4: 0.417482
x5: 0.915375
x6: 0.676682", "Arm 2_0
l2norm: 1.59865 (SEM: 0)
x1: 0.95764
x2: 0.167751
x3: 0.496014
x4: 0.642918
x5: 0.30651
x6: 0.92583", "Arm 3_0
l2norm: 0.955017 (SEM: 0)
x1: 0.0926778
x2: 0.332059
x3: 0.0585783
x4: 0.0471739
x5: 0.0107612
x6: 0.887374", "Arm 4_0
l2norm: 1.35976 (SEM: 0)
x1: 0.26073
x2: 0.286949
x3: 0.275763
x4: 0.888628
x5: 0.232173
x6: 0.882619", "Arm 5_0
l2norm: 1.39365 (SEM: 0)
x1: 0.639662
x2: 0.842044
x3: 0.622089
x4: 0.520951
x5: 0.121692
x6: 0.388392", "Arm 6_0
l2norm: 1.17602 (SEM: 0)
x1: 0.994613
x2: 0.196109
x3: 0.520917
x4: 0.268871
x5: 0.0392088
x6: 0.100654", "Arm 7_0
l2norm: 1.30677 (SEM: 0)
x1: 0.206567
x2: 0.986012
x3: 0.304217
x4: 0.470113
x5: 0.607818
x6: 0.0988146", "Arm 8_0
l2norm: 1.18932 (SEM: 0)
x1: 0.357994
x2: 0.705235
x3: 0.162171
x4: 0.689849
x5: 0.276761
x6: 0.458443", "Arm 9_0
l2norm: 1.49136 (SEM: 0)
x1: 0.485334
x2: 0.337206
x3: 0.485432
x4: 0.916801
x5: 0.145307
x6: 0.881819", "Arm 10_0
l2norm: 0.849615 (SEM: 0)
x1: 0.00647854
x2: 0.599803
x3: 0.508827
x4: 0.141854
x5: 0.236467
x6: 0.164607", "Arm 11_0
l2norm: 1.86108 (SEM: 0)
x1: 0.459401
x2: 0.898029
x3: 0.99714
x4: 0.650145
x5: 0.22863
x6: 0.988373", "Arm 12_0
l2norm: 1.16236 (SEM: 0)
x1: 0.148654
x2: 0.890722
x3: 0.322065
x4: 0.396069
x5: 0.512522
x6: 0.110999", "Arm 13_0
l2norm: 1.22574 (SEM: 0)
x1: 0.173257
x2: 0.938148
x3: 0.315384
x4: 0.421139
x5: 0.551775
x6: 0.104992", "Arm 14_0
l2norm: 1.2263 (SEM: 0)
x1: 0.156095
x2: 0.903943
x3: 0.303977
x4: 0.495681
x5: 0.558742
x6: 0.109725", "Arm 15_0
l2norm: 1.22827 (SEM: 0)
x1: 0.138462
x2: 0.887222
x3: 0.315214
x4: 0.440501
x5: 0.631318
x6: 0.101687", "Arm 16_0
l2norm: 1.22017 (SEM: 0)
x1: 0.213419
x2: 0.931309
x3: 0.302199
x4: 0.493319
x5: 0.476509
x6: 0.119136", "Arm 17_0
l2norm: 1.23097 (SEM: 0)
x1: 0.23707
x2: 0.931752
x3: 0.29827
x4: 0.526668
x5: 0.457952
x6: 0.121935", "Arm 18_0
l2norm: 1.22612 (SEM: 0)
x1: 0.277411
x2: 0.909669
x3: 0.289103
x4: 0.577296
x5: 0.408704
x6: 0.122599", "Arm 19_0
l2norm: 1.22105 (SEM: 0)
x1: 0.330297
x2: 0.877442
x3: 0.27184
x4: 0.634409
x5: 0.351309
x6: 0.110301", "Arm 20_0
l2norm: 1.23555 (SEM: 0)
x1: 0.373742
x2: 0.86826
x3: 0.257991
x4: 0.670804
x5: 0.327703
x6: 0.0953997", "Arm 21_0
l2norm: 1.19786 (SEM: 0)
x1: 0.380542
x2: 0.867854
x3: 0.183501
x4: 0.637279
x5: 0.294266
x6: 0.102488", "Arm 22_0
l2norm: 1.23852 (SEM: 0)
x1: 0.379637
x2: 0.900776
x3: 0.133906
x4: 0.683591
x5: 0.28126
x6: 0.118635", "Arm 23_0
l2norm: 1.1726 (SEM: 0)
x1: 0.3988
x2: 0.863998
x3: 0.204404
x4: 0.557786
x5: 0.329601
x6: 0.0890017" ], "type": "scatter", "x": [ 0.6201868057250977, 0.6891960520297289, 0.4960140520706773, 0.05857829935848713, 0.27576256915926933, 0.6220887135714293, 0.5209174817427993, 0.3042166670784354, 0.16217140387743711, 0.4854324860498309, 0.5088272364810109, 0.9971401728689671, 0.32206470728357206, 0.315383501963437, 0.30397682174188345, 0.3152143681598879, 0.3021986737486994, 0.29826994836343884, 0.2891031778192835, 0.27183955681974764, 0.25799069377063066, 0.1835014745751721, 0.13390581383041236, 0.20440419827708106 ], "xaxis": "x", "y": [ 0.3729006052017212, 0.4174817567691207, 0.6429175222292542, 0.04717387817800045, 0.8886282052844763, 0.520950760692358, 0.2688705064356327, 0.4701127056032419, 0.6898487396538258, 0.9168005948886275, 0.14185417629778385, 0.6501454496756196, 0.39606928607573527, 0.42113872373714384, 0.49568082674413944, 0.4405013271247066, 0.4933193418832443, 0.5266678644498773, 0.5772956548198634, 0.6344085467200655, 0.6708043060537464, 0.6372785278014517, 0.6835908755164742, 0.5577861302848721 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
l2norm: 1.38659 (SEM: 0)
x1: 0.390009
x2: 0.484777
x3: 0.620187
x4: 0.372901
x5: 0.968942
x6: 0.270128", "Arm 1_0
l2norm: 1.67238 (SEM: 0)
x1: 0.68776
x2: 0.615438
x3: 0.689196
x4: 0.417482
x5: 0.915375
x6: 0.676682", "Arm 2_0
l2norm: 1.59865 (SEM: 0)
x1: 0.95764
x2: 0.167751
x3: 0.496014
x4: 0.642918
x5: 0.30651
x6: 0.92583", "Arm 3_0
l2norm: 0.955017 (SEM: 0)
x1: 0.0926778
x2: 0.332059
x3: 0.0585783
x4: 0.0471739
x5: 0.0107612
x6: 0.887374", "Arm 4_0
l2norm: 1.35976 (SEM: 0)
x1: 0.26073
x2: 0.286949
x3: 0.275763
x4: 0.888628
x5: 0.232173
x6: 0.882619", "Arm 5_0
l2norm: 1.39365 (SEM: 0)
x1: 0.639662
x2: 0.842044
x3: 0.622089
x4: 0.520951
x5: 0.121692
x6: 0.388392", "Arm 6_0
l2norm: 1.17602 (SEM: 0)
x1: 0.994613
x2: 0.196109
x3: 0.520917
x4: 0.268871
x5: 0.0392088
x6: 0.100654", "Arm 7_0
l2norm: 1.30677 (SEM: 0)
x1: 0.206567
x2: 0.986012
x3: 0.304217
x4: 0.470113
x5: 0.607818
x6: 0.0988146", "Arm 8_0
l2norm: 1.18932 (SEM: 0)
x1: 0.357994
x2: 0.705235
x3: 0.162171
x4: 0.689849
x5: 0.276761
x6: 0.458443", "Arm 9_0
l2norm: 1.49136 (SEM: 0)
x1: 0.485334
x2: 0.337206
x3: 0.485432
x4: 0.916801
x5: 0.145307
x6: 0.881819", "Arm 10_0
l2norm: 0.849615 (SEM: 0)
x1: 0.00647854
x2: 0.599803
x3: 0.508827
x4: 0.141854
x5: 0.236467
x6: 0.164607", "Arm 11_0
l2norm: 1.86108 (SEM: 0)
x1: 0.459401
x2: 0.898029
x3: 0.99714
x4: 0.650145
x5: 0.22863
x6: 0.988373", "Arm 12_0
l2norm: 1.16236 (SEM: 0)
x1: 0.148654
x2: 0.890722
x3: 0.322065
x4: 0.396069
x5: 0.512522
x6: 0.110999", "Arm 13_0
l2norm: 1.22574 (SEM: 0)
x1: 0.173257
x2: 0.938148
x3: 0.315384
x4: 0.421139
x5: 0.551775
x6: 0.104992", "Arm 14_0
l2norm: 1.2263 (SEM: 0)
x1: 0.156095
x2: 0.903943
x3: 0.303977
x4: 0.495681
x5: 0.558742
x6: 0.109725", "Arm 15_0
l2norm: 1.22827 (SEM: 0)
x1: 0.138462
x2: 0.887222
x3: 0.315214
x4: 0.440501
x5: 0.631318
x6: 0.101687", "Arm 16_0
l2norm: 1.22017 (SEM: 0)
x1: 0.213419
x2: 0.931309
x3: 0.302199
x4: 0.493319
x5: 0.476509
x6: 0.119136", "Arm 17_0
l2norm: 1.23097 (SEM: 0)
x1: 0.23707
x2: 0.931752
x3: 0.29827
x4: 0.526668
x5: 0.457952
x6: 0.121935", "Arm 18_0
l2norm: 1.22612 (SEM: 0)
x1: 0.277411
x2: 0.909669
x3: 0.289103
x4: 0.577296
x5: 0.408704
x6: 0.122599", "Arm 19_0
l2norm: 1.22105 (SEM: 0)
x1: 0.330297
x2: 0.877442
x3: 0.27184
x4: 0.634409
x5: 0.351309
x6: 0.110301", "Arm 20_0
l2norm: 1.23555 (SEM: 0)
x1: 0.373742
x2: 0.86826
x3: 0.257991
x4: 0.670804
x5: 0.327703
x6: 0.0953997", "Arm 21_0
l2norm: 1.19786 (SEM: 0)
x1: 0.380542
x2: 0.867854
x3: 0.183501
x4: 0.637279
x5: 0.294266
x6: 0.102488", "Arm 22_0
l2norm: 1.23852 (SEM: 0)
x1: 0.379637
x2: 0.900776
x3: 0.133906
x4: 0.683591
x5: 0.28126
x6: 0.118635", "Arm 23_0
l2norm: 1.1726 (SEM: 0)
x1: 0.3988
x2: 0.863998
x3: 0.204404
x4: 0.557786
x5: 0.329601
x6: 0.0890017" ], "type": "scatter", "x": [ 0.6201868057250977, 0.6891960520297289, 0.4960140520706773, 0.05857829935848713, 0.27576256915926933, 0.6220887135714293, 0.5209174817427993, 0.3042166670784354, 0.16217140387743711, 0.4854324860498309, 0.5088272364810109, 0.9971401728689671, 0.32206470728357206, 0.315383501963437, 0.30397682174188345, 0.3152143681598879, 0.3021986737486994, 0.29826994836343884, 0.2891031778192835, 0.27183955681974764, 0.25799069377063066, 0.1835014745751721, 0.13390581383041236, 0.20440419827708106 ], "xaxis": "x2", "y": [ 0.3729006052017212, 0.4174817567691207, 0.6429175222292542, 0.04717387817800045, 0.8886282052844763, 0.520950760692358, 0.2688705064356327, 0.4701127056032419, 0.6898487396538258, 0.9168005948886275, 0.14185417629778385, 0.6501454496756196, 0.39606928607573527, 0.42113872373714384, 0.49568082674413944, 0.4405013271247066, 0.4933193418832443, 0.5266678644498773, 0.5772956548198634, 0.6344085467200655, 0.6708043060537464, 0.6372785278014517, 0.6835908755164742, 0.5577861302848721 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x4" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot(param_x=\"x3\", param_y=\"x4\", metric_name=\"l2norm\"))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Here we plot the optimization trace, showing the progression of finding the point with the optimal objective:" ] }, { "cell_type": "code", "execution_count": 13, "metadata": { "collapsed": true }, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.35768218847510747, -0.35768218847510747, -0.35768218847510747, -0.35768218847510747, -0.35768218847510747, -0.35768218847510747, -0.35768218847510747, -1.238584796203339, -1.238584796203339, -1.238584796203339, -1.238584796203339, -1.238584796203339, -1.238584796203339, -1.238584796203339, -1.238584796203339, -1.238584796203339, -1.4138917649735567, -1.6912030607171142, -2.144523008910148, -2.561152017041225, -2.6790020582468936, -2.80175017983848, -2.80175017983848, -2.9998627766727117, -2.9998627766727117 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "legendgroup": "objective value", "line": { "color": "rgba(128,177,211,1)" }, "mode": "lines", "name": "objective value", "text": [ "
Parameterization:
x1: 0.39000874757766724
x2: 0.48477688431739807
x3: 0.6201868057250977
x4: 0.3729006052017212
x5: 0.9689423441886902
x6: 0.270128071308136", "
Parameterization:
x1: 0.687760048545897
x2: 0.6154378708451986
x3: 0.6891960520297289
x4: 0.4174817567691207
x5: 0.9153745546936989
x6: 0.6766822021454573", "
Parameterization:
x1: 0.9576395759359002
x2: 0.16775123495608568
x3: 0.4960140520706773
x4: 0.6429175222292542
x5: 0.3065104326233268
x6: 0.9258302552625537", "
Parameterization:
x1: 0.0926778158172965
x2: 0.33205884136259556
x3: 0.05857829935848713
x4: 0.04717387817800045
x5: 0.01076122373342514
x6: 0.8873743591830134", "
Parameterization:
x1: 0.2607303876429796
x2: 0.2869488541036844
x3: 0.27576256915926933
x4: 0.8886282052844763
x5: 0.23217338509857655
x6: 0.8826193660497665", "
Parameterization:
x1: 0.6396621037274599
x2: 0.8420444577932358
x3: 0.6220887135714293
x4: 0.520950760692358
x5: 0.12169190961867571
x6: 0.38839204516261816", "
Parameterization:
x1: 0.9946128223091364
x2: 0.19610906951129436
x3: 0.5209174817427993
x4: 0.2688705064356327
x5: 0.03920882847160101
x6: 0.10065402742475271", "
Parameterization:
x1: 0.20656659547239542
x2: 0.9860119735822082
x3: 0.3042166670784354
x4: 0.4701127056032419
x5: 0.6078184014186263
x6: 0.09881463181227446", "
Parameterization:
x1: 0.35799355898052454
x2: 0.7052349736914039
x3: 0.16217140387743711
x4: 0.6898487396538258
x5: 0.27676060050725937
x6: 0.4584433799609542", "
Parameterization:
x1: 0.4853339958935976
x2: 0.33720611222088337
x3: 0.4854324860498309
x4: 0.9168005948886275
x5: 0.1453069420531392
x6: 0.8818185431882739", "
Parameterization:
x1: 0.00647854246199131
x2: 0.5998026626184583
x3: 0.5088272364810109
x4: 0.14185417629778385
x5: 0.23646723851561546
x6: 0.16460655350238085", "
Parameterization:
x1: 0.45940114092081785
x2: 0.898029220290482
x3: 0.9971401728689671
x4: 0.6501454496756196
x5: 0.2286302214488387
x6: 0.9883725671097636", "
Parameterization:
x1: 0.14865416557074349
x2: 0.8907215834754846
x3: 0.32206470728357206
x4: 0.39606928607573527
x5: 0.5125216058676955
x6: 0.11099920420143151", "
Parameterization:
x1: 0.17325699289581364
x2: 0.9381481282078161
x3: 0.315383501963437
x4: 0.42113872373714384
x5: 0.5517752901024279
x6: 0.10499187651816344", "
Parameterization:
x1: 0.15609532635273107
x2: 0.9039430771781723
x3: 0.30397682174188345
x4: 0.49568082674413944
x5: 0.5587418834660398
x6: 0.10972509255315252", "
Parameterization:
x1: 0.13846156901837675
x2: 0.887222090945938
x3: 0.3152143681598879
x4: 0.4405013271247066
x5: 0.6313183387021923
x6: 0.101686673697017", "
Parameterization:
x1: 0.21341931425309868
x2: 0.9313088555152559
x3: 0.3021986737486994
x4: 0.4933193418832443
x5: 0.4765091248027003
x6: 0.11913568697833954", "
Parameterization:
x1: 0.23706991985741568
x2: 0.9317521768838072
x3: 0.29826994836343884
x4: 0.5266678644498773
x5: 0.4579522457138489
x6: 0.12193457576678993", "
Parameterization:
x1: 0.2774112084230395
x2: 0.9096691710485897
x3: 0.2891031778192835
x4: 0.5772956548198634
x5: 0.40870402705985437
x6: 0.12259948679826595", "
Parameterization:
x1: 0.33029706062391895
x2: 0.8774421557504858
x3: 0.27183955681974764
x4: 0.6344085467200655
x5: 0.3513086129693555
x6: 0.11030071364850189", "
Parameterization:
x1: 0.37374210927118157
x2: 0.8682598103138811
x3: 0.25799069377063066
x4: 0.6708043060537464
x5: 0.32770326369546765
x6: 0.09539973805508543", "
Parameterization:
x1: 0.3805422671622196
x2: 0.8678538093147753
x3: 0.1835014745751721
x4: 0.6372785278014517
x5: 0.2942657010815383
x6: 0.10248785963985503", "
Parameterization:
x1: 0.3796368658852596
x2: 0.900775599635827
x3: 0.13390581383041236
x4: 0.6835908755164742
x5: 0.2812596833368221
x6: 0.11863466962057842", "
Parameterization:
x1: 0.398799983715681
x2: 0.8639979152227888
x3: 0.20440419827708106
x4: 0.5577861302848721
x5: 0.32960121633237277
x6: 0.08900174955572689", "
Parameterization:
x1: 0.41415796075985
x2: 0.8105076276095803
x3: 0.1911546105680069
x4: 0.5308527743544996
x5: 0.30001455785033193
x6: 0.04870912686776838" ], "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.35768218847510747, -0.35768218847510747, -0.35768218847510747, -0.35768218847510747, -0.35768218847510747, -0.35768218847510747, -0.35768218847510747, -1.238584796203339, -1.238584796203339, -1.238584796203339, -1.238584796203339, -1.238584796203339, -1.238584796203339, -1.238584796203339, -1.238584796203339, -1.238584796203339, -1.4138917649735567, -1.6912030607171142, -2.144523008910148, -2.561152017041225, -2.6790020582468936, -2.80175017983848, -2.80175017983848, -2.9998627766727117, -2.9998627766727117 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.35768218847510747, -0.35768218847510747, -0.35768218847510747, -0.35768218847510747, -0.35768218847510747, -0.35768218847510747, -0.35768218847510747, -1.238584796203339, -1.238584796203339, -1.238584796203339, -1.238584796203339, -1.238584796203339, -1.238584796203339, -1.238584796203339, -1.238584796203339, -1.238584796203339, -1.4138917649735567, -1.6912030607171142, -2.144523008910148, -2.561152017041225, -2.6790020582468936, -2.80175017983848, -2.80175017983848, -2.9998627766727117, -2.9998627766727117 ] }, { "line": { "color": "rgba(253,180,98,1)", "dash": "dash" }, "mode": "lines", "name": "Optimum", "type": "scatter", "x": [ 1, 25 ], "y": [ -3.32237, -3.32237 ] }, { "line": { "color": "rgba(141,211,199,1)", "dash": "dash" }, "mode": "lines", "name": "model change", "type": "scatter", "x": [ 12, 12 ], "y": [ -3.32237, -0.35768218847510747 ] } ], "layout": { "showlegend": true, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "Model performance vs. # of iterations" }, "xaxis": { "title": { "text": "Iteration" } }, "yaxis": { "title": { "text": "Hartmann6" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_optimization_trace(objective_optimum=hartmann6.fmin)) # Objective_optimum is optional." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 7. Save / reload optimization to JSON / SQL\n", "We can serialize the state of optimization to JSON and save it to a `.json` file or save it to the SQL backend. For the former:" ] }, { "cell_type": "code", "execution_count": 14, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:47] ax.service.ax_client: Saved JSON-serialized state of optimization to `ax_client_snapshot.json`.\n" ] } ], "source": [ "ax_client.save_to_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "code", "execution_count": 15, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:47] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "restored_ax_client = AxClient.load_from_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "To store state of optimization to an SQL backend, first follow [setup instructions](https://ax.dev/docs/storage.html#sql) on Ax website." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Having set up the SQL backend, pass `DBSettings` to `AxClient` on instantiation (note that `SQLAlchemy` dependency will have to be installed – for installation, refer to [optional dependencies](https://ax.dev/docs/installation.html#optional-dependencies) on Ax website):" ] }, { "cell_type": "code", "execution_count": 16, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:47] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "from ax.storage.sqa_store.structs import DBSettings\n", "\n", "# URL is of the form \"dialect+driver://username:password@host:port/database\".\n", "db_settings = DBSettings(url=\"sqlite:///foo.db\")\n", "# Instead of URL, can provide a `creator function`; can specify custom encoders/decoders if necessary.\n", "new_ax = AxClient(db_settings=db_settings)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "When valid `DBSettings` are passed into `AxClient`, a unique experiment name is a required argument (`name`) to `ax_client.create_experiment`. The **state of the optimization is auto-saved** any time it changes (i.e. a new trial is added or completed, etc). \n", "\n", "To reload an optimization state later, instantiate `AxClient` with the same `DBSettings` and use `ax_client.load_experiment_from_database(experiment_name=\"my_experiment\")`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Special Cases" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Evaluation failure**: should any optimization iterations fail during evaluation, `log_trial_failure` will ensure that the same trial is not proposed again." ] }, { "cell_type": "code", "execution_count": 17, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:52] ax.service.ax_client: Generated new trial 25 with parameters {'x1': 0.429583, 'x2': 0.911245, 'x3': 0.214969, 'x4': 0.525381, 'x5': 0.242507, 'x6': 0.082465}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:52] ax.service.ax_client: Registered failure of trial 25.\n" ] } ], "source": [ "_, trial_index = ax_client.get_next_trial()\n", "ax_client.log_trial_failure(trial_index=trial_index)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Adding custom trials**: should there be need to evaluate a specific parameterization, `attach_trial` will add it to the experiment." ] }, { "cell_type": "code", "execution_count": 18, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:52] ax.service.ax_client: Attached custom parameterization {'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9} as trial 26.\n" ] }, { "data": { "text/plain": [ "({'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9}, 26)" ] }, "execution_count": 18, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.attach_trial(parameters={\"x1\": 0.9, \"x2\": 0.9, \"x3\": 0.9, \"x4\": 0.9, \"x5\": 0.9, \"x6\": 0.9})" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Need to run many trials in parallel**: for optimal results and optimization efficiency, we strongly recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). However, if your use case needs to dispatch many trials in parallel before they are updated with data and you are running into the *\"All trials for current model have been generated, but not enough data has been observed to fit next model\"* error, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Exceptions Meaning and Handling\n", "[**`DataRequiredError`**](https://ax.dev/api/exceptions.html#ax.exceptions.core.DataRequiredError): Ax generation strategy needs to be updated with more data to proceed to the next optimization model. When the optimization moves from initialization stage to the Bayesian optimization stage, the underlying BayesOpt model needs sufficient data to train. For optimal results and optimization efficiency (finding the optimal point in the least number of trials), we recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). Therefore, the correct way to handle this exception is to wait until more trial evaluations complete and log their data via `ax_client.complete_trial(...)`. \n", "\n", "However, if there is strong need to generate more trials before more data is available, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`. With this setting, as many trials will be generated from the initialization stage as requested, and the optimization will move to the BayesOpt stage whenever enough trials are completed." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "[**`MaxParallelismReachedException`**](https://ax.dev/api/modelbridge.html#ax.modelbridge.generation_strategy.MaxParallelismReachedException): generation strategy restricts the number of trials that can be ran simultaneously (to encourage sequential optimization), and the parallelism limit has been reached. The correct way to handle this exception is the same as `DataRequiredError` – to wait until more trial evluations complete and log their data via `ax_client.complete_trial(...)`.\n", " \n", "In some cases higher parallelism is important, so `enforce_sequential_optimization=False` kwarg to AxClient allows to suppress limiting of parallelism. It's also possible to override the default parallelism setting for all stages of the optimization by passing `choose_generation_strategy_kwargs` to `ax_client.create_experiment`:" ] }, { "cell_type": "code", "execution_count": 19, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:52] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:52] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:52] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter y. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:52] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='y', parameter_type=FLOAT, range=[0.0, 15.0])], parameter_constraints=[]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:52] ax.modelbridge.dispatch_utils: Using Bayesian optimization since there are more ordered parameters than there are categories for the unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-25 21:21:52] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 5 trials, GPEI for subsequent trials]). Iterations after 5 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client = AxClient()\n", "ax_client.create_experiment(\n", " parameters=[\n", " {\"name\": \"x\", \"type\": \"range\", \"bounds\": [-5.0, 10.0]},\n", " {\"name\": \"y\", \"type\": \"range\", \"bounds\": [0.0, 15.0]},\n", " ],\n", " # Sets max parallelism to 10 for all steps of the generation strategy.\n", " choose_generation_strategy_kwargs={\"max_parallelism_override\": 10},\n", ")" ] }, { "cell_type": "code", "execution_count": 20, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "[(5, 10), (-1, 10)]" ] }, "execution_count": 20, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism() # Max parallelism is now 10 for all stages of the optimization." ] } ], "metadata": { "kernelspec": { "display_name": "python3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.7.12" } }, "nbformat": 4, "nbformat_minor": 2 }