{ "cells": [ { "cell_type": "markdown", "id": "3aadd600", "metadata": { "papermill": { "duration": 0.005519, "end_time": "2023-12-09T18:34:12.134339", "exception": false, "start_time": "2023-12-09T18:34:12.128820", "status": "completed" }, "tags": [] }, "source": [ "# Service API Example on Hartmann6\n", "\n", "The Ax Service API is designed to allow the user to control scheduling of trials and data computation while having an easy to use interface with Ax.\n", "\n", "The user iteratively:\n", "- Queries Ax for candidates\n", "- Schedules / deploys them however they choose\n", "- Computes data and logs to Ax\n", "- Repeat" ] }, { "cell_type": "code", "execution_count": 1, "id": "f4fe91a2", "metadata": { "execution": { "iopub.execute_input": "2023-12-09T18:34:12.145053Z", "iopub.status.busy": "2023-12-09T18:34:12.144590Z", "iopub.status.idle": "2023-12-09T18:34:15.296260Z", "shell.execute_reply": "2023-12-09T18:34:15.295501Z" }, "papermill": { "duration": 3.174635, "end_time": "2023-12-09T18:34:15.313668", "exception": false, "start_time": "2023-12-09T18:34:12.139033", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/html": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:15] ax.utils.notebook.plotting: Injecting Plotly library into cell. Do not overwrite or delete cell.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:15] ax.utils.notebook.plotting: Please see\n", " (https://ax.dev/tutorials/visualizations.html#Fix-for-plots-that-are-not-rendering)\n", " if visualizations are not rendering.\n" ] }, { "data": { "text/html": [ " \n", " " ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "from ax.service.ax_client import AxClient, ObjectiveProperties\n", "from ax.utils.measurement.synthetic_functions import hartmann6\n", "from ax.utils.notebook.plotting import init_notebook_plotting, render\n", "\n", "init_notebook_plotting()" ] }, { "cell_type": "markdown", "id": "eb5981d2", "metadata": { "papermill": { "duration": 0.04063, "end_time": "2023-12-09T18:34:15.391820", "exception": false, "start_time": "2023-12-09T18:34:15.351190", "status": "completed" }, "tags": [] }, "source": [ "## 1. Initialize client\n", "\n", "Create a client object to interface with Ax APIs. By default this runs locally without storage." ] }, { "cell_type": "code", "execution_count": 2, "id": "603ba62d", "metadata": { "execution": { "iopub.execute_input": "2023-12-09T18:34:15.475073Z", "iopub.status.busy": "2023-12-09T18:34:15.474448Z", "iopub.status.idle": "2023-12-09T18:34:15.478922Z", "shell.execute_reply": "2023-12-09T18:34:15.478288Z" }, "papermill": { "duration": 0.047623, "end_time": "2023-12-09T18:34:15.480246", "exception": false, "start_time": "2023-12-09T18:34:15.432623", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:15] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "ax_client = AxClient()" ] }, { "cell_type": "markdown", "id": "c27f3078", "metadata": { "papermill": { "duration": 0.040862, "end_time": "2023-12-09T18:34:15.561806", "exception": false, "start_time": "2023-12-09T18:34:15.520944", "status": "completed" }, "tags": [] }, "source": [ "## 2. Set up experiment\n", "An experiment consists of a **search space** (parameters and parameter constraints) and **optimization configuration** (objectives and outcome constraints). Note that:\n", "- Only `parameters`, and `objectives` arguments are required.\n", "- Dictionaries in `parameters` have the following required keys: \"name\" - parameter name, \"type\" - parameter type (\"range\", \"choice\" or \"fixed\"), \"bounds\" for range parameters, \"values\" for choice parameters, and \"value\" for fixed parameters.\n", "- Dictionaries in `parameters` can optionally include \"value_type\" (\"int\", \"float\", \"bool\" or \"str\"), \"log_scale\" flag for range parameters, and \"is_ordered\" flag for choice parameters.\n", "- `parameter_constraints` should be a list of strings of form \"p1 >= p2\" or \"p1 + p2 <= some_bound\".\n", "- `outcome_constraints` should be a list of strings of form \"constrained_metric <= some_bound\"." ] }, { "cell_type": "code", "execution_count": 3, "id": "beb85bee", "metadata": { "execution": { "iopub.execute_input": "2023-12-09T18:34:15.644959Z", "iopub.status.busy": "2023-12-09T18:34:15.644346Z", "iopub.status.idle": "2023-12-09T18:34:15.658220Z", "shell.execute_reply": "2023-12-09T18:34:15.657488Z" }, "papermill": { "duration": 0.057218, "end_time": "2023-12-09T18:34:15.659770", "exception": false, "start_time": "2023-12-09T18:34:15.602552", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:15] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x2. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:15] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x3. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:15] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x4. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:15] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x5. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:15] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x6. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:15] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x1', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x2', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x3', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x4', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x5', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x6', parameter_type=FLOAT, range=[0.0, 1.0])], parameter_constraints=[ParameterConstraint(1.0*x1 + 1.0*x2 <= 2.0)]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:15] ax.modelbridge.dispatch_utils: Using Models.BOTORCH_MODULAR since there are more ordered parameters than there are categories for the unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:15] ax.modelbridge.dispatch_utils: Calculating the number of remaining initialization trials based on num_initialization_trials=None max_initialization_trials=None num_tunable_parameters=6 num_trials=None use_batch_trials=False\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:15] ax.modelbridge.dispatch_utils: calculated num_initialization_trials=12\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:15] ax.modelbridge.dispatch_utils: num_completed_initialization_trials=0 num_remaining_initialization_trials=12\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:15] ax.modelbridge.dispatch_utils: `verbose`, `disable_progbar`, and `jit_compile` are not yet supported when using `choose_generation_strategy` with ModularBoTorchModel, dropping these arguments.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:15] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+BoTorch', steps=[Sobol for 12 trials, BoTorch for subsequent trials]). Iterations after 12 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client.create_experiment(\n", " name=\"hartmann_test_experiment\",\n", " parameters=[\n", " {\n", " \"name\": \"x1\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " \"value_type\": \"float\", # Optional, defaults to inference from type of \"bounds\".\n", " \"log_scale\": False, # Optional, defaults to False.\n", " },\n", " {\n", " \"name\": \"x2\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x3\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x4\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x5\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x6\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " ],\n", " objectives={\"hartmann6\": ObjectiveProperties(minimize=True)},\n", " parameter_constraints=[\"x1 + x2 <= 2.0\"], # Optional.\n", " outcome_constraints=[\"l2norm <= 1.25\"], # Optional.\n", ")" ] }, { "cell_type": "markdown", "id": "703a5b4e", "metadata": { "papermill": { "duration": 0.041206, "end_time": "2023-12-09T18:34:15.742818", "exception": false, "start_time": "2023-12-09T18:34:15.701612", "status": "completed" }, "tags": [] }, "source": [ "## 3. Define how to evaluate trials\n", "When using Ax a service, evaluation of parameterizations suggested by Ax is done either locally or, more commonly, using an external scheduler. Below is a dummy evaluation function that outputs data for two metrics \"hartmann6\" and \"l2norm\". Note that all returned metrics correspond to either the `objectives` set on experiment creation or the metric names mentioned in `outcome_constraints`." ] }, { "cell_type": "code", "execution_count": 4, "id": "5594e0b5", "metadata": { "execution": { "iopub.execute_input": "2023-12-09T18:34:15.827660Z", "iopub.status.busy": "2023-12-09T18:34:15.826997Z", "iopub.status.idle": "2023-12-09T18:34:15.831648Z", "shell.execute_reply": "2023-12-09T18:34:15.830950Z" }, "papermill": { "duration": 0.048581, "end_time": "2023-12-09T18:34:15.833132", "exception": false, "start_time": "2023-12-09T18:34:15.784551", "status": "completed" }, "tags": [] }, "outputs": [], "source": [ "import numpy as np\n", "\n", "\n", "def evaluate(parameters):\n", " x = np.array([parameters.get(f\"x{i+1}\") for i in range(6)])\n", " # In our case, standard error is 0, since we are computing a synthetic function.\n", " return {\"hartmann6\": (hartmann6(x), 0.0), \"l2norm\": (np.sqrt((x**2).sum()), 0.0)}" ] }, { "cell_type": "markdown", "id": "1dfd33b1", "metadata": { "papermill": { "duration": 0.041269, "end_time": "2023-12-09T18:34:15.915818", "exception": false, "start_time": "2023-12-09T18:34:15.874549", "status": "completed" }, "tags": [] }, "source": [ "Result of the evaluation should generally be a mapping of the format: `{metric_name -> (mean, SEM)}`. If there is only one metric in the experiment – the objective – then evaluation function can return a single tuple of mean and SEM, in which case Ax will assume that evaluation corresponds to the objective. _It can also return only the mean as a float, in which case Ax will treat SEM as unknown and use a model that can infer it._ \n", "\n", "For more details on evaluation function, refer to the \"Trial Evaluation\" section in the Ax docs at [ax.dev](https://ax.dev/)" ] }, { "cell_type": "markdown", "id": "8c574105", "metadata": { "papermill": { "duration": 0.040993, "end_time": "2023-12-09T18:34:15.998305", "exception": false, "start_time": "2023-12-09T18:34:15.957312", "status": "completed" }, "tags": [] }, "source": [ "## 4. Run optimization loop\n", "With the experiment set up, we can start the optimization loop.\n", "\n", "At each step, the user queries the client for a new trial then submits the evaluation of that trial back to the client.\n", "\n", "Note that Ax auto-selects an appropriate optimization algorithm based on the search space. For more advance use cases that require a specific optimization algorithm, pass a `generation_strategy` argument into the `AxClient` constructor. Note that when Bayesian Optimization is used, generating new trials may take a few minutes." ] }, { "cell_type": "code", "execution_count": 5, "id": "0ea76eb9", "metadata": { "execution": { "iopub.execute_input": "2023-12-09T18:34:16.082877Z", "iopub.status.busy": "2023-12-09T18:34:16.082365Z", "iopub.status.idle": "2023-12-09T18:35:52.503978Z", "shell.execute_reply": "2023-12-09T18:35:52.503217Z" }, "papermill": { "duration": 96.529294, "end_time": "2023-12-09T18:35:52.568841", "exception": false, "start_time": "2023-12-09T18:34:16.039547", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:16] ax.service.ax_client: Generated new trial 0 with parameters {'x1': 0.991195, 'x2': 0.696153, 'x3': 0.054462, 'x4': 0.525896, 'x5': 0.895495, 'x6': 0.122259}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:16] ax.service.ax_client: Completed trial 0 with data: {'hartmann6': (-0.005645, 0.0), 'l2norm': (1.60109, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:16] ax.service.ax_client: Generated new trial 1 with parameters {'x1': 0.835657, 'x2': 0.654382, 'x3': 0.747797, 'x4': 0.667518, 'x5': 0.685586, 'x6': 0.766227}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:16] ax.service.ax_client: Completed trial 1 with data: {'hartmann6': (-0.023781, 0.0), 'l2norm': (1.785623, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:16] ax.service.ax_client: Generated new trial 2 with parameters {'x1': 0.886116, 'x2': 0.397046, 'x3': 0.581595, 'x4': 0.169549, 'x5': 0.117816, 'x6': 0.90553}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:16] ax.service.ax_client: Completed trial 2 with data: {'hartmann6': (-0.544777, 0.0), 'l2norm': (1.464142, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:16] ax.service.ax_client: Generated new trial 3 with parameters {'x1': 0.110969, 'x2': 0.644237, 'x3': 0.142957, 'x4': 0.610617, 'x5': 0.213155, 'x6': 0.92319}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:16] ax.service.ax_client: Completed trial 3 with data: {'hartmann6': (-0.202081, 0.0), 'l2norm': (1.310862, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:16] ax.service.ax_client: Generated new trial 4 with parameters {'x1': 0.455642, 'x2': 0.893072, 'x3': 0.194919, 'x4': 0.703352, 'x5': 0.036289, 'x6': 0.910101}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:16] ax.service.ax_client: Completed trial 4 with data: {'hartmann6': (-0.011768, 0.0), 'l2norm': (1.538663, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:16] ax.service.ax_client: Generated new trial 5 with parameters {'x1': 0.752016, 'x2': 0.02573, 'x3': 0.716384, 'x4': 0.959104, 'x5': 0.703394, 'x6': 0.611876}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:16] ax.service.ax_client: Completed trial 5 with data: {'hartmann6': (-0.002652, 0.0), 'l2norm': (1.693645, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:16] ax.service.ax_client: Generated new trial 6 with parameters {'x1': 0.171156, 'x2': 0.991659, 'x3': 0.145412, 'x4': 0.915102, 'x5': 0.340763, 'x6': 0.378882}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:16] ax.service.ax_client: Completed trial 6 with data: {'hartmann6': (-0.071137, 0.0), 'l2norm': (1.459764, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:16] ax.service.ax_client: Generated new trial 7 with parameters {'x1': 0.757071, 'x2': 0.279597, 'x3': 0.109823, 'x4': 0.594536, 'x5': 0.954943, 'x6': 0.932046}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:16] ax.service.ax_client: Completed trial 7 with data: {'hartmann6': (-0.000263, 0.0), 'l2norm': (1.67257, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:16] ax.service.ax_client: Generated new trial 8 with parameters {'x1': 0.545973, 'x2': 0.957812, 'x3': 0.717702, 'x4': 0.39488, 'x5': 0.141303, 'x6': 0.855471}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:16] ax.service.ax_client: Completed trial 8 with data: {'hartmann6': (-0.114704, 0.0), 'l2norm': (1.624289, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:16] ax.service.ax_client: Generated new trial 9 with parameters {'x1': 0.577164, 'x2': 0.873977, 'x3': 0.840855, 'x4': 0.604265, 'x5': 0.983467, 'x6': 0.361855}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:16] ax.service.ax_client: Completed trial 9 with data: {'hartmann6': (-0.409662, 0.0), 'l2norm': (1.80756, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:16] ax.service.ax_client: Generated new trial 10 with parameters {'x1': 0.719934, 'x2': 0.158722, 'x3': 0.064065, 'x4': 0.874327, 'x5': 0.640713, 'x6': 0.47211}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:16] ax.service.ax_client: Completed trial 10 with data: {'hartmann6': (-0.00479, 0.0), 'l2norm': (1.394794, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:16] ax.service.ax_client: Generated new trial 11 with parameters {'x1': 0.619846, 'x2': 0.797084, 'x3': 0.85879, 'x4': 0.732571, 'x5': 0.379869, 'x6': 0.203436}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:16] ax.service.ax_client: Completed trial 11 with data: {'hartmann6': (-0.730603, 0.0), 'l2norm': (1.574618, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:24] ax.service.ax_client: Generated new trial 12 with parameters {'x1': 0.0, 'x2': 0.359867, 'x3': 0.134847, 'x4': 0.485981, 'x5': 0.208769, 'x6': 0.918502}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:24] ax.service.ax_client: Completed trial 12 with data: {'hartmann6': (-0.694722, 0.0), 'l2norm': (1.127429, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:40] ax.service.ax_client: Generated new trial 13 with parameters {'x1': 0.0, 'x2': 0.250039, 'x3': 0.137932, 'x4': 0.43853, 'x5': 0.194655, 'x6': 0.923408}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:40] ax.service.ax_client: Completed trial 13 with data: {'hartmann6': (-0.866244, 0.0), 'l2norm': (1.079086, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:46] ax.service.ax_client: Generated new trial 14 with parameters {'x1': 0.0, 'x2': 0.144176, 'x3': 0.152986, 'x4': 0.352474, 'x5': 0.158112, 'x6': 0.934129}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:46] ax.service.ax_client: Completed trial 14 with data: {'hartmann6': (-0.893259, 0.0), 'l2norm': (1.032486, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:58] ax.service.ax_client: Generated new trial 15 with parameters {'x1': 0.0, 'x2': 0.08504, 'x3': 0.096707, 'x4': 0.466104, 'x5': 0.214999, 'x6': 0.929151}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:34:58] ax.service.ax_client: Completed trial 15 with data: {'hartmann6': (-0.819815, 0.0), 'l2norm': (1.069291, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:35:08] ax.service.ax_client: Generated new trial 16 with parameters {'x1': 0.0, 'x2': 0.170764, 'x3': 0.237467, 'x4': 0.371316, 'x5': 0.224173, 'x6': 0.867484}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:35:08] ax.service.ax_client: Completed trial 16 with data: {'hartmann6': (-1.522364, 0.0), 'l2norm': (1.01302, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:35:16] ax.service.ax_client: Generated new trial 17 with parameters {'x1': 0.0, 'x2': 0.112163, 'x3': 0.275695, 'x4': 0.34454, 'x5': 0.243084, 'x6': 0.840935}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:35:16] ax.service.ax_client: Completed trial 17 with data: {'hartmann6': (-1.829459, 0.0), 'l2norm': (0.98669, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:35:21] ax.service.ax_client: Generated new trial 18 with parameters {'x1': 0.0, 'x2': 0.058052, 'x3': 0.322384, 'x4': 0.320043, 'x5': 0.270554, 'x6': 0.806368}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:35:21] ax.service.ax_client: Completed trial 18 with data: {'hartmann6': (-2.139187, 0.0), 'l2norm': (0.966001, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:35:27] ax.service.ax_client: Generated new trial 19 with parameters {'x1': 0.0, 'x2': 0.019936, 'x3': 0.383543, 'x4': 0.299243, 'x5': 0.309485, 'x6': 0.760721}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:35:27] ax.service.ax_client: Completed trial 19 with data: {'hartmann6': (-2.409111, 0.0), 'l2norm': (0.954739, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:35:31] ax.service.ax_client: Generated new trial 20 with parameters {'x1': 0.0, 'x2': 0.031891, 'x3': 0.453241, 'x4': 0.286296, 'x5': 0.346609, 'x6': 0.712598}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:35:31] ax.service.ax_client: Completed trial 20 with data: {'hartmann6': (-2.585812, 0.0), 'l2norm': (0.957259, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:35:37] ax.service.ax_client: Generated new trial 21 with parameters {'x1': 0.0, 'x2': 0.064859, 'x3': 0.540874, 'x4': 0.30781, 'x5': 0.306598, 'x6': 0.652317}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:35:37] ax.service.ax_client: Completed trial 21 with data: {'hartmann6': (-2.703465, 0.0), 'l2norm': (0.954473, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:35:41] ax.service.ax_client: Generated new trial 22 with parameters {'x1': 0.0, 'x2': 0.03436, 'x3': 0.632869, 'x4': 0.34134, 'x5': 0.318397, 'x6': 0.725043}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:35:41] ax.service.ax_client: Completed trial 22 with data: {'hartmann6': (-2.315024, 0.0), 'l2norm': (1.070177, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:35:47] ax.service.ax_client: Generated new trial 23 with parameters {'x1': 0.0, 'x2': 0.082237, 'x3': 0.46578, 'x4': 0.283365, 'x5': 0.289837, 'x6': 0.586879}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:35:47] ax.service.ax_client: Completed trial 23 with data: {'hartmann6': (-2.667558, 0.0), 'l2norm': (0.855829, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:35:52] ax.service.ax_client: Generated new trial 24 with parameters {'x1': 0.0, 'x2': 0.124512, 'x3': 0.505916, 'x4': 0.257546, 'x5': 0.271823, 'x6': 0.651577}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:35:52] ax.service.ax_client: Completed trial 24 with data: {'hartmann6': (-2.752398, 0.0), 'l2norm': (0.914453, 0.0)}.\n" ] } ], "source": [ "for i in range(25):\n", " parameters, trial_index = ax_client.get_next_trial()\n", " # Local evaluation here can be replaced with deployment to external system.\n", " ax_client.complete_trial(trial_index=trial_index, raw_data=evaluate(parameters))" ] }, { "cell_type": "markdown", "id": "d82edcd3", "metadata": { "papermill": { "duration": 0.042964, "end_time": "2023-12-09T18:35:52.663049", "exception": false, "start_time": "2023-12-09T18:35:52.620085", "status": "completed" }, "tags": [] }, "source": [ "### How many trials can run in parallel?\n", "By default, Ax restricts number of trials that can run in parallel for some optimization stages, in order to improve the optimization performance and reduce the number of trials that the optimization will require. To check the maximum parallelism for each optimization stage:" ] }, { "cell_type": "code", "execution_count": 6, "id": "22c5ea71", "metadata": { "execution": { "iopub.execute_input": "2023-12-09T18:35:52.750818Z", "iopub.status.busy": "2023-12-09T18:35:52.750128Z", "iopub.status.idle": "2023-12-09T18:35:52.757245Z", "shell.execute_reply": "2023-12-09T18:35:52.756698Z" }, "papermill": { "duration": 0.052456, "end_time": "2023-12-09T18:35:52.758644", "exception": false, "start_time": "2023-12-09T18:35:52.706188", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "[(12, 12), (-1, 3)]" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism()" ] }, { "cell_type": "markdown", "id": "276be636", "metadata": { "papermill": { "duration": 0.043158, "end_time": "2023-12-09T18:35:52.845619", "exception": false, "start_time": "2023-12-09T18:35:52.802461", "status": "completed" }, "tags": [] }, "source": [ "The output of this function is a list of tuples of form (number of trials, max parallelism), so the example above means \"the max parallelism is 12 for the first 12 trials and 3 for all subsequent trials.\" This is because the first 12 trials are produced quasi-randomly and can all be evaluated at once, and subsequent trials are produced via Bayesian optimization, which converges on optimal point in fewer trials when parallelism is limited. `MaxParallelismReachedException` indicates that the parallelism limit has been reached –– refer to the 'Service API Exceptions Meaning and Handling' section at the end of the tutorial for handling." ] }, { "cell_type": "markdown", "id": "1bbd966b", "metadata": { "papermill": { "duration": 0.043419, "end_time": "2023-12-09T18:35:52.932339", "exception": false, "start_time": "2023-12-09T18:35:52.888920", "status": "completed" }, "tags": [] }, "source": [ "### How to view all existing trials during optimization?" ] }, { "cell_type": "code", "execution_count": 7, "id": "b7cb9ef1", "metadata": { "execution": { "iopub.execute_input": "2023-12-09T18:35:53.021132Z", "iopub.status.busy": "2023-12-09T18:35:53.020656Z", "iopub.status.idle": "2023-12-09T18:35:53.046449Z", "shell.execute_reply": "2023-12-09T18:35:53.045792Z" }, "papermill": { "duration": 0.071802, "end_time": "2023-12-09T18:35:53.047767", "exception": false, "start_time": "2023-12-09T18:35:52.975965", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:35:53] ax.modelbridge.generation_strategy: Note that parameter values in dataframe are rounded to 2 decimal points; the values in the dataframe are thus not the exact ones suggested by Ax in trials.\n" ] }, { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
Generation StepGeneration ModelTrial IndexTrial StatusArm Parameterizations
0GenerationStep_0Sobol0COMPLETED{'0_0': {'x1': 0.99, 'x2': 0.7, 'x3': 0.05, 'x...
1GenerationStep_0Sobol1COMPLETED{'1_0': {'x1': 0.84, 'x2': 0.65, 'x3': 0.75, '...
2GenerationStep_0Sobol2COMPLETED{'2_0': {'x1': 0.89, 'x2': 0.4, 'x3': 0.58, 'x...
3GenerationStep_0Sobol3COMPLETED{'3_0': {'x1': 0.11, 'x2': 0.64, 'x3': 0.14, '...
4GenerationStep_0Sobol4COMPLETED{'4_0': {'x1': 0.46, 'x2': 0.89, 'x3': 0.19, '...
5GenerationStep_0Sobol5COMPLETED{'5_0': {'x1': 0.75, 'x2': 0.03, 'x3': 0.72, '...
6GenerationStep_0Sobol6COMPLETED{'6_0': {'x1': 0.17, 'x2': 0.99, 'x3': 0.15, '...
7GenerationStep_0Sobol7COMPLETED{'7_0': {'x1': 0.76, 'x2': 0.28, 'x3': 0.11, '...
8GenerationStep_0Sobol8COMPLETED{'8_0': {'x1': 0.55, 'x2': 0.96, 'x3': 0.72, '...
9GenerationStep_0Sobol9COMPLETED{'9_0': {'x1': 0.58, 'x2': 0.87, 'x3': 0.84, '...
10GenerationStep_0Sobol10COMPLETED{'10_0': {'x1': 0.72, 'x2': 0.16, 'x3': 0.06, ...
11GenerationStep_0Sobol11COMPLETED{'11_0': {'x1': 0.62, 'x2': 0.8, 'x3': 0.86, '...
12GenerationStep_1BoTorch12COMPLETED{'12_0': {'x1': 0.0, 'x2': 0.36, 'x3': 0.13, '...
13GenerationStep_1BoTorch13COMPLETED{'13_0': {'x1': 0.0, 'x2': 0.25, 'x3': 0.14, '...
14GenerationStep_1BoTorch14COMPLETED{'14_0': {'x1': 0.0, 'x2': 0.14, 'x3': 0.15, '...
15GenerationStep_1BoTorch15COMPLETED{'15_0': {'x1': 0.0, 'x2': 0.09, 'x3': 0.1, 'x...
16GenerationStep_1BoTorch16COMPLETED{'16_0': {'x1': 0.0, 'x2': 0.17, 'x3': 0.24, '...
17GenerationStep_1BoTorch17COMPLETED{'17_0': {'x1': 0.0, 'x2': 0.11, 'x3': 0.28, '...
18GenerationStep_1BoTorch18COMPLETED{'18_0': {'x1': 0.0, 'x2': 0.06, 'x3': 0.32, '...
19GenerationStep_1BoTorch19COMPLETED{'19_0': {'x1': 0.0, 'x2': 0.02, 'x3': 0.38, '...
20GenerationStep_1BoTorch20COMPLETED{'20_0': {'x1': 0.0, 'x2': 0.03, 'x3': 0.45, '...
21GenerationStep_1BoTorch21COMPLETED{'21_0': {'x1': 0.0, 'x2': 0.06, 'x3': 0.54, '...
22GenerationStep_1BoTorch22COMPLETED{'22_0': {'x1': 0.0, 'x2': 0.03, 'x3': 0.63, '...
23GenerationStep_1BoTorch23COMPLETED{'23_0': {'x1': 0.0, 'x2': 0.08, 'x3': 0.47, '...
24GenerationStep_1BoTorch24COMPLETED{'24_0': {'x1': 0.0, 'x2': 0.12, 'x3': 0.51, '...
\n", "
" ], "text/plain": [ " Generation Step Generation Model Trial Index Trial Status \\\n", "0 GenerationStep_0 Sobol 0 COMPLETED \n", "1 GenerationStep_0 Sobol 1 COMPLETED \n", "2 GenerationStep_0 Sobol 2 COMPLETED \n", "3 GenerationStep_0 Sobol 3 COMPLETED \n", "4 GenerationStep_0 Sobol 4 COMPLETED \n", "5 GenerationStep_0 Sobol 5 COMPLETED \n", "6 GenerationStep_0 Sobol 6 COMPLETED \n", "7 GenerationStep_0 Sobol 7 COMPLETED \n", "8 GenerationStep_0 Sobol 8 COMPLETED \n", "9 GenerationStep_0 Sobol 9 COMPLETED \n", "10 GenerationStep_0 Sobol 10 COMPLETED \n", "11 GenerationStep_0 Sobol 11 COMPLETED \n", "12 GenerationStep_1 BoTorch 12 COMPLETED \n", "13 GenerationStep_1 BoTorch 13 COMPLETED \n", "14 GenerationStep_1 BoTorch 14 COMPLETED \n", "15 GenerationStep_1 BoTorch 15 COMPLETED \n", "16 GenerationStep_1 BoTorch 16 COMPLETED \n", "17 GenerationStep_1 BoTorch 17 COMPLETED \n", "18 GenerationStep_1 BoTorch 18 COMPLETED \n", "19 GenerationStep_1 BoTorch 19 COMPLETED \n", "20 GenerationStep_1 BoTorch 20 COMPLETED \n", "21 GenerationStep_1 BoTorch 21 COMPLETED \n", "22 GenerationStep_1 BoTorch 22 COMPLETED \n", "23 GenerationStep_1 BoTorch 23 COMPLETED \n", "24 GenerationStep_1 BoTorch 24 COMPLETED \n", "\n", " Arm Parameterizations \n", "0 {'0_0': {'x1': 0.99, 'x2': 0.7, 'x3': 0.05, 'x... \n", "1 {'1_0': {'x1': 0.84, 'x2': 0.65, 'x3': 0.75, '... \n", "2 {'2_0': {'x1': 0.89, 'x2': 0.4, 'x3': 0.58, 'x... \n", "3 {'3_0': {'x1': 0.11, 'x2': 0.64, 'x3': 0.14, '... \n", "4 {'4_0': {'x1': 0.46, 'x2': 0.89, 'x3': 0.19, '... \n", "5 {'5_0': {'x1': 0.75, 'x2': 0.03, 'x3': 0.72, '... \n", "6 {'6_0': {'x1': 0.17, 'x2': 0.99, 'x3': 0.15, '... \n", "7 {'7_0': {'x1': 0.76, 'x2': 0.28, 'x3': 0.11, '... \n", "8 {'8_0': {'x1': 0.55, 'x2': 0.96, 'x3': 0.72, '... \n", "9 {'9_0': {'x1': 0.58, 'x2': 0.87, 'x3': 0.84, '... \n", "10 {'10_0': {'x1': 0.72, 'x2': 0.16, 'x3': 0.06, ... \n", "11 {'11_0': {'x1': 0.62, 'x2': 0.8, 'x3': 0.86, '... \n", "12 {'12_0': {'x1': 0.0, 'x2': 0.36, 'x3': 0.13, '... \n", "13 {'13_0': {'x1': 0.0, 'x2': 0.25, 'x3': 0.14, '... \n", "14 {'14_0': {'x1': 0.0, 'x2': 0.14, 'x3': 0.15, '... \n", "15 {'15_0': {'x1': 0.0, 'x2': 0.09, 'x3': 0.1, 'x... \n", "16 {'16_0': {'x1': 0.0, 'x2': 0.17, 'x3': 0.24, '... \n", "17 {'17_0': {'x1': 0.0, 'x2': 0.11, 'x3': 0.28, '... \n", "18 {'18_0': {'x1': 0.0, 'x2': 0.06, 'x3': 0.32, '... \n", "19 {'19_0': {'x1': 0.0, 'x2': 0.02, 'x3': 0.38, '... \n", "20 {'20_0': {'x1': 0.0, 'x2': 0.03, 'x3': 0.45, '... \n", "21 {'21_0': {'x1': 0.0, 'x2': 0.06, 'x3': 0.54, '... \n", "22 {'22_0': {'x1': 0.0, 'x2': 0.03, 'x3': 0.63, '... \n", "23 {'23_0': {'x1': 0.0, 'x2': 0.08, 'x3': 0.47, '... \n", "24 {'24_0': {'x1': 0.0, 'x2': 0.12, 'x3': 0.51, '... " ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.generation_strategy.trials_as_df" ] }, { "cell_type": "markdown", "id": "aab00fe5", "metadata": { "papermill": { "duration": 0.043167, "end_time": "2023-12-09T18:35:53.134888", "exception": false, "start_time": "2023-12-09T18:35:53.091721", "status": "completed" }, "tags": [] }, "source": [ "## 5. Retrieve best parameters\n", "\n", "Once it's complete, we can access the best parameters found, as well as the corresponding metric values." ] }, { "cell_type": "code", "execution_count": 8, "id": "5e729c2f", "metadata": { "execution": { "iopub.execute_input": "2023-12-09T18:35:53.223601Z", "iopub.status.busy": "2023-12-09T18:35:53.223110Z", "iopub.status.idle": "2023-12-09T18:35:53.509553Z", "shell.execute_reply": "2023-12-09T18:35:53.508764Z" }, "papermill": { "duration": 0.332441, "end_time": "2023-12-09T18:35:53.511241", "exception": false, "start_time": "2023-12-09T18:35:53.178800", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "{'x1': 0.0,\n", " 'x2': 0.12451185526129524,\n", " 'x3': 0.5059155772348647,\n", " 'x4': 0.25754633240884656,\n", " 'x5': 0.2718230793818827,\n", " 'x6': 0.6515768865975455}" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "best_parameters, values = ax_client.get_best_parameters()\n", "best_parameters" ] }, { "cell_type": "code", "execution_count": 9, "id": "82e17f6b", "metadata": { "execution": { "iopub.execute_input": "2023-12-09T18:35:53.636831Z", "iopub.status.busy": "2023-12-09T18:35:53.635870Z", "iopub.status.idle": "2023-12-09T18:35:53.641189Z", "shell.execute_reply": "2023-12-09T18:35:53.640542Z" }, "papermill": { "duration": 0.066536, "end_time": "2023-12-09T18:35:53.642653", "exception": false, "start_time": "2023-12-09T18:35:53.576117", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "{'l2norm': 0.9144523704163005, 'hartmann6': -2.752392501395622}" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "means, covariances = values\n", "means" ] }, { "cell_type": "markdown", "id": "f5b9e1d9", "metadata": { "papermill": { "duration": 0.044285, "end_time": "2023-12-09T18:35:53.731126", "exception": false, "start_time": "2023-12-09T18:35:53.686841", "status": "completed" }, "tags": [] }, "source": [ "For comparison, Hartmann6 minimum:" ] }, { "cell_type": "code", "execution_count": 10, "id": "dc6be5cf", "metadata": { "execution": { "iopub.execute_input": "2023-12-09T18:35:53.821061Z", "iopub.status.busy": "2023-12-09T18:35:53.820428Z", "iopub.status.idle": "2023-12-09T18:35:53.825114Z", "shell.execute_reply": "2023-12-09T18:35:53.824455Z" }, "papermill": { "duration": 0.051076, "end_time": "2023-12-09T18:35:53.826466", "exception": false, "start_time": "2023-12-09T18:35:53.775390", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "-3.32237" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "hartmann6.fmin" ] }, { "cell_type": "markdown", "id": "793604cf", "metadata": { "papermill": { "duration": 0.044074, "end_time": "2023-12-09T18:35:53.914495", "exception": false, "start_time": "2023-12-09T18:35:53.870421", "status": "completed" }, "tags": [] }, "source": [ "## 6. Plot the response surface and optimization trace\n", "Here we arbitrarily select \"x1\" and \"x2\" as the two parameters to plot for both metrics, \"hartmann6\" and \"l2norm\"." ] }, { "cell_type": "code", "execution_count": 11, "id": "5586be78", "metadata": { "execution": { "iopub.execute_input": "2023-12-09T18:35:54.003603Z", "iopub.status.busy": "2023-12-09T18:35:54.002914Z", "iopub.status.idle": "2023-12-09T18:35:54.772672Z", "shell.execute_reply": "2023-12-09T18:35:54.771965Z" }, "papermill": { "duration": 0.819434, "end_time": "2023-12-09T18:35:54.777459", "exception": false, "start_time": "2023-12-09T18:35:53.958025", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:35:54] ax.service.ax_client: Retrieving contour plot with parameter 'x1' on X-axis and 'x2' on Y-axis, for metric 'hartmann6'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ -2.125392625347335, -2.116678036095892, -2.101200993284344, -2.079138703898105, -2.0507745052175212, -2.016485427299179, -1.9767265072996745, -1.9320132498362401, -1.8829035937657883, -1.8299805468831516, -1.7738363570793245, -1.7150587721927257, -1.6542196538125866, -1.5918659814768013, -1.5285131212934586, -1.4646401318047704, -1.4006868282065397, -1.3370523105985332, -1.2740946707768726, -1.2121316155764277, -1.151441775858288, -1.0922665040652155, -1.0348119967334508, -0.9792516096236106, -0.9257282612672257, -0.8743568453415052, -0.8252265933581862, -0.7784033468543827, -0.7339317128735834, -0.6918370883243734, -0.6521275481028643, -0.6147955989410908, -0.5798198060527537, -0.5471663030234372, -0.5167901972548326, -0.48863688383674125, -0.4626432802045414, -0.43873899256844706, -0.4168474231075684, -0.3968868245441982, -0.3787713061856077, -0.36241179306177496, -0.34771693759025624, -0.33459398141765195, -0.3229495638265598, -0.3126904724095041, -0.3037243315959106, -0.29596022502464037, -0.289309248594131, -0.28368499217998966 ], [ -2.1344279233521415, -2.125569221948348, -2.1098676680753967, -2.087504450595082, -2.0587691139459836, -2.0240466624756395, -1.983801335183565, -1.9385585152188238, -1.8888861917699074, -1.8353771731540145, -1.7786329365675777, -1.7192496671926727, -1.6578067415198292, -1.5948576753653234, -1.5309233931017499, -1.466487574422918, -1.4019937856024427, -1.3378440895817336, -1.2743988408188738, -1.211977396764194, -1.1508595109264195, -1.091287207899332, -1.0334669753721104, -0.9775721402806371, -0.92374532498813, -0.8721009043940618, -0.8227274061870006, -0.7756898142923572, -0.7310317502212699, -0.6887775188273141, -0.6489340142395881, -0.6114924887548943, -0.5764301925008098, -0.5437118949637589, -0.5132913012353285, -0.4851123762833559, -0.45911058992226683, -0.4352140936678399, -0.4133448385525802, -0.39341964049138456, -0.37535119716287424, -0.35904905783456265, -0.34442054530735333, -0.3313716273439332, -0.31980773368344984, -0.30963451408252085, -0.30075853275543574, -0.2930878950585598, -0.2865328031799246, -0.2810060388319766 ], [ -2.1399054695214876, -2.1309123427917345, -2.115015490335407, -2.0923992891604084, -2.063358227895255, -2.02828363836856, -1.9876470343102426, -1.9419815795232314, -1.8918631493220839, -1.8378922130357538, -1.780677435161437, -1.720821546834122, -1.658909733081146, -1.5955005429050848, -1.5311191643970337, -1.4662528079494115, -1.401347893308634, -1.336808725920444, -1.2729973618608295, -1.2102343885375764, -1.1488003830452582, -1.088937846707965, -1.0308534499255475, -0.9747204542380072, -0.9206812077075168, -0.8688496350213492, -0.8193136652083396, -0.7721375577840374, -0.7273641028208482, -0.6850166822248773, -0.6451011887198461, -0.6076078059905492, -0.5725126583922804, -0.5397793418301899, -0.5093603490793621, -0.48119840317150886, -0.4552277117398468, -0.43137515362076995, -0.4095614067999648, -0.38970202420890665, -0.3717084611694188, -0.3554890556798074, -0.34094996043789016, -0.32799602366467484, -0.31653161453591794, -0.3064613883974753, -0.29769098692588025, -0.29012766893721553, -0.2836808685417145, -0.2782626786591176 ], [ -2.141714042910155, -2.132596768706464, -2.1165355592344435, -2.0937171030280632, -2.064439442897497, -2.029098434102859, -1.9881707657137415, -1.9421951108774935, -1.8917529032514975, -1.8374499874536716, -1.7799000486011114, -1.7197103706782473, -1.657470161571653, -1.5937414416232292, -1.5290523273641061, -1.4638924439200973, -1.3987101538320776, -1.333911281492105, -1.2698590278839, -1.2068747996295508, -1.1452397121960478, -1.0851965646573944, -1.0269521196480005, -0.9706795554064309, -0.9165209863039145, -0.8645899737487224, -0.8149739709527388, -0.7677366630127578, -0.7229201784410629, -0.6805471600373446, -0.6406226921656166, -0.6031360883928238, -0.5680625483319798, -0.5353646956561491, -0.5049940108372833, -0.476892172435476, -0.45099231994318667, -0.42722024950808424, -0.4054955515609745, -0.38573269671285915, -0.36784207350672415, -0.35173097895055483, -0.3373045604248649, -0.324466705714586, -0.3131208766714819, -0.3031708814184161, -0.2945215800494676, -0.2870795193933844, -0.28075349348267475, -0.27545502776902053 ], [ -2.1397729011985525, -2.130542206297874, -2.114348893281756, -2.0913810209013923, -2.061938697323931, -2.0264203754238137, -1.9853056874716812, -1.9391364116992817, -1.888497087554569, -1.83399653823471, -1.7762512086081703, -1.7158708659595017, -1.6534468961150315, -1.589543185395856, -1.5246894137320535, -1.4593764868399355, -1.3940537906413133, -1.3291279436339258, -1.2649627393999916, -1.2018800015981712, -1.1401611103161897, -1.0800489967245033, -1.0217504395908148, -0.9654385307392279, -0.9112552061997216, -0.8593137653841398, -0.809701322260955, -0.7624811504705881, -0.7176948989831615, -0.6753646666196894, -0.635494932881211, -0.5980743493688694, -0.5630774009056687, -0.5304659485327383, -0.5001906680760058, -0.4721923981837276, -0.44640341084461543, -0.42274861564489685, -0.4011467066560984, -0.3815112581183523, -0.3637517722499205, -0.34777467981254717, -0.3334842917048202, -0.320783698009552, -0.3095756096970932, -0.2997631376335206, -0.2912505036457389, -0.2839436790832355, -0.27775094747211637, -0.27258338933612847 ], [ -2.134034176448166, -2.124701076015875, -2.1084087525645034, -2.085345651339834, -2.0558123924314766, -2.020208021179378, -1.979012794751271, -1.9327691061910701, -1.8820620676757547, -1.8275010127926272, -1.7697028247254005, -1.7092776354376238, -1.6468171258616922, -1.5828854152542373, -1.5180123631973022, -1.4526890107403945, -1.3873648428626806, -1.3224465473176847, -1.2582979616978123, -1.1952409309568557, -1.1335568343504854, -1.0734885789571642, -1.015242893654956, -0.9589927910072353, -0.9048800941929226, -0.8530179517026387, -0.8034932841349569, -0.7563691253605205, -0.7116868349388292, -0.6694681703445496, -0.6297172166354061, -0.5924221779840262, -0.5575570402760286, -0.5250831169909276, -0.494950492057267, -0.46709937352815833, -0.4414613709818287, -0.4179607077482683, -0.3965153766456433, -0.377038245135601, -0.3594381129325406, -0.3436207223722867, -0.32948971947554495, -0.3169475618013039, -0.3058963679878478, -0.29623870337241376, -0.2878782962469528, -0.2807206800706855, -0.2746737581969573, -0.26964828923091166 ], [ -2.124484520335717, -2.1150601451656215, -2.0987022346733215, -2.0755986195078546, -2.046048851891414, -2.0104505322711974, -1.9692821895492343, -1.9230843065504397, -1.8724400025177794, -1.817956624152605, -1.7602491467088184, -1.699925927982247, -1.6375770455050254, -1.5737652070388728, -1.509019060546139, -1.4438286329730485, -1.378642582642125, -1.3138669425549274, -1.2498650482751132, -1.1869583740929097, -1.1254280375844086, -1.0655167706325521, -1.007431191492043, -0.9513442459009076, -0.8973977147969326, -0.8457047116782989, -0.7963521141727459, -0.7494028922382399, -0.7048983099710391, -0.6628599896135801, -0.6232918353822735, -0.5861818214838228, -0.5515036534321776, -0.5192183147591083, -0.48927551265480546, -0.46161503619861544, -0.4361680398668356, -0.41285826316904517, -0.3916031948151716, -0.37231518701196575, -0.35490252258974486, -0.3392704349165805, -0.325322078185883, -0.31295944383818963, -0.302084217713554, -0.29259857207451745, -0.28440588687174695, -0.2774113954632137, -0.27152275131503023, -0.26665051384891403 ], [ -2.1111459102817247, -2.101641329098138, -2.085251059899569, -2.0621613264535634, -2.0326690468721833, -1.9971683561762372, -1.9561337202329918, -1.9101012049280606, -1.8596493878069378, -1.8053811460455176, -1.747907212736651, -1.6878320420933495, -1.6257422168906916, -1.562197394253576, -1.4977236231156428, -1.4328087697043281, -1.3678997420540568, -1.3034011959697973, -1.239675420136236, -1.1770431271236443, -1.1157849126455044, -1.0561431827366434, -0.9983243845442302, -0.942501409472919, -0.8888160667033241, -0.8373815503771276, -0.7882848451128248, -0.7415890322596304, -0.6973354737635808, -0.6555458620720909, -0.6162241334828616, -0.5793582490566034, -0.5449218519307956, -0.5128758128339646, -0.48316967702906066, -0.45574302602622274, -0.4305267664208893, -0.4074443563663045, -0.38641297772894745, -0.3673446591618068, -0.3501473524263967, -0.3347259615513004, -0.3209833220546713, -0.3088211256571003, -0.2981407847858242, -0.28884423076875954, -0.2808346399154955, -0.2740170825965159, -0.26829909182752054, -0.2635911495779012 ], [ -2.094075576212226, -2.0845016207095477, -2.068111506962211, -2.0450888939350933, -2.0157265519346264, -1.98041319485755, -1.9396169614360774, -1.8938670644748092, -1.8437350569060476, -1.7898169218120914, -1.7327168646741873, -1.673033345915762, -1.6113475923999387, -1.548214593718445, -1.4841564279053125, -1.419657663938254, -1.3551625417101283, -1.2910736198435941, -1.22775159525034, -1.165516025832968, -1.104646722035467, -1.0453856092347686, -0.9879388982023645, -0.9324794333255371, -0.879149117123778, -0.8280613345574196, -0.7793033217725229, -0.7329384415111758, -0.689008341772291, -0.6475349857846446, -0.6085225502841227, -0.5719591957706591, -0.5378187171227129, -0.5060620859046524, -0.47663889713431584, -0.44948873339694173, -0.42454245821686976, -0.4017234487614614, -0.3809487755010216, -0.3621303336447982, -0.34517592828092836, -0.3299903124209136, -0.31647617481201273, -0.304535072612906, -0.294068302947156, -0.284977707003259, -0.277166400715522, -0.2705394270479735, -0.26500432637461346, -0.2604716232334984 ], [ -2.073365058687944, -2.0637321586521993, -2.0473735087240565, -2.0244693028304224, -1.9953067380551643, -1.9602672605581755, -1.9198105370502472, -1.8744566106654055, -1.8247676389783951, -1.7713303860339407, -1.7147403286128036, -1.655587911521744, -1.5944471976453407, -1.531866931485397, -1.468363875843468, -1.404418183688496, -1.3404705188516797, -1.2769206265985744, -1.2141270663259704, -1.152407844024801, -1.0920417146953514, -1.0332699597829247, -0.9762984788588427, -0.92130006642548, -0.8684167729805574, -0.817762274015178, -0.7694241914695681, -0.7234663295502616, -0.679930801029919, -0.6388400315380551, -0.600198638227404, -0.5639951858572094, -0.5302038280301782, -0.4987858442855234, -0.46969108520139125, -0.4428593378052037, -0.4182216226458717, -0.39570143207669783, -0.3752159168785555, -0.3566770255798827, -0.3399925979681303, -0.3250674115916704, -0.31180417774956803, -0.30010448174025306, -0.2898696611092516, -0.2810016153490976, -0.27340354093622865, -0.26698058664886115, -0.2616404256527294, -0.25729374269326066 ], [ -2.049138456630884, -2.039456491527465, -2.023158962410391, -2.000421775422355, -1.9715252478445735, -1.9368418588149465, -1.8968208198589251, -1.8519708509344448, -1.8028424975398052, -1.750011117558131, -1.6940613756399148, -1.635573775341959, -1.5751134828541633, -1.5132214763792746, -1.4504078989711704, -1.3871473947972048, -1.3238761584262604, -1.2609904114354349, -1.1988460289948781, -1.1377590618920215, -1.0780069298062582, -1.0198300947611714, -0.9634340564732436, -0.9089915419452, -0.8566447891595103, -0.8065078487301606, -0.7586688478448135, -0.7131921779517929, -0.6701205816929072, -0.6294771258626632, -0.5912670559891338, -0.5554795347615105, -0.5220892712239563, -0.49105805064031965, -0.46233617641907465, -0.4358638356776534, -0.41157239913148347, -0.38938566424153076, -0.3692210481884941, -0.35099073452043095, -0.3346027745081044, -0.31996214159460445, -0.30697173507216513, -0.29553332744315297, -0.28554844894604314, -0.27691920250000157, -0.26954900281826655, -0.2633432345672051, -0.2582098260577914, -0.25405973687031613 ], [ -2.021549961834288, -2.0118281338450448, -1.9956193460789629, -1.9730944870867608, -1.944525830718258, -1.9102753678125017, -1.8707800680654527, -1.8265353742845107, -1.77807819308774, -1.7259704604587116, -1.6707840931450666, -1.6130878497139243, -1.5534363634147663, -1.4923613978987171, -1.430365224188405, -1.3679159195080273, -1.3054443361774126, -1.2433424704536165, -1.1819629663425575, -1.1216195091969783, -1.0625878916825673, -1.0051075657105382, -0.9493835250882269, -0.8955883930309199, -0.8438646152749207, -0.7943266828807697, -0.7470633288301197, -0.7021396593275973, -0.6595991945572464, -0.6194658047915823, -0.5817455364925754, -0.5464283296428752, -0.5134896322424628, -0.4828919209185891, -0.4545861381290379, -0.4285130566898846, -0.40460458153588297, -0.38278499694527823, -0.36297216517081954, -0.3450786797706983, -0.3290129741893716, -0.3146803835548291, -0.3019841554658791, -0.2908264039258982, -0.2811089996623647, -0.27273438990474064, -0.265606341252171, -0.2596306004520502, -0.2547154695816217, -0.2507722940950001 ], [ -1.9907808048314881, -1.9810275367110803, -1.9649327596426356, -1.9426617184524466, -1.9144776399600882, -1.8807307057537832, -1.8418440796979212, -1.7982982013138402, -1.7506145303108245, -1.6993397643568942, -1.6450313100005143, -1.5882445218347065, -1.5295219798149415, -1.4693848735626243, -1.4083264143192677, -1.3468070979283033, -1.2852515878656798, -1.2240469658646291, -1.1635420993139967, -1.104047891063742, -1.0458382021215933, -0.9891512663416413, -0.9341914454664794, -0.881131200833194, -0.830113183580779, -0.781252367771267, -0.7346381703043666, -0.6903365179359713, -0.6483918352972255, -0.6088289387998675, -0.5716548299640692, -0.5368603882651292, -0.5044219682939173, -0.47430290907193007, -0.4464549649522588, -0.4208196678657643, -0.3973296299382676, -0.37590979392452306, -0.356478636712509, -0.33894932859820737, -0.32323084837577554, -0.30922905178558646, -0.2968476887428102, -0.28598936321932833, -0.27655642879732867, -0.26845181280657615, -0.26157976257516746, -0.2558465085704129, -0.2511608409321697, -0.24743459792034672 ], [ -1.9570357517306418, -1.9472586112433645, -1.9313005237769203, -1.9093205740657244, -1.8815721083970611, -1.8483923923345982, -1.8101894597225818, -1.7674272682103664, -1.7206102625741226, -1.6702683066958566, -1.6169427290528064, -1.5611739854151048, -1.503491215152697, -1.4444037777371201, -1.384394713275526, -1.3239159746983724, -1.2633852231713514, -1.2031839536803424, -1.1436567157176787, -1.0851112068774775, -1.0278190388395645, -0.9720170011824558, -0.9179086756058128, -0.8656662794571504, -0.8154326417601376, -0.7673232366222662, -0.721428217728406, -0.6778144136119868, -0.6365272566809055, -0.5975926297703873, -0.5610186225320275, -0.5267971964766438, -0.4949057621836901, -0.46530867527146624, -0.43795865937920075, -0.412798164830387, -0.38976067102018075, -0.3687719391062322, -0.3497512195096587, -0.33261241629534066, -0.31726520795406965, -0.30361612170395846, -0.2915695563948121, -0.2810287476243508, -0.27189666788694633, -0.26407685452868646, -0.25747415895498293, -0.25199541183469865, -0.24755000081708278, -0.24405035933898644 ], [ -1.9205392953851592, -1.9107449466429363, -1.894943474446604, -1.8732873986669698, -1.8460195252160334, -1.8134633169002825, -1.7760106017011852, -1.7341076355550746, -1.6882405337296076, -1.6389209667640845, -1.586672827228648, -1.532020356740956, -1.4754780142692554, -1.4175421892698514, -1.3586847268062852, -1.2993481373282636, -1.2399423064402613, -1.1808424923801237, -1.1223883932325516, -1.064884075076374, -1.0085985705697806, -0.9537669805786743, -0.9005919362770145, -0.8492453036544545, -0.7998700352987981, -0.7525820949882603, -0.7074723987248424, -0.6646087313079053, -0.624037610476583, -0.5857860812106439, -0.5498634311746005, -0.5162628247282695, -0.48496285760912955, -0.4559290375071572, -0.42911519748101423, -0.4044648496841545, -0.38191248636541797, -0.36138483378116515, -0.342802062723505, -0.32607895706921997, -0.3111260393349815, -0.29785064993370236, -0.2861579748916503, -0.27595201539401804, -0.2671364918076108, -0.2596156748404581, -0.25329513722027897, -0.2480824206148079, -0.24388761432769002, -0.2406238443980805 ], [ -1.8815316790336438, -1.8717258598799573, -1.8560980865683385, -1.8347940190952572, -1.8080454346982813, -1.7761613254834647, -1.7395164867211297, -1.6985385147397958, -1.6536941400778131, -1.6054757245875813, -1.5543885871914194, -1.5009396305833316, -1.445627552234961, -1.3889347587695984, -1.3313209735885823, -1.2732184356429541, -1.2150285291109217, -1.1571196534344625, -1.0998261339052418, -1.043447978432999, -0.98825130096276, -0.9344692521025214, -0.8823033198745758, -0.8319248860523241, -0.7834769449733648, -0.7370759112604487, -0.692813460152486, -0.6507583590224735, -0.6109582611736402, -0.5734414432861696, -0.5382184761062032, -0.5052838243136369, -0.4746173761601532, -0.44618590661204616, -0.4199444795337972, -0.3958377950774531, -0.37380148807539226, -0.353763382059995, -0.3356447017616899, -0.3193612447947769, -0.3048245109687524, -0.2919427855027813, -0.28062217059659245, -0.27076755850980005, -0.26228353865409204, -0.25507523127013587, -0.24904904102700987, -0.24411332525839868, -0.24017897338959038, -0.23715989622804656 ], [ -1.8402648790054201, -1.830452402710392, -1.8150125499393859, -1.7940839307540388, -1.767886970162015, -1.7367157331577245, -1.7009273982543562, -1.6609302022728656, -1.6171706940892188, -1.570121057647601, -1.5202671251142876, -1.468097532583301, -1.4140943014545957, -1.358724978095119, -1.3024363432061397, -1.245649613548034, -1.1887570003503183, -1.132119456132995, -1.0760654290563683, -1.0208904457071843, -0.9668573545683353, -0.9141970794269917, -0.8631097517430799, -0.8137661114707856, -0.7663090856347543, -0.7208554722719183, -0.6774976737034595, -0.6363054373063273, -0.5973275739899058, -0.5605936345338856, -0.5261155319478317, -0.49388910423512694, -0.46389561655270406, -0.4361032049185417, -0.41046826549156423, -0.386936794192447, -0.36544568121427246, -0.3459239639673759, -0.32829404041011967, -0.31247284275296805, -0.29837296941771063, -0.2859037711205554, -0.274972385246514, -0.2654847114789821, -0.2573463210748611, -0.25046329229651165, -0.24474296531556872, -0.24009461130666665, -0.23643001230829008, -0.23366395056138156 ], [ -1.796998657771693, -1.7871834367042096, -1.7719429063437206, -1.7514085346194814, -1.7257892250449838, -1.69536385855914, -1.6604716438335463, -1.6215010062153548, -1.5788777670341216, -1.533053305273694, -1.4844932771430046, -1.4336673236245139, -1.3810400462125338, -1.3270633946530181, -1.2721704979308115, -1.216770884906199, -1.1612469831250491, -1.10595174991852, -1.0512072742762468, -0.9973041862903438, -0.9445017188741567, -0.8930282803630741, -0.8430824137234465, -0.7948340364008443, -0.7484258729324648, -0.7039750094329494, -0.6615745144130121, -0.6212950838496158, -0.5831866799187517, -0.5472801423674599, -0.5135887592471976, -0.4821097897967159, -0.45282593680108374, -0.4257067689172458, -0.4007100953945111, -0.3777832964794312, -0.35686461273163395, -0.337884395656312, -0.3207663206633241, -0.3054285615951027, -0.291784924144485, -0.27974593363313416, -0.2692198710548348, -0.26011375018928995, -0.2523342280944352, -0.24578844145694634, -0.24038476211552673, -0.23603346649210932, -0.23264731553422235, -0.23014204391021054 ], [ -1.7519967815291657, -1.7421818701097709, -1.7271493405889973, -1.7070235157189217, -1.6820017494258486, -1.6523476654256277, -1.6183823641625859, -1.580474240443018, -1.5390280807538907, -1.4944740651232795, -1.44725720297015, -1.397827608638458, -1.3466318912936663, -1.2941058116207123, -1.2406682542768723, -1.1867164847757417, -1.1326226026901993, -1.0787310673922097, -1.0253571542945743, -0.9727861946559268, -0.9212734566231723, -0.8710445360325572, -0.8222961399473021, -0.7751971619975865, -0.7298899648958175, -0.6864918010807329, -0.6450963167126591, -0.6057750968822992, -0.568579220778298, -0.5335408046822241, -0.5006745180985845, -0.46997906419923063, -0.4414386202017625, -0.4150242364496052, -0.3906951949557226, -0.3684003291489104, -0.3480793066619995, -0.3296638763760017, -0.31307907975133065, -0.29824442492377723, -0.28507502032364773, -0.2734826629038959, -0.26337687464320303, -0.25466588000285173, -0.24725751659633166, -0.24106007154997555, -0.2359830368922735, -0.23193777873797639, -0.22883811689985634, -0.2266008136941544 ], [ -1.7055234790122276, -1.6957111330723538, -1.6808927014724455, -1.661185438138269, -1.6367752455873084, -1.607910582698465, -1.5748944984995839, -1.5380753522319675, -1.4978368101680077, -1.4545876789933236, -1.4087520591178446, -1.3607601976448724, -1.3110403076863875, -1.2600115124268128, -1.2080779782063948, -1.1556242257236282, -1.1030115533746727, -1.0505754703875876, -0.998624016996429, -0.9474368411092495, -0.8972649024519905, -0.8483306830702109, -0.8008287949012709, -0.7549268889862883, -0.7107667853672184, -0.6684657568301415, -0.6281179127751995, -0.589795641246054, -0.5535510773606618, -0.5194175750079533, -0.48741116575708476, -0.45753199456194726, -0.42976572615333264, -0.4040849191215028, -0.38045036672921373, -0.35881240458439834, -0.33911218556862366, -0.32128292199789954, -0.3052510940361577, -0.29093762205907525, -0.27825899916473706, -0.2671283785475117, -0.2574566091891286, -0.24915321245188293, -0.2421272918182924, -0.23628836828558863, -0.23154713480013522, -0.22781612454392464, -0.22501028974001636, -0.2230474897613175 ], [ -1.6578402011700957, -1.6480319507998582, -1.633431312159555, -1.6141486157795693, -1.5903585213049323, -1.5622945609365584, -1.5302419626386314, -1.4945292375315709, -1.4555190483876472, -1.4135988568709674, -1.3691717874976053, -1.3226480610015396, -1.2744372536140434, -1.2249415439892597, -1.1745500248198177, -1.123634086538813, -1.0725438276937225, -1.0216054100984975, -0.9711192547924979, -0.9213589645403689, -0.8725708573171609, -0.8249740003410335, -0.7787606435038285, -0.7340969626994264, -0.6911240361783575, -0.6499589896664306, -0.6106962578996042, -0.573408921031399, -0.538150083842063, -0.504954273743511, -0.4738388402468823, -0.4448053439159143, -0.41784092697328745, -0.3929196607738358, -0.3700038674229502, -0.3490454140122775, -0.3299869783797772, -0.31276328509426865, -0.29730230964771276, -0.2835264477609887, -0.27135364544133145, -0.26069848415540964, -0.2514732143876579, -0.24358873010880067, -0.23695547641957526, -0.23148428294046586, -0.22708711640551937, -0.2236777473346393, -0.22117232749084237, -0.21948987692058863 ], [ -1.609202725159593, -1.5993994581778936, -1.5850181136648918, -1.566162302794174, -1.5429957449489244, -1.5157374090815696, -1.4846550831468537, -1.450057786780169, -1.4122874760310893, -1.371710479106861, -1.3287090570182134, -1.283673414199243, -1.2369944035683074, -1.1890570885927958, -1.1402352495832226, -1.0908868576071842, -1.0413504893624088, -0.9919426202953211, -0.9429557100169375, -0.8946569816885712, -0.8472877932558415, -0.8010635009581362, -0.7561737224130869, -0.7127829160785376, -0.671031204687998, -0.6310353813376505, -0.5928900475722518, -0.5566688426200475, -0.5224257316082217, -0.4901963280403045, -0.4599992320289692, -0.4318373708083275, -0.40569933199050323, -0.38156068298591483, -0.359385272079056, -0.33912650794039556, -0.3207286149557488, -0.3041278617659927, -0.28925375994200353, -0.27603022890089934, -0.2643767221491895, -0.2542093088830759, -0.24544170405957266, -0.23798623943782238, -0.23175476791217808, -0.22665949380336303, -0.2226137226653656, -0.21953252556216718, -0.2173333145677261, -0.21593632829811205 ], [ -1.5598586310178906, -1.5500606843155333, -1.5358981703154795, -1.5174682331738019, -1.4949240325680129, -1.4684704423798094, -1.4383583191158305, -1.404877692681706, -1.3683502659490998, -1.3291216073082286, -1.2875533878344414, -1.244015960438874, -1.1988815119381055, -1.1525179491445874, -1.1052836138429227, -1.0575228636501641, -1.0095625088660198, -0.9617090602933196, -0.9142467191169966, -0.8674360259021503, -0.82151307981996, -0.7766892394400826, -0.7331512210503003, -0.6910615179148121, -0.6505590728809412, -0.6117601463005355, -0.5747593306306773, -0.5396306718392251, -0.5064288655799474, -0.47519050288499576, -0.4459353458222667, -0.4186676182241438, -0.39337730029241835, -0.37004141871604146, -0.348625325997203, -0.32908396405258045, -0.31136310791923183, -0.2954005856270041, -0.2811274700886397, -0.26846923830964964, -0.25734689245912534, -0.24767803651775233, -0.23937790148962124, -0.23236031168618554, -0.22653858449661768, -0.22182635643992432, -0.2181383291835961, -0.2153909305816123, -0.21350288754132307, -0.2123957095382043 ], [ -1.510045165535495, -1.5002524217051116, -1.486306552431604, -1.4682985256047427, -1.4463713841437953, -1.4207164598152549, -1.3915682908961464, -1.3591985403516846, -1.3239092444362393, -1.28602572535994, -1.2458894796156086, -1.2038513119864824, -1.160264931527066, -1.1154811671310028, -1.069842902774915, -1.0236807806568917, -0.9773096770173573, -0.9310259216727486, -0.8851052082166161, -0.839801126604659, -0.7953442420950647, -0.7519416427063381, -0.7097768799224866, -0.6690102328983129, -0.6297792336872241, -0.5921993990674256, -0.5563651226613165, -0.5223506887322795, -0.4902113759984938, -0.45998462587149413, -0.43169125466636604, -0.40533669357209856, -0.3809122435868062, -0.3583963352995895, -0.337755785422848, -0.3189470434179883, -0.3019174224756336, -0.2866063095654253, -0.27294634932282136, -0.26086459627035796, -0.2502836293802567, -0.2411226224011438, -0.23329836283739092, -0.2267262121325685, -0.22132099959999396, -0.2169978430584294, -0.21367289001334566, -0.2112639745558248, -0.2096911868560386, -0.2088773540823129 ], [ -1.4599874953828729, -1.4501994822443853, -1.4364665991359178, -1.4188739575648048, -1.3975549743744833, -1.3726880579831184, -1.34449212437505, -1.313221189955195, -1.279158320434452, -1.2426092231994064, -1.203895757262816, -1.1633496042008475, -1.121306300990291, -1.0780997871423634, -1.0340575692158944, -0.9894965598319679, -0.9447196085463572, -0.9000127099179511, -0.8556428502859503, -0.8118564387445593, -0.768878258636048, -0.7269108723316631, -0.6861344128034479, -0.6467066992345749, -0.6087636195467137, -0.5724197293165705, -0.537769023401072, -0.5048858431919556, -0.4738258884591724, -0.44462730805425843, -0.4173118482782546, -0.3918860414994336, -0.36834242070066736, -0.34666074812609005, -0.32680924815700674, -0.3087458360378531, -0.2924193351381349, -0.2777706761102742, -0.2647340716225772, -0.25323816036292524, -0.24320711379779936, -0.23456169883683708, -0.22722028922193782, -0.2210998182691667, -0.21611666567036492, -0.2121874715092008, -0.20922987151662809, -0.20716314887931864, -0.20590879955909902, -0.20539100997113746 ], [ -1.409897340604981, -1.400113331452402, -1.3865885533623274, -1.3694026019447283, -1.3486797928647303, -1.3245862781503046, -1.2973261095633282, -1.2671364526453472, -1.234282185484164, -1.1990501278543495, -1.1617431400721676, -1.1226743094109648, -1.0821614092250522, -1.0405217765436836, -0.9980677122100006, -0.9551024674000804, -0.9119168443658898, -0.8687864092627823, -0.8259692917315619, -0.783704529493693, -0.7422109059922839, -0.7016862241227244, -0.662306958232594, -0.6242282287056444, -0.5875840475476106, -0.5524877885867998, -0.519032841502423, -0.4872934144028282, -0.4573254547749682, -0.42916766314711596, -0.40284257769441745, -0.3783577112954727, -0.35570672528320846, -0.3348706264031882, -0.31581897536589376, -0.2985110969042294, -0.2828972824497331, -0.2689199774312535, -0.256514945787946, -0.24561240459657052, -0.23613812178885818, -0.2280144698578026, -0.22116142833018193, -0.21549752774283448, -0.21094072802790131, -0.2074092246917958, -0.20482217702717298, -0.2031003538365046, -0.20216669372242535, -0.2019467788172954 ], [ -1.3599719703373672, -1.3501910829631951, -1.3368685519382282, -1.320078810368713, -1.2999376196331198, -1.2765995744871173, -1.2502546637675869, -1.2211240524666294, -1.1894552794529631, -1.1555170790103626, -1.1195940336356551, -1.0819812516892868, -1.0429792392117991, -1.0028891039259353, -0.9620081947427753, -0.9206262453001439, -0.8790220578661591, -0.8374607362123125, -0.7961914538328738, -0.7554457274515001, -0.7154361548208894, -0.6763555696981207, -0.6383765646608538, -0.6016513331390099, -0.5663117847380915, -0.5324698918054633, -0.5002182295827206, -0.4696306767132492, -0.4407632470213959, -0.4136550271823405, -0.38832919810912814, -0.3647941206223567, -0.343044468307805, -0.32306239248554625, -0.3048187059751749, -0.28827407388201387, -0.27338020095670434, -0.2600810061821758, -0.2483137760984948, -0.23801028897926413, -0.2290979023414409, -0.22150059645708953, -0.21513996662947665, -0.2099361571111924, -0.20580872980097287, -0.20267746136664255, -0.20046306327771146, -0.1990878204161729, -0.1984761454363021, -0.19855504778152322 ], [ -1.310393535138099, -1.3006148279274936, -1.287487946180273, -1.2710825199976479, -1.2515063145302074, -1.22890308424788, -1.2034495825795641, -1.1753518600615431, -1.1448410105239912, -1.1121685401650074, -1.0776015379509607, -1.0414178181769966, -1.0039011888723126, -0.9653369755178114, -0.9260079011549223, -0.8861903942867575, -0.8461513675180294, -0.8061454845528225, -0.7664129121725547, -0.7271775376783687, -0.6886456209611157, -0.6510048433988747, -0.6144237124564943, -0.5790512803375601, -0.5450171364780911, -0.5124316363189069, -0.48138633202937064, -0.45195457421957463, -0.4241922568710157, -0.39813868058241997, -0.37381751172583133, -0.35123781727524406, -0.3303951569811654, -0.3112727163015633, -0.2938424651231921, -0.2780663288443713, -0.26389735983066653, -0.25128089856082536, -0.24015571490314158, -0.2304551208620882, -0.22210804679918428, -0.21504007358700838, -0.20917441346917098, -0.20443283267327206, -0.2007365091762593, -0.19800681956398025, -0.1961660497424812, -0.1951380253856485, -0.19484865942620788, -0.19522641554784803 ], [ -1.2613287047328483, -1.2515512683539578, -1.2386129228392189, -1.2225788549890386, -1.2035493935551473, -1.181658175099191, -1.1570695563919862, -1.1299753785954014, -1.100591212649941, -1.0691522313467094, -1.0359088603805788, -1.001122358079426, -0.9650604623013298, -0.9279932248795917, -0.8901891312356459, -0.8519115778319085, -0.8134157553013928, -0.7749459622429207, -0.736733355113697, -0.698994124085629, -0.6619280733184159, -0.6257175765758975, -0.5905268749195622, -0.5565016816499089, -0.5237690599903126, -0.49243754053064503, -0.4625974475922785, -0.43432140601114355, -0.40766500208239087, -0.38266757443052657, -0.3593531123375412, -0.33773124062859183, -0.31779827166860364, -0.2995383064506636, -0.2829243682197794, -0.26791955359051434, -0.2544781876569605, -0.24254697109562928, -0.2320661086469752, -0.22297040955685044, -0.2151903515210748, -0.20865310040248308, -0.20328347852740392, -0.1990048748047849, -0.19574009035944817, -0.19341211394576652, -0.191944822202764, -0.19126360087804928, -0.19129588448632195, -0.1919716134269216 ], [ -1.2129285762195137, -1.2031516196625123, -1.1903943914392465, -1.1747179899488887, -1.156215861163701, -1.1350122408453065, -1.1112599261633633, -1.0851374583159077, -1.0568458197061412, -1.0266047654741326, -0.9946489183141924, -0.9612237568234168, -0.926581621302193, -0.8909778480079, -0.8546671250587627, -0.81790014255355, -0.7809205880831251, -0.7439625184593559, -0.7072481205196626, -0.6709858591008457, -0.6353689990284641, -0.6005744801331735, -0.5667621194756147, -0.5340741125516452, -0.5026348046101274, -0.4725507037236567, -0.443910708379603, -0.4167865237072136, -0.3912332417747202, -0.36729006256351004, -0.34498113325030333, -0.324316484374195, -0.3052930424358594, -0.2878956995701122, -0.27209842221216396, -0.2578653821527468, -0.245152095003074, -0.23390655277957006, -0.2240703389601021, -0.21557971585273794, -0.20836667537714915, -0.20235994535801982, -0.19748594419313115, -0.19366967736010288, -0.19083556977199234, -0.18890822860093948, -0.1878131319627553, -0.18747723985982312, -0.18782952503079686, -0.18880142281771162 ], [ -1.1653288157725106, -1.1555517457034419, -1.1429681019858724, -1.1276352405538619, -1.1096402653934283, -1.0890987144111686, -1.0661526496438565, -1.0409682135479805, -1.0137327328803902, -0.9846514676921898, -0.953944113646495, -0.921841170168767, -0.888580284541131, -0.8544026734855444, -0.819549710282616, -0.7842597487307781, -0.7487652370934088, -0.7132901572933528, -0.6780478083340807, -0.6432389391430859, -0.6090502251728092, -0.5756530751803013, -0.5432027493542237, -0.5118377668876462, -0.4816795796432667, -0.45283248816708677, -0.42538377649727765, -0.3994040426282074, -0.37494770190553595, -0.3520536409608497, -0.33074600006713706, -0.3110350621044131, -0.29291822679235824, -0.2763810495849275, -0.26139832569776733, -0.2479352011564756, -0.23594829445175114, -0.22538681425270013, -0.2161936605213728, -0.20830649814976598, -0.20165879379520546, -0.19618080786182146, -0.19180053456619384, -0.1884445837934171, -0.1860389990966007, -0.18451000683778418, -0.18378469222225435, -0.18379159892048347, -0.18446125013394965, -0.1857265903232057 ], [ -1.1186499964497347, -1.1088724890428285, -1.0964549564956447, -1.081451345886608, -1.0639429418450514, -1.0440372659807735, -1.0218664481249533, -0.9975851145909694, -0.9713678563375929, -0.943406355382594, -0.9139062594424991, -0.8830839012645164, -0.8511629598148127, -0.8183711555125553, -0.7849370618943641, -0.7510871028129814, -0.7170427891075123, -0.6830182331790493, -0.6492179653611589, -0.6158350633066242, -0.5830495953218279, -0.5510273707875272, -0.5199189853248704, -0.48985914481108617, -0.46096625023341364, -0.43334222419752044, -0.40707255924780605, -0.3822265676934976, -0.3588578121823952, -0.3370046957712367, -0.31669118976333743, -0.2979276772451317, -0.2807118902020759, -0.2650299184592476, -0.25085726954671117, -0.23815995993331773, -0.22689561982901085, -0.2170145957863201, -0.20846103746470768, -0.20117395698268936, -0.19508825112865802, -0.1901356782439445, -0.18624578280889925, -0.18334676169909625, -0.1813662668282463, -0.18023213957789097, -0.179873073150162, -0.18021919986082335, -0.18120260146218192, -0.18275774184493332 ], [ -1.0729980956044516, -1.0632201601977012, -1.0509614786057841, -1.0362729076990507, -1.0192304130515695, -0.9999341544671901, -0.9785071038197816, -0.9550932267894934, -0.9298552757685352, -0.9029722559066067, -0.8746366383404012, -0.8450514026745134, -0.8144269938556488, -0.7829782765210168, -0.7509215632215172, -0.7184717826826652, -0.6858398418318643, -0.6532302220894511, -0.620838837619192, -0.5888511717740113, -0.5574406983988371, -0.5267675871520312, -0.49697768647423335, -0.4682017739574895, -0.44055506122948507, -0.41413693863005707, -0.389030943538368, -0.3653049349328271, -0.3430114554871564, -0.322188261209821, -0.3028589974120379, -0.28503399880014335, -0.2687111909082207, -0.2538770700648453, -0.24050773970637707, -0.22856998210478907, -0.2180223463792481, -0.20881623584511377, -0.20089698011831447, -0.19420487972932832, -0.18867621313284344, -0.18424419780860524, -0.18083989859186467, -0.17839307747667432, -0.17683297998948722, -0.17608905395523677, -0.17609159719939482, -0.17677233155092953, -0.17806490149432486, -0.1799052969744559 ], [ -1.028465117375817, -1.01868715145952, -1.0065804073955937, -0.9921929535501995, -0.975595911304414, -0.9568827017935876, -0.9361678790211286, -0.9135855698125708, -0.8892875549195158, -0.863441039361, -0.8362261722258815, -0.8078333851727422, -0.778460623704641, -0.7483105455511248, -0.7175877564165489, -0.6864961457592799, -0.6552363752979764, -0.6240035618446198, -0.5929851849760381, -0.5623592398585868, -0.5322926467930177, -0.5029399219794685, -0.47444210856884617, -0.44692596301681264, -0.4205033887294105, -0.39527110659966425, -0.371310549946115, -0.34868796934328994, -0.32745473077583365, -0.30764778847741925, -0.2892903118640765, -0.2723924443348692, -0.2569521705995288, -0.24295626877435306, -0.23038132385811716, -0.219194780354252, -0.20935601363888467, -0.200817402000238, -0.19352538385939932, -0.1874214872842659, -0.1824433213182165, -0.17852552071630545, -0.1756006373471274, -0.1735999727916896, -0.1724543476310546, -0.17209480368356767, -0.17245323616215058, -0.17346295348708995, -0.17505916338544347, -0.17717938495966057 ], [ -0.9851298085000624, -0.9753526436984531, -0.9633913842252102, -0.9492915932969174, -0.9331199953419025, -0.914963861559763, -0.8949300300060675, -0.8731435717042855, -0.8497461264278204, -0.8248939445631852, -0.7987556833696917, -0.7715100155163775, -0.7433431138714038, -0.714446078573685, -0.6850123704841093, -0.655235309787794, -0.62530569075065, -0.5954095545161049, -0.5657261523963772, -0.5364261231995671, -0.5076699002895868, -0.4796063575545696, -0.45237169825282386, -0.42608858661202165, -0.400865518763438, -0.37679642675902614, -0.35396050675104673, -0.3324222597187205, -0.31223173034029517, -0.2934249267988379, -0.2760244016497857, -0.26003997160342984, -0.24546955242991875, -0.23230008437445915, -0.22050852358407902, -0.2100628760896538, -0.20092325273995237, -0.1930429259391827, -0.18636937183198032, -0.18084528443563874, -0.1764095508977287, -0.17299817938294304, -0.17054517297680816, -0.1689833444337796, -0.16824506766533442, -0.16826296267986518, -0.1689705113882788, -0.1703026024013783, -0.1721960037557394, -0.17458976345323107 ], [ -0.9430584389851274, -0.93328337782985, -0.9214617046112015, -0.9076367414956134, -0.8918712341963047, -0.8742468563262132, -0.8548633910444968, -0.8338375943646319, -0.8113017550788155, -0.7874019779665294, -0.7622962284114105, -0.7361521863209876, -0.7091449641698728, -0.6814547473981054, -0.653264415193417, -0.624757196282675, -0.5961144085311907, -0.5675133238439272, -0.5391251920078244, -0.5111134494779317, -0.48363213221690343, -0.45682450580602585, -0.43082192117229134, -0.40574290025183246, -0.3816924524600407, -0.35876161966128883, -0.3370272441705924, -0.3165519510217091, -0.297384332277594, -0.2795593176498643, -0.26309871235143933, -0.24801188020901577, -0.23429654789026522, -0.2219397048787929, -0.2109185736811492, -0.20120162567099098, -0.1927496198367924, -0.1855166442698708, -0.17945114321627365, -0.17449691561324276, -0.17059407396639847, -0.16767995499519328, -0.16568997557058396, -0.16455842907320817, -0.16421921847655296, -0.16460652332610948, -0.16565539848418165, -0.16730230317395034, -0.16948555958557965, -0.1721457411544215 ], [ -0.9023056227863261, -0.8925344662095401, -0.8808471106764312, -0.867284881668297, -0.8519069347186065, -0.8347898607534162, -0.8160270066216151, -0.7957275095926707, -0.7740150537784807, -0.7510263670850801, -0.7269094881543566, -0.7018218424628746, -0.6759281741585386, -0.6493983846114891, -0.6224053298214985, -0.595122627029363, -0.56772251674769, -0.5403738207635218, -0.5132400302907808, -0.48647755205953763, -0.4602341342085514, -0.4346474886454804, -0.40984412208131293, -0.38593838408573544, -0.36303173700134395, -0.3412122491266678, -0.32055430900842374, -0.3011185548542866, -0.2829520090046227, -0.26608840323778693, -0.25054867669116754, -0.2363416246812371, -0.22346467401942505, -0.21190475880092963, -0.20163927022976602, -0.19263705483553895, -0.18485943729573062, -0.1782612467499297, -0.17279182865881149, -0.16839602758452887, -0.16501512944855312, -0.16258775462959296, -0.16105069556595375, -0.16033969429207606, -0.16039015662325395, -0.1611378006222003, -0.16251923768089338, -0.16447248517190116, -0.16693741027555487, -0.16985610533839945 ], [ -0.8629151573053148, -0.8531502229016351, -0.8415926033306209, -0.8282818518981199, -0.8132738926585845, -0.7966407109985657, -0.7784697929203992, -0.7588633075045383, -0.7379370349418645, -0.7158190521298431, -0.6926481979766732, -0.6685723499980214, -0.6437465514185248, -0.6183310330603122, -0.5924891765255651, -0.5663854647124391, -0.5401834630342754, -0.5140438705203083, -0.48812267497380585, -0.4625694411685227, -0.43752575611532774, -0.41312385095443016, -0.3894854150486302, -0.366720614235007, -0.34492732170888074, -0.3241905664189797, -0.30458219995313696, -0.28616077860344535, -0.26897165267250334, -0.2530472503126785, -0.2384075385851736, -0.22506064035192574, -0.21300358242938144, -0.20222314842346045, -0.19269680898735586, -0.1843937029014734, -0.17727564422005715, -0.17129813348979117, -0.1664113543759128, -0.16256114056563553, -0.1596899012271783, -0.15773749633208178, -0.15664205564703315, -0.15634073712315155, -0.15677042180234135, -0.15786834333564648, -0.15957265091412753, -0.16182290499576124, -0.16456050579241188, -0.16772905513555336 ], [ -0.8249208641449912, -0.8151649953668514, -0.8037332568929978, -0.7906636346836555, -0.776009150510989, -0.759837623937693, -0.7422312125761916, -0.7232857218791529, -0.7031096824927453, -0.681823201796526, -0.6595566056390438, -0.6364488953043109, -0.6126460523715878, -0.5882992296221405, -0.5635628691661952, -0.5385927895734262, -0.5135442823701171, -0.4885702553784164, -0.4638194566286996, -0.43943480851249384, -0.4155518778459457, -0.3922975037791777, -0.3697886020273946, -0.34813116058387206, -0.32741943868709, -0.30773537712686183, -0.2891482238172395, -0.27171437388075803, -0.255477418367416, -0.2404683904078858, -0.22670619242459789, -0.21419818340756003, -0.20294090160182, -0.1929208955665953, -0.18411563562783195, -0.1764944782659098, -0.17001965780210515, -0.16464728258220596, -0.16032831633256484, -0.1570095290908865, -0.15463440573491982, -0.15314400337061773, -0.152477751526503, -0.15257419117328574, -0.15337165008552223, -0.15480885309508052, -0.15682546650225093, -0.15936257646152652, -0.16236310167379187, -0.1657721412816252 ], [ -0.7883474169656584, -0.7786039835261555, -0.7672950222347119, -0.7544571372718503, -0.7401407485207565, -0.7244099128231201, -0.707341949588915, -0.6890268596646276, -0.6695665321374493, -0.6490737413858025, -0.6276709452776004, -0.6054889039270028, -0.5826651458840283, -0.5593423143400569, -0.5356664295242825, -0.5117851049370861, -0.48784575469976754, -0.46399382755699525, -0.44037110046391903, -0.4171140616827713, -0.39435241023294587, -0.37220769554381383, -0.35079211824609713, -0.33020751006856974, -0.31054450757219654, -0.2918819307381637, -0.27428637307868564, -0.25781200492848455, -0.24250058602088265, -0.2283816776284835, -0.21547303884797064, -0.20378118648494148, -0.19330209388577146, -0.18402200131528423, -0.17591830928740326, -0.1689605266357208, -0.16311124690043777, -0.15832712950186822, -0.15455986577617864, -0.1517571138494629, -0.14986339014122652, -0.14882090872024378, -0.14857036259601686, -0.14905164324528197, -0.1502044962743201, -0.15196911221033782, -0.1542866521461811, -0.157099708488179, -0.16035270151217118, -0.1639922129138064 ], [ -0.7532111454156301, -0.7434840352765242, -0.7322955076071637, -0.7196809517176637, -0.7056884581804854, -0.6903786888127056, -0.6738245739668864, -0.6561108244068317, -0.6373332499255586, -0.6175978835942972, -0.5970199183250875, -0.5757224703556788, -0.5538351914455222, -0.5314927573359987, -0.5088332640093904, -0.48599656542419883, -0.4631225869161598, -0.4403496477055875, -0.41781282436904155, -0.39564238510096106, -0.3739623223789561, -0.352889009375701, -0.3325300031023055, -0.31298301467590306, -0.29433506406737675, -0.27666183299598923, -0.26002722515972654, -0.24448313771342567, -0.23006944198035095, -0.21681416511516927, -0.20473385826048007, -0.19383413114965176, -0.18411032858144571, -0.17554832110267082, -0.1681253807993649, -0.16181111333628018, -0.15656841913238884, -0.15235445949771786, -0.14912160727145995, -0.14681836555442163, -0.14539024211815876, -0.14478057068144368, -0.14493127326740007, -0.14578356020663008, -0.1472785660536412, -0.14935792083689847, -0.15196425681317172, -0.15504165140296344, -0.15853600738642903, -0.16239537184258646 ], [ -0.7195208069000016, -0.7098144103191646, -0.6987447290786086, -0.686346086626493, -0.672664490192667, -0.6577575403571705, -0.6416941881161142, -0.6245543256728097, -0.6064282012758622, -0.5874156543202749, -0.567625173939162, -0.5471727916202402, -0.5261808251923044, -0.5047764972231386, -0.48309045509023624, -0.46125522264065744, -0.43940361459011634, -0.4176671449167093, -0.396174459828901, -0.3750498247431512, -0.35441169330710365, -0.33437138492889695, -0.31503189546671384, -0.2964868635342238, -0.27881971207150025, -0.2621029812137128, -0.24639786393488916, -0.2317539504597711, -0.21820918119745403, -0.20579000129641278, -0.19451170332179468, -0.1843789385453879, -0.17538637242760557, -0.1675194564642677, -0.16075528690279794, -0.15506352093219167, -0.15040732264890433, -0.14674431406638555, -0.1440275102394497, -0.14220622175847464, -0.14122691201062798, -0.14103400037173575, -0.1415706056634396, -0.14277922668905318, -0.14460235846030078, -0.14698304394111905, -0.14986536190854638, -0.15319485202357097, -0.15691887856204523, -0.16098693458835334 ], [ -0.6872783203783938, -0.677597506579301, -0.6666458248976256, -0.6544566648942545, -0.6410741711754742, -0.6265531846695017, -0.610959049142363, -0.5943672685947838, -0.5768630045839668, -0.5585404076378022, -0.5395017831872881, -0.5198565991165498, -0.49972034841565693, -0.47921328595605406, -0.45845906274614434, -0.4375832840557833, -0.4167120196162919, -0.39597029493337144, -0.37548059287028557, -0.3553613943144487, -0.33572578609034753, -0.31668016336352633, -0.2983230525103483, -0.28074407862832806, -0.2640230993090681, -0.248229522786221, -0.23342182398593747, -0.21964726636956944, -0.20694183096407615, -0.1953303469933797, -0.1848268115570606, -0.17543487941896163, -0.16714849871182968, -0.1599526646664865, -0.15382426158780693, -0.14873296326184948, -0.14464216361808113, -0.14150991244772593, -0.13928983485057478, -0.1379320173735008, -0.1373838480767524, -0.13759080166890914, -0.13849716415558, -0.14004669404254888, -0.1421832190248029, -0.14485116836789413, -0.14799604198902216, -0.1515648177309903, -0.15550629864139476, -0.1597714023385981 ], [ -0.6564794584426535, -0.6468295455470436, -0.6359957301332931, -0.6240105837627776, -0.6109165853541989, -0.5967660874133146, -0.5816211630832773, -0.5655533194350886, -0.5486430652141678, -0.5309793256791278, -0.5126587027124808, -0.49378458442784595, -0.47446611442599507, -0.4548170361572771, -0.4349544322083416, -0.4149973816250083, -0.39506556066486476, -0.37527781381239056, -0.35575072269978747, -0.33659720094428625, -0.3179251429445755, -0.2998361543719148, -0.2824243913332386, -0.2657755337772545, -0.24996591642739396, -0.2350618371515335, -0.2211190581037492, -0.20818250923230375, -0.1962861970549209, -0.18545331435043932, -0.1756965391373756, -0.16701850460350065, -0.15941241608946521, -0.15286278727027447, -0.14734626558988906, -0.14283251683210396, -0.13928514028407635, -0.13666258892108685, -0.13491907295805983, -0.13400542948726213, -0.13386994530137752, -0.13445912402359905, -0.13571839208775438, -0.13759274081291417, -0.1400273037941513, -0.14296787016653112, -0.14636133513049188, -0.15015608961162463, -0.15430235121635594, -0.1587524388585736 ], [ -0.6271144956315546, -0.6175012145635679, -0.6067858096203138, -0.5950001351643521, -0.5821851791084733, -0.5683910483388226, -0.5536768486346819, -0.5381104445643979, -0.5217680871050865, -0.5047339005159326, -0.48709922486935586, -0.4689618160780117, -0.450424910710597, -0.4315961679191789, -0.4125865051097739, -0.39350884745116954, -0.37447681395845045, -0.35560336482993693, -0.3369994361180566, -0.3187725888079824, -0.3010257000217966, -0.28385572431872785, -0.26735255278334846, -0.25159799656706305, -0.23666491953086177, -0.22261654141917486, -0.20950592846454885, -0.1973756825242282, -0.1862578330116541, -0.1761739284222681, -0.16713531672022874, -0.15914359687612178, -0.15219121802348223, -0.14626219851240574, -0.14133293486533938, -0.137373070338071, -0.13434639428813433, -0.1322117465034527, -0.13092390458397085, -0.13043443690098777, -0.1306925081209659, -0.13164562839944283, -0.13324034087185443, -0.13542284486394396, -0.13813955430164437, -0.14133759219484043, -0.14496522293344716, -0.1489722246237184, -0.15331020395797812, -0.15793285627687925 ], [ -0.5991688123152858, -0.5895982654400376, -0.5790024485861001, -0.5674125856614178, -0.55486832755732, -0.5414177518825585, -0.5271172691921007, -0.5120314214645234, -0.49623256039107577, -0.4798003962472013, -0.4628214123720904, -0.44538814513135927, -0.42759833422020943, -0.4095539528895087, -0.39136013187935714, -0.3731239944012156, -0.3549534224213874, -0.33695577684987466, -0.3192365961399234, -0.30189829933940526, -0.28503892082047444, -0.2687509046717904, -0.25311998689999626, -0.23822419292011032, -0.22413297606341132, -0.21090651978237818, -0.1985952217753265, -0.18723937243867284, -0.1768690331232715, -0.16750411205289994, -0.15915462803414904, -0.15182114489385867, -0.1454953535421849, -0.14016077417209238, -0.13579354866762372, -0.13236329286613768, -0.12983397973776412, -0.12816482745751245, -0.12731117028556982, -0.12722529463572918, -0.1278572272313696, -0.1291554664413086, -0.1310676514913215, -0.1335411671248744, -0.13652368341695165, -0.13996363189637828, -0.14381062003129708, -0.1480157866317875, -0.15253210097299652, -0.15731460856847457 ], [ -0.5726234545599106, -0.563102069860343, -0.5526276013875564, -0.5412307163253094, -0.5289498633883469, -0.5158312827552235, -0.5019289330173138, -0.48730432133125023, -0.47202622437419806, -0.4561702903952197, -0.4398185163423851, -0.4230585983445776, -0.4059831583471808, -0.38868885410579923, -0.3712753837973113, -0.3538444000957387, -0.33649835166685926, -0.31933927271164186, -0.3024675435052677, -0.2859806468772199, -0.2699719472347256, -0.25452951993740347, -0.23973505939234696, -0.22566289390492922, -0.21237913382661555, -0.1999409766684771, -0.18839618848873352, -0.17778277506933127, -0.1681288494202463, -0.15945269443278376, -0.1517630116358153, -0.1450593396535952, -0.13933261975584066, -0.13456588134006275, -0.13073501760227657, -0.12780962110603744, -0.12575385028983443, -0.12452730081020691, -0.12408585953521767, -0.12438252347428036, -0.1253681704817725, -0.12699227281633307, -0.12920354830530345, -0.1319505468103932, -0.13518217188649417, -0.13884813903144255, -0.14289937286057675, -0.1472883460539658, -0.15196936316469234, -0.15689879247134275 ], [ -0.5474556511956847, -0.5379901328184855, -0.5276392995731038, -0.5164333236756902, -0.5044095689062715, -0.49161260730179224, -0.4780941620882294, -0.46391296358632195, -0.4491345058956717, -0.43383069439935007, -0.41807937730055855, -0.40196375819045826, -0.38557169072307296, -0.36899486055347086, -0.352327863575851, -0.3356671930695333, -0.3191101515978627, -0.3027537064326372, -0.2866933099315955, -0.27102170868313835, -0.25582776729260015, -0.24119533427969875, -0.22720217847202817, -0.21391902424835096, -0.20140871273420313, -0.18972551335859855, -0.17891460593532849, -0.16901174769396055, -0.16004313271003767, -0.1520254434211562, -0.14496608596630833, -0.13886359362243383, -0.13370817628060716, -0.12948238922493616, -0.1261618917687337, -0.12371626564394722, -0.12210986427597836, -0.12130266686217683, -0.12125111504458452, -0.12190891442006968, -0.12322778768929477, -0.12515817051918576, -0.12764984490682485, -0.13065250783462612, -0.13411627525986125, -0.13799212303853015, -0.14223226735726557, -0.14679048778017223, -0.15162239625558938, -0.15668565549904168 ], [ -0.523639289900006, -0.5142365659137667, -0.5040121210470694, -0.4929956833563065, -0.481223632824224, -0.4687390219615255, -0.4555915307289181, -0.44183734313920475, -0.42753893367622864, -0.4127647535018186, -0.3975888091252632, -0.3820901295263879, -0.36635212138086737, -0.3504618157960647, -0.3345090136532938, -0.31858534016971984, -0.30278322260673807, -0.2871948081666348, -0.27191084204239213, -0.25701952829019903, -0.24260539859220454, -0.22874821590428673, -0.21552194120637513, -0.20299379181143318, -0.19122341866277892, -0.18026222753259324, -0.17015286491889836, -0.1609288837843752, -0.15261459734778893, -0.1452251213818161, -0.1387665974943707, -0.13323658235217173, -0.1286245813960325, -0.12491270082404704, -0.12207638880715399, -0.12008523613771072, -0.11890380764848996, -0.11849247843961286, -0.11880825275599194, -0.11980554776707097, -0.12143692904078307, -0.1236537887831306, -0.1264069616550687, -0.12964727602197001, -0.13332604079265176, -0.13739546960906512, -0.14180904515942583, -0.14652182694355032, -0.1514907060611369, -0.15667461064904975 ], [ -0.5011453545013378, -0.49181252270842474, -0.48171762248517214, -0.4708899785879743, -0.45936507368356294, -0.4471845705166748, -0.4343962754768762, -0.4210540315976058, -0.40721752954884516, -0.3929520266653901, -0.3783279663393714, -0.3634204929928566, -0.34830886111272874, -0.33307574027902564, -0.3178064216030583, -0.302587934426213, -0.2875080854763393, -0.2726544359246621, -0.2581132349147254, -0.2439683310929176, -0.23030008634331156, -0.2171843181328924, -0.20469129835655053, -0.19288483704478065, -0.18182147847470698, -0.1715498348802187, -0.162110078981762, -0.15353361101296614, -0.1458429090707566, -0.13905156391221252, -0.1331644913700446, -0.1281783080361817, -0.12408184942088629, -0.12085680496197737, -0.11847844136503427, -0.11691638489437983, -0.11613543426770079, -0.11609637840677645, -0.11675679701425523, -0.11807182628810164, -0.1199948765831993, -0.12247829309324798, -0.12547395437483244, -0.12893380660684606, -0.1328103338195048, -0.13705696597393158, -0.14162842782259288, -0.14648103206268026, -0.15157292054597704, -0.15686425735542997 ] ], "zauto": true, "zmax": 2.141714042910155, "zmin": -2.141714042910155 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.29628585372378363, 0.2974614906487058, 0.3016321811214468, 0.3085316939473076, 0.3177738731768345, 0.328905108763166, 0.3414537491305895, 0.35496779218056307, 0.36903856114366845, 0.38331227727935796, 0.39749301601319453, 0.41134039873403944, 0.4246645551477801, 0.4373200151744096, 0.44919950142528764, 0.4602281292868644, 0.47035823775897817, 0.47956491329441625, 0.48784218436388654, 0.49519982438473414, 0.5016606850621274, 0.5072584793822884, 0.5120359368989837, 0.5160432600450695, 0.5193368171998427, 0.5219780153388628, 0.5240323020021168, 0.5255682530337368, 0.5266567092032857, 0.5273699315969936, 0.5277807527422979, 0.527961707923704, 0.527984139094581, 0.5279172720963058, 0.5278272763231311, 0.5277763241211363, 0.5278216745427498, 0.5280148119558347, 0.5284006737660951, 0.5290170025700957, 0.5298938560228147, 0.5310533024846967, 0.5325093223801355, 0.5342679247987399, 0.5363274771640933, 0.5386792339343472, 0.5413080394622819, 0.5441931713593842, 0.5473092847186198, 0.5506274147184909 ], [ 0.29323249393526124, 0.2944138626489484, 0.2986273884380085, 0.30560048836899983, 0.31493860114749284, 0.3261793628293791, 0.33884329383885553, 0.35247212783206894, 0.36665259713630555, 0.3810278082212522, 0.39529988496547386, 0.40922734713725467, 0.42261980955923134, 0.4353316729480495, 0.4472557718547008, 0.45831747561614106, 0.4684694543818151, 0.47768716329777827, 0.48596501557621674, 0.4933131769294863, 0.49975489965507564, 0.505324312859697, 0.5100645894240788, 0.5140264168875188, 0.5172667067455701, 0.5198474839309041, 0.5218349052306157, 0.5232983621030348, 0.524309629952065, 0.5249420326110036, 0.5252695977928344, 0.5253661867442264, 0.5253045893699207, 0.5251555846181302, 0.524986974721138, 0.5248626105766251, 0.5248414335726572, 0.5249765658107501, 0.5253144852215077, 0.5258943238073003, 0.5267473256843482, 0.527896496542327, 0.5293564678050545, 0.531133587801412, 0.5332262396569343, 0.5356253726533868, 0.5383152217954393, 0.5412741804497353, 0.5444757840512789, 0.5478897594575721 ], [ 0.2909191380141503, 0.29209799760774646, 0.2963330226442014, 0.3033472654097752, 0.31274051085014476, 0.3240445866065067, 0.3367748773039374, 0.35046904760258624, 0.36471087319580486, 0.3791414670212979, 0.3934617058996398, 0.407429398835255, 0.42085381296675034, 0.43358923396888144, 0.44552852150533534, 0.45659714790515615, 0.4667479247858263, 0.47595646475760683, 0.4842173444107331, 0.49154089769506587, 0.49795055547622535, 0.5034806458854745, 0.5081745746469827, 0.5120833114582038, 0.515264116013566, 0.5177794446385031, 0.5196959854961064, 0.5210837769771735, 0.5220153703655728, 0.52256500442725, 0.5228077664516946, 0.5228187216863663, 0.5226720011671345, 0.5224398466489776, 0.5221916204976421, 0.5219927976341681, 0.5219039653509826, 0.5219798642965382, 0.5222685093228048, 0.5228104314036292, 0.5236380808355012, 0.5247754271234135, 0.5262377824705308, 0.5280318642552271, 0.5301560983591219, 0.5326011510777245, 0.5353506640748412, 0.5383821557786708, 0.5416680447767688, 0.5451767467024053 ], [ 0.2893379987609089, 0.2905056832694754, 0.2947403850279265, 0.301762849681568, 0.3111700346587996, 0.32249095674591094, 0.33523857714007865, 0.34894868023782755, 0.3632036973689327, 0.3776438419942501, 0.39196942254292133, 0.40593790669876406, 0.4193583647905646, 0.4320849698796848, 0.444010511883641, 0.4550604099537015, 0.4651874243869033, 0.47436711249454, 0.48259399253535756, 0.48987834319196694, 0.49624355308680523, 0.5017239339322613, 0.5063629156837455, 0.510211549110459, 0.5133272488066251, 0.5157727170680779, 0.5176149960079565, 0.5189246018203308, 0.5197747014163036, 0.5202402980221309, 0.5203973990285121, 0.520322146666481, 0.5200899001275742, 0.5197742665798993, 0.5194460880119972, 0.5191724006003409, 0.5190153927523611, 0.519031396330768, 0.5192699518945462, 0.5197729921725059, 0.5205741876522767, 0.5216984936905611, 0.5231619299760673, 0.524971611100377, 0.5271260325270954, 0.5296156008857414, 0.5324233828945055, 0.5355260348640156, 0.538894865831827, 0.5424969825932365 ], [ 0.2884741662686471, 0.2896216499500985, 0.2938340391665228, 0.30083183810250025, 0.31021199549798506, 0.32150369115952293, 0.3342201399394832, 0.34789739567376915, 0.3621181217448979, 0.3765226974123969, 0.3908115206532595, 0.40474207373991816, 0.4181233731241736, 0.4308094777089499, 0.4426930114859007, 0.45369918466352466, 0.46378051497063394, 0.4729122939843468, 0.4810887628345118, 0.488319924793818, 0.4946289091240544, 0.5000497995676066, 0.5046258456273544, 0.5084079818296021, 0.5114535877678493, 0.5138254290827488, 0.5155907263801227, 0.5168203054593385, 0.5175877883228024, 0.5179687905560141, 0.5180400971283065, 0.5178787957660501, 0.5175613550153433, 0.5171626430292028, 0.5167548928841442, 0.5164066305147729, 0.5161815915542813, 0.5161376626418503, 0.5163258900913533, 0.5167896031550524, 0.5175636995460627, 0.5186741368288356, 0.5201376646872565, 0.5219618204894368, 0.5241451951408348, 0.5266779595635579, 0.5295426260787818, 0.5327150052305649, 0.5361653085341649, 0.5398593420588353 ], [ 0.28830672722996264, 0.2894246743216957, 0.2935928679691994, 0.3005335846757182, 0.30984650209833864, 0.32106384644706915, 0.3337016804491194, 0.3472984112990208, 0.3614384645583936, 0.3757634216481534, 0.38997441245701286, 0.40382928333449847, 0.41713713907298977, 0.42975192539280593, 0.44156600836153836, 0.4525042384286684, 0.46251870478729207, 0.4715842282901406, 0.4796945597130696, 0.4868592124747185, 0.4931008451633349, 0.49845310784401897, 0.5029588706450523, 0.5066687600431728, 0.5096399357749478, 0.5119350485483144, 0.5136213254180065, 0.5147697358431957, 0.5154541972741868, 0.5157507849312709, 0.5157369166009593, 0.5154904901305928, 0.5150889591311874, 0.5146083413480577, 0.5141221641792629, 0.5137003626067296, 0.5134081557549404, 0.5133049385217732, 0.5134432331296092, 0.5138677508317903, 0.5146146153020069, 0.515710795695675, 0.5171737888178439, 0.5190115767607488, 0.5212228699738685, 0.5237976277341192, 0.5267178304028983, 0.5299584626371087, 0.533488655424611, 0.5372729283841549 ], [ 0.2888098413059106, 0.28988864133032494, 0.2939910859920741, 0.30084313637049465, 0.3100497925816842, 0.32114906383246794, 0.333662332564517, 0.34713235573599427, 0.36114679686156614, 0.3753494473329007, 0.3894428002601609, 0.40318541507466743, 0.4163866322913197, 0.42890029313597894, 0.44061842228163856, 0.45146536812196975, 0.461392613575561, 0.47037431171447086, 0.4784035174770384, 0.4854890476384086, 0.49165288642178356, 0.496928052075039, 0.5013568438461551, 0.5049893954580654, 0.5078824685103079, 0.5100984263075506, 0.5117043350937066, 0.5127711455569957, 0.5133729129759304, 0.5135860198324357, 0.5134883705208774, 0.5131585343288286, 0.5126748204965024, 0.512114278087881, 0.5115516236346055, 0.5110581107753001, 0.5107003678146755, 0.5105392403431255, 0.5106286855907216, 0.5110147717078475, 0.511734837416357, 0.5128168645467766, 0.5142791075420226, 0.5161300104957385, 0.5183684249180328, 0.5209841220415842, 0.5239585743063743, 0.5272659638728853, 0.5308743633913201, 0.5347470269014767 ], [ 0.28995370217788635, 0.29098349412878144, 0.2949991429068726, 0.3017320644420909, 0.3107949800941314, 0.321734226377613, 0.3340788228677048, 0.34737776744333787, 0.3612233762779259, 0.3752626300659888, 0.3892000088224801, 0.4027951381475567, 0.4158577513523696, 0.42824160556492424, 0.4398383124748916, 0.4505715874229346, 0.46039213987866223, 0.4692732680336711, 0.4772071350647542, 0.4842016636604917, 0.4902779692246579, 0.4954682491825495, 0.49981404934172663, 0.5033648345595145, 0.5061767980362768, 0.5083118503896951, 0.5098367358778715, 0.5108222287039588, 0.5113423674598634, 0.5114736908036457, 0.5112944428460107, 0.5108837228957749, 0.5103205615848944, 0.5096829142388639, 0.5090465727473771, 0.5084840088992365, 0.5080631745928459, 0.5078462965586882, 0.5078887139441846, 0.5082378148373046, 0.5089321311078102, 0.5100006487193264, 0.5114623824264999, 0.5133262498641513, 0.515591261691428, 0.5182470236566057, 0.5212745256162363, 0.5246471741063463, 0.5283320110387838, 0.5322910527600518 ], [ 0.29170535403121145, 0.2926760439837423, 0.2965844933384419, 0.30316917078812633, 0.31205268459268787, 0.32279201552164627, 0.3349259578513646, 0.3480115215394065, 0.3616470228115722, 0.3754835817183491, 0.3892282832653856, 0.4026421795106039, 0.41553556657921625, 0.42776215257018424, 0.4392130790448991, 0.4498113107882868, 0.4595066291259484, 0.4682713019520263, 0.4760964159279939, 0.48298881310437797, 0.4889685563563431, 0.49406684389813854, 0.49832429593834265, 0.5017895423707635, 0.5045180471268281, 0.5065711113528454, 0.508015003465176, 0.5089201693231072, 0.509360480446144, 0.509412482759493, 0.5091546132472772, 0.5086663576306797, 0.5080273292354255, 0.5073162579190089, 0.5066098884292892, 0.5059817996889098, 0.5055011696803752, 0.5052315238537365, 0.5052295169149117, 0.5055438068530107, 0.5062140845024665, 0.5072703205011697, 0.5087322835400409, 0.5106093695482412, 0.5129007621615399, 0.5155959225855048, 0.5186753844255682, 0.52211180890608, 0.5258712404069583, 0.5299144928747374 ], [ 0.29402936937391505, 0.29493064637701405, 0.2987122402630542, 0.305121077577681, 0.3137915595883292, 0.32429337560092325, 0.33617703269835286, 0.3490091915267881, 0.36239544204739693, 0.37599196235195464, 0.3895090553587444, 0.4027095687189013, 0.41540454639580887, 0.42744769928133797, 0.4387296580545027, 0.44917253472611557, 0.4587250419253441, 0.4673582550934591, 0.4750620123224784, 0.48184190086618023, 0.487716759587962, 0.4927166211774346, 0.4968810199132803, 0.5002575960235308, 0.5029009340171109, 0.5048715785362428, 0.506235176786321, 0.5070617013490167, 0.5074247113724221, 0.5074006141465154, 0.5070678934190418, 0.5065062760435626, 0.505795815212503, 0.5050158770364047, 0.5042440277936064, 0.503554831673782, 0.5030185827331837, 0.5027000090528306, 0.5026570002792656, 0.5029394200572508, 0.5035880705099756, 0.5046338753604115, 0.506097340670196, 0.507988337632564, 0.5103062316317587, 0.5130403580998674, 0.5161708214201137, 0.5196695712109327, 0.5235016933093531, 0.5276268423204877 ], [ 0.296888415245, 0.29770977011007094, 0.3013456784288197, 0.3075527257747052, 0.31597873783166397, 0.32620790789726606, 0.337804180173964, 0.35034536128165544, 0.3634455080139392, 0.37676674023685763, 0.39002318527709723, 0.402979864522571, 0.41544877073730524, 0.4272836874820137, 0.4383747116460434, 0.4486430170454103, 0.45803612273608113, 0.4665237643526325, 0.47409437360342266, 0.4807521227115933, 0.4865144687831516, 0.49141012622048075, 0.495477396294213, 0.4987627876194413, 0.5013198671264025, 0.5032082868648019, 0.5044929370422196, 0.505243179945295, 0.5055321230177168, 0.5054358927764939, 0.5050328749814945, 0.5044028911453937, 0.5036262876847165, 0.5027829222660039, 0.5019510424752922, 0.5012060647746156, 0.5006192762928477, 0.5002564972928522, 0.5001767566156603, 0.500431044103106, 0.5010612109163339, 0.502099089050465, 0.5035658941482918, 0.5054719609454965, 0.507816839563568, 0.5105897557476606, 0.5137704121063409, 0.5173300836985925, 0.5212329427382077, 0.5254375356216702 ], [ 0.3002437417782748, 0.3009744928882903, 0.3044467705241279, 0.3104278139504556, 0.3185802251787963, 0.32850422048387945, 0.33977868237350145, 0.351993906314877, 0.364773521087795, 0.3777864320419253, 0.39075118803716385, 0.4034353700523356, 0.4156521363950705, 0.42725543180153114, 0.4381348153423815, 0.44821045532324155, 0.45742856949727073, 0.4657574227032178, 0.47318389829498664, 0.47971060876026417, 0.485353487012273, 0.49013979146908965, 0.49410645800323577, 0.4972987357655175, 0.4997690491845732, 0.5015760336988702, 0.5027836973263115, 0.5034606638567563, 0.5036794564483307, 0.5035157831426792, 0.5030477888700007, 0.5023552425600525, 0.5015186336819664, 0.5006181604785498, 0.49973260269617087, 0.49893808474137474, 0.49830675043814476, 0.49790538686138247, 0.4977940504565178, 0.49802476175317345, 0.49864034321255934, 0.49967347613594426, 0.5011460458490523, 0.5030688294359216, 0.5054415583321402, 0.5082533615559091, 0.5114835675616545, 0.5151028171822374, 0.5190744199730337, 0.5233558735762077 ], [ 0.3040556234844981, 0.30468495320063926, 0.30797658530276667, 0.3137092056258997, 0.3215612692764396, 0.33115025819606064, 0.3420712667704953, 0.3539282625625785, 0.3663554559801806, 0.37902933521115384, 0.39167345392380426, 0.40405834358175796, 0.41599855936078356, 0.42734831419418295, 0.43799664481579903, 0.44786266593519186, 0.45689120485158735, 0.4650489425877197, 0.4723210896958529, 0.47870857143714285, 0.4842256710432638, 0.4888980698666648, 0.492761222118171, 0.49585900503990343, 0.4982425900463157, 0.4999694850583508, 0.5011027022202363, 0.5017100082291369, 0.5018632168035437, 0.5016374848096838, 0.5011105758786782, 0.5003620587051006, 0.4994724123607132, 0.4985220185368601, 0.4975900310775355, 0.4967531265472748, 0.49608415544543083, 0.4956507309639068, 0.49551380918718624, 0.49572632913873066, 0.4963319906542028, 0.4973642504999838, 0.498845610984451, 0.5007872602568995, 0.5031891007324799, 0.5060401741803207, 0.5093194624930938, 0.512997015844848, 0.5170353382173378, 0.5213909464461947 ], [ 0.30828377457867423, 0.30880077926320537, 0.31189571809948763, 0.3173593252085272, 0.32488672243854605, 0.33411363090644186, 0.34465240304455236, 0.35612169710663416, 0.36816721194278107, 0.38047376240106195, 0.39277047066218407, 0.40483121073793665, 0.4164721784279165, 0.42754797962945296, 0.43794716397590383, 0.4475877646629406, 0.45641314934269467, 0.46438832180039946, 0.47149671460159054, 0.4777374572479926, 0.48312307642543806, 0.4876775735176537, 0.4914348223539964, 0.4944372324879572, 0.4967346273121827, 0.49838329037366735, 0.49944513655859296, 0.4999869671423691, 0.500079769223178, 0.49979802124079004, 0.49921896778966535, 0.49842182954734227, 0.49748691866534306, 0.49649463713738423, 0.4955243459758445, 0.49465310661942125, 0.49395431244886384, 0.493496246525326, 0.49334061991345696, 0.4935411608563768, 0.4941423360008974, 0.4951782883887865, 0.4966720713465212, 0.49863524230046546, 0.5010678570585799, 0.5039588758903271, 0.5072869615456556, 0.5110216202910387, 0.5151246137678253, 0.5195515545295669 ], [ 0.3128877496046115, 0.313281505664713, 0.3161647041655066, 0.3213405529841349, 0.3285214092098124, 0.33736195041573486, 0.3474926104674007, 0.3585475897153303, 0.370184872923572, 0.3820982844040371, 0.3940230524309377, 0.4057367819960899, 0.4170575627588039, 0.42784053473765926, 0.43797381532913804, 0.44737434920436386, 0.45598399643280624, 0.46376601135801265, 0.4707019643918009, 0.476789101463821, 0.4820381061516825, 0.48647121667996607, 0.4901206466790695, 0.49302726006740216, 0.4952394536939241, 0.4968122047292679, 0.49780624236290305, 0.49828730489683215, 0.4983254440006755, 0.4979943381965374, 0.4973705782798613, 0.4965328891925224, 0.4955612567240303, 0.4945359341273156, 0.4935363138772372, 0.49263966356061406, 0.4919197418861357, 0.49144532995269397, 0.4912787323730959, 0.4914743201297515, 0.49207719931547117, 0.4931220945205149, 0.49463253066551144, 0.49662038197725045, 0.4990858326615133, 0.5020177633900704, 0.5053945449359954, 0.509185189546994, 0.5133507858809075, 0.5178461272918543 ], [ 0.31782733224926585, 0.318086979870432, 0.32074442666261505, 0.32561562107034575, 0.3324305008579478, 0.3408631786106282, 0.350562778793038, 0.3611797282124641, 0.3723849804875519, 0.3838819839694598, 0.39541257759255016, 0.4067584767454338, 0.4177399241269899, 0.42821274959784844, 0.4380647123531457, 0.44721168297418235, 0.45559398845962895, 0.4631730842865376, 0.4699286172846313, 0.4758558844431864, 0.4809636615933175, 0.4852723617772715, 0.48881247876343176, 0.49162327176055676, 0.49375164986811226, 0.4952512173718092, 0.49618144274608955, 0.49660691488442477, 0.49659664982707064, 0.4962234106090147, 0.4955630025571734, 0.49469350732058504, 0.4936944220647334, 0.4926456764744096, 0.49162651013847897, 0.49071420677980915, 0.4899826992957169, 0.4895010795901752, 0.4893320678004055, 0.48953051413185444, 0.49014202010777924, 0.4912017717306362, 0.4927336727339297, 0.49474985105589575, 0.49725058694705143, 0.5002246795589379, 0.5036502345928741, 0.5074958232610053, 0.5117219366333844, 0.5162826423735281 ], [ 0.32306290970886103, 0.323177755046584, 0.32559651516657134, 0.33014800596704136, 0.33657989264161237, 0.3445859832710387, 0.35383449970666, 0.3639926153614264, 0.3747448176704246, 0.3858047189875336, 0.3969212337383076, 0.407880552536909, 0.4185053323888688, 0.42865226113748395, 0.43820883227271284, 0.4470898785182254, 0.45523419181900265, 0.46260140360097496, 0.4691692000501872, 0.47493088791602095, 0.4798932940743566, 0.4840749668457675, 0.4875046417213527, 0.49021993385951473, 0.492266221361818, 0.4936956850584835, 0.49456647138947296, 0.4949419446701518, 0.4948899937756294, 0.4944823566101245, 0.4937939244418412, 0.49290198823268955, 0.49188539148569566, 0.4908235598131968, 0.4897953871110576, 0.4888779722059608, 0.48814521780296083, 0.48766632438871366, 0.48750423347015176, 0.48771409441145086, 0.4883418439905715, 0.48942299454413796, 0.4909817229016459, 0.49303033736654245, 0.49556917479415336, 0.49858694724291847, 0.5020615220549229, 0.505961085442109, 0.5102456121692941, 0.5148685458884908 ], [ 0.3285558272272899, 0.3285154627652326, 0.33068372725988315, 0.3349023096081793, 0.3409365755617126, 0.34850009352887257, 0.3572804014863341, 0.36696178073837366, 0.3772426980660039, 0.38784739007165897, 0.39853226568913264, 0.4090883356329334, 0.41934093067957945, 0.42914777493704154, 0.43839620627625503, 0.44700007779172934, 0.45489666881194035, 0.46204378708790206, 0.468417146948237, 0.4740080491345797, 0.47882135511429946, 0.4828737325501794, 0.486192142369929, 0.48881253671480634, 0.49077873781250997, 0.4921414686245504, 0.4929575059968141, 0.49328892570695854, 0.4932024064657684, 0.49276855717134616, 0.4920612293780207, 0.4911567760372152, 0.4901332191694544, 0.48906929424269113, 0.4880433484374312, 0.48713208401792113, 0.4864091564013066, 0.48594365809816825, 0.4857985424540001, 0.4860290621998902, 0.4866813138769862, 0.4877909869587458, 0.4893824134727576, 0.491467999128815, 0.4940480913597333, 0.4971113062361807, 0.5006352994038715, 0.5045879311163792, 0.5089287467766141, 0.5136106754861259 ], [ 0.3342687168427614, 0.334063158450116, 0.33597030475919887, 0.339844619302967, 0.34546899226793876, 0.35257664449923093, 0.36087447675800577, 0.37006408818532494, 0.3798582516221852, 0.3899922049334445, 0.400230219716507, 0.4103684469052663, 0.4202351450635442, 0.42968926076239183, 0.4386181030076265, 0.44693462557919655, 0.45457464281662796, 0.4614941658815414, 0.467666953163235, 0.47308231040247356, 0.477743143047019, 0.48166424663471874, 0.48487081399239107, 0.4873971360275572, 0.48928547274628437, 0.4905850709558492, 0.4913513039358426, 0.4916449059078549, 0.49153127063913643, 0.49107977959862276, 0.49036312163861345, 0.4894565642723527, 0.48843713739402067, 0.48738269481219254, 0.48637082807006143, 0.4854776210887261, 0.4847762529088145, 0.4843354780764517, 0.48421803792644436, 0.48447907819932184, 0.485164665597614, 0.4863105045970459, 0.4879409534345553, 0.4900684235892983, 0.4926932211825279, 0.4958038545594794, 0.4993777944947455, 0.503382637276094, 0.50777759124168, 0.5125151876586644 ], [ 0.34016579514422324, 0.33978563314976507, 0.3414222966216913, 0.3449428370682496, 0.35014736642393157, 0.3567884997439477, 0.3645923919442618, 0.37327802786196046, 0.3825726968996235, 0.3922229302044579, 0.40200117558771636, 0.41170901561285345, 0.421177882036707, 0.4302681360066348, 0.43886720021325104, 0.44688723154855486, 0.45426265280873324, 0.4609477333099423, 0.4669143195943485, 0.47214976115385565, 0.47665504344118614, 0.48044312343284745, 0.4835374553796977, 0.48597069156636363, 0.48778354182797073, 0.4890237743638885, 0.4897453380878501, 0.49000758310517484, 0.48987455118076095, 0.4894143029196525, 0.48869824377383864, 0.487800408045124, 0.486796659973332, 0.4857637749084224, 0.4847783723411547, 0.48391568662338613, 0.4832481802676357, 0.4828440276073197, 0.48276552116707455, 0.48306747627848656, 0.48379572765756834, 0.48498582124633616, 0.4866620028284518, 0.48883659055092266, 0.4915097924126506, 0.49466999506996956, 0.49829451168422384, 0.502350739445796, 0.5067976468847183, 0.5115874907358021 ], [ 0.34621312621027406, 0.3456496866456876, 0.34700784191664347, 0.35016696997550123, 0.35494399561012163, 0.3611105405838778, 0.36841176694297656, 0.3765839814913428, 0.38536908886250043, 0.39452512051948235, 0.4038329571407486, 0.4130998727061187, 0.42216070645496584, 0.4308774304910254, 0.43913773879367346, 0.4468531159008866, 0.45395669281203055, 0.46040108012304015, 0.46615628555471944, 0.4712077694979843, 0.4755546605242102, 0.47920813585836575, 0.4821899637358241, 0.48453120100826547, 0.4862710373563464, 0.48745577517912453, 0.4881379307403846, 0.4883754372368576, 0.4882309244236835, 0.4877710430023465, 0.4870657961523643, 0.48618783656297704, 0.485211686354761, 0.484212840553811, 0.4832667232101697, 0.4824474792726862, 0.48182660466334215, 0.48147144043529744, 0.481443582231747, 0.48179728033793146, 0.48257792470024347, 0.4838207196620227, 0.48554965194018695, 0.48777684125382564, 0.49050233687922346, 0.49371438833023296, 0.497390179157753, 0.5014969750937652, 0.5059936065885905, 0.5108321849208072 ], [ 0.35237884730611085, 0.3516243584481382, 0.3526974078683954, 0.3554893747255391, 0.3598334992748227, 0.365519912438256, 0.37231241440317336, 0.3799644498927783, 0.3882325314795056, 0.39688631466368646, 0.405715311933358, 0.41453271505923983, 0.42317699218356086, 0.43151192579362846, 0.4394256532458531, 0.4468291333410593, 0.45365433165300906, 0.45985231202984433, 0.46539134576740776, 0.4702550999886053, 0.47444093666063636, 0.47795833714903874, 0.48082745887693906, 0.4830778264418837, 0.4847471566092882, 0.4858803132026116, 0.4865283831764949, 0.4867478589133104, 0.48659990438613493, 0.4861496750526376, 0.48546565425384514, 0.48461896374645586, 0.48368260411758685, 0.48273058344684766, 0.48183690064305773, 0.4810743638387217, 0.4805132437807115, 0.48021978607212173, 0.4802546321167957, 0.48067122346292185, 0.4815142841047329, 0.48281848637344, 0.4846074053513691, 0.4868928529327813, 0.4896746565741112, 0.49294091252972766, 0.4966687038212405, 0.5008252349828809, 0.5053693039992949, 0.5102530105908148 ], [ 0.35863335598263035, 0.3576811145253396, 0.3584639794870852, 0.36088495132779397, 0.3647930149484569, 0.3699962199882384, 0.3762765293968379, 0.38340423308345406, 0.3911503453485251, 0.39929618929144356, 0.4076400510257457, 0.41600123239932824, 0.42422203802059166, 0.43216826245410744, 0.4397286726051783, 0.44681387017392793, 0.4533548084373249, 0.45930114548520096, 0.464619548029657, 0.4692920143339396, 0.4733142568655523, 0.47669416953833865, 0.47945039603597595, 0.4816110109318616, 0.483212321487939, 0.4842977934874312, 0.48491709843613595, 0.48512527183544435, 0.48498196340603217, 0.4845507509577041, 0.483898481194735, 0.4830945944419872, 0.4822103874561172, 0.4813181704253363, 0.4804902819373846, 0.47979793955759875, 0.4793099233902678, 0.4790911143126158, 0.4792009351271264, 0.4796917683692888, 0.48060744502820274, 0.48198191011006597, 0.4838381707662662, 0.4861876192396291, 0.4890297969842115, 0.49235263109789773, 0.49613313456208546, 0.5003385233886527, 0.5049276719078435, 0.5098528059149475 ], [ 0.364949457801239, 0.3637939884826569, 0.36428319850541363, 0.3663312822711671, 0.3698023376676909, 0.37452166479109683, 0.38028882208892156, 0.3868905549129738, 0.39411218206366777, 0.4017466620303379, 0.40960114106489415, 0.4175011896284118, 0.4252931422136234, 0.4328450090280569, 0.44004638649846767, 0.44680770972552175, 0.4530590994654805, 0.45874897788135227, 0.4638425680563008, 0.4683203518350396, 0.47217653534648996, 0.47541755699288957, 0.4780606645032661, 0.48013258242814744, 0.48166828676651224, 0.48270989775963963, 0.48330569455170974, 0.48350924635559756, 0.4833786444594403, 0.4829758087684975, 0.48236583280730777, 0.4816163236053255, 0.48079668909806894, 0.47997732691644684, 0.4792286757060092, 0.47862010385674086, 0.4782186303821787, 0.47808749732627615, 0.4782846400885942, 0.4788611280730932, 0.4798596691213733, 0.48131328337000767, 0.4832442524156397, 0.4856634365893179, 0.4885700275570598, 0.49195176848386, 0.4957856345058455, 0.5000389279230222, 0.5046707106271939, 0.5096334746453282 ], [ 0.3713024740323309, 0.3699396763684769, 0.3701334502093757, 0.37180871486454065, 0.3748439992097978, 0.379081120877713, 0.38433658803714493, 0.39041312622819374, 0.39711007898847267, 0.40423193758053166, 0.41159474245326844, 0.4190304586532314, 0.42638963011127917, 0.4335426879983027, 0.44038027177574485, 0.4468128619811222, 0.45276995284817595, 0.45819892870801554, 0.46306375830209273, 0.46734358652467617, 0.4710312811618135, 0.4741319791721332, 0.4766616692910526, 0.4786458422121309, 0.4801182341264997, 0.4811196826357185, 0.48169710539253296, 0.4819026013008236, 0.481792662280602, 0.48142747145654685, 0.4808702524485387, 0.4801866257025359, 0.4794439230070565, 0.47871041185804225, 0.4780543881734919, 0.4775431094433976, 0.47724156033599147, 0.47721106766926236, 0.47750780902294687, 0.4781812856850827, 0.47927285210078124, 0.48081440658789754, 0.4828273487503765, 0.4853218963727524, 0.48829682944270475, 0.4917396944113568, 0.49562746270776564, 0.499927599499343, 0.504599466963955, 0.5095959647168333 ], [ 0.3776703085209761, 0.3760975844844366, 0.3759958973998061, 0.3773003855575811, 0.3799032853218875, 0.38366214581156177, 0.3884097129361605, 0.3939641428568845, 0.4001384503840277, 0.40674849260902446, 0.41361918941559195, 0.4205889956711414, 0.4275128311067253, 0.4342637549405654, 0.44073367635695193, 0.4468333542894649, 0.4524918878431906, 0.45765584882838894, 0.46228816798844985, 0.4663668582670832, 0.4698836402546251, 0.4728425238404192, 0.4752583930048961, 0.4771556350060328, 0.4785668490439537, 0.4795316616538597, 0.48009566609720217, 0.48030949101788317, 0.480227990246891, 0.4799095319401619, 0.47941535259669715, 0.47880893148223747, 0.4781553351529106, 0.47752048153875465, 0.4769702794282532, 0.4765696125910723, 0.47638115773951817, 0.4764640505928411, 0.47687244193248624, 0.4776540122481342, 0.4788485353586074, 0.4804865943294075, 0.48258855407589074, 0.4851638828836951, 0.4882108905249703, 0.49171691675654217, 0.4956589655305161, 0.5000047427651443, 0.5047140241613969, 0.509740258060454 ], [ 0.3840334727322978, 0.3822498297463819, 0.38185446133660866, 0.3827921861631609, 0.38496819072409993, 0.3882549266960782, 0.39250061093355093, 0.39753821718851134, 0.4031940133837422, 0.40929499772805944, 0.4156749101310151, 0.4221787620191577, 0.42866600295692403, 0.4350125290176915, 0.44111175835249666, 0.446874981158034, 0.45223115687941456, 0.45712629575043423, 0.46152253210355965, 0.4653969754585654, 0.4687404113619984, 0.47155591508789374, 0.4738574351395703, 0.4756683978363542, 0.47702037751239756, 0.47795186801752765, 0.4785071799370169, 0.4787354744604341, 0.4786899298620141, 0.47842702126364023, 0.47800588020790014, 0.47748768921808393, 0.4769350596119832, 0.4764113398154089, 0.47597980731402484, 0.4757027105546127, 0.475640147049516, 0.4758487891091651, 0.4763804964211692, 0.47728088159952353, 0.4785879168289546, 0.4803306829444012, 0.48252836374460484, 0.48518957673257074, 0.48831210764074007, 0.4918830830449, 0.49587957777678665, 0.5002696171219222, 0.5050135029656602, 0.5100653718006297 ], [ 0.3903750680361049, 0.38838119250977965, 0.3876957502939752, 0.388272673139757, 0.39002931336536356, 0.3928521627292336, 0.39660409807745994, 0.40113224476708453, 0.4062756500264223, 0.4118721775390407, 0.4177642876697089, 0.42380358907461124, 0.42985420370532235, 0.43579507475603496, 0.44152138012207875, 0.4469452125003774, 0.4519956693143286, 0.456618473619485, 0.4607752277829061, 0.46444238742600213, 0.46761003360328807, 0.47028051489467637, 0.4724670260951831, 0.47419218474444996, 0.4754866595322564, 0.4763878948639585, 0.4769389633512818, 0.4771875630352814, 0.4771851595787802, 0.4769862567431223, 0.47664776276469584, 0.4762284075149314, 0.4757881572905075, 0.4753875722324166, 0.4750870567408737, 0.4749459661648718, 0.47502155292079923, 0.47536776041180356, 0.47603390100604387, 0.4770632813460867, 0.4784918604045341, 0.4803470391467572, 0.4826466825157756, 0.4853984634660935, 0.4885995957873873, 0.4922369904245017, 0.4962878334718122, 0.5007205482505337, 0.5054960737472916, 0.5105693707759242 ], [ 0.3966807247565047, 0.39447902251011724, 0.39350893743418397, 0.3937329225599695, 0.3950796912751832, 0.3974488881323877, 0.4007172049755085, 0.404745210024702, 0.4093842093582948, 0.4144826125024087, 0.419891465140639, 0.4254689901798269, 0.4310841136847536, 0.4366190370410214, 0.4419709586412888, 0.44705306112508153, 0.45179487713690797, 0.4561421375819497, 0.46005619718508545, 0.4635131251406635, 0.46650254391335627, 0.46902629580519695, 0.47109701333916065, 0.47273666448988816, 0.47397513629610916, 0.4748489098352464, 0.4753998658452357, 0.4756742438752991, 0.4757217596675589, 0.4755948668820377, 0.4753481319700048, 0.47503767682959613, 0.47472063465862996, 0.4744545616969054, 0.4742967523540321, 0.47430341783201563, 0.4745287081179344, 0.47502358243313736, 0.47583456114225003, 0.47700241918256286, 0.47856090330288625, 0.4805355690496781, 0.4829428357041283, 0.48578934707437843, 0.48907170403396355, 0.49277660384585303, 0.49688138602820536, 0.5013549498701916, 0.5061589793999813, 0.5112493911004609 ], [ 0.40293849848185287, 0.4005330997432552, 0.39928559113734324, 0.3991663351112779, 0.4001145873756033, 0.4020422415816112, 0.4048389352750655, 0.4083779379687976, 0.41252225636461687, 0.4171304891199527, 0.42206210107798264, 0.4271819250120388, 0.4323638123052369, 0.4374934332454874, 0.4424702752570271, 0.4472089117031724, 0.45163962402231217, 0.45570846313112406, 0.45937683673048313, 0.4626207094362657, 0.4654295029050945, 0.4678047827729372, 0.46975881733445723, 0.4713130885132337, 0.4724968280689776, 0.4733456407689814, 0.4739002614681389, 0.474205475236339, 0.4743092098818929, 0.47426178992977575, 0.4741153221422129, 0.4739231669943557, 0.4737394400542208, 0.4736184835650386, 0.4736142527234699, 0.47377957342438376, 0.47416524786292535, 0.474819009548789, 0.47578435718931694, 0.47709932395330734, 0.4787952609077423, 0.48089572726246066, 0.48341558276395197, 0.4863603680409492, 0.4897260377774829, 0.49349908206197396, 0.4976570373737695, 0.5021693552802963, 0.5069985685407433, 0.5121016742747585 ], [ 0.40913872556527875, 0.40653545367324656, 0.4050194626427114, 0.4045683973711992, 0.4051312297010925, 0.4066311905318686, 0.4089699789849313, 0.4120328011436381, 0.4156937770335755, 0.41982130742527907, 0.42428308350635496, 0.4289505240816967, 0.43370251640161245, 0.43842840825623103, 0.44303024953345543, 0.4474243148395881, 0.45154196031096366, 0.45532988200612373, 0.45874985334530827, 0.4617780265338081, 0.46440388822282913, 0.4666289626014473, 0.4684653551323258, 0.4699342266376504, 0.47106427993120636, 0.47189032946808107, 0.47245200872251086, 0.4727926508536653, 0.4729583568268373, 0.47299724313521346, 0.4729588405737718, 0.4728935982675597, 0.472852435378956, 0.47288627827972507, 0.47304552451450016, 0.473379386788893, 0.4739350896609612, 0.4747569167052468, 0.47588513377846686, 0.4773548410461055, 0.4791948287495017, 0.4814265257392465, 0.48406313298554654, 0.487109025569451, 0.4905594869170641, 0.49440081095342037, 0.49861077548134863, 0.503159458068069, 0.5080103383526786, 0.5131216111618854 ], [ 0.4152738415002001, 0.41248014595279603, 0.41070623770702136, 0.4099364075110916, 0.4101285164567728, 0.4112162208786805, 0.41311239177340203, 0.41571339333814483, 0.41890385100864647, 0.4225615568931397, 0.426562213160648, 0.4307837829620633, 0.43511028869044405, 0.43943495977340646, 0.4436626833235092, 0.44771175113005374, 0.45151492756838096, 0.45501988713814695, 0.45818908913144973, 0.4609991713263938, 0.4634399549906523, 0.465513159861177, 0.46723092991198445, 0.46861426832135716, 0.46969147284978185, 0.47049665078883124, 0.4710683760295193, 0.47144853037325885, 0.47168134822966423, 0.4718126600604483, 0.4718893074510128, 0.4719586837912481, 0.47206834138005505, 0.47226560007834945, 0.4725970954755596, 0.47310821604067343, 0.4738423979819647, 0.4748402715453133, 0.47613868029254003, 0.47776962190535566, 0.4797591814301868, 0.48212654215387934, 0.4848831630090191, 0.4880322035981818, 0.49156825945167854, 0.4954774435791902, 0.499737819607214, 0.5043201612114349, 0.509188986244227, 0.5143037949702992 ], [ 0.42133816770861465, 0.4183630236524016, 0.4163432607468711, 0.41526917529673496, 0.4151066970199453, 0.4157990040480298, 0.41726925300355117, 0.4194241831195518, 0.4221583048692742, 0.42535837342686633, 0.4289078678346939, 0.43269123728510717, 0.43659772623685106, 0.44052464251606854, 0.4443799823596089, 0.44808437114015337, 0.45157231733553416, 0.4547928099943556, 0.45770931664901565, 0.46029925956362006, 0.4625530635771973, 0.4644728787221496, 0.466071085265245, 0.46736868775603324, 0.46839369800590896, 0.4691795947376388, 0.4697639303255683, 0.4701871334290421, 0.47049153177855185, 0.4707205937980389, 0.4709183634213963, 0.4711290418301502, 0.4713966552040116, 0.4717647407708004, 0.47227598553839967, 0.4729717631745638, 0.4738915335555514, 0.47507209443175097, 0.4765467024353118, 0.4783441076531514, 0.48048756843553936, 0.4829939276512746, 0.485872835881098, 0.48912620018577374, 0.49274791993915246, 0.49672394625444877, 0.501032672420678, 0.5056456336664018, 0.5105284693487118, 0.5156420822301643 ], [ 0.42732767398491833, 0.42418145157341486, 0.4219292413696843, 0.4205667075462832, 0.4200670411478131, 0.4203820546494916, 0.4214443162233747, 0.4231701611684458, 0.42546335993797063, 0.42821919092118305, 0.43132866066228753, 0.4346826303652042, 0.43817563965666523, 0.44170926078808875, 0.4451948634703622, 0.4485557180442959, 0.4517284094641175, 0.4546635744350478, 0.4573260077429222, 0.45969421079859124, 0.4617594756020868, 0.4635246108290233, 0.46500242369700107, 0.4662140717696458, 0.4671873929650086, 0.467955309924383, 0.4685543870247873, 0.4690235956006641, 0.4694033168619749, 0.4697345846027637, 0.4700585435571503, 0.4704160768160704, 0.470847539534975, 0.47139252817954963, 0.47208961587075593, 0.4729759950383293, 0.47408698745773104, 0.4754554066176194, 0.47711078513988114, 0.47907850700540483, 0.4813789069054698, 0.48402641389105067, 0.48702882139142795, 0.49038675981716834, 0.4940934321845469, 0.4981346498602066, 0.5024891780936288, 0.507129373402811, 0.5120220707567572, 0.5171296606172202 ], [ 0.43323972516472253, 0.42993403334603053, 0.4274639541027712, 0.4258298908868529, 0.4250115091251615, 0.42496839211983173, 0.4256416659847475, 0.4269564954594296, 0.4288252885417373, 0.4311514009329137, 0.43383310521127694, 0.4367675854583908, 0.4398547340117747, 0.44300055918520775, 0.4461200559509119, 0.44913944017202384, 0.45199769602067896, 0.4546474318581353, 0.45705507956063335, 0.45920050472296975, 0.46107611990865704, 0.4626856101733813, 0.4640423896632845, 0.4651679103603636, 0.4660899391566892, 0.46684090761107866, 0.4674564204782752, 0.4679739853829547, 0.468431998431802, 0.46886899132466175, 0.4693231173152249, 0.4698318290360095, 0.4704316833953489, 0.47115819953625737, 0.47204569635050025, 0.4731270462533421, 0.4744333006244651, 0.4759931671773861, 0.47783234734212604, 0.47997276886292256, 0.48243177155200323, 0.48522131935306073, 0.48834731742641685, 0.49180910814006573, 0.49559920545734565, 0.49970330550112024, 0.5041005853171862, 0.5087642757443879, 0.513662471264294, 0.5187591223696644 ], [ 0.43907282136180287, 0.4356203315242532, 0.43294794235952283, 0.4310601835984041, 0.42994243527146897, 0.4295612192485873, 0.4298653941644669, 0.43078820753243297, 0.4322500918276161, 0.43416203320160474, 0.4364292995769956, 0.4389552941125617, 0.44164530197832297, 0.4444099210378139, 0.44716800562542314, 0.4498490009115593, 0.45239459712448454, 0.4547596829463964, 0.4569126220896103, 0.4588349143156695, 0.46052033112604013, 0.46197363689587173, 0.4632090185084545, 0.46424835077482174, 0.4651194212517758, 0.465854226734131, 0.4664874352080776, 0.46705508244007254, 0.4675935433363348, 0.4681387871202709, 0.4687258951353744, 0.46938879378053777, 0.4701601355857715, 0.47107125093717606, 0.4721520926358556, 0.4734311052652084, 0.4749349699130078, 0.4766881996903594, 0.4787125894213699, 0.4810265501427968, 0.4836443820218132, 0.48657555491929794, 0.48982407207481554, 0.4933879886027635, 0.49725914347382655, 0.5014231435501361, 0.5058596141280586, 0.5105427057823693, 0.5154418253335882, 0.5205225419617 ], [ 0.4448263412409785, 0.44124059670825017, 0.4383822371796389, 0.43625932751553154, 0.4348622361195119, 0.4341636291286336, 0.4341193074371983, 0.4346698814800877, 0.4357432106007234, 0.43725746820176886, 0.4391246402467063, 0.4412542308567218, 0.4435569389123405, 0.4459480835084181, 0.4483505897546392, 0.45069739332105535, 0.4529331752556826, 0.455015391752805, 0.4569146121832062, 0.4586142200614191, 0.46010956443433726, 0.46140667307214334, 0.4625206538874173, 0.46347391734552895, 0.4642943503781292, 0.46501356166360824, 0.4656652995877801, 0.4662841187988198, 0.46690434081754467, 0.46755932121288846, 0.4682810035379906, 0.46909971189605604, 0.47004411275987057, 0.4711412648563027, 0.4724166747732472, 0.4738942853412395, 0.47559634233638953, 0.4775431100502804, 0.47975243438276494, 0.4822391795933277, 0.4850145881008495, 0.4880856287869688, 0.4914544062157309, 0.49511770043127906, 0.49906669533012116, 0.5032869350589534, 0.5077585253648788, 0.5124565735712174, 0.5173518399077907, 0.5224115566452685 ], [ 0.4505002972605504, 0.4467955148621343, 0.4437681000824604, 0.44142908943546827, 0.4397731527625693, 0.43877835002002663, 0.43840667532710526, 0.4386054149699052, 0.4393092783545648, 0.44044319070948695, 0.4419255744920897, 0.4436719027186864, 0.44559828798931816, 0.4476248771610282, 0.4496788502026381, 0.451696866421993, 0.4536268545427085, 0.45542909815518434, 0.45707661963140106, 0.458554910338624, 0.45986109120754864, 0.46100261477710797, 0.461995637641845, 0.462863200792093, 0.46363335467961825, 0.4643373560657851, 0.4650080452534576, 0.4656784862265939, 0.46638092040840645, 0.4671460499382399, 0.46800263194849506, 0.468977334928505, 0.4700947852354272, 0.47137771867281536, 0.47284715008849826, 0.47452248298402183, 0.4764214996048449, 0.4785601971526032, 0.4809524641199865, 0.4836096185056573, 0.4865398532545973, 0.48974765080889765, 0.49323323632366, 0.4969921373644065, 0.5010149075402331, 0.5052870544780222, 0.5097891915407058, 0.514497410784882, 0.5193838546946896, 0.5244174484519238 ], [ 0.45609511069448533, 0.45228598054577146, 0.4491067975972587, 0.44657103939635723, 0.44467703450963336, 0.4434075350385222, 0.4427300255397348, 0.44259781883014565, 0.44295192289986407, 0.44372359072115924, 0.44483739760736873, 0.446214639902884, 0.4477768217786678, 0.4494489963883734, 0.4511627512531466, 0.4528586695378914, 0.4544881513286634, 0.45601453488133015, 0.45741351134943586, 0.4586728739009548, 0.45979168129996845, 0.46077894603511793, 0.46165197758995347, 0.4624345223149673, 0.4631548424370066, 0.4638438679982319, 0.4645335373002993, 0.4652554147815511, 0.4660396421434495, 0.46691424189229525, 0.46790475593105096, 0.4690341693556424, 0.4703230447913094, 0.47178977814709894, 0.4734508839143715, 0.47532122687394873, 0.4774141356010686, 0.4797413585716608, 0.48231285234637333, 0.48513641939624247, 0.48821723709180864, 0.4915573364050728, 0.49515509724310586, 0.49900482656708595, 0.5030964763286091, 0.5074155426252662, 0.5119431679172581, 0.516656447516967, 0.5215289225458136, 0.5265312262619777 ], [ 0.4616114126639366, 0.4577129018975884, 0.4543994128597349, 0.45168637074375695, 0.44957516830685296, 0.44805260071550873, 0.4470909902927616, 0.4466490687027453, 0.44667362001277866, 0.44710181520163866, 0.44786409865705085, 0.44888743158712824, 0.4500986645837668, 0.4514278054414258, 0.452810967241952, 0.4541928202472548, 0.45552842194770954, 0.4567843553449969, 0.4579391601761873, 0.4589830911385849, 0.4599172788033127, 0.46075240157868214, 0.46150700020897734, 0.4622055794845779, 0.4628766447481451, 0.46355081320059366, 0.464259122161784, 0.46503162932701597, 0.46589636572208537, 0.4668786636106614, 0.4680008429840229, 0.4692822057100043, 0.470739259826743, 0.4723860807248053, 0.47423471247484633, 0.47629552105512324, 0.4785774298699054, 0.4810879936679454, 0.4838332960090742, 0.48681768388316193, 0.4900433774331512, 0.4935100102467386, 0.49721416472244934, 0.5011489671707038, 0.5053037993541141, 0.5096641688736602, 0.5142117626031526, 0.5189246879508739, 0.523777888604793, 0.5287437065991915 ], [ 0.467049875539428, 0.46307704108209563, 0.459646697299793, 0.45677576432238043, 0.45446815562052956, 0.45271411557639446, 0.45149020438217, 0.45076000926464743, 0.4504755995689784, 0.45057967130283066, 0.4510082557491072, 0.4516938084030055, 0.45256845779594107, 0.45356718308200944, 0.4546307038404079, 0.4557079005990301, 0.456757633137071, 0.45774987843373593, 0.4586661650596363, 0.4594993314444816, 0.46025267905629935, 0.46093862656260626, 0.46157699663392404, 0.46219308254068364, 0.4628156464903326, 0.46347499532905867, 0.4642012618600591, 0.4650229925516475, 0.465966106927328, 0.4670532537482188, 0.46830354843595506, 0.46973263960851847, 0.4713530242912326, 0.4731745143982951, 0.47520475292374503, 0.4774496866001193, 0.4799139205897387, 0.4826009068425664, 0.4855129471929917, 0.48865102111064657, 0.49201447275766796, 0.4956006099830259, 0.49940427755539407, 0.5034174679465262, 0.5076290261041122, 0.5120244915963271, 0.5165861045739585, 0.5212929837073472, 0.5261214669840828, 0.5310455918960325 ], [ 0.4724110771015428, 0.4683788917486025, 0.4648489631034418, 0.4618392966374793, 0.459355835864413, 0.45739173718766957, 0.45592725297994746, 0.45493030877916313, 0.4543578019392253, 0.4541575791026588, 0.45427097941057587, 0.45463577093022844, 0.4551892685304418, 0.455871407196724, 0.45662755547548506, 0.4574108852470928, 0.45818415988923394, 0.4589208561400942, 0.4596055895179107, 0.4602338644609741, 0.46081121544541537, 0.4613518424049687, 0.4618768716418821, 0.46241239113247756, 0.46298741581908737, 0.46363193347443443, 0.46437516491472697, 0.46524414459182895, 0.4662626910695353, 0.4674507950704796, 0.46882441017286475, 0.4703955927300186, 0.47217290764686176, 0.4741619985413167, 0.47636621606845597, 0.4787872063887347, 0.48142538078276503, 0.4842802138612839, 0.4873503476662284, 0.4906335081823175, 0.49412626588498476, 0.4978236903576061, 0.5017189592575052, 0.5058029837048388, 0.510064106293199, 0.5144879160131325, 0.5190572086249894, 0.5237521037952566, 0.5285503138499078, 0.5334275450947031 ], [ 0.4776953979404887, 0.4736185930169523, 0.47000601499894124, 0.46687638961846234, 0.4642372531871314, 0.46208419382520866, 0.4604006648552983, 0.4591584594533066, 0.4583188801808888, 0.4578345697460424, 0.4576519005787759, 0.4577137616107547, 0.4579625400639818, 0.4583430791746939, 0.4588054000827891, 0.45930700414626635, 0.4598146148303555, 0.460305269515377, 0.46076672515852174, 0.4611971931718811, 0.46160446500054897, 0.46200452863549746, 0.4624198062056176, 0.4628771626042142, 0.4634058436417844, 0.4640354985461523, 0.46479442544694455, 0.4657081505625452, 0.4667984143539627, 0.4680825945846052, 0.4695735518096264, 0.4712798425186597, 0.47320621371614996, 0.47535427358824883, 0.47772322764566527, 0.48031057787421433, 0.48311270168552156, 0.48612525428381553, 0.48934336830224356, 0.4927616541346734, 0.49637402982294615, 0.5001734281440212, 0.5041514393007381, 0.508297950123429, 0.512600835726942, 0.5170457487206617, 0.521616036414268, 0.5262928002426467, 0.5310550959474047, 0.5358802595987759 ], [ 0.4829029508760172, 0.47879587775680826, 0.4751171181389189, 0.4718857978292674, 0.4691106616540309, 0.46678930515353284, 0.46490794497538396, 0.46344181737300266, 0.4623562418916384, 0.4616083232426284, 0.461149198145214, 0.46092667597831666, 0.46088808117037466, 0.46098308654193826, 0.4611663312213765, 0.46139964145548557, 0.46165371240987674, 0.46190915783910874, 0.46215688667824734, 0.46239781667250573, 0.46264198187452393, 0.462907130916824, 0.463216944656702, 0.46359902352382126, 0.46408280519268896, 0.46469757084457664, 0.4654706827647952, 0.46642616802158854, 0.46758372472583665, 0.46895818270469203, 0.470559404381992, 0.47239256974765004, 0.4744587565227112, 0.4767557065937241, 0.4792786641090678, 0.48202117875296113, 0.4849757872141281, 0.48813451303699573, 0.4914891556223069, 0.4950313690078238, 0.4987525567600089, 0.5026436284053135, 0.5066946740329044, 0.5108946168375027, 0.5152308992395079, 0.5196892483509364, 0.5242535529261062, 0.5289058686625252, 0.5336265537752161, 0.5383945237635155 ], [ 0.4880335397913635, 0.48391005155700423, 0.48018099751766596, 0.4768656276894715, 0.4739735626370746, 0.47150403514540806, 0.4694456393347189, 0.4677766747218778, 0.46646612355011435, 0.4654752391436431, 0.46475965995419405, 0.4642719080565594, 0.46396409040513764, 0.46379060130917893, 0.4637106265732376, 0.46369027134263896, 0.46370417031642497, 0.4637364851328787, 0.4637812441264643, 0.4638420299471995, 0.463931067433719, 0.4640678051775041, 0.4642771173929364, 0.46458727614585116, 0.4650278559019236, 0.4656277312519369, 0.4664133138355593, 0.4674071464960779, 0.46862693381363635, 0.4700850423615578, 0.47178845659430607, 0.47373913298165254, 0.4759346610909752, 0.4783691195373684, 0.4810340087054852, 0.48391915027572213, 0.4870134633024614, 0.4903055540488098, 0.4937840876237805, 0.497437939540268, 0.5012561511997558, 0.5052277326468578, 0.5093413675121948, 0.5135850787592947, 0.5179459104756907, 0.5224096719837791, 0.5269607778762068, 0.5315822032029968, 0.5362555588133158, 0.5409612793026224 ], [ 0.4930866442561201, 0.48895999783906235, 0.4851958635128914, 0.4818133825215825, 0.4788227675791277, 0.4762245699151745, 0.4740094243782882, 0.47215835654994565, 0.4706436897414792, 0.46943053287255093, 0.4684787706597033, 0.4677454242070097, 0.46718721073159347, 0.4667631107436355, 0.4664367510250864, 0.4661784304991085, 0.465966649610493, 0.4657890472100688, 0.46564269728950886, 0.4655337670917234, 0.46547658484219867, 0.46549220700680194, 0.4656066093328098, 0.46584865081961857, 0.46624797311170196, 0.4668329978613281, 0.4676291704547309, 0.46865757060850305, 0.4699339709965304, 0.47146837836808053, 0.4732650430586754, 0.47532287838635656, 0.47763619660422263, 0.48019564670950066, 0.4829892331401112, 0.4860033025287097, 0.4892234055575633, 0.4926349686071764, 0.4962237408880067, 0.4999760129207583, 0.5038786282124105, 0.5079188294710916, 0.5120839925785793, 0.5163613057285177, 0.5207374484515112, 0.5251983171225691, 0.5297288317767432, 0.5343128455344437, 0.5389331644106523, 0.5435716731870444 ], [ 0.49806142567908596, 0.4939442040560461, 0.49015945776112657, 0.48672602699563955, 0.4836544791831267, 0.48094641313368464, 0.47859421345960246, 0.4765813344788093, 0.4748831497864209, 0.4734683505592019, 0.47230081982947897, 0.4713418595660586, 0.47055260958370815, 0.46989647680673785, 0.4693413918864531, 0.46886172636081486, 0.4684397341022115, 0.4680664213625531, 0.4677417958607241, 0.46747449314818484, 0.4672808246998312, 0.4671833341072258, 0.46720898294990404, 0.4673871139798515, 0.46774735382477955, 0.46831761850686754, 0.4691223715838023, 0.4701812570277857, 0.4715081893460991, 0.47311093612359373, 0.47499117879678715, 0.4771449922481772, 0.4795636483295635, 0.4822346266320738, 0.48514270936992915, 0.48827104537771326, 0.4916020881689081, 0.49511834072393496, 0.49880287069463924, 0.5026395898686423, 0.5066133177084389, 0.510709668350296, 0.5149148125539548, 0.5192151707134037, 0.5235970909819126, 0.5280465592220067, 0.5325489765737065, 0.5370890277273903, 0.5416506501409226, 0.5462171028091432 ], [ 0.5029567504624147, 0.4988608037985361, 0.49506911361364647, 0.4916000647344068, 0.4884643844102073, 0.485664492143752, 0.4831942733089647, 0.4810393503034923, 0.4791778848549828, 0.47758189572567483, 0.4762190240663369, 0.4750546314256716, 0.47405407947084044, 0.4731850202751834, 0.47241952332269915, 0.47173587930240923, 0.47111994852476813, 0.4705659595765174, 0.47007670764399273, 0.4696631481231758, 0.4693434265472267, 0.46914142773310713, 0.4690849627623487, 0.469203739338243, 0.4695272766180293, 0.47008292760030024, 0.47089415929232586, 0.4719792134826244, 0.47335023127934184, 0.4750128769289214, 0.47696644658926385, 0.47920440202776554, 0.48171523334335553, 0.4844835327697753, 0.48749115504620727, 0.4907183479304677, 0.49414475634385474, 0.49775023128178086, 0.5015154055124152, 0.5054220280849555, 0.5094530755186707, 0.5135926771022779, 0.5178259040027685, 0.5221384768766001, 0.5265164451987308, 0.5309458849188997, 0.535412650948687, 0.5399022090637144, 0.5443995596264047, 0.5488892543746497 ], [ 0.5077712256755627, 0.5037076298406714, 0.49992182579666955, 0.4964316233777156, 0.4932477533473186, 0.49037326868541387, 0.48780334435472006, 0.48552554335033593, 0.4835205795256827, 0.48176356197478276, 0.4802256575864296, 0.47887606439475733, 0.477684154476448, 0.4766216255355102, 0.4756644967526643, 0.4747947964253082, 0.474001814087893, 0.4732828248912488, 0.4726432354658583, 0.4720961449184617, 0.4716613589727473, 0.47136393676676464, 0.47123238571736004, 0.4712966473443861, 0.4715860332345408, 0.4721272730363831, 0.47294282411948035, 0.47404956552171634, 0.47545795931724716, 0.47717171488906945, 0.47918794164347583, 0.48149772986293243, 0.48408706340541985, 0.4869379458323482, 0.4900296149041903, 0.49333972837284046, 0.49684542375058866, 0.5005241821403393, 0.5043544568020009, 0.508316056825707, 0.5123903018945097, 0.5165599835804543, 0.5208091809885952, 0.525122983882981, 0.5294871754884892, 0.5338879212540023, 0.5383115005343175, 0.5427441069924863, 0.5471717320032594, 0.5515801346580413 ], [ 0.5125032430670876, 0.5084822736225647, 0.504714324523871, 0.5012165421785895, 0.49799953890903165, 0.4950668491464191, 0.49241475981198046, 0.4900325765440733, 0.48790335281631375, 0.4860050668163226, 0.48431218654021596, 0.48279752283085065, 0.48143423841057204, 0.48019786216023225, 0.4790681537528088, 0.47803067400177485, 0.4770779390734982, 0.4762100692274727, 0.4754348818297024, 0.4747674209291389, 0.4742289587810909, 0.47384554554710684, 0.4736462191611524, 0.4736610150758299, 0.4739189323584721, 0.4744460158809149, 0.47526370264404466, 0.4763875537605251, 0.47782645453423017, 0.47958231775489696, 0.4816502756464065, 0.4840193002809805, 0.4866731564394907, 0.4895915688477883, 0.49275147904086913, 0.4961282749274832, 0.4996968955729362, 0.5034327407060512, 0.5073123445736561, 0.5113138030073903, 0.5154169678257365, 0.519603441975095, 0.5238564212272767, 0.5281604338529228, 0.5325010292517846, 0.536864461277969, 0.5412374034199887, 0.5456067225830882, 0.5499593273505091, 0.5542820964080981 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
hartmann6: -0.00564496 (SEM: 0)
x1: 0.991195
x2: 0.696153
x3: 0.0544616
x4: 0.525896
x5: 0.895495
x6: 0.122259", "Arm 1_0
hartmann6: -0.023781 (SEM: 0)
x1: 0.835657
x2: 0.654382
x3: 0.747797
x4: 0.667518
x5: 0.685586
x6: 0.766227", "Arm 2_0
hartmann6: -0.544777 (SEM: 0)
x1: 0.886116
x2: 0.397046
x3: 0.581595
x4: 0.169549
x5: 0.117816
x6: 0.90553", "Arm 3_0
hartmann6: -0.202081 (SEM: 0)
x1: 0.110969
x2: 0.644237
x3: 0.142957
x4: 0.610617
x5: 0.213155
x6: 0.92319", "Arm 4_0
hartmann6: -0.0117684 (SEM: 0)
x1: 0.455642
x2: 0.893072
x3: 0.194919
x4: 0.703352
x5: 0.0362887
x6: 0.910101", "Arm 5_0
hartmann6: -0.00265169 (SEM: 0)
x1: 0.752016
x2: 0.0257296
x3: 0.716384
x4: 0.959104
x5: 0.703394
x6: 0.611876", "Arm 6_0
hartmann6: -0.0711372 (SEM: 0)
x1: 0.171156
x2: 0.991659
x3: 0.145412
x4: 0.915102
x5: 0.340763
x6: 0.378882", "Arm 7_0
hartmann6: -0.000262885 (SEM: 0)
x1: 0.757071
x2: 0.279597
x3: 0.109823
x4: 0.594536
x5: 0.954943
x6: 0.932046", "Arm 8_0
hartmann6: -0.114704 (SEM: 0)
x1: 0.545973
x2: 0.957812
x3: 0.717702
x4: 0.39488
x5: 0.141303
x6: 0.855471", "Arm 9_0
hartmann6: -0.409662 (SEM: 0)
x1: 0.577164
x2: 0.873977
x3: 0.840855
x4: 0.604265
x5: 0.983467
x6: 0.361855", "Arm 10_0
hartmann6: -0.00478964 (SEM: 0)
x1: 0.719934
x2: 0.158722
x3: 0.0640648
x4: 0.874327
x5: 0.640713
x6: 0.47211", "Arm 11_0
hartmann6: -0.730603 (SEM: 0)
x1: 0.619846
x2: 0.797084
x3: 0.85879
x4: 0.732571
x5: 0.379869
x6: 0.203436", "Arm 12_0
hartmann6: -0.694722 (SEM: 0)
x1: 1.67725e-17
x2: 0.359867
x3: 0.134847
x4: 0.485981
x5: 0.208769
x6: 0.918502", "Arm 13_0
hartmann6: -0.866244 (SEM: 0)
x1: 1.76327e-16
x2: 0.250039
x3: 0.137932
x4: 0.43853
x5: 0.194655
x6: 0.923408", "Arm 14_0
hartmann6: -0.893259 (SEM: 0)
x1: 0
x2: 0.144176
x3: 0.152986
x4: 0.352474
x5: 0.158112
x6: 0.934129", "Arm 15_0
hartmann6: -0.819815 (SEM: 0)
x1: 4.05827e-16
x2: 0.0850404
x3: 0.0967067
x4: 0.466104
x5: 0.214999
x6: 0.929151", "Arm 16_0
hartmann6: -1.52236 (SEM: 0)
x1: 0
x2: 0.170764
x3: 0.237467
x4: 0.371316
x5: 0.224173
x6: 0.867484", "Arm 17_0
hartmann6: -1.82946 (SEM: 0)
x1: 0
x2: 0.112163
x3: 0.275695
x4: 0.34454
x5: 0.243084
x6: 0.840935", "Arm 18_0
hartmann6: -2.13919 (SEM: 0)
x1: 7.33317e-10
x2: 0.0580523
x3: 0.322384
x4: 0.320043
x5: 0.270554
x6: 0.806368", "Arm 19_0
hartmann6: -2.40911 (SEM: 0)
x1: 8.12925e-18
x2: 0.0199359
x3: 0.383543
x4: 0.299243
x5: 0.309485
x6: 0.760721", "Arm 20_0
hartmann6: -2.58581 (SEM: 0)
x1: 1.38813e-16
x2: 0.0318909
x3: 0.453241
x4: 0.286296
x5: 0.346609
x6: 0.712598", "Arm 21_0
hartmann6: -2.70347 (SEM: 0)
x1: 3.85551e-16
x2: 0.0648594
x3: 0.540874
x4: 0.30781
x5: 0.306598
x6: 0.652317", "Arm 22_0
hartmann6: -2.31502 (SEM: 0)
x1: 3.59951e-17
x2: 0.0343595
x3: 0.632869
x4: 0.34134
x5: 0.318397
x6: 0.725043", "Arm 23_0
hartmann6: -2.66756 (SEM: 0)
x1: 8.08344e-17
x2: 0.0822369
x3: 0.46578
x4: 0.283365
x5: 0.289837
x6: 0.586879" ], "type": "scatter", "x": [ 0.9911952018737793, 0.8356570182368159, 0.8861156608909369, 0.11096904519945383, 0.45564178470522165, 0.7520163990557194, 0.17115615028887987, 0.7570707192644477, 0.5459734154865146, 0.5771640036255121, 0.7199341291561723, 0.6198462834581733, 1.6772481594938277e-17, 1.7632722968858015e-16, 0.0, 4.0582738784702687e-16, 0.0, 0.0, 7.333171606617148e-10, 8.129245036965176e-18, 1.388125246212118e-16, 3.855507832274641e-16, 3.599505365983038e-17, 8.083437368258469e-17 ], "xaxis": "x", "y": [ 0.6961528658866882, 0.654381649568677, 0.3970457296818495, 0.644237007945776, 0.8930717082694173, 0.025729618966579437, 0.9916594577953219, 0.2795970821753144, 0.9578120745718479, 0.8739767307415605, 0.15872156899422407, 0.7970844069495797, 0.3598671860448771, 0.25003902129640826, 0.14417563063530092, 0.0850403563930537, 0.17076396733095991, 0.11216324860230645, 0.05805234252385064, 0.019935891139020764, 0.03189093172260944, 0.06485938559054745, 0.03435951151483752, 0.08223693079205716 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
hartmann6: -0.00564496 (SEM: 0)
x1: 0.991195
x2: 0.696153
x3: 0.0544616
x4: 0.525896
x5: 0.895495
x6: 0.122259", "Arm 1_0
hartmann6: -0.023781 (SEM: 0)
x1: 0.835657
x2: 0.654382
x3: 0.747797
x4: 0.667518
x5: 0.685586
x6: 0.766227", "Arm 2_0
hartmann6: -0.544777 (SEM: 0)
x1: 0.886116
x2: 0.397046
x3: 0.581595
x4: 0.169549
x5: 0.117816
x6: 0.90553", "Arm 3_0
hartmann6: -0.202081 (SEM: 0)
x1: 0.110969
x2: 0.644237
x3: 0.142957
x4: 0.610617
x5: 0.213155
x6: 0.92319", "Arm 4_0
hartmann6: -0.0117684 (SEM: 0)
x1: 0.455642
x2: 0.893072
x3: 0.194919
x4: 0.703352
x5: 0.0362887
x6: 0.910101", "Arm 5_0
hartmann6: -0.00265169 (SEM: 0)
x1: 0.752016
x2: 0.0257296
x3: 0.716384
x4: 0.959104
x5: 0.703394
x6: 0.611876", "Arm 6_0
hartmann6: -0.0711372 (SEM: 0)
x1: 0.171156
x2: 0.991659
x3: 0.145412
x4: 0.915102
x5: 0.340763
x6: 0.378882", "Arm 7_0
hartmann6: -0.000262885 (SEM: 0)
x1: 0.757071
x2: 0.279597
x3: 0.109823
x4: 0.594536
x5: 0.954943
x6: 0.932046", "Arm 8_0
hartmann6: -0.114704 (SEM: 0)
x1: 0.545973
x2: 0.957812
x3: 0.717702
x4: 0.39488
x5: 0.141303
x6: 0.855471", "Arm 9_0
hartmann6: -0.409662 (SEM: 0)
x1: 0.577164
x2: 0.873977
x3: 0.840855
x4: 0.604265
x5: 0.983467
x6: 0.361855", "Arm 10_0
hartmann6: -0.00478964 (SEM: 0)
x1: 0.719934
x2: 0.158722
x3: 0.0640648
x4: 0.874327
x5: 0.640713
x6: 0.47211", "Arm 11_0
hartmann6: -0.730603 (SEM: 0)
x1: 0.619846
x2: 0.797084
x3: 0.85879
x4: 0.732571
x5: 0.379869
x6: 0.203436", "Arm 12_0
hartmann6: -0.694722 (SEM: 0)
x1: 1.67725e-17
x2: 0.359867
x3: 0.134847
x4: 0.485981
x5: 0.208769
x6: 0.918502", "Arm 13_0
hartmann6: -0.866244 (SEM: 0)
x1: 1.76327e-16
x2: 0.250039
x3: 0.137932
x4: 0.43853
x5: 0.194655
x6: 0.923408", "Arm 14_0
hartmann6: -0.893259 (SEM: 0)
x1: 0
x2: 0.144176
x3: 0.152986
x4: 0.352474
x5: 0.158112
x6: 0.934129", "Arm 15_0
hartmann6: -0.819815 (SEM: 0)
x1: 4.05827e-16
x2: 0.0850404
x3: 0.0967067
x4: 0.466104
x5: 0.214999
x6: 0.929151", "Arm 16_0
hartmann6: -1.52236 (SEM: 0)
x1: 0
x2: 0.170764
x3: 0.237467
x4: 0.371316
x5: 0.224173
x6: 0.867484", "Arm 17_0
hartmann6: -1.82946 (SEM: 0)
x1: 0
x2: 0.112163
x3: 0.275695
x4: 0.34454
x5: 0.243084
x6: 0.840935", "Arm 18_0
hartmann6: -2.13919 (SEM: 0)
x1: 7.33317e-10
x2: 0.0580523
x3: 0.322384
x4: 0.320043
x5: 0.270554
x6: 0.806368", "Arm 19_0
hartmann6: -2.40911 (SEM: 0)
x1: 8.12925e-18
x2: 0.0199359
x3: 0.383543
x4: 0.299243
x5: 0.309485
x6: 0.760721", "Arm 20_0
hartmann6: -2.58581 (SEM: 0)
x1: 1.38813e-16
x2: 0.0318909
x3: 0.453241
x4: 0.286296
x5: 0.346609
x6: 0.712598", "Arm 21_0
hartmann6: -2.70347 (SEM: 0)
x1: 3.85551e-16
x2: 0.0648594
x3: 0.540874
x4: 0.30781
x5: 0.306598
x6: 0.652317", "Arm 22_0
hartmann6: -2.31502 (SEM: 0)
x1: 3.59951e-17
x2: 0.0343595
x3: 0.632869
x4: 0.34134
x5: 0.318397
x6: 0.725043", "Arm 23_0
hartmann6: -2.66756 (SEM: 0)
x1: 8.08344e-17
x2: 0.0822369
x3: 0.46578
x4: 0.283365
x5: 0.289837
x6: 0.586879" ], "type": "scatter", "x": [ 0.9911952018737793, 0.8356570182368159, 0.8861156608909369, 0.11096904519945383, 0.45564178470522165, 0.7520163990557194, 0.17115615028887987, 0.7570707192644477, 0.5459734154865146, 0.5771640036255121, 0.7199341291561723, 0.6198462834581733, 1.6772481594938277e-17, 1.7632722968858015e-16, 0.0, 4.0582738784702687e-16, 0.0, 0.0, 7.333171606617148e-10, 8.129245036965176e-18, 1.388125246212118e-16, 3.855507832274641e-16, 3.599505365983038e-17, 8.083437368258469e-17 ], "xaxis": "x2", "y": [ 0.6961528658866882, 0.654381649568677, 0.3970457296818495, 0.644237007945776, 0.8930717082694173, 0.025729618966579437, 0.9916594577953219, 0.2795970821753144, 0.9578120745718479, 0.8739767307415605, 0.15872156899422407, 0.7970844069495797, 0.3598671860448771, 0.25003902129640826, 0.14417563063530092, 0.0850403563930537, 0.17076396733095991, 0.11216324860230645, 0.05805234252385064, 0.019935891139020764, 0.03189093172260944, 0.06485938559054745, 0.03435951151483752, 0.08223693079205716 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "hartmann6" }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x2" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot())" ] }, { "cell_type": "markdown", "id": "ab7b29ff", "metadata": { "papermill": { "duration": 0.05739, "end_time": "2023-12-09T18:35:54.892649", "exception": false, "start_time": "2023-12-09T18:35:54.835259", "status": "completed" }, "tags": [] }, "source": [ "We can also retrieve a contour plot for the other metric, \"l2norm\" –– say, we are interested in seeing the response surface for parameters \"x3\" and \"x4\" for this one." ] }, { "cell_type": "code", "execution_count": 12, "id": "87d54218", "metadata": { "execution": { "iopub.execute_input": "2023-12-09T18:35:55.008210Z", "iopub.status.busy": "2023-12-09T18:35:55.007881Z", "iopub.status.idle": "2023-12-09T18:35:55.617638Z", "shell.execute_reply": "2023-12-09T18:35:55.616943Z" }, "papermill": { "duration": 0.672609, "end_time": "2023-12-09T18:35:55.622259", "exception": false, "start_time": "2023-12-09T18:35:54.949650", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:35:55] ax.service.ax_client: Retrieving contour plot with parameter 'x3' on X-axis and 'x4' on Y-axis, for metric 'l2norm'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ 1.1285492338107306, 1.126648201337634, 1.125071849055461, 1.1238330884232837, 1.122943976585587, 1.1224155906884874, 1.1222579016440992, 1.1224796489554414, 1.1230882184109363, 1.1240895246430667, 1.1254879007102785, 1.1272859969943076, 1.1294846917938324, 1.1320830160268758, 1.135078094414985, 1.1384651053997616, 1.1422372618265242, 1.146385814114281, 1.1509000772148759, 1.1557674821520214, 1.160973652336035, 1.1665025041926393, 1.1723363709518573, 1.1784561477494904, 1.1848414555356876, 1.1914708207008515, 1.1983218668534044, 1.2053715148459931, 1.2125961869666844, 1.2199720111987065, 1.227475021603786, 1.2350813511858438, 1.2427674140197695, 1.25051007395301, 1.2582867977705157, 1.2660757913200162, 1.273856117691551, 1.2816077971033606, 1.2893118886440686, 1.296950554443202, 1.304507107181002, 1.3119660421028752, 1.3193130548776424, 1.3265350467399868, 1.333620118396345, 1.340557554161592, 1.3473377977425465, 1.353952421004808, 1.3603940869607516, 1.3666565081073936 ], [ 1.1266834491799425, 1.124803695353873, 1.1232544112868823, 1.1220487848232161, 1.121199131566215, 1.1207167646803828, 1.120611863891084, 1.120893345351019, 1.1215687342562504, 1.1226440422982313, 1.1241236522221805, 1.1260102119143887, 1.1283045405479288, 1.1310055493630242, 1.1341101796297652, 1.1376133602226475, 1.141507987016213, 1.1457849259810216, 1.1504330414166144, 1.1554392502080568, 1.160788602348322, 1.1664643872525187, 1.172448264632432, 1.178720417938823, 1.1852597276563726, 1.1920439610952744, 1.1990499748041903, 1.2062539253649078, 1.213631484142134, 1.2211580515626954, 1.228808966682652, 1.2365597081519548, 1.24438608317516, 1.2522644016575342, 1.2601716333772368, 1.2680855466956331, 1.2759848279710948, 1.2838491814453983, 1.2916594099024312, 1.2993974768409267, 1.3070465512498324, 1.3145910363269022, 1.3220165836443318, 1.3293100943502523, 1.336459709013771, 1.3434547876879295, 1.3502858816923238, 1.3569446985173261, 1.3634240611353292, 1.3697178628795204 ], [ 1.1252150242524497, 1.12336354625576, 1.121848038219033, 1.1206819376612545, 1.1198777922693905, 1.1194471253671847, 1.1194003003326092, 1.119746385687012, 1.120493022809374, 1.1216462984511895, 1.1232106244309579, 1.1251886270593683, 1.1275810489720746, 1.130386666110253, 1.133602222572539, 1.137222385949153, 1.1412397255257027, 1.1456447154000435, 1.1504257640870499, 1.15556927159735, 1.1610597142808725, 1.1668797569486187, 1.1730103909604355, 1.179431096134725, 1.186120023545853, 1.193054195574795, 1.2002097190143353, 1.2075620066391275, 1.2150860024587962, 1.2227564058897051, 1.2305478903027514, 1.2384353118098146, 1.246393904707121, 1.25439946065703, 1.2624284894141256, 1.2704583596402204, 1.2784674190639942, 1.2864350938898237, 1.2943419679220725, 1.3021698423302515, 1.309901777331823, 1.317522117315286, 1.3250165010752681, 1.332371858896627, 1.3395763982209279, 1.346619579571779, 1.353492084320095, 1.360185775749711, 1.3666936547488935, 1.3730098113130786 ], [ 1.1241577755350538, 1.1223418667306655, 1.1208671141267723, 1.1197471749575656, 1.1189947993337537, 1.1186216915977603, 1.1186383703854588, 1.1190540291683417, 1.1198763992968246, 1.1211116178056697, 1.1227641024656654, 1.1248364367578456, 1.1273292675919417, 1.1302412186712247, 1.1335688224023068, 1.1373064731423248, 1.1414464043501806, 1.1459786918513275, 1.1508912849313166, 1.156170066345384, 1.161798941584311, 1.167759956896444, 1.174033444669646, 1.180598193871956, 1.1874316423892337, 1.1945100873369188, 1.2018089088128845, 1.2093028021411891, 1.2169660134610667, 1.2247725735530126, 1.2326965250571364, 1.2407121387037474, 1.2487941148030657, 1.2569177669815164, 1.2650591859523443, 1.273195381916542, 1.281304404959114, 1.2893654434985287, 1.2973589014373912, 1.3052664551354072, 1.3130710916776038, 1.3207571301465837, 1.3283102277389007, 1.3357173726080964, 1.342966865288305, 1.3500482904701947, 1.3569524807818896, 1.3636714740855098, 1.3701984656471016, 1.3765277563825418 ], [ 1.123523864234384, 1.1217510741555428, 1.120324288593678, 1.1192573513548203, 1.11856318208904, 1.1182536337905133, 1.1183393487745557, 1.1188296149533574, 1.1197322244946777, 1.1210533372058622, 1.122797351227974, 1.1249667838370114, 1.1275621653142864, 1.1305819489460616, 1.1340224402227401, 1.1378777482089326, 1.1421397618286802, 1.1467981534404648, 1.1518404115569774, 1.1572519038977886, 1.1630159711635617, 1.169114051016222, 1.1755258307815428, 1.1822294264107596, 1.1892015843056858, 1.1964179017887377, 1.2038530613431162, 1.2114810733062698, 1.2192755215032194, 1.2272098063673913, 1.2352573804057803, 1.2433919713940518, 1.2515877893899523, 1.2598197144744017, 1.2680634630085588, 1.2762957310732856, 1.2844943145838645, 1.2926382063073305, 1.3007076706252625, 1.3086842973678083, 1.316551036393062, 1.3242922148076715, 1.3318935388345272, 1.3393420823503017, 1.346626264059881, 1.3537358151661634, 1.3606617392502527, 1.367396265914069, 1.373932799566685, 1.380265864566808 ], [ 1.1233236131958713, 1.1216017006336187, 1.1202302798219896, 1.1192233449324689, 1.1185939491645227, 1.118354058687278, 1.1185144048472557, 1.119084336508505, 1.1200716746691324, 1.1214825717733599, 1.1233213783991922, 1.1255905202336227, 1.1282903884315811, 1.1314192465705855, 1.1349731574369948, 1.1389459327886762, 1.143329109010967, 1.1481119512014273, 1.1532814876745534, 1.158822576172219, 1.1647180022138974, 1.170948609052475, 1.1774934576613196, 1.184330014123245, 1.191434360787866, 1.1987814266792394, 1.2063452319344048, 1.2140991405882267, 1.2220161158251164, 1.230068971906211, 1.23823061733973, 1.2464742844586691, 1.2547737413519977, 1.2631034829993297, 1.2714388994173167, 1.2797564195737425, 1.2880336307069518, 1.2962493734613758, 1.3043838138866968, 1.3124184938367192, 1.3203363616444401, 1.3281217851537952, 1.335760549273943, 1.3432398402110182, 1.3505482184479978, 1.3576755824077005, 1.364613124566243, 1.371353281600661, 1.377889679967169, 1.3842170781247114 ], [ 1.1235653349349164, 1.1219022143371014, 1.1205936894659656, 1.11965386576834, 1.1190958910785738, 1.1189318063361546, 1.1191723943829983, 1.1198270287484762, 1.120903524621905, 1.1224079945033463, 1.1243447113020453, 1.1267159819022647, 1.1295220344190327, 1.1327609224991244, 1.1364284500600712, 1.1405181197766368, 1.1450211083958333, 1.1499262715688956, 1.1552201803204238, 1.1608871905317695, 1.16690954591272, 1.1732675139042055, 1.1799395528433574, 1.1869025075929318, 1.19413182976247, 1.2016018177037906, 1.2092858707192988, 1.2171567514358825, 1.2251868501072314, 1.2333484447257652, 1.2416139512376874, 1.2499561588218557, 1.2583484460560972, 1.2667649747822218, 1.2751808595178151, 1.2835723112782698, 1.2919167556061837, 1.300192925412785, 1.3083809298896567, 1.3164623012384729, 1.3244200212948851, 1.332238530305219, 1.3399037201729864, 1.3474029144515978, 1.3547248372461302, 1.361859573024246, 1.3687985191450716, 1.3755343327117169, 1.3820608731506179, 1.388373141727695 ], [ 1.1242551748973324, 1.1226588565088742, 1.1214208335595928, 1.1205552810372366, 1.1200753998173818, 1.119993264527486, 1.1203196693347308, 1.12106397360461, 1.1222339496817186, 1.1238356353498848, 1.1258731938234798, 1.128348784389177, 1.131262447037527, 1.1346120045721793, 1.138392985734842, 1.1425985728079466, 1.1472195769279565, 1.1522444439388755, 1.1576592930241143, 1.1634479895754275, 1.1695922528049278, 1.1760717975138664, 1.1828645082514855, 1.189946642896531, 1.1972930615515367, 1.2048774756384013, 1.2126727113002806, 1.2206509807119719, 1.228784154719474, 1.2370440303812285, 1.2454025874515373, 1.2538322285860075, 1.2623059989932608, 1.2707977823272514, 1.279282470727796, 1.287736107996043, 1.2961360058729436, 1.3044608342256179, 1.31269068661206, 1.3208071231801843, 1.3287931931698536, 1.336633439444623, 1.3443138875091878, 1.3518220213974927, 1.3591467486734636, 1.36627835659726, 1.37320846129623, 1.3799299515586831, 1.386436928652402, 1.3927246433670988 ], [ 1.125396974137799, 1.1238754985401682, 1.122715594186297, 1.121931461525987, 1.121536310513286, 1.121542206021965, 1.121959911065039, 1.1227987298014863, 1.124066352629352, 1.1257687059829988, 1.1279098097613633, 1.1304916455967713, 1.133514039409151, 1.1369745618531597, 1.1408684503270161, 1.145188556141948, 1.1499253202210624, 1.1550667802822103, 1.1605986118460956, 1.1665042045965173, 1.1727647746200545, 1.17935951190231, 1.1862657612125753, 1.1934592332409306, 1.200914241646469, 1.2086039606217556, 1.2165006967604195, 1.22457616849939, 1.2328017862376963, 1.2411489264217332, 1.2495891934119707, 1.2580946637574961, 1.2666381085288907, 1.275193190509626, 1.2837346342311446, 1.29223836797478, 1.3006816378865333, 1.3090430952114198, 1.317302858326096, 1.325442551725822, 1.333445324415274, 1.3412958502840724, 1.3489803130471645, 1.3564863782285135, 1.3638031544951126, 1.37092114643417, 1.377832200632099, 1.3845294466767526, 1.3910072344766071, 1.3972610690799467 ], [ 1.1269921555160114, 1.1255535234543617, 1.1244792964535752, 1.123783654361246, 1.1234797702513308, 1.1235796538284735, 1.1240939925578284, 1.125031992537349, 1.1264012214552819, 1.128207456305411, 1.1304545388538823, 1.133144242147023, 1.136276151597772, 1.1398475643626513, 1.1438534107916158, 1.1482862016676272, 1.1531360047206876, 1.1583904534759744, 1.1640347908612574, 1.1700519491519508, 1.176422666788838, 1.1831256414002858, 1.1901377170561385, 1.197434102451885, 1.2049886154603096, 1.2127739483889104, 1.220761947434623, 1.2289238993045766, 1.237230817817603, 1.245653723527473, 1.2541639099907391, 1.2627331911837798, 1.2713341256735649, 1.279940214370523, 1.2885260699424057, 1.2970675571576735, 1.3055419044847705, 1.3139277881517397, 1.3222053905437658, 1.3303564352815407, 1.3383642015945858, 1.3462135207074615, 1.3538907569255836, 1.3613837759762195, 1.3686819029618404, 1.3757758720459434, 1.38265776973885, 1.3893209734002339, 1.3957600863376827, 1.4019708706641973 ], [ 1.129039637263688, 1.1276917358709941, 1.1267106150689337, 1.1261103864683866, 1.1259041387419646, 1.1261037794844637, 1.126719874766012, 1.1277614884262341, 1.1292360234916734, 1.1311490684375818, 1.1335042513462228, 1.1363031053196928, 1.139544948763306, 1.143226784338815, 1.1473432204633385, 1.1518864191668015, 1.1568460738848554, 1.162209420328256, 1.167961282914906, 1.1740841583742223, 1.180558337050789, 1.1873620611838405, 1.1944717180824997, 1.2018620647357217, 1.209506479086926, 1.2173772320676832, 1.225445773616855, 1.2336830253871252, 1.2420596727062112, 1.2505464486253144, 1.2591144035249462, 1.2677351546958127, 1.2763811114823955, 1.285025672867071, 1.2936433956804, 1.3022101328560634, 1.3107031422339182, 1.319101167303534, 1.3273844919498115, 1.3355349717119853, 1.343536044314882, 1.351372722306924, 1.3590315705790192, 1.3665006713795194, 1.373769579217555, 1.3808292677898035, 1.3876720707975683, 1.3942916182590541, 1.4006827696771154, 1.406841545202269 ], [ 1.1315357773616024, 1.1302863040874764, 1.1294055143526678, 1.1289074027930586, 1.1288049250833097, 1.1291098387476333, 1.1298325416798256, 1.1309819104498466, 1.132565140814417, 1.134587593194801, 1.1370526462230612, 1.1399615617710328, 1.1433133651409713, 1.1471047442853437, 1.151329972003044, 1.1559808549956556, 1.1610467134263804, 1.1665143941764293, 1.1723683203201787, 1.1785905784369042, 1.1851610442602325, 1.192057545876011, 1.1992560622796413, 1.2067309536805928, 1.2144552185960147, 1.222400771612785, 1.2305387348169055, 1.238839735369232, 1.2472742015944978, 1.2558126502549383, 1.2644259583697197, 1.2730856139486222, 1.2817639412399089, 1.2904342974391587, 1.2990712391606127, 1.3076506582389933, 1.3161498875335047, 1.3245477782985802, 1.3328247513468383, 1.3409628246610001, 1.3489456203348658, 1.3567583537717927, 1.364387807981403, 1.3718222956315989, 1.3790516112684947, 1.3860669758428732, 1.3928609754009085, 1.3994274955264796, 1.4057616528728891, 1.4118597248990845 ], [ 1.1344743515821076, 1.1333307372965702, 1.132557224865728, 1.1321676426193215, 1.1321747640959576, 1.1325901483217276, 1.1334239778667838, 1.1346848967835257, 1.1363798508746226, 1.1385139330891458, 1.141090237187456, 1.1441097231321153, 1.147571097929856, 1.151470715839629, 1.1558025019410365, 1.160557902990317, 1.1657258692425436, 1.1712928704586987, 1.1772429486251235, 1.183557808986296, 1.1902169498470827, 1.197197830278701, 1.2044760734302973, 1.21202570169427, 1.21981939860263, 1.2278287911538162, 1.2360247453856734, 1.2443776675014921, 1.25285780276929, 1.2614355247569338, 1.2700816082025759, 1.2787674798788948, 1.287465443091727, 1.2961488728456234, 1.304792380098778, 1.313371944819109, 1.321865018666856, 1.3302505990195006, 1.338509276703144, 1.3466232602059607, 1.3545763793486987, 1.3623540714100675, 1.3699433525932418, 1.3773327775144224, 1.3845123891325817, 1.3914736612520355, 1.3982094354394266, 1.4047138539205675, 1.4109822897703763, 1.4170112754859687 ], [ 1.1378465673068479, 1.1368159001641551, 1.1361562589865741, 1.1358812564204483, 1.1360034347591244, 1.1365341062262428, 1.1374831911594396, 1.1388590562215908, 1.1406683551137835, 1.1429158746159367, 1.1456043891245284, 1.1487345271737621, 1.152304653693242, 1.1563107719427124, 1.1607464491392787, 1.1656027697185063, 1.1708683199126604, 1.1765292068565882, 1.182569114724395, 1.1889693994546944, 1.1957092224560337, 1.2027657223402264, 1.2101142222780559, 1.2177284691004333, 1.2255808988858876, 1.2336429225939503, 1.2418852244272358, 1.2502780651135295, 1.2587915822399591, 1.2673960801493074, 1.276062302685741, 1.2847616831777633, 1.2934665673664885, 1.302150406411051, 1.3107879185150852, 1.3193552190191171, 1.327829919918243, 1.3361912006463645, 1.344419852600754, 1.3524983002717472, 1.3604106020190274, 1.3681424335365922, 1.3756810569165239, 1.3830152779992386, 1.3901353944229464, 1.3970331364879107, 1.4037016026552969, 1.4101351912211602, 1.416329529453539, 1.4222814012583715 ], [ 1.1416411143395337, 1.1407300660439645, 1.1401904667623, 1.1400356646058856, 1.140277922137521, 1.1409282572107715, 1.1419962818863005, 1.1434900415727889, 1.1454158568869872, 1.14777817107852, 1.1505794062064907, 1.1538198315683859, 1.1574974481434102, 1.1616078929933178, 1.1661443676300334, 1.171097594275338, 1.1764558036677857, 1.1822047575861092, 1.1883278085369078, 1.194805998094543, 1.2016181942014046, 1.208741266381126, 1.2161502963555797, 1.2238188200817084, 1.2317190958443924, 1.2398223918698903, 1.2480992860642224, 1.2565199700129033, 1.2650545493478855, 1.2736733329973784, 1.2823471046436896, 1.2910473708443715, 1.2997465816168166, 1.3084183207272317, 1.3170374643457095, 1.3255803080301216, 1.3340246631081552, 1.342349924394759, 1.350537111796485, 1.35856888872496, 1.3664295603982166, 1.3741050550906593, 1.381582891244679, 1.3888521331222616, 1.3959033373910446, 1.4027284927368757, 1.4093209542964271, 1.415675374424052, 1.4217876310556843, 1.427654754713011 ], [ 1.1458442529284967, 1.1450590090358643, 1.1446451322212847, 1.1446156583195, 1.1449825229072035, 1.1457564032586367, 1.1469465586085137, 1.1485606708862237, 1.1506046884303154, 1.1530826755397792, 1.1559966710547716, 1.1593465594657326, 1.1631299583024852, 1.1673421257248784, 1.171975892290564, 1.1770216207779673, 1.1824671976587326, 1.1882980593146955, 1.1944972553611148, 1.2010455504687616, 1.2079215648921748, 1.2151019525548186, 1.2225616140851112, 1.2302739407329937, 1.2382110837339235, 1.2463442425374225, 1.2546439644836371, 1.2630804480720919, 1.2716238419652999, 1.2802445323067655, 1.2889134117652188, 1.2976021248639513, 1.3062832855086999, 1.3149306640703518, 1.3235193427945757, 1.3320258395998417, 1.3404282014160875, 1.3487060690652213, 1.3568407162789495, 1.3648150658012201, 1.372613685661713, 1.3802227686749382, 1.3876300980608147, 1.3948250018407544, 1.4017982983751687, 1.4085422351045844, 1.41505042225867, 1.4213177630203964, 1.4273403813843084, 1.4331155487319345 ], [ 1.1504399381319068, 1.1497861339443385, 1.1495031091145849, 1.1496035411520868, 1.1500989932228038, 1.1509997577842594, 1.1523146988098882, 1.1540510947785663, 1.1562144849459812, 1.1588085217556459, 1.1618348325751064, 1.1652928942383265, 1.1691799241150218, 1.1734907915828225, 1.1782179538162723, 1.1833514196929475, 1.1888787453178888, 1.194785064155452, 1.2010531540152927, 1.20766354216638, 1.214594648670491, 1.2218229666804827, 1.2293232770095721, 1.237068892838796, 1.2450319290973981, 1.2531835899355828, 1.2614944669103487, 1.2699348400991057, 1.2784749743825279, 1.2870854035963581, 1.2957371960967896, 1.304402196434723, 1.3130532391833754, 1.3216643323937751, 1.3302108095497465, 1.3386694501612548, 1.34701857020212, 1.3552380844240068, 1.363309543152348, 1.3712161465040207, 1.3789427390924913, 1.3864757882447516, 1.3938033485902468, 1.4009150156378292, 1.4078018706692952, 1.4144564189766267, 1.4208725231761312, 1.4270453330599726, 1.4329712132021328, 1.4386476693245465 ], [ 1.1554099785476024, 1.1548926420160897, 1.154744993807642, 1.1549793093169693, 1.1556067362861142, 1.156637140678138, 1.1580789514707168, 1.1599390065521942, 1.162222402236795, 1.164932349247755, 1.1680700383333122, 1.1716345189616622, 1.1756225947641854, 1.180028739533096, 1.1848450375986155, 1.1900611522786344, 1.195664325778548, 1.2016394133949027, 1.2079689541284182, 1.2146332788413643, 1.2216106559233566, 1.228877473104804, 1.2364084526489827, 1.2441768957529427, 1.2521549506987795, 1.2603138982264863, 1.2686244468437413, 1.2770570304182047, 1.2855821004515477, 1.29417040590749, 1.3027932543133762, 1.3114227489956352, 1.3200319986387663, 1.328595296760366, 1.33708827006035, 1.3454879958378139, 1.3537730897055813, 1.3619237656323673, 1.3699218708950303, 1.3777508988424454, 1.3853959824888409, 1.3928438719085068, 1.400082898239333, 1.4071029268612174, 1.4138953020327227, 1.4204527849741926, 1.4267694870980894, 1.4328407998212602, 1.4386633221565412, 1.4442347870751633 ], [ 1.1607342263433225, 1.1603577291882299, 1.1603493318357203, 1.1607208665697548, 1.161483025649983, 1.1626452099719904, 1.1642153770225006, 1.1661998903127497, 1.1686033727982856, 1.1714285671139144, 1.1746762057538633, 1.1783448945912098, 1.1824310133338038, 1.186928636629451, 1.191829479530577, 1.197122870876191, 1.202795757817582, 1.2088327441796243, 1.2152161645997483, 1.2219261954244538, 1.2289410021924823, 1.2362369222408711, 1.2437886796045348, 1.2515696280299944, 1.2595520166902883, 1.2677072721722966, 1.2760062896006379, 1.2844197254309848, 1.292918284523518, 1.3014729945884764, 1.3100554619349642, 1.3186381035724777, 1.3271943520104248, 1.3356988304632784, 1.3441274974920479, 1.3524577613068547, 1.3606685649562622, 1.3687404443997984, 1.376655561991954, 1.384397718212139, 1.3919523445857196, 1.3993064806954827, 1.4064487380230004, 1.4133692531252429, 1.4200596323782413, 1.426512890233699, 1.432723382656364, 1.4386867371522463, 1.4443997805677786, 1.4498604656402665 ], [ 1.1663907945186502, 1.1661588125231517, 1.1662928535317691, 1.1668042690018998, 1.1677032590972367, 1.1689987246636984, 1.1706981189145615, 1.1728073010019, 1.1753303939650295, 1.178269649852788, 1.1816253251004407, 1.1853955694856346, 1.1895763321684474, 1.1941612884124106, 1.1991417905572888, 1.2045068466414712, 1.2102431297243943, 1.2163350204171424, 1.2227646843818285, 1.2295121856129885, 1.236555635191986, 1.243871373954228, 1.2514341861967988, 1.2592175402656383, 1.2671938506924438, 1.275334755597691, 1.2836114024223946, 1.2919947347590433, 1.3004557731511377, 1.3089658832134066, 1.3174970252461613, 1.3260219806015556, 1.3345145513095724, 1.3429497307820002, 1.351303844683039, 1.3595546622009747, 1.3676814789153298, 1.375665173194059, 1.3834882385667178, 1.3911347948153496, 1.3985905806333239, 1.4058429306611917, 1.4128807395575538, 1.4196944155404887, 1.4262758255740182, 1.432618234100693, 1.4387162369546616, 1.4445656918419665, 1.4501636465530878, 1.4555082658798304 ], [ 1.1723562964645562, 1.1722717796026658, 1.17255073319767, 1.1732039938700007, 1.1742412369416049, 1.1756708322302631, 1.177499700000485, 1.179733169234446, 1.1823748406863859, 1.1854264574731566, 1.1888877862177207, 1.1927565119831445, 1.1970281503906577, 1.2016959803815637, 1.20675100103252, 1.2121819156399358, 1.2179751459276305, 1.2241148786845197, 1.2305831463986152, 1.237359942527455, 1.2444233709589199, 1.2517498280158108, 1.259314214107877, 1.2670901709168179, 1.2750503389029584, 1.2831666290360553, 1.2914105020548783, 1.2997532483066456, 1.3081662613339984, 1.3166212988545678, 1.325090725573178, 1.3335477333069028, 1.3419665350972607, 1.3503225312326816, 1.3585924463141028, 1.3667544375878369, 1.374788175685566, 1.3826748996191458, 1.3903974483695611, 1.3979402716968048, 1.4052894229071555, 1.4124325362811998, 1.4193587917277808, 1.4260588690215363, 1.4325248937364785, 1.4387503767294816, 1.444730148774326, 1.4504602917106524, 1.4559380672597777, 1.461161844473534 ], [ 1.1786061022113732, 1.1786712549575022, 1.179096865576045, 1.1798932258972343, 1.181069457866852, 1.1826333736280867, 1.1845913362334881, 1.1869481231289307, 1.1897067948354862, 1.19286857152535, 1.1964327204299119, 1.2003964572141743, 1.2047548645813193, 1.2095008314111189, 1.2146250156611642, 1.2201158340464362, 1.2259594811389203, 1.2321399799801818, 1.2386392655712208, 1.245437301704958, 1.2525122305636143, 1.2598405533608394, 1.2673973391284972, 1.2751564576069063, 1.2830908311779445, 1.291172699965015, 1.299373893682985, 1.3076661036049626, 1.3160211481427742, 1.3244112260044245, 1.3328091516527087, 1.341188568777158, 1.3495241386212706, 1.3577917011867748, 1.3659684084796002, 1.3740328299944562, 1.3819650315036425, 1.3897466288903295, 1.3973608192390494, 1.404792391676996, 1.412027720573134, 1.4190547436801735, 1.425862927682016, 1.4324432234198936, 1.43878801284325, 1.4448910494900407, 1.4507473940627973, 1.456353346443097, 1.4617063752847865, 1.4668050461480595 ], [ 1.1851146053144916, 1.1853308771623354, 1.1859041529349656, 1.1868441540454586, 1.1881594249962102, 1.1898571981772015, 1.191943259786682, 1.1944218189862101, 1.1972953826680242, 1.2005646384619852, 1.2042283488272996, 1.2082832592442354, 1.2127240236234125, 1.2175431500635334, 1.2227309699900952, 1.2282756334760596, 1.234163133162486, 1.2403773586506497, 1.2469001825254697, 1.2537115783038602, 1.260789769607717, 1.268111408782812, 1.2756517820804067, 1.2833850374585396, 1.2912844301212525, 1.2993225801706751, 1.3074717362624724, 1.3157040389737062, 1.3239917777318415, 1.3323076356035917, 1.3406249169632927, 1.348917753989989, 1.3571612890018825, 1.3653318307423459, 1.373406983803359, 1.3813657513425035, 1.3891886120695034, 1.3968575731191637, 1.4043562008813864, 1.4116696321346005, 1.418784567947865, 1.4256892528083474, 1.4323734413264997, 1.4388283547020042, 1.4450466289265493, 1.451022256476806, 1.4567505230288589, 1.4622279405152867, 1.467452177654376, 1.4724219889108847 ], [ 1.1918554941471633, 1.192223580060039, 1.1929447959299546, 1.1940282716332096, 1.1954819547919513, 1.1973124806718212, 1.1995250437053637, 1.202123272714513, 1.205109112151966, 1.2084827119076218, 1.2122423284191968, 1.2163842399689322, 1.2209026791233324, 1.2257897852600754, 1.2310355800057067, 1.2366279681606254, 1.2425527662988807, 1.2487937606904649, 1.2553327955035676, 1.2621498914158555, 1.2692233938241064, 1.2765301488313747, 1.2840457041654456, 1.2917445312062483, 1.2996002634426504, 1.3075859460074626, 1.3156742905096248, 1.3238379292329454, 1.332049662916187, 1.3402826967585333, 1.3485108599711864, 1.3567088050623206, 1.3648521840282604, 1.3729177996515582, 1.3808837311047277, 1.3887294339649932, 1.3964358155153762, 1.403985286814352, 1.4113617934519003, 1.4185508271808644, 1.4255394207383874, 1.4323161281782488, 1.438870992950164, 1.4451955058144177, 1.4512825544947032, 1.4571263667691015, 1.4627224484943802, 1.4680675178629075, 1.473159437011082, 1.4779971419365714 ], [ 1.1988020214627881, 1.1993218717014693, 1.2001905815648348, 1.2014166728713982, 1.2030074816264422, 1.2049690333515646, 1.207305920546443, 1.2100211843090265, 1.2131162023655255, 1.2165905859642596, 1.2204420882539828, 1.2246665268829517, 1.2292577236029192, 1.2342074636246316, 1.2395054773308012, 1.245139446692727, 1.2510950383454995, 1.2573559647476324, 1.2639040741866263, 1.2707194696056585, 1.277780655344607, 1.2850647099497916, 1.292547482261978, 1.3002038071003326, 1.3080077360833875, 1.3159327785260975, 1.3239521469740174, 1.3320390018143349, 1.3401666895512017, 1.3483089697380282, 1.356440226188631, 1.364535658890626, 1.3725714539539777, 1.380524929876775, 1.3883746593338393, 1.3961005665361628, 1.4036840009291336, 1.4111077885705767, 1.4183562629468873, 1.4254152772528257, 1.4322722002934944, 1.4389158981885606, 1.4453367039941667, 1.451526377232753, 1.4574780551576174, 1.4631861973967337, 1.4686465254334435, 1.4738559582005992, 1.4788125448960454, 1.4835153959745373 ], [ 1.2059272664456924, 1.2065981049872767, 1.2076131620202641, 1.2089803393868237, 1.2107063514189234, 1.2127966059786028, 1.2152550881323334, 1.218084248430079, 1.2212848979626538, 1.2248561125487942, 1.2287951485435007, 1.2330973728478178, 1.2377562097220516, 1.2427631069438518, 1.248107523694441, 1.2537769422871536, 1.259756905462638, 1.2660310804607977, 1.2725813504449697, 1.27938793311288, 1.2864295255072806, 1.2936834731728937, 1.3011259609421586, 1.3087322218232402, 1.316476759765354, 1.3243335815409283, 1.3322764326540086, 1.3402790320880045, 1.348315300852579, 1.3563595796682466, 1.3643868317077321, 1.3723728270485651, 1.3802943063251918, 1.388129121939496, 1.39585635603839, 1.4034564152458249, 1.4109111028071353, 1.4182036693428062, 1.4253188438081756, 1.432242846518598, 1.4389633862398863, 1.44546964338059, 1.4517522412783954, 1.4578032074700875, 1.4636159266936881, 1.4691850872097183, 1.4745066218600553, 1.4795776451168434, 1.4843963872173809, 1.4889621263371824 ], [ 1.2132043840607476, 1.2140247346431638, 1.2151843188197944, 1.2166904110625285, 1.2185490985506575, 1.2207651681451, 1.2233419964865844, 1.2262814451248278, 1.2295837627657387, 1.2332474968763383, 1.2372694170009666, 1.241644452204702, 1.2463656450571918, 1.2514241244888868, 1.2568090996788703, 1.2625078768585154, 1.2685059005305366, 1.2747868201072547, 1.2813325823701187, 1.2881235494596308, 1.2951386413444852, 1.3023555009251682, 1.309750679142232, 1.3172998367306286, 1.3249779586375605, 1.3327595766480502, 1.3406189954762153, 1.3485305175052456, 1.3564686615021135, 1.3644083709840986, 1.372325208445336, 1.3801955323221673, 1.3879966543352211, 1.3957069756404115, 1.4033061009985708, 1.4107749308902329, 1.4180957321238536, 1.4252521879920077, 1.4322294294111673, 1.439014048739474, 1.4455940981136421, 1.4519590741976065, 1.4580998912109635, 1.4640088440243564, 1.4696795629903092, 1.4751069620371686, 1.480287181403423, 1.4852175262391756, 1.489896402157147, 1.49432324868134 ], [ 1.2206068372911403, 1.221574555998317, 1.2228762077016315, 1.224518436482716, 1.2265067012896205, 1.228845169012095, 1.2315366111517974, 1.2345823059235854, 1.2379819477804483, 1.241733566482503, 1.2458334579185313, 1.250276128926057, 1.2550542583307147, 1.2601586763262569, 1.2655783641324097, 1.2713004755903494, 1.2773103819796416, 1.2835917408662543, 1.2901265892250813, 1.296895460436585, 1.3038775240587455, 1.311050746552945, 1.318392070434055, 1.3258776086623587, 1.333482850541062, 1.3411828749673, 1.348952566637946, 1.3567668307543577, 1.3646008019076012, 1.372430043148138, 1.3802307317269096, 1.3879798286020841, 1.3956552294931919, 1.4032358959851101, 1.4107019658925661, 1.4180348427527065, 1.4252172648881443, 1.4322333549564068, 1.439068651264842, 1.4457101223836233, 1.4521461667419695, 1.4583665989576815, 1.4643626246441335, 1.4701268053791139, 1.4756530154226608, 1.4809363916505145, 1.4859732780374035, 1.4907611658892546, 1.4952986308913094, 1.4995852679145105 ], [ 1.2281086087603599, 1.2292209220036339, 1.230661580590774, 1.2324365993544006, 1.2345508120959348, 1.2370077708734564, 1.239809649330586, 1.2429571518247957, 1.2464494302467817, 1.2502840105257487, 1.2544567308791874, 1.2589616938799244, 1.263791234367793, 1.2689359051186393, 1.2743844819910204, 1.2801239899943444, 1.2861397513581554, 1.292415456232236, 1.29893325611811, 1.3056738795385978, 1.3126167688142762, 1.3197402361622115, 1.32702163669664, 1.3344375553304069, 1.3419640040868361, 1.349576625968287, 1.3572509013162313, 1.3649623525552046, 1.3726867433431327, 1.3804002684445746, 1.3880797310797408, 1.3957027050492203, 1.4032476795538071, 1.4106941852796844, 1.4180229009617673, 1.4252157402377468, 1.432255919135004, 1.4391280049745037, 1.4458179478205941, 1.4523130958535229, 1.4586021961983167, 1.464675382820774, 1.4705241531125526, 1.4761413347473546, 1.481521044313443, 1.4866586391266075, 1.4915506635129694, 1.496194790730872, 1.5005897615813362, 1.5047353206416727 ], [ 1.2356843892024287, 1.2369379359506543, 1.2385139821448592, 1.2404179184083914, 1.2426539603575657, 1.2452250541598686, 1.248132786549045, 1.2513773009719757, 1.254957221652542, 1.2588695874374194, 1.263109797329546, 1.2676715696079786, 1.2725469163698668, 1.2777261352033398, 1.2831978195025917, 1.288948888663863, 1.294964639051439, 1.3012288161988907, 1.3077237082198008, 1.3144302598577091, 1.3213282060261533, 1.3283962231020108, 1.3356120956680102, 1.3429528958859316, 1.3503951722522454, 1.3579151441716157, 1.3654888986034341, 1.37309258500575, 1.3807026049228532, 1.3882957928290847, 1.3958495852334756, 1.4033421755402147, 1.4107526527156118, 1.4180611223977664, 1.4252488096659142, 1.432298143232214, 1.4391928213054959, 1.4459178597874869, 1.452459623788969, 1.4588058436944138, 1.4649456171635356, 1.4708693985458514, 1.4765689772109085, 1.482037446275223, 1.4872691631491735, 1.4922597032445704, 1.4970058080857283, 1.5015053289613023, 1.505757167146769, 1.5097612116219203 ], [ 1.2433097412081955, 1.2447006183643141, 1.246407919405165, 1.248436419382372, 1.2507897262436392, 1.2534701926677638, 1.2564788327379803, 1.2598152450400972, 1.263477543860106, 1.2674623002136063, 1.2717644944589817, 1.2763774822204996, 1.281292975269591, 1.286501038876259, 1.2919901069429829, 1.2977470159675002, 1.3037570585479565, 1.3100040567475022, 1.316470455182647, 1.323137433203488, 1.3299850350115905, 1.3369923160354704, 1.3441375033799625, 1.3513981677123648, 1.3587514035722106, 1.3661740148174242, 1.3736427017662827, 1.381134246573264, 1.3886256934896763, 1.3960945208998419, 1.4035188023740686, 1.410877354417404, 1.4181498690897865, 1.4253170301980456, 1.4323606122836632, 1.4392635621254384, 1.4460100629223862, 1.4525855817036188, 1.458976900820903, 1.4651721346131934, 1.471160732494031, 1.476933469808988, 1.4824824278505095, 1.4878009644124135, 1.4928836762260025, 1.4977263545545696, 1.5023259351411364, 1.5066804436128292, 1.5107889373497034, 1.5146514447300745 ], [ 1.250961237577639, 1.2524850474827731, 1.254319004058828, 1.2564672786942872, 1.2589328853941049, 1.2617175988500575, 1.264821877693179, 1.2682447944223916, 1.2719839735708187, 1.2760355397084224, 1.2803940768801327, 1.2850526010365884, 1.2900025469245178, 1.2952337707610293, 1.3007345698170698, 1.3064917197781958, 1.3124905304364054, 1.3187149198982537, 1.3251475070797145, 1.3317697218084257, 1.3385619313851471, 1.345503581987999, 1.3525733528579444, 1.3597493208059912, 1.3670091322547728, 1.3743301797905008, 1.381689780071197, 1.3890653499231165, 1.3964345775608613, 1.4037755860814731, 1.4110670866948962, 1.41828851954258, 1.4254201803983175, 1.432443332014651, 1.439340299348621, 1.4460945483491412, 1.4526907483961349, 1.4591148188349823, 1.465353960340797, 1.4713966720725744, 1.4772327557390719, 1.482853307801471, 1.488250701089731, 1.4934185571190466, 1.4983517103684503, 1.5030461657343475, 1.5074990503048076, 1.5117085605223834, 1.5156739057190773, 1.519395248920785 ], [ 1.2586165744050886, 1.2602684735600818, 1.2622240676635563, 1.2644869392780032, 1.267059525042494, 1.269943039892791, 1.2731374067672911, 1.2766411931978296, 1.2804515562323122, 1.2845641971545856, 1.2889733274507296, 1.2936716474151086, 1.2986503386900476, 1.3038990718863726, 1.3094060302360235, 1.315157949981704, 1.3211401779134848, 1.327336746122071, 1.333730463660345, 1.3403030243992864, 1.347035129945461, 1.353906626072194, 1.3608966507247686, 1.3679837913118111, 1.3751462487103863, 1.3823620052083618, 1.3896089934975964, 1.3968652638231287, 1.404109146487876, 1.4113194071038715, 1.4184753922580642, 1.4255571636058666, 1.4325456187988388, 1.43942259807121, 1.4461709757320382, 1.4527747362151302, 1.4592190347110605, 1.4654902427323435, 1.4715759792362157, 1.477465128146308, 1.483147843275206, 1.4886155417582934, 1.493860887170909, 1.4988777635230264, 1.5036612413155284, 1.5082075368073617, 1.5125139655897704, 1.5165788914982428, 1.5204016718197, 1.5239825996752154 ], [ 1.266254659688209, 1.268029407905372, 1.270101250874596, 1.2724731997490881, 1.2751471328680248, 1.2781237260009017, 1.2814023883401764, 1.2849812055445546, 1.288856891165319, 1.2930247477898993, 1.297478639206106, 1.3022109748234552, 1.307212707481668, 1.3124733456283157, 1.3179809806567124, 1.323722329961081, 1.3296827959910786, 1.3358465412753167, 1.3421965790408161, 1.3487148786912353, 1.35538248503415, 1.3621796497811351, 1.369085973500691, 1.3760805559006566, 1.3831421520700535, 1.3902493321350933, 1.3973806416911871, 1.404514760368652, 1.411630655975104, 1.4187077318278085, 1.425725965134174, 1.432666034584126, 1.4395094356665514, 1.446238582594654, 1.4528368961028972, 1.459288876744131, 1.4655801636546548, 1.4716975790564775, 1.4776291590223325, 1.4833641712366408, 1.4888931206441376, 1.494207743989796, 1.4993009943232842, 1.5041670165741885, 1.5088011153066128, 1.5131997157399568, 1.5173603190821807, 1.521281453168062, 1.5249626193320749, 1.5284042363771244 ], [ 1.2738556787724689, 1.2757476880961625, 1.2779300682381507, 1.2804052785906403, 1.2831746603901153, 1.286238372824939, 1.2895953351120224, 1.2932431757477811, 1.2971781901524226, 1.3013953079138538, 1.3058880707944822, 1.310648622588435, 1.3156677118058457, 1.3209347080135725, 1.3264376324773843, 1.3321632035301332, 1.3380968968354185, 1.3442230204311296, 1.3505248041277629, 1.3569845025110838, 1.3635835104685237, 1.3703024898361167, 1.377121505462357, 1.3840201687214722, 1.3909777862955262, 1.3979735118943808, 1.404986498504317, 1.4119960487550152, 1.4189817610714472, 1.4259236694279736, 1.4328023747382983, 1.4395991661846246, 1.44629613109802, 1.4528762523332848, 1.459323492419718, 1.4656228640989952, 1.471760487170183, 1.4777236318397313, 1.4835007490140395, 1.4890814881703471, 1.4944567035969887, 1.4996184499080678, 1.5045599678134467, 1.5092756611669598, 1.5137610663289853, 1.5180128148691652, 1.522028590605955, 1.5258070819366476, 1.5293479303582156, 1.5326516760193125 ], [ 1.2814011383238106, 1.2834045211791703, 1.2856914504837877, 1.2882638554078245, 1.2911225630654912, 1.2942672402940865, 1.2976963415816094, 1.3014070642516156, 1.3053953120134938, 1.3096556679608962, 1.3141813780481857, 1.3189643459923985, 1.3239951404350447, 1.3292630150532738, 1.3347559421337363, 1.340460659915789, 1.3463627337758346, 1.3524466310653378, 1.358695809136868, 1.365092815802907, 1.3716194011804506, 1.3782566395914662, 1.384985059927276, 1.3917847826560885, 1.3986356614690358, 1.4055174274314135, 1.4124098334398318, 1.4192927967872062, 1.4261465377064217, 1.432951711896713, 1.4396895352275456, 1.4463418990526613, 1.4528914748400061, 1.4593218071177052, 1.465617394038454, 1.4717637551619895, 1.4777474863361235, 1.483556301812607, 1.4891790639579938, 1.494605801108126, 1.4998277142661107, 1.5048371734585215, 1.509627704644974, 1.5141939681257155, 1.5185317294141882, 1.5226378235412836, 1.5265101137390276, 1.5301474454181179, 1.5335495963093178, 1.5367172235865962 ], [ 1.2888738907776554, 1.290982506916344, 1.2933677664800456, 1.2960310915173021, 1.2989728194500751, 1.3021921503062377, 1.3056871002399837, 1.3094544623539324, 1.3134897758236226, 1.3177873042890695, 1.3223400244172734, 1.3271396254527439, 1.332176520459391, 1.337439869816414, 1.3429176173636075, 1.3485965393991248, 1.3544623065173973, 1.3604995580402321, 1.3666919885450464, 1.3730224457370759, 1.379473038655559, 1.3860252549562218, 1.3926600857845277, 1.399358156555903, 1.4060998618009921, 1.4128655021237952, 1.41963542126511, 1.4263901412665496, 1.433110493791863, 1.4397777457800593, 1.4463737177725962, 1.4528808934668032, 1.4592825192890557, 1.4655626930428918, 1.4717064409574285, 1.4776997827292309, 1.483529784406245, 1.4891845991975856, 1.4946534965018303, 1.4999268796251868, 1.5049962928074863, 1.5098544182884648, 1.5144950642305086, 1.5189131443693418, 1.5231046502942125, 1.527066617267363, 1.5307970844827445, 1.5342950506391249, 1.5375604256666335, 1.5405939794008112 ], [ 1.2962581413618113, 1.2984656432691928, 1.3009428271373518, 1.3036906322412651, 1.3067089318742744, 1.3099964857946251, 1.3135508990606954, 1.3173685881764885, 1.3214447554448732, 1.325773372381433, 1.330347172974913, 1.3351576574908335, 1.3401951074020901, 1.3454486118949234, 1.3509061062411, 1.356554422148984, 1.362379350009735, 1.3683657127431985, 1.3744974507257295, 1.3807577170547283, 1.387128982178894, 1.3935931467070641, 1.4001316610105143, 1.406725650062309, 1.4133560418211897, 1.4200036973733698, 1.42664954099902, 1.4332746883341123, 1.4398605708532648, 1.4463890550028848, 1.4528425544618706, 1.4592041341919337, 1.465457605153301, 1.471587608793977, 1.477579690662432, 1.4834203627349205, 1.489097154280896, 1.4945986513062912, 1.4999145248089687, 1.5050355482497177, 1.509953604783634, 1.5146616849099672, 1.5191538752842364, 1.5234253394962325, 1.5274722916538566, 1.531291963628327, 1.5348825668141637, 1.5382432492403542, 1.5413740488402883, 1.544275843649828 ], [ 1.3035394398554863, 1.3058393163639326, 1.308401873576017, 1.311227593292878, 1.3143159110804752, 1.3176651736738019, 1.321272602834232, 1.3251342664926533, 1.3292450579778157, 1.333598684077675, 1.3381876626104334, 1.3430033300912843, 1.348035859970515, 1.3532742917893152, 1.3587065714520286, 1.3643196026496196, 1.3700993092903868, 1.3760307086038943, 1.3820979943861593, 1.3882846296532558, 1.3945734477726577, 1.4009467609531907, 1.4073864748027274, 1.413874207514949, 1.4203914121294718, 1.4269195002292985, 1.433439965400404, 1.4399345047829806, 1.4463851370927445, 1.452774315582272, 1.459085034542498, 1.4653009281076748, 1.4714063603161545, 1.4773865055861148, 1.483227418981741, 1.488916095862878, 1.4944405207226181, 1.4997897052161056, 1.5049537155648833, 1.509923689680834, 1.5146918444896835, 1.5192514740452716, 1.5235969391125033, 1.5277236489599484, 1.5316280361444399, 1.5353075250917017, 1.5387604952814766, 1.541986239835579, 1.5449849202848829, 1.5477575182592112 ], [ 1.3107046592458054, 1.3130902771648003, 1.3157315518468573, 1.3186285335946049, 1.3217802472108886, 1.325184654091833, 1.3288386208035223, 1.3327378948901207, 1.3368770886204318, 1.3412496713228774, 1.3458479708849347, 1.3506631849025421, 1.3556854018579307, 1.3609036325817054, 1.366305852117653, 1.371879051958208, 1.3776093024568272, 1.3834818250530627, 1.3894810737704433, 1.3955908252703646, 1.4017942765719213, 1.4080741493836322, 1.4144127998441998, 1.420792332341982, 1.4271947159822613, 1.4336019022028907, 1.4399959420060462, 1.4463591012789572, 1.4526739727201503, 1.4589235829684661, 1.4650914936469377, 1.4711618951776517, 1.4771196923913452, 1.4829505811396073, 1.4886411153114651, 1.4941787638525224, 1.499551957577328, 1.5047501257484963, 1.5097637225645908, 1.514584243849333, 1.5192042343649044, 1.5236172862808202, 1.5278180294164854, 1.5318021139409763, 1.5355661862587522, 1.539107858836678, 1.5424256747378848, 1.5455190676236847, 1.5483883179683198, 1.5510345062046467 ], [ 1.3177419633928766, 1.3202066070197274, 1.3229198764159222, 1.3258814167815725, 1.3290898694315811, 1.3325428383004614, 1.3362368629299142, 1.3401673986067846, 1.3443288042721213, 1.3487143387608898, 1.353316165856571, 1.3581253685553185, 1.3631319728315463, 1.368324981081083, 1.3736924152908632, 1.3792213698465194, 1.384898073743259, 1.3907079618131364, 1.3966357544260928, 1.4026655449665828, 1.4087808942361704, 1.4149649307897882, 1.4212004560846998, 1.427470053211035, 1.4337561978866953, 1.44004137034071, 1.4463081666817685, 1.4525394083540393, 1.4587182483213286, 1.4648282726920645, 1.4708535965988623, 1.476778953273991, 1.4825897754107433, 1.4882722680651148, 1.4938134725261705, 1.4992013207610673, 1.5044246802161614, 1.509473388923952, 1.5143382810222477, 1.5190112029338618, 1.523485020579438, 1.5277536181016713, 1.5318118886652103, 1.5356557179631898, 1.5392819611094555, 1.5426884136261796, 1.5458737772513864, 1.548837621291649, 1.5515803402338313, 1.5541031083080519 ], [ 1.3246407657263646, 1.3271776741438184, 1.3299561845152765, 1.3329755635219662, 1.3362340963477308, 1.3397290573140332, 1.34345668696834, 1.3474121762183133, 1.3515896580525515, 1.355982207324676, 1.3605818490017016, 1.3653795751900755, 1.3703653711545358, 1.3755282504364148, 1.3808562990606377, 1.386336728695359, 1.391955938496724, 1.3976995852354135, 1.4035526611639684, 1.409499578947147, 1.4155242628453972, 1.4216102452175046, 1.4277407672971358, 1.4338988831030504, 1.440067565268792, 1.4462298115276335, 1.452368750565655, 1.4584677459613922, 1.4645104969653524, 1.4704811349359117, 1.4763643143377865, 1.4821452973222866, 1.4878100310409792, 1.4933452169912678, 1.4987383718489635, 1.5039778794037078, 1.5090530333733407, 1.5139540710282504, 1.5186721977026312, 1.5231996024029364, 1.5275294648424893, 1.5316559543333148, 1.5355742210510976, 1.5392803802563635, 1.5427714901051277, 1.5460455237159423, 1.5491013361789727, 1.5519386271976927, 1.5545579000468477, 1.5569604175129044 ], [ 1.3313916808791, 1.333994082979966, 1.3368310833270958, 1.339901596643504, 1.3432035792142833, 1.3467340033693942, 1.3504888383646734, 1.3544630381836205, 1.3586505367272173, 1.3630442507933473, 1.3676360911718244, 1.3724169820962089, 1.3773768892000917, 1.382504856024318, 1.3877890490135747, 1.3932168108269514, 1.3987747216690072, 1.4044486682269157, 1.4102239196776263, 1.4160852101090902, 1.4220168265841202, 1.4280027019678585, 1.4340265115433128, 1.4400717723577794, 1.4461219441792217, 1.452160530899213, 1.458171181199768, 1.4641377873072152, 1.4700445806873925, 1.4758762235926772, 1.481617895450889, 1.4872553731866447, 1.4927751046837896, 1.4981642747292978, 1.5034108629201257, 1.508503693160447, 1.5134324745232384, 1.5181878333930376, 1.5227613369425064, 1.5271455081208487, 1.5313338324451071, 1.535320756983742, 1.5391016820050394, 1.5426729458300663, 1.5460318034811604, 1.5491763997530998, 1.5521057373557592, 1.554819640785617, 1.5573187165802436, 1.5596043105963777 ], [ 1.3379864710222868, 1.3406476182282046, 1.3435363918142267, 1.346651380894565, 1.3499902397797987, 1.3535496660273114, 1.3573253848117781, 1.3613121400738897, 1.365503692847529, 1.36989282709909, 1.374471363338185, 1.3792301801770936, 1.3841592439279369, 1.3892476462323335, 1.3944836496191548, 1.3998547407828612, 1.4053476912689051, 1.410948625145183, 1.4166430931311895, 1.4224161525513161, 1.4282524523780427, 1.4341363225373116, 1.4400518665648319, 1.4459830566316392, 1.4519138299025582, 1.4578281851548653, 1.4637102785686147, 1.4695445176057342, 1.4753156519232338, 1.4810088603158058, 1.4866098327540338, 1.4921048466739681, 1.4974808367796089, 1.5027254577381706, 1.5078271392756286, 1.5127751333127846, 1.5175595529163288, 1.5221714029713405, 1.526602602608085, 1.5308459995339834, 1.534895376528875, 1.53874545045639, 1.5423918642252132, 1.5458311722005769, 1.5490608196183162, 1.552079116591492, 1.5548852073237551, 1.5574790351549905, 1.5598613040648055, 1.5620334372491878 ], [ 1.3444179885070255, 1.3471311851702124, 1.3500650788400823, 1.3532179589939917, 1.3565872044228469, 1.3601692645740564, 1.3639596471161126, 1.3679529121240286, 1.3721426732251998, 1.376521605978679, 1.3810814636879207, 1.3858131007685823, 1.39070650370958, 1.3957508295781893, 1.4009344519291698, 1.4062450138845075, 1.41166948805539, 1.4171942428825495, 1.422805114876339, 1.4284874861457737, 1.434226366517844, 1.440006479467229, 1.4458123510042369, 1.4516284006080118, 1.4574390332450946, 1.4632287314824397, 1.468982146690871, 1.4746841883407182, 1.4803201104168282, 1.4858755940248698, 1.4913368253242612, 1.4966905680031546, 1.5019242296059374, 1.5070259211304073, 1.5119845094275146, 1.5167896620575818, 1.5214318843802104, 1.5259025487770443, 1.5301939160244993, 1.5342991489444253, 1.5382123185625352, 1.5419284030952234, 1.5454432801639757, 1.5487537127021211, 1.5518573290707196, 1.554752597939217, 1.5574387985123488, 1.5599159866985546, 1.5621849578178222, 1.5642472064395085 ], [ 1.3506801162423505, 1.3534387477366998, 1.3564111990385652, 1.359595485438201, 1.362988736052384, 1.3665871781921373, 1.370386127835979, 1.3743799865543067, 1.37856224517009, 1.382925494374894, 1.3874614424483764, 1.3921609401543713, 1.3970140128083712, 1.4020098994301384, 1.407137098812144, 1.4123834222500398, 1.4177360525963358, 1.423181609213547, 1.4287062183195884, 1.4342955881373074, 1.4399350881833777, 1.4456098319611872, 1.4513047622597017, 1.4570047382078952, 1.4626946231938789, 1.4683593727315796, 1.4739841213469904, 1.479554267561845, 1.485055556075644, 1.49047415628727, 1.4957967363542368, 1.5010105320596736, 1.5061034098427308, 1.5110639234447336, 1.5158813637285617, 1.5205458013395003, 1.5250481219891492, 1.5293800542570546, 1.5335341899146575, 1.537503996880489, 1.5412838250120764, 1.5448689050269213, 1.5482553409209725, 1.5514400963170805, 1.5544209752277376, 1.557196597755749, 1.559766371283644, 1.5621304577182644, 1.5642897373617655, 1.566245769975433 ], [ 1.3567677070553292, 1.3595652655774033, 1.362569827703933, 1.3657791593415092, 1.3691901650495981, 1.3727988751746252, 1.3766004389581947, 1.3805891239167436, 1.384758321729263, 1.3891005608046014, 1.3936075256312455, 1.3982700829410766, 1.4030783146450831, 1.4080215574239927, 1.4130884487808508, 1.4182669792861633, 1.4235445506699924, 1.4289080393400235, 1.4343438648308593, 1.439838062618886, 1.445376360670063, 1.4509442590265993, 1.4565271116841898, 1.4621102099661825, 1.467678866566344, 1.4732184994094917, 1.478714714470503, 1.4841533866980576, 1.489520738210581, 1.4948034129683012, 1.4999885471764953, 1.5050638347401133, 1.510017587167345, 1.5148387874074811, 1.5195171372043847, 1.5240430976484047, 1.5284079227141243, 1.532603685676249, 1.5366232983985795, 1.5404605235891708, 1.5441099802062104, 1.547567142282251, 1.5508283315076652, 1.5538907039766903, 1.556752231550538, 1.5594116783315157, 1.5618685727702022, 1.564123175944603, 1.5661764465569692, 1.56803000319107 ], [ 1.3626765230889237, 1.3655066312009476, 1.3685369957761266, 1.3717651573899594, 1.3751878203326218, 1.3788008422618478, 1.3825992296855854, 1.3865771395284645, 1.390727886975734, 1.3950439597246607, 1.3995170387072593, 1.4041380252803963, 1.4088970748104204, 1.4137836365100973, 1.4187864993161385, 1.4238938435264634, 1.429093297848048, 1.4343720014390613, 1.4397166704639617, 1.445113668617822, 1.4505490810176769, 1.4560087908051522, 1.4614785577576124, 1.4669440981658266, 1.4723911652064166, 1.4778056290182977, 1.4831735556853274, 1.4884812843333002, 1.4937155015688632, 1.4988633125209958, 1.5039123077921492, 1.5088506256850684, 1.513667009141715, 1.5183508569106623, 1.5228922685472004, 1.5272820829437497, 1.5315119101847898, 1.5355741566180385, 1.5394620431295345, 1.5431696167026714, 1.5466917554277608, 1.550024167208022, 1.5531633824782811, 1.5561067413133474, 1.5588523753531338, 1.5613991850109348, 1.5637468124597387, 1.565895610909512, 1.567846610696428, 1.5696014827039904 ], [ 1.3684031761037732, 1.3712596080600825, 1.3743096258038925, 1.3775505677951312, 1.3809789614319192, 1.3845905149867204, 1.3883801152170896, 1.3923418308665105, 1.3964689222112854, 1.4007538567474294, 1.4051883310480995, 1.4097632987577455, 1.4144690046247055, 1.4192950244097382, 1.4242303104443803, 1.4292632425504275, 1.434381683970396, 1.4395730418991581, 1.4448243321492658, 1.4501222474276836, 1.4554532286503923, 1.460803538674691, 1.4661593377881446, 1.4715067602592344, 1.4768319912292045, 1.4821213432084817, 1.4873613314356298, 1.4925387473627294, 1.4976407295491534, 1.502654831275887, 1.5075690842349185, 1.5123720577018407, 1.5170529126640389, 1.521601450450044, 1.5260081554862708, 1.530264231893422, 1.5343616337244175, 1.5382930887363913, 1.5420521156791287, 1.5456330351691965, 1.549030974301008, 1.5522418652215346, 1.5552624379629907, 1.558090207886418, 1.5607234581380762, 1.5631612175593417, 1.565403234519563, 1.5674499471599304, 1.5693024505457291, 1.5709624612246915 ], [ 1.3739450693661188, 1.3768217702721475, 1.3798854695814393, 1.3831333259476377, 1.386561712278044, 1.3901662097303638, 1.3939416072200468, 1.3978819066195942, 1.4019803337728782, 1.4062293553875527, 1.4106207018077923, 1.4151453956087932, 1.419793785894067, 1.4245555881171112, 1.4294199291907574, 1.4343753975906166, 1.4394100981038687, 1.4445117108212804, 1.4496675539192463, 1.4548646497303475, 1.460089793555943, 1.4653296246335765, 1.4705706986364677, 1.4757995610529984, 1.4810028207721866, 1.486167223187585, 1.4912797221279381, 1.4963275499290032, 1.501298284977773, 1.5061799160881615, 1.5109609031059552, 1.5156302331899674, 1.52017747227511, 1.5245928112904208, 1.5288671067792456, 1.532991915648494, 1.536959523856879, 1.54076296893673, 1.544396056327997, 1.5478533695849355, 1.5511302745934497, 1.5542229180089409, 1.5571282201892231, 1.5598438629535523, 1.562368272546419, 1.5647005982228892, 1.5668406869008569, 1.5687890543447227, 1.570546853355099, 1.572115839440715 ] ], "zauto": true, "zmax": 1.572115839440715, "zmin": -1.572115839440715 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.14941216849328134, 0.14800550149428604, 0.14663459825901218, 0.1453040250065322, 0.1440182775983057, 0.14278172658788715, 0.14159856059561945, 0.14047272976030317, 0.13940789125168065, 0.13840735897190637, 0.13747405960548867, 0.13661049707628561, 0.13581872722681235, 0.13510034415144012, 0.1344564791063825, 0.13388781231454858, 0.13339459732274928, 0.1329766969007253, 0.13263362884744986, 0.13236461953911327, 0.13216866265614705, 0.13204458029248278, 0.13199108359249287, 0.13200683017769593, 0.13209047589916517, 0.1322407188539617, 0.13245633409819355, 0.13273619803538753, 0.133079302017767, 0.13348475523494216, 0.13395177745148937, 0.1344796825716118, 0.13506785434327834, 0.135715715760213, 0.136422693878027, 0.1371881818344058, 0.13801149985927202, 0.13889185698713855, 0.13982831504965426, 0.1408197563411444, 0.14186485612425687, 0.1429620608875842, 0.1441095729939749, 0.14530534207923707, 0.1465470632879714, 0.14783218217768498, 0.14915790589413053, 0.15052122002803828, 0.15191891041180022, 0.1533475890071302 ], [ 0.14756826030720224, 0.14612409698030351, 0.1447165488081743, 0.14335029208189123, 0.14202993127472585, 0.1407599411635499, 0.13954460696441393, 0.13838796438378417, 0.13729374175871156, 0.13626530663463615, 0.13530561917837183, 0.13441719472250152, 0.13360207747320818, 0.13286182698754148, 0.13219751845528163, 0.13160975713781561, 0.13109870656849845, 0.13066412936192232, 0.13030543877340048, 0.13002175855154358, 0.12981198818370757, 0.12967487037909003, 0.12960905758231567, 0.12961317445769457, 0.12968587360993972, 0.1298258822766215, 0.13003203829766458, 0.13030331429155279, 0.1306388296015597, 0.13103785017950847, 0.13149977711798427, 0.13202412500339628, 0.13261049162865768, 0.13325852087091608, 0.1339678607072066, 0.13473811841431543, 0.13556881498566387, 0.1364593407064773, 0.1374089136687113, 0.1384165427893369, 0.13948099663140973, 0.14060077902910897, 0.14177411219930028, 0.14299892769744826, 0.14427286525919772, 0.14559327927438392, 0.1469572523796093, 0.14836161543845697, 0.14980297301137915, 0.1512777333034149 ], [ 0.14574678998809854, 0.14426747996188516, 0.14282568447622077, 0.14142617715346886, 0.1400736573972372, 0.13877268958196504, 0.13752763993176897, 0.13634261314640314, 0.1352213911481794, 0.13416737653385585, 0.13318354338431274, 0.1322723979839649, 0.13143595171534772, 0.13067570792220964, 0.1299926638955504, 0.12938732836873332, 0.12885975406393116, 0.12840958397767216, 0.1280361092975857, 0.12773833617134295, 0.1275150580568252, 0.12736493010690147, 0.12728654199886758, 0.12727848580181658, 0.12733941585923042, 0.12746809820794747, 0.12766344770792593, 0.12792455176639528, 0.1282506802542947, 0.1286412818887551, 0.12909596795914263, 0.12961448478298138, 0.13019667667913978, 0.13084244153471206, 0.13155168122071012, 0.13232424918588032, 0.13315989753538743, 0.13405822579114393, 0.13501863334309835, 0.13604027734694052, 0.13712203751600466, 0.13826248890776435, 0.13945988343421753, 0.14071214044769859, 0.14201684638672912, 0.14337126312699086, 0.14477234438499798, 0.14621675927786576, 0.1477009219592242, 0.14922102613191807 ], [ 0.14394994535883035, 0.1424380932131012, 0.1409647214326744, 0.13953468733436283, 0.13815277041576254, 0.13682360861922097, 0.13555163195112063, 0.13434099567748245, 0.13319551568106194, 0.1321186088136359, 0.13111324116833895, 0.13018188709709533, 0.12932650148780073, 0.1285485072938014, 0.12784879959507403, 0.12722776660893972, 0.12668532711972744, 0.1262209828365473, 0.12583388329612755, 0.12552290017893414, 0.12528670736384803, 0.12512386275105208, 0.12503288785143926, 0.12501234136527759, 0.12506088342198438, 0.12517732777818127, 0.125360680014505, 0.12561016057165764, 0.12592521226608114, 0.12630549267727592, 0.12675085246599807, 0.12726130124152907, 0.1278369630345368, 0.1284780237460055, 0.12918467313515467, 0.12995704398626187, 0.13079515106419634, 0.1316988323400377, 0.13266769475170062, 0.1337010664711718, 0.13479795729346652, 0.13595702835904253, 0.1371765719896974, 0.1384545019788964, 0.13978835425202008, 0.14117529742077767, 0.14261215241641384, 0.14409542011206505, 0.1456213156440947, 0.1471858080184337 ], [ 0.1421793252254515, 0.14063776425844224, 0.13913573627164771, 0.137678167994558, 0.13626990326037028, 0.13491563635918605, 0.13361984241004102, 0.13238670714231168, 0.13122005889334093, 0.130123305919298, 0.12909938223199455, 0.12815070507595724, 0.12727914682396957, 0.12648602349294938, 0.12577210128847646, 0.12513762162357708, 0.12458234399617188, 0.12410560503568925, 0.12370639103417425, 0.12338342044685302, 0.12313523225180072, 0.12296027574423773, 0.12285699732539511, 0.12282392011713332, 0.12285971275400978, 0.12296324441778954, 0.12313362401852944, 0.12337022232219577, 0.12367267671409485, 0.12404087911796556, 0.12447494832380814, 0.1249751885893923, 0.1255420368587602, 0.12617600128337755, 0.1268775939412768, 0.12764726073289268, 0.12848531139714217, 0.1293918524458166, 0.13036672556796658, 0.13140945371999588, 0.13251919670638784, 0.13369471758873772, 0.13493436075955006, 0.13623604200706976, 0.1375972504044061, 0.13901506140529077, 0.14048616014141346, 0.1420068736085575, 0.14357321021022215, 0.145180905000891 ], [ 0.1404359119298915, 0.1388676717799309, 0.13734012596131331, 0.13585825597065376, 0.1344269535624968, 0.13305095121436944, 0.131734749279515, 0.13048254239346735, 0.12929814817256804, 0.12818494157736016, 0.1271457984556922, 0.1261830516833978, 0.12529846295632124, 0.12449321265259253, 0.12376790930367756, 0.12312261914146028, 0.12255691500678287, 0.1220699427102863, 0.12166050183296225, 0.12132713703891564, 0.12106823532495432, 0.12088212430129512, 0.12076716660222618, 0.12072184584906161, 0.1207448401855415, 0.12083508021249512, 0.12099178908803933, 0.12121450355458824, 0.12150307563512545, 0.12185765565246402, 0.1222786580264221, 0.12276671197089728, 0.12332259973463, 0.12394718540437956, 0.12464133752110629, 0.12540584885447006, 0.12624135664504546, 0.12714826646359687, 0.12812668256060078, 0.1291763471978072, 0.13029659098262938, 0.13148629568680473, 0.13274387044978586, 0.13406724167523543, 0.13545385635802087, 0.136900698059758, 0.13840431430926517, 0.1399608538595304, 0.14156611199561056, 0.1432155819604726 ], [ 0.13872006546609933, 0.13712833424953558, 0.13557859060902963, 0.134075856100615, 0.13262505361994395, 0.13123093500882932, 0.1298980050331527, 0.1286304444796065, 0.1274320356493255, 0.12630609390825043, 0.12525540912334646, 0.12428220071761088, 0.123388089682083, 0.1225740901850617, 0.12184062244528382, 0.1211875473489572, 0.12061422198115158, 0.12011957392104636, 0.11970219093503592, 0.1193604217009301, 0.11909248249730744, 0.11889656444888767, 0.11877093594833533, 0.11871403525596444, 0.11872454895893025, 0.11880147287555332, 0.11894415303274171, 0.11915230544010452, 0.11942601445781643, 0.11976571054757551, 0.12017212906597038, 0.12064625248389814, 0.12118923898445262, 0.12180234080449254, 0.12248681594551487, 0.12324383699232527, 0.12407440074726644, 0.12497924221736623, 0.1259587561870897, 0.12701292918033774, 0.12814128407842817, 0.12934283904039728, 0.13061608170014527, 0.13195895892898543, 0.1333688817916988, 0.13484274472658175, 0.13637695747695178, 0.1379674879158284, 0.13960991364906963, 0.1412994801562628 ], [ 0.13703154197404288, 0.13541962390251625, 0.13385114247247368, 0.132331144841267, 0.13086456820210673, 0.12945616456806397, 0.12811042163731584, 0.12683148267373537, 0.1256230689282882, 0.12448840855698319, 0.1234301761880494, 0.12245044719417744, 0.1215506702972193, 0.12073166136656398, 0.11999362020000591, 0.11933617076710501, 0.11875842395248018, 0.11825906038498608, 0.1178364296094407, 0.1174886607716717, 0.11721377924014983, 0.11700982323616904, 0.11687495460422676, 0.1168075582980434, 0.1168063259238208, 0.11687031968592568, 0.11699901422588004, 0.1171923150405407, 0.1174505533294686, 0.11777445819307102, 0.11816510804143658, 0.1186238638567625, 0.1191522875718864, 0.11975204928412232, 0.12042482732044514, 0.12117220530956882, 0.1219955703989453, 0.12289601657979675, 0.12387425675291323, 0.12493054668994492, 0.12606462343668784, 0.12727565999430202, 0.12856223734000638, 0.12992233405607348, 0.13135333307341343, 0.13285204434957157, 0.13441474172884055, 0.1360372118012606, 0.13771481230097915, 0.13944253746244825 ], [ 0.13536953862848644, 0.13374080833870783, 0.1321571437897314, 0.13062360384308086, 0.12914512338686507, 0.1277264353388493, 0.1263719884803343, 0.12508586424644758, 0.12387169625174665, 0.12273259680919688, 0.1216710949242836, 0.12068909014623919, 0.1197878261921733, 0.11896788742058495, 0.11822922005363803, 0.11757117861155958, 0.11699259644293242, 0.11649187765078192, 0.11606710627214566, 0.11571616740092394, 0.11543687415319387, 0.11522709402069274, 0.11508486825394534, 0.1150085184274299, 0.11499673519389819, 0.11504864533801251, 0.11516385448632464, 0.11534246412119521, 0.11558506279658781, 0.11589269260080531, 0.1162667929159129, 0.11670912436582159, 0.11722167651925852, 0.11780656342108764, 0.1184659113678905, 0.11920174352004122, 0.12001586594803518, 0.12090975953930243, 0.12188448183992619, 0.12294058237884571, 0.12407803433780316, 0.1252961846207803, 0.12659372348768672, 0.1279686740041174, 0.12941840068126945, 0.13093963589336968, 0.13252852201054408, 0.13418066670445405, 0.13589120858715045, 0.13765489022824046 ], [ 0.13373276595041128, 0.1320906209963122, 0.1304953749055548, 0.12895208520863913, 0.12746566842177628, 0.12604081931540245, 0.12468192581857304, 0.1233929828808108, 0.1221775093280913, 0.12103847227659072, 0.1199782239160825, 0.11899845536847344, 0.11810017181839229, 0.11728369219483895, 0.11654867539608721, 0.11589417348288117, 0.11531871054647955, 0.11482038424296083, 0.11439698543364034, 0.1140461301278947, 0.1137653970983193, 0.11355246419018408, 0.11340523648526712, 0.11332196006208813, 0.113301316038627, 0.11334249078383124, 0.11344521952703704, 0.11360980197395223, 0.11383708986709085, 0.11412844764525752, 0.11448568842373798, 0.1149109884180168, 0.11540678366587018, 0.11597565346765602, 0.11662019536243248, 0.11734289668236297, 0.11814600776791137, 0.11903142176782588, 0.12000056558096894, 0.12105430592292563, 0.12219287373659608, 0.1234158092494673, 0.12472192896517872, 0.1261093148304816, 0.12757532481228945, 0.12911662322094608, 0.13072922838045803, 0.13240857471140552, 0.13414958597381593, 0.13594675631113312 ], [ 0.1321195474406496, 0.13046736054273875, 0.12886413289711393, 0.12731490881181187, 0.1258245711764707, 0.12439775804615463, 0.12303877473993874, 0.12175150497601507, 0.12053932534018573, 0.11940502795652967, 0.11835075649780462, 0.11737796055512122, 0.11648737282966486, 0.11567901260726106, 0.11495221757556515, 0.11430570434317365, 0.11373765616339372, 0.1132458345230812, 0.11282770960339805, 0.11248060330936488, 0.11220183771323522, 0.11198888142338326, 0.11183948657764056, 0.11175180981613334, 0.1117245116211612, 0.11175682970412297, 0.1118486235504083, 0.11200038869180771, 0.112213240674321, 0.11248886996684136, 0.11282947018006298, 0.11323764292301504, 0.11371628341701835, 0.11426845161612958, 0.11489723404652653, 0.11560560186283675, 0.11639627070671124, 0.1172715678187741, 0.11823331148100974, 0.11928270724892578, 0.12042026458816374, 0.1216457365003985, 0.12295808357197259, 0.12435546268610298, 0.1258352394915601, 0.12739402269880554, 0.12902771744454897, 0.13073159437113793, 0.13250037072593615, 0.1343282996908384 ], [ 0.13052794523423658, 0.12886901794230862, 0.1272613595300879, 0.12570999059050786, 0.1242197461938407, 0.122795189838183, 0.121440522888378, 0.12015949322940696, 0.11895530769160344, 0.11783055341701326, 0.11678713361942801, 0.11582622305409271, 0.11494824790140705, 0.11415289367703095, 0.11343914326211808, 0.11280534531336966, 0.11224931132175185, 0.11176843762701912, 0.11135984695065229, 0.11102054264642251, 0.11074756800318973, 0.11053816262678388, 0.11038990817120578, 0.11030085642208848, 0.11026963385350647, 0.11029551815661931, 0.11037848374695615, 0.11051921478237638, 0.11071908567859128, 0.11098011043682432, 0.111304863271129, 0.11169637403432038, 0.1121580027952702, 0.11269329861955625, 0.11330584814386989, 0.11399911989301396, 0.11477631043605402, 0.1156401983806719, 0.1165930118334832, 0.11763631429846594, 0.1187709130612006, 0.11999679295954613, 0.12131307714588883, 0.12271801509674822, 0.12420899682460976, 0.12578259109087092, 0.12743460448574045, 0.12916015758154087, 0.13095377399989427, 0.1328094781505386 ], [ 0.1289559092728084, 0.1272934286720515, 0.12568479599443058, 0.12413499924590218, 0.1226488127636021, 0.12123070858296163, 0.1198847633854018, 0.11861456496108756, 0.11742312300273215, 0.11631278969095449, 0.11528519582086152, 0.11434120805565401, 0.11348091221838079, 0.11270362634523104, 0.11200794558497035, 0.11139181906369926, 0.11085265671611973, 0.11038746201522893, 0.10999298471204677, 0.10966588629659824, 0.10940291002973603, 0.1092010471253713, 0.10905769096972638, 0.10897077207488104, 0.10893886766317304, 0.10896128123188133, 0.10903808902009145, 0.10917015187662078, 0.10935909252451492, 0.10960723958257144, 0.10991754091677852, 0.11029344995396206, 0.11073878950443189, 0.11125759841333806, 0.11185396698185035, 0.11253186754142462, 0.11329498678528888, 0.11414656641310235, 0.11508925828747747, 0.11612499961565308, 0.11725491266948324, 0.11847923229223625, 0.11979726299669788, 0.12120736594555044, 0.1227069746420139, 0.12429263685970662, 0.12596007929686, 0.12770429071049708, 0.12951961889274635, 0.1313998767808661 ], [ 0.12740144636053521, 0.12573844634217413, 0.12413216056591102, 0.12258753738282456, 0.12110927894196202, 0.11970175001879448, 0.1183688826611407, 0.11711408080007685, 0.11594012989636143, 0.11484911735964033, 0.11384236976151645, 0.11292041266129764, 0.11208295811617622, 0.1113289236580711, 0.11065648475935723, 0.11006316071770249, 0.10954593165605431, 0.10910138217296833, 0.108725865301789, 0.10841567902003747, 0.1081672467097036, 0.10797729275064312, 0.10784300480730971, 0.10776217525815622, 0.10773331549138082, 0.10775573830743003, 0.10782960529015934, 0.10795593762061635, 0.10813659032940157, 0.10837419137142007, 0.10867204814748621, 0.1090340251974435, 0.10946439776151035, 0.10996768675456593, 0.11054848140762524, 0.1112112563652258, 0.11196019033237879, 0.11279899337813436, 0.1137307496713971, 0.11475778171989622, 0.11588154111479665, 0.11710252940520849, 0.11842025113440892, 0.11983319938885566, 0.12133887258063135, 0.12293381973532333, 0.12461371039651492, 0.1263734244530696, 0.12820715677095812, 0.13010853145104118 ], [ 0.125862804463218, 0.12420213290109999, 0.12260134418683347, 0.1210653418914651, 0.11959874611819965, 0.11820579982684568, 0.11689027138601375, 0.11565535771903805, 0.11450359336236844, 0.11343677143056885, 0.11245588274618817, 0.11156107913853455, 0.11075166608518976, 0.11002612847284955, 0.10938219137332701, 0.10881691551986275, 0.10832682483331013, 0.10790806111598542, 0.10755655912144027, 0.10726823379812042, 0.10703917070563541, 0.1068658104499763, 0.10674511844028342, 0.10667473223673762, 0.10665308010089261, 0.10667946592717752, 0.10675411738834906, 0.10687819575683555, 0.10705376739399489, 0.10728373829475152, 0.10757175433148093, 0.10792207097288156, 0.10833939727778935, 0.10882871988507745, 0.10939511352012526, 0.11004354517032715, 0.11077867947915343, 0.11160469299372167, 0.11252510460723521, 0.11354262882563153, 0.11465905736210334, 0.11587517308008623, 0.11719069857017303, 0.11860427980081838, 0.12011350348421952, 0.12171494519763187, 0.12340424401818667, 0.12517619854411954, 0.12702487871531928, 0.12894374779220094 ], [ 0.12433866676686096, 0.12268295970751816, 0.12109061800435048, 0.11956649735379123, 0.11811512764541723, 0.11674061680148394, 0.11544655145865025, 0.11423589908281745, 0.1131109170756248, 0.11207307509802633, 0.11112299706298968, 0.1102604289270688, 0.10948423748513306, 0.10879244386175987, 0.10818229339379717, 0.10765036128025858, 0.10719269095798827, 0.10680495988379476, 0.10648266548918621, 0.1062213226970493, 0.10601666365414764, 0.10586483026216818, 0.10576255063131255, 0.10570729162352957, 0.10569738105259556, 0.10573209471204441, 0.10581170507108911, 0.10593749010662391, 0.10611170226007784, 0.1063374988951715, 0.10661883689164983, 0.10696033516296773, 0.10736710995438933, 0.1078445887669438, 0.10839830963956021, 0.10903371325182071, 0.10975593580317268, 0.11056961078974491, 0.1114786875548887, 0.1124862737835861, 0.11359450794210102, 0.11480446609012375, 0.11611610562661215, 0.11752824652895058, 0.11903858868364463, 0.12064376215482163, 0.12233940583171465, 0.12412026892712066, 0.125980329297992, 0.12791292250590694 ], [ 0.12282834934382317, 0.12118001304770892, 0.1195988461637489, 0.11808965547863284, 0.11665687423248175, 0.11530446347151892, 0.11403581109369113, 0.11285363341125408, 0.11175988501815746, 0.11075568338730239, 0.10984125479059947, 0.10901590772541286, 0.10827803899687813, 0.10762517597600386, 0.107054056440766, 0.10656074499623125, 0.1061407825934621, 0.10578936337282951, 0.1055015311692665, 0.10527238670324579, 0.10509729583301529, 0.10497208926910663, 0.10489324478415979, 0.10485804406744051, 0.10486469782161419, 0.1049124343243373, 0.10500154834378848, 0.10513340890586226, 0.10531042590491829, 0.10553597691374243, 0.10581429679662518, 0.10615033389169046, 0.10654957763105385, 0.10701786351561442, 0.10756116232873233, 0.10818536129728894, 0.10889604549798262, 0.10969828805577402, 0.11059645749408047, 0.11159404990959058, 0.1126935524496999, 0.11389634292374881, 0.11520262840039797, 0.11661142350147462, 0.11812056699007294, 0.11972677335470679, 0.12142571456539929, 0.12321212612197717, 0.12507993096741388, 0.12702237477824607 ], [ 0.12133199577176887, 0.11969319715359084, 0.11812569661343864, 0.11663425301261521, 0.11522319822264573, 0.1138963359632072, 0.11265683945317126, 0.11150715294185487, 0.11044890312498132, 0.10948282703228679, 0.10860872305757743, 0.10782543128414375, 0.10713084810108152, 0.10652197835330893, 0.10599502604877513, 0.10554552216113712, 0.10516848555949908, 0.10485861082017109, 0.10461047484889748, 0.10441875302272181, 0.10427843502397142, 0.10418503067555492, 0.1041347568143672, 0.10412469742461941, 0.10415293073788989, 0.1042186186372564, 0.10432205534924878, 0.10446467397933126, 0.10464901089809998, 0.10487862931123956, 0.105158004570535, 0.10549237494252142, 0.10588756267568576, 0.10634977130278267, 0.10688536615188196, 0.1075006459491787, 0.10820161407639954, 0.10899375837839623, 0.1098818482928031, 0.11086975741897447, 0.11196031844079375, 0.11315521562085071, 0.11445491801561444, 0.11585865430112309, 0.11736442785339109, 0.11896906870038615, 0.12066831732174013, 0.1224569341300281, 0.1243288278677926, 0.1262771960767177 ], [ 0.11985076168739349, 0.11822342740477765, 0.11667184230246903, 0.11520072019987916, 0.11381428851704066, 0.11251618454088819, 0.11130935192738116, 0.11019594276149737, 0.1091772313814926, 0.10825354667181447, 0.10742422950000217, 0.10668762132226713, 0.10604108868657798, 0.10548108648282759, 0.10500326047407042, 0.1046025871064921, 0.10427354609149928, 0.10401031903220041, 0.1038070056395443, 0.10365784799147282, 0.1035574528875211, 0.10350100261282756, 0.10348444525165117, 0.10350465693827365, 0.1035595699426357, 0.10364826210813852, 0.10377100476841446, 0.10392926778889466, 0.10412568177314369, 0.10436395874864209, 0.10464877383465274, 0.10498561153858009, 0.1053805814602874, 0.10584020931255554, 0.10637121025803925, 0.10698025254419385, 0.10767372017780165, 0.10845748379238922, 0.10933668880448143, 0.11031556934291245, 0.11139729524395085, 0.1125838576827077, 0.1138759968827788, 0.11527317299614272, 0.11677357889191803, 0.11837419145225209, 0.1200708562286928, 0.12185839908572438, 0.1237307578013508, 0.12568112648938276 ], [ 0.1183869820027386, 0.11677280613961313, 0.11523914489679665, 0.113790671621413, 0.1124315076811736, 0.11116511607304949, 0.10999419702518608, 0.10892059118271587, 0.10794519676832219, 0.10706790748799196, 0.10628757777773534, 0.10560202117721737, 0.10500804616640012, 0.10450153179408019, 0.10407754302918092, 0.10373048320573262, 0.10345427846793477, 0.10324258699783903, 0.1030890242207887, 0.10298739425267563, 0.10293191761118044, 0.10291744561124504, 0.10293965279069019, 0.10299520001475514, 0.10308186242893237, 0.10319861802319992, 0.1033456941269373, 0.10352457060504264, 0.10373793984957282, 0.10398962487315637, 0.10428445795076588, 0.10462812337267882, 0.10502696899931159, 0.1054877924546201, 0.10601760892485143, 0.10662340856530096, 0.10731191234402884, 0.1080893356332009, 0.1089611688667519, 0.10993198402280543, 0.11100527452697805, 0.11218333445153503, 0.11346718072757976, 0.11485651968051135, 0.11634975676741827, 0.11794404616546433, 0.11963537502608995, 0.12141867590434965, 0.123287960155336, 0.12523646494648855 ], [ 0.11694431334556779, 0.11534477332817399, 0.11383081297323297, 0.11240707109397197, 0.11107756265140768, 0.10984556959460316, 0.10871353581623039, 0.10768297209749135, 0.1067543775970508, 0.10592718466136361, 0.10519973337745062, 0.10456928129214917, 0.10403205210288534, 0.10358332499115668, 0.10321756380732303, 0.10292858276413232, 0.10270974291329356, 0.10255417169758436, 0.10245499646459409, 0.10240558209096208, 0.10239976280443994, 0.10243205883512609, 0.10249786955078484, 0.10259363607969219, 0.10271696794190843, 0.10286672976149497, 0.10304308561996883, 0.10324749998147811, 0.10348269536240674, 0.10375256805724152, 0.1040620643154042, 0.10441702044109523, 0.10482397139720384, 0.10528993364113669, 0.10582216906975851, 0.10642793802207519, 0.10711425016348479, 0.10788762261495446, 0.10875385475944728, 0.10971782865463929, 0.11078334286405152, 0.11195298582430471, 0.11322805271185647, 0.1146085073439417, 0.11609298817249257, 0.1176788551387689, 0.11936227225197456, 0.12113831937956261, 0.12300112595777936, 0.12494401914027904 ], [ 0.1155278442077502, 0.11394422427221346, 0.11245152656325168, 0.11105436223732632, 0.10975664041891062, 0.10856145614652696, 0.10747098494701032, 0.10648639021032771, 0.10560775005827858, 0.10483401042383421, 0.10416297048102179, 0.10359130535213917, 0.10311462921752233, 0.10272759969726683, 0.10242406186994146, 0.10219722778811237, 0.10203988509450083, 0.1019446265497017, 0.10190409109867214, 0.10191120659097923, 0.10195942440728503, 0.102042936940493, 0.1021568699971324, 0.10229744356728447, 0.10246209591077313, 0.10264956740119918, 0.1028599419748349, 0.10309464530885319, 0.10335640000449324, 0.10364913910898392, 0.10397788032683919, 0.10434856429960161, 0.10476786141025954, 0.10524295269997858, 0.10578129163448839, 0.10639035454434784, 0.10707738846851884, 0.107849165713403, 0.10871175456214743, 0.10967031512513627, 0.11072892826440865, 0.11189046388085107, 0.11315649273374104, 0.11452724354786867, 0.11600160467862301, 0.11757716728365919, 0.11925030499739248, 0.12101628367092811, 0.12286939390060798, 0.12480309882239043 ], [ 0.11414416533162185, 0.11257758652766113, 0.11110751994707568, 0.10973855636003217, 0.10847450014158909, 0.10731825419906142, 0.1062717144520025, 0.10533568034856101, 0.10450978821915144, 0.10379247404653741, 0.10318097139334527, 0.10267134877043305, 0.10225858873469608, 0.1019367086364654, 0.10169892041870258, 0.10153782445297431, 0.10144563031724782, 0.10141439586457145, 0.10143627501089393, 0.10150376441135875, 0.1016099395455641, 0.10174867158225262, 0.10191481759721499, 0.10210437812175348, 0.1023146174647823, 0.10254414367282023, 0.1027929463023401, 0.1030623913537711, 0.10335517376881062, 0.10367522886344319, 0.10402760501298178, 0.10441830087627743, 0.10485407147987785, 0.10534220858399367, 0.10589030188407783, 0.10650598868451953, 0.1071967005969762, 0.10796941642612007, 0.10883043057243663, 0.10978514589692244, 0.11083789900305355, 0.11199182431848395, 0.11324876130376244, 0.11460920674958341, 0.11607231166561162, 0.11763591994311907, 0.11929664399788881, 0.12104997112298727, 0.1228903933857271, 0.12481155359696906 ], [ 0.11280139310711831, 0.11125284847284735, 0.10980661482393492, 0.1084672695536913, 0.10723851340760503, 0.10612305229235051, 0.10512249198590182, 0.10423725255293678, 0.10346650933514738, 0.10280816687041122, 0.1022588709543753, 0.1018140623296322, 0.10146807329322381, 0.10121426604740731, 0.10104520912099374, 0.10095288590602448, 0.10092892750171874, 0.10096486078597504, 0.1010523620141364, 0.10118350626280607, 0.10135100361092415, 0.10154841395197703, 0.10177033360988945, 0.10201254834046686, 0.10227214871633244, 0.10254760522756179, 0.10283880163392906, 0.10314702616864839, 0.1034749211412863, 0.10382639236588635, 0.104206480706208, 0.10462119893601483, 0.10507733809261109, 0.10558224855927928, 0.10614360221030036, 0.106769143012587, 0.10746643438673674, 0.10824261225230629, 0.10910415288281929, 0.11005666436739765, 0.11110470956174898, 0.11225166692555769, 0.11349963367714787, 0.11484937340988466, 0.11630030791557329, 0.11785055067135362, 0.1194969774726278, 0.12123532819140821, 0.12306033269582162, 0.12496585359818771 ], [ 0.11150913930229779, 0.1099795324894935, 0.10855819653509599, 0.107249701458923, 0.1060576449880795, 0.10498453120296428, 0.10403166585869601, 0.10319907550835984, 0.1024854573173086, 0.10188816559874837, 0.10140323961841116, 0.10102547519484235, 0.10074854022766241, 0.1005651317449865, 0.1004671696239667, 0.10044602004080184, 0.10049274013259354, 0.10059833441095915, 0.10075401317939138, 0.10095144351898032, 0.10118298420840545, 0.10144189709008457, 0.10172252873441265, 0.1020204576524563, 0.1023326036581157, 0.10265729721490886, 0.10299430769034916, 0.10334483038762551, 0.10371143306349836, 0.10409796342427921, 0.10450941987584225, 0.1049517886395569, 0.10543185126491715, 0.10595696757255622, 0.10653484011168766, 0.10717326723837652, 0.1078798928064166, 0.10866196108180912, 0.10952608571564085, 0.1104780413331426, 0.11152258546103912, 0.11266331712859365, 0.11390257662030315, 0.11524138867700132, 0.11667944913123887, 0.1182151527346017, 0.11984565798725186, 0.12156698326866375, 0.12337412758634649, 0.12526120883056138 ], [ 0.11027842144337334, 0.10876860673295459, 0.10737312705285298, 0.10609654924351146, 0.10494236754958, 0.10391287914918856, 0.10300908054627245, 0.10223059226543278, 0.10157561869689738, 0.10104094868821464, 0.1006220006191999, 0.10031291336678919, 0.10010668198038879, 0.0999953343015458, 0.09997014243056632, 0.10002186108270145, 0.10014098363157577, 0.10031800606429324, 0.10054368914276521, 0.10080930968292491, 0.10110689288831862, 0.10142941895241953, 0.1017709985283902, 0.10212701303503922, 0.10249421703771022, 0.10287080106554362, 0.10325641419087563, 0.10365214652204086, 0.10406047248928703, 0.10448515648965363, 0.10493112315704171, 0.10540429528589107, 0.10591140328860257, 0.10645977100669578, 0.10705708368756696, 0.10771114491036443, 0.10842963009306503, 0.1092198448165636, 0.11008849643836381, 0.11104148723726061, 0.11208373657352332, 0.11321903826849752, 0.11444995767304342, 0.11577777083824238, 0.11720244600309093, 0.11872266547107435, 0.1203358840495868, 0.12203841872489782, 0.1238255632365854, 0.12569172073075963 ], [ 0.10912150974217397, 0.10763233110157358, 0.10626359014146697, 0.10501985209446209, 0.10390450563584229, 0.1029196354724687, 0.10206592036513079, 0.10134256431297002, 0.10074726763052988, 0.10027624296038976, 0.09992427899768182, 0.09968485205777611, 0.09955028285780747, 0.09951193328812984, 0.09956043577483958, 0.0996859462649871, 0.09987841099616042, 0.10012783704068615, 0.10042455705913679, 0.10075947962043347, 0.10112431768355502, 0.10151178922815168, 0.10191578543065961, 0.10233150310641309, 0.1027555393137486, 0.1031859470181209, 0.10362225155019728, 0.1040654282942383, 0.10451784266074884, 0.10498315398703398, 0.10546618562560199, 0.10597276416704611, 0.10650953152471489, 0.10708373447946216, 0.10770299720824919, 0.10837508323184296, 0.10910765401814654, 0.10990803205565616, 0.11078297645221082, 0.1117384789225767, 0.11277958734809476, 0.11391026292021621, 0.1151332752767711, 0.11645013812303662, 0.11786108576111205, 0.11936508891385593, 0.12095990640106266, 0.1226421677518049, 0.12440748081438541, 0.12625055789239492 ], [ 0.10805170876402348, 0.10658403540939901, 0.10524286659194676, 0.10403276412446434, 0.10295700692931213, 0.10201746103224497, 0.10121447989043601, 0.10054684303002476, 0.10001173951644163, 0.09960480061910269, 0.09932018334010692, 0.099150703521414, 0.09908801433778877, 0.09912282342561073, 0.09924513993187666, 0.0994445415387954, 0.09971045106326792, 0.10003241248326768, 0.10040035706734897, 0.10080485150277677, 0.10123732135041107, 0.10169024463945439, 0.10215731182848685, 0.10263354961998408, 0.10311540718487298, 0.10360080422860247, 0.10408914103564286, 0.1045812712091754, 0.10507943833168926, 0.10558717826741403, 0.10610918936104995, 0.10665117339824118, 0.10721965090114258, 0.10782175513108551, 0.10846501002435086, 0.10915709813202362, 0.10990562538154017, 0.11071789002184979, 0.11160066335112451, 0.11255998966758582, 0.11360101227622729, 0.11472783132141574, 0.1159433977474595, 0.11724944591967851, 0.11864646551217162, 0.1201337113518486, 0.12170924816537211, 0.12337002574510052, 0.12511197902718543, 0.12693014700306007 ], [ 0.10708307510792216, 0.10563783099973151, 0.10432504081334791, 0.10314925711163009, 0.10211364244467082, 0.1012198372964677, 0.1004678635194175, 0.0998560714146189, 0.09938113666953038, 0.09903811070237206, 0.09882052484033586, 0.09872054551178783, 0.0987291746178226, 0.09883648677978583, 0.09903189345543581, 0.09930442307206043, 0.09964300631076133, 0.10003675636288195, 0.10047523517663963, 0.10094869820923935, 0.10144831180259332, 0.1019663388534445, 0.10249628984482159, 0.103033037488236, 0.10357289418048023, 0.10411365222364363, 0.10465458733279709, 0.10519642641649345, 0.10574128101953188, 0.1062925482220305, 0.10685478124228394, 0.10743353252762024, 0.10803517275259374, 0.10866668986887472, 0.1093354731313309, 0.11004908779963023, 0.11081504690216112, 0.11164058695429578, 0.11253245475036086, 0.11349671221753162, 0.11453856577935986, 0.11566222571890224, 0.11687079969784422, 0.11816622296834926, 0.11954922603674542, 0.12101933875196974, 0.12257492814682121, 0.12421326598599501, 0.12593062096423405, 0.12772236989755406 ], [ 0.10623007620882904, 0.10480826108295646, 0.1035246442982755, 0.10238375889006608, 0.10138864183657378, 0.10054070073201343, 0.09983962124932888, 0.09928332364626957, 0.0988679740986882, 0.09858805347120754, 0.09843648259408389, 0.0984047996096826, 0.09848338187832567, 0.09866170260726076, 0.09892861097294522, 0.09927262408098701, 0.09968221955051806, 0.10014611862599271, 0.10065355126973924, 0.1011944964356174, 0.10175989246706578, 0.10234181415642234, 0.10293361436126255, 0.10353002916530907, 0.10412724640597054, 0.10472293800564804, 0.10531625699437527, 0.10590780045881243, 0.10649953995831399, 0.10709472126812684, 0.10769773568718435, 0.10831396561316904, 0.10894960765145702, 0.109611477176487, 0.11030679897010454, 0.11104298926496059, 0.11182743514729622, 0.1126672777361912, 0.11356920576967472, 0.11453926611853593, 0.11558269726948998, 0.11670379096091275, 0.11790578595083412, 0.11919079642532258, 0.12055977592792481, 0.1220125160401931, 0.12354767750478954, 0.12516285017565557, 0.12685463719294432, 0.12861875816247817 ], [ 0.10550719980786438, 0.10410989976699891, 0.10285624637967487, 0.10175073827908412, 0.10079627519217219, 0.09999402434452652, 0.09934333297383306, 0.09884169519157997, 0.09848477842697548, 0.0982665110095713, 0.09817922851671552, 0.09821387279585164, 0.09836023449563444, 0.09860722781018086, 0.09894318509787829, 0.09935615904893216, 0.09983422097322835, 0.10036574530573204, 0.10093967229841297, 0.10154574282832364, 0.10217470110071869, 0.10281846263389809, 0.10347024621631618, 0.10412466951918999, 0.1047778087612953, 0.10542722331244718, 0.10607194645448216, 0.10671244376102347, 0.10735054077235974, 0.10798932188243723, 0.10863300266159759, 0.10928677823622227, 0.1099566508419689, 0.11064924024825662, 0.11137158138489053, 0.11213091413486227, 0.11293447082208603, 0.11378926734180245, 0.11470190407739253, 0.11567838265458782, 0.116723944159745, 0.11784293368254987, 0.11903869496313359, 0.12031349759475128, 0.12166849775325086, 0.12310373191030882, 0.12461814155972516, 0.12620962575389133, 0.12787511729443518, 0.12961067779622892 ], [ 0.10492852834170509, 0.10355691471706889, 0.10233400787637467, 0.10126425276888426, 0.10035039808601287, 0.09959336362085976, 0.09899215891704433, 0.09854386130423791, 0.09824365788324897, 0.09808495187192645, 0.09805952945300897, 0.09815777939893196, 0.09836895473070154, 0.0986814637831648, 0.0990831773844054, 0.0995617393115993, 0.10010486851894533, 0.10070064353324029, 0.10133776156324671, 0.10200576700125728, 0.10269524591556163, 0.10339798472956443, 0.10410709251817851, 0.10481708724152429, 0.10552394683171486, 0.10622512642098121, 0.10691954322379175, 0.1076075307334429, 0.10829076402735541, 0.10897215814501773, 0.10965574174445757, 0.11034650857766341, 0.11105024975628466, 0.1117733702920497, 0.11252269395966545, 0.11330526109487075, 0.11412812444492712, 0.11499814856392648, 0.1159218184220261, 0.11690506281750987, 0.11795309780465751, 0.11907029466821568, 0.12026007600928006, 0.12152484231338423, 0.12286593003332448, 0.12428360083878667, 0.12577706036916309, 0.12734450367358244, 0.12898318361062228, 0.13068949785830428 ], [ 0.1045072969744471, 0.10316261309003233, 0.10197121810522626, 0.10093748015516492, 0.10006398165687659, 0.09935138902443041, 0.09879837854452801, 0.09840162622670236, 0.09815586540913361, 0.09805401132789532, 0.09808734731482835, 0.09824576334345397, 0.09851803474261975, 0.09889212729638677, 0.09935551467383513, 0.09989549501350989, 0.10049949521980844, 0.10115535375433637, 0.10185157508368864, 0.10257755120367298, 0.10332374761694674, 0.10408185270559539, 0.10484489059675046, 0.10560729840593054, 0.1063649692282861, 0.1071152625142928, 0.10785698359540627, 0.10859033419040835, 0.10931683578596031, 0.110039227892162, 0.11076134335778594, 0.11148796320671353, 0.11222465382779477, 0.11297758979960464, 0.11375336612860612, 0.11455880417916954, 0.11540075602084204, 0.11628591225041492, 0.11722061850271429, 0.11821070579273159, 0.11926133949795026, 0.12037689118316765, 0.12156083660883711, 0.12281568219503163, 0.12414292100841176, 0.12554301808752, 0.12701542371655425, 0.1285586121874899, 0.1301701427264762, 0.13184673864993351 ], [ 0.10425545759108892, 0.10293899414640251, 0.10177983958451008, 0.100782259167864, 0.09994865323531987, 0.09927943078931004, 0.09877294362759093, 0.09842548840604093, 0.09823137954156103, 0.0981830909435771, 0.09827145982974542, 0.09848594193122827, 0.09881490466600899, 0.0992459435660422, 0.09976620735214252, 0.10036271832374258, 0.10102267681028297, 0.10173374092322242, 0.10248427539775683, 0.10326356565247617, 0.10406199515707769, 0.10487118571321834, 0.10568410132740247, 0.10649511704358544, 0.1073000544894351, 0.10809618606429759, 0.10888220974469223, 0.10965819647879686, 0.11042551214421271, 0.11118671609706815, 0.11194543847324531, 0.11270623862738836, 0.11347444741062597, 0.11425599637780036, 0.11505723744998664, 0.11588475699696629, 0.11674518869668545, 0.11764502981964693, 0.11859046572178403, 0.11958720726388526, 0.12064034557812402, 0.12175422806289192, 0.122932358720358, 0.12417732499674307, 0.12549075220441117, 0.1268732854740551, 0.12832459808672003, 0.1298434240474746, 0.1314276119501316, 0.13307419659042158 ], [ 0.10418327309794427, 0.10289633400793136, 0.10177008678848058, 0.10080866606999615, 0.1000142748016651, 0.09938706326014499, 0.09892507233018387, 0.09862424787879766, 0.0984785282001004, 0.09848000133252871, 0.09861912421898068, 0.09888499180042759, 0.09926564162403122, 0.09974837857124208, 0.10032010477677897, 0.10096764142370046, 0.10167803146162326, 0.1024388149875808, 0.10323827169288038, 0.10406562715523786, 0.1049112216950227, 0.10576664196776053, 0.10662481645644963, 0.1074800766271935, 0.10832818581247723, 0.1091663379839439, 0.10999312855833583, 0.11080849931980974, 0.11161365949601985, 0.1124109850344206, 0.11320389821404475, 0.11399672990654947, 0.11479456706529333, 0.11560308835634185, 0.1164283912228358, 0.11727681405619528, 0.118154757488962, 0.11906850907589749, 0.12002407574484848, 0.1210270283366549, 0.12208236228669779, 0.12319437802030757, 0.12436658395189491, 0.12560162412665246, 0.12690123157622524, 0.1282662074416013, 0.12969642491924321, 0.13119085617924692, 0.13274761964568604, 0.13436404446133557 ], [ 0.10429896622622149, 0.10304282776203696, 0.10195006487840266, 0.10102465355157314, 0.10026858564460558, 0.09968175482617343, 0.09926190968465681, 0.09900468017553672, 0.09890367842461403, 0.09895066958460436, 0.09913580360849207, 0.09944789506202494, 0.09987473583674264, 0.10040342495779812, 0.10102070046119811, 0.1017132602058699, 0.10246806105702884, 0.10327258870085325, 0.10411509307147263, 0.10498478674445276, 0.10587200554596944, 0.10676833201165421, 0.1076666832425629, 0.10856136522880168, 0.10944809594239684, 0.11032399953847143, 0.11118757393518336, 0.1120386339398066, 0.11287823200478744, 0.11370855867085654, 0.11453282480596776, 0.11535512788687254, 0.1161803047898182, 0.11701377384211711, 0.11786136921104662, 0.11872917103617374, 0.11962333500515485, 0.12054992528818367, 0.12151475484087425, 0.12252323702424997, 0.1235802522497039, 0.12469003292776872, 0.1258560693917768, 0.1270810387090311, 0.1283667574273655, 0.1297141583903583, 0.1311232908520535, 0.13259334229250566, 0.13412267963133886, 0.13570890699662397 ], [ 0.10460844435835887, 0.10338431115779546, 0.10232549108220274, 0.10143577468687277, 0.10071693173711445, 0.10016860537010822, 0.09978827546057371, 0.09957129655420538, 0.09951101045525884, 0.09959892819061136, 0.09982497132763347, 0.10017775907914013, 0.10064492563217825, 0.10121345175417858, 0.10186999576960348, 0.1026012110943914, 0.10339404021945683, 0.104235977921136, 0.10511529920218332, 0.10602124980321626, 0.10694419895824046, 0.10787575538167783, 0.10880884831760707, 0.10973777594188393, 0.11065822358556116, 0.11156725424204647, 0.11246327371653479, 0.11334597264342397, 0.11421624748669676, 0.11507610258393672, 0.11592853531595822, 0.1167774065871254, 0.11762729898083384, 0.11848336519477029, 0.11935116963713448, 0.12023652634660172, 0.12114533664914386, 0.12208343014576811, 0.12305641270022358, 0.12406952503401739, 0.12512751531674154, 0.12623452875497432, 0.12739401664070818, 0.12860866664388498, 0.1298803553610755, 0.13121012331184442, 0.1325981717596868, 0.13404387997858735, 0.1355458409360275, 0.13710191285424284 ], [ 0.10511511673620051, 0.10392407856664314, 0.1028995154386011, 0.10204500842666878, 0.10136209777196016, 0.10085018638013539, 0.10050651355337864, 0.10032620349093525, 0.10030238776728097, 0.10042639570182456, 0.10068800196101198, 0.10107571743054591, 0.101577107664382, 0.10217912308049754, 0.10286842630830077, 0.10363170431386405, 0.10445595569125662, 0.10532874639463623, 0.1062384298699094, 0.107174329816065, 0.10812688556706991, 0.10908776132906457, 0.11004992129034763, 0.11100767303296692, 0.11195668181538965, 0.11289395826210116, 0.11381782187096887, 0.1147278425985614, 0.11562476265541653, 0.11651040056910707, 0.11738753957020308, 0.11825980242969701, 0.11913151502044106, 0.12000756107483264, 0.12089323084396135, 0.12179406660126815, 0.12271570814421019, 0.12366374159668235, 0.12464355487119529, 0.12566020308613257, 0.12671828703164278, 0.12782184743097225, 0.12897427725869282, 0.13017825377329154, 0.1314356912311007, 0.1327477145130122, 0.1341146531611011, 0.13553605463553273, 0.13701071500425174, 0.1385367248013304 ], [ 0.10581981327046362, 0.1046628062649252, 0.1036726496002185, 0.10285269476358957, 0.10220424926605015, 0.10172649026687852, 0.10141644847297104, 0.10126906600136237, 0.10127732663077328, 0.1014324517400667, 0.10172415089893413, 0.10214091304259516, 0.10267032268451685, 0.10329938568537221, 0.10401485045967715, 0.10480351277607527, 0.10565249505835793, 0.10654949392452027, 0.10748299230470253, 0.10844243466314439, 0.10941836552961584, 0.11040253272310759, 0.11138795738315399, 0.11236897330092242, 0.11334123816084707, 0.11430171925672156, 0.11524865611279139, 0.11618150228265711, 0.11710084846182892, 0.11800832896290309, 0.11890651358131021, 0.11979878692848259, 0.12068921742253083, 0.12158241829023148, 0.12248340312791436, 0.12339743876710682, 0.12432989836485116, 0.1252861177587934, 0.1262712581655457, 0.1272901782341822, 0.1283473182791887, 0.1294465992027899, 0.13059133818059168, 0.13178418264388722, 0.13302706347419546, 0.13432116766611424, 0.13566693005331504, 0.13706404306977912, 0.13851148297060048, 0.14000755049301944 ], [ 0.10672080596470448, 0.10559858143446627, 0.1046428033806461, 0.10385657847858516, 0.10324098283522391, 0.1027949861924477, 0.10251544549839657, 0.10239717070901817, 0.10243306058333476, 0.10261430135798469, 0.10293061714592927, 0.10337055815406604, 0.10392181156789027, 0.10457152016702055, 0.10530659516251892, 0.1061140120073642, 0.1069810806114845, 0.10789568411992352, 0.1088464829043679, 0.10982308249905756, 0.11081616580775094, 0.11181759102369392, 0.11282045739709161, 0.11381914133939572, 0.1148093054636478, 0.11578788311254343, 0.1167530407951395, 0.11770412079762953, 0.11864156609550819, 0.11956682960116813, 0.12048226974698031, 0.1213910344329866, 0.12229693545524815, 0.12320431566294796, 0.12411791125116878, 0.12504271175895995, 0.12598382048341442, 0.1269463181140716, 0.12793513241361124, 0.1289549167004184, 0.13000993971250635, 0.13110398914529606, 0.13224029076237623, 0.13342144449311819, 0.1346493783773011, 0.13592532062518947, 0.1372497894662181, 0.13862259989557169, 0.1400428859275108, 0.14150913655335512 ], [ 0.10781392584006819, 0.10672702880281912, 0.10580542003097268, 0.10505195159063029, 0.10446747401537554, 0.10405077119812507, 0.10379856288370938, 0.10370557685100494, 0.10376468802269245, 0.10396711717658672, 0.10430267821731279, 0.10476006050092164, 0.10532713166128871, 0.10599124670575732, 0.10673955058058199, 0.10755926359582751, 0.10843794165915205, 0.10936370585508852, 0.1103254382624354, 0.11131294286808907, 0.11231707194451644, 0.1133298193161078, 0.11434438260088338, 0.11535519685760104, 0.11635794218051905, 0.11734952774605174, 0.118328054696587, 0.11929276010120325, 0.12024394410034348, 0.12118288224727458, 0.1221117250170311, 0.12303338646716933, 0.1239514240993859, 0.12486991207562369, 0.12579331007015127, 0.12672633017000312, 0.12767380434769413, 0.12864055509949515, 0.1296312718486352, 0.1306503956382244, 0.13170201447166266, 0.13278977139451953, 0.1339167870551858, 0.135085598044477, 0.13629811181694526, 0.13755557846507344, 0.13885857908149135, 0.140207029934224, 0.14160020122380582, 0.14303674881204695 ], [ 0.10909276132951128, 0.10804151974704988, 0.10715369406916356, 0.10643187752803877, 0.105876705081886, 0.10548679878547682, 0.10525877825648992, 0.10518733763045827, 0.10526538585906865, 0.1054842429996089, 0.10583388177028245, 0.1063032014541115, 0.10688032036227664, 0.10755287344524957, 0.10830830303083164, 0.10913413274059768, 0.11001821703840514, 0.11094896128471943, 0.11191550937419194, 0.11290789787690445, 0.11391717702520497, 0.1149354998929966, 0.11595618175126007, 0.11697373192421374, 0.11798386059342693, 0.11898346297672516, 0.11997058320864251, 0.12094436011983334, 0.12190495699093284, 0.12285347726589704, 0.12379186816382351, 0.12472281413041934, 0.12564962211678105, 0.1265761007540873, 0.12750643559356162, 0.12844506268382352, 0.1293965428428113, 0.1303654390290248, 0.13135619920858135, 0.13237304703554928, 0.1334198825032478, 0.13450019447999284, 0.1356169867176612, 0.13677271852614095, 0.13796926085865957, 0.1392078680745885, 0.14048916516330368, 0.141813149751338, 0.14317920779991333, 0.14458614155150373 ], [ 0.1105489192677914, 0.10953344384936622, 0.1086788507449701, 0.10798747547867711, 0.10745975101348398, 0.10709416311651039, 0.1068872677220688, 0.10683377108282162, 0.10692666931773508, 0.10715744013945723, 0.10751627651467666, 0.10799235007609315, 0.10857409137400029, 0.1092494744548356, 0.11000629456505844, 0.11083242970160874, 0.11171607894896862, 0.11264597277803882, 0.11361155252300939, 0.11460311796826494, 0.11561194331172343, 0.11663036272600151, 0.11765182735637413, 0.11867093593788883, 0.11968344135350478, 0.12068623545781267, 0.12167731441486528, 0.12265572669014185, 0.12362150572975701, 0.1245755892771832, 0.12551972723154353, 0.12645637994584027, 0.12738860889538842, 0.128319961707684, 0.1292543536222417, 0.13019594752697491, 0.1311490347793515, 0.1321179190486151, 0.13310680539406922, 0.1341196967109695, 0.13516029952153827, 0.1362319408610242, 0.13733749771076953, 0.13847934007131346, 0.1396592883636484, 0.14087858541535916, 0.14213788285262924, 0.1434372413018432, 0.1447761434271374, 0.1461535185108438 ], [ 0.11217232727031387, 0.11119252073049089, 0.11037046427815952, 0.10970824168430494, 0.1092061003286941, 0.10886241586073127, 0.10867371532038572, 0.10863475900762028, 0.10873867758763198, 0.10897715748035289, 0.10934066488786673, 0.1098186971138615, 0.11040004921193501, 0.1110730843916978, 0.11182599781680302, 0.11264706518147692, 0.11352486947249722, 0.11444850136431055, 0.11540773056816485, 0.11639314704323524, 0.11739627222550265, 0.11840964133730089, 0.11942685844156181, 0.12044262625428419, 0.1214527528882793, 0.12245413773054745, 0.12344473860696095, 0.12442352230348407, 0.1253904004243399, 0.12634615249544412, 0.12729233817809874, 0.12823120044763955, 0.12916556161235906, 0.13009871409242674, 0.13103430793579834, 0.1319762371046999, 0.13292852660739748, 0.13389522256079286, 0.13488028723638681, 0.13588750105450245, 0.13692037334226387, 0.13798206345740024, 0.13907531360543024, 0.1402023943504509, 0.1413650634526951, 0.14256453827606594, 0.14380148161521283, 0.14507600041416963, 0.14638765650576216, 0.14773548820883625 ], [ 0.11395155642892513, 0.11300713040193482, 0.1122167927057479, 0.11158238541153681, 0.11110398873122682, 0.11077989412479151, 0.11060663203964358, 0.11057905416924323, 0.11069046670369252, 0.1109328079856438, 0.1112968616060744, 0.11177249448670021, 0.11234890896772864, 0.11301489828372059, 0.1137590958939935, 0.11457021070567643, 0.11543724204373795, 0.11634967006610664, 0.11729761902686361, 0.11827199224934087, 0.11926457883304602, 0.12026813297871515, 0.12127642740152506, 0.12228428265924916, 0.12328757440299415, 0.12428322061546211, 0.12526915088202972, 0.12624425968137876, 0.12720834561375957, 0.12816203842593213, 0.1291067156539523, 0.130044410692848, 0.13097771411457182, 0.1319096700866411, 0.1328436697842686, 0.13378334372703743, 0.1347324549945046, 0.135694795270901, 0.13667408562581448, 0.13767388384624096, 0.13869749998988745, 0.13974792162835378, 0.1408277499946423, 0.14193914794969748, 0.14308380034877755, 0.14426288703509793, 0.1454770683319622, 0.14672648256272922, 0.1480107548166512, 0.14932901591181413 ], [ 0.11587414542015233, 0.11496464286809507, 0.11420510995102731, 0.11359716034520795, 0.11314072668618017, 0.11283404118605146, 0.1126736669016637, 0.11265457923377976, 0.11277029420198538, 0.11301303734164862, 0.11337394498275519, 0.11384328837059185, 0.1144107106297245, 0.11506546689538331, 0.11579665889172745, 0.11659345662586093, 0.117445301480332, 0.11834208663689547, 0.1192743123040164, 0.12023321455345919, 0.12121086764892113, 0.1222002605634916, 0.12319534895270137, 0.12419108421333266, 0.12518342145976924, 0.12616930833476991, 0.1271466565810425, 0.12811429826798668, 0.12907192852059196, 0.13002003655304586, 0.13095982677918935, 0.13189313176033765, 0.13282231875773395, 0.1337501916773781, 0.134679890221491, 0.13561478808360536, 0.13655839203245387, 0.1375142437126669, 0.13848582593812822, 0.13947647515904757, 0.1404893016416785, 0.14152711870898071, 0.14259238215411554, 0.14368714066305624, 0.14481299777787512, 0.14597108561119976, 0.1471620501994007, 0.14838604807218436, 0.14964275333355484, 0.15093137430574674 ], [ 0.11792691064976067, 0.11705173154059151, 0.1163220198021806, 0.11573917639583026, 0.11530300638452932, 0.11501170609234873, 0.11486189689844632, 0.11484870502300594, 0.11496588398752298, 0.11520597406911118, 0.11556049124751665, 0.1160201370088738, 0.11657501996587975, 0.11721488052829161, 0.11792931068505519, 0.11870796217180733, 0.11954073771663813, 0.12041796152090818, 0.12133052651249832, 0.12227001711953034, 0.1232288073072834, 0.12420013438803168, 0.125178149666365, 0.12615794735064248, 0.12713557338165726, 0.1281080159408458, 0.12907317943797086, 0.1300298437723152, 0.13097761063556151, 0.13191683859559022, 0.13284856867888156, 0.13377444216003553, 0.1346966122703547, 0.13561765154995356, 0.13654045658317573, 0.1374681518670033, 0.138403994557591, 0.13935128181201026, 0.1403132623826552, 0.14129305402432035, 0.1422935681349593, 0.14331744286992726, 0.1443669857487551, 0.14544412651917182, 0.14655038076409724, 0.14768682444485423, 0.14885407928052136, 0.15005230858212298, 0.15128122290353008, 0.15254009464913987 ], [ 0.12009623121840941, 0.11925465942907235, 0.11855374106181689, 0.11799468158031612, 0.11757717823335652, 0.11729941280257367, 0.11715808702979583, 0.11714849993050082, 0.11726466385994225, 0.11749945414179759, 0.1178447854860904, 0.1182918074327562, 0.11883111069546015, 0.11945293650404254, 0.12014738174893473, 0.12090459377663888, 0.1217149499215811, 0.12256921814821795, 0.12345869640698333, 0.12437532940114258, 0.12531180237535028, 0.12626161225646357, 0.12721911701078192, 0.12817956445184103, 0.12913910196913153, 0.13009476878287946, 0.1310444723936813, 0.1319869509147149, 0.1329217229694183, 0.1338490268242939, 0.13476975041475525, 0.1356853539166727, 0.13659778651832644, 0.13750939905429826, 0.13842285416937516, 0.13934103568005937, 0.14026695878628984, 0.14120368274894268, 0.14215422758301416, 0.14312149621699852, 0.14410820343305294, 0.14511681272985227, 0.14614948204324182, 0.1472080190243315, 0.1482938463184727, 0.14940797702146907, 0.15055100022240636, 0.15172307628694687, 0.1529239413014878, 0.15415291989651278 ], [ 0.12236830164742507, 0.1215595313857091, 0.1208863575343303, 0.12034980806353514, 0.1199494913910319, 0.11968359381241145, 0.11954891579160036, 0.11954094622615312, 0.1196539717675788, 0.11988121649493796, 0.12021500586757522, 0.12064694801800684, 0.12116812511842585, 0.12176928772910117, 0.12244104562861617, 0.12317404951836981, 0.12395915906156049, 0.12478759384303768, 0.1256510649250145, 0.12654188565596405, 0.1274530612252833, 0.1283783571284443, 0.1293123472194792, 0.13025044239612546, 0.1311889012114119, 0.13212482386035876, 0.1330561310774402, 0.13398152952223089, 0.1349004652457252, 0.13581306683199235, 0.1367200798083143, 0.137622793916669, 0.13852296484166657, 0.1394227319931069, 0.1403245339412488, 0.1412310230942461, 0.14214498118385216, 0.143069237081319, 0.14400658839505012, 0.1449597282010336, 0.14593117812431314, 0.14692322882494877, 0.14793788874771102, 0.1489768417761548, 0.15004141419582537, 0.1511325511268624, 0.15225080234283267, 0.1533963171600822, 0.1545688478695689, 0.15576776099904327 ], [ 0.12472934898768827, 0.1239525094413701, 0.12330603030109838, 0.12279078019960324, 0.12240629653505204, 0.12215078674960048, 0.12202116483713106, 0.12201312215006832, 0.1221212298145483, 0.122339068524861, 0.12265938030074991, 0.12307423603533392, 0.12357521236216884, 0.12415357149969936, 0.1248004382209154, 0.12550696885042673, 0.12626450810649215, 0.1270647305834595, 0.12789976462835023, 0.12876229724328675, 0.1296456594052779, 0.13054389181930792, 0.13145179160909212, 0.132364940813378, 0.13327971781241507, 0.13419329298047103, 0.1351036099673156, 0.1360093540737518, 0.1369099092196094, 0.1378053050194261, 0.13869615548974093, 0.13958359091729203, 0.1404691844210611, 0.1413548747420243, 0.14224288678965935, 0.1431356514594274, 0.1440357262056594, 0.14494571780462837, 0.14586820866884437, 0.14680568797272234, 0.14776048872036307, 0.14873473172881632, 0.14973027731749186, 0.1507486852909939, 0.15179118358496863, 0.15285864572027358, 0.15395157698839773, 0.15507010907915822, 0.1562140026683914, 0.15738265731562942 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
l2norm: 1.60109 (SEM: 0)
x1: 0.991195
x2: 0.696153
x3: 0.0544616
x4: 0.525896
x5: 0.895495
x6: 0.122259", "Arm 1_0
l2norm: 1.78562 (SEM: 0)
x1: 0.835657
x2: 0.654382
x3: 0.747797
x4: 0.667518
x5: 0.685586
x6: 0.766227", "Arm 2_0
l2norm: 1.46414 (SEM: 0)
x1: 0.886116
x2: 0.397046
x3: 0.581595
x4: 0.169549
x5: 0.117816
x6: 0.90553", "Arm 3_0
l2norm: 1.31086 (SEM: 0)
x1: 0.110969
x2: 0.644237
x3: 0.142957
x4: 0.610617
x5: 0.213155
x6: 0.92319", "Arm 4_0
l2norm: 1.53866 (SEM: 0)
x1: 0.455642
x2: 0.893072
x3: 0.194919
x4: 0.703352
x5: 0.0362887
x6: 0.910101", "Arm 5_0
l2norm: 1.69364 (SEM: 0)
x1: 0.752016
x2: 0.0257296
x3: 0.716384
x4: 0.959104
x5: 0.703394
x6: 0.611876", "Arm 6_0
l2norm: 1.45976 (SEM: 0)
x1: 0.171156
x2: 0.991659
x3: 0.145412
x4: 0.915102
x5: 0.340763
x6: 0.378882", "Arm 7_0
l2norm: 1.67257 (SEM: 0)
x1: 0.757071
x2: 0.279597
x3: 0.109823
x4: 0.594536
x5: 0.954943
x6: 0.932046", "Arm 8_0
l2norm: 1.62429 (SEM: 0)
x1: 0.545973
x2: 0.957812
x3: 0.717702
x4: 0.39488
x5: 0.141303
x6: 0.855471", "Arm 9_0
l2norm: 1.80756 (SEM: 0)
x1: 0.577164
x2: 0.873977
x3: 0.840855
x4: 0.604265
x5: 0.983467
x6: 0.361855", "Arm 10_0
l2norm: 1.39479 (SEM: 0)
x1: 0.719934
x2: 0.158722
x3: 0.0640648
x4: 0.874327
x5: 0.640713
x6: 0.47211", "Arm 11_0
l2norm: 1.57462 (SEM: 0)
x1: 0.619846
x2: 0.797084
x3: 0.85879
x4: 0.732571
x5: 0.379869
x6: 0.203436", "Arm 12_0
l2norm: 1.12743 (SEM: 0)
x1: 1.67725e-17
x2: 0.359867
x3: 0.134847
x4: 0.485981
x5: 0.208769
x6: 0.918502", "Arm 13_0
l2norm: 1.07909 (SEM: 0)
x1: 1.76327e-16
x2: 0.250039
x3: 0.137932
x4: 0.43853
x5: 0.194655
x6: 0.923408", "Arm 14_0
l2norm: 1.03249 (SEM: 0)
x1: 0
x2: 0.144176
x3: 0.152986
x4: 0.352474
x5: 0.158112
x6: 0.934129", "Arm 15_0
l2norm: 1.06929 (SEM: 0)
x1: 4.05827e-16
x2: 0.0850404
x3: 0.0967067
x4: 0.466104
x5: 0.214999
x6: 0.929151", "Arm 16_0
l2norm: 1.01302 (SEM: 0)
x1: 0
x2: 0.170764
x3: 0.237467
x4: 0.371316
x5: 0.224173
x6: 0.867484", "Arm 17_0
l2norm: 0.98669 (SEM: 0)
x1: 0
x2: 0.112163
x3: 0.275695
x4: 0.34454
x5: 0.243084
x6: 0.840935", "Arm 18_0
l2norm: 0.966001 (SEM: 0)
x1: 7.33317e-10
x2: 0.0580523
x3: 0.322384
x4: 0.320043
x5: 0.270554
x6: 0.806368", "Arm 19_0
l2norm: 0.954739 (SEM: 0)
x1: 8.12925e-18
x2: 0.0199359
x3: 0.383543
x4: 0.299243
x5: 0.309485
x6: 0.760721", "Arm 20_0
l2norm: 0.957259 (SEM: 0)
x1: 1.38813e-16
x2: 0.0318909
x3: 0.453241
x4: 0.286296
x5: 0.346609
x6: 0.712598", "Arm 21_0
l2norm: 0.954473 (SEM: 0)
x1: 3.85551e-16
x2: 0.0648594
x3: 0.540874
x4: 0.30781
x5: 0.306598
x6: 0.652317", "Arm 22_0
l2norm: 1.07018 (SEM: 0)
x1: 3.59951e-17
x2: 0.0343595
x3: 0.632869
x4: 0.34134
x5: 0.318397
x6: 0.725043", "Arm 23_0
l2norm: 0.855829 (SEM: 0)
x1: 8.08344e-17
x2: 0.0822369
x3: 0.46578
x4: 0.283365
x5: 0.289837
x6: 0.586879" ], "type": "scatter", "x": [ 0.054461557418107986, 0.7477971455082297, 0.5815947651863098, 0.14295703638345003, 0.19491854589432478, 0.7163842003792524, 0.14541183970868587, 0.10982315894216299, 0.7177021754905581, 0.8408549539744854, 0.06406482309103012, 0.8587901405990124, 0.13484711147815956, 0.13793190310517953, 0.1529859588365636, 0.09670669035548415, 0.23746723345034682, 0.27569532525428087, 0.3223839248568095, 0.383543203069104, 0.45324114050899106, 0.5408739398573269, 0.6328688456033084, 0.465780447116418 ], "xaxis": "x", "y": [ 0.5258956551551819, 0.6675178641453385, 0.16954911593347788, 0.610617340542376, 0.7033517276868224, 0.9591042520478368, 0.9151019472628832, 0.594535656273365, 0.39488018583506346, 0.6042647454887629, 0.874326553195715, 0.732570699416101, 0.48598088102955855, 0.4385295831943108, 0.35247375762900385, 0.4661043123277255, 0.3713159180988593, 0.34453990601792267, 0.3200434548349499, 0.2992434190091267, 0.2862956166477214, 0.30781001390500967, 0.3413399146917884, 0.2833652484680828 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
l2norm: 1.60109 (SEM: 0)
x1: 0.991195
x2: 0.696153
x3: 0.0544616
x4: 0.525896
x5: 0.895495
x6: 0.122259", "Arm 1_0
l2norm: 1.78562 (SEM: 0)
x1: 0.835657
x2: 0.654382
x3: 0.747797
x4: 0.667518
x5: 0.685586
x6: 0.766227", "Arm 2_0
l2norm: 1.46414 (SEM: 0)
x1: 0.886116
x2: 0.397046
x3: 0.581595
x4: 0.169549
x5: 0.117816
x6: 0.90553", "Arm 3_0
l2norm: 1.31086 (SEM: 0)
x1: 0.110969
x2: 0.644237
x3: 0.142957
x4: 0.610617
x5: 0.213155
x6: 0.92319", "Arm 4_0
l2norm: 1.53866 (SEM: 0)
x1: 0.455642
x2: 0.893072
x3: 0.194919
x4: 0.703352
x5: 0.0362887
x6: 0.910101", "Arm 5_0
l2norm: 1.69364 (SEM: 0)
x1: 0.752016
x2: 0.0257296
x3: 0.716384
x4: 0.959104
x5: 0.703394
x6: 0.611876", "Arm 6_0
l2norm: 1.45976 (SEM: 0)
x1: 0.171156
x2: 0.991659
x3: 0.145412
x4: 0.915102
x5: 0.340763
x6: 0.378882", "Arm 7_0
l2norm: 1.67257 (SEM: 0)
x1: 0.757071
x2: 0.279597
x3: 0.109823
x4: 0.594536
x5: 0.954943
x6: 0.932046", "Arm 8_0
l2norm: 1.62429 (SEM: 0)
x1: 0.545973
x2: 0.957812
x3: 0.717702
x4: 0.39488
x5: 0.141303
x6: 0.855471", "Arm 9_0
l2norm: 1.80756 (SEM: 0)
x1: 0.577164
x2: 0.873977
x3: 0.840855
x4: 0.604265
x5: 0.983467
x6: 0.361855", "Arm 10_0
l2norm: 1.39479 (SEM: 0)
x1: 0.719934
x2: 0.158722
x3: 0.0640648
x4: 0.874327
x5: 0.640713
x6: 0.47211", "Arm 11_0
l2norm: 1.57462 (SEM: 0)
x1: 0.619846
x2: 0.797084
x3: 0.85879
x4: 0.732571
x5: 0.379869
x6: 0.203436", "Arm 12_0
l2norm: 1.12743 (SEM: 0)
x1: 1.67725e-17
x2: 0.359867
x3: 0.134847
x4: 0.485981
x5: 0.208769
x6: 0.918502", "Arm 13_0
l2norm: 1.07909 (SEM: 0)
x1: 1.76327e-16
x2: 0.250039
x3: 0.137932
x4: 0.43853
x5: 0.194655
x6: 0.923408", "Arm 14_0
l2norm: 1.03249 (SEM: 0)
x1: 0
x2: 0.144176
x3: 0.152986
x4: 0.352474
x5: 0.158112
x6: 0.934129", "Arm 15_0
l2norm: 1.06929 (SEM: 0)
x1: 4.05827e-16
x2: 0.0850404
x3: 0.0967067
x4: 0.466104
x5: 0.214999
x6: 0.929151", "Arm 16_0
l2norm: 1.01302 (SEM: 0)
x1: 0
x2: 0.170764
x3: 0.237467
x4: 0.371316
x5: 0.224173
x6: 0.867484", "Arm 17_0
l2norm: 0.98669 (SEM: 0)
x1: 0
x2: 0.112163
x3: 0.275695
x4: 0.34454
x5: 0.243084
x6: 0.840935", "Arm 18_0
l2norm: 0.966001 (SEM: 0)
x1: 7.33317e-10
x2: 0.0580523
x3: 0.322384
x4: 0.320043
x5: 0.270554
x6: 0.806368", "Arm 19_0
l2norm: 0.954739 (SEM: 0)
x1: 8.12925e-18
x2: 0.0199359
x3: 0.383543
x4: 0.299243
x5: 0.309485
x6: 0.760721", "Arm 20_0
l2norm: 0.957259 (SEM: 0)
x1: 1.38813e-16
x2: 0.0318909
x3: 0.453241
x4: 0.286296
x5: 0.346609
x6: 0.712598", "Arm 21_0
l2norm: 0.954473 (SEM: 0)
x1: 3.85551e-16
x2: 0.0648594
x3: 0.540874
x4: 0.30781
x5: 0.306598
x6: 0.652317", "Arm 22_0
l2norm: 1.07018 (SEM: 0)
x1: 3.59951e-17
x2: 0.0343595
x3: 0.632869
x4: 0.34134
x5: 0.318397
x6: 0.725043", "Arm 23_0
l2norm: 0.855829 (SEM: 0)
x1: 8.08344e-17
x2: 0.0822369
x3: 0.46578
x4: 0.283365
x5: 0.289837
x6: 0.586879" ], "type": "scatter", "x": [ 0.054461557418107986, 0.7477971455082297, 0.5815947651863098, 0.14295703638345003, 0.19491854589432478, 0.7163842003792524, 0.14541183970868587, 0.10982315894216299, 0.7177021754905581, 0.8408549539744854, 0.06406482309103012, 0.8587901405990124, 0.13484711147815956, 0.13793190310517953, 0.1529859588365636, 0.09670669035548415, 0.23746723345034682, 0.27569532525428087, 0.3223839248568095, 0.383543203069104, 0.45324114050899106, 0.5408739398573269, 0.6328688456033084, 0.465780447116418 ], "xaxis": "x2", "y": [ 0.5258956551551819, 0.6675178641453385, 0.16954911593347788, 0.610617340542376, 0.7033517276868224, 0.9591042520478368, 0.9151019472628832, 0.594535656273365, 0.39488018583506346, 0.6042647454887629, 0.874326553195715, 0.732570699416101, 0.48598088102955855, 0.4385295831943108, 0.35247375762900385, 0.4661043123277255, 0.3713159180988593, 0.34453990601792267, 0.3200434548349499, 0.2992434190091267, 0.2862956166477214, 0.30781001390500967, 0.3413399146917884, 0.2833652484680828 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "l2norm" }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x4" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot(param_x=\"x3\", param_y=\"x4\", metric_name=\"l2norm\"))" ] }, { "cell_type": "markdown", "id": "8807ccf8", "metadata": { "papermill": { "duration": 0.071117, "end_time": "2023-12-09T18:35:55.764656", "exception": false, "start_time": "2023-12-09T18:35:55.693539", "status": "completed" }, "tags": [] }, "source": [ "Here we plot the optimization trace, showing the progression of finding the point with the optimal objective:" ] }, { "cell_type": "code", "execution_count": 13, "id": "e287b9ac", "metadata": { "execution": { "iopub.execute_input": "2023-12-09T18:35:55.908297Z", "iopub.status.busy": "2023-12-09T18:35:55.907768Z", "iopub.status.idle": "2023-12-09T18:35:55.970082Z", "shell.execute_reply": "2023-12-09T18:35:55.969429Z" }, "papermill": { "duration": 0.135547, "end_time": "2023-12-09T18:35:55.971507", "exception": false, "start_time": "2023-12-09T18:35:55.835960", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ null, null, null, null, null, null, null, null, null, null, null, null, -0.6947224432144676, -0.8662444383461858, -0.8932592790120116, -0.8932592790120116, -1.5223637158768037, -1.8294586974002442, -2.1391871557256272, -2.4091107537192404, -2.5858117962816007, -2.7034653064222436, -2.7034653064222436, -2.7034653064222436, -2.752397634461022 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "legendgroup": "objective value", "line": { "color": "rgba(128,177,211,1)" }, "mode": "lines", "name": "objective value", "text": [ "
Parameterization:
x1: 0.9911952018737793
x2: 0.6961528658866882
x3: 0.054461557418107986
x4: 0.5258956551551819
x5: 0.8954952955245972
x6: 0.12225896865129471", "
Parameterization:
x1: 0.8356570182368159
x2: 0.654381649568677
x3: 0.7477971455082297
x4: 0.6675178641453385
x5: 0.6855857213959098
x6: 0.766226933337748", "
Parameterization:
x1: 0.8861156608909369
x2: 0.3970457296818495
x3: 0.5815947651863098
x4: 0.16954911593347788
x5: 0.11781587172299623
x6: 0.905530296266079", "
Parameterization:
x1: 0.11096904519945383
x2: 0.644237007945776
x3: 0.14295703638345003
x4: 0.610617340542376
x5: 0.21315453946590424
x6: 0.9231897285208106", "
Parameterization:
x1: 0.45564178470522165
x2: 0.8930717082694173
x3: 0.19491854589432478
x4: 0.7033517276868224
x5: 0.036288739182054996
x6: 0.9101007431745529", "
Parameterization:
x1: 0.7520163990557194
x2: 0.025729618966579437
x3: 0.7163842003792524
x4: 0.9591042520478368
x5: 0.7033938597887754
x6: 0.6118756625801325", "
Parameterization:
x1: 0.17115615028887987
x2: 0.9916594577953219
x3: 0.14541183970868587
x4: 0.9151019472628832
x5: 0.3407628107815981
x6: 0.3788818493485451", "
Parameterization:
x1: 0.7570707192644477
x2: 0.2795970821753144
x3: 0.10982315894216299
x4: 0.594535656273365
x5: 0.9549430087208748
x6: 0.9320464413613081", "
Parameterization:
x1: 0.5459734154865146
x2: 0.9578120745718479
x3: 0.7177021754905581
x4: 0.39488018583506346
x5: 0.14130298234522343
x6: 0.8554714126512408", "
Parameterization:
x1: 0.5771640036255121
x2: 0.8739767307415605
x3: 0.8408549539744854
x4: 0.6042647454887629
x5: 0.9834670992568135
x6: 0.3618552554398775", "
Parameterization:
x1: 0.7199341291561723
x2: 0.15872156899422407
x3: 0.06406482309103012
x4: 0.874326553195715
x5: 0.6407126896083355
x6: 0.47210961766541004", "
Parameterization:
x1: 0.6198462834581733
x2: 0.7970844069495797
x3: 0.8587901405990124
x4: 0.732570699416101
x5: 0.379869332537055
x6: 0.20343645755201578", "
Parameterization:
x1: 1.6772481594938277e-17
x2: 0.3598671860448771
x3: 0.13484711147815956
x4: 0.48598088102955855
x5: 0.2087690016148828
x6: 0.9185023251618663", "
Parameterization:
x1: 1.7632722968858015e-16
x2: 0.25003902129640826
x3: 0.13793190310517953
x4: 0.4385295831943108
x5: 0.19465485196508422
x6: 0.923407935671613", "
Parameterization:
x1: 0.0
x2: 0.14417563063530092
x3: 0.1529859588365636
x4: 0.35247375762900385
x5: 0.158112404732673
x6: 0.9341293969929527", "
Parameterization:
x1: 4.0582738784702687e-16
x2: 0.0850403563930537
x3: 0.09670669035548415
x4: 0.4661043123277255
x5: 0.214999074091971
x6: 0.9291506547519539", "
Parameterization:
x1: 0.0
x2: 0.17076396733095991
x3: 0.23746723345034682
x4: 0.3713159180988593
x5: 0.2241726629139055
x6: 0.8674844261951064", "
Parameterization:
x1: 0.0
x2: 0.11216324860230645
x3: 0.27569532525428087
x4: 0.34453990601792267
x5: 0.24308397151515945
x6: 0.8409347648001765", "
Parameterization:
x1: 7.333171606617148e-10
x2: 0.05805234252385064
x3: 0.3223839248568095
x4: 0.3200434548349499
x5: 0.2705541104542183
x6: 0.8063684232848881", "
Parameterization:
x1: 8.129245036965176e-18
x2: 0.019935891139020764
x3: 0.383543203069104
x4: 0.2992434190091267
x5: 0.30948545173532155
x6: 0.7607207632410544", "
Parameterization:
x1: 1.388125246212118e-16
x2: 0.03189093172260944
x3: 0.45324114050899106
x4: 0.2862956166477214
x5: 0.34660902685848594
x6: 0.7125984673461665", "
Parameterization:
x1: 3.855507832274641e-16
x2: 0.06485938559054745
x3: 0.5408739398573269
x4: 0.30781001390500967
x5: 0.30659839450002335
x6: 0.6523166277876222", "
Parameterization:
x1: 3.599505365983038e-17
x2: 0.03435951151483752
x3: 0.6328688456033084
x4: 0.3413399146917884
x5: 0.3183968790837853
x6: 0.7250425113161947", "
Parameterization:
x1: 8.083437368258469e-17
x2: 0.08223693079205716
x3: 0.465780447116418
x4: 0.2833652484680828
x5: 0.2898369796175371
x6: 0.5868793948890354", "
Parameterization:
x1: 0.0
x2: 0.12451185526129524
x3: 0.5059155772348647
x4: 0.25754633240884656
x5: 0.2718230793818827
x6: 0.6515768865975455" ], "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ null, null, null, null, null, null, null, null, null, null, null, null, -0.6947224432144676, -0.8662444383461858, -0.8932592790120116, -0.8932592790120116, -1.5223637158768037, -1.8294586974002442, -2.1391871557256272, -2.4091107537192404, -2.5858117962816007, -2.7034653064222436, -2.7034653064222436, -2.7034653064222436, -2.752397634461022 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ null, null, null, null, null, null, null, null, null, null, null, null, -0.6947224432144676, -0.8662444383461858, -0.8932592790120116, -0.8932592790120116, -1.5223637158768037, -1.8294586974002442, -2.1391871557256272, -2.4091107537192404, -2.5858117962816007, -2.7034653064222436, -2.7034653064222436, -2.7034653064222436, -2.752397634461022 ] }, { "line": { "color": "rgba(253,180,98,1)", "dash": "dash" }, "mode": "lines", "name": "Optimum", "type": "scatter", "x": [ 1, 25 ], "y": [ -3.32237, -3.32237 ] }, { "line": { "color": "rgba(141,211,199,1)", "dash": "dash" }, "mode": "lines", "name": "model change", "type": "scatter", "x": [ 12, 12 ], "y": [ null, null ] } ], "layout": { "showlegend": true, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "Model performance vs. # of iterations" }, "xaxis": { "title": { "text": "Iteration" } }, "yaxis": { "title": { "text": "Hartmann6" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(\n", " ax_client.get_optimization_trace(objective_optimum=hartmann6.fmin)\n", ") # Objective_optimum is optional." ] }, { "cell_type": "markdown", "id": "cbe77bf8", "metadata": { "papermill": { "duration": 0.077658, "end_time": "2023-12-09T18:35:56.123627", "exception": false, "start_time": "2023-12-09T18:35:56.045969", "status": "completed" }, "tags": [] }, "source": [ "## 7. Save / reload optimization to JSON / SQL\n", "We can serialize the state of optimization to JSON and save it to a `.json` file or save it to the SQL backend. For the former:" ] }, { "cell_type": "code", "execution_count": 14, "id": "e7fcfc98", "metadata": { "execution": { "iopub.execute_input": "2023-12-09T18:35:56.273837Z", "iopub.status.busy": "2023-12-09T18:35:56.273176Z", "iopub.status.idle": "2023-12-09T18:35:56.301393Z", "shell.execute_reply": "2023-12-09T18:35:56.300885Z" }, "papermill": { "duration": 0.105112, "end_time": "2023-12-09T18:35:56.302834", "exception": false, "start_time": "2023-12-09T18:35:56.197722", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:35:56] ax.service.ax_client: Saved JSON-serialized state of optimization to `ax_client_snapshot.json`.\n" ] } ], "source": [ "ax_client.save_to_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "code", "execution_count": 15, "id": "05ad0c54", "metadata": { "execution": { "iopub.execute_input": "2023-12-09T18:35:56.453190Z", "iopub.status.busy": "2023-12-09T18:35:56.452870Z", "iopub.status.idle": "2023-12-09T18:35:56.562692Z", "shell.execute_reply": "2023-12-09T18:35:56.562038Z" }, "papermill": { "duration": 0.186646, "end_time": "2023-12-09T18:35:56.564125", "exception": false, "start_time": "2023-12-09T18:35:56.377479", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.bwZKabbZig/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.bwZKabbZig/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.bwZKabbZig/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.bwZKabbZig/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.bwZKabbZig/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.bwZKabbZig/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.bwZKabbZig/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.bwZKabbZig/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.bwZKabbZig/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.bwZKabbZig/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.bwZKabbZig/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.bwZKabbZig/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.bwZKabbZig/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.bwZKabbZig/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.bwZKabbZig/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.bwZKabbZig/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.bwZKabbZig/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.bwZKabbZig/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.bwZKabbZig/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.bwZKabbZig/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.bwZKabbZig/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.bwZKabbZig/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.bwZKabbZig/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.bwZKabbZig/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.bwZKabbZig/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "[INFO 12-09 18:35:56] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "restored_ax_client = (\n", " AxClient.load_from_json_file()\n", ") # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "markdown", "id": "69dab515", "metadata": { "papermill": { "duration": 0.072159, "end_time": "2023-12-09T18:35:56.710788", "exception": false, "start_time": "2023-12-09T18:35:56.638629", "status": "completed" }, "tags": [] }, "source": [ "To store state of optimization to an SQL backend, first follow [setup instructions](https://ax.dev/docs/storage.html#sql) on Ax website." ] }, { "cell_type": "markdown", "id": "9405dd8a", "metadata": { "papermill": { "duration": 0.073862, "end_time": "2023-12-09T18:35:56.859104", "exception": false, "start_time": "2023-12-09T18:35:56.785242", "status": "completed" }, "tags": [] }, "source": [ "Having set up the SQL backend, pass `DBSettings` to `AxClient` on instantiation (note that `SQLAlchemy` dependency will have to be installed – for installation, refer to [optional dependencies](https://ax.dev/docs/installation.html#optional-dependencies) on Ax website):" ] }, { "cell_type": "code", "execution_count": 16, "id": "dbabd0bd", "metadata": { "execution": { "iopub.execute_input": "2023-12-09T18:35:57.009900Z", "iopub.status.busy": "2023-12-09T18:35:57.009230Z", "iopub.status.idle": "2023-12-09T18:35:57.020034Z", "shell.execute_reply": "2023-12-09T18:35:57.019412Z" }, "papermill": { "duration": 0.087739, "end_time": "2023-12-09T18:35:57.021446", "exception": false, "start_time": "2023-12-09T18:35:56.933707", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:35:57] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "from ax.storage.sqa_store.structs import DBSettings\n", "\n", "# URL is of the form \"dialect+driver://username:password@host:port/database\".\n", "db_settings = DBSettings(url=\"sqlite:///foo.db\")\n", "# Instead of URL, can provide a `creator function`; can specify custom encoders/decoders if necessary.\n", "new_ax = AxClient(db_settings=db_settings)" ] }, { "cell_type": "markdown", "id": "93905cc7", "metadata": { "papermill": { "duration": 0.074715, "end_time": "2023-12-09T18:35:57.176233", "exception": false, "start_time": "2023-12-09T18:35:57.101518", "status": "completed" }, "tags": [] }, "source": [ "When valid `DBSettings` are passed into `AxClient`, a unique experiment name is a required argument (`name`) to `ax_client.create_experiment`. The **state of the optimization is auto-saved** any time it changes (i.e. a new trial is added or completed, etc). \n", "\n", "To reload an optimization state later, instantiate `AxClient` with the same `DBSettings` and use `ax_client.load_experiment_from_database(experiment_name=\"my_experiment\")`." ] }, { "cell_type": "markdown", "id": "01977493", "metadata": { "papermill": { "duration": 0.074957, "end_time": "2023-12-09T18:35:57.326488", "exception": false, "start_time": "2023-12-09T18:35:57.251531", "status": "completed" }, "tags": [] }, "source": [ "# Special Cases" ] }, { "cell_type": "markdown", "id": "e96d1a49", "metadata": { "papermill": { "duration": 0.07426, "end_time": "2023-12-09T18:35:57.475257", "exception": false, "start_time": "2023-12-09T18:35:57.400997", "status": "completed" }, "tags": [] }, "source": [ "**Evaluation failure**: should any optimization iterations fail during evaluation, `log_trial_failure` will ensure that the same trial is not proposed again." ] }, { "cell_type": "code", "execution_count": 17, "id": "2d6e74ba", "metadata": { "execution": { "iopub.execute_input": "2023-12-09T18:35:57.626118Z", "iopub.status.busy": "2023-12-09T18:35:57.625594Z", "iopub.status.idle": "2023-12-09T18:36:03.226249Z", "shell.execute_reply": "2023-12-09T18:36:03.225489Z" }, "papermill": { "duration": 5.678223, "end_time": "2023-12-09T18:36:03.228106", "exception": false, "start_time": "2023-12-09T18:35:57.549883", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:36:03] ax.service.ax_client: Generated new trial 25 with parameters {'x1': 0.078483, 'x2': 0.084011, 'x3': 0.500426, 'x4': 0.257017, 'x5': 0.268767, 'x6': 0.64478}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:36:03] ax.service.ax_client: Registered failure of trial 25.\n" ] } ], "source": [ "_, trial_index = ax_client.get_next_trial()\n", "ax_client.log_trial_failure(trial_index=trial_index)" ] }, { "cell_type": "markdown", "id": "b87d0a5e", "metadata": { "papermill": { "duration": 0.072507, "end_time": "2023-12-09T18:36:03.416170", "exception": false, "start_time": "2023-12-09T18:36:03.343663", "status": "completed" }, "tags": [] }, "source": [ "**Adding custom trials**: should there be need to evaluate a specific parameterization, `attach_trial` will add it to the experiment." ] }, { "cell_type": "code", "execution_count": 18, "id": "fdc7f89c", "metadata": { "execution": { "iopub.execute_input": "2023-12-09T18:36:03.568003Z", "iopub.status.busy": "2023-12-09T18:36:03.567493Z", "iopub.status.idle": "2023-12-09T18:36:03.573937Z", "shell.execute_reply": "2023-12-09T18:36:03.573239Z" }, "papermill": { "duration": 0.083845, "end_time": "2023-12-09T18:36:03.575257", "exception": false, "start_time": "2023-12-09T18:36:03.491412", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:36:03] ax.core.experiment: Attached custom parameterizations [{'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9}] as trial 26.\n" ] }, { "data": { "text/plain": [ "({'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9}, 26)" ] }, "execution_count": 18, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.attach_trial(\n", " parameters={\"x1\": 0.9, \"x2\": 0.9, \"x3\": 0.9, \"x4\": 0.9, \"x5\": 0.9, \"x6\": 0.9}\n", ")" ] }, { "cell_type": "markdown", "id": "b494b729", "metadata": { "papermill": { "duration": 0.074752, "end_time": "2023-12-09T18:36:03.725098", "exception": false, "start_time": "2023-12-09T18:36:03.650346", "status": "completed" }, "tags": [] }, "source": [ "**Need to run many trials in parallel**: for optimal results and optimization efficiency, we strongly recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). However, if your use case needs to dispatch many trials in parallel before they are updated with data and you are running into the *\"All trials for current model have been generated, but not enough data has been observed to fit next model\"* error, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`." ] }, { "cell_type": "markdown", "id": "233a4dd8", "metadata": { "papermill": { "duration": 0.07474, "end_time": "2023-12-09T18:36:03.875510", "exception": false, "start_time": "2023-12-09T18:36:03.800770", "status": "completed" }, "tags": [] }, "source": [ "# Service API Exceptions Meaning and Handling\n", "[**`DataRequiredError`**](https://ax.dev/api/exceptions.html#ax.exceptions.core.DataRequiredError): Ax generation strategy needs to be updated with more data to proceed to the next optimization model. When the optimization moves from initialization stage to the Bayesian optimization stage, the underlying BayesOpt model needs sufficient data to train. For optimal results and optimization efficiency (finding the optimal point in the least number of trials), we recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). Therefore, the correct way to handle this exception is to wait until more trial evaluations complete and log their data via `ax_client.complete_trial(...)`. \n", "\n", "However, if there is strong need to generate more trials before more data is available, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`. With this setting, as many trials will be generated from the initialization stage as requested, and the optimization will move to the BayesOpt stage whenever enough trials are completed." ] }, { "cell_type": "markdown", "id": "65d74c2d", "metadata": { "papermill": { "duration": 0.074599, "end_time": "2023-12-09T18:36:04.024809", "exception": false, "start_time": "2023-12-09T18:36:03.950210", "status": "completed" }, "tags": [] }, "source": [ "[**`MaxParallelismReachedException`**](https://ax.dev/api/modelbridge.html#ax.modelbridge.generation_strategy.MaxParallelismReachedException): generation strategy restricts the number of trials that can be ran simultaneously (to encourage sequential optimization), and the parallelism limit has been reached. The correct way to handle this exception is the same as `DataRequiredError` – to wait until more trial evluations complete and log their data via `ax_client.complete_trial(...)`.\n", " \n", "In some cases higher parallelism is important, so `enforce_sequential_optimization=False` kwarg to AxClient allows to suppress limiting of parallelism. It's also possible to override the default parallelism setting for all stages of the optimization by passing `choose_generation_strategy_kwargs` to `ax_client.create_experiment`:" ] }, { "cell_type": "code", "execution_count": 19, "id": "daba15b1", "metadata": { "execution": { "iopub.execute_input": "2023-12-09T18:36:04.177489Z", "iopub.status.busy": "2023-12-09T18:36:04.176826Z", "iopub.status.idle": "2023-12-09T18:36:04.188468Z", "shell.execute_reply": "2023-12-09T18:36:04.187829Z" }, "papermill": { "duration": 0.089632, "end_time": "2023-12-09T18:36:04.190135", "exception": false, "start_time": "2023-12-09T18:36:04.100503", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:36:04] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:36:04] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:36:04] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter y. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:36:04] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='y', parameter_type=FLOAT, range=[0.0, 15.0])], parameter_constraints=[]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:36:04] ax.modelbridge.dispatch_utils: Using Models.BOTORCH_MODULAR since there are more ordered parameters than there are categories for the unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:36:04] ax.modelbridge.dispatch_utils: Calculating the number of remaining initialization trials based on num_initialization_trials=None max_initialization_trials=None num_tunable_parameters=2 num_trials=None use_batch_trials=False\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:36:04] ax.modelbridge.dispatch_utils: calculated num_initialization_trials=5\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:36:04] ax.modelbridge.dispatch_utils: num_completed_initialization_trials=0 num_remaining_initialization_trials=5\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:36:04] ax.modelbridge.dispatch_utils: `verbose`, `disable_progbar`, and `jit_compile` are not yet supported when using `choose_generation_strategy` with ModularBoTorchModel, dropping these arguments.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-09 18:36:04] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+BoTorch', steps=[Sobol for 5 trials, BoTorch for subsequent trials]). Iterations after 5 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client = AxClient()\n", "ax_client.create_experiment(\n", " parameters=[\n", " {\"name\": \"x\", \"type\": \"range\", \"bounds\": [-5.0, 10.0]},\n", " {\"name\": \"y\", \"type\": \"range\", \"bounds\": [0.0, 15.0]},\n", " ],\n", " # Sets max parallelism to 10 for all steps of the generation strategy.\n", " choose_generation_strategy_kwargs={\"max_parallelism_override\": 10},\n", ")" ] }, { "cell_type": "code", "execution_count": 20, "id": "93ca2d92", "metadata": { "execution": { "iopub.execute_input": "2023-12-09T18:36:04.341312Z", "iopub.status.busy": "2023-12-09T18:36:04.340796Z", "iopub.status.idle": "2023-12-09T18:36:04.345569Z", "shell.execute_reply": "2023-12-09T18:36:04.344951Z" }, "papermill": { "duration": 0.080349, "end_time": "2023-12-09T18:36:04.347018", "exception": false, "start_time": "2023-12-09T18:36:04.266669", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "[(5, 10), (-1, 10)]" ] }, "execution_count": 20, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism() # Max parallelism is now 10 for all stages of the optimization." ] } ], "metadata": { "kernelspec": { "display_name": "Python 3 (ipykernel)", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.9.18" }, "papermill": { "default_parameters": {}, "duration": 114.011834, "end_time": "2023-12-09T18:36:05.231100", "environment_variables": {}, "exception": null, "input_path": "/tmp/tmp.bwZKabbZig/Ax-main/tutorials/gpei_hartmann_service.ipynb", "output_path": "/tmp/tmp.bwZKabbZig/Ax-main/tutorials/gpei_hartmann_service.ipynb", "parameters": {}, "start_time": "2023-12-09T18:34:11.219266", "version": "2.5.0" } }, "nbformat": 4, "nbformat_minor": 5 }