{ "cells": [ { "cell_type": "markdown", "id": "4e3f5f1c", "metadata": { "papermill": { "duration": 0.005841, "end_time": "2025-01-31T05:07:30.859839", "exception": false, "start_time": "2025-01-31T05:07:30.853998", "status": "completed" }, "tags": [] }, "source": [ "# Service API Example on Hartmann6\n", "\n", "The Ax Service API is designed to allow the user to control scheduling of trials and data computation while having an easy to use interface with Ax.\n", "\n", "The user iteratively:\n", "- Queries Ax for candidates\n", "- Schedules / deploys them however they choose\n", "- Computes data and logs to Ax\n", "- Repeat" ] }, { "cell_type": "code", "execution_count": 1, "id": "213127e9", "metadata": { "execution": { "iopub.execute_input": "2025-01-31T05:07:30.871819Z", "iopub.status.busy": "2025-01-31T05:07:30.871218Z", "iopub.status.idle": "2025-01-31T05:07:33.884184Z", "shell.execute_reply": "2025-01-31T05:07:33.883293Z" }, "papermill": { "duration": 3.067318, "end_time": "2025-01-31T05:07:33.932400", "exception": false, "start_time": "2025-01-31T05:07:30.865082", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/html": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:33] ax.utils.notebook.plotting: Injecting Plotly library into cell. Do not overwrite or delete cell.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:33] ax.utils.notebook.plotting: Please see\n", " (https://ax.dev/tutorials/visualizations.html#Fix-for-plots-that-are-not-rendering)\n", " if visualizations are not rendering.\n" ] }, { "data": { "text/html": [ " \n", " \n", " " ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "from ax.service.ax_client import AxClient, ObjectiveProperties\n", "from ax.utils.measurement.synthetic_functions import hartmann6\n", "from ax.utils.notebook.plotting import init_notebook_plotting, render\n", "\n", "init_notebook_plotting()" ] }, { "cell_type": "markdown", "id": "f6ae4340", "metadata": { "papermill": { "duration": 0.04374, "end_time": "2025-01-31T05:07:34.020213", "exception": false, "start_time": "2025-01-31T05:07:33.976473", "status": "completed" }, "tags": [] }, "source": [ "## 1. Initialize client\n", "\n", "Create a client object to interface with Ax APIs. By default this runs locally without storage." ] }, { "cell_type": "code", "execution_count": 2, "id": "473dafd1", "metadata": { "execution": { "iopub.execute_input": "2025-01-31T05:07:34.108177Z", "iopub.status.busy": "2025-01-31T05:07:34.107887Z", "iopub.status.idle": "2025-01-31T05:07:34.112040Z", "shell.execute_reply": "2025-01-31T05:07:34.111378Z" }, "papermill": { "duration": 0.050127, "end_time": "2025-01-31T05:07:34.113400", "exception": false, "start_time": "2025-01-31T05:07:34.063273", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:34] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "ax_client = AxClient()" ] }, { "cell_type": "markdown", "id": "ad6d2831", "metadata": { "papermill": { "duration": 0.043514, "end_time": "2025-01-31T05:07:34.200249", "exception": false, "start_time": "2025-01-31T05:07:34.156735", "status": "completed" }, "tags": [] }, "source": [ "## 2. Set up experiment\n", "An experiment consists of a **search space** (parameters and parameter constraints) and **optimization configuration** (objectives and outcome constraints). Note that:\n", "- Only `parameters`, and `objectives` arguments are required.\n", "- Dictionaries in `parameters` have the following required keys: \"name\" - parameter name, \"type\" - parameter type (\"range\", \"choice\" or \"fixed\"), \"bounds\" for range parameters, \"values\" for choice parameters, and \"value\" for fixed parameters.\n", "- Dictionaries in `parameters` can optionally include \"value_type\" (\"int\", \"float\", \"bool\" or \"str\"), \"log_scale\" flag for range parameters, and \"is_ordered\" flag for choice parameters.\n", "- `parameter_constraints` should be a list of strings of form \"p1 >= p2\" or \"p1 + p2 <= some_bound\".\n", "- `outcome_constraints` should be a list of strings of form \"constrained_metric <= some_bound\"." ] }, { "cell_type": "code", "execution_count": 3, "id": "36b47540", "metadata": { "execution": { "iopub.execute_input": "2025-01-31T05:07:34.289004Z", "iopub.status.busy": "2025-01-31T05:07:34.288725Z", "iopub.status.idle": "2025-01-31T05:07:34.302529Z", "shell.execute_reply": "2025-01-31T05:07:34.301837Z" }, "papermill": { "duration": 0.06045, "end_time": "2025-01-31T05:07:34.304674", "exception": false, "start_time": "2025-01-31T05:07:34.244224", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:34] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x2. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:34] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x3. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:34] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x4. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:34] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x5. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:34] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x6. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:34] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x1', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x2', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x3', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x4', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x5', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x6', parameter_type=FLOAT, range=[0.0, 1.0])], parameter_constraints=[ParameterConstraint(1.0*x1 + 1.0*x2 <= 2.0)]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:34] ax.modelbridge.dispatch_utils: Using Models.BOTORCH_MODULAR since there is at least one ordered parameter and there are no unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:34] ax.modelbridge.dispatch_utils: Calculating the number of remaining initialization trials based on num_initialization_trials=None max_initialization_trials=None num_tunable_parameters=6 num_trials=None use_batch_trials=False\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:34] ax.modelbridge.dispatch_utils: calculated num_initialization_trials=12\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:34] ax.modelbridge.dispatch_utils: num_completed_initialization_trials=0 num_remaining_initialization_trials=12\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:34] ax.modelbridge.dispatch_utils: `verbose`, `disable_progbar`, and `jit_compile` are not yet supported when using `choose_generation_strategy` with ModularBoTorchModel, dropping these arguments.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:34] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+BoTorch', steps=[Sobol for 12 trials, BoTorch for subsequent trials]). Iterations after 12 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client.create_experiment(\n", " name=\"hartmann_test_experiment\",\n", " parameters=[\n", " {\n", " \"name\": \"x1\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " \"value_type\": \"float\", # Optional, defaults to inference from type of \"bounds\".\n", " \"log_scale\": False, # Optional, defaults to False.\n", " },\n", " {\n", " \"name\": \"x2\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x3\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x4\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x5\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x6\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " ],\n", " objectives={\"hartmann6\": ObjectiveProperties(minimize=True)},\n", " parameter_constraints=[\"x1 + x2 <= 2.0\"], # Optional.\n", " outcome_constraints=[\"l2norm <= 1.25\"], # Optional.\n", ")" ] }, { "cell_type": "markdown", "id": "1069a7c8", "metadata": { "papermill": { "duration": 0.043914, "end_time": "2025-01-31T05:07:34.392791", "exception": false, "start_time": "2025-01-31T05:07:34.348877", "status": "completed" }, "tags": [] }, "source": [ "## 3. Define how to evaluate trials\n", "When using Ax a service, evaluation of parameterizations suggested by Ax is done either locally or, more commonly, using an external scheduler. Below is a dummy evaluation function that outputs data for two metrics \"hartmann6\" and \"l2norm\". Note that all returned metrics correspond to either the `objectives` set on experiment creation or the metric names mentioned in `outcome_constraints`." ] }, { "cell_type": "code", "execution_count": 4, "id": "29615a3c", "metadata": { "execution": { "iopub.execute_input": "2025-01-31T05:07:34.481968Z", "iopub.status.busy": "2025-01-31T05:07:34.481689Z", "iopub.status.idle": "2025-01-31T05:07:34.486162Z", "shell.execute_reply": "2025-01-31T05:07:34.485596Z" }, "papermill": { "duration": 0.050827, "end_time": "2025-01-31T05:07:34.487473", "exception": false, "start_time": "2025-01-31T05:07:34.436646", "status": "completed" }, "tags": [] }, "outputs": [], "source": [ "import numpy as np\n", "\n", "\n", "def evaluate(parameterization):\n", " x = np.array([parameterization.get(f\"x{i+1}\") for i in range(6)])\n", " # In our case, standard error is 0, since we are computing a synthetic function.\n", " return {\"hartmann6\": (hartmann6(x), 0.0), \"l2norm\": (np.sqrt((x**2).sum()), 0.0)}" ] }, { "cell_type": "markdown", "id": "dfeb5adc", "metadata": { "papermill": { "duration": 0.044023, "end_time": "2025-01-31T05:07:34.575752", "exception": false, "start_time": "2025-01-31T05:07:34.531729", "status": "completed" }, "tags": [] }, "source": [ "Result of the evaluation should generally be a mapping of the format: `{metric_name -> (mean, SEM)}`. If there is only one metric in the experiment – the objective – then evaluation function can return a single tuple of mean and SEM, in which case Ax will assume that evaluation corresponds to the objective. _It can also return only the mean as a float, in which case Ax will treat SEM as unknown and use a model that can infer it._ \n", "\n", "For more details on evaluation function, refer to the \"Trial Evaluation\" section in the Ax docs at [ax.dev](https://ax.dev/)" ] }, { "cell_type": "markdown", "id": "deea6c3a", "metadata": { "papermill": { "duration": 0.04343, "end_time": "2025-01-31T05:07:34.663012", "exception": false, "start_time": "2025-01-31T05:07:34.619582", "status": "completed" }, "tags": [] }, "source": [ "## 4. Run optimization loop\n", "With the experiment set up, we can start the optimization loop.\n", "\n", "At each step, the user queries the client for a new trial then submits the evaluation of that trial back to the client.\n", "\n", "Note that Ax auto-selects an appropriate optimization algorithm based on the search space. For more advance use cases that require a specific optimization algorithm, pass a `generation_strategy` argument into the `AxClient` constructor. Note that when Bayesian Optimization is used, generating new trials may take a few minutes." ] }, { "cell_type": "code", "execution_count": 5, "id": "8efdc791", "metadata": { "execution": { "iopub.execute_input": "2025-01-31T05:07:34.752189Z", "iopub.status.busy": "2025-01-31T05:07:34.751586Z", "iopub.status.idle": "2025-01-31T05:09:40.224073Z", "shell.execute_reply": "2025-01-31T05:09:40.223535Z" }, "papermill": { "duration": 125.518519, "end_time": "2025-01-31T05:09:40.225473", "exception": false, "start_time": "2025-01-31T05:07:34.706954", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.8SPGnWMU26/Ax-main/ax/modelbridge/cross_validation.py:439: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 01-31 05:07:34] ax.service.ax_client: Generated new trial 0 with parameters {'x1': 0.703969, 'x2': 0.889873, 'x3': 0.783413, 'x4': 0.502978, 'x5': 0.067759, 'x6': 0.233801} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:34] ax.service.ax_client: Completed trial 0 with data: {'hartmann6': (-0.39686, 0.0), 'l2norm': (1.487758, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.8SPGnWMU26/Ax-main/ax/modelbridge/cross_validation.py:439: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 01-31 05:07:34] ax.service.ax_client: Generated new trial 1 with parameters {'x1': 0.419934, 'x2': 0.180336, 'x3': 0.411221, 'x4': 0.19127, 'x5': 0.938351, 'x6': 0.66866} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:34] ax.service.ax_client: Completed trial 1 with data: {'hartmann6': (-0.254644, 0.0), 'l2norm': (1.31991, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.8SPGnWMU26/Ax-main/ax/modelbridge/cross_validation.py:439: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 01-31 05:07:34] ax.service.ax_client: Generated new trial 2 with parameters {'x1': 0.226501, 'x2': 0.612951, 'x3': 0.737841, 'x4': 0.79007, 'x5': 0.532533, 'x6': 0.784452} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:34] ax.service.ax_client: Completed trial 2 with data: {'hartmann6': (-0.135248, 0.0), 'l2norm': (1.579427, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.8SPGnWMU26/Ax-main/ax/modelbridge/cross_validation.py:439: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 01-31 05:07:34] ax.service.ax_client: Generated new trial 3 with parameters {'x1': 0.899604, 'x2': 0.316626, 'x3': 0.113939, 'x4': 0.478366, 'x5': 0.411064, 'x6': 0.344343} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:34] ax.service.ax_client: Completed trial 3 with data: {'hartmann6': (-0.165744, 0.0), 'l2norm': (1.199542, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.8SPGnWMU26/Ax-main/ax/modelbridge/cross_validation.py:439: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 01-31 05:07:34] ax.service.ax_client: Generated new trial 4 with parameters {'x1': 0.816311, 'x2': 0.718168, 'x3': 0.366568, 'x4': 0.276598, 'x5': 0.354597, 'x6': 0.078877} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:34] ax.service.ax_client: Completed trial 4 with data: {'hartmann6': (-0.07839, 0.0), 'l2norm': (1.234896, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.8SPGnWMU26/Ax-main/ax/modelbridge/cross_validation.py:439: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 01-31 05:07:34] ax.service.ax_client: Generated new trial 5 with parameters {'x1': 0.059786, 'x2': 0.477507, 'x3': 0.984853, 'x4': 0.964771, 'x5': 0.733056, 'x6': 0.518654} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:34] ax.service.ax_client: Completed trial 5 with data: {'hartmann6': (-0.003749, 0.0), 'l2norm': (1.714257, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.8SPGnWMU26/Ax-main/ax/modelbridge/cross_validation.py:439: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 01-31 05:07:34] ax.service.ax_client: Generated new trial 6 with parameters {'x1': 0.364092, 'x2': 0.785114, 'x3': 0.16299, 'x4': 0.048069, 'x5': 0.764806, 'x6': 0.903241} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:34] ax.service.ax_client: Completed trial 6 with data: {'hartmann6': (-0.012229, 0.0), 'l2norm': (1.476013, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.8SPGnWMU26/Ax-main/ax/modelbridge/cross_validation.py:439: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 01-31 05:07:34] ax.service.ax_client: Generated new trial 7 with parameters {'x1': 0.509804, 'x2': 0.019914, 'x3': 0.532985, 'x4': 0.736238, 'x5': 0.135333, 'x6': 0.467987} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:34] ax.service.ax_client: Completed trial 7 with data: {'hartmann6': (-0.144938, 0.0), 'l2norm': (1.15054, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.8SPGnWMU26/Ax-main/ax/modelbridge/cross_validation.py:439: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 01-31 05:07:34] ax.service.ax_client: Generated new trial 8 with parameters {'x1': 0.622962, 'x2': 0.53223, 'x3': 0.233523, 'x4': 0.889147, 'x5': 0.925249, 'x6': 0.28714} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:34] ax.service.ax_client: Completed trial 8 with data: {'hartmann6': (-0.076377, 0.0), 'l2norm': (1.566844, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.8SPGnWMU26/Ax-main/ax/modelbridge/cross_validation.py:439: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 01-31 05:07:34] ax.service.ax_client: Generated new trial 9 with parameters {'x1': 0.253142, 'x2': 0.272034, 'x3': 0.601565, 'x4': 0.326832, 'x5': 0.053501, 'x6': 0.849444} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:34] ax.service.ax_client: Completed trial 9 with data: {'hartmann6': (-1.062603, 0.0), 'l2norm': (1.153777, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.8SPGnWMU26/Ax-main/ax/modelbridge/cross_validation.py:439: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 01-31 05:07:34] ax.service.ax_client: Generated new trial 10 with parameters {'x1': 0.073102, 'x2': 0.966383, 'x3': 0.311139, 'x4': 0.660618, 'x5': 0.460229, 'x6': 0.728661} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:34] ax.service.ax_client: Completed trial 10 with data: {'hartmann6': (-0.050511, 0.0), 'l2norm': (1.488361, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.8SPGnWMU26/Ax-main/ax/modelbridge/cross_validation.py:439: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 01-31 05:07:35] ax.service.ax_client: Generated new trial 11 with parameters {'x1': 0.800801, 'x2': 0.22853, 'x3': 0.931378, 'x4': 0.098299, 'x5': 0.581039, 'x6': 0.165996} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:35] ax.service.ax_client: Completed trial 11 with data: {'hartmann6': (-0.017243, 0.0), 'l2norm': (1.391329, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:44] ax.service.ax_client: Generated new trial 12 with parameters {'x1': 0.272393, 'x2': 0.261966, 'x3': 0.684906, 'x4': 0.267852, 'x5': 0.0, 'x6': 0.942885} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:44] ax.service.ax_client: Completed trial 12 with data: {'hartmann6': (-0.902076, 0.0), 'l2norm': (1.254073, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:58] ax.service.ax_client: Generated new trial 13 with parameters {'x1': 0.158744, 'x2': 0.150478, 'x3': 0.62625, 'x4': 0.362772, 'x5': 0.0, 'x6': 0.905898} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:07:58] ax.service.ax_client: Completed trial 13 with data: {'hartmann6': (-0.642203, 0.0), 'l2norm': (1.179952, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:08:05] ax.service.ax_client: Generated new trial 14 with parameters {'x1': 0.235196, 'x2': 0.327363, 'x3': 0.45339, 'x4': 0.296878, 'x5': 0.056643, 'x6': 0.785352} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:08:05] ax.service.ax_client: Completed trial 14 with data: {'hartmann6': (-1.011484, 0.0), 'l2norm': (1.037385, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:08:12] ax.service.ax_client: Generated new trial 15 with parameters {'x1': 0.538952, 'x2': 0.283618, 'x3': 0.599381, 'x4': 0.529577, 'x5': 0.119609, 'x6': 0.813866} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:08:12] ax.service.ax_client: Completed trial 15 with data: {'hartmann6': (-0.770359, 0.0), 'l2norm': (1.298963, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:08:24] ax.service.ax_client: Generated new trial 16 with parameters {'x1': 0.219188, 'x2': 0.276851, 'x3': 0.696525, 'x4': 0.086881, 'x5': 0.098485, 'x6': 0.788912} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:08:24] ax.service.ax_client: Completed trial 16 with data: {'hartmann6': (-1.236144, 0.0), 'l2norm': (1.117795, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:08:38] ax.service.ax_client: Generated new trial 17 with parameters {'x1': 0.106711, 'x2': 0.278854, 'x3': 0.812076, 'x4': 0.0, 'x5': 0.16989, 'x6': 0.778902} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:08:38] ax.service.ax_client: Completed trial 17 with data: {'hartmann6': (-1.131755, 0.0), 'l2norm': (1.176505, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:08:47] ax.service.ax_client: Generated new trial 18 with parameters {'x1': 0.252234, 'x2': 0.308824, 'x3': 0.739985, 'x4': 0.027777, 'x5': 0.0, 'x6': 0.723812} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:08:47] ax.service.ax_client: Completed trial 18 with data: {'hartmann6': (-0.634111, 0.0), 'l2norm': (1.109616, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:08:55] ax.service.ax_client: Generated new trial 19 with parameters {'x1': 0.3242, 'x2': 0.278458, 'x3': 0.623416, 'x4': 0.15834, 'x5': 0.126965, 'x6': 0.942561} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:08:55] ax.service.ax_client: Completed trial 19 with data: {'hartmann6': (-1.19408, 0.0), 'l2norm': (1.225115, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:09:03] ax.service.ax_client: Generated new trial 20 with parameters {'x1': 0.235849, 'x2': 0.447336, 'x3': 0.679505, 'x4': 0.0, 'x5': 0.100441, 'x6': 0.894866} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:09:03] ax.service.ax_client: Completed trial 20 with data: {'hartmann6': (-1.041901, 0.0), 'l2norm': (1.236259, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:09:11] ax.service.ax_client: Generated new trial 21 with parameters {'x1': 0.043586, 'x2': 0.275752, 'x3': 0.760699, 'x4': 0.094319, 'x5': 0.103941, 'x6': 0.910776} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:09:11] ax.service.ax_client: Completed trial 21 with data: {'hartmann6': (-1.294885, 0.0), 'l2norm': (1.227116, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:09:27] ax.service.ax_client: Generated new trial 22 with parameters {'x1': 0.008141, 'x2': 0.321377, 'x3': 0.886142, 'x4': 0.183151, 'x5': 0.108566, 'x6': 0.688974} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:09:27] ax.service.ax_client: Completed trial 22 with data: {'hartmann6': (-0.97257, 0.0), 'l2norm': (1.18685, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:09:33] ax.service.ax_client: Generated new trial 23 with parameters {'x1': 0.0, 'x2': 0.0, 'x3': 0.180104, 'x4': 0.0, 'x5': 0.257047, 'x6': 0.0} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:09:33] ax.service.ax_client: Completed trial 23 with data: {'hartmann6': (-0.029863, 0.0), 'l2norm': (0.313864, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:09:40] ax.service.ax_client: Generated new trial 24 with parameters {'x1': 0.0, 'x2': 0.258798, 'x3': 0.0, 'x4': 0.0, 'x5': 0.102482, 'x6': 0.886137} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:09:40] ax.service.ax_client: Completed trial 24 with data: {'hartmann6': (-0.290107, 0.0), 'l2norm': (0.928827, 0.0)}.\n" ] } ], "source": [ "for i in range(25):\n", " parameterization, trial_index = ax_client.get_next_trial()\n", " # Local evaluation here can be replaced with deployment to external system.\n", " ax_client.complete_trial(trial_index=trial_index, raw_data=evaluate(parameterization))" ] }, { "cell_type": "markdown", "id": "6a92e93a", "metadata": { "papermill": { "duration": 0.045749, "end_time": "2025-01-31T05:09:40.317347", "exception": false, "start_time": "2025-01-31T05:09:40.271598", "status": "completed" }, "tags": [] }, "source": [ "### How many trials can run in parallel?\n", "By default, Ax restricts number of trials that can run in parallel for some optimization stages, in order to improve the optimization performance and reduce the number of trials that the optimization will require. To check the maximum parallelism for each optimization stage:" ] }, { "cell_type": "code", "execution_count": 6, "id": "7d41b2af", "metadata": { "execution": { "iopub.execute_input": "2025-01-31T05:09:40.410761Z", "iopub.status.busy": "2025-01-31T05:09:40.410016Z", "iopub.status.idle": "2025-01-31T05:09:40.416949Z", "shell.execute_reply": "2025-01-31T05:09:40.416374Z" }, "papermill": { "duration": 0.055201, "end_time": "2025-01-31T05:09:40.418281", "exception": false, "start_time": "2025-01-31T05:09:40.363080", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "[(12, 12), (-1, 3)]" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism()" ] }, { "cell_type": "markdown", "id": "0abc600c", "metadata": { "papermill": { "duration": 0.048098, "end_time": "2025-01-31T05:09:40.512464", "exception": false, "start_time": "2025-01-31T05:09:40.464366", "status": "completed" }, "tags": [] }, "source": [ "The output of this function is a list of tuples of form (number of trials, max parallelism), so the example above means \"the max parallelism is 12 for the first 12 trials and 3 for all subsequent trials.\" This is because the first 12 trials are produced quasi-randomly and can all be evaluated at once, and subsequent trials are produced via Bayesian optimization, which converges on optimal point in fewer trials when parallelism is limited. `MaxParallelismReachedException` indicates that the parallelism limit has been reached –– refer to the 'Service API Exceptions Meaning and Handling' section at the end of the tutorial for handling." ] }, { "cell_type": "markdown", "id": "c0e3cc2a", "metadata": { "papermill": { "duration": 0.046294, "end_time": "2025-01-31T05:09:40.607228", "exception": false, "start_time": "2025-01-31T05:09:40.560934", "status": "completed" }, "tags": [] }, "source": [ "### How to view all existing trials during optimization?" ] }, { "cell_type": "code", "execution_count": 7, "id": "8a354a82", "metadata": { "execution": { "iopub.execute_input": "2025-01-31T05:09:40.701109Z", "iopub.status.busy": "2025-01-31T05:09:40.700830Z", "iopub.status.idle": "2025-01-31T05:09:40.745825Z", "shell.execute_reply": "2025-01-31T05:09:40.745142Z" }, "papermill": { "duration": 0.093702, "end_time": "2025-01-31T05:09:40.747185", "exception": false, "start_time": "2025-01-31T05:09:40.653483", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "/tmp/ipykernel_2531/1060711394.py:1: DeprecationWarning:\n", "\n", "`GenerationStrategy.trials_as_df` is deprecated and will be removed in a future release. Please use `Experiment.to_df()` instead.\n", "\n" ] }, { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
trial_indexarm_nametrial_statusgeneration_methodgeneration_nodel2normhartmann6x1x2x3x4x5x6
000_0COMPLETEDSobolGenerationStep_01.487758-0.3968600.7039698.898727e-010.7834135.029778e-016.775916e-022.338011e-01
111_0COMPLETEDSobolGenerationStep_01.319910-0.2546440.4199341.803363e-010.4112211.912697e-019.383513e-016.686604e-01
222_0COMPLETEDSobolGenerationStep_01.579427-0.1352480.2265016.129511e-010.7378417.900701e-015.325335e-017.844525e-01
333_0COMPLETEDSobolGenerationStep_01.199542-0.1657440.8996043.166262e-010.1139394.783657e-014.110641e-013.443427e-01
444_0COMPLETEDSobolGenerationStep_01.234896-0.0783900.8163117.181677e-010.3665682.765979e-013.545974e-017.887731e-02
555_0COMPLETEDSobolGenerationStep_01.714257-0.0037490.0597864.775067e-010.9848539.647710e-017.330556e-015.186535e-01
666_0COMPLETEDSobolGenerationStep_01.476013-0.0122290.3640927.851139e-010.1629904.806898e-027.648059e-019.032410e-01
777_0COMPLETEDSobolGenerationStep_01.150540-0.1449380.5098041.991366e-020.5329857.362382e-011.353332e-014.679867e-01
888_0COMPLETEDSobolGenerationStep_01.566844-0.0763770.6229625.322298e-010.2335238.891465e-019.252491e-012.871403e-01
999_0COMPLETEDSobolGenerationStep_01.153777-1.0626030.2531422.720337e-010.6015653.268318e-015.350136e-028.494445e-01
101010_0COMPLETEDSobolGenerationStep_01.488361-0.0505110.0731029.663826e-010.3111396.606175e-014.602292e-017.286609e-01
111111_0COMPLETEDSobolGenerationStep_01.391329-0.0172430.8008012.285299e-010.9313789.829898e-025.810389e-011.659958e-01
121212_0COMPLETEDBoTorchGenerationStep_11.254073-0.9020760.2723932.619656e-010.6849062.678518e-011.210877e-159.428853e-01
131313_0COMPLETEDBoTorchGenerationStep_11.179952-0.6422030.1587441.504775e-010.6262503.627725e-010.000000e+009.058980e-01
141414_0COMPLETEDBoTorchGenerationStep_11.037385-1.0114840.2351963.273625e-010.4533902.968781e-015.664273e-027.853520e-01
151515_0COMPLETEDBoTorchGenerationStep_11.298963-0.7703590.5389522.836184e-010.5993815.295772e-011.196091e-018.138664e-01
161616_0COMPLETEDBoTorchGenerationStep_11.117795-1.2361440.2191882.768505e-010.6965258.688063e-029.848539e-027.889120e-01
171717_0COMPLETEDBoTorchGenerationStep_11.176505-1.1317550.1067112.788543e-010.8120760.000000e+001.698903e-017.789022e-01
181818_0COMPLETEDBoTorchGenerationStep_11.109616-0.6341110.2522343.088239e-010.7399852.777717e-020.000000e+007.238124e-01
191919_0COMPLETEDBoTorchGenerationStep_11.225115-1.1940800.3242002.784577e-010.6234161.583403e-011.269645e-019.425614e-01
202020_0COMPLETEDBoTorchGenerationStep_11.236259-1.0419010.2358494.473361e-010.6795050.000000e+001.004413e-018.948661e-01
212121_0COMPLETEDBoTorchGenerationStep_11.227116-1.2948850.0435862.757521e-010.7606999.431888e-021.039409e-019.107761e-01
222222_0COMPLETEDBoTorchGenerationStep_11.186850-0.9725700.0081413.213769e-010.8861421.831513e-011.085663e-016.889743e-01
232323_0COMPLETEDBoTorchGenerationStep_10.313864-0.0298630.0000001.220982e-150.1801040.000000e+002.570473e-012.788560e-16
242424_0COMPLETEDBoTorchGenerationStep_10.928827-0.2901070.0000002.587985e-010.0000005.625888e-141.024816e-018.861374e-01
\n", "
" ], "text/plain": [ " trial_index arm_name trial_status generation_method generation_node \\\n", "0 0 0_0 COMPLETED Sobol GenerationStep_0 \n", "1 1 1_0 COMPLETED Sobol GenerationStep_0 \n", "2 2 2_0 COMPLETED Sobol GenerationStep_0 \n", "3 3 3_0 COMPLETED Sobol GenerationStep_0 \n", "4 4 4_0 COMPLETED Sobol GenerationStep_0 \n", "5 5 5_0 COMPLETED Sobol GenerationStep_0 \n", "6 6 6_0 COMPLETED Sobol GenerationStep_0 \n", "7 7 7_0 COMPLETED Sobol GenerationStep_0 \n", "8 8 8_0 COMPLETED Sobol GenerationStep_0 \n", "9 9 9_0 COMPLETED Sobol GenerationStep_0 \n", "10 10 10_0 COMPLETED Sobol GenerationStep_0 \n", "11 11 11_0 COMPLETED Sobol GenerationStep_0 \n", "12 12 12_0 COMPLETED BoTorch GenerationStep_1 \n", "13 13 13_0 COMPLETED BoTorch GenerationStep_1 \n", "14 14 14_0 COMPLETED BoTorch GenerationStep_1 \n", "15 15 15_0 COMPLETED BoTorch GenerationStep_1 \n", "16 16 16_0 COMPLETED BoTorch GenerationStep_1 \n", "17 17 17_0 COMPLETED BoTorch GenerationStep_1 \n", "18 18 18_0 COMPLETED BoTorch GenerationStep_1 \n", "19 19 19_0 COMPLETED BoTorch GenerationStep_1 \n", "20 20 20_0 COMPLETED BoTorch GenerationStep_1 \n", "21 21 21_0 COMPLETED BoTorch GenerationStep_1 \n", "22 22 22_0 COMPLETED BoTorch GenerationStep_1 \n", "23 23 23_0 COMPLETED BoTorch GenerationStep_1 \n", "24 24 24_0 COMPLETED BoTorch GenerationStep_1 \n", "\n", " l2norm hartmann6 x1 x2 x3 x4 \\\n", "0 1.487758 -0.396860 0.703969 8.898727e-01 0.783413 5.029778e-01 \n", "1 1.319910 -0.254644 0.419934 1.803363e-01 0.411221 1.912697e-01 \n", "2 1.579427 -0.135248 0.226501 6.129511e-01 0.737841 7.900701e-01 \n", "3 1.199542 -0.165744 0.899604 3.166262e-01 0.113939 4.783657e-01 \n", "4 1.234896 -0.078390 0.816311 7.181677e-01 0.366568 2.765979e-01 \n", "5 1.714257 -0.003749 0.059786 4.775067e-01 0.984853 9.647710e-01 \n", "6 1.476013 -0.012229 0.364092 7.851139e-01 0.162990 4.806898e-02 \n", "7 1.150540 -0.144938 0.509804 1.991366e-02 0.532985 7.362382e-01 \n", "8 1.566844 -0.076377 0.622962 5.322298e-01 0.233523 8.891465e-01 \n", "9 1.153777 -1.062603 0.253142 2.720337e-01 0.601565 3.268318e-01 \n", "10 1.488361 -0.050511 0.073102 9.663826e-01 0.311139 6.606175e-01 \n", "11 1.391329 -0.017243 0.800801 2.285299e-01 0.931378 9.829898e-02 \n", "12 1.254073 -0.902076 0.272393 2.619656e-01 0.684906 2.678518e-01 \n", "13 1.179952 -0.642203 0.158744 1.504775e-01 0.626250 3.627725e-01 \n", "14 1.037385 -1.011484 0.235196 3.273625e-01 0.453390 2.968781e-01 \n", "15 1.298963 -0.770359 0.538952 2.836184e-01 0.599381 5.295772e-01 \n", "16 1.117795 -1.236144 0.219188 2.768505e-01 0.696525 8.688063e-02 \n", "17 1.176505 -1.131755 0.106711 2.788543e-01 0.812076 0.000000e+00 \n", "18 1.109616 -0.634111 0.252234 3.088239e-01 0.739985 2.777717e-02 \n", "19 1.225115 -1.194080 0.324200 2.784577e-01 0.623416 1.583403e-01 \n", "20 1.236259 -1.041901 0.235849 4.473361e-01 0.679505 0.000000e+00 \n", "21 1.227116 -1.294885 0.043586 2.757521e-01 0.760699 9.431888e-02 \n", "22 1.186850 -0.972570 0.008141 3.213769e-01 0.886142 1.831513e-01 \n", "23 0.313864 -0.029863 0.000000 1.220982e-15 0.180104 0.000000e+00 \n", "24 0.928827 -0.290107 0.000000 2.587985e-01 0.000000 5.625888e-14 \n", "\n", " x5 x6 \n", "0 6.775916e-02 2.338011e-01 \n", "1 9.383513e-01 6.686604e-01 \n", "2 5.325335e-01 7.844525e-01 \n", "3 4.110641e-01 3.443427e-01 \n", "4 3.545974e-01 7.887731e-02 \n", "5 7.330556e-01 5.186535e-01 \n", "6 7.648059e-01 9.032410e-01 \n", "7 1.353332e-01 4.679867e-01 \n", "8 9.252491e-01 2.871403e-01 \n", "9 5.350136e-02 8.494445e-01 \n", "10 4.602292e-01 7.286609e-01 \n", "11 5.810389e-01 1.659958e-01 \n", "12 1.210877e-15 9.428853e-01 \n", "13 0.000000e+00 9.058980e-01 \n", "14 5.664273e-02 7.853520e-01 \n", "15 1.196091e-01 8.138664e-01 \n", "16 9.848539e-02 7.889120e-01 \n", "17 1.698903e-01 7.789022e-01 \n", "18 0.000000e+00 7.238124e-01 \n", "19 1.269645e-01 9.425614e-01 \n", "20 1.004413e-01 8.948661e-01 \n", "21 1.039409e-01 9.107761e-01 \n", "22 1.085663e-01 6.889743e-01 \n", "23 2.570473e-01 2.788560e-16 \n", "24 1.024816e-01 8.861374e-01 " ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.generation_strategy.trials_as_df" ] }, { "cell_type": "markdown", "id": "ada8eb61", "metadata": { "papermill": { "duration": 0.047564, "end_time": "2025-01-31T05:09:40.841758", "exception": false, "start_time": "2025-01-31T05:09:40.794194", "status": "completed" }, "tags": [] }, "source": [ "## 5. Retrieve best parameters\n", "\n", "Once it's complete, we can access the best parameters found, as well as the corresponding metric values." ] }, { "cell_type": "code", "execution_count": 8, "id": "c65ba7b4", "metadata": { "execution": { "iopub.execute_input": "2025-01-31T05:09:40.937297Z", "iopub.status.busy": "2025-01-31T05:09:40.936791Z", "iopub.status.idle": "2025-01-31T05:09:41.285284Z", "shell.execute_reply": "2025-01-31T05:09:41.284293Z" }, "papermill": { "duration": 0.399173, "end_time": "2025-01-31T05:09:41.288186", "exception": false, "start_time": "2025-01-31T05:09:40.889013", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "{'x1': 0.04358563812513101,\n", " 'x2': 0.2757520708015818,\n", " 'x3': 0.7606988007693695,\n", " 'x4': 0.09431888146679386,\n", " 'x5': 0.10394089808185872,\n", " 'x6': 0.910776096828327}" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "best_parameters, values = ax_client.get_best_parameters()\n", "best_parameters" ] }, { "cell_type": "code", "execution_count": 9, "id": "bd4680b3", "metadata": { "execution": { "iopub.execute_input": "2025-01-31T05:09:41.422894Z", "iopub.status.busy": "2025-01-31T05:09:41.422402Z", "iopub.status.idle": "2025-01-31T05:09:41.427142Z", "shell.execute_reply": "2025-01-31T05:09:41.426566Z" }, "papermill": { "duration": 0.061443, "end_time": "2025-01-31T05:09:41.428460", "exception": false, "start_time": "2025-01-31T05:09:41.367017", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "{'l2norm': 1.2271159516754357, 'hartmann6': -1.2948834708530028}" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "means, covariances = values\n", "means" ] }, { "cell_type": "markdown", "id": "2acca7ef", "metadata": { "papermill": { "duration": 0.046619, "end_time": "2025-01-31T05:09:41.521940", "exception": false, "start_time": "2025-01-31T05:09:41.475321", "status": "completed" }, "tags": [] }, "source": [ "For comparison, Hartmann6 minimum:" ] }, { "cell_type": "code", "execution_count": 10, "id": "68170784", "metadata": { "execution": { "iopub.execute_input": "2025-01-31T05:09:41.617368Z", "iopub.status.busy": "2025-01-31T05:09:41.616888Z", "iopub.status.idle": "2025-01-31T05:09:41.621461Z", "shell.execute_reply": "2025-01-31T05:09:41.620799Z" }, "papermill": { "duration": 0.053909, "end_time": "2025-01-31T05:09:41.622790", "exception": false, "start_time": "2025-01-31T05:09:41.568881", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "-3.32237" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "hartmann6.fmin" ] }, { "cell_type": "markdown", "id": "f2a48a6b", "metadata": { "papermill": { "duration": 0.046527, "end_time": "2025-01-31T05:09:41.716094", "exception": false, "start_time": "2025-01-31T05:09:41.669567", "status": "completed" }, "tags": [] }, "source": [ "## 6. Plot the response surface and optimization trace\n", "Here we arbitrarily select \"x1\" and \"x2\" as the two parameters to plot for both metrics, \"hartmann6\" and \"l2norm\"." ] }, { "cell_type": "code", "execution_count": 11, "id": "7525700b", "metadata": { "execution": { "iopub.execute_input": "2025-01-31T05:09:41.810584Z", "iopub.status.busy": "2025-01-31T05:09:41.810042Z", "iopub.status.idle": "2025-01-31T05:09:42.519971Z", "shell.execute_reply": "2025-01-31T05:09:42.518700Z" }, "papermill": { "duration": 0.805787, "end_time": "2025-01-31T05:09:42.568383", "exception": false, "start_time": "2025-01-31T05:09:41.762596", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:09:41] ax.service.ax_client: Retrieving contour plot with parameter 'x1' on X-axis and 'x2' on Y-axis, for metric 'hartmann6'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ -0.2927035115708464, -0.2926477099203233, -0.2925851573535552, -0.29251586151582765, -0.29243983092625975, -0.29235707497606356, -0.2922676039266079, -0.2921714289073004, -0.2920685619132794, -0.29195901580292205, -0.2918428042951644, -0.291719941966638, -0.2915904442486242, -0.2914543274238234, -0.2913116086229421, -0.29116230582110103, -0.29100643783406116, -0.2908440243142724, -0.29067508574674383, -0.29049964344473805, -0.29031771954528834, -0.2901293370045464, -0.2899345195929515, -0.28973329189023445, -0.28952567928024747, -0.2893117079456286, -0.28909140486229945, -0.28886479779379454, -0.28863191528543386, -0.28839278665832824, -0.2881474420032266, -0.2878959121742068, -0.2876382287822087, -0.2873744241884129, -0.28710453149746884, -0.2868285845505718, -0.2865466179183898, -0.28625866689384744, -0.28596476748476407, -0.28566495640634904, -0.2853592710735601, -0.28504774959332085, -0.2847304307566064, -0.2844073540303916, -0.2840785595494745, -0.2837440881081664, -0.28340398115185894, -0.28305828076846623, -0.2827070296797479, -0.2823502712325121 ], [ -0.3025878484946164, -0.30252803638170134, -0.30246104445852057, -0.30238688091396004, -0.30230555486640515, -0.30221707636187434, -0.3021214563719493, -0.3020187067915109, -0.30190884043627203, -0.30179187104011285, -0.3016678132522216, -0.3015366826340355, -0.30139849565598814, -0.30125326969406246, -0.3011010230261478, -0.3009417748282075, -0.300775545170253, -0.30060235501212823, -0.3004222261991057, -0.300235181457293, -0.3000412443888562, -0.29984043946705474, -0.2996327920310952, -0.29941832828080195, -0.29919707527110884, -0.2989690609063706, -0.29873431393449756, -0.2984928639409149, -0.2982447413423496, -0.2979899773804433, -0.2977286041151979, -0.2974606544182514, -0.29718616196598674, -0.29690516123248134, -0.29661768748228867, -0.29632377676306415, -0.2960234658980321, -0.29571679247829774, -0.29540379485500523, -0.2950845121313454, -0.29475898415441476, -0.2944272515069286, -0.2940893554987902, -0.29374533815851794, -0.2933952422245347, -0.2930391111363213, -0.29267698902543443, -0.2923089207063952, -0.29193495166744704, -0.29155512806119166 ], [ -0.3118773514391274, -0.31181351295587234, -0.31174209088072213, -0.311663093945291, -0.31157653186317835, -0.31148241532797744, -0.31138075601107584, -0.3112715665592433, -0.3111548605920095, -0.3110306526988346, -0.3108989584360672, -0.31075979432369977, -0.3106131778419139, -0.3104591274274202, -0.31029766246959695, -0.31012880330642006, -0.30995257122019615, -0.30976898843308953, -0.3095780781024555, -0.30937986431596864, -0.30917437208656073, -0.30896162734715804, -0.30874165694522837, -0.3085144886371344, -0.30828015108229645, -0.30803867383716743, -0.30779008734901936, -0.30753442294954547, -0.3072717128482795, -0.3070019901258326, -0.3067252887269505, -0.3064416434533963, -0.30615108995665374, -0.30585366473045916, -0.3055494051031653, -0.30523834922993065, -0.30492053608474784, -0.3045960054523047, -0.30426479791968475, -0.30392695486790855, -0.30358251846331785, -0.30323153164880495, -0.30287403813489167, -0.30251008239065846, -0.30213970963452574, -0.3017629658248951, -0.3013798976506436, -0.30099055252148543, -0.30059497855819517, -0.30019322458269704 ], [ -0.32040735566321943, -0.32033950909924236, -0.3202637073339759, -0.3201799596358645, -0.32008827630373593, -0.31998866866469033, -0.3198811490717699, -0.3197657309014057, -0.31964242855064295, -0.31951125743415165, -0.3193722339810119, -0.31922537563128595, -0.3190707008323722, -0.3189082290351434, -0.31873798068986836, -0.31855997724192475, -0.31837424112729584, -0.3181807957678553, -0.31797966556644963, -0.317770875901763, -0.31755445312298397, -0.3173304245442612, -0.3170988184389595, -0.316859664033713, -0.3166129915022783, -0.3163588319591909, -0.31609721745322306, -0.31582818096064946, -0.31555175637832034, -0.3152679785165433, -0.3149768830917785, -0.3146785067191453, -0.3143728869047494, -0.31406006203782416, -0.31374007138269533, -0.31341295507056616, -0.3130787540911327, -0.3127375102840222, -0.31238926633006514, -0.3120340657423983, -0.31167195285740446, -0.31130297282549146, -0.31092717160171063, -0.3105445959362165, -0.3101552933645815, -0.3097593121979476, -0.30935670151304206, -0.30894751114204033, -0.3085317916622883, -0.30810959438588914 ], [ -0.32801826561933994, -0.3279464656055058, -0.32786637780485295, -0.32777801201149226, -0.3276813790933457, -0.3275764909899239, -0.327463360709866, -0.32734200232825306, -0.3272124309836883, -0.32707466287515063, -0.32692871525862055, -0.32677460644347633, -0.32661235578866865, -0.32644198369866373, -0.3262635116191709, -0.32607696203264075, -0.32588235845354707, -0.3256797254234456, -0.32546908850581624, -0.3252504742806892, -0.325023910339055, -0.32478942527705923, -0.32454704868999085, -0.3242968111660537, -0.32403874427993423, -0.32377288058616227, -0.3234992536122674, -0.3232178978517306, -0.3229288487567402, -0.32263214273074525, -0.32232781712081526, -0.3220159102098065, -0.32169646120833606, -0.32136951024656635, -0.3210350983658048, -0.32069326750991733, -0.3203440605165613, -0.31998752110824, -0.3196236938831798, -0.3192526243060321, -0.31887435869840697, -0.31848894422923785, -0.318096428904978, -0.3176968615596386, -0.31729029184466295, -0.3168767702186467, -0.31645634793690314, -0.3160290770408768, -0.3155950103474121, -0.3151542014378729 ], [ -0.3345598524866068, -0.3344841916961554, -0.33439995601749506, -0.33430715575379955, -0.33420580231968916, -0.33409590823889057, -0.33397748714165915, -0.3338505537619609, -0.33371512393441966, -0.3335712145910229, -0.3334188437575954, -0.3332580305500361, -0.33308879517032075, -0.3329111589022736, -0.33272514410710374, -0.3325307742187177, -0.33232807373879525, -0.33211706823164655, -0.3318977843188331, -0.3316702496735755, -0.33143449301493044, -0.33119054410175086, -0.33093843372642395, -0.33067819370839546, -0.33040985688747626, -0.33013345711693415, -0.3298490292563804, -0.3295566091644376, -0.3292562336912094, -0.3289479406705399, -0.3286317689120716, -0.32830775819310365, -0.3279759492502534, -0.32763638377091864, -0.3272891043845515, -0.32693415465373665, -0.32657157906508893, -0.32620142301995836, -0.3258237328249576, -0.3254385556823074, -0.32504593968000645, -0.32464593378182666, -0.3242385878171387, -0.3238239524705673, -0.32340207927148135, -0.32297302058332644, -0.3225368295927916, -0.32209356029882685, -0.3216432675015022, -0.3211860067907224 ], [ -0.3398954932945436, -0.33981610364356246, -0.33972790337515046, -0.3396309032794309, -0.33952511528904517, -0.3394105524767084, -0.33928722905251607, -0.33915516036101034, -0.3390143628779951, -0.3388648542071133, -0.33870665307617653, -0.33853977933325763, -0.33836425394254077, -0.3381800989799292, -0.33798733762842126, -0.33778599417324573, -0.33757609399676025, -0.3373576635731219, -0.3371307304627216, -0.3368953233063859, -0.3366514718193564, -0.33639920678503626, -0.33613856004851445, -0.3358695645098678, -0.33559225411723603, -0.3353066638596869, -0.33501282975985336, -0.3347107888663664, -0.33440057924606703, -0.33408223997600955, -0.3337558111352633, -0.3334213337964975, -0.3330788500173705, -0.332728402831719, -0.3323700362405446, -0.33200379520280643, -0.3316297256260228, -0.3312478743566813, -0.3308582891704608, -0.3304610187622724, -0.33005611273611535, -0.3296436215947555, -0.32922359672922985, -0.32879609040817676, -0.32836115576699687, -0.3279188467968501, -0.32746921833348686, -0.32701232604591934, -0.32654822642494147, -0.32607697677148734 ], [ -0.3439061961183866, -0.34382324941616726, -0.3437313128832641, -0.34363039776911875, -0.3435205164895397, -0.3434016826241576, -0.3432739109136314, -0.3431372172565981, -0.3429916187063783, -0.34283713346743, -0.34267378089155665, -0.3425015814738652, -0.34232055684848234, -0.34213072978402354, -0.34193212417882163, -0.3417247650559112, -0.34150867855777467, -0.3412838919408503, -0.34105043356980136, -0.3408083329115513, -0.3405576205290861, -0.3402983280750228, -0.34003048828495125, -0.3397541349705444, -0.3394693030124468, -0.3391760283529368, -0.3388743479883676, -0.3385642999613895, -0.3382459233529558, -0.33791925827411173, -0.33758434585757435, -0.3372412282490995, -0.3368899485986453, -0.33653055105132623, -0.3361630807381694, -0.33578758376666973, -0.3354041072111482, -0.33501269910291864, -0.3346134084202609, -0.33420628507820727, -0.333791379918146, -0.3333687446972392, -0.3329384320776655, -0.3325004956156835, -0.33205498975052744, -0.3316019697931293, -0.33114149191467734, -0.3306736131350101, -0.3301983913108545, -0.32971588512390293 ], [ -0.34649425719034616, -0.34640796520052164, -0.3463125649257317, -0.3462080680416857, -0.3460944874065359, -0.34597183705823753, -0.34584013221166165, -0.3456993892554465, -0.3455496257486034, -0.3453908604168642, -0.3452231131487765, -0.34504640499155614, -0.3448607581466838, -0.3446661959652574, -0.344462742943094, -0.3442504247155944, -0.3440292680523569, -0.3437993008515525, -0.3435605521340612, -0.34331305203736645, -0.3430568318092173, -0.34279192380105206, -0.3425183614611901, -0.34223617932779615, -0.3419454130216102, -0.3416460992384545, -0.34133827574151815, -0.34102198135341194, -0.34069725594801464, -0.34036414044208946, -0.3400226767866966, -0.33967290795838745, -0.3393148779501892, -0.33894863176238343, -0.33857421539308336, -0.338191675828602, -0.33780106103362895, -0.337402419941208, -0.3369958024425187, -0.3365812593764753, -0.33615884251913153, -0.3357286045729062, -0.3352905991556232, -0.3348448807893808, -0.3343915048892392, -0.3339305277517436, -0.3334620065432734, -0.3329859992882318, -0.33250256485707286, -0.33201176295416945 ], [ -0.3475864043502467, -0.34749701823533563, -0.34739846934743096, -0.3472907697502309, -0.3471739326977499, -0.34704797263160775, -0.34691290517804896, -0.34676874714471917, -0.34661551651717293, -0.3464532324551396, -0.34628191528852964, -0.3461015865131878, -0.3459122687864012, -0.3457139859221532, -0.34550676288613114, -0.34529062579048947, -0.3450656018883625, -0.3448317195681404, -0.3445890083475002, -0.3443374988671948, -0.34407722288460924, -0.3438082132670761, -0.34353050398496054, -0.3432441301045074, -0.342949127780466, -0.34264553424848176, -0.34233338781726247, -0.34201272786052345, -0.34168359480870997, -0.34134603014050213, -0.3410000763741048, -0.34064577705831833, -0.3402831767634088, -0.33991232107175884, -0.339533256568321, -0.33914603083086664, -0.3387506924200311, -0.3383472908691674, -0.33793587667400393, -0.3375165012821113, -0.3370892170821784, -0.33665407739311276, -0.3362111364529462, -0.3357604494075754, -0.33530207229931885, -0.3348360620553049, -0.3343624764756929, -0.33388137422172637, -0.33339281480362787, -0.3328968585683341 ], [ -0.3471362969216429, -0.34704410605641656, -0.3469427639602505, -0.3468322830415892, -0.3467126768986056, -0.34658396031641436, -0.3464461492640243, -0.3462992608910397, -0.3461433135241038, -0.34597832666308576, -0.3458043209770202, -0.3456213182997896, -0.34542934162556055, -0.34522841510396785, -0.3450185640350505, -0.34479981486394434, -0.3445721951753258, -0.34433573368761683, -0.344090460246945, -0.3438364058208653, -0.3435736024918453, -0.343302083450512, -0.3430218829886659, -0.34273303649206377, -0.3424355804329708, -0.3421295523624863, -0.34181499090264356, -0.34149193573828496, -0.3411604276087212, -0.34082050829916616, -0.3404722206319618, -0.3401156084575892, -0.3397507166454632, -0.3393775910745287, -0.33899627862364445, -0.33860682716177026, -0.33820928553795016, -0.33780370357110345, -0.3373901320396191, -0.3369686226707642, -0.33653922812989934, -0.33610200200951657, -0.33565699881808997, -0.33520427396875463, -0.3347438837678083, -0.33427588540304154, -0.3338003369319026, -0.333317297269496, -0.3328268261764218, -0.3323289842464583 ], [ -0.34512627430849324, -0.34503160446106695, -0.3449278617992564, -0.34481505902842, -0.3446932100344662, -0.34456232988100954, -0.34442243480626333, -0.34427354221968753, -0.3441156706983738, -0.34394883998318654, -0.34377307097464616, -0.34358838572856765, -0.34339480745144857, -0.3431923604956049, -0.34298107035407205, -0.34276096365524833, -0.3425320681573072, -0.3422944127423593, -0.3420480274103817, -0.3417929432729049, -0.3415291925464661, -0.3412568085458282, -0.3409758256769674, -0.3406862794298294, -0.3403882063708603, -0.3400816441353106, -0.33976663141931185, -0.3394432079717436, -0.33911141458586924, -0.33877129309076415, -0.33842288634252554, -0.3380662382152746, -0.3377013935919495, -0.33732839835489126, -0.33694729937622697, -0.3365581445080582, -0.3361609825724421, -0.33575586335118945, -0.3353428375754629, -0.3349219569151922, -0.33449327396830164, -0.3340568422497576, -0.33361271618043475, -0.33316095107580956, -0.3327016031344801, -0.3322347294265161, -0.3317603878816472, -0.3312786372772827, -0.3307895372263806, -0.3302931481651542 ], [ -0.3415682734377349, -0.3414714843310168, -0.3413657672852588, -0.34125113525074924, -0.3411276023406059, -0.3409951838278804, -0.340853896142415, -0.3407037568674404, -0.34054478473593397, -0.3403769996267231, -0.3402004225603419, -0.34001507569464323, -0.3398209823201656, -0.33961816685525276, -0.3394066548409378, -0.3391864729355797, -0.3389576489092644, -0.33872021163796845, -0.33847419109748544, -0.3382196183571193, -0.3379565255731461, -0.33768494598204246, -0.33740491389349125, -0.3371164646831548, -0.33681963478523025, -0.33651446168477794, -0.3362009839098331, -0.3358792410232997, -0.33554927361462994, -0.33521112329128955, -0.33486483267001443, -0.33451044536786156, -0.33414800599305206, -0.33377756013561255, -0.33339915435782286, -0.3330128361844576, -0.3326186540928435, -0.33221665750272056, -0.3318068967659141, -0.33138942315583253, -0.3309642888567671, -0.33053154695302833, -0.3300912514178971, -0.32964345710240994, -0.3291882197239719, -0.32872559585480426, -0.3282556429102298, -0.32777841913680383, -0.32729398360028206, -0.3268023961734424 ], [ -0.3365038673560462, -0.3364053496357392, -0.33629811363124784, -0.3361821724821775, -0.33605754046489844, -0.3359242329896167, -0.33578226659720267, -0.3356316589557663, -0.33547242885699924, -0.3353045962122614, -0.33512818204843575, -0.334943208503536, -0.3347496988220769, -0.33454767735020685, -0.33433716953060333, -0.3341182018971305, -0.33389080206926836, -0.33365499874630505, -0.33341082170129976, -0.33315830177481964, -0.3328974708684467, -0.33262836193806244, -0.33235100898690645, -0.33206544705841834, -0.33177171222885626, -0.3314698415997054, -0.3311598732898631, -0.3308418464276215, -0.33051580114243373, -0.33018177855647535, -0.3298398207760024, -0.32948997088250326, -0.3291322729236575, -0.32876677190409054, -0.32839351377593773, -0.3280125454292189, -0.32762391468201846, -0.32722767027048916, -0.32682386183865964, -0.3264125399280769, -0.3259937559672594, -0.3255675622609865, -0.3251340119794089, -0.32469315914699737, -0.3242450586313251, -0.32378976613168975, -0.3233273381675761, -0.3228578320669677, -0.32238130595450404, -0.3218978187394924 ], [ -0.3300034122805314, -0.3299035839288932, -0.3297953088190466, -0.3296786002212483, -0.32955347250847683, -0.3294199411534827, -0.32927802272560225, -0.3291277348873325, -0.3289690963906648, -0.32880212707318857, -0.32862684785395746, -0.32844328072911805, -0.32825144876731427, -0.32805137610485285, -0.3278430879406423, -0.32762661053090414, -0.32740197118365844, -0.3271691982529804, -0.32692832113303677, -0.32667937025189886, -0.3264223770651403, -0.3261573740492086, -0.325884394694588, -0.3256034734987465, -0.3253146459588693, -0.3250179485643842, -0.32471341878927873, -0.3244010950842121, -0.3240810168684253, -0.32375322452144994, -0.32341775937461736, -0.32307466370237664, -0.32272398071341235, -0.3223657545415817, -0.322000030236653, -0.3216268537548684, -0.3212462719493192, -0.320858332560142, -0.3204630842045414, -0.3200605763666343, -0.3196508593871293, -0.319233984452833, -0.31881000358599343, -0.31837896963348444, -0.31794093625582953, -0.31749595791606955, -0.31704408986848054, -0.31658538814714166, -0.31611990955435876, -0.31564771164894406 ], [ -0.3221643264716716, -0.32206362871825117, -0.3219548135375958, -0.3218378942695377, -0.3217128853151155, -0.32157980213362247, -0.32143866123941667, -0.321289480198511, -0.3211322776249277, -0.3209670731768283, -0.32079388755241567, -0.3206127424856155, -0.32042366074152684, -0.32022666611165673, -0.32002178340893095, -0.3198090384624833, -0.31958845811223097, -0.31936007020323065, -0.31912390357982034, -0.31887998807954765, -0.3186283545268903, -0.31836903472675837, -0.3181020614578015, -0.3178274684655003, -0.31754529045505725, -0.3172555630840904, -0.31695832295512083, -0.3166536076078662, -0.31634145551134407, -0.316021906055773, -0.3156949995442933, -0.31536077718449285, -0.31501928107975274, -0.31467055422040824, -0.31431464047472824, -0.313951584579722, -0.31358143213176526, -0.31320422957705896, -0.3128200242019171, -0.3124288641228898, -0.3120307982767182, -0.31162587641013756, -0.31121414906951367, -0.3107956675903311, -0.3103704840865267, -0.30993865143967825, -0.3095002232880428, -0.3090552540154581, -0.3086037987401024, -0.30814591330312047 ], [ -0.31310855962557715, -0.31300745241687133, -0.3128986097989348, -0.31278204511836516, -0.31265777273462725, -0.31252580801710794, -0.31238616734194574, -0.3122388680886486, -0.3120839286364867, -0.3119213683606715, -0.311751207628318, -0.3115734677941936, -0.31138817119624884, -0.31119534115094066, -0.3109950019483414, -0.31078717884704177, -0.3105718980688411, -0.31034918679323464, -0.31011907315169424, -0.3098815862217479, -0.3096367560208534, -0.3093846135000793, -0.3091251905375806, -0.3088585199318841, -0.30858463539497716, -0.3083035715452058, -0.3080153638999822, -0.3077200488683041, -0.3074176637430931, -0.307108246693341, -0.30679183675608657, -0.30646847382820386, -0.30613819865802083, -0.30580105283676096, -0.3054570787898174, -0.3051063197678525, -0.3047488198377394, -0.30438462387333365, -0.30401377754608794, -0.30363632731550805, -0.3032523204194535, -0.3028618048642874, -0.30246482941487457, -0.30206144358443576, -0.3016516976242577, -0.30123564251326157, -0.3008133299474371, -0.3003848123291363, -0.2999501427562457, -0.2995093750112195 ], [ -0.30297934427841505, -0.3028783013775219, -0.30276995173916116, -0.302654308652863, -0.3025313863666226, -0.302401200083975, -0.3022637659608613, -0.30211910110228835, -0.3019672235587818, -0.301808152322631, -0.30164190732393314, -0.30146850942643094, -0.30128798042314925, -0.3011003430318283, -0.3009056208901629, -0.3007038385508364, -0.30049502147636364, -0.30027919603373415, -0.30005638948886526, -0.29982663000086063, -0.2995899466160788, -0.2993463692620164, -0.2990959287409965, -0.2988386567236822, -0.29857458574240103, -0.2983037491842859, -0.29802618128424435, -0.29774191711774645, -0.2974509925934369, -0.2971534444455744, -0.2968493102263065, -0.296538628297769, -0.2962214378240203, -0.29589777876281825, -0.2955676918572293, -0.29523121862708135, -0.2948884013602635, -0.2945392831038656, -0.2941839076551741, -0.29382231955251475, -0.2934545640659515, -0.2930806871878422, -0.29270073562325416, -0.2923147567802416, -0.29192279875999116, -0.2915249103468317, -0.2911211409981195, -0.29071154083399436, -0.29029616062701463, -0.28987505179167194 ], [ -0.29193734931788284, -0.29183685311257535, -0.2917295187088872, -0.29161535927515475, -0.2914943888785708, -0.29136662248229744, -0.29123207594238176, -0.29109076600447825, -0.2909427103003738, -0.2907879273443228, -0.29062643652918824, -0.290458258122394, -0.29028341326168344, -0.290101923950693, -0.28991381305433706, -0.2897191042940086, -0.28951782224259015, -0.2893099923192897, -0.28909564078428923, -0.288874794733212, -0.28864748209142155, -0.28841373160812933, -0.2881735728503402, -0.28792703619661886, -0.28767415283068276, -0.28741495473483397, -0.28714947468321556, -0.28687774623490536, -0.28659980372684696, -0.2863156822666197, -0.28602541772504786, -0.2857290467286537, -0.2854266066519563, -0.2851181356096156, -0.2848036724484311, -0.28448325673918634, -0.2841569287683532, -0.2838247295296498, -0.28348670071545995, -0.2831428847081132, -0.2827933245710323, -0.28243806403974053, -0.2820771475127491, -0.28171062004230907, -0.2813385273250396, -0.28096091569243875, -0.28057783210126763, -0.28018932412382497, -0.2797954399381019, -0.27939622831783095 ], [ -0.28015637867683396, -0.2800569147799132, -0.2799511137331324, -0.2798389885199409, -0.2797205529587693, -0.27959582170018993, -0.2794648102238991, -0.2793275348355163, -0.27918401266320103, -0.2790342616540926, -0.2788783005705688, -0.27871614898632874, -0.27854782728230026, -0.27837335664236906, -0.2781927590489361, -0.2780060572783004, -0.27781327489587426, -0.277614436251225, -0.2774095664729487, -0.2771986914633782, -0.2769818378931279, -0.27675903319546835, -0.27653030556054387, -0.276295683929431, -0.2760551979880325, -0.27580887816081984, -0.27555675560441867, -0.2752988622010407, -0.27503523055176565, -0.2747658939696728, -0.2744908864728264, -0.27421024277711714, -0.27392399828895514, -0.27363218909783055, -0.273334851968729, -0.27303202433441287, -0.27272374428756824, -0.27241005057282075, -0.27209098257862196, -0.2717665803290056, -0.2714368844752238, -0.27110193628725787, -0.2707617776452113, -0.2704164510305832, -0.27006599951742877, -0.26971046676340754, -0.26934989700072204, -0.26898433502694935, -0.268613826195766, -0.26823841640757784 ], [ -0.2678187745324276, -0.2677208262616922, -0.2676170666642311, -0.2675075084760779, -0.2673921652010849, -0.26727105110814764, -0.26714418122826883, -0.2670115713514441, -0.26687323802339125, -0.2667291985421084, -0.26657947095426965, -0.2664240740514572, -0.2662630273662303, -0.26609635116803376, -0.2659240664589463, -0.26574619496926993, -0.2655627591529636, -0.26537378218291724, -0.2651792879460735, -0.26497930103839823, -0.2647738467596936, -0.26456295110826605, -0.2643466407754438, -0.26412494313994667, -0.26389788626211175, -0.2636654988779733, -0.26342781039320406, -0.2631848508769136, -0.2629366510553088, -0.2626832423052189, -0.26242465664748515, -0.262160926740219, -0.2618920858719269, -0.2616181679545113, -0.26133920751614004, -0.26105523969399425, -0.26076630022689323, -0.2604724254477999, -0.26017365227620726, -0.2598700182104098, -0.25956156131966035, -0.25924832023621897, -0.25893033414728883, -0.258607642786848, -0.25828028642737805, -0.25794830587148804, -0.257611742443443, -0.2572706379805918, -0.2569250348247045, -0.2565749758132146 ], [ -0.2551106931223527, -0.25501473594907975, -0.25491351013532115, -0.2548070281090346, -0.2546953029965565, -0.25457834861990425, -0.25445617949393023, -0.25432881082331815, -0.25419625849943056, -0.25405853909700427, -0.2539156698706964, -0.2537676687514819, -0.25361455434290336, -0.25345634591717314, -0.2532930634111311, -0.2531247274220575, -0.2529513592033422, -0.25277298066001413, -0.25258961434412674, -0.2524012834500098, -0.25220801180937497, -0.2520098238862947, -0.2518067447720395, -0.25159880017978464, -0.2513860164391838, -0.2511684204908154, -0.2509460398804955, -0.25071890275346875, -0.25048703784847365, -0.2502504744916788, -0.2500092425905051, -0.249763372627326, -0.2495128956530454, -0.24925784328056427, -0.24899824767813533, -0.2487341415625966, -0.24846555819250576, -0.24819253136115638, -0.2479150953894978, -0.247633285118942, -0.2473471359040748, -0.24705668360526595, -0.24676196458117894, -0.2464630156811885, -0.2461598742377043, -0.24585257805840366, -0.24554116541837429, -0.24522567505217158, -0.24490614614579354, -0.24458261832857064 ], [ -0.24221742231035753, -0.2421239183649203, -0.242025697438926, -0.24192277159414188, -0.24181515352000205, -0.24170285653100448, -0.24158589456396173, -0.24146428217512422, -0.2413380345371567, -0.2412071674359872, -0.24107169726751526, -0.24093164103419035, -0.24078701634145372, -0.24063784139405148, -0.2404841349922155, -0.24032591652771385, -0.2401632059797752, -0.23999602391088165, -0.2398243914624409, -0.23964833035032995, -0.23946786286031418, -0.23928301184334888, -0.23909380071075687, -0.23890025342928617, -0.2387023945160529, -0.23850024903336242, -0.23829384258342434, -0.2380832013029437, -0.23786835185760963, -0.2376493214364671, -0.23742613774618615, -0.23719882900521916, -0.2369674239378572, -0.23673195176817924, -0.23649244221390575, -0.23624892548014542, -0.23600143225304915, -0.23574999369336752, -0.2354946414299119, -0.23523540755292593, -0.23497232460736572, -0.2347054255860917, -0.23443474392297464, -0.23416031348591743, -0.2338821685697945, -0.2336003438893116, -0.233314874571787, -0.23302579614985797, -0.2327331445541111, -0.23243695610564308 ], [ -0.22931890341060762, -0.22922829613193518, -0.22913352482941118, -0.22903460114368135, -0.22893153727205956, -0.22882434596602363, -0.22871304052858654, -0.22859763481154588, -0.22847814321261056, -0.22835458067240733, -0.22822696267136788, -0.22809530522649762, -0.22795962488802402, -0.22781993873592998, -0.22767626437637006, -0.22752861993797385, -0.22737702406803145, -0.22722149592856977, -0.22706205519231648, -0.22689872203855221, -0.22673151714885464, -0.22656046170273425, -0.22638557737316367, -0.22620688632200264, -0.2260244111953152, -0.22583817511858956, -0.22564820169185396, -0.22545451498469216, -0.22525713953116133, -0.22505610032461487, -0.22485142281242748, -0.2246431328906282, -0.22443125689844023, -0.22421582161273118, -0.22399685424237376, -0.22377438242252112, -0.22354843420879222, -0.22331903807137987, -0.2230862228890711, -0.22285001794319037, -0.2226104529114621, -0.2223675578617993, -0.22212136324601534, -0.221871899893462, -0.22161919900459798, -0.2213632921444879, -0.22110421123623336, -0.22084198855433707, -0.22057665671800836, -0.22030824868439897 ], [ -0.2165856060530782, -0.21649831506525263, -0.21640740701838357, -0.2163128930808378, -0.21621478490729695, -0.21611309463636286, -0.21600783488805697, -0.21589901876120943, -0.21578665983074274, -0.2156707721448508, -0.21555137022207, -0.21542846904824886, -0.21530208407341478, -0.2151722312085343, -0.21503892682217857, -0.21490218773708003, -0.21476203122659798, -0.21461847501108194, -0.21447153725413592, -0.21432123655878965, -0.2141675919635735, -0.21401062293849976, -0.21385034938095115, -0.21368679161147652, -0.21351997036949982, -0.21334990680893534, -0.21317662249371877, -0.2130001393932518, -0.21282047987775893, -0.21263766671356332, -0.2124517230582797, -0.21226267245592578, -0.2120705388319553, -0.21187534648821227, -0.2116771200978087, -0.21147588469992878, -0.21127166569455846, -0.21106448883714268, -0.21085438023317443, -0.2106413663327129, -0.21042547392483613, -0.21020673013202712, -0.20998516240449705, -0.20976079851444612, -0.20953366655026268, -0.20930379491066708, -0.20907121229879455, -0.20883594771622377, -0.20859803045695402, -0.20835749010132915 ], [ -0.204174884950319, -0.20409130124493446, -0.2040046347085388, -0.203914895990371, -0.2038220961571406, -0.20372624669075734, -0.20362735948596167, -0.20352544684786683, -0.20342052148940615, -0.20331259652869071, -0.20320168548627698, -0.2030878022823424, -0.20297096123377545, -0.20285117705117378, -0.20272846483576118, -0.20260284007621016, -0.20247431864538756, -0.20234291679701144, -0.20220865116222353, -0.20207153874608408, -0.20193159692398072, -0.20178884343795966, -0.20164329639297768, -0.20149497425307517, -0.20134389583747297, -0.20119008031659413, -0.20103354720800848, -0.20087431637230874, -0.20071240800890805, -0.2005478426517731, -0.2003806411650827, -0.20021082473882268, -0.20003841488430724, -0.1998634334296417, -0.19968590251511736, -0.19950584458854181, -0.1993232824005114, -0.19913823899962152, -0.19895073772761707, -0.1987608022144875, -0.19856845637350468, -0.19837372439620837, -0.198176630747334, -0.19797720015969406, -0.19777545762900728, -0.19757142840867908, -0.1973651380045347, -0.19715661216950886, -0.19694587689828907, -0.19673295842191774 ], [ -0.1922279225252742, -0.1921484040224708, -0.1920663181097746, -0.19198167487522627, -0.19189448475778947, -0.19180475854520385, -0.19171250737176376, -0.19161774271601423, -0.19152047639837133, -0.1914207205786656, -0.1913184877536086, -0.19121379075418315, -0.1911066427429609, -0.19099705721134302, -0.19088504797672973, -0.19077062917961768, -0.19065381528062342, -0.1905346210574395, -0.19041306160171584, -0.19028915231587923, -0.19016290890987875, -0.19003434739786623, -0.18990348409481284, -0.18977033561305745, -0.1896349188587932, -0.18949725102849024, -0.1893573496052563, -0.1892152323551381, -0.18907091732336156, -0.1889244228305137, -0.18877576746866637, -0.18862497009744789, -0.18847204984005206, -0.18831702607920053, -0.18815991845304814, -0.18800074685103763, -0.18783953140970577, -0.1876762925084371, -0.18751105076517333, -0.1873438270320737, -0.18717464239113168, -0.18700351814974592, -0.18683047583625, -0.1866555371954009, -0.18647872418382644, -0.18630005896543417, -0.1861195639067832, -0.1859372615724208, -0.18575317472018205, -0.18556732629645867 ], [ -0.18086733291907614, -0.18079220047357525, -0.18071499194007928, -0.18063571680854967, -0.1805543848562955, -0.18047100614596573, -0.18038559102347396, -0.18029815011586048, -0.18020869432908798, -0.18011723484577463, -0.18002378312286582, -0.17992835088924064, -0.17983095014326073, -0.17973159315025328, -0.17963029243994016, -0.17952706080380293, -0.1794219112923906, -0.17931485721257112, -0.1792059121247248, -0.17909508983988082, -0.17898240441680158, -0.1788678701590084, -0.17875150161175823, -0.17863331355896322, -0.17851332102006268, -0.1783915392468431, -0.1782679837202052, -0.17814267014688767, -0.1780156144561389, -0.177886832796343, -0.17775634153160114, -0.1776241572382649, -0.17749029670143068, -0.17735477691138574, -0.1772176150600166, -0.177078828537176, -0.17693843492700845, -0.17679645200423832, -0.17665289773042248, -0.17650779025016156, -0.17636114788728302, -0.17621298914098332, -0.17606333268194124, -0.17591219734839963, -0.1757596021422121, -0.17560556622486745, -0.175450108913477, -0.1752932496767433, -0.17513500813089833, -0.1749754040356148 ], [ -0.17019547248451833, -0.17012500639572087, -0.17005292700042324, -0.16997924315914553, -0.16990396395973484, -0.16982709871549861, -0.16974865696328473, -0.16966864846150992, -0.16958708318813642, -0.16950397133859868, -0.16941932332367954, -0.16933314976733665, -0.16924546150448122, -0.1691562695787056, -0.1690655852399685, -0.16897341994222737, -0.1688797853410282, -0.16878469329105006, -0.16868815584360236, -0.16859018524408165, -0.16849079392938077, -0.16838999452526032, -0.16828779984367404, -0.16818422288005697, -0.16807927681056983, -0.16797297498930847, -0.16786533094547113, -0.16775635838048836, -0.16764607116511976, -0.16753448333651094, -0.16742160909521525, -0.1673074628021865, -0.16719205897573158, -0.16707541228843564, -0.1669575375640534, -0.1668384497743713, -0.1667181640360389, -0.1665966956073729, -0.1664740598851311, -0.1663502724012642, -0.16622534881963513, -0.16609930493272063, -0.16597215665828402, -0.16584392003602572, -0.16571461122421483, -0.16558424649629777, -0.1654528422374853, -0.16532041494132294, -0.16518698120624525, -0.1650525577321083 ], [ -0.16029347108431619, -0.16022790816169113, -0.16016116262643382, -0.16009324268404457, -0.16002415671134707, -0.15995391325476555, -0.15988252102856532, -0.1598099889130497, -0.15973632595272097, -0.1596615413543987, -0.159585644485305, -0.1595086448711065, -0.15943055219392332, -0.15935137629029988, -0.15927112714913982, -0.1591898149096062, -0.1591074498589855, -0.15902404243052093, -0.1589396032012073, -0.15885414288955735, -0.15876767235333522, -0.15868020258725574, -0.15859174472065674, -0.1585023100151377, -0.15841190986217318, -0.1583205557806932, -0.15822825941463836, -0.158135032530488, -0.15804088701475882, -0.15794583487148212, -0.157849888219653, -0.15775305929065542, -0.15765536042566614, -0.1575568040730328, -0.15745740278563253, -0.15735716921820853, -0.15725611612468543, -0.15715425635546804, -0.15705160285471653, -0.1569481686576094, -0.15684396688758373, -0.15673901075356383, -0.1566333135471713, -0.15652688863992203, -0.1564197494804085, -0.1563119095914689, -0.15620338256734617, -0.15609418207083275, -0.15598432183040561, -0.15587381563735503 ], [ -0.15122096888858222, -0.15116050011526616, -0.1510992446952843, -0.15103721015950766, -0.15097440415849084, -0.15091083446089915, -0.15084650895190876, -0.15078143563157598, -0.15071562261317967, -0.15064907812153555, -0.1505818104912836, -0.15051382816514763, -0.1504451396921695, -0.15037575372591871, -0.15030567902267317, -0.15023492443958003, -0.15016349893278802, -0.1500914115555601, -0.15001867145635933, -0.14994528787691563, -0.14987127015026835, -0.14979662769878843, -0.14972137003218017, -0.14964550674546234, -0.14956904751692895, -0.14949200210609487, -0.14941438035161608, -0.14933619216920074, -0.14925744754949638, -0.14917815655596345, -0.1490983293227342, -0.14901797605245393, -0.14893710701410895, -0.1488557325408409, -0.14877386302774726, -0.1486915089296698, -0.14860868075897093, -0.14852538908329777, -0.1484416445233383, -0.1483574577505642, -0.14827283948496756, -0.1481878004927869, -0.14810235158422563, -0.14801650361116492, -0.14793026746486748, -0.1478436540736776, -0.1477566744007146, -0.14766933944156285, -0.1475816602219575, -0.14749364779546636 ], [ -0.14301651628886702, -0.14296128511766548, -0.14290562678943375, -0.1428495481468819, -0.14279305610536486, -0.14273615765145986, -0.1426788598415289, -0.14262116980025796, -0.14256309471918344, -0.1425046418551963, -0.14244581852903127, -0.1423866321237402, -0.14232709008314598, -0.14226719991028314, -0.1422069691658222, -0.142146405466479, -0.14208551648340928, -0.14202430994058907, -0.14196279361318354, -0.1419009753258993, -0.1418388629513263, -0.1417764644082688, -0.14171378766006099, -0.14165084071287543, -0.14158763161401833, -0.14152416845021581, -0.14146045934589058, -0.14139651246142892, -0.1413323359914399, -0.1412679381630061, -0.14120332723392692, -0.1411385114909549, -0.14107349924802526, -0.1410082988444804, -0.14094291864328806, -0.1408773670292553, -0.1408116524072382, -0.1407457832003458, -0.14067976784814418, -0.14061361480485557, -0.14054733253755536, -0.14048092952436764, -0.140414414252661, -0.1403477952172409, -0.14028108091854552, -0.140214279860839, -0.14014740055040742, -0.14008045149375564, -0.14001344119580744, -0.1399463781581064 ], [ -0.1356985711810963, -0.13564867248793444, -0.1355986687540155, -0.13554856612646843, -0.13549837078275523, -0.1354480889294009, -0.13539772680071482, -0.1353472906575035, -0.1352967867857729, -0.13524622149542376, -0.13519560111893714, -0.13514493201005334, -0.13509422054244208, -0.13504347310836678, -0.13499269611734166, -0.13494189599478312, -0.1348910791806539, -0.1348402521281038, -0.13478942130210197, -0.1347385931780694, -0.13468777424050216, -0.134636970981595, -0.1345861898998572, -0.13453543749872982, -0.13448472028519715, -0.13443404476839727, -0.13438341745823024, -0.13433284486396607, -0.1342823334928494, -0.1342318898487066, -0.13418152043055065, -0.13413123173118624, -0.13408103023581763, -0.13403092242065473, -0.1339809147515233, -0.13393101368247556, -0.13388122565440425, -0.13383155709365702, -0.1337820144106598, -0.13373260399853487, -0.13368333223173212, -0.13363420546465804, -0.1335852300303142, -0.1335364122389373, -0.1334877583766474, -0.1334392747041011, -0.13339096745515172, -0.1333428428355165, -0.1332949070214493, -0.13324716615842436 ], [ -0.12926700910665984, -0.12922248881698645, -0.1291781481215864, -0.12913399247065377, -0.1290900273071579, -0.129046258065725, -0.12900269017151933, -0.12895932903912272, -0.1289161800714133, -0.12887324865844335, -0.12883054017631768, -0.12878805998607168, -0.1287458134325491, -0.12870380584328234, -0.12866204252737234, -0.12862052877437025, -0.12857926985316048, -0.12853827101084808, -0.12849753747164533, -0.12845707443576299, -0.12841688707830334, -0.12837698054815982, -0.12833735996691548, -0.12829803042774907, -0.12825899699434468, -0.12822026469980663, -0.1281818385455768, -0.12814372350036113, -0.1281059244990589, -0.12806844644169946, -0.12803129419238496, -0.12799447257823882, -0.12795798638836364, -0.12792184037280285, -0.12788603924151365, -0.12785058766334473, -0.12781549026502426, -0.127780751630156, -0.12774637629822255, -0.12771236876360137, -0.12767873347458614, -0.12764547483241995, -0.12761259719033974, -0.12758010485262805, -0.1275480020736769, -0.12751629305706402, -0.12748498195463742, -0.12745407286561328, -0.12742356983568465, -0.12739347685614405 ], [ -0.12370504816246386, -0.12366590355615592, -0.1236271862992564, -0.12358890114961812, -0.12355105282500334, -0.12351364600211268, -0.12347668531562511, -0.12344017535723883, -0.12340412067472217, -0.12336852577096935, -0.12333339510306268, -0.1232987330813432, -0.12326454406848819, -0.12323083237859445, -0.1231976022762733, -0.12316485797575005, -0.1231326036399738, -0.12310084337973598, -0.12306958125279643, -0.1230388212630204, -0.1230085673595242, -0.12297882343583083, -0.12294959332903416, -0.12292088081897679, -0.12289268962743405, -0.12286502341731192, -0.12283788579185517, -0.1228112802938654, -0.12278521040493218, -0.12275967954467504, -0.12273469106999796, -0.12271024827435428, -0.12268635438702641, -0.12266301257241691, -0.12264022592935148, -0.12261799749039726, -0.12259633022119137, -0.12257522701978563, -0.12255469071600356, -0.12253472407081101, -0.12251532977570112, -0.12249651045209425, -0.12247826865075134, -0.12246060685120119, -0.12244352746118514, -0.12242703281611333, -0.12241112517853936, -0.1223958067376465, -0.12238107960875355, -0.12236694583283247 ], [ -0.11898148246105333, -0.11894766315100802, -0.1189144832830622, -0.11888194693307907, -0.11885005810851151, -0.11881882074757977, -0.11878823871846028, -0.118758315818489, -0.11872905577337456, -0.11870046223642555, -0.11867253878779127, -0.11864528893371273, -0.1186187161057915, -0.11859282366026713, -0.11856761487731238, -0.11854309296033999, -0.1185192610353244, -0.11849612215013844, -0.11847367927390251, -0.11845193529635167, -0.11843089302721455, -0.11841055519560939, -0.11839092444945554, -0.1183720033548969, -0.11835379439574767, -0.11833629997294709, -0.11831952240403443, -0.11830346392263841, -0.11828812667798339, -0.11827351273441244, -0.11825962407092605, -0.11824646258073818, -0.11823403007084976, -0.1182223282616382, -0.11821135878646344, -0.118201123191295, -0.11819162293435054, -0.11818285938575762, -0.11817483382722938, -0.11816754745175961, -0.11816100136333502, -0.11815519657666612, -0.11815013401693497, -0.11814581451956219, -0.11814223882999147, -0.11813940760349262, -0.11813732140498323, -0.11813598070886788, -0.11813538589889594, -0.11813553726803944 ], [ -0.1150531151957504, -0.1150245247646346, -0.11499675193769154, -0.1149698001246402, -0.1149436726428103, -0.11491837271645988, -0.11489390347611445, -0.11487026795792055, -0.11484746910301791, -0.11482550975692973, -0.11480439266897136, -0.11478412049167652, -0.11476469578024118, -0.11474612099198811, -0.11472839848584793, -0.11471153052186034, -0.11469551926069388, -0.11468036676318483, -0.11466607498989517, -0.11465264580069046, -0.11464008095433731, -0.11462838210811932, -0.11461755081747443, -0.114607588535651, -0.11459849661338412, -0.11459027629859275, -0.11458292873609599, -0.11457645496734925, -0.11457085593020355, -0.1145661324586818, -0.11456228528277673, -0.11455931502827138, -0.11455722221657699, -0.11455600726459458, -0.11455567048459397, -0.11455621208411781, -0.11455763216590226, -0.11455993072782134, -0.11456310766285055, -0.11456716275905265, -0.11457209569958338, -0.114577906062719, -0.1145845933219028, -0.11459215684581597, -0.11460059589846627, -0.11460990963929818, -0.11462009712332566, -0.11463115730128398, -0.11464308901980352, -0.11465589102160301 ], [ -0.11186728471610846, -0.11184378298474318, -0.11182124522936543, -0.111799674214564, -0.11177907259263553, -0.11175944290303996, -0.1117407875718805, -0.11172310891140275, -0.11170640911951768, -0.11169069027934725, -0.11167595435879007, -0.11166220321011111, -0.11164943856955423, -0.11163766205697667, -0.11162687517550629, -0.11161707931122228, -0.11160827573285775, -0.11160046559152731, -0.11159364992047599, -0.11158782963485137, -0.11158300553150136, -0.11157917828879166, -0.11157634846645031, -0.11157451650543349, -0.11157368272781432, -0.11157384733669845, -0.11157501041615875, -0.11157717193119765, -0.11158033172773052, -0.11158448953259364, -0.11158964495357587, -0.11159579747947351, -0.11160294648016966, -0.11161109120673579, -0.11162023079155847, -0.11163036424848854, -0.11164149047301442, -0.11165360824245801, -0.1116667162161959, -0.11168081293590187, -0.11169589682581382, -0.11171196619302382, -0.11172901922779138, -0.11174705400387974, -0.11176606847891479, -0.1117860604947683, -0.11180702777796186, -0.11182896794009534, -0.11185187847829686, -0.11187575677569633 ], [ -0.10936438387943265, -0.10934578976916237, -0.10932827665959416, -0.10931184669597788, -0.10929650189514495, -0.10928224414509558, -0.10926907520461154, -0.1092569967028954, -0.10924601013923418, -0.10923611688268958, -0.10922731817181403, -0.10921961511439116, -0.10921300868720452, -0.10920749973583077, -0.10920308897445963, -0.10919977698573924, -0.10919756422064852, -0.10919645099839609, -0.10919643750634334, -0.10919752379995684, -0.10919970980278432, -0.10920299530645922, -0.10920737997072949, -0.10921286332351432, -0.10921944476098666, -0.109227123547681, -0.10923589881662954, -0.10924576956952303, -0.10925673467689745, -0.10926879287834829, -0.10928194278276998, -0.10929618286862153, -0.1093115114842173, -0.10932792684804571, -0.10934542704911182, -0.10936401004730606, -0.10938367367379859, -0.10940441563146036, -0.10942623349530645, -0.10944912471296891, -0.10947308660519106, -0.10949811636634821, -0.10952421106499433, -0.10955136764443091, -0.10957958292330289, -0.1096088535962167, -0.1096391762343849, -0.10967054728629322, -0.10970296307839128, -0.10973641981580767 ], [ -0.1074802835622869, -0.10746637850262658, -0.107453644765372, -0.10744208390655863, -0.10743169734112601, -0.10742248634262891, -0.10741445204297756, -0.10740759543220574, -0.10740191735826737, -0.10739741852686269, -0.10739409950129081, -0.10739196070233376, -0.10739100240816624, -0.10739122475429602, -0.10739262773353231, -0.10739521119598355, -0.1073989748490824, -0.10740391825764045, -0.10741004084393213, -0.10741734188780594, -0.10742582052682587, -0.10743547575643919, -0.1074463064301755, -0.10745831125987199, -0.1074714888159285, -0.10748583752759061, -0.10750135568325991, -0.10751804143083493, -0.1075358927780774, -0.10755490759300823, -0.10757508360433138, -0.10759641840188444, -0.10761890943711738, -0.10764255402359935, -0.10766734933755218, -0.10769329241841147, -0.10772038016941393, -0.10774860935821384, -0.10777797661752248, -0.1078084784457784, -0.10784011120784065, -0.10787287113571031, -0.10790675432927654, -0.10794175675708961, -0.10797787425715877, -0.10801510253777574, -0.10805343717836302, -0.10809287363034714, -0.10813340721805759, -0.10817503313964777 ], [ -0.10614858471304944, -0.10613911653517377, -0.1061308860486202, -0.10612389425417351, -0.1061181420019508, -0.1061136299912297, -0.10611035877030683, -0.10610832873638737, -0.10610754013550389, -0.10610799306246727, -0.10610968746084787, -0.10611262312298736, -0.10611679969004056, -0.10612221665204924, -0.10612887334804555, -0.10613676896618557, -0.10614590254391576, -0.10615627296816732, -0.10616787897558183, -0.10618071915276839, -0.10619479193658965, -0.10621009561447886, -0.10622662832478702, -0.10624438805715941, -0.10626337265294344, -0.10628357980562464, -0.1063050070612942, -0.10632765181914433, -0.10635151133199405, -0.10637658270684452, -0.10640286290546247, -0.10643034874499402, -0.10645903689860542, -0.1064889238961545, -0.10652000612488882, -0.10655227983017324, -0.10658574111624447, -0.10662038594699502, -0.1066562101467825, -0.10669320940126847, -0.10673137925828285, -0.10677071512871628, -0.10681121228743867, -0.10685286587424353, -0.10689567089481994, -0.10693962222174896, -0.10698471459552589, -0.10703094262560853, -0.10707830079148989, -0.10712678344379511 ], [ -0.10530263875939866, -0.10529732600595415, -0.10529329613114013, -0.10529054961775597, -0.10528908679112214, -0.10528890781901673, -0.10529001271164351, -0.10529240132163242, -0.10529607334407182, -0.1053010283165744, -0.10530726561937298, -0.105314784475451, -0.10532358395070296, -0.105333662954128, -0.10534502023805542, -0.10535765439840228, -0.10537156387496244, -0.10538674695172756, -0.10540320175723933, -0.10542092626497529, -0.10543991829376304, -0.10546017550822823, -0.10548169541927288, -0.10550447538458468, -0.105528512609178, -0.10555380414596438, -0.10558034689635537, -0.10560813761089394, -0.10563717288991786, -0.10566744918425242, -0.10569896279593272, -0.10573170987895603, -0.10576568644006423, -0.10580088833955414, -0.1058373112921181, -0.1058749508677127, -0.10591380249245635, -0.10595386144955471, -0.10599512288025498, -0.10603758178482664, -0.10608123302357131, -0.106126071317858, -0.1061720912511872, -0.10621928727027935, -0.10626765368619201, -0.10631718467546103, -0.10636787428126826, -0.10641971641463488, -0.1064727048556387, -0.10652683325465745 ], [ -0.10487729260453255, -0.10487582917717259, -0.10487567535257042, -0.10487683113553803, -0.10487929636901783, -0.10488307073411623, -0.10488815375017424, -0.10489454477486737, -0.10490224300434275, -0.10491124747338687, -0.10492155705562711, -0.10493317046376732, -0.10494608624985474, -0.10496030280558216, -0.10497581836262021, -0.10499263099298495, -0.105010738609437, -0.10503013896591318, -0.1050508296579904, -0.10507280812338327, -0.10509607164247148, -0.10512061733886213, -0.10514644217998081, -0.1051735429776971, -0.10520191638897947, -0.10523155891658309, -0.10526246690976787, -0.10529463656504706, -0.10532806392696809, -0.10536274488892206, -0.10539867519398455, -0.10543585043578618, -0.10547426605941307, -0.10551391736233628, -0.10555479949537094, -0.10559690746366446, -0.10564023612771295, -0.10568478020440608, -0.10573053426810058, -0.10577749275172077, -0.10582564994788696, -0.10587500001007133, -0.10592553695377949, -0.10597725465775976, -0.10603014686523865, -0.10608420718517986, -0.10613942909357271, -0.10619580593474126, -0.10625333092268202, -0.10631199714242295 ], [ -0.10481033095278203, -0.10481239101110523, -0.10481577153773375, -0.10482047210163131, -0.10482649210759126, -0.10483383079636105, -0.10484248724480383, -0.1048524603660902, -0.10486374890992622, -0.10487635146281526, -0.10489026644835214, -0.10490549212755251, -0.1049220265992144, -0.10493986780031445, -0.10495901350643672, -0.10497946133223451, -0.10500120873192637, -0.1050242529998236, -0.10504859127089206, -0.1050742205213448, -0.1051011375692687, -0.1051293390752831, -0.10515882154322936, -0.10518958132089373, -0.10522161460076129, -0.10525491742080073, -0.10528948566528179, -0.1053253150656221, -0.10536240120126589, -0.10540073950059259, -0.1054403252418562, -0.10548115355415355, -0.10552321941842385, -0.10556651766847625, -0.10561104299204666, -0.10565678993188438, -0.10570375288686595, -0.10575192611313794, -0.10580130372528762, -0.10585187969754034, -0.1059036478649849, -0.10595660192482537, -0.10601073543765954, -0.1060660418287831, -0.1061225143895202, -0.10618014627857864, -0.10623893052343042, -0.10629886002171662, -0.10635992754267726, -0.10642212572860327 ], [ -0.1050436044921802, -0.10504884751177435, -0.10505540844947475, -0.10506328648206564, -0.10507248062164487, -0.1050829897158288, -0.10509481244799429, -0.10510794733755296, -0.1051223927402603, -0.10513814684855938, -0.10515520769195696, -0.1051735731374347, -0.10519324088989346, -0.10521420849263186, -0.10523647332785668, -0.10526003261722872, -0.10528488342243975, -0.10531102264582365, -0.10533844703099976, -0.10536715316354905, -0.10539713747172269, -0.10542839622718236, -0.10546092554577308, -0.10549472138832733, -0.10552977956150134, -0.10556609571864145, -0.10560366536068272, -0.10564248383707786, -0.10568254634675567, -0.1057238479391116, -0.10576638351502671, -0.10581014782791653, -0.10585513548480974, -0.10590134094745529, -0.10594875853345886, -0.10599738241744666, -0.10604720663225842, -0.10609822507016747, -0.10615043148412795, -0.1062038194890495, -0.10625838256309827, -0.1063141140490243, -0.1063710071555149, -0.10642905495857286, -0.10648825040292087, -0.10654858630342923, -0.10661005534656959, -0.10667265009189086, -0.10673636297351935, -0.10680118630168256 ], [ -0.1055238468494491, -0.10553192274284157, -0.10554130283452529, -0.10555198595369569, -0.1055639707658435, -0.10557725577303306, -0.10559183931421395, -0.10560771956556753, -0.1056248945408867, -0.10564336209199049, -0.10566311990917138, -0.10568416552167692, -0.10570649629822487, -0.10573010944755096, -0.1057550020189913, -0.10578117090309591, -0.10580861283227666, -0.10583732438148696, -0.10586730196893435, -0.10589854185682523, -0.1059310401521415, -0.10596479280744886, -0.10599979562173739, -0.10603604424129237, -0.10607353416059717, -0.10611226072326652, -0.10615221912300982, -0.10619340440462588, -0.10623581146502664, -0.10627943505429083, -0.10632426977674692, -0.10637031009208586, -0.10641755031650119, -0.10646598462385887, -0.10651560704689428, -0.10656641147843754, -0.1066183916726659, -0.106671541246383, -0.106725853680325, -0.10678132232049353, -0.10683794037951289, -0.10689570093801498, -0.10695459694604731, -0.10701462122450689, -0.10707576646659822, -0.10713802523931498, -0.1072013899849451, -0.1072658530225995, -0.1073314065497622, -0.10739804264386393 ], [ -0.10620319569346925, -0.10621374989622756, -0.10622558543472349, -0.10623870083546866, -0.10625309446349462, -0.1062687645226928, -0.1062857090561879, -0.10630392594674543, -0.10632341291721203, -0.1063441675309908, -0.1063661871925482, -0.10638946914795566, -0.1064140104854634, -0.10643980813610732, -0.10646685887434831, -0.10649515931874515, -0.10652470593265845, -0.10655549502498723, -0.10658752275093752, -0.10662078511282275, -0.10665527796089475, -0.10669099699420725, -0.10672793776150946, -0.10676609566216999, -0.1068054659471327, -0.10684604371990081, -0.10688782393755247, -0.10693080141178468, -0.10697497080998758, -0.10702032665634659, -0.107066863332974, -0.1071145750810687, -0.10716345600210347, -0.10721350005904012, -0.10726470107757269, -0.10731705274739572, -0.10737054862350143, -0.1074251821275009, -0.10748094654897244, -0.107537835046835, -0.10759584065074634, -0.10765495626252652, -0.107715174657604, -0.10777648848648808, -0.10783889027626226, -0.10790237243210227, -0.10796692723881546, -0.10803254686240288, -0.10809922335164324, -0.10816694863969756 ], [ -0.10703944353055705, -0.10705212195579034, -0.10706605150784615, -0.1070812304551873, -0.10709765690803325, -0.10711532881875285, -0.10713424398228955, -0.10715440003662025, -0.10717579446324632, -0.10719842458771855, -0.10722228758019403, -0.10724738045602633, -0.10727370007638737, -0.10730124314892187, -0.10733000622843358, -0.10735998571760358, -0.1073911778677406, -0.10742357877956132, -0.10745718440400359, -0.10749199054306918, -0.10752799285069797, -0.10756518683367255, -0.10760356785255254, -0.1076431311226389, -0.10768387171496879, -0.10772578455733778, -0.10776886443535333, -0.10781310599351557, -0.10785850373632655, -0.10790505202942818, -0.10795274510076786, -0.10800157704179031, -0.10805154180865867, -0.10810263322350028, -0.10815484497567995, -0.1082081706230984, -0.10826260359351769, -0.10831813718591005, -0.10837476457183332, -0.10843247879682938, -0.10849127278184767, -0.10855113932469179, -0.10861207110148963, -0.10867406066818613, -0.10873710046205842, -0.10880118280325285, -0.10886629989634411, -0.10893244383191442, -0.10899960658815416, -0.10906778003248274 ], [ -0.10799605140556306, -0.10801050517372895, -0.10802617407799625, -0.1080430561725838, -0.1080611493575162, -0.10808045137905947, -0.10810095983018847, -0.1081226721510874, -0.10814558562968246, -0.10816969740220617, -0.10819500445379387, -0.10822150361911254, -0.10824919158301982, -0.10827806488125596, -0.10830811990116562, -0.10833935288245167, -0.10837175991795905, -0.10840533695448956, -0.10844007979364628, -0.10847598409270914, -0.10851304536553918, -0.10855125898351253, -0.10859062017648463, -0.1086311240337815, -0.10867276550522198, -0.1087155394021661, -0.1087594403985932, -0.10880446303220692, -0.1088506017055681, -0.10889785068725394, -0.10894620411304551, -0.10899565598713956, -0.10904620018338862, -0.10909783044656485, -0.1091505403936508, -0.10920432351515375, -0.10925917317644629, -0.10931508261912903, -0.10937204496241948, -0.10943005320456212, -0.109489100224263, -0.10954917878214654, -0.10961028152223373, -0.109672400973444, -0.10973552955111582, -0.10979965955855042, -0.10986478318857501, -0.10993089252512595, -0.10999797954485169, -0.11006603611873489 ], [ -0.10904196384758857, -0.10905785370481125, -0.109074918265333, -0.10909315541158437, -0.10911256287648863, -0.10913313824393245, -0.1091548789492664, -0.10917778227983843, -0.1092018453755575, -0.10922706522948872, -0.10925343868848036, -0.10928096245381996, -0.10930963308192243, -0.1093394469850481, -0.1093704004320512, -0.10940248954915732, -0.10943571032077232, -0.10947005859031889, -0.10950553006110425, -0.10954212029721527, -0.10957982472444322, -0.10961863863123689, -0.10965855716968353, -0.10969957535651825, -0.10974168807416096, -0.10978489007177983, -0.10982917596638342, -0.10987454024393734, -0.10992097726050948, -0.1099684812434395, -0.11001704629253528, -0.11006666638129392, -0.11011733535814827, -0.11016904694773738, -0.11022179475220256, -0.11027557225250556, -0.11033037280977193, -0.11038618966665636, -0.11044301594873118, -0.11050084466589755, -0.1105596687138179, -0.11061948087537027, -0.11068027382212364, -0.11074204011583455, -0.11080477220996243, -0.1108684624512068, -0.11093310308106202, -0.1109986862373924, -0.11106520395602454, -0.11113264817235902 ] ], "zauto": true, "zmax": 0.3475864043502467, "zmin": -0.3475864043502467 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.39513653890501693, 0.3949930512303807, 0.39485646879456915, 0.39472683094729377, 0.39460417518721147, 0.39448853714022025, 0.39437995053873837, 0.39427844720198735, 0.39418405701730147, 0.3940968079224831, 0.39401672588922304, 0.39394383490760526, 0.3938781569717104, 0.3938197120663368, 0.3937685181548526, 0.3937245911681916, 0.39368794499500676, 0.39365859147299115, 0.3936365403813771, 0.3936217994346215, 0.39361437427728463, 0.393614268480109, 0.3936214835373016, 0.39363601886502414, 0.3936578718010925, 0.39368703760588597, 0.39372350946446577, 0.3937672784899013, 0.39381833372779895, 0.3938766621620308, 0.39394224872165595, 0.3940150762890269, 0.39409512570907307, 0.39418237579975157, 0.3942768033636528, 0.39437838320074975, 0.3944870881222762, 0.39460288896572054, 0.3947257546109174, 0.3948556519972211, 0.39499254614174245, 0.39513640015862944, 0.39528717527937174, 0.3954448308741079, 0.39560932447391206, 0.395780611794039, 0.395958646758101, 0.3961433815231536, 0.396334766505665, 0.3965327504083405 ], [ 0.3866611745066825, 0.38650284521558004, 0.3863521582559532, 0.3862091579476039, 0.3860738865261549, 0.3859463841175673, 0.3858266887138078, 0.3857148361496889, 0.3856108600809117, 0.3855147919633336, 0.3854266610334893, 0.38534649429038176, 0.3852743164785709, 0.3852101500725752, 0.38515401526260673, 0.38510592994165604, 0.385065909693943, 0.3850339677847464, 0.385010115151626, 0.38499436039704565, 0.38498670978240823, 0.3849871672235098, 0.38499573428741707, 0.385012410190774, 0.3850371917995384, 0.3850700736301501, 0.38511104785212896, 0.3851601042920996, 0.38521723043924044, 0.38528241145214764, 0.38535563016710855, 0.3854368671077741, 0.3855261004962193, 0.3856233062653791, 0.38572845807284406, 0.38584152731600363, 0.38596248314851367, 0.38609129249807583, 0.38622792008550305, 0.38637232844505276, 0.3865244779460034, 0.3866843268154512, 0.3868518311622975, 0.38702694500240736, 0.38720962028490213, 0.3873998069195653, 0.3875974528053263, 0.38780250385979226, 0.3880149040497968, 0.3882345954229337 ], [ 0.37776264000599213, 0.3775884591938315, 0.37742271079231665, 0.3772654446840949, 0.3771167084069279, 0.3769765471236834, 0.3768450035936679, 0.3767221181453383, 0.3766079286504245, 0.3765024704994945, 0.3764057765789935, 0.3763178772497857, 0.3762388003272239, 0.37616857106277457, 0.37610721212721876, 0.3760547435954539, 0.3760111829329133, 0.37597654498361943, 0.3759508419598922, 0.3759340834337182, 0.37592627632979914, 0.37592742492028197, 0.37593753082118386, 0.375956592990513, 0.37598460772808834, 0.3760215686770607, 0.3760674668271316, 0.3761222905194666, 0.37618602545329743, 0.3762586546942047, 0.3763401586840704, 0.37643051525268806, 0.37652969963101685, 0.37663768446606194, 0.3767544398373629, 0.37687993327507063, 0.3770141297795887, 0.3771569918427568, 0.3773084794705493, 0.37746855020725945, 0.37763715916114415, 0.3778142590314927, 0.3779998001370916, 0.37819373044604837, 0.3783959956069394, 0.37860653898124624, 0.37882530167704104, 0.3790522225838806, 0.37928723840887285, 0.379530283713869 ], [ 0.36850696177418, 0.3683159664981783, 0.36813424498965963, 0.3679618533416834, 0.3677988450115994, 0.36764527078560205, 0.3675011787448626, 0.3673666142332809, 0.3672416198269005, 0.3671262353050254, 0.36702049762308114, 0.3669244408872512, 0.3668380963309277, 0.3667614922930059, 0.3666946541980521, 0.3666376045383726, 0.3665903628580094, 0.36655294573868213, 0.3665253667876992, 0.36650763662785085, 0.36649976288930225, 0.36650175020349635, 0.36651360019907464, 0.36653531149982227, 0.3665668797246405, 0.36660829748954843, 0.36665955441170706, 0.3667206371154661, 0.3667915292404216, 0.36687221145147386, 0.36696266145087375, 0.36706285399224015, 0.36717276089652845, 0.36729235106993147, 0.36742159052368445, 0.3675604423957536, 0.36770886697437155, 0.3678668217233958, 0.3680342613094501, 0.36821113763081836, 0.36839739984804926, 0.3685929944162339, 0.3687978651189119, 0.3690119531035668, 0.3692351969186595, 0.3694675325521583, 0.369708893471513, 0.3699592106650248, 0.37021841268455996, 0.37048642568955775 ], [ 0.35898748683236203, 0.35877881686865365, 0.358580309042768, 0.35839202634659323, 0.3582140288134447, 0.3580463734761092, 0.35788911432674303, 0.35774230227868087, 0.3576059851302063, 0.3574802075303377, 0.3573650109466789, 0.3572604336353793, 0.3571665106132502, 0.35708327363207476, 0.35701075115515035, 0.3569489683360993, 0.3568979469999794, 0.356857705626719, 0.35682825933690665, 0.3568096198799518, 0.35680179562463776, 0.3568047915520796, 0.35681860925109854, 0.35684324691601915, 0.3568786993468932, 0.35692495795215123, 0.3569820107536755, 0.3570498423942891, 0.35712843414765033, 0.35721776393053556, 0.35731780631749516, 0.35742853255785945, 0.3575499105950701, 0.3576819050883073, 0.3578244774363844, 0.35797758580387246, 0.35814118514941606, 0.3583152272562037, 0.3584996607645446, 0.3586944312065067, 0.35889948104256914, 0.3591147497002343, 0.359340173614547, 0.35957568627046355, 0.35982121824701435, 0.36007669726319746, 0.36034204822554217, 0.3606171932772783, 0.36090205184904617, 0.3611965407110813 ], [ 0.3493284058038213, 0.3491013775212752, 0.3488854390907874, 0.34868066110457013, 0.348487110840669, 0.348304852213258, 0.3481339457251141, 0.34797444842234265, 0.34782641385142415, 0.34768989201864653, 0.34756492935198763, 0.3474515686655067, 0.3473498491263006, 0.3472598062240769, 0.3471814717433927, 0.3471148737386034, 0.3470600365115606, 0.3470169805920965, 0.34698572272132566, 0.34696627583779055, 0.34695864906647483, 0.3469628477107012, 0.34697887324692706, 0.34700672332244814, 0.3470463917560113, 0.3470978685413383, 0.3471611398535529, 0.34723618805850326, 0.34732299172496084, 0.3474215256396811, 0.3475317608252981, 0.34765366456102553, 0.3477872004061319, 0.3479323282261502, 0.34808900422178374, 0.3482571809604596, 0.3484368074104812, 0.3486278289777274, 0.34883018754483874, 0.3490438215128336, 0.34926866584508715, 0.349504652113608, 0.34975170854754334, 0.3500097600838373, 0.3502787284199692, 0.3505585320686951, 0.35084908641471024, 0.3511503037731529, 0.3514620934498658, 0.3517843618033288 ], [ 0.33968720715587736, 0.33944140724074856, 0.3392076522190712, 0.33898602095055624, 0.33877658859379933, 0.33857942654745465, 0.33839460239396535, 0.33822217984595004, 0.3380622186953256, 0.3379147747652564, 0.33777989986500806, 0.337657641747782, 0.33754804407160344, 0.33745114636332785, 0.33736698398582976, 0.33729558810842963, 0.3372369856806084, 0.3371911994090596, 0.33715824773811465, 0.33713814483357846, 0.3371309005700028, 0.33713652052141996, 0.33715500595555364, 0.3371863538315157, 0.3372305568009945, 0.3372876032129326, 0.33735747712168396, 0.3374401582986383, 0.33753562224729156, 0.33764384022173455, 0.33776477924853043, 0.33789840215193934, 0.3380446675824489, 0.3382035300485611, 0.3383749399517781, 0.3385588436247306, 0.3387551833723818, 0.338963897516236, 0.3391849204414805, 0.3394181826469794, 0.33966361079803764, 0.3399211277818477, 0.34019065276553, 0.3404721012566714, 0.34076538516626714, 0.3410704128739638, 0.3413870892955051, 0.3417153159522727, 0.3420549910428179, 0.34240600951627503 ], [ 0.3302553788533096, 0.32999077748440836, 0.3297391860740557, 0.32950069230925993, 0.3292753797621152, 0.3290633278204373, 0.3288646116213926, 0.3286793019882387, 0.3285074653702898, 0.3283491637862118, 0.3282044547707533, 0.32807339132500574, 0.32795602187028783, 0.32785239020573437, 0.3277625354696748, 0.32768649210486633, 0.3276242898276532, 0.3275759536011053, 0.3275415036121911, 0.32752095525302344, 0.3275143191062185, 0.32752160093439214, 0.32754280167381666, 0.3275779174322454, 0.3276269394909154, 0.32768985431071895, 0.3277666435425336, 0.32785728404169273, 0.3279617478865659, 0.32808000240121543, 0.3282120101820859, 0.328357729128675, 0.32851711247812804, 0.32869010884369326, 0.3288766622569622, 0.32907671221382045, 0.32929019372402146, 0.32951703736429316, 0.3297571693348823, 0.3300105115194315, 0.3302769815480852, 0.33055649286370925, 0.3308489547911117, 0.3311542726091411, 0.33147234762553995, 0.33180307725442715, 0.33214635509627743, 0.3325020710202674, 0.33287011124885146, 0.3332503584444338 ], [ 0.3212565013768342, 0.3209735803318341, 0.32070462098785985, 0.32044972020890033, 0.32020897031222634, 0.3199824589871886, 0.3197702692174955, 0.3195724792071155, 0.3193891623099464, 0.31922038696338867, 0.3190662166259504, 0.31892670971900605, 0.3188019195728262, 0.31869189437698325, 0.31859667713523415, 0.31851630562496935, 0.31845081236131223, 0.31840022456593925, 0.3183645641406863, 0.3183438476459945, 0.3183380862842393, 0.318347285887977, 0.31837144691313346, 0.31841056443714744, 0.31846462816207294, 0.31853362242263344, 0.3186175261992115, 0.31871631313574583, 0.31882995156249866, 0.31895840452364754, 0.3191016298096423, 0.31925957999426335, 0.3194322024763039, 0.31961943952579147, 0.31982122833465665, 0.3200375010717473, 0.32026818494207676, 0.3205132022501913, 0.3207724704675324, 0.32104590230366076, 0.32133340578120917, 0.32163488431441706, 0.32195023679110246, 0.3222793576579167, 0.3226221370087257, 0.3229784606759573, 0.32334821032475175, 0.3237312635497461, 0.3241274939743301, 0.32453677135219583 ], [ 0.31294075339415245, 0.31264063788822016, 0.3123553928343252, 0.312085124282659, 0.31182993330115516, 0.31158991588152496, 0.3113651628492887, 0.3111557597779888, 0.31096178690775456, 0.31078331906839357, 0.3106204256071645, 0.31047317032138466, 0.3103416113960176, 0.31022580134636996, 0.31012578696602494, 0.3100416092801201, 0.30997330350407554, 0.3099208990078599, 0.3098844192858717, 0.3098638819325039, 0.30985929862344497, 0.3098706751027554, 0.30989801117575094, 0.309941300707704, 0.3100005316283706, 0.31007568594232643, 0.310166739745093, 0.31027366324501526, 0.3103964207908421, 0.3105349709049479, 0.3106892663221228, 0.31085925403384307, 0.31104487533792874, 0.3112460658934758, 0.3114627557809463, 0.3116948695672879, 0.31194232637594116, 0.3122050399615888, 0.3124829187894889, 0.3127758661192283, 0.3130837800927225, 0.3134065538262856, 0.31374407550658234, 0.3140962284902747, 0.31446289140716654, 0.31484393826664625, 0.3152392385672284, 0.3156486574089846, 0.31607205560865925, 0.3165092898172622 ], [ 0.30557489609757754, 0.30525947013472265, 0.3049597449840114, 0.3046758354063692, 0.3044078507614208, 0.3041558949005437, 0.30392006606444555, 0.30370045678548907, 0.3034971537949724, 0.3033102379355718, 0.3031397840791417, 0.3029858610500498, 0.3028485315542298, 0.30272785211410436, 0.3026238730095312, 0.30253663822490856, 0.3024661854025614, 0.30241254580251653, 0.3023757442687594, 0.30235579920205513, 0.3023527225393922, 0.30236651974010076, 0.30239718977867425, 0.3024447251443145, 0.3025091118471969, 0.3025903294314412, 0.3026883509947581, 0.3028031432147206, 0.3029346663816004, 0.3030828744376889, 0.303247715023013, 0.30342912952733253, 0.3036270531483033, 0.30384141495566724, 0.304072137961323, 0.30431913919511533, 0.3045823297861733, 0.3048616150496119, 0.30515689457840645, 0.3054680623402351, 0.30579500677908, 0.3061376109213686, 0.3064957524864277, 0.30686930400101936, 0.3072581329177246, 0.3076621017369285, 0.3080810681321677, 0.3085148850785879, 0.3089634009842689, 0.30942645982415956 ], [ 0.2994271869403716, 0.2990991626062017, 0.29878755180048083, 0.29849247690678704, 0.2982140545304346, 0.2979523953793978, 0.29770760415026, 0.29747977941944614, 0.2972690135399872, 0.2970753925440553, 0.29689899605149855, 0.2967398971845865, 0.29659816248917853, 0.2964738518624913, 0.29636701848765246, 0.2962777087751893, 0.2962059623116019, 0.2961518118151424, 0.2961152830989132, 0.29609639504137025, 0.2960951595643084, 0.2961115816183793, 0.296145659176181, 0.29619738323293066, 0.29626673781472224, 0.29635369999434397, 0.2964582399146169, 0.2965803208191935, 0.29671989909074, 0.2968769242964058, 0.29705133924046445, 0.2972430800239995, 0.2974520761114845, 0.29767825040409523, 0.29792151931957617, 0.2981817928784691, 0.29845897479649675, 0.2987529625828839, 0.2990636476443871, 0.2993909153947877, 0.2997346453696047, 0.3000947113457629, 0.3004709814659514, 0.3008633183674025, 0.30127157931480647, 0.30169561633708697, 0.30213527636774423, 0.3025904013884816, 0.3030608285758264, 0.3035463904504504 ], [ 0.2947475630849818, 0.2944104691015335, 0.294090344020707, 0.2937873160821463, 0.29350150744098963, 0.29323303403886314, 0.2929820054803238, 0.2927485249150468, 0.29253268892603324, 0.29233458742411134, 0.2921543035489826, 0.29199191357706233, 0.2918474868363368, 0.2917210856284531, 0.2916127651582366, 0.29152257347081456, 0.2914505513965044, 0.2913967325036103, 0.2913611430592464, 0.291343801998287, 0.2913447209005261, 0.2913639039761018, 0.29140134805922285, 0.2914570426102148, 0.29153096972587456, 0.29162310415811094, 0.29173341334081515, 0.2918618574248944, 0.29200838932137324, 0.2921729547524529, 0.29235549231039165, 0.29255593352405856, 0.292774202932986, 0.29301021816873474, 0.29326389004336406, 0.29353512264478726, 0.2938238134387754, 0.2941298533773573, 0.2944531270133544, 0.294793512620776, 0.2951508823207879, 0.2955251022129601, 0.2959160325114931, 0.29632352768611275, 0.2967474366073155, 0.29718760269565236, 0.29764386407472093, 0.29811605372754896, 0.2986039996560402, 0.2991075250431605 ], [ 0.29174483865485423, 0.2914028990201108, 0.29107829093407217, 0.29077114609232485, 0.2904815898980539, 0.2902097413266779, 0.2899557127962388, 0.2897196100438624, 0.28950153200858747, 0.28930157072085516, 0.2891198111989338, 0.28895633135254034, 0.2888112018939023, 0.28868448625649096, 0.2885762405216323, 0.288486513353188, 0.2884153459404786, 0.2883627719495936, 0.2883288174832234, 0.28831350104911146, 0.28831683353721627, 0.28833881820563767, 0.28837945067534754, 0.2884387189337359, 0.28851660334696116, 0.2886130766810712, 0.2887281041318366, 0.288861643363213, 0.2890136445543331, 0.28918405045489665, 0.2893727964488157, 0.28957981062594157, 0.28980501386168933, 0.29004831990435004, 0.29030963546986244, 0.2905888603438058, 0.2908858874903511, 0.2912006031678989, 0.29153288705111563, 0.2918826123590687, 0.2922496459891517, 0.2926338486564805, 0.29303507503842596, 0.29345317392395953, 0.29388798836746094, 0.29433935584665055, 0.29480710842429536, 0.29529107291334394, 0.2957910710451382, 0.2963069196403565 ], [ 0.2905642467301706, 0.2902221409123094, 0.2898975107937943, 0.2895904886759278, 0.289301200479469, 0.28902976560753296, 0.28877629681438755, 0.2885409000804713, 0.2883236744939374, 0.28812471213902086, 0.2879440979915108, 0.2877819098215915, 0.28763821810430706, 0.28751308593787533, 0.28740656897006717, 0.2873187153328465, 0.28724956558543846, 0.28719915266598056, 0.2871675018518836, 0.2871546307290072, 0.2871605491697323, 0.28718525931999067, 0.2872287555952801, 0.2872910246856794, 0.28737204556984647, 0.28747178953795904, 0.2875902202235354, 0.28772729364404914, 0.2878829582502239, 0.28805715498387785, 0.28824981734416044, 0.2884608714620058, 0.2886902361826036, 0.2889378231556718, 0.28920353693329565, 0.2894872750750788, 0.289788928260341, 0.2901083804070732, 0.29044550879735703, 0.2908001842089389, 0.29117227105263316, 0.29156162751523196, 0.29196810570757464, 0.29239155181744186, 0.29283180626691435, 0.2932887038738503, 0.2937620740171195, 0.29425174080524164, 0.29475752324806503, 0.2952792354311364 ], [ 0.29126970984336586, 0.2909322389822526, 0.29061215784180183, 0.29030959633202913, 0.2900246780243909, 0.2897575200179543, 0.2895082328114263, 0.28927692018135337, 0.2890636790667874, 0.28886859946071136, 0.28869176430848587, 0.2885332494135849, 0.28839312335085343, 0.28827144738751453, 0.28816827541212825, 0.2880836538716893, 0.2880176217170267, 0.2879702103566494, 0.2879414436191602, 0.28793133772433693, 0.28793990126295615, 0.28796713518541217, 0.28801303279916324, 0.2880775797750059, 0.28816075416216447, 0.28826252641214833, 0.28838285941131536, 0.2885217085220524, 0.28867902163245973, 0.2888547392144085, 0.28904879438981496, 0.2892611130049561, 0.28949161371263143, 0.2897402080619588, 0.2900068005955679, 0.29029128895394596, 0.29059356398667113, 0.2909135098702525, 0.2912510042322865, 0.2916059182816261, 0.2919781169442472, 0.29236745900449046, 0.29277379725134484, 0.2931969786294394, 0.29363684439439625, 0.2940932302722024, 0.29456596662224843, 0.29505487860368873, 0.29555978634476787, 0.2960805051147723 ], [ 0.2938349419993911, 0.29350665815406296, 0.29319545273489506, 0.29290145047006594, 0.2926247699179652, 0.29236552334121374, 0.2921238165863227, 0.2918997489692797, 0.29169341316733494, 0.291504895117251, 0.2913342739202656, 0.29118162175400114, 0.29104700379154513, 0.2909304781279005, 0.29083209571399354, 0.29075190029840947, 0.2906899283770016, 0.2906462091505047, 0.29062076449026364, 0.29061360891216076, 0.29062474955881484, 0.29065418619009126, 0.2907019111819525, 0.2907679095336464, 0.2908521588832151, 0.29095462953127943, 0.29107528447304015, 0.2912140794384062, 0.29137096294014997, 0.29154587632995527, 0.29173875386222337, 0.2919495227654635, 0.2921781033210889, 0.292424408949419, 0.2926883463026675, 0.29296981536468814, 0.2932687095572294, 0.29358491585243934, 0.29391831489134784, 0.2942687811080445, 0.29463618285925885, 0.2950203825590426, 0.29542123681824445, 0.2958385965884653, 0.2962723073101721, 0.2967222090646508, 0.2971881367294707, 0.29766992013713744, 0.298167384236605, 0.29868034925732584 ], [ 0.29814558990241236, 0.29783046059971935, 0.2975318936801356, 0.29725000641375315, 0.29698491017998985, 0.29673671035292415, 0.2965055061918979, 0.29629139073763705, 0.2960944507141343, 0.29591476643651843, 0.29575241172513117, 0.2956074538260191, 0.2954799533380242, 0.29536996414665784, 0.2952775333649145, 0.29520270128117065, 0.2951455013142984, 0.2951059599761041, 0.2950840968411836, 0.29507992452427034, 0.2950934486651321, 0.2951246679210519, 0.29517357396691235, 0.2952401515028826, 0.2953243782696859, 0.29542622507140903, 0.29554565580579745, 0.2956826275019558, 0.2958370903653599, 0.2960089878300707, 0.2961982566180143, 0.2964048268051868, 0.29662862189461664, 0.2968695588959114, 0.2971275484111914, 0.2974024947272091, 0.2976942959134322, 0.29800284392586135, 0.29832802471634173, 0.2986697183471159, 0.2990277991103625, 0.2994021356524464, 0.29979259110261475, 0.3001990232058527, 0.3006212844596205, 0.3010592222541795, 0.3015126790162226, 0.30198149235551436, 0.3024654952142528, 0.3029645160188588 ], [ 0.30401176054167367, 0.3037129294989457, 0.3034299729043459, 0.3031629989940939, 0.3029121104773437, 0.30267740443483443, 0.3024589722223301, 0.3022568993790582, 0.3020712655413502, 0.30190214436167745, 0.30174960343326157, 0.3016137042204331, 0.30149450199489697, 0.3013920457780492, 0.3013063782894824, 0.3012375359017953, 0.301185548601814, 0.30115043995831653, 0.3011322270963352, 0.30113092067809505, 0.30114652489063926, 0.3011790374401615, 0.30122844955306716, 0.30129474598375183, 0.30137790502908385, 0.30147789854955365, 0.30159469199703753, 0.30172824444911067, 0.3018785086498291, 0.30204543105688, 0.3022289518949938, 0.3024290052154891, 0.30264551896181524, 0.3028784150409377, 0.3031276094004069, 0.3033930121109309, 0.30367452745427076, 0.3039720540162579, 0.3042854847847338, 0.3046147072521939, 0.30495960352291746, 0.3053200504243544, 0.3056959196225369, 0.30608707774127664, 0.3064933864849036, 0.3069147027643042, 0.307350878826007, 0.30780176238406837, 0.30826719675450714, 0.3087470209920378 ], [ 0.3111877423242673, 0.31090741539796013, 0.31064214315697714, 0.31039202396755183, 0.310157151087013, 0.3099376125763234, 0.30973349121687055, 0.3095448644316822, 0.3093718042112309, 0.30921437704398047, 0.30907264385182537, 0.30894665993055903, 0.30883647489549604, 0.3087421326323714, 0.30866367125361865, 0.3086011230601244, 0.308554514508542, 0.308523866184239, 0.30850919277993294, 0.3085105030800669, 0.30852779995095714, 0.3085610803367347, 0.30861033526108983, 0.3086755498348136, 0.30875670326912164, 0.3088537688947279, 0.30896671418662514, 0.30909550079452036, 0.30924008457885127, 0.3094004156523116, 0.30957643842678495, 0.30976809166559344, 0.3099753085409399, 0.3101980166964239, 0.3104361383144956, 0.3106895901887053, 0.3109582838005932, 0.3112421254010626, 0.31154101609606494, 0.3118548519364229, 0.3121835240116102, 0.31252691854729814, 0.3128849170064786, 0.3132573961939669, 0.31364422836408073, 0.3140452813312957, 0.3144604185836688, 0.3148894993988219, 0.31533237896227967, 0.3157889084879488 ], [ 0.3193945696587575, 0.3191340195840131, 0.3188876146471921, 0.31865544316634997, 0.31843758879442086, 0.3182341304450882, 0.318045142222363, 0.3178706933540067, 0.31771084812892464, 0.3175656658386587, 0.3174352007230873, 0.317319501920448, 0.3172186134217767, 0.3171325740298602, 0.31706141732278054, 0.3170051716221288, 0.31696385996595194, 0.31693750008648663, 0.31692610439272806, 0.31692967995786797, 0.3169482285116279, 0.3169817464375028, 0.3170302247749221, 0.31709364922632094, 0.3171720001691097, 0.31726525267251354, 0.3173733765192491, 0.3174963362319942, 0.31763409110459195, 0.31778659523793024, 0.3179537975804204, 0.31813564197299266, 0.31833206719851814, 0.31854300703555916, 0.3187683903163392, 0.31900814098881664, 0.3192621781827457, 0.319530416279588, 0.31981276498614836, 0.3201091294117872, 0.32041941014906966, 0.32074350335769547, 0.32108130085155956, 0.3214326901887818, 0.3217975547645444, 0.32217577390657465, 0.3225672229731024, 0.322971773453128, 0.3233892930688278, 0.32381964587992906 ], [ 0.32834149231536114, 0.32810115169152587, 0.3278739966706733, 0.3276601058524636, 0.32745955361646556, 0.3272724100600869, 0.3270987409396931, 0.3269386076150215, 0.3267920669969887, 0.3266591714989896, 0.3265399689917745, 0.3264345027619885, 0.3263428114744502, 0.32626492913824073, 0.3262008850766652, 0.32615070390114376, 0.326114405489082, 0.32609200496576246, 0.32608351269029107, 0.32608893424562585, 0.3261082704327055, 0.32614151726869156, 0.32618866598932467, 0.32624970305539247, 0.3263246101632945, 0.32641336425968637, 0.3265159375601727, 0.32663229757201545, 0.326762407120813, 0.3269062243811002, 0.32706370291081016, 0.32723479168953806, 0.32741943516052757, 0.32761757327631047, 0.32782914154790926, 0.3280540710975163, 0.3282922887145513, 0.32854371691499895, 0.3288082740039187, 0.32908587414101603, 0.32937642740916234, 0.3296798398857423, 0.32999601371670817, 0.3303248471932141, 0.33066623483070445, 0.3310200674503218, 0.33138623226250624, 0.3317646129526478, 0.3321550897686597, 0.3325575396103327 ], [ 0.3377437883053708, 0.337523392652239, 0.33731520792540337, 0.33711930367740495, 0.33693574566875234, 0.3367645958162972, 0.3366059121443263, 0.3364597487384571, 0.33632615570240715, 0.3362051791177148, 0.3360968610064773, 0.3360012392971717, 0.33591834779361457, 0.3358482161471166, 0.3357908698318787, 0.335746330123673, 0.33571461408184583, 0.33569573453467366, 0.3356897000680987, 0.33569651501786385, 0.3357161794650587, 0.3357486892350875, 0.3357940359000598, 0.3358522067845982, 0.33592318497505497, 0.3360069493321204, 0.33610347450680117, 0.33621273095974047, 0.33633468498384617, 0.33646929873018877, 0.336616530237123, 0.3367763334625826, 0.3369486583194962, 0.3371334507142577, 0.33733065258819306, 0.3375402019619484, 0.3377620329827262, 0.33799607597429376, 0.3382422574896776, 0.3385005003664603, 0.3387707237845899, 0.33905284332660734, 0.33934677104019906, 0.3396524155029738, 0.3399696818893651, 0.3402984720395552, 0.3406386845303171, 0.34099021474766666, 0.34135295496122153, 0.3417267944001532 ], [ 0.34733589026417155, 0.34713463793167215, 0.3469446353655813, 0.34676594393579574, 0.3465986216192076, 0.34644272295684597, 0.3462982990133267, 0.346165397338672, 0.3460440619325595, 0.34593433321105543, 0.3458362479758853, 0.3457498393862902, 0.34567513693351165, 0.3456121664179487, 0.34556094992902076, 0.34552150582777114, 0.34549384873223615, 0.3454779895056071, 0.3454739352472013, 0.3454816892862583, 0.34550125117857133, 0.3455326167059593, 0.3455757778785799, 0.34563072294008124, 0.3456974363755832, 0.34577589892247507, 0.3458660875840137, 0.3459679756456986, 0.34608153269440006, 0.34620672464020713, 0.34634351374096317, 0.3464918586294493, 0.3466517143431712, 0.3468230323567063, 0.3470057606165563, 0.3471998435784556, 0.3474052222470741, 0.3476218342180555, 0.3478496137223279, 0.3480884916726177, 0.3483383957120983, 0.348599250265103, 0.34887097658982386, 0.34915349283292335, 0.34944671408597816, 0.3497505524436755, 0.35006491706367887, 0.35038971422808224, 0.35072484740636467, 0.3510702173197634 ], [ 0.3568799438715307, 0.3566966500572308, 0.356523680705312, 0.35636108994610605, 0.3562089288800899, 0.35606724554222374, 0.35593608486824796, 0.3558154886629852, 0.3557054955706936, 0.35560614104751526, 0.35551745733605794, 0.35543947344214827, 0.35537221511379025, 0.35531570482235975, 0.3552699617460634, 0.35523500175568584, 0.3552108374026465, 0.35519747790938466, 0.355194929162086, 0.3552031937057626, 0.35522227074169305, 0.3552521561272279, 0.35529284237795894, 0.35534431867225175, 0.35540657085813204, 0.3554795814625187, 0.3555633297027875, 0.35565779150065036, 0.3557629394983283, 0.35587874307699563, 0.35600516837746743, 0.35614217832310185, 0.356289732644881, 0.3564477879086385, 0.3566162975443894, 0.3567952118777258, 0.356984478163229, 0.35718404061985426, 0.35739384046823613, 0.35761381596986375, 0.35784390246807113, 0.3580840324307867, 0.35833413549498333, 0.3585941385127688, 0.35886396559905615, 0.3591435381807488, 0.35943277504737836, 0.3597315924031271, 0.36003990392017027, 0.36035762079326983 ], [ 0.3661705359561347, 0.36600376849525734, 0.36584645260448645, 0.3656986361170146, 0.36556036416052784, 0.36543167912736085, 0.3653126206463178, 0.3652032255561964, 0.3651035278810507, 0.36501355880722686, 0.3649333466621998, 0.3648629168952429, 0.3648022920599545, 0.36475149179866595, 0.3647105328287531, 0.3646794289308691, 0.36465819093911517, 0.36464682673316373, 0.36464534123234293, 0.3646537363916935, 0.3646720112000016, 0.36470016167981073, 0.364738180889414, 0.3647860589268231, 0.36484378293570946, 0.364911337113309, 0.36498870272027933, 0.36507585809249915, 0.3651727786547888, 0.36527943693653797, 0.365395802589218, 0.36552184240575397, 0.3656575203417323, 0.3658027975384158, 0.3659576323475335, 0.36612198035781424, 0.36629579442322957, 0.3664790246929061, 0.3666716186426727, 0.366873521108197, 0.36708467431967273, 0.3673050179380111, 0.3675344890924913, 0.3677730224198233, 0.3680205501045729, 0.3682770019209005, 0.3685423052755631, 0.3688163852521246, 0.3690991646563249, 0.3693905640625518 ], [ 0.37503652304135165, 0.3748847153486192, 0.3747415503611544, 0.3746070705073433, 0.37448131579536037, 0.37436432378797585, 0.37425612957878945, 0.37415676576991824, 0.37406626245116886, 0.37398464718071894, 0.37391194496733143, 0.3738481782541256, 0.37379336690392323, 0.3737475281861918, 0.3737106767655976, 0.3736828246921868, 0.3736639813932048, 0.37365415366656535, 0.3736533456759783, 0.37366155894774195, 0.37367879236920437, 0.373705042188895, 0.373740302018329, 0.37378456283547906, 0.37383781298991287, 0.37390003820958867, 0.3739712216093013, 0.37405134370076665, 0.3741403824043341, 0.3742383130623103, 0.3743451084538793, 0.37446073881159864, 0.3745851718394531, 0.374718372732442, 0.3748603041976763, 0.3750109264769603, 0.3751701973708293, 0.3753380722640146, 0.37551450415230486, 0.37569944367077135, 0.37589283912332305, 0.37609463651355773, 0.3763047795768698, 0.37652320981378107, 0.3767498665244526, 0.3769846868443387, 0.37722760578094316, 0.3774785562516346, 0.3777374691224797, 0.3780042732480502 ], [ 0.3833408349045467, 0.38320237608117025, 0.3830718227076659, 0.3829492126225364, 0.3828345814917148, 0.3827279627870666, 0.38262938776612476, 0.38253888545307857, 0.38245648262103854, 0.38238220377559945, 0.38231607113971927, 0.38225810463993265, 0.3822083218939162, 0.3821667381994178, 0.3821333665245665, 0.38210821749957175, 0.3820912994098243, 0.38208261819040495, 0.38208217742201017, 0.3820899783282975, 0.3821060197746562, 0.3821302982684023, 0.3821628079604001, 0.3822035406481083, 0.3822524857800453, 0.3823096304616709, 0.38237495946267597, 0.38244845522567317, 0.38253009787627656, 0.38261986523456026, 0.38271773282788196, 0.38282367390505595, 0.38293765945186087, 0.38305965820786175, 0.3831896366845298, 0.3833275591846364, 0.38347338782290147, 0.3836270825478706, 0.38378860116499786, 0.38395789936090724, 0.3841349307288057, 0.3843196467950201, 0.38451199704662686, 0.3847119289601464, 0.3849193880312693, 0.38513431780558194, 0.38535665991025914, 0.3855863540866904, 0.3858233382240034, 0.38606754839345137 ], [ 0.3909789684891519, 0.39085227283879126, 0.3907328213751413, 0.39062064807200375, 0.390515784942899, 0.39041826202249486, 0.39032810734910933, 0.39024534694830487, 0.39017000481759456, 0.39010210291227454, 0.3900416611324004, 0.389988697310922, 0.3899432272029871, 0.38990526447643026, 0.3898748207034552, 0.3898519053535189, 0.38983652578742867, 0.3898286872526569, 0.38982839287987886, 0.3898356436807381, 0.38985043854684326, 0.38987277424999495, 0.3899026454436444, 0.38994004466558374, 0.38998496234186064, 0.3900373867919188, 0.3900973042349533, 0.3901646987974785, 0.39023955252209686, 0.3903218453774608, 0.39041155526941607, 0.39050865805331547, 0.3906131275474873, 0.39072493554784665, 0.39084405184363186, 0.39097044423424915, 0.3911040785472084, 0.39124491865713, 0.39139292650580193, 0.3915480621232678, 0.3917102836499203, 0.3918795473595804, 0.3920558076835355, 0.39223901723551186, 0.3924291268375572, 0.3926260855468052, 0.3928298406830948, 0.3930403378574167, 0.3932575210011593, 0.39348133239612326 ], [ 0.3978767124127994, 0.3977602713314327, 0.3976504910522914, 0.39754740231698416, 0.3974510340864823, 0.39736141352485843, 0.3972785659839735, 0.39720251498912745, 0.39713328222568817, 0.39707088752671277, 0.3970153488615751, 0.3969666823256104, 0.3969249021307888, 0.39689002059742734, 0.39686204814694953, 0.3968409932957002, 0.3968268626498223, 0.39681966090120135, 0.39681939082448137, 0.3968260532751573, 0.39683964718874376, 0.39686016958102294, 0.3968876155493706, 0.39692197827516007, 0.3969632490272398, 0.3970114171664833, 0.39706647015140495, 0.397128393544837, 0.3971971710216604, 0.3972727843775816, 0.3973552135389457, 0.3974444365735771, 0.39754042970263487, 0.39764316731347193, 0.3977526219734841, 0.39786876444493446, 0.3979915637007394, 0.39812098694119824, 0.39825699961165106, 0.39839956542104643, 0.3985486463613992, 0.39870420272812135, 0.3988661931412029, 0.39903457456722397, 0.39920930234217544, 0.3993903301950656, 0.3995776102722905, 0.39977109316274484, 0.39997072792364735, 0.4001764621070587 ], [ 0.40398748975968246, 0.4038799089025032, 0.40377848328921884, 0.40368324097164515, 0.40359420837075805, 0.40351141026225634, 0.403434869762974, 0.403364608318153, 0.4033006456895912, 0.40324299994467555, 0.40319168744631395, 0.4031467228437732, 0.403108119064435, 0.4030758873064762, 0.40305003703248216, 0.40303057596399966, 0.40301751007703407, 0.4030108435984969, 0.4030105790036061, 0.4030167170142425, 0.40302925659826494, 0.4030481949697828, 0.40307352759038834, 0.40310524817134613, 0.4031433486767374, 0.4031878193275578, 0.4032386486067621, 0.4032958232652537, 0.40335932832881055, 0.40342914710594224, 0.40350526119666985, 0.40358765050221973, 0.4036762932356223, 0.4037711659332048, 0.4038722434669668, 0.40397949905782665, 0.4040929042897258, 0.40421242912457667, 0.40433804191804085, 0.40446970943612065, 0.40460739687254954, 0.40475106786696413, 0.4049006845238398, 0.40505620743217374, 0.4052175956858946, 0.40538480690498097, 0.40555779725726954, 0.4057365214809305, 0.4059209329075917, 0.4061109834860896 ], [ 0.4092895861629648, 0.40918961041827007, 0.40909536061528906, 0.4090068625738465, 0.40892414060560456, 0.4088472175010682, 0.40877611451736134, 0.4087108513667852, 0.40865144620617005, 0.40859791562703, 0.4085502746465313, 0.4085085366992826, 0.40847271362995513, 0.4084428156867396, 0.40841885151564744, 0.40840082815566064, 0.4083887510347366, 0.40838262396666986, 0.4083824491488164, 0.4083882271606808, 0.4083999569633684, 0.4084176358999037, 0.4084412596964145, 0.4084708224641794, 0.4085063167025394, 0.40854773330266847, 0.4085950615522008, 0.40864828914071, 0.408707402166035, 0.4087723851414467, 0.4088432210036485, 0.4089198911216035, 0.4090023753061789, 0.40909065182059984, 0.4091846973917018, 0.40928448722197086, 0.40938999500236184, 0.40950119292588005, 0.40961805170191556, 0.4097405405713172, 0.40986862732218937, 0.41000227830640057, 0.4101414584567861, 0.4102861313050299, 0.41043625900020936, 0.41059180232798625, 0.4107527207304256, 0.41091897232642693, 0.41109051393274637, 0.41126730108559456 ], [ 0.4137834375637387, 0.41368996593717366, 0.41360186442378494, 0.4135191569915208, 0.4134418661983013, 0.41337001318016764, 0.41330361764014245, 0.41324269783781264, 0.41318727057964255, 0.41313735121002837, 0.41309295360310055, 0.41305409015528355, 0.4130207717786187, 0.4129930078948574, 0.4129708064303297, 0.4129541738115936, 0.4129431149618692, 0.4129376332982607, 0.41293773072976947, 0.41294340765610055, 0.41295466296726224, 0.4129714940439615, 0.41299389675879217, 0.4130218654782184, 0.4130553930653476, 0.4130944708834938, 0.41313908880052597, 0.4131892351939982, 0.41324489695705724, 0.41330605950512056, 0.413372706783321, 0.4134448212747087, 0.4135223840092045, 0.41360537457329594, 0.4136937711204668, 0.4137875503823506, 0.41388668768059833, 0.41399115693944916, 0.4141009306989925, 0.4142159801291102, 0.41433627504408505, 0.4144617839178637, 0.4145924738999599, 0.41472831083198314, 0.41486925926477913, 0.4150152824761665, 0.41516634248925416, 0.41532240009132315, 0.41548341485325724, 0.41564934514950486 ], [ 0.41748908002992696, 0.41740117217727374, 0.41731834829854103, 0.4172406308196509, 0.41716804083250336, 0.4171005980840385, 0.4170383209659665, 0.41698122650517394, 0.41692933035481594, 0.4168826467861016, 0.41684118868078057, 0.4168049675243377, 0.4167739933999028, 0.416748274982879, 0.41672781953629756, 0.4167126329069012, 0.4167027195219608, 0.4166980823868282, 0.4166987230832272, 0.41670464176828476, 0.4167158371743033, 0.4167323066092742, 0.4167540459581319, 0.4167810496847484, 0.41681331083466544, 0.41685082103856214, 0.41689357051645565, 0.41694154808262984, 0.4169947411512887, 0.4170531357429284, 0.4171167164914232, 0.4171854666518178, 0.41725936810882, 0.417338401385985, 0.4174225456555844, 0.4175117787491498, 0.4176060771686821, 0.4177054160985165, 0.4178097694178331, 0.4179191097138004, 0.41803340829534225, 0.4181526352075143, 0.4182767592464788, 0.4184057479750636, 0.4185395677388923, 0.4186781836830714, 0.41882155976942115, 0.4189696587942332, 0.41912244240654234, 0.41927987112689574 ], [ 0.4204438060635931, 0.4203606819388776, 0.4202824206899968, 0.4202090434478931, 0.42014057006564254, 0.4200770191082535, 0.420018407843102, 0.4199647522310122, 0.41991606691798944, 0.41987236522761456, 0.419833659154105, 0.41979995935604986, 0.4197712751508243, 0.4197476145096883, 0.41972898405357423, 0.41971538904956784, 0.41970683340808423, 0.41970331968074337, 0.419704849058946, 0.41971142137315115, 0.41972303509285663, 0.41973968732728245, 0.4197613738267559, 0.41978808898479825, 0.41981982584091, 0.4198565760840529, 0.4198983300568263, 0.419945076760332, 0.4199968038597258, 0.4200534976904491, 0.42011514326513516, 0.42018172428118516, 0.42025322312900537, 0.4203296209008994, 0.42041089740060805, 0.4204970311534866, 0.42058799941731223, 0.4206837781937114, 0.4207843422401972, 0.4208896650828061, 0.4209997190293235, 0.4211144751830859, 0.42123390345734885, 0.42135797259020713, 0.4214866501600556, 0.4216199026015765, 0.42175769522224055, 0.4218999922193075, 0.42204675669731173, 0.4221979506860194 ], [ 0.42270002379335747, 0.4226210576926369, 0.42254679298512793, 0.42247724969830636, 0.4224124466202741, 0.4223524012901606, 0.42229712998914254, 0.42224664773208676, 0.4222009682598266, 0.4221601040320771, 0.4221240662209946, 0.4220928647053885, 0.4220665080655893, 0.4220450035789765, 0.4220283572161727, 0.4220165736379052, 0.42200965619253933, 0.42200760691428496, 0.4220104265220782, 0.4220181144191394, 0.42203066869320743, 0.4220480861174507, 0.4220703621520536, 0.4220974909464772, 0.42212946534239243, 0.42216627687728236, 0.42220791578871186, 0.42225437101925917, 0.42230563022210593, 0.42236167976728106, 0.4224225047485521, 0.4224880889909584, 0.42255841505897984, 0.42263346426533277, 0.4227132166803871, 0.422797651142195, 0.4228867452671228, 0.42298047546107737, 0.4230788169313163, 0.4231817436988329, 0.4232892286113036, 0.4234012433565897, 0.42351775847677753, 0.42363874338274965, 0.42376416636927194, 0.42389399463058425, 0.4240281942764829, 0.4241667303488804, 0.4243095668388286, 0.4244566667039924 ], [ 0.424323275764409, 0.42424798591948737, 0.42417728945098754, 0.42411120542588693, 0.4240497516947681, 0.4239929448827269, 0.4239408003808869, 0.4238933323385294, 0.42385055365584234, 0.4238124759772984, 0.4237791096856649, 0.42375046389665316, 0.4237265464542107, 0.42370736392646097, 0.42369292160229416, 0.42368322348861215, 0.4236782723082302, 0.42367806949843695, 0.4236826152102144, 0.4236919083081181, 0.4237059463708183, 0.4237247256923016, 0.42374824128373045, 0.4237764868759617, 0.4238094549227197, 0.42384713660442164, 0.4238895218326525, 0.42393659925528493, 0.4239883562622398, 0.42404477899188237, 0.4241058523380484, 0.4241715599576939, 0.42424188427916226, 0.42431680651106135, 0.424396306651742, 0.4244803634993713, 0.4245689546625906, 0.4246620565717497, 0.42475964449070724, 0.42486169252918715, 0.424968173655681, 0.4250790597108852, 0.4251943214216608, 0.42531392841550586, 0.42543784923552597, 0.42556605135589326, 0.4256985011977778, 0.42583516414574146, 0.4259760045645782, 0.42612098581658847 ], [ 0.4253903431784924, 0.42531837796236116, 0.42525094473805247, 0.42518806171315043, 0.42512974588848274, 0.42507601304946707, 0.4250268777580625, 0.42498235334533185, 0.42494245190462143, 0.42490718428536556, 0.42487656008751956, 0.4248505876566279, 0.42482927407952986, 0.42481262518070834, 0.42480064551928404, 0.4247933383866584, 0.4247907058048059, 0.42479274852521964, 0.4247994660285088, 0.4248108565246498, 0.4248269169538901, 0.4248476429883051, 0.4248730290340048, 0.42490306823399043, 0.4249377524716563, 0.42497707237493626, 0.42502101732108877, 0.4250695754421179, 0.42512273363082453, 0.4251804775474838, 0.4252427916271409, 0.4253096590875208, 0.4253810619375433, 0.42545698098643814, 0.4255373958534493, 0.4256222849781231, 0.42571162563116927, 0.4258053939258861, 0.4259035648301402, 0.42600611217889045, 0.4261130086872455, 0.42622422596404325, 0.42633973452594237, 0.42645950381201175, 0.4265835021988079, 0.4267116970159265, 0.42684405456201546, 0.4269805401212369, 0.4271211179801632, 0.427265751445096 ], [ 0.42598734123762094, 0.42591846296315683, 0.42585409445469957, 0.42579425312607183, 0.42573895518288335, 0.4256882156142717, 0.4256420481852527, 0.4256004654296842, 0.4255634786438537, 0.4255310978806906, 0.42550333194461265, 0.4254801883870077, 0.4254616735023568, 0.4254477923250016, 0.425438548626558, 0.42543394491398, 0.425433982428274, 0.4254386611438652, 0.425447979768617, 0.4254619357445031, 0.42548052524893115, 0.4255037431967183, 0.42553158324271484, 0.4255640377850752, 0.425601097969173, 0.4256427536921562, 0.4256889936081389, 0.4257398051340247, 0.4257951744559574, 0.42585508653639154, 0.42591952512177933, 0.4259884727508642, 0.42606191076357597, 0.42613981931051903, 0.4262221773630452, 0.42630896272390256, 0.42640015203845166, 0.4264957208064388, 0.4265956433943162, 0.4266998930480994, 0.42680844190675005, 0.42692126101607314, 0.4270383203431174, 0.4271595887910659, 0.4272850342146052, 0.42741462343575976, 0.4275483222601795, 0.4276860954938658, 0.42782790696032325, 0.427973719518123 ], [ 0.42620770417691684, 0.4261417713887233, 0.4260803572521515, 0.4260234784235466, 0.42597115034084426, 0.4259233872156826, 0.42588020202613097, 0.42584160651004344, 0.4258076111590425, 0.42577822521313813, 0.4257534566559873, 0.4257333122107977, 0.4257177973368797, 0.4257069162268494, 0.4257006718044852, 0.42569906572323973, 0.4257020983654089, 0.42570976884195855, 0.4257220749930079, 0.42573901338897163, 0.425760579332357, 0.42578676686021594, 0.42581756874724963, 0.4258529765095631, 0.42589298040906465, 0.42593756945850964, 0.42598673142718063, 0.426040452847201, 0.4260987190204759, 0.4261615140262538, 0.4262288207293033, 0.42630062078869635, 0.4263768946671922, 0.4264576216412114, 0.42654277981139416, 0.42663234611373047, 0.4267262963312558, 0.4268246051062998, 0.4269272459532788, 0.4270341912720205, 0.42714541236160997, 0.42726087943474533, 0.4273805616325905, 0.4275044270401129, 0.42763244270189327, 0.427764574638395, 0.42790078786267854, 0.42804104639754803, 0.428185313293116, 0.42833355064477163 ], [ 0.42614996699425156, 0.42608691606499843, 0.4260284152659922, 0.42597448050891756, 0.42592512647059916, 0.42588036658547423, 0.42584021303869674, 0.42580467675987715, 0.42577376741746703, 0.4257474934137891, 0.425725861880721, 0.4257088786760337, 0.42569654838038984, 0.4256888742950034, 0.4256858584399631, 0.4256875015532218, 0.4256938030902512, 0.4257047612243636, 0.4257203728477001, 0.425740633572883, 0.42576553773533315, 0.4257950783962488, 0.4258292473462426, 0.42586803510963556, 0.42591143094940176, 0.42595942287276173, 0.42601199763741715, 0.4260691407584235, 0.42613083651569283, 0.4261970679621211, 0.42626781693233234, 0.4263430640520326, 0.426422788747964, 0.42650696925845244, 0.4265955826445373, 0.4266886048016755, 0.42678601047200865, 0.42688777325718297, 0.4269938656317107, 0.42710425895686277, 0.42721892349507895, 0.42733782842488494, 0.42746094185630323, 0.42758823084674474, 0.4277196614173677, 0.42785519856989135, 0.4279948063038491, 0.42813844763426817, 0.4282860846097607, 0.42843767833101226 ], [ 0.42591527627796766, 0.42585510302604046, 0.42579952513872676, 0.42574855777805637, 0.4257022148510985, 0.42566050900279884, 0.4256234516094644, 0.4255910527728989, 0.4255633213151961, 0.4255402647741947, 0.4255218893995991, 0.42550820014977, 0.42549920068918584, 0.42549489338658064, 0.425495279313756, 0.425500358245072, 0.42551012865761395, 0.42552458773203794, 0.42554373135409257, 0.4255675541168153, 0.42559604932340317, 0.425629208990753, 0.4256670238536699, 0.42570948336973874, 0.4257565757248553, 0.4258082878394119, 0.4258646053751305, 0.4259255127425401, 0.425990993109089, 0.4260610284078861, 0.42613559934706324, 0.42621468541974994, 0.4262982649146525, 0.42638631492722734, 0.42647881137143945, 0.42657572899209534, 0.42667704137773954, 0.42678272097410475, 0.426892739098102, 0.4270070659523408, 0.4271256706401659, 0.4272485211811978, 0.4273755845273647, 0.42750682657941147, 0.42764221220387255, 0.42778170525049447, 0.42792526857009355, 0.4280728640328344, 0.42822445254691394, 0.42837999407763644 ], [ 0.42560460468893424, 0.42554734663815524, 0.4254947339946648, 0.42544678115344586, 0.425403501233457, 0.42536490607084676, 0.42533100621283215, 0.4253018109122419, 0.42527732812273383, 0.42525756449468766, 0.42524252537177787, 0.42523221478823076, 0.42522663546676565, 0.4252257888172247, 0.42522967493589103, 0.4252382926054961, 0.4252516392959161, 0.4252697111655573, 0.42529250306342886, 0.4253200085319, 0.4253522198101414, 0.42538912783824545, 0.4254307222620227, 0.42547699143847006, 0.4255279224419055, 0.4255835010707642, 0.42564371185504934, 0.42570853806443193, 0.42577796171699067, 0.4258519635885862, 0.4259305232228597, 0.4260136189418475, 0.4261012278572031, 0.426193325882015, 0.4262898877432115, 0.42639088699454175, 0.42649629603011957, 0.42660608609852124, 0.42672022731742304, 0.42683868868876707, 0.426961438114441, 0.427088442412461, 0.4272196673336411, 0.427355077578737, 0.42749463681604993, 0.42763830769947486, 0.42778605188697894, 0.4279378300594955, 0.42809360194021634, 0.42825332631426977 ], [ 0.42531569988099116, 0.4252614196906061, 0.425211830965825, 0.4251669473099284, 0.425126781030841, 0.4250913431347425, 0.42506064332035504, 0.4250346899739109, 0.42501349016480733, 0.42499704964194984, 0.42498537283078985, 0.4249784628310562, 0.4249763214151866, 0.42497894902745625, 0.42498634478380715, 0.4249985064723778, 0.4250154305547312, 0.42503711216778245, 0.42506354512642225, 0.42509472192683434, 0.4251306337505046, 0.4251712704689171, 0.4252166206489335, 0.42526667155885095, 0.4253214091751317, 0.42538081818980117, 0.42544488201850394, 0.4255135828092138, 0.42558690145158895, 0.42566481758696184, 0.4257473096189588, 0.4258343547247368, 0.4259259288668279, 0.4260220068055828, 0.4261225621121999, 0.42622756718233035, 0.4263369932502468, 0.4264508104035629, 0.42656898759849143, 0.4266914926756282, 0.4268182923762479, 0.42694935235909726, 0.42708463721767276, 0.4272241104979679, 0.4273677347166743, 0.42751547137982276, 0.4276672810018485, 0.427823123125064, 0.427982956339526, 0.4281467383032774 ], [ 0.4251398631958624, 0.42508863370246336, 0.4250421294225106, 0.4250003631404322, 0.42496334633030425, 0.4249310891498773, 0.42490360043529085, 0.4248808876964793, 0.4248629571132751, 0.4248498135322118, 0.4248414604640292, 0.4248379000818848, 0.42483913322027134, 0.4248451593746415, 0.42485597670174197, 0.4248715820206537, 0.4248919708145398, 0.4249171372330981, 0.4249470740957163, 0.42498177289532757, 0.425021223802962, 0.4250654156729901, 0.4251143360490542, 0.4251679711706813, 0.425226305980572, 0.4252893241325587, 0.4253570080002263, 0.4254293386861866, 0.4255062960319993, 0.42558785862872917, 0.42567400382813264, 0.4257647077544598, 0.4258599453168656, 0.42595969022241625, 0.426063914989681, 0.4261725909628958, 0.4262856883266894, 0.42640317612135514, 0.4265250222586591, 0.426651193538168, 0.4267816556640847, 0.4269163732625769, 0.42705530989958307, 0.4271984280990821, 0.427345689361811, 0.42749705418441464, 0.42765248207901263, 0.4278119315931665, 0.4279753603302316, 0.4281427249700769 ], [ 0.4251587174685954, 0.4251106086996666, 0.42506723906124894, 0.42502862049356027, 0.42499476361818705, 0.42496567773254473, 0.4249413708050345, 0.4249218494708972, 0.42490711902876993, 0.42489718343794997, 0.4248920453163647, 0.4248917059392528, 0.424896165238556, 0.424905421803023, 0.42491947287902443, 0.4249383143720789, 0.42496194084908767, 0.4249903455412782, 0.42502352034785024, 0.42506145584032423, 0.425104141267587, 0.42515156456162934, 0.4252037123439712, 0.4252605699327687, 0.42532212135059516, 0.42538834933289127, 0.42545923533707464, 0.42553475955230113, 0.42561490090987125, 0.42569963709426795, 0.4257889445548204, 0.425882798517981, 0.4259811730002046, 0.4260840408214202, 0.4261913736190815, 0.4263031418627848, 0.4264193148694422, 0.4265398608189954, 0.4266647467706581, 0.4267939386796717, 0.4269274014145614, 0.427065098774877, 0.4272069935094037, 0.427353047334828, 0.427503220954843, 0.42765747407967725, 0.4278157654460308, 0.4279780528374028, 0.4281442931047943, 0.42831444218776865 ], [ 0.4254411755204716, 0.425396243956281, 0.42535603923262133, 0.42532057242559335, 0.4252898532931267, 0.4252638902698911, 0.4252426904629031, 0.4252262596478324, 0.4252146022660105, 0.42520772142214525, 0.4252056188827425, 0.42520829507523683, 0.425215749087832, 0.425227978670051, 0.42524498023399543, 0.42526674885631305, 0.4252932782808715, 0.4253245609221353, 0.42536058786924447, 0.4254013488907893, 0.4254468324402777, 0.4254970256622904, 0.4255519143993176, 0.4256114831992717, 0.42567571532366894, 0.42574459275647175, 0.42581809621358563, 0.42589620515300014, 0.425978897785566, 0.4260661510863989, 0.42615794080689795, 0.4262542414873712, 0.4263550264702545, 0.42646026791391256, 0.4265699368070119, 0.42668400298344994, 0.42680243513783106, 0.42692520084147273, 0.4270522665589303, 0.4271835976650258, 0.4273191584623655, 0.4274589121993325, 0.4276028210885387, 0.4277508463257206, 0.42790294810906404, 0.428059085658941, 0.42821921723804324, 0.4283833001718957, 0.42855129086973404, 0.4287231448457282 ], [ 0.4260408497294498, 0.4259991299987025, 0.4259620936819124, 0.4259297509794858, 0.42590211078439666, 0.4258791806775581, 0.42586096692388203, 0.4258474744690327, 0.4258387069368757, 0.4258346666276258, 0.4258353545166945, 0.4258407702542387, 0.4258509121654104, 0.4258657772513082, 0.4258853611906283, 0.4259096583420145, 0.42593866174710554, 0.42597236313427383, 0.42601075292305735, 0.42605382022927585, 0.42610155287082935, 0.4261539373741727, 0.4262109589814606, 0.4262726016583568, 0.42633884810249983, 0.42640967975261823, 0.42648507679828684, 0.4265650181903154, 0.4266494816517602, 0.4267384436895491, 0.4268318796067099, 0.4269297635151898, 0.42703206834925744, 0.4271387658794728, 0.42724982672721484, 0.42736522037975405, 0.4274849152058548, 0.42760887847189777, 0.4277370763585063, 0.42786947397766095, 0.42800603539029347, 0.4281467236243383, 0.4282915006932324, 0.42844032761484463, 0.4285931644308207, 0.42874997022632727, 0.42891070315017943, 0.4290753204353352, 0.4292437784197408, 0.42941603256751015 ], [ 0.42699413909521416, 0.4269556381846274, 0.426921742873692, 0.42689246248584983, 0.4268678050590815, 0.42684777734173723, 0.42683238478904445, 0.42682163156029507, 0.42681552051671473, 0.4268140532200148, 0.42681722993163135, 0.4268250496126477, 0.42683750992440506, 0.42685460722979673, 0.4268763365952471, 0.42690269179337215, 0.4269336653063213, 0.4269692483297937, 0.4270094307777302, 0.42705420128767146, 0.42710354722678223, 0.4271574546985331, 0.42721590855003516, 0.42727889238002, 0.4273463885474591, 0.4274183781808148, 0.4274948411879125, 0.4275757562664282, 0.427661100914981, 0.4277508514448198, 0.4278449829920952, 0.4279434695307057, 0.42804628388570637, 0.42815339774726874, 0.42826478168517973, 0.42838040516386866, 0.42850023655794545, 0.42862424316824266, 0.42875239123834186, 0.42888464597157483, 0.4290209715484832, 0.42916133114472327, 0.4293056869493982, 0.42945400018380875, 0.4296062311205993, 0.42976233910329026, 0.42992228256617837, 0.4300860190545884, 0.43025350524546063, 0.43042469696826163 ], [ 0.42831918939468455, 0.42828388333324896, 0.4282530692273043, 0.4282267555333818, 0.4282049494560612, 0.4281876569442556, 0.42817488268815246, 0.4281666301168127, 0.42816290139642943, 0.42816369742925, 0.42816901785315997, 0.4281788610419305, 0.4281932241061291, 0.428212102894692, 0.4282354919971575, 0.4282633847465581, 0.4282957732229689, 0.4283326482577075, 0.4283739994381851, 0.428419815113401, 0.428470082400077, 0.42852478718942644, 0.42858391415455177, 0.42864744675846334, 0.428715367262713, 0.42878765673663505, 0.428864295067186, 0.42894526096937396, 0.4290305319972704, 0.4291200845555918, 0.42921389391184445, 0.4293119342090193, 0.4294141784788267, 0.4295205986554606, 0.4296311655898793, 0.4297458490645909, 0.429864617808931, 0.4299874395148206, 0.43011428085298953, 0.4302451074896532, 0.43037988410362815, 0.4305185744038725, 0.4306611411474373, 0.4308075461578139, 0.4309577503436628, 0.431111713717908, 0.4312693954171838, 0.4314307537216162, 0.43159574607492535, 0.43176432910483253 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
hartmann6: -0.39686 (SEM: 0)
x1: 0.703969
x2: 0.889873
x3: 0.783413
x4: 0.502978
x5: 0.0677592
x6: 0.233801", "Arm 10_0
hartmann6: -0.0505109 (SEM: 0)
x1: 0.0731024
x2: 0.966383
x3: 0.311139
x4: 0.660618
x5: 0.460229
x6: 0.728661", "Arm 11_0
hartmann6: -0.017243 (SEM: 0)
x1: 0.800801
x2: 0.22853
x3: 0.931378
x4: 0.098299
x5: 0.581039
x6: 0.165996", "Arm 12_0
hartmann6: -0.902076 (SEM: 0)
x1: 0.272393
x2: 0.261966
x3: 0.684906
x4: 0.267852
x5: 1.21088e-15
x6: 0.942885", "Arm 13_0
hartmann6: -0.642203 (SEM: 0)
x1: 0.158744
x2: 0.150478
x3: 0.62625
x4: 0.362772
x5: 0
x6: 0.905898", "Arm 14_0
hartmann6: -1.01148 (SEM: 0)
x1: 0.235196
x2: 0.327363
x3: 0.45339
x4: 0.296878
x5: 0.0566427
x6: 0.785352", "Arm 15_0
hartmann6: -0.770359 (SEM: 0)
x1: 0.538952
x2: 0.283618
x3: 0.599381
x4: 0.529577
x5: 0.119609
x6: 0.813866", "Arm 16_0
hartmann6: -1.23614 (SEM: 0)
x1: 0.219188
x2: 0.276851
x3: 0.696525
x4: 0.0868806
x5: 0.0984854
x6: 0.788912", "Arm 17_0
hartmann6: -1.13175 (SEM: 0)
x1: 0.106711
x2: 0.278854
x3: 0.812076
x4: 0
x5: 0.16989
x6: 0.778902", "Arm 18_0
hartmann6: -0.634111 (SEM: 0)
x1: 0.252234
x2: 0.308824
x3: 0.739985
x4: 0.0277772
x5: 0
x6: 0.723812", "Arm 19_0
hartmann6: -1.19408 (SEM: 0)
x1: 0.3242
x2: 0.278458
x3: 0.623416
x4: 0.15834
x5: 0.126965
x6: 0.942561", "Arm 1_0
hartmann6: -0.254644 (SEM: 0)
x1: 0.419934
x2: 0.180336
x3: 0.411221
x4: 0.19127
x5: 0.938351
x6: 0.66866", "Arm 20_0
hartmann6: -1.0419 (SEM: 0)
x1: 0.235849
x2: 0.447336
x3: 0.679505
x4: 0
x5: 0.100441
x6: 0.894866", "Arm 21_0
hartmann6: -1.29488 (SEM: 0)
x1: 0.0435856
x2: 0.275752
x3: 0.760699
x4: 0.0943189
x5: 0.103941
x6: 0.910776", "Arm 22_0
hartmann6: -0.97257 (SEM: 0)
x1: 0.0081406
x2: 0.321377
x3: 0.886142
x4: 0.183151
x5: 0.108566
x6: 0.688974", "Arm 23_0
hartmann6: -0.0298629 (SEM: 0)
x1: 0
x2: 1.22098e-15
x3: 0.180104
x4: 0
x5: 0.257047
x6: 2.78856e-16", "Arm 2_0
hartmann6: -0.135248 (SEM: 0)
x1: 0.226501
x2: 0.612951
x3: 0.737841
x4: 0.79007
x5: 0.532533
x6: 0.784452", "Arm 3_0
hartmann6: -0.165744 (SEM: 0)
x1: 0.899604
x2: 0.316626
x3: 0.113939
x4: 0.478366
x5: 0.411064
x6: 0.344343", "Arm 4_0
hartmann6: -0.0783903 (SEM: 0)
x1: 0.816311
x2: 0.718168
x3: 0.366568
x4: 0.276598
x5: 0.354597
x6: 0.0788773", "Arm 5_0
hartmann6: -0.00374949 (SEM: 0)
x1: 0.0597861
x2: 0.477507
x3: 0.984853
x4: 0.964771
x5: 0.733056
x6: 0.518654", "Arm 6_0
hartmann6: -0.0122285 (SEM: 0)
x1: 0.364092
x2: 0.785114
x3: 0.16299
x4: 0.048069
x5: 0.764806
x6: 0.903241", "Arm 7_0
hartmann6: -0.144938 (SEM: 0)
x1: 0.509804
x2: 0.0199137
x3: 0.532985
x4: 0.736238
x5: 0.135333
x6: 0.467987", "Arm 8_0
hartmann6: -0.0763775 (SEM: 0)
x1: 0.622962
x2: 0.53223
x3: 0.233523
x4: 0.889147
x5: 0.925249
x6: 0.28714", "Arm 9_0
hartmann6: -1.0626 (SEM: 0)
x1: 0.253142
x2: 0.272034
x3: 0.601565
x4: 0.326832
x5: 0.0535014
x6: 0.849444" ], "type": "scatter", "x": [ 0.7039692401885986, 0.0731023894622922, 0.8008011942729354, 0.27239334316444214, 0.15874437920702364, 0.23519589801157317, 0.5389521838498029, 0.21918849969676493, 0.10671067566014657, 0.2522337508996379, 0.3242003713153602, 0.41993400547653437, 0.2358494836733764, 0.04358563812513101, 0.008140604839402642, 0.0, 0.22650093212723732, 0.8996037896722555, 0.8163106394931674, 0.05978607479482889, 0.3640918396413326, 0.5098042171448469, 0.6229621190577745, 0.25314199924468994 ], "xaxis": "x", "y": [ 0.8898727297782898, 0.9663825742900372, 0.22852987330406904, 0.26196562219159164, 0.15047750976710164, 0.3273625373443004, 0.2836184133424968, 0.27685052740492694, 0.27885430956812013, 0.30882391447335605, 0.2784577255431607, 0.18033630028367043, 0.4473361234214467, 0.2757520708015818, 0.32137689426604615, 1.220981934244119e-15, 0.612951054237783, 0.3166261911392212, 0.7181677175685763, 0.47750668600201607, 0.7851139297708869, 0.019913658499717712, 0.5322297886013985, 0.272033697925508 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
hartmann6: -0.39686 (SEM: 0)
x1: 0.703969
x2: 0.889873
x3: 0.783413
x4: 0.502978
x5: 0.0677592
x6: 0.233801", "Arm 10_0
hartmann6: -0.0505109 (SEM: 0)
x1: 0.0731024
x2: 0.966383
x3: 0.311139
x4: 0.660618
x5: 0.460229
x6: 0.728661", "Arm 11_0
hartmann6: -0.017243 (SEM: 0)
x1: 0.800801
x2: 0.22853
x3: 0.931378
x4: 0.098299
x5: 0.581039
x6: 0.165996", "Arm 12_0
hartmann6: -0.902076 (SEM: 0)
x1: 0.272393
x2: 0.261966
x3: 0.684906
x4: 0.267852
x5: 1.21088e-15
x6: 0.942885", "Arm 13_0
hartmann6: -0.642203 (SEM: 0)
x1: 0.158744
x2: 0.150478
x3: 0.62625
x4: 0.362772
x5: 0
x6: 0.905898", "Arm 14_0
hartmann6: -1.01148 (SEM: 0)
x1: 0.235196
x2: 0.327363
x3: 0.45339
x4: 0.296878
x5: 0.0566427
x6: 0.785352", "Arm 15_0
hartmann6: -0.770359 (SEM: 0)
x1: 0.538952
x2: 0.283618
x3: 0.599381
x4: 0.529577
x5: 0.119609
x6: 0.813866", "Arm 16_0
hartmann6: -1.23614 (SEM: 0)
x1: 0.219188
x2: 0.276851
x3: 0.696525
x4: 0.0868806
x5: 0.0984854
x6: 0.788912", "Arm 17_0
hartmann6: -1.13175 (SEM: 0)
x1: 0.106711
x2: 0.278854
x3: 0.812076
x4: 0
x5: 0.16989
x6: 0.778902", "Arm 18_0
hartmann6: -0.634111 (SEM: 0)
x1: 0.252234
x2: 0.308824
x3: 0.739985
x4: 0.0277772
x5: 0
x6: 0.723812", "Arm 19_0
hartmann6: -1.19408 (SEM: 0)
x1: 0.3242
x2: 0.278458
x3: 0.623416
x4: 0.15834
x5: 0.126965
x6: 0.942561", "Arm 1_0
hartmann6: -0.254644 (SEM: 0)
x1: 0.419934
x2: 0.180336
x3: 0.411221
x4: 0.19127
x5: 0.938351
x6: 0.66866", "Arm 20_0
hartmann6: -1.0419 (SEM: 0)
x1: 0.235849
x2: 0.447336
x3: 0.679505
x4: 0
x5: 0.100441
x6: 0.894866", "Arm 21_0
hartmann6: -1.29488 (SEM: 0)
x1: 0.0435856
x2: 0.275752
x3: 0.760699
x4: 0.0943189
x5: 0.103941
x6: 0.910776", "Arm 22_0
hartmann6: -0.97257 (SEM: 0)
x1: 0.0081406
x2: 0.321377
x3: 0.886142
x4: 0.183151
x5: 0.108566
x6: 0.688974", "Arm 23_0
hartmann6: -0.0298629 (SEM: 0)
x1: 0
x2: 1.22098e-15
x3: 0.180104
x4: 0
x5: 0.257047
x6: 2.78856e-16", "Arm 2_0
hartmann6: -0.135248 (SEM: 0)
x1: 0.226501
x2: 0.612951
x3: 0.737841
x4: 0.79007
x5: 0.532533
x6: 0.784452", "Arm 3_0
hartmann6: -0.165744 (SEM: 0)
x1: 0.899604
x2: 0.316626
x3: 0.113939
x4: 0.478366
x5: 0.411064
x6: 0.344343", "Arm 4_0
hartmann6: -0.0783903 (SEM: 0)
x1: 0.816311
x2: 0.718168
x3: 0.366568
x4: 0.276598
x5: 0.354597
x6: 0.0788773", "Arm 5_0
hartmann6: -0.00374949 (SEM: 0)
x1: 0.0597861
x2: 0.477507
x3: 0.984853
x4: 0.964771
x5: 0.733056
x6: 0.518654", "Arm 6_0
hartmann6: -0.0122285 (SEM: 0)
x1: 0.364092
x2: 0.785114
x3: 0.16299
x4: 0.048069
x5: 0.764806
x6: 0.903241", "Arm 7_0
hartmann6: -0.144938 (SEM: 0)
x1: 0.509804
x2: 0.0199137
x3: 0.532985
x4: 0.736238
x5: 0.135333
x6: 0.467987", "Arm 8_0
hartmann6: -0.0763775 (SEM: 0)
x1: 0.622962
x2: 0.53223
x3: 0.233523
x4: 0.889147
x5: 0.925249
x6: 0.28714", "Arm 9_0
hartmann6: -1.0626 (SEM: 0)
x1: 0.253142
x2: 0.272034
x3: 0.601565
x4: 0.326832
x5: 0.0535014
x6: 0.849444" ], "type": "scatter", "x": [ 0.7039692401885986, 0.0731023894622922, 0.8008011942729354, 0.27239334316444214, 0.15874437920702364, 0.23519589801157317, 0.5389521838498029, 0.21918849969676493, 0.10671067566014657, 0.2522337508996379, 0.3242003713153602, 0.41993400547653437, 0.2358494836733764, 0.04358563812513101, 0.008140604839402642, 0.0, 0.22650093212723732, 0.8996037896722555, 0.8163106394931674, 0.05978607479482889, 0.3640918396413326, 0.5098042171448469, 0.6229621190577745, 0.25314199924468994 ], "xaxis": "x2", "y": [ 0.8898727297782898, 0.9663825742900372, 0.22852987330406904, 0.26196562219159164, 0.15047750976710164, 0.3273625373443004, 0.2836184133424968, 0.27685052740492694, 0.27885430956812013, 0.30882391447335605, 0.2784577255431607, 0.18033630028367043, 0.4473361234214467, 0.2757520708015818, 0.32137689426604615, 1.220981934244119e-15, 0.612951054237783, 0.3166261911392212, 0.7181677175685763, 0.47750668600201607, 0.7851139297708869, 0.019913658499717712, 0.5322297886013985, 0.272033697925508 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermap": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermap" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "hartmann6" }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x2" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
\n", "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot())" ] }, { "cell_type": "markdown", "id": "a610401a", "metadata": { "papermill": { "duration": 0.104162, "end_time": "2025-01-31T05:09:42.778260", "exception": false, "start_time": "2025-01-31T05:09:42.674098", "status": "completed" }, "tags": [] }, "source": [ "We can also retrieve a contour plot for the other metric, \"l2norm\" –– say, we are interested in seeing the response surface for parameters \"x3\" and \"x4\" for this one." ] }, { "cell_type": "code", "execution_count": 12, "id": "d8054021", "metadata": { "execution": { "iopub.execute_input": "2025-01-31T05:09:42.982541Z", "iopub.status.busy": "2025-01-31T05:09:42.981998Z", "iopub.status.idle": "2025-01-31T05:09:43.556456Z", "shell.execute_reply": "2025-01-31T05:09:43.555522Z" }, "papermill": { "duration": 0.722367, "end_time": "2025-01-31T05:09:43.603636", "exception": false, "start_time": "2025-01-31T05:09:42.881269", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:09:42] ax.service.ax_client: Retrieving contour plot with parameter 'x3' on X-axis and 'x4' on Y-axis, for metric 'l2norm'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ 0.873357211044174, 0.8718968506625616, 0.8709503850977343, 0.8705241960886989, 0.8706238712037639, 0.8712541820035598, 0.8724190640581957, 0.8741215989051176, 0.8763639980286334, 0.879147588935824, 0.8824728033972113, 0.8863391679136341, 0.8907452964634817, 0.8956888855771653, 0.9011667117777042, 0.9071746314184139, 0.9137075829403791, 0.9207595915640969, 0.9283237764209177, 0.9363923601215283, 0.9449566807496601, 0.9540072062609183, 0.9635335512572968, 0.9735244960998948, 0.9839680083132201, 0.9948512662262865, 1.0061606847874585, 1.017881943481602, 1.0300000162706573, 1.04249920347086, 1.0553631654727942, 1.0685749582034707, 1.0821170702231475, 1.0959714613436138, 1.1101196026487274, 1.124542517793257, 1.1392208254509308, 1.1541347827788353, 1.169264329761396, 1.184589134294173, 1.200088637865431, 1.21574210169099, 1.2315286531572032, 1.2474273324254799, 1.263417139052175, 1.2794770784777598, 1.295586208240355, 1.3117236837703545, 1.3278688036249409, 1.344001054024134 ], [ 0.8756791497886467, 0.8742112994323876, 0.8732564171839755, 0.8728209132515621, 0.8729104052684629, 0.8735296963615489, 0.8746827550685694, 0.8763726971914663, 0.8786017696668014, 0.8813713365287476, 0.8846818670332403, 0.8885329260051704, 0.8929231664634214, 0.8978503245709284, 0.9033112169492027, 0.9093017403888306, 0.9158168739791196, 0.9228506836717303, 0.9303963292845261, 0.9384460739432974, 0.9469912959502329, 0.9560225030591987, 0.9655293491292865, 0.975500653119276, 0.9859244203771235, 0.9967878661699691, 1.0080774413921072, 1.019778860379908, 1.0318771307551817, 1.0443565852105765, 1.0572009151435113, 1.0703932060382255, 1.0839159744888804, 1.0977512067506738, 1.1118803987000925, 1.1262845970803783, 1.1409444419035053, 1.1558402098756333, 1.1709518587096113, 1.1862590721848212, 1.2017413058120365, 1.217377832959282, 1.233147791293015, 1.249030229388332, 1.2650041533616891, 1.2810485733800079, 1.2971425499011147, 1.3132652395018478, 1.3293959401526398, 1.3455141357998794 ], [ 0.8783720664431379, 0.876898571087418, 0.875936923388734, 0.8754935585676518, 0.8755741211413643, 0.8761834429068514, 0.8773255227671749, 0.8790035084882861, 0.8812196804679556, 0.8839754375924751, 0.8872712852502675, 0.8911068255647209, 0.895480749901393, 0.9003908336972967, 0.9058339336522385, 0.9118059873140347, 0.918302015081461, 0.9253161246401458, 0.9328415178381979, 0.9408704999997791, 0.9493944916657937, 0.9584040427426229, 0.9678888490304653, 0.9778377710947188, 0.9882388554347821, 0.9990793578964584, 1.0103457692655609, 1.022023842972499, 1.0340986248294062, 1.046554484714014, 1.059375150107113, 1.0725437413834273, 1.0860428087493024, 1.0998543707143014, 1.1139599539782439, 1.128340634609956, 1.1429770803890815, 1.1578495941783604, 1.172938158189889, 1.1882224790057472, 1.2036820332109075, 1.2192961134942863, 1.2350438750723016, 1.2509043822886852, 1.266856655243888, 1.2828797163079155, 1.2989526363713857, 1.3150545806910072, 1.3311648541881422, 1.3472629460614223 ], [ 0.8814345709926494, 0.8799573031186547, 0.878990569640465, 0.8785408272879576, 0.8786137442327684, 0.8792141779956868, 0.8803461551908616, 0.8820128531943543, 0.8842165838191147, 0.886958779072314, 0.8902399790645611, 0.8940598221337133, 0.8984170372388649, 0.9033094386727282, 0.9087339231326073, 0.9146864691825978, 0.9211621391310474, 0.9281550833391665, 0.9356585469680004, 0.94366487916245, 0.9521655446621562, 0.9611511378204479, 0.9706113990036884, 0.9805352333347181, 0.990910731735439, 1.0017251942150227, 1.0129651553420824, 1.0246164118306538, 1.0366640521623893, 1.0490924881593793, 1.061885488414694, 1.0750262134812758, 1.0884972527124788, 1.1022806626419825, 1.1163580067847865, 1.13071039673582, 1.1453185344378685, 1.1601627554862817, 1.1752230733342843, 1.1904792242593851, 1.2059107129488718, 1.2214968585604384, 1.2372168411122497, 1.2530497480563143, 1.2689746208884236, 1.2849705016485222, 1.3010164791660732, 1.3170917349067892, 1.3331755882789493, 1.3492475412603395 ], [ 0.8848648169362883, 0.8833856735485907, 0.8824155596305088, 0.881960949876444, 0.8820275328390523, 0.8826201887705178, 0.8837429692936605, 0.8853990789906423, 0.8875908589917217, 0.8903197726401813, 0.8935863933034596, 0.8973903943934556, 0.9017305416520908, 0.906604687750598, 0.9120097692434541, 0.9179418059096967, 0.9243959025064112, 0.9313662529506372, 0.9388461469373786, 0.9468279789929706, 0.9553032599540627, 0.9642626308539721, 0.973695879189219, 0.9835919575304444, 0.9939390044332739, 1.0047243675961193, 1.0159346292036635, 1.0275556333865123, 1.0395725157196487, 1.051969734674696, 1.0647311049336337, 1.0778398324646188, 1.0912785512539798, 1.1050293615823454, 1.119073869726845, 1.1333932289663524, 1.1479681817617127, 1.1627791029787453, 1.1778060440178981, 1.1930287777114572, 1.208426843846337, 1.2239795951685986, 1.2396662437242671, 1.2554659073902152, 1.271357656448541, 1.287320560058164, 1.3033337324784093, 1.3193763789006554, 1.3354278407463116, 1.3514676402920782 ], [ 0.8886605024922497, 0.8871814020640247, 0.8862096358722436, 0.8857516929940139, 0.8858132790500091, 0.8863992939893988, 0.8875138116968957, 0.889160061510206, 0.891340411730314, 0.8940563552011704, 0.8973084970291569, 0.9010965445055501, 0.9054192992884902, 0.9102746518934051, 0.9156595785330006, 0.9215701403402802, 0.9280014849996283, 0.934947850802692, 0.9424025731374228, 0.950358093409713, 0.9588059703886567, 0.9677368939575937, 0.9771407012441954, 0.9870063950944633, 0.9973221648465329, 1.0080754093519544, 1.0192527621835306, 1.0308401189608558, 1.0428226667165428, 1.0551849152186512, 1.0679107301574726, 1.0809833680976944, 1.0943855130904467, 1.1080993148335565, 1.1221064282624664, 1.1363880544489149, 1.1509249826798773, 1.1656976335846223, 1.180686103174298, 1.195870207654918, 1.2112295288722137, 1.2267434602445284, 1.2423912530386128, 1.258152062842026, 1.274004996085831, 1.2899291564713455, 1.3059036911556214, 1.3219078365518122, 1.3379209636027576, 1.3539226223884366 ], [ 0.8928188726882242, 0.8913417520411311, 0.8903700816587109, 0.8899103613867461, 0.8899683105659061, 0.890548845770113, 0.8916560603588354, 0.8932932059317737, 0.8954626757686384, 0.8981659903309325, 0.9014037848961438, 0.9051757993882763, 0.9094808704612418, 0.9143169258845391, 0.919680981272877, 0.9255691391934118, 0.9319765906761746, 0.9388976191449121, 0.9463256067770789, 0.9542530432930453, 0.9626715371658836, 0.9715718292345256, 0.980943808694045, 0.9907765314283463, 1.0010582406418878, 1.0117763897383771, 1.0229176673862488, 1.0344680247024522, 1.0464127044780642, 1.0587362723618121, 1.0714226499100374, 1.0844551494046017, 1.0978165103337858, 1.1114889374248798, 1.1254541401112188, 1.139693373311403, 1.1541874793933398, 1.1689169311914016, 1.183861875941437, 1.1990021799947521, 1.2143174741698428, 1.229787199598198, 1.24539065391935, 1.261107037678919, 1.2769155007836261, 1.2927951888669746, 1.3087252894204533, 1.3246850775465844, 1.3406539611917887, 1.3566115257201796 ], [ 0.8973367223363777, 0.8958635334618293, 0.894893723918037, 0.8944338006780689, 0.8944894934241353, 0.895065732249255, 0.8961666271640613, 0.8977954494974726, 0.8999546152739484, 0.9026456706447057, 0.9058692794434163, 0.9096252129305309, 0.9139123417833674, 0.9187286303814142, 0.9240711334291081, 0.9299359949500419, 0.9363184496786805, 0.9432128268671601, 0.9506125565165153, 0.9585101780326912, 0.9668973512994428, 0.9757648701511494, 0.9851026782200147, 0.9948998871234271, 1.0051447969485152, 1.0158249189825752, 1.0269270006294868, 1.0384370524443487, 1.0503403772102964, 1.062621600974126, 1.0752647059497016, 1.0882530651912714, 1.101569478932143, 1.1151962124777757, 1.129115035536771, 1.1433072628676628, 1.1577537961146542, 1.1724351667010238, 1.1873315796452055, 1.202422958161076, 1.2176889889014553, 1.2331091677015062, 1.2486628456773834, 1.2643292755341329, 1.280087657937011, 1.2959171878000506, 1.3117971003469098, 1.3277067168003152, 1.3436254895583384, 1.359533046718363 ], [ 0.9022103998892972, 0.900743106718278, 0.899776936963665, 0.8993184010620199, 0.8993732356329165, 0.899946381153712, 0.90104196143037, 0.9026632649527605, 0.9048127282176448, 0.9074919210966533, 0.9107015343202768, 0.9144413691421234, 0.9187103292408103, 0.9235064149095014, 0.9288267195754998, 0.934667428684306, 0.9410238209746734, 0.9478902721626491, 0.955260261044278, 0.9631263780180487, 0.9714803360194237, 0.980312983851172, 0.9896143218843831, 0.9993735200965205, 1.0095789384040927, 1.0202181492390903, 1.0312779623099806, 1.0427444514798978, 1.054602983686647, 1.0668382498216133, 1.0794342974771103, 1.0923745654648693, 1.1056419200014813, 1.1192186924506087, 1.1330867185056317, 1.1472273786912932, 1.1616216400579318, 1.176250098937328, 1.1910930246256863, 1.2061304038556013, 1.221341985916427, 1.2367073282799979, 1.2522058425873162, 1.2678168408506667, 1.2835195817253102, 1.2992933167049212, 1.3151173360960773, 1.330971014628017, 1.346833856556237, 1.3626855401208042 ], [ 0.9074358121712272, 0.9059763872998732, 0.9050156471339414, 0.9045601018923948, 0.9046154917068818, 0.9051867642798461, 0.9062780543286133, 0.9078926649042067, 0.9100330506682384, 0.9127008032052869, 0.9158966384419344, 0.9196203862370799, 0.9238709822011064, 0.9286464617941974, 0.9339439567466095, 0.9397596938356096, 0.9460889960460429, 0.9529262861329792, 0.9602650925964303, 0.9680980580698747, 0.9764169501152491, 0.9852126744086878, 0.9944752902924935, 1.0041940286600943, 1.0143573121322127, 1.0249527774738767, 1.0359673001937366, 1.0473870212586984, 1.0591973758493158, 1.0713831240733138, 1.0839283835475542, 1.0968166637516181, 1.1100309020493473, 1.1235535012686324, 1.1373663687238635, 1.151450956559823, 1.1657883032912315, 1.180359076407551, 1.195143615908714, 1.2101219786344304, 1.2252739832464814, 1.2405792557217261, 1.2560172752114145, 1.2715674201218883, 1.2872090142708368, 1.3029213729738314, 1.318683848916325, 1.3344758776678576, 1.350277022696987, 1.366067019748032 ], [ 0.913008429976534, 0.9115588513548188, 0.910605338313369, 0.9101543971600647, 0.9102117680972546, 0.9107824028730918, 0.911870444208442, 0.9134792070881005, 0.9156111619998655, 0.9182679201988626, 0.9214502210686555, 0.9251579216437892, 0.9293899883517586, 0.9341444910248191, 0.9394185992248729, 0.9452085809164733, 0.951509803515239, 0.9583167373305623, 0.9656229614131184, 0.9734211718091528, 0.9817031922149861, 0.9904599870162607, 0.9996816766881294, 1.0093575555235044, 1.0194761116482869, 1.030025049273766, 1.0409913131280295, 1.0523611150003442, 1.064119962324067, 1.076252688716488, 1.0887434863862406, 1.1015759403120169, 1.1147330640896649, 1.1281973373384804, 1.1419507445514387, 1.1559748152690605, 1.170250665451357, 1.184759039918034, 1.199480355723225, 1.2143947463276987, 1.22948210642854, 1.2447221373043462, 1.2600943925319883, 1.2755783239303415, 1.2911533275855502, 1.3067987898127118, 1.322494132909706, 1.3382188605598269, 1.3539526027422306, 1.3696751600112906 ], [ 0.918923294524979, 0.9174855421161057, 0.9165410583253456, 0.9160963418488055, 0.916157129506771, 0.9167283738983125, 0.9178142228204573, 0.9194180005408699, 0.921542191007261, 0.9241884230715295, 0.927357457799787, 0.931049177933608, 0.9352625795602396, 0.9399957660428713, 0.9452459442541397, 0.9510094231484932, 0.9572816147009137, 0.9640570372313486, 0.9713293211258004, 0.9790912169564178, 0.9873346059945745, 0.9960505131019475, 1.0052291219763163, 1.0148597927197278, 1.0249310816885473, 1.035430763576072, 1.0463458556703333, 1.0576626442212564, 1.0693667128439024, 1.0814429728762027, 1.0938756956028546, 1.106648546249553, 1.1197446196452887, 1.1331464774439792, 1.1468361867910357, 1.1607953603148915, 1.1750051973185385, 1.1894465260420177, 1.204099846862318, 1.2189453762944134, 1.2339630916538102, 1.2491327762390882, 1.2644340648910324, 1.2798464897840345, 1.295349526304806, 1.3109226388736848, 1.3265453265643616, 1.34219716837931, 1.357857868039958, 1.373507298152917 ], [ 0.925175024761111, 0.9237510771792476, 0.9228174261840081, 0.9223805591570002, 0.9224462060772121, 0.9230193171889707, 0.9241040424230097, 0.9257037126593768, 0.9278208229157848, 0.9304570175390968, 0.9336130774715208, 0.9372889096568315, 0.9414835386446145, 0.9461951004438385, 0.9514208386692047, 0.9571571030162545, 0.9633993500930176, 0.9701421466279658, 0.9773791750655769, 0.9851032415524144, 0.9933062863080633, 1.0019793963665151, 1.011112820665083, 1.0206959874493924, 1.0307175239540711, 1.0411652783107652, 1.052026343626542, 1.0632870841674655, 1.0749331635747212, 1.086949575032338, 1.0993206732987535, 1.1120302085070608, 1.1250613616323164, 1.138396781517777, 1.1520186233462804, 1.1659085884374336, 1.1800479652462914, 1.1944176714348613, 1.2089982968838406, 1.2237701475083862, 1.2387132897392832, 1.253807595528145, 1.2690327877339653, 1.2843684857470195, 1.299794251205682, 1.3152896336617415, 1.3308342160505806, 1.3464076598236536, 1.3619897496026931, 1.3775604372173602 ], [ 0.9317578254830572, 0.9303496566170437, 0.9294286401905142, 0.9290012485708572, 0.9290732014349918, 0.9296494434607445, 0.9307341237592455, 0.9323305771371881, 0.9344413072724074, 0.9370679718805797, 0.9402113699447149, 0.9438714310727799, 0.9480472070417623, 0.9527368655795398, 0.9579376864284597, 0.9636460597265708, 0.9698574867350055, 0.976566582931317, 0.9837670834806891, 0.9914518510882461, 0.9996128862272723, 1.0082413397295251, 1.0173275277151461, 1.0268609488312435, 1.036830303759499, 1.0472235169448243, 1.0580277604888146, 1.0692294801435593, 1.0808144233334624, 1.0927676691251451, 1.105073660058145, 1.1177162357418777, 1.130678668117993, 1.1439436982806173, 1.1574935747413269, 1.1713100930201952, 1.1853746364391757, 1.199668217989922, 1.2141715231438266, 1.2288649534689626, 1.2437286709155888, 1.2587426426296264, 1.273886686151817, 1.289140514859146, 1.3044837835045375, 1.3198961337108779, 1.3353572392761102, 1.3508468511473317, 1.36634484192353, 1.3818312497491725 ], [ 0.9386654962832781, 0.9372750719142808, 0.936368486856672, 0.9359521947721289, 0.9360319015781704, 0.9366125431728363, 0.9376982648880539, 0.9392924027602383, 0.9413974667014933, 0.9440151256493947, 0.9471461947669202, 0.95079062475803, 0.9549474933573789, 0.9596149990456332, 0.9647904570345445, 0.9704702975580692, 0.9766500664982252, 0.9833244283658842, 0.9904871716489008, 0.9981312165310159, 1.0062486249770495, 1.0148306131708436, 1.0238675662841692, 1.0333490555460156, 1.043263857573408, 1.0535999759162298, 1.0643446647604256, 1.0754844547258466, 1.0870051806870311, 1.0988920115376353, 1.1111294818118314, 1.1237015250690159, 1.1365915089414302, 1.1497822717380273, 1.1632561604920468, 1.176995070334257, 1.190980485069039, 1.2051935188256897, 1.2196149586538452, 1.2342253079278487, 1.2490048304228203, 1.2639335949220298, 1.2789915202141566, 1.2941584203373833, 1.3094140499269467, 1.3247381495227122, 1.3401104906939156, 1.3555109208394942, 1.3709194075240698, 1.3863160822120681 ], [ 0.9458914412823075, 0.9445207157030977, 0.9436303506367849, 0.9432267773613094, 0.9433156845856709, 0.943901996218107, 0.9449898508499088, 0.9465825830432997, 0.9486827065067558, 0.9512918992357109, 0.9544109906901452, 0.9580399510747064, 0.9621778827799556, 0.9668230140363547, 0.9719726948252267, 0.9776233950835918, 0.983770705231322, 0.9904093390417009, 0.9975331388676923, 1.005135083228148, 1.0132072967496601, 1.0217410624511003, 1.030726836349584, 1.0401542643579402, 1.0500122014350377, 1.0602887329425708, 1.0709711981528927, 1.0820462158450233, 1.0934997119176981, 1.105316948940911, 1.1174825575599194, 1.1299805696588547, 1.1427944531840775, 1.1559071485215007, 1.1693011063159877, 1.1829583266154655, 1.1968603992177056, 1.2109885450928273, 1.2253236587509992, 1.2398463514211706, 1.2545369949037464, 1.2693757659579543, 1.2843426910827656, 1.2994176915490807, 1.3145806285403348, 1.3298113482585638, 1.3450897268537814, 1.3603957150353252, 1.3757093822259456, 1.391010960121297 ], [ 0.9534286796339083, 0.9520795922777163, 0.9512072244465, 0.9508179813748807, 0.9509175311275372, 0.9515107824208482, 0.9526018641465895, 0.9541941066861485, 0.9562900250984103, 0.9588913042591989, 0.9619987860238082, 0.9656124584782879, 0.9697314473381697, 0.9743540095463159, 0.9794775291145037, 0.9850985152455332, 0.9912126027649453, 0.9978145548835162, 1.0048982683032506, 1.0124567806715479, 1.0204822803796214, 1.028966118692808, 1.0378988241918645, 1.0472701194959846, 1.0570689402295315, 1.0672834561864941, 1.077901094638157, 1.0889085657215176, 1.100291889838217, 1.1120364269859826, 1.1241269079373895, 1.1365474671736275, 1.1492816774744872, 1.1623125860590766, 1.1756227521665579, 1.1891942859600022, 1.203008888632168, 1.2170478935870273, 1.2312923085671308, 1.2457228585934885, 1.260320029581503, 1.2750641124944126, 1.289935247893772, 1.3049134707452963, 1.3199787553379418, 1.3351110601737257, 1.350290372686745, 1.3654967536506772, 1.3807103811358645, 1.3959115938793316 ], [ 0.9612698567782536, 0.9599443288650489, 0.9590917209449568, 0.9587184085733578, 0.9588300357529649, 0.9594314928188412, 0.9605268960114934, 0.9621195688263157, 0.9642120252225457, 0.9668059547692034, 0.9699022097999634, 0.9735007946421905, 0.9776008569791179, 0.9822006813969576, 0.9872976851616114, 0.9928884162620758, 0.9989685537497849, 1.0055329103954853, 1.0125754376765785, 1.02008923310009, 1.0280665498577335, 1.0364988088011968, 1.0453766127173343, 1.0546897628742924, 1.0644272778016222, 1.0745774142584241, 1.085127690336181, 1.0960649106341276, 1.1073751934378164, 1.119043999823549, 1.1310561646041473, 1.1433959290246378, 1.1560469751096145, 1.1689924615579033, 1.1822150610741535, 1.1956969990216482, 1.2094200932756256, 1.223365795151866, 1.2375152312813673, 1.2518492462984572, 1.2663484462067713, 1.280993242285203, 1.2957638953939905, 1.3106405605401357, 1.3256033315604667, 1.3406322857807291, 1.355707528509582, 1.370809237227432, 1.3859177053317917, 1.4010133853029818 ], [ 0.969407256417699, 0.9681071876257188, 0.9672760845550332, 0.9669202894745553, 0.9670454189304477, 0.9676563417043402, 0.9687571584452146, 0.9703511830630861, 0.9724409259673352, 0.975028079227108, 0.9781135037257217, 0.981697218374149, 0.9857783914427232, 0.9903553340628296, 0.9954254959434535, 1.0009854633398398, 1.0070309593037687, 1.013556846237232, 1.02055713076293, 1.0280249709170108, 1.035952685661011, 1.0443317667015175, 1.0531528925978384, 1.0624059451292511, 1.072080027885317, 1.0821634870342276, 1.0926439342161585, 1.1035082715004152, 1.1147427183376561, 1.1263328404304929, 1.1382635804389367, 1.1505192904297723, 1.1630837659726538, 1.1759402817790812, 1.1890716287749625, 1.2024601524916732, 1.2160877926557996, 1.229936123853043, 1.243986397138088, 1.2582195824583686, 1.272616411757092, 1.2871574226182807, 1.3018230023149446, 1.316593432120045, 1.3314489317394707, 1.346369703726049, 1.3613359777340426, 1.3763280544748602, 1.391326349236024, 1.4063114348280314 ], [ 0.9778328131877999, 0.976560078358145, 0.975752204194122, 0.9754154961046961, 0.9755555398127846, 0.9761771793964267, 0.9772844969888748, 0.9788807942253057, 0.9809685755189077, 0.9835495332437223, 0.9866245348956664, 0.9901936122973103, 0.9942559529050689, 0.9988098932709433, 1.0038529147036166, 1.0093816411664545, 1.015391839441997, 1.0218784215851082, 1.0288354496784493, 1.0362561428961343, 1.0441328868728208, 1.0524572453674281, 1.0612199742020134, 1.0704110374481757, 1.0800196258248966, 1.0900341772634645, 1.1004423995871426, 1.1112312952450756, 1.122387188032282, 1.1338957517201211, 1.1457420405140424, 1.1579105212489007, 1.17038510722509, 1.1831491935828475, 1.1961856941058382, 1.2094770793401977, 1.2230054159097172, 1.2367524069037574, 1.250699433210303, 1.2648275956631214, 1.2791177578690835, 1.2935505895792927, 1.3081066104658507, 1.3227662341647553, 1.3375098124449114, 1.3523176793629645, 1.3671701952641304, 1.3820477904904216, 1.3969310086589712, 1.411800549375614 ], [ 0.9865381259944463, 0.9852945718764315, 0.9845116266861877, 0.9841955554379749, 0.9843519096974643, 0.9849855057155754, 0.9861004042059804, 0.9876998918537379, 0.9897864646374704, 0.992361813042328, 0.995426809235141, 0.9989814962669382, 1.003025079361823, 1.0075559193442094, 1.0125715282492544, 1.0180685671542522, 1.024042846260852, 1.030489327250323, 1.0374021279260184, 1.044774529149132, 1.0525989840654884, 1.060867129612988, 1.0695698002907088, 1.0786970441626367, 1.0882381410604343, 1.0981816229417307, 1.1085152963519436, 1.119226266930149, 1.1303009658914063, 1.141725178410664, 1.153484073826013, 1.1655622375722146, 1.177943704748703, 1.1906119952201122, 1.2035501501416028, 1.216740769795619, 1.2301660526219638, 1.2438078353185469, 1.257647633886055, 1.271666685486444, 1.2858459909820887, 1.300166358020234, 1.3146084445251713, 1.3291528024597814, 1.3437799217168929, 1.358470274001138, 1.3732043565621872, 1.3879627356413906, 1.4027260894954243, 1.417475250862487 ], [ 0.9955144719861405, 0.9943019140310569, 0.9935455708240215, 0.9932516634934832, 0.9934257061513243, 0.9940724841289437, 0.9951960338414044, 0.9967996243667028, 0.998885740822349, 1.00145606961626, 1.0045114856431376, 1.0080520414915788, 1.0120769587206775, 1.0165846212581482, 1.021572570965022, 1.027037505404605, 1.0329752778458337, 1.0393808995235148, 1.046248544169869, 1.0535715548236784, 1.0613424529155, 1.0695529496185774, 1.078193959447431, 1.0872556160771552, 1.0967272903489416, 1.106597610418364, 1.1168544839957313, 1.1274851226192122, 1.1384760678941586, 1.1498132196245507, 1.1614818657549693, 1.173466714034961, 1.1857519253109232, 1.1983211483442457, 1.2111575560490457, 1.2242438830368758, 1.2375624643513785, 1.25109527527097, 1.264823972053825, 1.2787299334959015, 1.292794303169833, 1.3069980322101074, 1.32132192250794, 1.3357466701782204, 1.3502529091599513, 1.364821254811602, 1.379432347363026, 1.3940668950868276, 1.4087057170533515, 1.423329785335703 ], [ 1.0047528211289367, 1.003573040339663, 1.0028449420488954, 1.0025747000566092, 1.0027677877664438, 1.003428956533578, 1.0045622156245617, 1.006170813875894, 1.0082572231332412, 1.010823123547933, 1.0138693908018792, 1.017396085325845, 1.0214024435698792, 1.0258868713778722, 1.0308469395113344, 1.0362793813601043, 1.0421800928705225, 1.0485441347134445, 1.0553657367069595, 1.0626383045006058, 1.0703544285195463, 1.0785058951591286, 1.0870837002121188, 1.0960780645022585, 1.1054784516901695, 1.1152735882089624, 1.1254514852792559, 1.135999462945274, 1.14690417606617, 1.1581516421891083, 1.1697272712235685, 1.181615896829518, 1.1938018094252587, 1.2062687907149694, 1.219000149629784, 1.231978759571031, 1.2451870968393275, 1.2586072801286565, 1.2722211109606463, 1.2860101149307066, 1.299955583634744, 1.3140386171428948, 1.3282401668845147, 1.342541078807788, 1.3569221366761588, 1.3713641053639074, 1.3858477740134205, 1.4003539989177225, 1.4148637459932616, 1.429358132710227 ], [ 1.014243851349865, 1.0130985911937984, 1.0124003477133028, 1.0121552439903971, 1.0123687095128102, 1.0130454586428688, 1.0141894706821177, 1.0158039716177272, 1.0178914176324916, 1.0204534804546177, 1.0234910346183386, 1.0270041466999715, 1.0309920665882795, 1.035453220840961, 1.040385208172348, 1.0457847971102743, 1.0516479258525162, 1.0579697043455862, 1.0647444186010198, 1.0719655372560353, 1.0796257203776853, 1.0877168305012022, 1.0962299458852731, 1.1051553759586545, 1.1144826789244164, 1.1242006814801169, 1.1342975006041294, 1.1447605673505694, 1.1555766525876792, 1.1667318946071552, 1.1782118285245478, 1.1900014173842937, 1.2020850848762392, 1.214446749564347, 1.2270698605225114, 1.2399374342670673, 1.2530320928705745, 1.26633610313708, 1.2798314167149174, 1.2934997110197843, 1.3073224308377935, 1.3212808304757964, 1.3353560163243443, 1.3495289896973264, 1.3637806898117448, 1.3780920367705856, 1.3924439744122514, 1.406817512891105, 1.4211937708548157, 1.4355540170864955 ], [ 1.023977964213298, 1.0228689276057152, 1.0222021128907937, 1.0219835891009923, 1.022218738651594, 1.0229122359400065, 1.0240680275238505, 1.0256893139637988, 1.0277785334123468, 1.0303373470245167, 1.0333666262612307, 1.0368664421498288, 1.0408360565604116, 1.045273915549685, 1.0501776448176199, 1.0555440473146471, 1.0613691030301111, 1.0676479709848836, 1.07437499344349, 1.0815437023530274, 1.0891468280081593, 1.097176309933622, 1.1056233099671453, 1.1144782275179337, 1.1237307169675335, 1.1333697071720048, 1.1433834230163378, 1.1537594089642758, 1.1644845545392406, 1.1755451216645019, 1.1869267737838312, 1.1986146066768393, 1.210593180876892, 1.2228465555932158, 1.2353583240331036, 1.2481116500147276, 1.2610893057562167, 1.274273710722057, 1.2876469714040877, 1.3011909219106599, 1.314887165234789, 1.328717115069479, 1.3426620380366883, 1.3567030961949644, 1.3708213896900034, 1.3849979994121289, 1.3992140295252984, 1.413450649732577, 1.4276891371451021, 1.4419109176230616 ], [ 1.0339453010934099, 1.032874147458336, 1.0322402966958377, 1.032049760519554, 1.032307871171504, 1.0330192601607906, 1.034187838564, 1.0358167789727446, 1.0379084991691943, 1.0404646476052233, 1.0434860907555927, 1.0469729024094878, 1.0509243549587999, 1.055338912734976, 1.0602142274394157, 1.0655471357053943, 1.0713336588222155, 1.077569004644764, 1.084247571703895, 1.0913629555253237, 1.0989079571567588, 1.106874593894791, 1.115254112195334, 1.1240370027430107, 1.1332130176469761, 1.1427711897228163, 1.1526998538119537, 1.1629866700828062, 1.1736186492497411, 1.1845821796392046, 1.1958630560248527, 1.2074465101469378, 1.2193172428246675, 1.231459457564248, 1.243856895559382, 1.2564928719757549, 1.2693503134062176, 1.2824117963787947, 1.295659586795713, 1.3090756801781591, 1.322641842588589, 1.3363396520998658, 1.3501505406786138, 1.3640558363489106, 1.3780368055016217, 1.3920746952142355, 1.4061507754467661, 1.4202463809797496, 1.4343429529620477, 1.448422079938023 ], [ 1.0441357598044667, 1.0431041022198606, 1.0425047090749964, 1.042343531562218, 1.0426258487093927, 1.0433562462669168, 1.044538597138991, 1.0461760434441814, 1.0482709802854633, 1.0508250413053206, 1.0538390860956472, 1.057313189526826, 1.0612466330540409, 1.0656378980524766, 1.070484661226431, 1.0757837921303026, 1.0815313528322394, 1.0877225997436983, 1.094351987630682, 1.1014131758144852, 1.1088990365620743, 1.1168016656580644, 1.125112395142511, 1.1338218081903848, 1.1429197561009752, 1.1523953773573201, 1.1622371187078713, 1.1724327582153926, 1.182969430209983, 1.1938336520762771, 1.2050113527976793, 1.216487903173743, 1.228248147620438, 1.2402764374567894, 1.2525566655759477, 1.265072302393031, 1.2778064329576477, 1.2907417951140854, 1.303860818588697, 1.3171456648800637, 1.330578267824897, 1.344140374709998, 1.357813587798838, 1.3715794061397784, 1.385419267522334, 1.3993145904474602, 1.4132468159781866, 1.4271974493378519, 1.4411481011244571, 1.4550805280115064 ], [ 1.0545390116498765, 1.0535484140836988, 1.0529849280298562, 1.0528544410279939, 1.0531621759150784, 1.0539126698693984, 1.0551097549812423, 1.056756540434451, 1.0588553963788347, 1.0614079395684195, 1.0644150208351235, 1.067876714461708, 1.071792309512071, 1.076160303170274, 1.0809783961333073, 1.086243490095499, 1.0919516873553887, 1.0980982925685603, 1.104677816662257, 1.1116839829199814, 1.119109735236433, 1.1269472485352965, 1.1351879413343517, 1.1438224904345007, 1.1528408477014165, 1.1622322589005345, 1.1719852845385064, 1.1820878226565072, 1.1925271335134329, 1.2032898660896727, 1.2143620863353142, 1.225729307079764, 1.2373765195135171, 1.2492882261465785, 1.261448475142537, 1.2738408959218468, 1.2864487359230903, 1.2992548984064796, 1.3122419811801354, 1.3253923161257453, 1.3386880093979117, 1.3521109821683568, 1.3656430117847433, 1.3792657732123375, 1.3929608806257225, 1.4067099290178806, 1.4204945356938643, 1.434296381517236, 1.4480972517789061, 1.4618790765597371 ], [ 1.0651445188495723, 1.0641964934931474, 1.063670317230961, 1.0635718108938363, 1.0639061382192456, 1.0646777850610332, 1.065890540107579, 1.0675474771924962, 1.0696509392768678, 1.0722025241779978, 1.0752030721135066, 1.0786526551246727, 1.0825505684365029, 1.0868953238061128, 1.0916846449039328, 1.096915464765917, 1.1025839253475707, 1.1086853792031375, 1.1152143933063479, 1.122164755020851, 1.1295294802212195, 1.1373008235572812, 1.1454702908467644, 1.1540286535734, 1.1629659654597095, 1.172271581075847, 1.1819341764383653, 1.1919417715450304, 1.2022817547844642, 1.212940909152237, 1.223905440198176, 1.235161005622755, 1.2466927464342783, 1.2584853195724917, 1.2705229318985358, 1.2827893754459119, 1.2952680638223826, 1.3079420696481259, 1.3207941629117297, 1.3338068501220346, 1.3469624141308691, 1.3602429544993409, 1.3736304282783942, 1.387106691072988, 1.4006535382583163, 1.4142527462163053, 1.4278861134608685, 1.4415355015210187, 1.4551828754525267, 1.4688103438504378 ], [ 1.0759415523047304, 1.07503755700943, 1.0745500439811306, 1.0744847643649473, 1.0748468199624435, 1.0756406426154457, 1.0768699750798945, 1.0785378534733339, 1.0806465913746155, 1.0831977656500975, 1.086192204074965, 1.0896299748131884, 1.093510377813293, 1.0978319381713353, 1.1025924015055515, 1.107788731380702, 1.1134171088129476, 1.1194729338788982, 1.125950829445019, 1.1328446470261053, 1.1401474747738383, 1.1478516475885738, 1.1559487593398965, 1.1644296771734457, 1.1732845578738638, 1.1825028662460224, 1.1920733954688927, 1.2019842893690058, 1.2122230665531761, 1.2227766463329426, 1.2336313763662818, 1.2447730619356059, 1.2561869967746486, 1.267857995350855, 1.2797704265044523, 1.2919082483396973, 1.3042550442595948, 1.3167940600303687, 1.329508241758534, 1.34238027465961, 1.355392622494847, 1.3685275675497106, 1.3817672510259744, 1.3950937137179245, 1.4084889368424, 1.421934882891832, 1.43541353637991, 1.4489069443501914, 1.4623972565192063, 1.4758667649275394 ], [ 1.086919209657889, 1.086060645480973, 1.0856130974857336, 1.0855822442377385, 1.0859731228421894, 1.086790108509875, 1.0880368955947362, 1.089716480185752, 1.0918311443314068, 1.094382441970322, 1.0973711866364582, 1.1007974410017858, 1.1046605083135972, 1.1089589257773795, 1.1136904599297384, 1.118852104039255, 1.1244400775660726, 1.1304498277040058, 1.1368760330214716, 1.1437126092101462, 1.1509527169427225, 1.1585887718331982, 1.1666124564856966, 1.1750147346099098, 1.183785867173508, 1.192915430554259, 1.202392336647071, 1.2122048548735653, 1.2223406360346512, 1.2327867379395776, 1.2435296527376682, 1.2545553358730732, 1.2658492365758014, 1.2773963297970001, 1.2891811494904684, 1.3011878231373044, 1.313400107405827, 1.325801424834486, 1.3383749014215072, 1.3511034050018274, 1.3639695842885746, 1.376955908454187, 1.3900447071243274, 1.4032182106559927, 1.4164585905709945, 1.4297480000149896, 1.4430686141128963, 1.4564026700920571, 1.469732507045886, 1.4830406052124272 ], [ 1.0980664336060404, 1.0972546424711929, 1.0968483073868502, 1.096853031532057, 1.0972737846347218, 1.0981148827277287, 1.099379969357953, 1.101071998330022, 1.1031932180626567, 1.1057451576306547, 1.1087286145603346, 1.112143644441155, 1.1159895524101753, 1.120264886560095, 1.1249674333152948, 1.130094214813491, 1.1356414883239252, 1.141604747725839, 1.147978727063721, 1.1547574061884365, 1.1619340184858409, 1.1695010606867287, 1.17745030474454, 1.1857728117593311, 1.194458947919033, 1.203498402421355, 1.2128802073321665, 1.2225927593288062, 1.2326238432696714, 1.2429606575241796, 1.25358984099067, 1.2644975017230682, 1.2756692470810356, 1.2870902153123593, 1.2987451084707362, 1.3106182265671056, 1.3226935028476223, 1.334954540087324, 1.3473846477844533, 1.359966880137031, 1.3726840746804017, 1.3855188914618495, 1.3984538526267802, 1.4114713822891525, 1.4245538465583718, 1.4376835935941583, 1.45084299356132, 1.4640144783570355, 1.4771805809843985, 1.4903239744477885 ], [ 1.1093720304236334, 1.1086082929013492, 1.1082443625178118, 1.1082857643488497, 1.108737398147208, 1.1096035182966086, 1.1108877151996632, 1.1125928981808277, 1.1147212799816824, 1.1172743629208453, 1.1202529267861254, 1.1236570185210049, 1.127485943761854, 1.1317382602763983, 1.1364117733475607, 1.1415035331402885, 1.147009834082131, 1.152926216281465, 1.1592474689998757, 1.1659676361880802, 1.1730800240871924, 1.1805772108895551, 1.1884510584460155, 1.1966927259985454, 1.205292685909971, 1.2142407413545668, 1.223526045926207, 1.233137125113358, 1.2430618995828138, 1.2532877102074929, 1.2638013447665117, 1.2745890662395654, 1.2856366426112078, 1.2969293780949753, 1.30845214568162, 1.32018942091066, 1.332125316759639, 1.3442436195413139, 1.3565278256948996, 1.3689611793542962, 1.381526710573195, 1.3942072740845144, 1.4069855884697573, 1.4198442756124188, 1.432765900308691, 1.445733009908405, 1.4587281738592386, 1.4717340230279357, 1.484733288673524, 1.4977088409492727 ], [ 1.1208246886521294, 1.1201102218649248, 1.119789829833966, 1.1198689569089464, 1.1203524303559487, 1.1212444405170856, 1.1225485223846259, 1.1242675386702672, 1.126403664446088, 1.1289583734290483, 1.1319324259759727, 1.1353258588508184, 1.1391379768201557, 1.1433673461271858, 1.1480117898880966, 1.1530683854483017, 1.158533463729272, 1.1644026105898486, 1.1706706702186571, 1.1773317505671659, 1.184379230825444, 1.1918057709352756, 1.1996033231277412, 1.2077631454648128, 1.2162758173571586, 1.225131257022696, 1.2343187408431624, 1.2438269245686977, 1.253643866313443, 1.263757051278013, 1.2741534181282588, 1.284819386953266, 1.2957408887192055, 1.306903396130102, 1.3182919558009085, 1.3298912216432877, 1.3416854893596766, 1.3536587319370499, 1.3657946360277913, 1.3780766391019017, 1.3904879672516013, 1.4030116735272022, 1.4156306766809468, 1.4283278001944868, 1.4410858114642167, 1.4538874610188357, 1.4667155216434227, 1.479552827284894, 1.4923823116150778, 1.5051870461292605 ], [ 1.1324129979126687, 1.1317489535694945, 1.1314731734756434, 1.1315910187284948, 1.1321072416856026, 1.13302596633699, 1.1343506700727035, 1.136084166925275, 1.1382285923630322, 1.1407853897054914, 1.143755298227335, 1.1471383430121336, 1.150933826611592, 1.1551403225600532, 1.159755670788095, 1.1647769749723873, 1.170200601852625, 1.176022182539215, 1.1822366158286917, 1.188838073536269, 1.1958200078480947, 1.2031751606879877, 1.2108955750862662, 1.2189726085307515, 1.227396948272486, 1.2361586285515533, 1.245247049700904, 1.2546509990788606, 1.2643586737742334, 1.27435770502076, 1.2846351842513035, 1.2951776907155785, 1.3059713205793702, 1.3170017174171211, 1.3282541040046478, 1.3397133153134044, 1.3513638326032538, 1.3631898185062163, 1.375175152990073, 1.387303470087187, 1.3995581952709593, 1.411922583360119, 1.4243797568288357, 1.4369127443995786, 1.449504519794377, 1.462138040520022, 1.474796286562756, 1.487462298868669, 1.500119217487169, 1.512750319256623 ], [ 1.1441254677979247, 1.1435129303621732, 1.1432827739186562, 1.1434402738862959, 1.1439901053846204, 1.1449363238260866, 1.1462823468837708, 1.1480309379137545, 1.1501841909072665, 1.152743517043179, 1.1557096329068735, 1.1590825504360893, 1.1628615686491752, 1.1670452672050888, 1.171631501838777, 1.1766174017088749, 1.1819993686884764, 1.1877730786226328, 1.1939334845695653, 1.2004748220353036, 1.207390616204315, 1.2146736911614402, 1.2223161810930028, 1.2303095434476206, 1.238644574030011, 1.247311423993509, 1.2562996186901252, 1.2655980783295133, 1.2751951403915445, 1.2850785837302243, 1.295235654300248, 1.305653092431032, 1.3163171615672082, 1.3272136783886055, 1.3383280442177015, 1.3496452776169985, 1.3611500480746535, 1.3728267106721252, 1.384659341623847, 1.3966317745757242, 1.4087276375462046, 1.4209303903913235, 1.4332233626732256, 1.4455897918102991, 1.4580128613858594, 1.4704757394924752, 1.4829616169884239, 1.4954537455441843, 1.507935475357177, 1.5203902924153614 ], [ 1.1559505467997004, 1.1553905317944115, 1.155206947168311, 1.1554049803382536, 1.1559892269517076, 1.1569636717057366, 1.1583316705216118, 1.1600959341535888, 1.1622585133060692, 1.1648207853293242, 1.1677834425589368, 1.171146482359348, 1.1749091989262141, 1.1790701768968361, 1.1836272868117468, 1.1885776824644847, 1.19391780016984, 1.1996433599746286, 1.2057493688275602, 1.2122301257184651, 1.2190792287893992, 1.226289584413278, 1.2338534182284446, 1.2417622881099442, 1.25000709905152, 1.2585781199245805, 1.2674650020735885, 1.2766567997002403, 1.2861419919817008, 1.2959085068616991, 1.3059437464466839, 1.3162346139329109, 1.3267675419845215, 1.3375285224768085, 1.3485031375136836, 1.35967659162325, 1.371033745030844, 1.382559147904641, 1.3942370754653108, 1.4060515638475555, 1.4179864465989118, 1.4300253916983328, 1.442151938975663, 1.4543495378111921, 1.4666015849939058, 1.4788914626165957, 1.4912025758858727, 1.5035183907260445, 1.5158224710566317, 1.528098515625116 ], [ 1.167876641228598, 1.1673700936825198, 1.1672339639523541, 1.1674733492346174, 1.1680927635685603, 1.1690961188884048, 1.170486707411326, 1.1722671854388065, 1.1744395586449679, 1.1770051689212717, 1.179964682842261, 1.1833180818120346, 1.1870646539458476, 1.1912029877356642, 1.195730967542451, 1.2006457709519942, 1.2059438680244805, 1.2116210224617414, 1.217672294708821, 1.2240920470002326, 1.2308739503536634, 1.2380109935070276, 1.2454954937876046, 1.2533191098946528, 1.261472856569797, 1.2699471211223001, 1.2787316817692416, 1.2878157277436586, 1.2971878811169733, 1.3068362202751866, 1.3167483049821216, 1.3269112029566175, 1.3373115178848096, 1.3479354187827597, 1.3587686706197384, 1.3697966661072587, 1.3810044585544006, 1.3923767956860325, 1.403898154316432, 1.4155527757678341, 1.427324701920326, 1.4391978117772681, 1.4511558584284978, 1.4631825062920583, 1.4752613685143956, 1.487376044408454, 1.4995101568092721, 1.5116473892271678, 1.523771522679761, 1.5358664720855624 ], [ 1.1798921340826174, 1.1794399271200338, 1.1793520688691015, 1.1796335641953701, 1.180288843494104, 1.1813217439820378, 1.1827354923048814, 1.1845326885373588, 1.1867152916484975, 1.1892846065010272, 1.192241272448752, 1.195585253591252, 1.1993158307396123, 1.203431595141746, 1.2079304440097156, 1.2128095778856367, 1.2180654998762588, 1.2236940167799233, 1.2296902421228961, 1.2360486011151064, 1.2427628375286364, 1.2498260224948745, 1.2572305652095994, 1.2649682255277543, 1.2730301284226968, 1.2814067802777513, 1.2900880869706857, 1.299063373704997, 1.308321406535086, 1.3178504155257562, 1.3276381194803548, 1.337671752165359, 1.3479380899536502, 1.3584234808031075, 1.3691138744816544, 1.37999485394542, 1.3910516677716307, 1.4022692635442613, 1.4136323220862501, 1.425125292429127, 1.4367324274080024, 1.4484378197673238, 1.4602254386611584, 1.4720791664301214, 1.4839828355363538, 1.4959202655372337, 1.5078752999790228, 1.5198318430916316, 1.5317738961672922, 1.5436855935071592 ], [ 1.1919854038218378, 1.191588337398953, 1.1915494994470763, 1.1918738005001068, 1.1925655853761052, 1.1936286147147108, 1.1950660478100879, 1.1968804268153919, 1.1990736623907223, 1.2016470208626093, 1.2046011129583905, 1.2079358841740362, 1.211650606828903, 1.2157438738552848, 1.2202135943650612, 1.2250569910296178, 1.2302705993029848, 1.2358502685119357, 1.2417911648298103, 1.2480877761445073, 1.2547339188237838, 1.261722746374431, 1.2690467599846218, 1.2766978209318103, 1.284667164831481, 1.2929454176950828, 1.301522613758513, 1.3103882150358581, 1.3195311325461274, 1.3289397491545911, 1.3386019439636831, 1.3485051181826426, 1.3586362223990007, 1.368981785169739, 1.3795279428446356, 1.3902604705294141, 1.4011648140918758, 1.412226123110174, 1.4234292846585348, 1.4347589578226048, 1.4461996088336928, 1.4577355467089168, 1.4693509592822274, 1.481029949510062, 1.492756571934242, 1.5045148691844836, 1.5162889084028075, 1.5280628174726976, 1.539820820937014, 1.5515472754900295 ], [ 1.2041448430069124, 1.203803642796989, 1.203814505073153, 1.204182244148798, 1.204911117436254, 1.2060048072355176, 1.2074664037984923, 1.2092983897432705, 1.2115026258902917, 1.2140803385871244, 1.217032108584896, 1.2203578615241868, 1.2240568600833919, 1.228127697836968, 1.2325682948654832, 1.2373758951534448, 1.2425470658046125, 1.2480776980983759, 1.2539630104041366, 1.26019755296397, 1.2667752145471116, 1.273689230972861, 1.2809321954917905, 1.2884960710077773, 1.2963722041169967, 1.3045513409324407, 1.3130236446564458, 1.3217787148561773, 1.3308056083911641, 1.3400928619349972, 1.3496285160273773, 1.3594001405865206, 1.369394861806407, 1.3795993903575998, 1.39000005080543, 1.4005828121545836, 1.4113333194243332, 1.4222369261551067, 1.4332787277429553, 1.4444435954955268, 1.455716211300318, 1.4670811027934794, 1.4785226789158046, 1.4900252657408704, 1.5015731424596135, 1.5131505774050162, 1.524741864000584, 1.5363313565170915, 1.54790350552269, 1.559442892913249 ], [ 1.2163588767597229, 1.2160741931889203, 1.2161353657467209, 1.2165471107508021, 1.217313596485651, 1.218438425248179, 1.2199246166484408, 1.221774592239354, 1.2239901615459794, 1.2265725095608597, 1.2295221857672467, 1.2328390947478647, 1.2365224884313024, 1.2405709600232886, 1.2449824396641818, 1.2497541918484494, 1.2548828146356683, 1.2603642406764293, 1.2661937400701408, 1.2723659250649597, 1.2788747566036798, 1.285713552712386, 1.2928749987218962, 1.3003511593052846, 1.3081334923077539, 1.3162128643383948, 1.324579568086527, 1.3332233413188752, 1.3421333875069892, 1.3512983980282527, 1.3607065758775334, 1.3703456608205757, 1.3802029559146238, 1.390265355316299, 1.4005193732917167, 1.4109511743389647, 1.421546604328927, 1.4322912225659572, 1.4431703346668028, 1.454169026152564, 1.4652721966459294, 1.4764645945634944, 1.4877308521911299, 1.4990555210290188, 1.5104231072918957, 1.5218181074497898, 1.533225043694356, 1.5446284992166446, 1.556013153182903, 1.5673638152966065 ], [ 1.2286159810053479, 1.2283883884407494, 1.2285004106182689, 1.2289566641999452, 1.2297612267284073, 1.2309176189346294, 1.2324287882803402, 1.2342970938081124, 1.2365242923689166, 1.2391115262926529, 1.242059312563038, 1.2453675335536687, 1.2490354293768424, 1.2530615918919488, 1.2574439604143843, 1.262179819160367, 1.2672657964570202, 1.272697865741024, 1.2784713483626424, 1.284580918205604, 1.2910206081266267, 1.2977838182117334, 1.3048633258396123, 1.3122512975358538, 1.3199393025947024, 1.327918328438511, 1.3361787976782629, 1.3447105868321003, 1.3535030466522529, 1.362545024004405, 1.3718248852377033, 1.381330540977497, 1.3910494722673805, 1.4009687579817602, 1.4110751034251774, 1.4213548700297969, 1.4317941060582366, 1.4423785782148766, 1.4530938040651096, 1.4639250851590573, 1.4748575407532023, 1.4858761420214, 1.4969657466445845, 1.5081111336673256, 1.5192970385082845, 1.5305081880112725, 1.541729335423584, 1.5529452951887701, 1.564140977441975, 1.5753014220974064 ], [ 1.2409047004554536, 1.2407346965462773, 1.240898036271696, 1.241399235094742, 1.242242278311687, 1.243430603626902, 1.2449670849418153, 1.2468540174302234, 1.2490931039687647, 1.2516854429873818, 1.2546315178002927, 1.2579311874736676, 1.2615836792811645, 1.265587582793421, 1.269940845642136, 1.2746407709938605, 1.2796840167625378, 1.2850665965839847, 1.29078388256906, 1.2968306098460154, 1.3032008828959711, 1.3098881836788425, 1.3168853815404205, 1.3241847448845612, 1.3317779545879265, 1.3396561191277927, 1.3478097913871598, 1.356228987094664, 1.3649032048506005, 1.3738214476840798, 1.3829722460803304, 1.3923436824114066, 1.4019234166979413, 1.4116987136244117, 1.4216564707252075, 1.431783247654488, 1.4420652964479868, 1.4524885926815496, 1.4630388674272137, 1.4737016399046614, 1.4844622507231664, 1.4953058956067824, 1.5062176594937677, 1.5171825508997525, 1.528185536433324, 1.5392115753521245, 1.5502456540476945, 1.5612728203477027, 1.5722782175250778, 1.5832471179050878 ], [ 1.2532136662939761, 1.2531016714667476, 1.2533167247104462, 1.25386323886342, 1.2547451055818644, 1.2559656781863222, 1.2575277557018396, 1.2594335681630817, 1.2616847632522232, 1.2642823943336758, 1.2672269099454803, 1.2705181448028149, 1.2741553123641802, 1.2781369990058726, 1.282461159844979, 1.2871251162456063, 1.2921255550371438, 1.29745852946766, 1.3031194619090216, 1.3091031483242883, 1.3154037645014574, 1.3220148740510527, 1.3289294381585692, 1.3361398270761986, 1.3436378333315986, 1.3514146866249626, 1.3594610703791519, 1.3677671399012459, 1.3763225421075294, 1.3851164367579534, 1.394137519139935, 1.403374044135958, 1.4128138516035824, 1.422444392991619, 1.4322527591109706, 1.4422257089743076, 1.4523496996143286, 1.4626109167864996, 1.4729953064586108, 1.4834886069865707, 1.4940763818727854, 1.504744053001538, 1.515476934243829, 1.526260265322705, 1.537079245829233, 1.5479190692788438, 1.5587649570976423, 1.5696021924288779, 1.5804161536506496, 1.5911923474971204 ], [ 1.2655316135274794, 1.2654779706353567, 1.265745061008927, 1.2663371935548906, 1.2672581650073356, 1.2685112430503045, 1.2700991506134884, 1.2720240514114127, 1.2742875367929904, 1.2768906139647305, 1.2798336956466105, 1.283116591215393, 1.2867384993853141, 1.2906980024713033, 1.2949930622743855, 1.299621017623755, 1.3045785836040216, 1.3098618524904497, 1.3154662964088437, 1.3213867717305572, 1.327617525206792, 1.3341522018399294, 1.3409838544831523, 1.3481049551531934, 1.3555074080343896, 1.3631825641459996, 1.3711212376380002, 1.3793137236746051, 1.3877498178583343, 1.3964188371414328, 1.4053096421657443, 1.4144106609662284, 1.4237099139681233, 1.433195040202542, 1.4428533246602477, 1.4526717266992533, 1.4626369094169878, 1.4727352698947314, 1.4829529702177595, 1.4932759691722302, 1.503690054516669, 1.5141808757238389, 1.5247339770871864, 1.5353348310842159, 1.545968871888627, 1.5566215289223968, 1.5672782603390152, 1.5779245863294313, 1.5885461221434003, 1.5991286107199727 ], [ 1.2778473979633045, 1.2778523720894375, 1.2781717505917838, 1.2788097372577294, 1.2797700327298043, 1.2810558179083371, 1.282669738506728, 1.2846138908287656, 1.2868898088338607, 1.2894984525526443, 1.29244019791123, 1.2957148280180972, 1.2993215259630155, 1.3032588691724993, 1.3075248253611378, 1.31211675011275, 1.3170313861197, 1.3222648641029824, 1.3278127054295696, 1.333669826437578, 1.3398305444734488, 1.3462885856390994, 1.3530370942406016, 1.3600686439234841, 1.3673752504735177, 1.3749483862552372, 1.382778996254274, 1.3908575156833538, 1.39917388910566, 1.4077175910232471, 1.4164776478725243, 1.4254426613631976, 1.4346008330916173, 1.4439399903545787, 1.4534476130847203, 1.4631108618240105, 1.472916606648115, 1.4828514569500024, 1.4929017919882854, 1.5030537921023484, 1.5132934704938845, 1.5236067054721067, 1.5339792730582025, 1.5443968798431973, 1.554845195992328, 1.5653098882888985, 1.5757766531101804, 1.586231249228591, 1.5966595303322062, 1.6070474771599197 ], [ 1.2901500127804142, 1.2902137911948244, 1.2905856361048316, 1.2912696451107635, 1.2922694217072546, 1.293588058969831, 1.2952281243735402, 1.2971916458121315, 1.299480098882782, 1.302094395497771, 1.3050348738807818, 1.308301290000959, 1.3118928104935812, 1.3158080071111704, 1.320044852744023, 1.3246007190436178, 1.3294723756770597, 1.334655991234807, 1.3401471358082542, 1.345940785247512, 1.352031327103819, 1.358412568254613, 1.3650777442031294, 1.372019530037993, 1.37923005303208, 1.3867009068534815, 1.394423167355297, 1.4023874099048022, 1.410583728206514, 1.4190017545677291, 1.4276306815495756, 1.436459284940915, 1.4454759479872932, 1.4546686868020546, 1.4640251768820245, 1.4735327806457221, 1.4831785759079574, 1.4929493852008584, 1.5028318058481098, 1.5128122406959599, 1.5228769294021478, 1.5330119801815734, 1.5432034019057348, 1.5534371364517436, 1.5636990911955722, 1.573975171544017, 1.5842513133995264, 1.5945135154527015, 1.6047478711979188, 1.6149406005691 ], [ 1.3024286046588063, 1.3025512969277933, 1.3029757138430378, 1.3037058458701536, 1.304745198413103, 1.3060967757881201, 1.3077630663093134, 1.3097460285531455, 1.3120470788661123, 1.3146670801760705, 1.317606332163956, 1.3208645628484668, 1.324440921631748, 1.328333973849476, 1.332541696863682, 1.3370614777315304, 1.3418901124777691, 1.3470238069929281, 1.3524581795737318, 1.3581882651160149, 1.3642085209646913, 1.3705128344188127, 1.3770945318840704, 1.3839463896583821, 1.3910606463303468, 1.3984290167639657, 1.4060427076369408, 1.4138924344938233, 1.421968440269415, 1.4302605152317707, 1.438758018288925, 1.4474498995975835, 1.456324724407315, 1.4653706980683188, 1.4745756921265478, 1.4839272714254372, 1.4934127221294502, 1.5030190805808723, 1.5127331628980927, 1.5225415952204795, 1.5324308445024029, 1.5423872497568687, 1.5523970536472897, 1.5624464343247564, 1.5725215374071864, 1.5826085079960979, 1.5926935226271215, 1.6027628210502387, 1.6128027377370568, 1.6227997330132526 ], [ 1.3146724894352224, 1.3148541276820254, 1.3153311497022826, 1.31610743799941, 1.3171863990576094, 1.3185709476063516, 1.3202634919760228, 1.3222659206110716, 1.3245795898038952, 1.3272053127089702, 1.3301433496933124, 1.3333934000749084, 1.3369545952966184, 1.3408254935782817, 1.3450040760848858, 1.3494877446436242, 1.3542733210371525, 1.3593570478950479, 1.3647345911995605, 1.3704010444162065, 1.376350934253432, 1.3825782280500054, 1.3890763427822395, 1.395838155677404, 1.4028560164133752, 1.4101217608784917, 1.4176267264595597, 1.4253617688200062, 1.433317280124284, 1.44148320865895, 1.4498490797953383, 1.4584040182331923, 1.4671367714598915, 1.4760357343544945, 1.4850889748617595, 1.4942842606565145, 1.5036090867151042, 1.5130507037066894, 1.5225961471140952, 1.5322322669908084, 1.5419457582582332, 1.5517231914451746, 1.5615510437696585, 1.5714157304620107, 1.5813036362271928, 1.5912011467437601, 1.6010946800969512, 1.6109707180437272, 1.620815837008371, 1.6306167387085337 ] ], "zauto": true, "zmax": 1.6306167387085337, "zmin": -1.6306167387085337 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.054416055362998615, 0.05188581771737505, 0.04943537825986525, 0.04706681967439786, 0.044782039274956616, 0.042582733587683025, 0.040470380632333984, 0.03844621963295801, 0.036511227988390106, 0.03466609550220645, 0.03291119612629963, 0.031246557827804496, 0.029671831654522286, 0.028186261645425023, 0.026788657885907566, 0.025477375694747808, 0.02425030457252076, 0.023104871037517263, 0.022038059711440728, 0.021046456888085673, 0.020126320260081106, 0.019273677493040615, 0.01848445500455519, 0.01775463677592497, 0.017080451467605957, 0.016458584642275256, 0.01588641149963826, 0.015362243952003144, 0.014885583616667523, 0.014457368646528053, 0.014080196488458666, 0.013758496226653295, 0.013498613785885023, 0.01330876369928293, 0.013198798181748295, 0.0131797563702437, 0.013263191570184034, 0.013460332100530206, 0.013781196364782675, 0.014233824745120955, 0.014823780175584689, 0.015554000372726855, 0.01642498650507633, 0.017435231229027535, 0.018581755018684264, 0.019860634348851266, 0.02126744698934079, 0.022797603945026314, 0.024446569864543792, 0.026209990805998794 ], [ 0.0532178270103094, 0.05067839714225175, 0.0482197224516198, 0.04584397601838088, 0.04355315715482024, 0.04134907702996583, 0.03923334176513236, 0.03720733258681201, 0.035272182690421684, 0.033428750608946074, 0.031677590116629295, 0.030018917058100367, 0.02845257399529184, 0.026977994219782035, 0.025594167471276477, 0.024299610587647878, 0.023092347199808256, 0.021969901343287416, 0.020929310324486944, 0.01996716218618589, 0.01907966253497189, 0.01826273427987388, 0.017512152061470155, 0.01682371101429209, 0.01619342725687354, 0.015617765363365184, 0.015093886103277736, 0.014619905749226017, 0.014195155756951638, 0.013820427911659853, 0.013498184433788323, 0.013232704896353047, 0.01303013326143516, 0.012898382218402532, 0.012846854245025636, 0.01288595678471373, 0.01302642732326959, 0.013278538451223862, 0.013651305053764815, 0.014151838551011998, 0.01478496698599535, 0.015553169711706217, 0.016456792031464808, 0.01749444498204435, 0.018663477756709835, 0.019960429604508244, 0.021381404859830543, 0.022922350425211867, 0.024579239788034835, 0.026348180191078065 ], [ 0.05211192519543153, 0.04956469038106745, 0.047099136097593634, 0.044717521756332305, 0.042421944634899574, 0.04021432672560824, 0.038096398873096654, 0.036069681638743, 0.03413546235501885, 0.03229476793171414, 0.03054833318005341, 0.028896564767511252, 0.02733950144145476, 0.025876771890476748, 0.02450755255096818, 0.0232305287752602, 0.022043863960383474, 0.02094518233095827, 0.019931571850286208, 0.018999613950161, 0.018145446199744997, 0.01736486256366271, 0.016653453586206464, 0.016006785928434186, 0.015420617557004659, 0.014891141918499917, 0.01441525184033548, 0.01399081157598811, 0.013616922899604707, 0.013294167758668417, 0.013024805116727647, 0.012812893321075125, 0.012664303080292946, 0.012586583484387567, 0.01258865003484809, 0.012680285193537135, 0.012871480350047992, 0.013171696002464272, 0.013589156167016885, 0.014130301571695517, 0.014799492714680545, 0.015598988843147152, 0.01652916044351373, 0.01758884877434244, 0.018775777521393838, 0.020086941227386818, 0.021518926349926325, 0.023068149555549103, 0.024731017368779553, 0.0265040210653661 ], [ 0.05109959291796982, 0.048546041904198395, 0.04607507601503718, 0.04368903717695866, 0.041390116594497116, 0.03918034292865329, 0.03706156762004111, 0.03503544664280381, 0.03310341795143166, 0.03126667392861839, 0.029526128299168765, 0.027882377292465094, 0.026335655368352667, 0.02488578661945784, 0.023532134051481017, 0.022273550303393008, 0.021108334902703512, 0.02003420466250598, 0.019048285019091754, 0.018147130617365052, 0.017326782928522404, 0.01658287091137893, 0.01591075773451778, 0.015305732686496265, 0.014763243179101687, 0.014279157811404994, 0.013850048232994804, 0.013473475041087842, 0.01314826072712994, 0.01287473002365798, 0.012654894291674533, 0.012492551984061856, 0.012393273322642328, 0.012364237634447021, 0.012413901260894098, 0.01255149688191232, 0.012786401239164774, 0.013127448995016557, 0.013582299181993197, 0.014156960261201688, 0.014855544510518426, 0.015680264641490364, 0.01663162941223667, 0.01770876165171, 0.01890975815726746, 0.020232028745616564, 0.021672577918226427, 0.023228216246733675, 0.02489570461151948, 0.026671842581058758 ], [ 0.05018169526042286, 0.04762339785321013, 0.04514857976949236, 0.0427596620050625, 0.04045892577558068, 0.038248502041156485, 0.03613035805218214, 0.034106280048952074, 0.03217785116717301, 0.030346423585799576, 0.02861308405050553, 0.026978612180066357, 0.025443431489725627, 0.024007553924154875, 0.02267051994048536, 0.02143133782477874, 0.020288427870812465, 0.01923957906739526, 0.018281927642449684, 0.017411967691419304, 0.016625603654600866, 0.015918252247155748, 0.015284997581469615, 0.014720798101370421, 0.014220738403054422, 0.013780313998206763, 0.01339573328130104, 0.01306421853840029, 0.012784286295227007, 0.012555985780163233, 0.012381072049360316, 0.012263087496460144, 0.01220732363234403, 0.012220637471786713, 0.012311107907422635, 0.0124875402004189, 0.012758859677104955, 0.01313347012028265, 0.013618673538405832, 0.014220242695187015, 0.01494220353714614, 0.015786833738156956, 0.016754836495805097, 0.017845621949058397, 0.019057626414429592, 0.020388615185188756, 0.021835936853964674, 0.02339671718661273, 0.025067994368441832, 0.026846804697705673 ], [ 0.049358691904276095, 0.046797272684438875, 0.04432022545913522, 0.04193004721595315, 0.03962910538811862, 0.03741962864060779, 0.03530369455269308, 0.03328321317245708, 0.03135990527770145, 0.02953527409326519, 0.02781056924341293, 0.026186741939626553, 0.02466439091885134, 0.023243699568303067, 0.021924366097242985, 0.020705530582575262, 0.019585705140031127, 0.018562716084096022, 0.017633669238404332, 0.016794950852939337, 0.016042276140623524, 0.015370794741361151, 0.014775257433338069, 0.0142502417813312, 0.01379042734946662, 0.013390904995587814, 0.013047500619174906, 0.012757091772043438, 0.0125178951141729, 0.012329702659850833, 0.012194044145487862, 0.012114251638686357, 0.012095402209667613, 0.01214411820825906, 0.012268216241255127, 0.012476217671266726, 0.012776763268786283, 0.013178004129256236, 0.013687057276735592, 0.014309606837638641, 0.015049699483760151, 0.015909737472049802, 0.016890631662020428, 0.017992053946564352, 0.019212726782556422, 0.020550700970491744, 0.022003592148638864, 0.023568764135779418, 0.025243459664506446, 0.027024885831001478 ], [ 0.04863061773976105, 0.046067724590094394, 0.0435901009576843, 0.04120031696511356, 0.03890082243649412, 0.03669393875268258, 0.034581847450147, 0.03256657437661912, 0.03064996801247735, 0.028833670411258443, 0.02711907917071715, 0.025507299014828882, 0.023999082075118642, 0.022594756959079355, 0.02129414832548735, 0.02009649102857312, 0.019000345867412803, 0.018003527255535674, 0.017103056066343537, 0.01629515259431527, 0.015575284011661217, 0.014938277203106236, 0.01437850144151654, 0.013890116973274488, 0.013467376929468214, 0.013104962956634549, 0.01279833086451961, 0.012544041577298585, 0.012340053769930422, 0.012185956210135837, 0.012083118730291479, 0.012034740769908051, 0.012045777040115519, 0.012122724086033645, 0.012273262888377708, 0.012505773081548387, 0.012828761574693634, 0.013250274412631224, 0.013777374109963448, 0.01441575636579753, 0.0151695499372111, 0.016041302063123326, 0.01703211478164567, 0.01814187662065437, 0.01936953222965185, 0.020713344342058602, 0.022171119788291366, 0.023740387420358184, 0.025418527404317232, 0.027202857910921883 ], [ 0.0479970734463534, 0.045434342057510506, 0.042957785573028595, 0.04057004432409113, 0.03827364635676215, 0.03607100005425867, 0.03396438329437825, 0.03195592778549949, 0.030047596958277488, 0.028241155565762795, 0.026538129038129275, 0.024939750766133625, 0.02344689600976932, 0.022060002239313852, 0.020778977604468844, 0.01960310200597017, 0.018530928828016623, 0.01756019937041126, 0.01668778556948349, 0.01590967853403189, 0.015221039489721871, 0.014616325103406715, 0.01408949100812534, 0.013634267069173289, 0.013244487846699599, 0.012914454208852814, 0.012639298573841527, 0.012415326705728782, 0.01224031187172145, 0.012113720431638294, 0.012036850013450274, 0.01201286213487426, 0.012046692025889915, 0.012144822551812278, 0.012314919961575863, 0.012565348438819603, 0.012904605785744115, 0.013340746488573401, 0.013880870258994487, 0.014530745734362168, 0.015294610499372495, 0.016175149771330017, 0.017173621298650688, 0.01829007416402099, 0.01952360691857577, 0.020872621145079755, 0.022335042638271106, 0.023908497647303167, 0.025590442805020697, 0.02737825389126769 ], [ 0.04745722751381752, 0.044896243474108886, 0.042422346583206136, 0.04003824398152899, 0.037746536997919175, 0.03554971413126575, 0.033450140278687826, 0.031450040676543604, 0.02955147769672476, 0.027756318356894814, 0.026066190248494957, 0.024482423699218044, 0.023005978561546066, 0.021637355293114932, 0.02037649220118654, 0.019222653996302526, 0.0181743210241318, 0.017229093188926577, 0.016383626597740415, 0.01563362287308648, 0.014973889413121576, 0.01439848278178665, 0.013900937351291867, 0.013474569281349916, 0.013112834863420412, 0.01280971493959514, 0.01256009487625294, 0.012360111841564688, 0.012207445803112255, 0.012101535218243966, 0.012043701121454491, 0.012037164123091337, 0.01208693948658936, 0.012199599152123292, 0.012382899774172569, 0.012645294231917346, 0.012995368342770122, 0.01344126735872837, 0.013990188043069368, 0.014648003906618067, 0.015419063676253971, 0.016306165604507712, 0.01731067647896454, 0.01843274465198148, 0.019671553790550928, 0.02102557403912615, 0.022492782744207414, 0.024070841755283498, 0.025757229366228467, 0.02754933153238688 ], [ 0.04700983058595784, 0.04445209099224689, 0.04198235229398554, 0.03960338410881595, 0.0373178548580532, 0.03512832460701089, 0.033037233766578994, 0.031046885940491546, 0.02915942283175448, 0.02737678879572977, 0.025700682451757842, 0.024132492903746826, 0.022673218801997318, 0.021323369980787123, 0.020082853993035096, 0.0189508536661369, 0.017925706637368265, 0.017004802998065324, 0.01618452138490622, 0.015460225370531672, 0.014826339200634486, 0.014276514101314189, 0.01380388447614127, 0.013401399965846111, 0.013062208042591178, 0.012780055424608252, 0.01254967610620578, 0.01236713796667568, 0.012230126057130378, 0.012138145961295782, 0.012092633403077818, 0.012096956669139645, 0.012156298463693288, 0.012277406910906246, 0.01246821509702161, 0.012737346499752562, 0.013093547577520704, 0.01354511143251696, 0.014099367685425931, 0.014762305724969423, 0.015538371368284095, 0.016430439826455815, 0.0174399342214565, 0.01856703922405355, 0.019810956497750973, 0.02117015838823087, 0.02264261163270608, 0.024225957733969707, 0.02591764777888306, 0.027715036163793658 ], [ 0.04665324228685987, 0.0441001189873423, 0.04163590218806738, 0.039263418276592695, 0.036985394878706786, 0.03480445298693692, 0.03272309446310138, 0.030743683021151012, 0.028868416393699938, 0.027099287043721568, 0.02543802862485328, 0.023886045610496346, 0.022444324364682057, 0.02111332572296051, 0.01989286216313673, 0.01878196696666332, 0.017778768103951625, 0.01688038502722608, 0.016082870579297227, 0.01538122090732185, 0.014769472003075382, 0.01424089190792385, 0.013788264245063417, 0.013404244811374207, 0.013081762252177222, 0.012814429019617136, 0.01259693026340898, 0.012425364114202505, 0.012297513866402765, 0.01221303796828277, 0.012173566006272627, 0.012182688481170248, 0.012245827432857275, 0.01236997746412327, 0.012563316078798924, 0.012834700224987847, 0.013193090184369684, 0.013646965093302054, 0.01420380606400386, 0.014869715063732988, 0.015649210320651138, 0.016545201282435987, 0.017559111833798786, 0.01869110034099441, 0.019940322092819977, 0.0213051896474573, 0.022783602266018388, 0.02437313082280032, 0.02607115597150737, 0.02787496417783688 ], [ 0.04638546990187556, 0.04383817646447328, 0.04138067351684308, 0.03901583678582061, 0.036746443194698705, 0.034575161672585966, 0.03250453875964671, 0.030536976951146436, 0.02867470331150303, 0.026919725564757198, 0.025273772774005908, 0.02373821807534078, 0.022313982017505094, 0.02100141719563533, 0.01980017830905536, 0.018709086533534716, 0.01772600272752383, 0.01684772938766112, 0.016069964692755234, 0.015387331453718617, 0.01479349792028631, 0.014281396297896723, 0.013843530620850567, 0.01347235196101357, 0.013160669571724471, 0.01290206365478258, 0.012691268684535725, 0.01252450316654544, 0.012399729016539527, 0.012316828674743452, 0.012277689458717723, 0.012286183280331379, 0.012348028273807475, 0.012470520861431812, 0.012662136086886645, 0.012932012489083102, 0.013289362974290989, 0.01374287740444178, 0.014300195101057208, 0.014967517659305473, 0.015749404160199286, 0.01664875165969832, 0.017666928164543943, 0.018804004474280024, 0.02005902835640574, 0.021430295076596287, 0.02291558474292957, 0.024512352765553913, 0.02621787151083224, 0.028029328220530385 ], [ 0.046204217516743876, 0.04366378180324784, 0.041213982469898006, 0.03885773524180514, 0.036597854291914145, 0.03443704113030181, 0.03237786764624936, 0.0304227511139927, 0.02857391857920811, 0.02683335777455666, 0.025202751731670556, 0.0236833948001673, 0.02227608914957113, 0.020981023324836433, 0.019797638248397205, 0.018724491111294057, 0.017759133250827883, 0.016898023086253555, 0.01613649763986666, 0.015468824236346723, 0.014888346615886587, 0.014387727579327063, 0.013959276013934466, 0.013595333518114094, 0.013288688269945484, 0.013032982793533382, 0.012823086915839516, 0.012655414665074246, 0.012528170839148228, 0.01244151700673116, 0.012397646976043173, 0.01240075933097301, 0.01245691224885628, 0.01257374740079911, 0.012760079225703923, 0.013025365198744417, 0.013379099401270132, 0.013830197626747283, 0.014386455811885496, 0.015054155564093308, 0.015837860646325735, 0.016740406753327074, 0.01776304927595978, 0.018905712069357747, 0.02016727767445431, 0.02154587106527724, 0.023039106616231, 0.024644284725069833, 0.026358536794707847, 0.028178924417062254 ], [ 0.04610694355288893, 0.043574187392198406, 0.04113285699810312, 0.03878589685781342, 0.03653614432534826, 0.034386316043512055, 0.03233898785163981, 0.03039656590503083, 0.02856124638718841, 0.026834961021749534, 0.025219305767143412, 0.023715450850416046, 0.022324031960606845, 0.02104502524583706, 0.01987761285559792, 0.018820050902211692, 0.017869557097791727, 0.017022239546425042, 0.016273089419506195, 0.015616056893331306, 0.015044221213373165, 0.014550053242825193, 0.014125755250967185, 0.013763651653488636, 0.013456598807461993, 0.013198382631365966, 0.012984078317577086, 0.012810353801065507, 0.012675704848061861, 0.01258061251729688, 0.012527612816619413, 0.012521264893049, 0.012568000958504804, 0.012675842458015053, 0.012853976887503378, 0.01311221027788397, 0.013460339092200797, 0.013907513403865352, 0.014461678085396463, 0.015129170231945216, 0.015914518793275705, 0.01682044767647794, 0.01784804339329011, 0.018997025710794965, 0.02026605787620028, 0.021653046168342637, 0.023155397754050913, 0.02477022370605895, 0.026494486864610034, 0.028325101473538776 ], [ 0.04609092414535923, 0.04356645108746785, 0.041134117592202625, 0.0387968840046067, 0.03655759513332527, 0.03441896375857637, 0.032383546984562285, 0.030453713139429774, 0.028631596659848026, 0.026919038351605213, 0.025317508782619506, 0.023828013586121306, 0.022450981398197737, 0.021186138234255938, 0.020032376330585938, 0.01898763046337842, 0.018048779594335786, 0.017211594933105236, 0.016470755477375972, 0.01581994752235752, 0.015252055431878915, 0.014759438696104639, 0.014334277925573412, 0.013968963243459713, 0.013656494778826305, 0.013390866873422573, 0.013167413443226006, 0.012983098819200466, 0.012836743538491945, 0.012729176195406281, 0.012663300330058356, 0.012644060835319553, 0.012678290521297477, 0.01277441857984604, 0.012942033194477178, 0.013191312805911825, 0.013532371855328415, 0.013974597663529143, 0.014526071478898851, 0.015193157401472226, 0.01598030749234807, 0.016890082582976654, 0.017923345010833643, 0.01907955595987428, 0.02035710929174737, 0.021753649034166572, 0.023266338938857198, 0.024892071743939925, 0.02662761918783396, 0.028469731108919597 ], [ 0.046153319538029605, 0.04363751109758074, 0.041214461913441386, 0.03888713403168999, 0.03665836289877896, 0.03453083764780336, 0.0325070736659756, 0.03058937519557609, 0.02877978555833959, 0.027080022700515127, 0.025491398323954213, 0.02401472012870032, 0.022650178871844256, 0.021397225176909722, 0.020254445203408286, 0.019219448911166344, 0.018288788741950123, 0.017457928697903725, 0.016721282580951298, 0.016072334695863884, 0.015503846939490282, 0.015008144688136799, 0.01457746307719226, 0.014204327950087319, 0.01388194355779438, 0.013604561792187352, 0.0133678134618763, 0.013168988192582233, 0.013007253499133892, 0.012883803955779522, 0.012801928099607021, 0.012766975224882491, 0.012786199694873079, 0.01286846134547333, 0.013023771825880293, 0.013262701008087293, 0.013595692035785117, 0.014032367661336208, 0.014580928588503295, 0.015247733989460745, 0.016037114931011058, 0.01695141763181019, 0.017991226582749542, 0.019155693184234723, 0.020442896373708098, 0.021850179680260165, 0.023374432817116993, 0.025012306653181503, 0.026760364387351455, 0.028615178971686802 ], [ 0.046291240632249694, 0.043784260863856395, 0.04137054915594425, 0.03905305440136649, 0.0368345854811033, 0.03471778818501507, 0.032705113976653495, 0.03079877847778694, 0.029000707507618177, 0.027312468782702583, 0.02573518814914604, 0.02426945068346825, 0.02291518933469485, 0.021671567034432408, 0.020536862167211234, 0.01950837138893994, 0.018582347011053, 0.017753987265451614, 0.017017495574715633, 0.0163662189786181, 0.0157928667525844, 0.01528979984893471, 0.014849372644138248, 0.014464302866044962, 0.014128044585193709, 0.013835142247698549, 0.013581549039066432, 0.013364897975083983, 0.013184716875253544, 0.013042577542985353, 0.012942165073314369, 0.012889246766642447, 0.012891514889845006, 0.012958278333294588, 0.013099990397006501, 0.01332762660961689, 0.013651964605807879, 0.014082855937715152, 0.014628599605296846, 0.015295514836664423, 0.016087766207719664, 0.01700743440538848, 0.018054775015800124, 0.019228582737389092, 0.020526581467073785, 0.021945781972693885, 0.02348277534419705, 0.02513395276290414, 0.0268956566117918, 0.0287642749726305 ], [ 0.04650181300348473, 0.04400362074965605, 0.04159908035605503, 0.0392911126408633, 0.03708248308767336, 0.03497577542913499, 0.03297335680039119, 0.03107733253077666, 0.029289488731157526, 0.027611221265438735, 0.026043450634155803, 0.024586523914010807, 0.023240107300779363, 0.022003075959642522, 0.020873411508884002, 0.019848120925759206, 0.018923193019543805, 0.01809360877782741, 0.017353418997358518, 0.016695896486971513, 0.016113761614208674, 0.015599470845407052, 0.015145550397972647, 0.014744952964928027, 0.014391415336837144, 0.014079797917814166, 0.013806391841897612, 0.013569183483928257, 0.013368067754512708, 0.013204999595675504, 0.013084067622518758, 0.01301146644080912, 0.012995338187786105, 0.01304545450394382, 0.013172723373274473, 0.013388534683150325, 0.013704000716013326, 0.014129189921279222, 0.014672474160224288, 0.01534009508954264, 0.01613600486349303, 0.017061969640428807, 0.018117869105200815, 0.01930210000269401, 0.020611997660877207, 0.022044214670967625, 0.023595025497702756, 0.025260549791212596, 0.027036902033686982, 0.028920281814300907 ], [ 0.04678223605412394, 0.04429260381337441, 0.04189687146950271, 0.0395979174157349, 0.03739844800842118, 0.03530096800566757, 0.033307742486112124, 0.031420748567116075, 0.02964161545773289, 0.02797155195643115, 0.026411261579429773, 0.024960847208435805, 0.02361970952778942, 0.022386446476226913, 0.021258764126015812, 0.02023341219602753, 0.0193061589496071, 0.018471819633618866, 0.01772434929386148, 0.01705700482537759, 0.01646257340946343, 0.015933656685526806, 0.015462993934789625, 0.015043804560055421, 0.014670130564800125, 0.014337162766111768, 0.01404153849111586, 0.013781601593336561, 0.013557616132183526, 0.013371922018101792, 0.013229014419817605, 0.013135520320797303, 0.01310003883306496, 0.01313281237535606, 0.013245210220796276, 0.013449038422172184, 0.013755737253014776, 0.014175574189933525, 0.014716964253269864, 0.015386032075031458, 0.016186472474952092, 0.017119691871961547, 0.018185153076952565, 0.019380821078328597, 0.020703617113849944, 0.022149818014367995, 0.023715370765212893, 0.025396117830143478, 0.02718794384709531, 0.02908686042368362 ], [ 0.047129835442879305, 0.04464837354235445, 0.042260916807834864, 0.03997028801509333, 0.037779120401980545, 0.035689825294900064, 0.033704551315928484, 0.03182513378244789, 0.03005303324278189, 0.02838926278335279, 0.026834304909642653, 0.02538802052821708, 0.024049554836650076, 0.02281724760635838, 0.02168855805198891, 0.020660016626837068, 0.01972721692766523, 0.01888485974314823, 0.018126857778949835, 0.017446503976796555, 0.016836699545505086, 0.0162902312724741, 0.015800082867873398, 0.01535976299844869, 0.014963633405613309, 0.014607223257043929, 0.014287519178472183, 0.014003222556400359, 0.01375496520835006, 0.01354547048085219, 0.013379639321500436, 0.013264531446942476, 0.01320920410890871, 0.013224371289319938, 0.01332186184124205, 0.01351389099789579, 0.013812212031741095, 0.01422726683925522, 0.014767479864324487, 0.015438818695388025, 0.016244678985087684, 0.01718606846058973, 0.01826200056843332, 0.01946998429749559, 0.020806510861518652, 0.02226747258924677, 0.023848485782101955, 0.025545116354451586, 0.02735302212298311, 0.029268031009319594 ], [ 0.04754210746194735, 0.04506829208822874, 0.04268844125451199, 0.04040531057453103, 0.03822144841167285, 0.03613916113437987, 0.03416047023330996, 0.03228706022801517, 0.030520216719935524, 0.028860754725874797, 0.02730893863694506, 0.025864396835815536, 0.024526036122155193, 0.023291963452469682, 0.02215942472700053, 0.021124771915882724, 0.020183470095794877, 0.019330154455437943, 0.018558743842538295, 0.017862612302714777, 0.017234814180207933, 0.016668352933785376, 0.016156480045113324, 0.015693008968854033, 0.015272629958212993, 0.014891214004442457, 0.014546096728798493, 0.014236334343757076, 0.013962922395588441, 0.013728963036501604, 0.013539758083833058, 0.013402794679105287, 0.013327581881372364, 0.01332529670580243, 0.013408215205465932, 0.013588943755616296, 0.013879523611402449, 0.014290539079565935, 0.014830386872364132, 0.015504838785916174, 0.01631695524891069, 0.017267315627054535, 0.018354462833242907, 0.019575437469301085, 0.020926295977050608, 0.022402547200015586, 0.023999481552082248, 0.02571239526573972, 0.027536726996919808, 0.02946812858302716 ], [ 0.04801675456653373, 0.045549958196396435, 0.04317694047707127, 0.040900380329962946, 0.03872273205796677, 0.03664618874205487, 0.03467263793967257, 0.032803608933919426, 0.03104021128678498, 0.029383065278674812, 0.02783222602817182, 0.026387104688746037, 0.025046392033185098, 0.023807991755223756, 0.02266897259007414, 0.021625549413658775, 0.02067310333261767, 0.019806249063829065, 0.01901895457241556, 0.01830471337125641, 0.01765676487798767, 0.01706835379413712, 0.016533016534994924, 0.016044881791392494, 0.015598973217601739, 0.015191504264644435, 0.01482015712425091, 0.014484338244560642, 0.014185400649627328, 0.013926817473227044, 0.013714281694887826, 0.013555695631506886, 0.01346100443361822, 0.013441827919429354, 0.013510863678895086, 0.013681077744887919, 0.013964762691974041, 0.014372605456765183, 0.0149129355499761, 0.015591293908277551, 0.016410378672397297, 0.01737032383946364, 0.018469194924875837, 0.019703565866008705, 0.02106906620288101, 0.022560832762399115, 0.024173842992157673, 0.025903136280536445, 0.02774394393530678, 0.029691752026178284 ], [ 0.0485517117543165, 0.04609123461039131, 0.04372420904932687, 0.04145323001690114, 0.03928065131068257, 0.03720854766438285, 0.03523866970326173, 0.03337239133057308, 0.03161064966056429, 0.029953878462897217, 0.02840193725913926, 0.02695403969550664, 0.02560868650639598, 0.024363610071618812, 0.02321573893656178, 0.022161191314158554, 0.021195306139201595, 0.020312718460412802, 0.01950748287094631, 0.018773244680466157, 0.01810345431836183, 0.017491616860816146, 0.016931566302378073, 0.016417753581105133, 0.015945538229463013, 0.015511475165604449, 0.015113589485114917, 0.01475163190645263, 0.014427304553659955, 0.014144440155224706, 0.013909107456937249, 0.013729603305783353, 0.01361628183752438, 0.013581171314986998, 0.013637349373898353, 0.013798094594432427, 0.0140759013087007, 0.014481511659100752, 0.015023147802096409, 0.015706091275402432, 0.01653266331247914, 0.017502551572237495, 0.01861335438734644, 0.019861196781179865, 0.021241302938656625, 0.02274845994080037, 0.02437735316411164, 0.026122783503968613, 0.027979790274708934, 0.029943706151681904 ], [ 0.04914516391483791, 0.04669026522145928, 0.04432835695949572, 0.042061945165993916, 0.03989327945188493, 0.037824314321872665, 0.03585666403048243, 0.03399155082242529, 0.032229746989663625, 0.030571512019888367, 0.02901652722316594, 0.027563831566842032, 0.026211763911460413, 0.024957918222167426, 0.023799119348793484, 0.02273142729946308, 0.02175017728997791, 0.0208500610882856, 0.020025252381005425, 0.019269575437076882, 0.01857671282858545, 0.017940445063340103, 0.017354913228710946, 0.01681489535868108, 0.016316088000039503, 0.01585538572399839, 0.015431152128874878, 0.015043475044026287, 0.01469439501514113, 0.014388088851490198, 0.014130978987251873, 0.013931726316765652, 0.013801053617694499, 0.01375134701677411, 0.013796004848803042, 0.013948553995852772, 0.014221627575428188, 0.014625968667171228, 0.015169653320038466, 0.015857684621171812, 0.01669200793088362, 0.017671882488435976, 0.018794468842454073, 0.02005547812723118, 0.021449764880511996, 0.022971799431737494, 0.024616003524771835, 0.026376962817122963, 0.02824954286018124, 0.030228936715900937 ], [ 0.049795554606355694, 0.04734548261095582, 0.044987815394742274, 0.04272496749126181, 0.04055908330449037, 0.03849199818658912, 0.0365251937788873, 0.03465974772139427, 0.03289627842868492, 0.0312348864435048, 0.029675094908948214, 0.028215792893854796, 0.026855186549649735, 0.025590764185415425, 0.02441928207950386, 0.023336777940736974, 0.022338618179795305, 0.021419583473460995, 0.020573994620862908, 0.01979587774083752, 0.019079164944439495, 0.01841792427483478, 0.01780661134688476, 0.017240334870916453, 0.016715128877904557, 0.01622822537881625, 0.015778321493483485, 0.015365833688315182, 0.014993127552019769, 0.014664703650954906, 0.014387308389613497, 0.014169925193587403, 0.014023590565786406, 0.013960980404203639, 0.01399573557759836, 0.014141549581428757, 0.014411118544050996, 0.014815126947433322, 0.01536146969269288, 0.01605486443500505, 0.01689689968161018, 0.017886444765629388, 0.019020271977681143, 0.020293731115927062, 0.02170135669147308, 0.023237345456779714, 0.024895890836268007, 0.02667139072923409, 0.02855855740367467, 0.030552458950877312 ], [ 0.05050158696689295, 0.04805560689846467, 0.04570133296723638, 0.04344108783973105, 0.04127691215489581, 0.039210525836653305, 0.037243284427740615, 0.035376130771192484, 0.03360954295014666, 0.0319434801654273, 0.030377329166377694, 0.028909854894925494, 0.027539160044154017, 0.02626265910586475, 0.025077072983258696, 0.023978450170923735, 0.022962219705429766, 0.022023279534355684, 0.021156121771957238, 0.02035499380667145, 0.019614091816168747, 0.018927781356090065, 0.018290838624445114, 0.0176987058308991, 0.017147754580703778, 0.016635551761004272, 0.01616112226784721, 0.015725201017501713, 0.01533046198080107, 0.014981703635004237, 0.014685958235390038, 0.014452478504149604, 0.014292544743292558, 0.014219037034676538, 0.014245742457088647, 0.014386423378257171, 0.014653752383567474, 0.015058292894275477, 0.015607729528908222, 0.016306501209630533, 0.017155877378222547, 0.018154396532271622, 0.01929851170612704, 0.020583280457437528, 0.02200297973332839, 0.02355158507392862, 0.025223102943444254, 0.02701177453899703, 0.028912181090924135, 0.030919280876904858 ], [ 0.05126221763317232, 0.04881963697379935, 0.04646796370066775, 0.04420943030095996, 0.04204597728588527, 0.0399792151570237, 0.038010382156015925, 0.036140298307447666, 0.034369316828106566, 0.03269727468924117, 0.031123444957073598, 0.029646494438656253, 0.028264451021025996, 0.026974685767195136, 0.02577391515538903, 0.02465822866026937, 0.023623146074066546, 0.022663707551308403, 0.02177459746585136, 0.020950301054786714, 0.020185290832915537, 0.01947423822906082, 0.018812245045780714, 0.018195089196230627, 0.01761947948510548, 0.0170833144579861, 0.01658593978117196, 0.016128396281745665, 0.015713645672427144, 0.01534675234335953, 0.015034987497877286, 0.014787808298064059, 0.01461665473360836, 0.014534509736078569, 0.014555194810007385, 0.014692430796325035, 0.014958772931353217, 0.01536460109990904, 0.015917368059023388, 0.01662125446872411, 0.01747726595785786, 0.018483687618587975, 0.01963673920422463, 0.02093126933696433, 0.022361370808630158, 0.023920858122639506, 0.025603597283728012, 0.027403706892250516, 0.029315660896514443, 0.031334323354118475 ], [ 0.05207664463699443, 0.04963683527278963, 0.04728704815430881, 0.04502942909652948, 0.04286582400625443, 0.040797741856657, 0.03882631418944189, 0.03695225180139421, 0.03517579980503143, 0.03349669290575349, 0.03191411347997868, 0.030426655809120226, 0.029032300528044945, 0.027728403860209336, 0.0265117063989316, 0.02537836593520222, 0.024324018059045098, 0.02334386699332377, 0.0224328074814306, 0.021585576767569364, 0.020796934058248274, 0.02006186359799107, 0.019375796790589903, 0.01873484863435688, 0.01813606387547035, 0.017577668235889056, 0.01705931913568149, 0.016582347623152142, 0.01614997782931412, 0.015767501508649348, 0.015442373315065237, 0.01518417947586613, 0.015004423693557244, 0.01491607834617838, 0.014932876955788578, 0.015068381123612213, 0.015334932487624622, 0.01574266805771405, 0.016298795442940172, 0.017007269550732344, 0.017868901342355754, 0.018881813873601463, 0.020042092236594863, 0.021344470019281914, 0.022782937569609106, 0.02435121464335981, 0.02604307750442367, 0.0278525589471708, 0.029774050904355153, 0.03180233945763249 ], [ 0.05294429028688632, 0.05050670727394674, 0.04815818904880521, 0.04590079981646352, 0.0437362979579527, 0.04166610030119619, 0.0396912436295699, 0.03781234419764434, 0.03602955652049039, 0.03434253329284699, 0.03275038894462123, 0.03125166999148927, 0.029844335909269083, 0.02852575464378075, 0.027292716954849885, 0.026141473493829656, 0.025067797785723146, 0.02406707716030102, 0.023134432265873386, 0.02226486429379158, 0.021453427664642925, 0.020695424880108705, 0.0199866196372785, 0.01932346409258642, 0.018703336114334883, 0.01812478202779646, 0.017587759086227648, 0.017093868893219562, 0.016646567437275352, 0.016251328742860265, 0.01591572774621755, 0.015649396077007844, 0.015463797142841303, 0.015371772748291835, 0.01538684202316909, 0.015522289082818575, 0.01579014880833779, 0.016200262080064608, 0.016759586001186, 0.017471890814644408, 0.018337870317053095, 0.019355584578285925, 0.020521089488942795, 0.02182910345982831, 0.023273601163875616, 0.02484827805340674, 0.02654687464486416, 0.028363377171290744, 0.030292122542674365, 0.03232783622181838 ], [ 0.05386478003711996, 0.05142897686325769, 0.049081222696763946, 0.04682350646891454, 0.04465750733321009, 0.042584560456423344, 0.04060562071148555, 0.03872122512399278, 0.03693145538181721, 0.035235902245238204, 0.03363363426028501, 0.03212317372623588, 0.030702483325856927, 0.02936896710639906, 0.028119489513885616, 0.026950415865598116, 0.025857676971331522, 0.024836859617928208, 0.023883323416227488, 0.022992343231248484, 0.02215927525379718, 0.021379743877063203, 0.020649845985454003, 0.019966368982973878, 0.019327018655582028, 0.018730652361385828, 0.01817751148597145, 0.01766944387441815, 0.017210101359359294, 0.016805089168064526, 0.01646203343127389, 0.016190522529895626, 0.01600187259422046, 0.015908674886522416, 0.015924111329765355, 0.016061077067027425, 0.01633121561723539, 0.01674402688230757, 0.017306218653237098, 0.01802142153000664, 0.01889029130120588, 0.019910924494388513, 0.021079453461706588, 0.022390681995142683, 0.023838657267448205, 0.025417122844028615, 0.02711983974006007, 0.028940789121566335, 0.030874281907889656, 0.03291500201345723 ], [ 0.0548379183086283, 0.05240355865254242, 0.05005618744965263, 0.047797725682588714, 0.045629782466789955, 0.04355362252556177, 0.04157013217778793, 0.039679784746017764, 0.03788260671005808, 0.036178146400152385, 0.03456544751199111, 0.03304303018402129, 0.03160888274203148, 0.030260467414093616, 0.028994743282267633, 0.02780820941624216, 0.026696970515895722, 0.025656826510710145, 0.024683386512831317, 0.023772206425716466, 0.022918948512328022, 0.022119560438599147, 0.021370470768417502, 0.020668797520958623, 0.02001256598929419, 0.019400931182718975, 0.0188343984705314, 0.018315032657709153, 0.017846640253291843, 0.017434901893646656, 0.017087422437177955, 0.01681365748172609, 0.01662467164213815, 0.016532692718907557, 0.016550453667067453, 0.016690362614860614, 0.016963600224840236, 0.017379290386990178, 0.017943897282570974, 0.018660955852239883, 0.019531157914735496, 0.02055272903155476, 0.021721977237054064, 0.023033887611681892, 0.024482665589534342, 0.026062174864577972, 0.027766254257846075, 0.029588923284895874, 0.03152449818963639, 0.03356764270209494 ], [ 0.05586366216714511, 0.05343052825480187, 0.051083290263921825, 0.04882380926283476, 0.04665363409706416, 0.044573970657901515, 0.04258565021708685, 0.040689097769030985, 0.038884301699671234, 0.03717078651499097, 0.035547590781688586, 0.034013252813498186, 0.032565806924540794, 0.031202793205889617, 0.029921283709265813, 0.02871792760606985, 0.027589017325936445, 0.026530576901673195, 0.02553847283178421, 0.0246085468223359, 0.02373676889516483, 0.022919408631094654, 0.02215322176991281, 0.02143564893071653, 0.020765022639823303, 0.02014077781987123, 0.019563658949071205, 0.019035913736241406, 0.01856145796021914, 0.018145989053962197, 0.01779701788914571, 0.017523781317353927, 0.017336996573537277, 0.017248428446802508, 0.017270266411211644, 0.01741435204715184, 0.017691347794772626, 0.01810997672795722, 0.018676467410448084, 0.019394297689473882, 0.020264258597945797, 0.021284784258226337, 0.02245244534153076, 0.023762494569108138, 0.025209375272942976, 0.026787140391562603, 0.028489763487041183, 0.03031134716776287, 0.03224624660274951, 0.034289129384054366 ], [ 0.05694209369064501, 0.054510091426356745, 0.05216287237283353, 0.04990224616093409, 0.047729711422364346, 0.04564642691318353, 0.04365318219816654, 0.0417503688527337, 0.03993795347889427, 0.038215454194985614, 0.03658192261795159, 0.03503593367227159, 0.033575585784591015, 0.03219851410889615, 0.030901919330293078, 0.02968261429027691, 0.028537090161980055, 0.027461603212709577, 0.02645228238543674, 0.025505257094399252, 0.02461680384539988, 0.02378350961532645, 0.023002449355760304, 0.022271374436700804, 0.021588908128483155, 0.020954743037169134, 0.02036983338050545, 0.01983657171964119, 0.01935893497366983, 0.01894257835339255, 0.018594849158299176, 0.018324687342459026, 0.018142380049828162, 0.018059147650017694, 0.018086562969350153, 0.01823584284303471, 0.018517093451912277, 0.01893862201407258, 0.019506429826193883, 0.020223967703873805, 0.021092174332863946, 0.022109754558322984, 0.023273612043503783, 0.024579339981546613, 0.026021689806840977, 0.027594967422493833, 0.02929333601928858, 0.031111026420837518, 0.0330424682405271, 0.03508235971736153 ], [ 0.058073391776699325, 0.05564255288626569, 0.05329537493171999, 0.05103362477713447, 0.048858760919520336, 0.04677190648700965, 0.04477382223434382, 0.0428648804930293, 0.041045041337209626, 0.03931383254417015, 0.03767033523420931, 0.03611317733437679, 0.03464053718406154, 0.03325015964789364, 0.03193938698800434, 0.03070520645503259, 0.02954431608663519, 0.028453209582594386, 0.027428280407869217, 0.02646594452491181, 0.025562780436771803, 0.024715684569578296, 0.02392203942404678, 0.023179891296254515, 0.022488133539785914, 0.021846690063565096, 0.021256691727015622, 0.02072063521395165, 0.020242509696284137, 0.019827871371796868, 0.01948384070874208, 0.01921899391153829, 0.01904312182063293, 0.01896683982259662, 0.01900105393398785, 0.01915631986398648, 0.0194421663237609, 0.01986647830604301, 0.020435037206289405, 0.021151286887810858, 0.022016345669331333, 0.0230292318300244, 0.024187233315626024, 0.02548634042468164, 0.02692167084737774, 0.028487839469614022, 0.030179250125536298, 0.03199030606836334, 0.033915548014527244, 0.035949734019392464 ], [ 0.05925780405459569, 0.056828285522211225, 0.05448130538674515, 0.05221859638345993, 0.050041586740493166, 0.04795137503587171, 0.04594870543192674, 0.044033944233354765, 0.04220705898546517, 0.04046760160614953, 0.03881469730471826, 0.037247041253289564, 0.03576290510784735, 0.03436015549317751, 0.033036286441418206, 0.031788467493684594, 0.030613608741243907, 0.029508443521498742, 0.028469628835753328, 0.027493862871652255, 0.026578018339526346, 0.025719289691091274, 0.02491535166156135, 0.024164525883833787, 0.0234659514215978, 0.02281975375246049, 0.022227204769675536, 0.0216908635657594, 0.021214684079467794, 0.020804071444584318, 0.02046586498232308, 0.020208223937966337, 0.020040394763745854, 0.019972348698867912, 0.02001429717447851, 0.020176118697657775, 0.02046675832114786, 0.020893679678478293, 0.02146244997835594, 0.02217651627259954, 0.023037192355021524, 0.024043833261995752, 0.025194142894676762, 0.026484547865682048, 0.02791057651079392, 0.02946719911736009, 0.031149105502676706, 0.03295091314126469, 0.03486731051155695, 0.03689314628098514 ], [ 0.06049561947967143, 0.058067700591114185, 0.055721205202269856, 0.053457840323166146, 0.05127901335971483, 0.04918580878388916, 0.047178965507856635, 0.0452588558879457, 0.04342546752415819, 0.041678389261239936, 0.04001680301694017, 0.03843948323549868, 0.036944805861059984, 0.035530768718787985, 0.03419502505917653, 0.03293493175234004, 0.031747613217871014, 0.03063004166183983, 0.029579133599155538, 0.02859186200627883, 0.027665382809323444, 0.026797173779765655, 0.02598518326122213, 0.02522798541783287, 0.024524937757944693, 0.023876335387763653, 0.023283554620409295, 0.022749176094860504, 0.02227707449365485, 0.021872458646723904, 0.021541843109174563, 0.021292931638449336, 0.021134396301774088, 0.021075545138137464, 0.021125887240501847, 0.021294625264622103, 0.02159012685768655, 0.02201944087441844, 0.022587924318510897, 0.023299028829720597, 0.02415426525146633, 0.02515333110051823, 0.026294359399662355, 0.02757423503227897, 0.028988926907889026, 0.0305337962361894, 0.032203856912812794, 0.03399397844194263, 0.03589903235819663, 0.03791398928520293 ], [ 0.06178714210005304, 0.05936121942367957, 0.05701561947052999, 0.05475203151988418, 0.05257185100873717, 0.0504761579450969, 0.04846569630153028, 0.04654085528754115, 0.04470165361127606, 0.04294772804893788, 0.041278327824904024, 0.03969231644398876, 0.03818818268502046, 0.03676406243857034, 0.03541777293387039, 0.03414686064161677, 0.03294866376457249, 0.03182038975225991, 0.030759207726858674, 0.02976235511404187, 0.0288272571601629, 0.02795165739268011, 0.027133756422434503, 0.026372355737119966, 0.025667002201344453, 0.0250181277426202, 0.024427177054852294, 0.02389671404467456, 0.02343049528431975, 0.023033496283003933, 0.02271187468636996, 0.02247285471988003, 0.022324520755227836, 0.02227551609948975, 0.022334656360089352, 0.02251048356184071, 0.022810803787671367, 0.023242261977497812, 0.023810007494766, 0.02451749109293199, 0.02536641076632949, 0.02635679755058958, 0.02748721058425157, 0.02875499907378693, 0.030156588259137633, 0.031687754312174986, 0.03334386490672202, 0.035120073996167914, 0.03701146868856578, 0.039013172198071454 ], [ 0.06313266640041695, 0.060709247045862766, 0.05836506882032817, 0.05610181071131996, 0.053920864305189845, 0.051823313854110674, 0.049809917553039304, 0.04788109089278503, 0.046036893141887844, 0.04427701818905721, 0.042600791132177726, 0.041007172109311485, 0.03949476891061142, 0.03806185986806482, 0.03670642837805351, 0.03542621016260036, 0.03421875402246161, 0.033081496391576024, 0.032011849489225676, 0.031007302306719796, 0.030065533077935344, 0.029184531271358713, 0.028362726487254828, 0.027599120901915877, 0.02689342100224403, 0.02624616321734777, 0.025658826616128116, 0.025133924102346012, 0.024675061634998857, 0.024286953277800363, 0.023975378961871775, 0.023747072636843638, 0.023609532036051376, 0.023570748433550573, 0.023638865597664746, 0.023821790361225857, 0.024126789929197076, 0.024560119232424526, 0.025126721651878927, 0.02583003679382221, 0.02667193155556073, 0.027652750278689877, 0.02877146208920323, 0.030025872850642288, 0.03141286684965564, 0.032928647922741604, 0.034568958214292386, 0.03632926207845362, 0.0382048906576545, 0.040191148403604535 ], [ 0.06453245454422357, 0.06211214803780582, 0.05977002393917878, 0.05750775771011967, 0.055326744360475334, 0.053228080064618294, 0.05121254517500448, 0.049280589462830565, 0.04743232057939659, 0.04566749688531485, 0.04398552592257843, 0.042385469888971156, 0.04086605949757166, 0.03942571754923113, 0.03806259340095229, 0.0367746092724838, 0.0355595189993633, 0.034414979424475946, 0.03333863413800087, 0.032328208746580885, 0.031381616290233644, 0.0304970708334169, 0.029673206620406057, 0.02890919947232495, 0.028204886265026607, 0.027560877313851158, 0.026978655274074455, 0.026460652778656404, 0.02601029962058103, 0.02563202915589546, 0.02533123326307315, 0.025114156332009637, 0.024987722107872846, 0.024959293298819064, 0.025036372579736826, 0.025226263909226925, 0.025535722747162426, 0.0259706299443038, 0.02653572419009984, 0.027234420866765856, 0.02806873217472108, 0.029039287743721377, 0.030145440728771126, 0.031385434919835434, 0.0327566050688761, 0.03425558482731191, 0.03587850245241576, 0.037621151537458423, 0.03947913066093353, 0.041447951024199514 ], [ 0.06598671575654705, 0.06357022486306975, 0.061230882927002676, 0.058970367889116915, 0.0567900845357667, 0.0546911475502016, 0.05267436610957828, 0.050740230819011835, 0.0488889039170482, 0.04712021381784292, 0.045433655160115376, 0.04382839559630511, 0.04230329056137762, 0.0408569071955082, 0.03948755844803667, 0.03819334815709027, 0.03697222758217145, 0.035822063474817936, 0.03474071731868356, 0.033726134870405655, 0.03277644459784435, 0.031890063046583934, 0.031065804559431993, 0.030302992106138918, 0.029601565220519977, 0.028962180163600013, 0.02838629643017204, 0.02787624264398444, 0.027435253882704985, 0.027067471802526468, 0.026777898993979112, 0.02657230030156529, 0.02645704688278456, 0.026438903865945995, 0.026524769421867274, 0.026721381022724953, 0.027035012012717158, 0.02747118631379941, 0.02803443931374449, 0.028728147934952975, 0.0295544433162914, 0.030514207664339193, 0.03160714553894905, 0.03283191164469803, 0.034186273414893505, 0.0356672871857159, 0.03727147039503717, 0.03899495742099387, 0.04083363198038221, 0.042783233495912454 ], [ 0.06749558801474372, 0.06508369881887299, 0.06274795160981854, 0.0604900319907245, 0.058311359910268076, 0.05621307402784929, 0.05419601773861461, 0.052260727609624816, 0.050407425102996034, 0.04863601257269511, 0.04694607460654281, 0.045336885830043486, 0.04380742628044328, 0.04235640538582426, 0.04098229543634403, 0.03968337520928649, 0.03845778410804849, 0.03730358680540981, 0.036218847954525374, 0.03520171606027178, 0.034250515099334154, 0.03336384194407763, 0.03254066707919246, 0.03178043548892133, 0.031083163920313604, 0.03044952998473931, 0.029880947758638435, 0.029379623742822967, 0.02894858636536288, 0.028591681881958837, 0.028313529847899394, 0.028119432670557498, 0.028015236434786827, 0.028007144385158528, 0.028101489956369005, 0.028304482384874204, 0.028621943532792855, 0.02905905815699212, 0.029620160175032925, 0.030308573919797455, 0.031126522388221986, 0.03207510554498171, 0.033154342858377324, 0.03436326730342121, 0.03570005421313202, 0.037162167770546366, 0.03874650997077647, 0.04044956048048784, 0.042267499904362925, 0.04419631271833204 ], [ 0.0690591221449093, 0.06665269368271176, 0.06432142686027811, 0.0620670192721538, 0.059890910430957546, 0.057794267322745944, 0.05577797170605479, 0.05384260986535613, 0.051988465637516856, 0.05021551762321678, 0.04852344156264996, 0.04691161888449884, 0.04537915241704687, 0.04392489017018873, 0.04254745794968194, 0.04124530134712456, 0.04001673736271812, 0.03886001556940568, 0.03777338832652973, 0.03675518911017849, 0.03580391755615999, 0.0349183293156048, 0.03409752830346958, 0.033341058371878916, 0.03264899085759834, 0.032022003838420326, 0.031461448307979374, 0.030969395900902554, 0.030548662379762115, 0.030202801004319844, 0.029936060372520844, 0.02975330260730245, 0.029659880080084855, 0.029661472284022553, 0.029763888814155294, 0.029972849152189333, 0.030293754235113216, 0.030731467578590837, 0.031290124114936084, 0.03197298244168759, 0.0327823311156767, 0.0337194529324169, 0.034784644198472325, 0.03597728022237059, 0.03729591457719686, 0.03873839844073965, 0.040302007204387126, 0.0419835638828671, 0.043779551870834654, 0.045686212611233505 ], [ 0.07067726835927031, 0.06827722206296002, 0.06595138289919564, 0.06370146392065047, 0.06152892763070288, 0.05943497260594681, 0.0574205219199601, 0.05548621403869053, 0.053632396950819554, 0.0518591263743807, 0.050166168933220165, 0.04855301121349822, 0.04701887558051618, 0.04556274355134188, 0.044183387372534286, 0.042879410242422505, 0.04164929534588251, 0.040491463541993164, 0.03940433917079518, 0.03838642303496737, 0.03743637117582474, 0.036553077607569436, 0.03573575870378178, 0.034984036446146644, 0.03429801724978174, 0.03367836258103145, 0.03312634710809826, 0.03264389972541219, 0.03223362256084425, 0.03189878314409595, 0.03164327545368637, 0.03147154674618187, 0.031388489040823635, 0.03139929690965666, 0.03150929664553891, 0.03172375554925258, 0.032047683373047156, 0.032485640148191865, 0.03304156505708173, 0.033718639342433326, 0.03451919260807196, 0.035444656881541976, 0.03649556743671679, 0.037671604626231654, 0.03897166762582048, 0.04039396940573186, 0.04193614234050103, 0.04359534524777795, 0.045368364765976214, 0.047251706319336374 ], [ 0.07234986521395603, 0.0699571744018878, 0.06763776048971067, 0.06539335460713357, 0.06322544473300537, 0.06113526326547007, 0.059123776428682336, 0.05719167614682277, 0.0553393750960258, 0.05356700570909156, 0.051874423947400654, 0.050261218659860184, 0.04872672731122692, 0.04727005877390488, 0.045890123733588674, 0.044585673057755085, 0.04335534421932997, 0.04219771556107379, 0.04111136783822386, 0.04009495209744457, 0.03914726254930285, 0.038267312677979975, 0.03745441241193978, 0.036708243758321706, 0.03602893188811138, 0.03541710826189706, 0.03487396203310683, 0.03440127570387118, 0.034001440911345576, 0.033677450391183396, 0.03343286272138069, 0.03327173751453317, 0.03319854038319234, 0.03321801924913779, 0.033335056266624155, 0.03355450248249325, 0.03388100491426931, 0.034318837467717, 0.034871747569229505, 0.03554282929102447, 0.0363344311532833, 0.037248103094843034, 0.03828458296530513, 0.039443819037159905, 0.04072502207972351, 0.04212673882918166, 0.04364693827638421, 0.0452831028656099, 0.047032318095561, 0.04889135575093399 ], [ 0.07407663091877753, 0.07169231052938774, 0.06938035888361217, 0.06714252699321788, 0.06498032990739208, 0.06289503511704048, 0.06088765281243274, 0.05895892858658392, 0.05710933924499218, 0.05533909243476049, 0.053648130834639214, 0.052036141643812234, 0.05050257206367134, 0.04904665137673908, 0.04766742008638626, 0.04636376638872045, 0.04513447000607383, 0.043978253125468256, 0.042893837863157744, 0.04188000932754835, 0.04093568298763596, 0.04005997468178327, 0.03925227123042082, 0.03851229925387529, 0.03784018945200703, 0.037236533290517466, 0.03670242878354318, 0.03623951190332529, 0.03584997014264499, 0.035536534980372646, 0.03530245054106123, 0.035151416677311614, 0.035087506087680145, 0.03511505689844773, 0.03523854427335312, 0.03546243684787102, 0.03579104578868968, 0.0362283756794171, 0.036777986889865937, 0.03744287839349018, 0.038225398165135545, 0.03912718556868096, 0.04014914697170774, 0.04129146272563633, 0.042553621098968986, 0.043934473065084155, 0.045432301132446014, 0.04704489557741729, 0.04876963227708469, 0.05060354756693181 ], [ 0.07585715689086849, 0.07348225362501898, 0.07117883033832749, 0.0689486589657458, 0.06679328239975799, 0.06471400362322895, 0.0627118766974563, 0.06078770016101541, 0.05894201345305219, 0.057175097016781064, 0.05548697675804967, 0.053877433522680415, 0.052346018208064324, 0.050892073033819124, 0.04951475935983926, 0.04821309225720161, 0.04698598181027099, 0.04583228086255825, 0.04475083862174612, 0.043740559220533305, 0.04280046399925357, 0.04192975594351273, 0.04112788438444806, 0.0403946077597828, 0.03973005195089901, 0.03913476146942206, 0.038609740587509704, 0.03815648142195758, 0.03777697603711113, 0.037473709881838145, 0.037249634381470144, 0.037108117320838734, 0.03705287080680877, 0.037087858068238874, 0.03721718204960877, 0.03744496051476931, 0.03777519396317359, 0.03821163380122125, 0.03875765865682276, 0.03941616631577658, 0.04018948747891945, 0.04107932554131851, 0.04208672417418533, 0.043212062018577385, 0.0444550716387901, 0.045814878303203244, 0.04729005329416337, 0.04887867628562628, 0.050578401744145865, 0.05238652512010443 ], [ 0.07769090341256059, 0.07532648641476233, 0.07303267699273464, 0.07081126834444097, 0.06866383123620508, 0.06659170376799808, 0.06459598298390055, 0.06267751884862859, 0.06083691115981398, 0.05907450999909576, 0.05739042033618716, 0.05578451138293273, 0.05425643124278048, 0.05280562731080673, 0.05143137274777957, 0.05013279917833564, 0.048908935551112385, 0.047758752852340484, 0.04668121409170222, 0.04567532868912767, 0.04474021009328084, 0.04387513516669879, 0.043079603588654224, 0.04235339526383101, 0.0416966234941348, 0.04110978148547296, 0.04059377963986253, 0.04014997105145766, 0.03978016271695867, 0.03948661022628334, 0.039271994161257914, 0.039139377132654314, 0.03909214134429892, 0.03913390776634338, 0.039268439358453394, 0.03949953218342643, 0.039830899519836836, 0.04026605502122977, 0.04080820139487045, 0.041460130859436735, 0.042224142760806736, 0.04310198226748438, 0.044094802228111706, 0.045203148315319484, 0.0464269657746465, 0.047765624668085566, 0.04921795958409132, 0.05078231941261048, 0.05245662289741045, 0.05423841616127516 ], [ 0.07957719723033128, 0.07722434940667672, 0.07494124986996419, 0.0727297127912784, 0.07059133618616016, 0.06852749222642908, 0.06653931937833853, 0.06462771685515198, 0.06279334191313711, 0.06103661054564542, 0.059357702134490126, 0.057756568595750346, 0.05623294850343764, 0.05478638658530356, 0.05341625885866788, 0.05212180351048588, 0.050902157427907345, 0.049756398058203484, 0.04868359002731888, 0.04768283568316129, 0.04675332846235219, 0.045894407717337424, 0.04510561339376141, 0.04438673872564305, 0.04373787892807436, 0.043159473726275835, 0.042652341481229095, 0.042217702676165834, 0.04185719064002075, 0.041572847632707376, 0.04136710483162557, 0.04124274536181992, 0.041202850309972325, 0.04125072863599247, 0.04138983299075283, 0.041623664571714444, 0.041955671172824414, 0.042389143366130325, 0.04292711415251024, 0.04357226733866041, 0.0443268593046005, 0.04519265776962627, 0.04617089977337314, 0.04726226954607067, 0.04846689545062414, 0.04978436391870349, 0.05121374739951242, 0.05275364284763251, 0.05440221718097821, 0.056157256373501815 ], [ 0.08151523091578251, 0.07917504095601301, 0.07690374976466126, 0.07470319164366647, 0.07257499066910598, 0.07052055147445951, 0.06854105183496384, 0.0666374375104247, 0.06481041983794356, 0.06306047658499883, 0.0613878565724064, 0.05979258855079676, 0.05827449475920417, 0.05683320950715414, 0.055468203000659286, 0.05417881047867852, 0.052964266542344964, 0.05182374434989089, 0.05075639912231073, 0.0497614151666877, 0.048838055384778235, 0.0479857120030835, 0.04720395704631769, 0.046492590888176144, 0.04585168706075011, 0.045281631397776884, 0.04478315353954484, 0.044357348854651465, 0.04400568895449199, 0.04373001921109572, 0.04353254205724071, 0.0434157853641308, 0.043382555857810735, 0.043435878334234165, 0.04357892232197747, 0.04381491875128637, 0.044147070024726946, 0.044578457540443185, 0.04511195109054416, 0.045750124565952816, 0.04649518201187189, 0.04734889731929471, 0.048312569790247305, 0.04938699660562369, 0.05057246200348263, 0.05186874188508251, 0.05327512171605115, 0.05479042504367298, 0.0564130497198387, 0.058141008969659715 ], [ 0.08350406380063574, 0.0811776189442967, 0.07891922977001369, 0.0767307493958456, 0.07461382629748078, 0.07256989549866114, 0.07060017153306425, 0.06870564360653977, 0.06688707341646866, 0.06514499609846117, 0.06347972476505012, 0.061891359072250594, 0.060379798194267524, 0.058944758501682404, 0.05758579612333337, 0.05630233442754309, 0.05509369628748583, 0.05395914080283131, 0.05289790394219047, 0.05190924235580532, 0.050992479393920376, 0.050147052162054, 0.049372558258555375, 0.048668800680579966, 0.048035829260894315, 0.047473976918211994, 0.04698388897892295, 0.046566543869829925, 0.046223263603521754, 0.04595571269521751, 0.04576588447504586, 0.04565607420177219, 0.045628838942030965, 0.04568694483856984, 0.04583330311897174, 0.04607089694016285, 0.04640270185374988, 0.04683160323250231, 0.04736031434030843, 0.047991298794624444, 0.04872670092976729, 0.04956828703083509, 0.05051739962323766, 0.05157492605999424, 0.05274128165704314, 0.05401640669667464, 0.05539977584454743, 0.056890417969136124, 0.05848694403983946, 0.060187580701580735 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
l2norm: 1.48776 (SEM: 0)
x1: 0.703969
x2: 0.889873
x3: 0.783413
x4: 0.502978
x5: 0.0677592
x6: 0.233801", "Arm 10_0
l2norm: 1.48836 (SEM: 0)
x1: 0.0731024
x2: 0.966383
x3: 0.311139
x4: 0.660618
x5: 0.460229
x6: 0.728661", "Arm 11_0
l2norm: 1.39133 (SEM: 0)
x1: 0.800801
x2: 0.22853
x3: 0.931378
x4: 0.098299
x5: 0.581039
x6: 0.165996", "Arm 12_0
l2norm: 1.25407 (SEM: 0)
x1: 0.272393
x2: 0.261966
x3: 0.684906
x4: 0.267852
x5: 1.21088e-15
x6: 0.942885", "Arm 13_0
l2norm: 1.17995 (SEM: 0)
x1: 0.158744
x2: 0.150478
x3: 0.62625
x4: 0.362772
x5: 0
x6: 0.905898", "Arm 14_0
l2norm: 1.03739 (SEM: 0)
x1: 0.235196
x2: 0.327363
x3: 0.45339
x4: 0.296878
x5: 0.0566427
x6: 0.785352", "Arm 15_0
l2norm: 1.29896 (SEM: 0)
x1: 0.538952
x2: 0.283618
x3: 0.599381
x4: 0.529577
x5: 0.119609
x6: 0.813866", "Arm 16_0
l2norm: 1.1178 (SEM: 0)
x1: 0.219188
x2: 0.276851
x3: 0.696525
x4: 0.0868806
x5: 0.0984854
x6: 0.788912", "Arm 17_0
l2norm: 1.17651 (SEM: 0)
x1: 0.106711
x2: 0.278854
x3: 0.812076
x4: 0
x5: 0.16989
x6: 0.778902", "Arm 18_0
l2norm: 1.10962 (SEM: 0)
x1: 0.252234
x2: 0.308824
x3: 0.739985
x4: 0.0277772
x5: 0
x6: 0.723812", "Arm 19_0
l2norm: 1.22511 (SEM: 0)
x1: 0.3242
x2: 0.278458
x3: 0.623416
x4: 0.15834
x5: 0.126965
x6: 0.942561", "Arm 1_0
l2norm: 1.31991 (SEM: 0)
x1: 0.419934
x2: 0.180336
x3: 0.411221
x4: 0.19127
x5: 0.938351
x6: 0.66866", "Arm 20_0
l2norm: 1.23626 (SEM: 0)
x1: 0.235849
x2: 0.447336
x3: 0.679505
x4: 0
x5: 0.100441
x6: 0.894866", "Arm 21_0
l2norm: 1.22712 (SEM: 0)
x1: 0.0435856
x2: 0.275752
x3: 0.760699
x4: 0.0943189
x5: 0.103941
x6: 0.910776", "Arm 22_0
l2norm: 1.18685 (SEM: 0)
x1: 0.0081406
x2: 0.321377
x3: 0.886142
x4: 0.183151
x5: 0.108566
x6: 0.688974", "Arm 23_0
l2norm: 0.313864 (SEM: 0)
x1: 0
x2: 1.22098e-15
x3: 0.180104
x4: 0
x5: 0.257047
x6: 2.78856e-16", "Arm 2_0
l2norm: 1.57943 (SEM: 0)
x1: 0.226501
x2: 0.612951
x3: 0.737841
x4: 0.79007
x5: 0.532533
x6: 0.784452", "Arm 3_0
l2norm: 1.19954 (SEM: 0)
x1: 0.899604
x2: 0.316626
x3: 0.113939
x4: 0.478366
x5: 0.411064
x6: 0.344343", "Arm 4_0
l2norm: 1.2349 (SEM: 0)
x1: 0.816311
x2: 0.718168
x3: 0.366568
x4: 0.276598
x5: 0.354597
x6: 0.0788773", "Arm 5_0
l2norm: 1.71426 (SEM: 0)
x1: 0.0597861
x2: 0.477507
x3: 0.984853
x4: 0.964771
x5: 0.733056
x6: 0.518654", "Arm 6_0
l2norm: 1.47601 (SEM: 0)
x1: 0.364092
x2: 0.785114
x3: 0.16299
x4: 0.048069
x5: 0.764806
x6: 0.903241", "Arm 7_0
l2norm: 1.15054 (SEM: 0)
x1: 0.509804
x2: 0.0199137
x3: 0.532985
x4: 0.736238
x5: 0.135333
x6: 0.467987", "Arm 8_0
l2norm: 1.56684 (SEM: 0)
x1: 0.622962
x2: 0.53223
x3: 0.233523
x4: 0.889147
x5: 0.925249
x6: 0.28714", "Arm 9_0
l2norm: 1.15378 (SEM: 0)
x1: 0.253142
x2: 0.272034
x3: 0.601565
x4: 0.326832
x5: 0.0535014
x6: 0.849444" ], "type": "scatter", "x": [ 0.7834134697914124, 0.3111385013908148, 0.9313776018097997, 0.6849062263116664, 0.626249507551447, 0.4533899566817806, 0.5993813391368221, 0.6965249850659173, 0.8120756107607193, 0.739985215311018, 0.6234159616361906, 0.41122139897197485, 0.6795049682253216, 0.7606988007693695, 0.8861421318154215, 0.18010407469320308, 0.7378409802913666, 0.11393948923796415, 0.3665676023811102, 0.984853339381516, 0.16298976726830006, 0.5329849952831864, 0.23352292366325855, 0.601565265096724 ], "xaxis": "x", "y": [ 0.5029778480529785, 0.6606175433844328, 0.09829898457974195, 0.2678518318539636, 0.36277249089652214, 0.29687807329287225, 0.5295772361696667, 0.0868806268290617, 0.0, 0.027777171328946373, 0.15834025573221686, 0.19126965012401342, 0.0, 0.09431888146679386, 0.1831512851131844, 0.0, 0.7900700783357024, 0.47836566902697086, 0.2765979468822479, 0.9647710295394063, 0.04806897509843111, 0.7362382337450981, 0.8891465170308948, 0.326831778511405 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
l2norm: 1.48776 (SEM: 0)
x1: 0.703969
x2: 0.889873
x3: 0.783413
x4: 0.502978
x5: 0.0677592
x6: 0.233801", "Arm 10_0
l2norm: 1.48836 (SEM: 0)
x1: 0.0731024
x2: 0.966383
x3: 0.311139
x4: 0.660618
x5: 0.460229
x6: 0.728661", "Arm 11_0
l2norm: 1.39133 (SEM: 0)
x1: 0.800801
x2: 0.22853
x3: 0.931378
x4: 0.098299
x5: 0.581039
x6: 0.165996", "Arm 12_0
l2norm: 1.25407 (SEM: 0)
x1: 0.272393
x2: 0.261966
x3: 0.684906
x4: 0.267852
x5: 1.21088e-15
x6: 0.942885", "Arm 13_0
l2norm: 1.17995 (SEM: 0)
x1: 0.158744
x2: 0.150478
x3: 0.62625
x4: 0.362772
x5: 0
x6: 0.905898", "Arm 14_0
l2norm: 1.03739 (SEM: 0)
x1: 0.235196
x2: 0.327363
x3: 0.45339
x4: 0.296878
x5: 0.0566427
x6: 0.785352", "Arm 15_0
l2norm: 1.29896 (SEM: 0)
x1: 0.538952
x2: 0.283618
x3: 0.599381
x4: 0.529577
x5: 0.119609
x6: 0.813866", "Arm 16_0
l2norm: 1.1178 (SEM: 0)
x1: 0.219188
x2: 0.276851
x3: 0.696525
x4: 0.0868806
x5: 0.0984854
x6: 0.788912", "Arm 17_0
l2norm: 1.17651 (SEM: 0)
x1: 0.106711
x2: 0.278854
x3: 0.812076
x4: 0
x5: 0.16989
x6: 0.778902", "Arm 18_0
l2norm: 1.10962 (SEM: 0)
x1: 0.252234
x2: 0.308824
x3: 0.739985
x4: 0.0277772
x5: 0
x6: 0.723812", "Arm 19_0
l2norm: 1.22511 (SEM: 0)
x1: 0.3242
x2: 0.278458
x3: 0.623416
x4: 0.15834
x5: 0.126965
x6: 0.942561", "Arm 1_0
l2norm: 1.31991 (SEM: 0)
x1: 0.419934
x2: 0.180336
x3: 0.411221
x4: 0.19127
x5: 0.938351
x6: 0.66866", "Arm 20_0
l2norm: 1.23626 (SEM: 0)
x1: 0.235849
x2: 0.447336
x3: 0.679505
x4: 0
x5: 0.100441
x6: 0.894866", "Arm 21_0
l2norm: 1.22712 (SEM: 0)
x1: 0.0435856
x2: 0.275752
x3: 0.760699
x4: 0.0943189
x5: 0.103941
x6: 0.910776", "Arm 22_0
l2norm: 1.18685 (SEM: 0)
x1: 0.0081406
x2: 0.321377
x3: 0.886142
x4: 0.183151
x5: 0.108566
x6: 0.688974", "Arm 23_0
l2norm: 0.313864 (SEM: 0)
x1: 0
x2: 1.22098e-15
x3: 0.180104
x4: 0
x5: 0.257047
x6: 2.78856e-16", "Arm 2_0
l2norm: 1.57943 (SEM: 0)
x1: 0.226501
x2: 0.612951
x3: 0.737841
x4: 0.79007
x5: 0.532533
x6: 0.784452", "Arm 3_0
l2norm: 1.19954 (SEM: 0)
x1: 0.899604
x2: 0.316626
x3: 0.113939
x4: 0.478366
x5: 0.411064
x6: 0.344343", "Arm 4_0
l2norm: 1.2349 (SEM: 0)
x1: 0.816311
x2: 0.718168
x3: 0.366568
x4: 0.276598
x5: 0.354597
x6: 0.0788773", "Arm 5_0
l2norm: 1.71426 (SEM: 0)
x1: 0.0597861
x2: 0.477507
x3: 0.984853
x4: 0.964771
x5: 0.733056
x6: 0.518654", "Arm 6_0
l2norm: 1.47601 (SEM: 0)
x1: 0.364092
x2: 0.785114
x3: 0.16299
x4: 0.048069
x5: 0.764806
x6: 0.903241", "Arm 7_0
l2norm: 1.15054 (SEM: 0)
x1: 0.509804
x2: 0.0199137
x3: 0.532985
x4: 0.736238
x5: 0.135333
x6: 0.467987", "Arm 8_0
l2norm: 1.56684 (SEM: 0)
x1: 0.622962
x2: 0.53223
x3: 0.233523
x4: 0.889147
x5: 0.925249
x6: 0.28714", "Arm 9_0
l2norm: 1.15378 (SEM: 0)
x1: 0.253142
x2: 0.272034
x3: 0.601565
x4: 0.326832
x5: 0.0535014
x6: 0.849444" ], "type": "scatter", "x": [ 0.7834134697914124, 0.3111385013908148, 0.9313776018097997, 0.6849062263116664, 0.626249507551447, 0.4533899566817806, 0.5993813391368221, 0.6965249850659173, 0.8120756107607193, 0.739985215311018, 0.6234159616361906, 0.41122139897197485, 0.6795049682253216, 0.7606988007693695, 0.8861421318154215, 0.18010407469320308, 0.7378409802913666, 0.11393948923796415, 0.3665676023811102, 0.984853339381516, 0.16298976726830006, 0.5329849952831864, 0.23352292366325855, 0.601565265096724 ], "xaxis": "x2", "y": [ 0.5029778480529785, 0.6606175433844328, 0.09829898457974195, 0.2678518318539636, 0.36277249089652214, 0.29687807329287225, 0.5295772361696667, 0.0868806268290617, 0.0, 0.027777171328946373, 0.15834025573221686, 0.19126965012401342, 0.0, 0.09431888146679386, 0.1831512851131844, 0.0, 0.7900700783357024, 0.47836566902697086, 0.2765979468822479, 0.9647710295394063, 0.04806897509843111, 0.7362382337450981, 0.8891465170308948, 0.326831778511405 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermap": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermap" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "l2norm" }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x4" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
\n", "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot(param_x=\"x3\", param_y=\"x4\", metric_name=\"l2norm\"))" ] }, { "cell_type": "markdown", "id": "fab6d836", "metadata": { "papermill": { "duration": 0.15311, "end_time": "2025-01-31T05:09:43.909364", "exception": false, "start_time": "2025-01-31T05:09:43.756254", "status": "completed" }, "tags": [] }, "source": [ "Here we plot the optimization trace, showing the progression of finding the point with the optimal objective:" ] }, { "cell_type": "code", "execution_count": 13, "id": "77e40499", "metadata": { "execution": { "iopub.execute_input": "2025-01-31T05:09:44.211452Z", "iopub.status.busy": "2025-01-31T05:09:44.210971Z", "iopub.status.idle": "2025-01-31T05:09:44.317465Z", "shell.execute_reply": "2025-01-31T05:09:44.316050Z" }, "papermill": { "duration": 0.298614, "end_time": "2025-01-31T05:09:44.358290", "exception": false, "start_time": "2025-01-31T05:09:44.059676", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": { "bdata": "AQIDBAUGBwgJCgsMDQ4PEBESExQVFhcYGQ==", "dtype": "i1" }, "y": { "bdata": "AAAAAAAA+H8AAAAAAAD4fwAAAAAAAPh/d5VM4Rc3xb93lUzhFzfFv3eVTOEXN8W/d5VM4Rc3xb93lUzhFzfFv3eVTOEXN8W/MGe27WsA8b8wZ7btawDxvzBntu1rAPG/MGe27WsA8b8wZ7btawDxvzBntu1rAPG/MGe27WsA8b+Z4XOwPsfzv5nhc7A+x/O/meFzsD7H87+Z4XOwPsfzv5nhc7A+x/O/15xcTdm39L/XnFxN2bf0v9ecXE3Zt/S/15xcTdm39L8=", "dtype": "f8" } }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "legendgroup": "objective value", "line": { "color": "rgba(128,177,211,1)" }, "mode": "lines", "name": "objective value", "text": [ "
Parameterization:
x1: 0.7039692401885986
x2: 0.8898727297782898
x3: 0.7834134697914124
x4: 0.5029778480529785
x5: 0.06775915622711182
x6: 0.23380112648010254", "
Parameterization:
x1: 0.41993400547653437
x2: 0.18033630028367043
x3: 0.41122139897197485
x4: 0.19126965012401342
x5: 0.9383512791246176
x6: 0.6686604022979736", "
Parameterization:
x1: 0.22650093212723732
x2: 0.612951054237783
x3: 0.7378409802913666
x4: 0.7900700783357024
x5: 0.5325334565714002
x6: 0.7844524662941694", "
Parameterization:
x1: 0.8996037896722555
x2: 0.3166261911392212
x3: 0.11393948923796415
x4: 0.47836566902697086
x5: 0.41106410138309
x6: 0.34434268437325954", "
Parameterization:
x1: 0.8163106394931674
x2: 0.7181677175685763
x3: 0.3665676023811102
x4: 0.2765979468822479
x5: 0.35459736455231905
x6: 0.07887730933725834", "
Parameterization:
x1: 0.05978607479482889
x2: 0.47750668600201607
x3: 0.984853339381516
x4: 0.9647710295394063
x5: 0.7330555599182844
x6: 0.5186535287648439", "
Parameterization:
x1: 0.3640918396413326
x2: 0.7851139297708869
x3: 0.16298976726830006
x4: 0.04806897509843111
x5: 0.7648058952763677
x6: 0.9032410494983196", "
Parameterization:
x1: 0.5098042171448469
x2: 0.019913658499717712
x3: 0.5329849952831864
x4: 0.7362382337450981
x5: 0.1353332009166479
x6: 0.46798669174313545", "
Parameterization:
x1: 0.6229621190577745
x2: 0.5322297886013985
x3: 0.23352292366325855
x4: 0.8891465170308948
x5: 0.9252491053193808
x6: 0.28714029770344496", "
Parameterization:
x1: 0.25314199924468994
x2: 0.272033697925508
x3: 0.601565265096724
x4: 0.326831778511405
x5: 0.053501364775002
x6: 0.8494444591924548", "
Parameterization:
x1: 0.0731023894622922
x2: 0.9663825742900372
x3: 0.3111385013908148
x4: 0.6606175433844328
x5: 0.4602292310446501
x6: 0.7286609010770917", "
Parameterization:
x1: 0.8008011942729354
x2: 0.22852987330406904
x3: 0.9313776018097997
x4: 0.09829898457974195
x5: 0.5810388820245862
x6: 0.16599575895816088", "
Parameterization:
x1: 0.27239334316444214
x2: 0.26196562219159164
x3: 0.6849062263116664
x4: 0.2678518318539636
x5: 1.2108772621974513e-15
x6: 0.9428853496105299", "
Parameterization:
x1: 0.15874437920702364
x2: 0.15047750976710164
x3: 0.626249507551447
x4: 0.36277249089652214
x5: 0.0
x6: 0.9058979681390775", "
Parameterization:
x1: 0.23519589801157317
x2: 0.3273625373443004
x3: 0.4533899566817806
x4: 0.29687807329287225
x5: 0.056642732097656315
x6: 0.7853519648498337", "
Parameterization:
x1: 0.5389521838498029
x2: 0.2836184133424968
x3: 0.5993813391368221
x4: 0.5295772361696667
x5: 0.1196090570509714
x6: 0.8138663837344382", "
Parameterization:
x1: 0.21918849969676493
x2: 0.27685052740492694
x3: 0.6965249850659173
x4: 0.0868806268290617
x5: 0.09848539263247161
x6: 0.7889119833320477", "
Parameterization:
x1: 0.10671067566014657
x2: 0.27885430956812013
x3: 0.8120756107607193
x4: 0.0
x5: 0.16989027806779772
x6: 0.778902170791999", "
Parameterization:
x1: 0.2522337508996379
x2: 0.30882391447335605
x3: 0.739985215311018
x4: 0.027777171328946373
x5: 0.0
x6: 0.7238124184359537", "
Parameterization:
x1: 0.3242003713153602
x2: 0.2784577255431607
x3: 0.6234159616361906
x4: 0.15834025573221686
x5: 0.12696454023291937
x6: 0.942561446802327", "
Parameterization:
x1: 0.2358494836733764
x2: 0.4473361234214467
x3: 0.6795049682253216
x4: 0.0
x5: 0.10044132925913428
x6: 0.8948660775942827", "
Parameterization:
x1: 0.04358563812513101
x2: 0.2757520708015818
x3: 0.7606988007693695
x4: 0.09431888146679386
x5: 0.10394089808185872
x6: 0.910776096828327", "
Parameterization:
x1: 0.008140604839402642
x2: 0.32137689426604615
x3: 0.8861421318154215
x4: 0.1831512851131844
x5: 0.1085662788021865
x6: 0.6889743333715633", "
Parameterization:
x1: 0.0
x2: 1.220981934244119e-15
x3: 0.18010407469320308
x4: 0.0
x5: 0.25704728256367865
x6: 2.7885601423049797e-16", "
Parameterization:
x1: 0.0
x2: 0.25879849383896086
x3: 0.0
x4: 5.625888164628883e-14
x5: 0.10248155244832759
x6: 0.8861374468481676" ], "type": "scatter", "x": { "bdata": "AQIDBAUGBwgJCgsMDQ4PEBESExQVFhcYGQ==", "dtype": "i1" }, "y": { "bdata": "AAAAAAAA8H8AAAAAAADwfwAAAAAAAPB/d5VM4Rc3xb93lUzhFzfFv3eVTOEXN8W/d5VM4Rc3xb93lUzhFzfFv3eVTOEXN8W/MGe27WsA8b8wZ7btawDxvzBntu1rAPG/MGe27WsA8b8wZ7btawDxvzBntu1rAPG/MGe27WsA8b+Z4XOwPsfzv5nhc7A+x/O/meFzsD7H87+Z4XOwPsfzv5nhc7A+x/O/15xcTdm39L/XnFxN2bf0v9ecXE3Zt/S/15xcTdm39L8=", "dtype": "f8" } }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": { "bdata": "AQIDBAUGBwgJCgsMDQ4PEBESExQVFhcYGQ==", "dtype": "i1" }, "y": { "bdata": "AAAAAAAA+H8AAAAAAAD4fwAAAAAAAPh/d5VM4Rc3xb93lUzhFzfFv3eVTOEXN8W/d5VM4Rc3xb93lUzhFzfFv3eVTOEXN8W/MGe27WsA8b8wZ7btawDxvzBntu1rAPG/MGe27WsA8b8wZ7btawDxvzBntu1rAPG/MGe27WsA8b+Z4XOwPsfzv5nhc7A+x/O/meFzsD7H87+Z4XOwPsfzv5nhc7A+x/O/15xcTdm39L/XnFxN2bf0v9ecXE3Zt/S/15xcTdm39L8=", "dtype": "f8" } }, { "line": { "color": "rgba(253,180,98,1)", "dash": "dash" }, "mode": "lines", "name": "Optimum", "type": "scatter", "x": [ 1, 25 ], "y": [ -3.32237, -3.32237 ] } ], "layout": { "showlegend": true, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermap": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermap" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "Best objective found vs. # of iterations" }, "xaxis": { "title": { "text": "Iteration" } }, "yaxis": { "title": { "text": "Hartmann6" } } } }, "text/html": [ "
\n", "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(\n", " ax_client.get_optimization_trace(objective_optimum=hartmann6.fmin)\n", ") # Objective_optimum is optional." ] }, { "cell_type": "markdown", "id": "949bd90d", "metadata": { "papermill": { "duration": 0.197189, "end_time": "2025-01-31T05:09:44.755989", "exception": false, "start_time": "2025-01-31T05:09:44.558800", "status": "completed" }, "tags": [] }, "source": [ "## 7. Save / reload optimization to JSON / SQL\n", "We can serialize the state of optimization to JSON and save it to a `.json` file or save it to the SQL backend. For the former:" ] }, { "cell_type": "code", "execution_count": 14, "id": "87569141", "metadata": { "execution": { "iopub.execute_input": "2025-01-31T05:09:45.152041Z", "iopub.status.busy": "2025-01-31T05:09:45.151758Z", "iopub.status.idle": "2025-01-31T05:09:45.184994Z", "shell.execute_reply": "2025-01-31T05:09:45.184346Z" }, "papermill": { "duration": 0.231871, "end_time": "2025-01-31T05:09:45.186376", "exception": false, "start_time": "2025-01-31T05:09:44.954505", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:09:45] ax.service.ax_client: Saved JSON-serialized state of optimization to `ax_client_snapshot.json`.\n" ] } ], "source": [ "ax_client.save_to_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "code", "execution_count": 15, "id": "d609a280", "metadata": { "execution": { "iopub.execute_input": "2025-01-31T05:09:45.580626Z", "iopub.status.busy": "2025-01-31T05:09:45.580097Z", "iopub.status.idle": "2025-01-31T05:09:45.702034Z", "shell.execute_reply": "2025-01-31T05:09:45.701397Z" }, "papermill": { "duration": 0.32139, "end_time": "2025-01-31T05:09:45.703324", "exception": false, "start_time": "2025-01-31T05:09:45.381934", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:09:45] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "restored_ax_client = (\n", " AxClient.load_from_json_file()\n", ") # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "markdown", "id": "92cc8722", "metadata": { "papermill": { "duration": 0.199353, "end_time": "2025-01-31T05:09:46.102319", "exception": false, "start_time": "2025-01-31T05:09:45.902966", "status": "completed" }, "tags": [] }, "source": [ "To store state of optimization to an SQL backend, first follow [setup instructions](https://ax.dev/docs/storage.html#sql) on Ax website." ] }, { "cell_type": "markdown", "id": "c28efb5a", "metadata": { "papermill": { "duration": 0.199345, "end_time": "2025-01-31T05:09:46.501561", "exception": false, "start_time": "2025-01-31T05:09:46.302216", "status": "completed" }, "tags": [] }, "source": [ "Having set up the SQL backend, pass `DBSettings` to `AxClient` on instantiation (note that `SQLAlchemy` dependency will have to be installed – for installation, refer to [optional dependencies](https://ax.dev/docs/installation.html#optional-dependencies) on Ax website):" ] }, { "cell_type": "code", "execution_count": 16, "id": "4ef3c71c", "metadata": { "execution": { "iopub.execute_input": "2025-01-31T05:09:46.900877Z", "iopub.status.busy": "2025-01-31T05:09:46.900591Z", "iopub.status.idle": "2025-01-31T05:09:46.911912Z", "shell.execute_reply": "2025-01-31T05:09:46.911280Z" }, "papermill": { "duration": 0.209255, "end_time": "2025-01-31T05:09:46.913317", "exception": false, "start_time": "2025-01-31T05:09:46.704062", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:09:46] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "from ax.storage.sqa_store.structs import DBSettings\n", "\n", "# URL is of the form \"dialect+driver://username:password@host:port/database\".\n", "db_settings = DBSettings(url=\"sqlite:///foo.db\")\n", "# Instead of URL, can provide a `creator function`; can specify custom encoders/decoders if necessary.\n", "new_ax = AxClient(db_settings=db_settings)" ] }, { "cell_type": "markdown", "id": "63fa32a4", "metadata": { "papermill": { "duration": 0.196189, "end_time": "2025-01-31T05:09:47.305129", "exception": false, "start_time": "2025-01-31T05:09:47.108940", "status": "completed" }, "tags": [] }, "source": [ "When valid `DBSettings` are passed into `AxClient`, a unique experiment name is a required argument (`name`) to `ax_client.create_experiment`. The **state of the optimization is auto-saved** any time it changes (i.e. a new trial is added or completed, etc). \n", "\n", "To reload an optimization state later, instantiate `AxClient` with the same `DBSettings` and use `ax_client.load_experiment_from_database(experiment_name=\"my_experiment\")`." ] }, { "cell_type": "markdown", "id": "d0eec69a", "metadata": { "papermill": { "duration": 0.198951, "end_time": "2025-01-31T05:09:47.699973", "exception": false, "start_time": "2025-01-31T05:09:47.501022", "status": "completed" }, "tags": [] }, "source": [ "# Special Cases" ] }, { "cell_type": "markdown", "id": "ca675105", "metadata": { "papermill": { "duration": 0.200825, "end_time": "2025-01-31T05:09:48.099725", "exception": false, "start_time": "2025-01-31T05:09:47.898900", "status": "completed" }, "tags": [] }, "source": [ "**Evaluation failure**: should any optimization iterations fail during evaluation, `log_trial_failure` will ensure that the same trial is not proposed again." ] }, { "cell_type": "code", "execution_count": 17, "id": "aa91bb9e", "metadata": { "execution": { "iopub.execute_input": "2025-01-31T05:09:48.502675Z", "iopub.status.busy": "2025-01-31T05:09:48.502172Z", "iopub.status.idle": "2025-01-31T05:09:58.567901Z", "shell.execute_reply": "2025-01-31T05:09:58.567217Z" }, "papermill": { "duration": 10.269136, "end_time": "2025-01-31T05:09:58.569533", "exception": false, "start_time": "2025-01-31T05:09:48.300397", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:09:58] ax.service.ax_client: Generated new trial 25 with parameters {'x1': 0.0, 'x2': 0.269161, 'x3': 0.681361, 'x4': 0.0, 'x5': 0.105778, 'x6': 0.938284} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:09:58] ax.service.ax_client: Registered failure of trial 25.\n" ] } ], "source": [ "_, trial_index = ax_client.get_next_trial()\n", "ax_client.log_trial_failure(trial_index=trial_index)" ] }, { "cell_type": "markdown", "id": "caed47f9", "metadata": { "papermill": { "duration": 0.196171, "end_time": "2025-01-31T05:09:58.971346", "exception": false, "start_time": "2025-01-31T05:09:58.775175", "status": "completed" }, "tags": [] }, "source": [ "**Adding custom trials**: should there be need to evaluate a specific parameterization, `attach_trial` will add it to the experiment." ] }, { "cell_type": "code", "execution_count": 18, "id": "7b939044", "metadata": { "execution": { "iopub.execute_input": "2025-01-31T05:09:59.363883Z", "iopub.status.busy": "2025-01-31T05:09:59.363350Z", "iopub.status.idle": "2025-01-31T05:09:59.369587Z", "shell.execute_reply": "2025-01-31T05:09:59.369016Z" }, "papermill": { "duration": 0.20437, "end_time": "2025-01-31T05:09:59.370926", "exception": false, "start_time": "2025-01-31T05:09:59.166556", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:09:59] ax.core.experiment: Attached custom parameterizations [{'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9}] as trial 26.\n" ] }, { "data": { "text/plain": [ "({'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9}, 26)" ] }, "execution_count": 18, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.attach_trial(\n", " parameters={\"x1\": 0.9, \"x2\": 0.9, \"x3\": 0.9, \"x4\": 0.9, \"x5\": 0.9, \"x6\": 0.9}\n", ")" ] }, { "cell_type": "markdown", "id": "c7541172", "metadata": { "papermill": { "duration": 0.19591, "end_time": "2025-01-31T05:09:59.762500", "exception": false, "start_time": "2025-01-31T05:09:59.566590", "status": "completed" }, "tags": [] }, "source": [ "**Need to run many trials in parallel**: for optimal results and optimization efficiency, we strongly recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). However, if your use case needs to dispatch many trials in parallel before they are updated with data and you are running into the *\"All trials for current model have been generated, but not enough data has been observed to fit next model\"* error, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`." ] }, { "cell_type": "code", "execution_count": null, "id": "d239849c", "metadata": { "papermill": { "duration": 0.19544, "end_time": "2025-01-31T05:10:00.159261", "exception": false, "start_time": "2025-01-31T05:09:59.963821", "status": "completed" }, "tags": [] }, "outputs": [], "source": [] }, { "cell_type": "markdown", "id": "77aef75f", "metadata": { "papermill": { "duration": 0.196229, "end_time": "2025-01-31T05:10:00.551067", "exception": false, "start_time": "2025-01-31T05:10:00.354838", "status": "completed" }, "tags": [] }, "source": [ "**Nonlinear parameter constraints and/or constraints on non-Range parameters:** Ax parameter constraints can currently only support linear inequalities ([discussion](https://github.com/facebook/Ax/issues/153)). Users may be able to simulate this functionality, however, by substituting the following `evaluate` function for that defined in section 3 above." ] }, { "cell_type": "code", "execution_count": 19, "id": "77c82d9f", "metadata": { "execution": { "iopub.execute_input": "2025-01-31T05:10:00.948255Z", "iopub.status.busy": "2025-01-31T05:10:00.947785Z", "iopub.status.idle": "2025-01-31T05:10:00.952199Z", "shell.execute_reply": "2025-01-31T05:10:00.951534Z" }, "papermill": { "duration": 0.207411, "end_time": "2025-01-31T05:10:00.953522", "exception": false, "start_time": "2025-01-31T05:10:00.746111", "status": "completed" }, "tags": [] }, "outputs": [], "source": [ "def evaluate(parameterization):\n", " x = np.array([parameterization.get(f\"x{i+1}\") for i in range(6)])\n", " # First calculate the nonlinear quantity to be constrained.\n", " l2norm = np.sqrt((x**2).sum())\n", " # Then define a constraint consistent with an outcome constraint on this experiment.\n", " if l2norm > 1.25:\n", " return {\"l2norm\": (l2norm, 0.0)}\n", " return {\"hartmann6\": (hartmann6(x), 0.0), \"l2norm\": (l2norm, 0.0)}" ] }, { "cell_type": "markdown", "id": "26a0fe84", "metadata": { "papermill": { "duration": 0.197316, "end_time": "2025-01-31T05:10:01.347953", "exception": false, "start_time": "2025-01-31T05:10:01.150637", "status": "completed" }, "tags": [] }, "source": [ "For this to work, the constraint quantity (`l2norm` in this case) should have a corresponding outcome constraint on the experiment. See the outcome_constraint arg to ax_client.create_experiment in section 2 above for how to specify outcome constraints.\n", "\n", "This setup accomplishes the following:\n", "1. Allows computation of an arbitrarily complex constraint value.\n", "2. Skips objective computation when the constraint is violated, useful when the objective is relatively expensive to compute.\n", "3. Constraint metric values are returned even when there is a violation. This helps the model understand + avoid constraint violations." ] }, { "cell_type": "markdown", "id": "a9f4dea7", "metadata": { "papermill": { "duration": 0.19731, "end_time": "2025-01-31T05:10:01.741913", "exception": false, "start_time": "2025-01-31T05:10:01.544603", "status": "completed" }, "tags": [] }, "source": [ "# Service API Exceptions Meaning and Handling\n", "[**`DataRequiredError`**](https://ax.dev/api/exceptions.html#ax.exceptions.core.DataRequiredError): Ax generation strategy needs to be updated with more data to proceed to the next optimization model. When the optimization moves from initialization stage to the Bayesian optimization stage, the underlying BayesOpt model needs sufficient data to train. For optimal results and optimization efficiency (finding the optimal point in the least number of trials), we recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). Therefore, the correct way to handle this exception is to wait until more trial evaluations complete and log their data via `ax_client.complete_trial(...)`. \n", "\n", "However, if there is strong need to generate more trials before more data is available, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`. With this setting, as many trials will be generated from the initialization stage as requested, and the optimization will move to the BayesOpt stage whenever enough trials are completed." ] }, { "cell_type": "markdown", "id": "1e64fa02", "metadata": { "papermill": { "duration": 0.196841, "end_time": "2025-01-31T05:10:02.135620", "exception": false, "start_time": "2025-01-31T05:10:01.938779", "status": "completed" }, "tags": [] }, "source": [ "[**`MaxParallelismReachedException`**](https://ax.dev/api/modelbridge.html#ax.modelbridge.generation_strategy.MaxParallelismReachedException): generation strategy restricts the number of trials that can be ran simultaneously (to encourage sequential optimization), and the parallelism limit has been reached. The correct way to handle this exception is the same as `DataRequiredError` – to wait until more trial evluations complete and log their data via `ax_client.complete_trial(...)`.\n", " \n", "In some cases higher parallelism is important, so `enforce_sequential_optimization=False` kwarg to AxClient allows to suppress limiting of parallelism. It's also possible to override the default parallelism setting for all stages of the optimization by passing `choose_generation_strategy_kwargs` to `ax_client.create_experiment`:" ] }, { "cell_type": "code", "execution_count": 20, "id": "cbbacb0e", "metadata": { "execution": { "iopub.execute_input": "2025-01-31T05:10:02.532587Z", "iopub.status.busy": "2025-01-31T05:10:02.532146Z", "iopub.status.idle": "2025-01-31T05:10:02.545020Z", "shell.execute_reply": "2025-01-31T05:10:02.544487Z" }, "papermill": { "duration": 0.212743, "end_time": "2025-01-31T05:10:02.546320", "exception": false, "start_time": "2025-01-31T05:10:02.333577", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:10:02] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:10:02] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:10:02] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter y. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:10:02] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='y', parameter_type=FLOAT, range=[0.0, 15.0])], parameter_constraints=[]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:10:02] ax.modelbridge.dispatch_utils: Using Models.BOTORCH_MODULAR since there is at least one ordered parameter and there are no unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:10:02] ax.modelbridge.dispatch_utils: Calculating the number of remaining initialization trials based on num_initialization_trials=None max_initialization_trials=None num_tunable_parameters=2 num_trials=None use_batch_trials=False\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:10:02] ax.modelbridge.dispatch_utils: calculated num_initialization_trials=5\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:10:02] ax.modelbridge.dispatch_utils: num_completed_initialization_trials=0 num_remaining_initialization_trials=5\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:10:02] ax.modelbridge.dispatch_utils: `verbose`, `disable_progbar`, and `jit_compile` are not yet supported when using `choose_generation_strategy` with ModularBoTorchModel, dropping these arguments.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 01-31 05:10:02] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+BoTorch', steps=[Sobol for 5 trials, BoTorch for subsequent trials]). Iterations after 5 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client = AxClient()\n", "ax_client.create_experiment(\n", " parameters=[\n", " {\"name\": \"x\", \"type\": \"range\", \"bounds\": [-5.0, 10.0]},\n", " {\"name\": \"y\", \"type\": \"range\", \"bounds\": [0.0, 15.0]},\n", " ],\n", " # Sets max parallelism to 10 for all steps of the generation strategy.\n", " choose_generation_strategy_kwargs={\"max_parallelism_override\": 10},\n", ")" ] }, { "cell_type": "code", "execution_count": 21, "id": "0009fabb", "metadata": { "execution": { "iopub.execute_input": "2025-01-31T05:10:02.940809Z", "iopub.status.busy": "2025-01-31T05:10:02.940276Z", "iopub.status.idle": "2025-01-31T05:10:02.945116Z", "shell.execute_reply": "2025-01-31T05:10:02.944499Z" }, "papermill": { "duration": 0.203913, "end_time": "2025-01-31T05:10:02.946421", "exception": false, "start_time": "2025-01-31T05:10:02.742508", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "[(5, 10), (-1, 10)]" ] }, "execution_count": 21, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism() # Max parallelism is now 10 for all stages of the optimization." ] } ], "metadata": { "kernelspec": { "display_name": "Python 3 (ipykernel)", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.10.16" }, "papermill": { "default_parameters": {}, "duration": 154.018579, "end_time": "2025-01-31T05:10:03.949889", "environment_variables": {}, "exception": null, "input_path": "/tmp/tmp.8SPGnWMU26/Ax-main/tutorials/gpei_hartmann_service.ipynb", "output_path": "/tmp/tmp.8SPGnWMU26/Ax-main/tutorials/gpei_hartmann_service.ipynb", "parameters": {}, "start_time": "2025-01-31T05:07:29.931310", "version": "2.6.0" } }, "nbformat": 4, "nbformat_minor": 5 }